Original Post
I'm trying to solve an odd little problem and would like some feedback on my proposed solution. Given a large collection of files on multiple disk drives, I need to present a single point-of-access for the files as if they were on a single volume. I'm not allowed to use RAID to achieve this. The directory structure needs to be maintained, but there are no duplicate directories across different drives; the complete contents of any given directory are all on the same disk and no other disk contains a directory with the same name. Once created files will not be removed unless the entire dataset is scrapped, but new files may be added. After a quick bit of research my proposed solution is to create a utility that does the following:
- Duplicate the complete directory structure from all of the disks on a single volume; this will be done on an additional disk, not one of the ones containing the data.
- Populate the newly created directory structure with Symbolic Links to the original files.
- Given the above has already been done, the utility will search through the existing set of files and symlinks and create additional links to any newly added files.