SYSTEM AND METHOD FOR HIERARCHICAL STORAGE MANAGEMENT USING SHADOW VOLUMES

Abstract

Data partitioned onto two or more storage devices is presented to a user as if the data resided on a single storage area. Data is divided between the storage areas based on policies. Data on the primary storage can utilize frequent back up or other storage management to ensure the accuracy of the data. The data on the secondary storage can employ other data management than the data management for the primary storage. The subdirectory structure is replicated in each area so a data file can be located in either physical area. This allows data files to migrate between the storage areas based on policy.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a block diagram of a computer system including a file system interface to present to a client a union of files a primary storage device and a secondary storage device, according to an embodiment of the invention.

FIG. 2 shows the file system interface of FIG. 1 combining and presenting to a client files in a directory on the primary storage and the directory on the secondary storage.

FIG. 3 shows a policy manager with types of migration and retrieval policies used to move files between the primary storage and secondary storage of FIG. 1.

FIG. 4 is a flowchart of the process of the file system interface combining files from the primary storage and the secondary storage of FIG. 1 in response to a client request.

FIG. 5 shows a flowchart of the process of migrating files from the primary storage to the secondary storage of FIG. 1.

FIG. 6 shows a flowchart of the process of retrieving files from the secondary storage to the primary storage of FIG. 1.

Claims

1. A system, comprising: a computer;a primary storage;a first file system installed on the primary storage, the first file system including a first directory tree structure;a second storage;a second file system installed on the second storage, the second file system including a second directory tree structure;a means for synchronizing the first directory tree structure with the secondary directory tree structure;a receiver to receive a request from a client for a list of files in a directory;a file access module to directly access the first file system and identify a first list of files on the first storage and to directly access the second file system and identify a second list of file on the second storage;a combiner to combine the first list of files and the second list of files into a combined list; anda transmitter to transmit the combined list to the client.

2. A system according to claim 1, further comprising a file mover to move a file from the primary storage to the second storage according to a migration policy.

3. A system according to claim 2, wherein the migration policy includes a file inactivity policy.

4. A system according to claim 2, wherein the migration policy includes a file type policy.

5. A system according to claim 2, wherein the migration policy includes a file owner policy.

6. A system according to claim 1, further comprising a file retriever to retrieve the file from the second storage back to the primary storage according to a reverse migration policy.

7. A system according to claim 1, wherein: the system further comprises: a third storage; anda third file system installed on the third storage;the file system access module is operative to access the third file system and identify a third list of files; andthe combiner is operative to combine the third list of files with the combined list.

8. A system according to claim 1, further comprising a directory interface to enable the client to access a file in the second list of files without retrieving the file from the second storage back to primary storage.

9. A system according to claim 1, wherein the means for synchronizing the first directory tree structure with the secondary directory tree structure includes an access control list copier to copy an access control list from the primary storage to the second storage.

10. A computer-implemented method of using shadow volumes to manage file storage, comprising: synchronizing a first directory tree structure with a second directory tree structure, the first directory tree structure organizing a first file system on a primary storage, and the second directory tree structure organizing a second file system on a second storage;receiving a client request for a list of files in a directory;accessing the first file system on the primary storage;identifying a first list of files in the directory on the primary storage;accessing the second file system on the second storage;identifying a second list of files in the directory on the second storage;combining the first list of files and the second list of files into a combined list; andtransmitting the combined list to the client.

11. A method according to claim 10, wherein receiving a client request includes intercepting a file system request from the client for the list of files in the directory.

12. A method according to claim 10, further comprising: accessing a migration policy;determining if a file in a directory on the primary storage satisfies the migration policy; andmoving the file from the directory on the primary storage to a corresponding directory on the secondary storage if the file satisfies the migration policy.

13. A method according to claim 12, wherein: accessing a migration policy includes accessing a file inactivity policy; anddetermining if the file satisfies the migration policy includes determining if the file has not been opened for an amount of time specified in the file inactivity policy.

14. A method according to claim 12, wherein: accessing a migration policy includes accessing a file type policy; anddetermining if the file satisfies the migration policy includes determining if the file is a file type specified by the file type policy.

15. A method according to claim 12, wherein: accessing a migration policy includes accessing a file owner policy; anddetermining if the file satisfies the migration policy includes determining if the file is owned by a file owner specified in the file owner policy.

16. A method according to claim 10, wherein synchronizing a first directory tree structure with a second directory tree structure includes synchronizing an access control list on the primary storage with an access control list on the second storage.

17. A method according to claim 10, further comprising: accessing a reverse migration policy;determining if the file on the secondary storage satisfies the reverse migration policy; andmoving the file from the second storage back to the directory on the primary storage if the file satisfies the reverse migration policy.

18. A method according to claim 10, wherein: the method further comprises: accessing a third file system on a third storage; andidentifying a third list of files in the directory on the third storage; andcombining the first list of files and the second list of files into a combined list includes combining the first list of files, the second list of files, and the third list of files into the combined list.

19. An article, comprising a storage medium, said storage medium having stored thereon instructions, that, when executed by a machine, result in: synchronizing a first directory tree structure with a second directory tree structure, the first directory tree structure organizing a first file system on a primary storage, and the second directory tree structure organizing a second file system on a second storage;receiving a client request for a list of files in a directory;accessing the first file system on the primary storage;identifying a first list of files in the directory on the primary storage;accessing the second file system on the second storage;identifying a second list of files in the directory on the second storage;combining the first list of files and the second list of files into a combined list;transmitting the combined list to the client.

20. An article according to claim 19, wherein receiving a client request includes intercepting a file system request from the client for the list of files in the directory.

21. An article according to claim 19, further comprising: accessing a migration policy;determining if a file in a directory on the primary storage satisfies the migration policy; andmoving the file from the directory on the primary storage to a corresponding directory on the secondary storage if the file satisfies the migration policy.

22. An article according to claim 21, wherein: accessing a migration policy includes accessing a file inactivity policy; anddetermining if the file satisfies the migration policy includes determining if the file has not been opened for an amount of time specified in the file inactivity policy.

23. An article according to claim 21, wherein: accessing a migration policy includes accessing a file type policy; anddetermining if the file satisfies the migration policy includes determining if the file is a file type specified by the file type policy.

24. An article according to claim 21, wherein: accessing a migration policy includes accessing a file owner policy; anddetermining if the file satisfies the migration policy includes determining if the file is owned by a file owner specified in the file owner policy.

25. An article according to claim 19, wherein synchronizing a first directory tree structure with a second directory tree structure includes synchronizing an access control list on the primary storage with an access control list on the second storage.

26. An article according to claim 19, further comprising: accessing a reverse migration policy;determining if the file on the secondary storage satisfies the reverse migration policy; andmoving the file from the second storage back to the directory on the primary storage if the file satisfies the reverse migration policy.

27. An article according to claim 26, further comprising: accessing a third file system on a third storage;identifying a third list of files in the directory on the third storage; andcombining the third list of files into the combined list with the first list of file and the second list of files.