Extending cluster allocations in an extensible file system

Abstract

An extensible file system format for portable storage media is provided. The extensible file system format includes the specification of primary and secondary directory entry types that may be custom defined. The primary and secondary directory entry types can be further classified as critical and benign directory entries. The directory entry types can define whether a cluster chain corresponding to a file can be contiguously allocated.

Description

BACKGROUND

Generally described, there are a number of portable computing devices, such as digital still cameras, digital video cameras, media players, mobile phones, mobile computing devices, personal digital assistants, and the like that maintain data on a storage media, such as a portable storage media. The continued development of more complex portable computing devices and larger storage capacity portable storage media places a greater demand for flexibility on the file system format used on the storage media. Current file system format approaches can become deficient in that they do not provide adequate flexibility for increasing storage size capacities and/or storage media applications.

In one embodiment, extensible file systems may be utilized in these embodiments to allow for increased storage size capacities and application to storage media application. In one embodiment of an extensible file system, data may be stored in allocated clusters within a file system. As the amount of data increases, the number of allocated clusters may also increase. Accordingly, in these embodiments, each new allocated cluster would likely be added as a new entry in the file system, such as an additional entry in a file allocation table. The additional allocation and management of each separate cluster in an allocation can become inefficient for file system management.

SUMMARY

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This summary is not intended to identify key features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

An extensible file system format for portable storage media is provided. The extensible file system format includes the specification of primary and secondary directory entry types that may be custom defined. The primary and secondary directory entry types can be further classified as critical and benign directory entries. The directory entry types can define whether a cluster chain corresponding to a file can be contiguously allocated.

A computer-readable medium having computer-executable components for storing data is provided. The components include a boot parameters component for specifying boot parameters for a file system. The components also include a file allocation table component for defining a file allocation table associated with the file system. The components further include two or more primary directory entry components for specifying data in a root directory of the file system. At least one primary directory entry component includes a flag corresponding to an indication of a contiguous cluster chain. Finally, the components include at least one secondary entry component corresponding to the primary directory entry component and defining meta data associated with the primary directory entry component.

In accordance with another aspect, a method for managing data organized into a plurality of clusters is provided. In accordance with the method, a request for an extension of a plurality of clusters is obtained. A determination is made whether the set of clusters can be contiguously allocated. If the set of clusters can be contiguously allocated, a cluster chain size allocation is updated in accordance with the size of the request for the extension. If the set of clusters cannot be contiguously allocated, entries are made in the file allocation table for each cluster in the cluster chain.

DESCRIPTION OF THE DRAWINGS

The foregoing aspects and many of the attendant advantages of this invention will become more readily appreciated as the same become better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein:

FIGS. 1A-1C are block diagrams illustrative of an illustrative environment including a portable computing device and a storage device implementing the extensible file system format in accordance with an aspect of the present invention;

FIG. 2 is a block diagram illustrative of various volume layout components corresponding to an extensible file system format in accordance with an aspect of the present invention;

FIG. 3 is a block diagram illustrative of an extensible file system directory structures including primary and secondary directory entry structures in accordance with an aspect of the present invention;

FIG. 4 is a block diagram illustrative of data components for implementing a boot process block in an extensible file system format in accordance with an aspect of the present invention;

FIG. 5 is a block diagram illustrative of data components for implementing directory entries in an extensible file system format in accordance with an aspect of the present invention

FIG. 6 is a block diagram illustrative of data components for implementing a file name and extensions in an extensible file system format in accordance with an aspect of the present invention;

FIG. 7 is a block diagram illustrative of data components for implementing a volume identifier in an extensible file system format in accordance with an aspect of the present invention;

FIG. 8 is a block diagram illustrative of data components for implementing an extensible directory entry in an extensible file system format in accordance with an aspect of the present invention;

FIG. 9 is a block diagram illustrative of data components for implementing an extensible directory entry in an extensible file system format in accordance with an aspect of the present invention;

FIG. 10 is a block diagram illustrative of data components for implementing an access control list in an extensible file system format in accordance with an aspect of the present invention;

FIG. 11 is a flow diagram illustrative of a cluster chain extension routine for an extensible file system format in accordance with an aspect of the present invention;

FIG. 12 is a flow diagram of a non-contiguous cluster allocation sub-routine for an extensible file system format in accordance with an aspect of the present invention; and

FIG. 13 is a flow diagram of a cluster chain deletion routine for an extensible file system format in accordance with an aspect of the present invention.

DETAILED DESCRIPTION

Generally described, the present invention relates to an extensible file system format and various processes associated with the extensible file system format. In an illustrative embodiment, the extensible file system format corresponds to an extensible file system format for portable storage media and various processes associated with the extensible file system format on the portable storage media. More specifically, in an embodiment, processes and data structures are provided for facilitating the storage and management of file data in contiguous data clusters. Although the present invention will be described with regard to a portable storage media file system format, one skilled in the relevant art will appreciate that the disclosed embodiments are illustrative in nature and should not be construed as limiting. Additionally, one skilled in the relevant art will appreciate that the data structures and data layouts used in the illustrative examples may require additional information related to performance, security, and the like.

FIGS. 1A-1C are block diagrams illustrative of various operating environments 100 for the extensible file system format of the present invention. With reference to FIG. 1A, in an illustrative embodiment, the extensible file system format is utilized to store data from a computing device, such as a mobile computing device 102, and a storage media, such as a portable storage media 104. In an illustrative embodiment, the mobile computing device 102 can correspond to any one of a variety of computing devices, including but not limited to, portable computing devices, mobile telephones, personal digital assistants, music players, media players. The portable storage media can also include, but is not limited to, hard drives, flash media, micro-drives and other storage media. In an illustrative embodiment, the extensible file system on the portable storage media 104 does not have to include any type of executable or readable software components, such as an operating environment, utilized by the mobile computing device 102. Alternatively, the extensible file system on the portable storage media 104 may include executable or readable software components used by the mobile device 102.

In an illustrative embodiment, the mobile computing device 102 may be in communication with other computing devices for collecting/exchanging data to be stored on the portable storage media 104. With reference to FIG. 1B, the mobile computing device 102 may be in direct communication with another computing device 106 and storage media 108. In an illustrative embodiment, the direct communication can correspond to various wired and wireless communication methods. In an illustrative embodiment, the other storage media 108 is not required to be formatted in accordance with the extensible file system format of the present invention. With reference to FIG. 1C, in a similar manner, the mobile computing device 102 may also be in communication with another computing device 110 and storage media 112, via a network connection. In an illustrative embodiment, the network connection can correspond to local area network (LAN) and wide area network (WAN) connections.

With reference now to FIG. 2, an illustrative embodiment volume layout 200 for an extensible file system format will be described. The volume layout 200 includes a boot parameters component 202 that include various information related to a description of the file system parameters of the partition. In an illustrative embodiment, the boot parameters component 202 can include code for bootstrapping from a defined partition, fundamental file system parameters for the defined partition, and various error checking information. A data structure for defining at least a portion of the boot parameters will be described below with regard to FIG. 4.

The volume layout 200 also includes an extensible parameters component, designated as OEM parameters 204, that define various additional data structures used in conjunction with the file system. In an illustrative embodiment, an original equipment manufacturer (OEM) may specify various extensible data structures, such as performance parameters for a storage medium, that can be defined at time of manufacture. The volume layout 200 can further include a file allocation table component 206 that defines file and directory allocations. In an illustrative embodiment, each entry in the file allocation table component 206 corresponds to a 32-bit entry that represents an allocated cluster, an unallocated cluster or an unusable cluster. As will be explained in greater detail below, in an illustrative embodiment, contiguously allocated clusters will not require a separate entry for each allocated cluster in the file allocation table component 206. The volume layout 200 can still further include series of file data components 208A-208X that correspond to the data stored according to the file system format. Various data structures for defining a portion of the file data components 208A-208X will be defined with regard to FIGS. 3-10.

Turning now to FIG. 3, in one aspect, the file data components 208 may include one or more directory entries according to a directory structure 300. In an illustrative embodiment, the directory structure 300 is organized into primary directory entries 302 and secondary directory entries 304. Each directory entry in the primary and secondary entries is typed. For example, in an illustrative embodiment, type values for the primary and secondary directory entries can correspond to a range of 1-255. Primary directory entries 302 correspond to the entries in the root directory of the file system. Secondary directory entries 304 follow a primary directory entry and are associated with the primary directory entry. Secondary directory entries extend the metadata associated with the correlated primary directory entry.

With continued reference to FIG. 3, in an illustrative embodiment, the primary directory entries 302 can be further classified as critical primary directory entries 306 and benign primary directory entries 308. Critical primary directory entries 306 define potentially different formats for each directory entry. In an illustrative embodiment, an operating environment will not mount a volume corresponding to the extensible file system format with an unknown critical primary directory entry, as will be described below. Examples of known primary directory entries 306 can include allocation bitmaps, up-case tables, volume labels, encryption keys, and normal directory entries. Benign primary directory entries 308 also define potential different formats for each directory entry, but can be ignored by the file system if a particular benign primary directory entry is not understood. Benign primary directory entries 308 can be associated with another cluster chain in the volume and can be contiguously allocated. For example, a contiguously allocated benign primary directory entry can be identified through the setting of a corresponding flag. Additionally, benign primary directory entries 308 can also be associated with a number of secondary directory entries 304.

In a manner similar to primary directory entries 302, secondary directory entries 304 may also be further classified as critical secondary directory entries 310 and benign secondary directory entries 312. As described above, the critical secondary directory entries 310 and benign secondary directory entries 312 are associated with a benign primary directory entry and extend the metadata associated with the primary directory entry. Both the critical secondary directory entries 310 and the benign secondary directory entries 312 can be associated with another cluster chain in the volume and can be contiguously allocated.

To mount a volume corresponding to the extensible file system format, the file system implements a mount volume procedure. In an illustrative embodiment, the mount volume procedure attempts to look at a version number for the volume. If the version number is not understood (e.g., the version number is higher), the volume will not be mounted. During a normal directory enumeration, any critical primary directory entries not known by the file system will prevent the volume from being mounted. Thereafter, various user-initiated processes, such as a file open, will cause the file system to enumerate the secondary directory entries. If the critical secondary directory entries 310 are not known by a file system, the entire directory entry will be skipped. Additionally, if benign secondary directory entries 312 are not known by the file system, the particular unknown benign secondary directory entry will be ignored.

With reference now to FIG. 4, a block diagram illustrative of data components 400 for implementing a boot process block in the boot parameters component 202 (FIG. 2) will be described. The data components 400 include an OEM name component 402 for specifying a name for the file system format of the storage media. The data components 400 also include a data size descriptor component 404 for specifying various characteristics of the data stored in the file system. For example, the data size descriptor component 404 can specify a count of bytes per sector, a number of sectors per allocation unit, a file allocation table (“FAT”) table offset, and a count of sectors for all data structures. The data components include an active FAT flags component 406 for specifying a number of active FATs on the file system. In an illustrative embodiment, a file system may support multiple FATs for utilization with some operating system environments. The data components 400 can further include a volume identification component 408 for identifying a volume serial number and/or version number. Still further, the data components 400 can include a file system type for specifying the file system format for the file system. One skilled in the relevant art will appreciate that the data components 400 can include a number of additional/alternative rows for implementing the above-identified components 402-410 and additional components.

Turning now to FIG. 5, a block diagram illustrative of data components 500 for implementing directory entries in an extensible file system format will be described. The data components 500 include an in use component 502 for specifying whether the particular directory entry is in use. In an illustrative embodiment, the high bit of the data components will be set to “1” if the directory entry is in use. The data components 500 further include a type designation component 504 for specifying that the directory entry is associated with a normal directory entry. The data components 500 further include a secondary directory entries component 504 for specifying a number of secondary entries associated with the normal directory entry. The data components 500 also include a file attributes component 508 for specifying various file system attributes for the directory entry. Still further, the data components 500 include a time component 510 for specifying various time information such as a creation timestamp, modification time stamp and other time information. Additionally, the data components 500 further include a time zone component 512 for specifying a time zone for the last created time stamp. One skilled in the relevant art will appreciate that the data components 500 can include a number of additional/alternative rows for implementing the above-identified components 502-512 and additional components.

Turning now to FIG. 6, a block diagram illustrative of data components 600 for implementing a file name and extensions will be described. The data components 600 include an in use component 602 for specifying whether the particular directory entry is in use. In an illustrative embodiment, the high bit of the data components will be set to “1” if the directory entry is in use. The data components 600 further include a type designation component 604 for specifying that the directory entry is associated with a file system name. The data components further include a file name length component 606 and a file name hash component 608. The utilization of the file name hash component 608 will be described below. The data components 600 also include a file name component 610 for specifying the file name. One skilled in the relevant art will appreciate that the data components 600 can include a number of additional/alternative rows for implementing the above-identified components 602-610 and additional components. Additionally, file name directory entries may be extended by secondary directory entries.

Turning now to FIG. 7, a block diagram illustrative of data components 700 for implementing a volume identifier in an extensible file system format is provided. The data components 700 include an in use component 702 for specifying whether the particular directory entry is in use. In an illustrative embodiment, the high bit of the data components will be set to “1” if the directory entry is in use. The data components 700 further include a type designation component 704 for specifying that the directory entry is associated with a volume identifier. The data components 700 further include a secondary directory entries component 706 for specifying a number of secondary entries associated with the volume identifier. The data components 700 also include a volume identifier 708, such as a global unique identifier. One skilled in the relevant art will appreciate that the data components 700 can include a number of additional/alternative rows for implementing the above-identified components 702-708 and additional components. Additionally, in an illustrative embodiment, the data components 700 correspond to a benign directory entry that can be ignored by a file system that does not support volume identifiers.

With reference now to FIGS. 8 and 9, in an illustrative embodiment, parties, such as an OEM, may be able to define specific benign primary directory entry types 308 and benign secondary directory entry types 312. As discussed above, in the event the file system would not recognize or understand either the specific benign primary directory entry types 308 or benign secondary directory entry types 312, the file system could ignore the defined directory entry types.

With reference to FIG. 8, a block diagram illustrative of data components 800 for implementing an extensible benign primary directory entry 308 in an extensible file system format will be described. The data components 800 include an in use component 802 for specifying whether the particular directory entry is in use. In an illustrative embodiment, the high bit of the data components will be set to “1” if the directory entry is in use. The data components 800 further include a type designation component 804 for specifying that the directory entry is a benign primary directory entry. The data components 800 further include a secondary directory entries component 806 for specifying a number of secondary entries associated with the volume identifier. The data components 800 also include a volume identifier 808, such as a global unique identifier. The data components 800 can further include a flag component 810 that corresponds to an indication of whether contiguous allocation of a cluster chain is to be implemented. The data components 800 can still further include additional information 812, such as verification information and a starting cluster. As will be explained in greater detail below, cluster chains utilizing contiguous allocation can be defined according to cluster chain size and a starting cluster for the first cluster in the cluster chain. One skilled in the relevant art will appreciate that the data components 800 can include a number of additional/alternative rows for implementing the above-identified components 802-812 and additional components.

With reference to FIG. 9, a block diagram illustrative of data components 900 for implementing a benign secondary directory entry in an extensible file system format will be described. The data components 900 include an in use component 902 for specifying whether the particular directory entry is in use. In an illustrative embodiment, the high bit of the data components will be set to “1” if the directory entry is in use. The data components 900 further include a type designation component 904 for specifying that the directory entry is a benign primary directory entry. The data components 900 further include a secondary directory entries component 906 for specifying a number of secondary entries associated with the volume identifier. The data components 900 also include a volume identifier 908, such as a global unique identifier. The data components 900 can further include a flag component 910 that corresponds to an indication of whether contiguous allocation of a cluster chain is to be implemented. The data components 900 can further include additional information 912, such as verification information and a starting cluster. One skilled in the relevant art will appreciate that the data components 900 can include a number of additional/alternative rows for implementing the above-identified components 902-912 and additional components.

In an illustrative embodiment, a benign primary directory entry and/or secondary directory entries may be associated with access control list (ACL) information. FIG. 10 is a block diagram illustrative of data components 1000 for implementing an access control list in an extensible file system format. The data components 1000 include an in use component 1002 for specifying whether the particular directory entry is in use. In an illustrative embodiment, the high bit of the data components will be set to “1” if the directory entry is in use. The data components 1000 further include a type designation component 1004 for specifying that the directory entry is an ACL directory entry. The data components 1000 further include a number of ACL fields 1006, such as ACL flags, pointers to ACL databases, and the like. One skilled in the relevant art will appreciate that the data components 1000 can include a number of additional/alternative rows for implementing the above-identified components 1002-1006 and additional components.

In accordance with an aspect of the invention, the utilization of contiguously allocated clusters in a cluster chain mitigates the need for traversing the file allocation table component 206 to identify the clusters in the cluster chain. Because the clusters will be contiguously allocated, each cluster in the chain can be identified with knowledge of the starting location of the first cluster in the chain and the total cluster chain size. For example, assume that each cluster has a size of 4K of data and that the total allocation for a cluster chain is 18 K of data. The cluster chain will require five clusters to capture the data. If the first cluster begins at cluster position 40, then cluster positions 41, 42, 43 and 44 would be taken by the remaining four contiguously allocated clusters in the cluster chain.

In addition to the storage and processing of contiguously allocated clusters, additional processes may be utilized in the extension of a cluster chain. With reference now to FIG. 11, a cluster chain extension routine 1100 for an extensible file system format will be described. At block 1102, a request for extending or modifying the cluster chain is obtained. In an illustrative embodiment, the request for the extension of the cluster chain can correspond to the addition, substitution, modification or rewriting of data.

At decision block 1104, a test is conducted to determine whether the contiguous allocation is available for the cluster chain associated with the request. In an illustrative embodiment, the determination of whether contiguous allocation is available can correspond to a determination of whether the first cluster in the cluster chain includes the contiguous allocation flag set in the flag components (810 or 910). In another embodiment, the determination of whether contiguous allocation is available can correspond to a determination of whether additional contiguous clusters are available. In this embodiment, the last cluster in the cluster chain can be located by identifying the first cluster in the cluster chain and determining the cluster chain size. The determination can check whether contiguous clusters are available, such as by referring to the allocation bitmap.

If contiguous allocation is not available, at block 1106, the entire cluster chain is subject to a noncontiguous allocation. A subroutine for allocating a cluster chain in a noncontiguous manner will be described below with regard to FIG. 12. Alternatively, if contiguous allocation is available, at block 1108, the cluster chain size is updated to reflect the additional cluster. The routine 1100 terminates at block 1110.

With reference now to FIG. 12, a subroutine for making a noncontiguous allocation of a cluster chain (corresponding to block 1106) will be described. At block 1202, an entry for each existing cluster in the cluster chain is created in the FAT table component 206. Each cluster will also have the flag component 806/906 set to indicate no contiguous allocations. At block 1204, an entry for each cluster to be added will be created in the FAT table component 206. At block 1206, the bitmap allocation will be updated to reflect that allocation of each cluster in the cluster chain. At block 1208, the subroutine returns.

With reference now to FIG. 13, a routine 1300 for cluster chain deletion will be described. At block 1302, a request for extending or modifying the cluster chain is obtained. In an illustrative embodiment, the request for the extension of the cluster chain can correspond to the substitution, modification or rewriting of data. At block 1304, the starting cluster associated with the identified cluster chain is identified. Additionally, the allocation size of the cluster chain is also obtained. At block 1306, the FAT allocation bitmap entries for each cluster corresponding to the allocated cluster chain are cleared. At block 1308, the routine 1300 terminates. In an illustrative embodiment, the bitmap entries for each cluster can be cleared without having to traverse the FAT entry for each allocated cluster in the cluster chain.

While illustrative embodiments have been illustrated and described, it will be appreciated that various changes can be made therein without departing from the spirit and scope of the invention.

Claims

1. In a computing device that implements a file system for storing data on a storage medium, the storage medium comprising a plurality of clusters, a method comprising: storing, on the storage medium, information defining a file allocation table associated with the file system;storing, on the storage medium, an allocation bitmap comprising, for each cluster of the storage medium, an entry that indicates whether the cluster is allocated or is available for storage;storing, on the storage medium, a directory entry specifying information concerning data in a directory of the file system, wherein the directory entry comprises a flag that indicates that the data is stored in a chain of contiguous clusters, the directory entry further comprising information specifying a starting cluster of the chain of contiguous clusters and information indicative of a size of the chain of contiguous clusters;obtaining a request to delete the data;determining from the flag in the directory entry for the data that the data is stored in the chain of contiguous clusters;identifying the contiguous clusters of the chain based on the information from the directory entry specifying the starting cluster of the chain and indicative of the size of the chain, without traversing the file allocation table; andupdating the entries of the allocation bitmap corresponding to each of the identified clusters of the chain of contiguous clusters to indicate that each cluster is available for storage.

2. A computing device that implements a file system for storing data on a storage medium, the storage medium comprising a plurality of clusters, the computing device configured to: store, on the storage medium, information defining a file allocation table associated with the file system;store, on the storage medium, an allocation bitmap comprising, for each cluster of the storage medium, an entry that indicates whether the cluster is allocated or is available for storage;store, on the storage medium, a directory entry specifying information concerning data in a directory of the file system, wherein the directory entry comprises a flag that indicates that the data is stored in a chain of contiguous clusters, the directory entry further comprising information specifying a starting cluster of the chain of contiguous clusters and information indicative of a size of the chain of contiguous clusters;obtain a request to delete the data;determine from the flag in the directory entry for the data that the data is stored in the chain of contiguous clusters;identify the contiguous clusters of the chain based on the information from the directory entry specifying the starting cluster of the chain and indicative of the size of the chain, without traversing the file allocation table; andupdate the entries of the allocation bitmap corresponding to each of the identified clusters of the chain of contiguous clusters to indicate that each cluster is available for storage.

3. The method recited in claim 1, further comprising: storing, on the storage medium, another directory entry specifying information concerning other data in the directory of the file system, wherein the another directory entry comprises a flag that indicates that the other data is stored in one or more clusters of the storage medium that are not contiguous;obtaining a request to delete the other data;determining from the flag in the another directory entry that the other data is not stored in contiguous clusters;identifying the one or more non-contiguous clusters in which the other data is stored by traversing entries of the file allocation table corresponding to each of the one or more non-contiguous clusters; andupdating the entries of the allocation bitmap corresponding to each of the identified one or more non-contiguous clusters to indicate that each cluster is available for storage.

4. The method recited in claim 1, the updating the corresponding entries of the allocation bitmap comprising clearing the entries.

5. The method recited in claim 1, the identifying the contiguous clusters of the chain being further based on a size of each cluster.

6. The method recited in claim 1, the flag comprising a single bit.

7. The method recited in claim 1, the storage medium comprising a portable storage medium.

8. The computing device of claim 2, further configured to: store, on the storage medium, another directory entry specifying information concerning other data in the directory of the file system, wherein the another directory entry comprises a flag that indicates that the other data is stored in one or more clusters of the storage medium that are not contiguous;obtain a request to delete the other data;determine from the flag in the another directory entry that the other data is not stored in contiguous clusters;identify the one or more non-contiguous clusters in which the other data is stored by traversing entries of the file allocation table corresponding to each of the one or more non-contiguous clusters; andupdate the entries of the allocation bitmap corresponding to each of the identified one or more non-contiguous clusters to indicate that each cluster is available for storage.

9. The computing device of claim 2, the computing device configured to update the corresponding entries of the allocation bitmap by clearing the entries.

10. The computing device of claim 2, the computing device configured to identify the contiguous clusters of the chain based further on a size of each cluster.

11. The computing device of claim 2, the flag comprising a single bit.

12. The computing device of claim 2, the storage medium comprising a portable storage medium.