Massive amounts of data storage may be needed for many emerging and existing applications. For example, video-on-demand applications may provide access to hundreds or thousands of movies for hundreds or thousands of users simultaneously. These video-on-demand applications may require vast amounts of digital storage, fast access, 24 hours-per-day and 7 days per week (24/7) availability and uptime, and substantial bandwidth. Modern supercomputers may also need these features, and may require extraordinary data integrity, error checking, and error correction.
One traditional solution to provide massive amounts of data storage is a conventional rack-mount disk-drive enclosure, which may arrange a number of disk drives (e.g. 3 to 14) in a removable carrier. These disk-drive enclosures may often be installed in a preexisting infrastructure that may use a number of different transport protocols to transfer data. However, traditional disk-drive enclosures may only support a single protocol and may require a protocol converting switch or other modifications to work with a preexisting infrastructure. Traditional disk-drive enclosures may also have many other deficiencies that keep them from meeting increasing data storage demands for many applications
The instant disclosure presents various storage systems and methods. In some embodiments, a storage system may include a protocol translator. The protocol translator may be programmed to receive a storage-access command formatted in a first protocol format and translate the storage-access command into a second protocol format. Thus, the protocol translator may be programmed to translate storage-access commands from two or more different protocols into a single protocol. A protocol translator may therefore provide a protocol agnostic front end for a storage system.
In certain embodiments, the protocol translator may be coupled to a pseudo-target module. The pseudo-target module may be programmed to transfer the storage-access command from the protocol translator to a storage device. In at least one embodiment, a virtualization engine may provide an interface between the pseudo-target module and the protocol translator. The storage system may also include a mid-level interface that may transfer the storage-access command from the protocol translator to the pseudo-target module.
According to various embodiments, the pseudo-target module may be programmed to communicate with both a Storage-Area-Network (SAN) interface and a Network-Attached-Storage (NAS) interface. The pseudo-target module may provide SAN/NAS convergence. The pseudo-target module may also be configured to receive, from an initiator, a request to access a first storage device. The pseudo-target module may access the first storage device and a second storage device in response to the request, and the access to the second storage device may be transparent to the initiator.
The storage devices presented herein may include a data-storage enclosure. A plurality of hard-disk drives may be positioned in the data-storage enclosure. In some embodiments, the data-storage enclosure may be configured as a high-density data-storage enclosure. Embodiments of the present disclosure may also be implemented in various other devices and systems and may comprise various other features and advantages.
The accompanying drawings illustrate a number of exemplary embodiments and are a part of the specification. Together with the following description, these drawings demonstrate and explain various principles of the instant disclosure.
Throughout the drawings, identical reference characters and descriptions indicate similar, but not necessarily identical, elements. While the exemplary embodiments described herein are susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and will be described in detail herein. However, the exemplary embodiments described herein are not intended to be limited to the particular forms disclosed. Rather, the instant disclosure covers all modifications, equivalents, and alternatives falling within the scope of the appended claims.
The following is intended to provide a detailed description of various exemplary embodiments and should not be taken to be limiting in any way. Various exemplary storage device methods and systems are disclosed herein. In some embodiments, a storage system may comprise a protocol translator. The protocol translator may be programmed to receive a storage-access command formatted in a first protocol format and translate the storage-access command into a second protocol format. The storage system may also comprise a pseudo-target module. The pseudo-target module may be coupled to a virtualization engine of a first storage device of the storage system. In some embodiments, the pseudo-target module may be programmed to communicate with both a storage-area-network (SAN) interface and a network-attached-storage (NAS) interface. The pseudo-target module may also be programmed to perform device bridging. Embodiments of the instant disclosure may also provide various other features and advantages over prior storage systems.
Storage system 100 may also include a mid-level interface 122, a protocol translator 120, and a pseudo-target module 124 in the kernel space of storage system 100. Mid-level interface 122 may provide an interface for communications between protocol-translator m120 and pseudo-target module 124. Mid-level interface 122 may be a small-computer-system-interface (SCSI) interface. Mid-level interface 122 may also be an interface that supports any other suitable protocol.
SAN interfaces 132 and 134 may be configured for different transport protocols. For example, SAN interface 132 may be an internet Small-Computer-System-Interface (iSCSI) interface while SAN interface 134 may be a Fibre Channel (FC) interface. In prior systems, in order to receive commands formatted in different protocols, an administrator may have installed a transfer-protocol-converting switch in order to convert transfer protocols before they arrived at the storage system. In contrast, in some embodiments, virtualization engine 110 may be programmed to communicate with commands formatted in accordance with various different transport protocols. However, programming virtualization engine 110 to support numerous transport protocols may result in a resource-intensive virtualization engine with a relatively large footprint. Protocol translator 120 may solve this problem by performing protocol translations on storage-access commands after they arrive at storage system 100 but before they are sent to virtualization engine 110, thereby allowing virtualization engine 110 to be less resource intensive and provide a smaller footprint.
Virtualization engine 110 may be any suitable virtualization system for providing an interface to storage device 112. For example, virtualization engine 110 may abstract logical storage from physical storage. In some embodiments, virtualization engine 110 may be an ATRATO™ virtualization engine that provides access to a Single Array of Identical Disks (SAID).
Protocol translator 214 may communicate with target mode drivers 222 through a target mode driver API 216. Target mode drivers 222 may be drivers for various network interfaces, such as InfiniBand (IB) interfaces, fibre channel interfaces, serial attached SCSI (SAS) interfaces, Ethernet interfaces, and/or any other types of network interfaces. As shown, storage system 200 may include IB interfaces 224, such as a remote direct memory access (RDMA) interface 226, a SCSI remote protocol (SRP) interface 228, and an iSCSI RDMA (iSER) interface 230. Storage system 200 may also include a fibre channel interface 232, a serial attached SCSI (SAS) interface 234, and an Ethernet interface 236. Ethernet interface 236 may comprise an RDMA interface 238, and iSCSI interface 240, and an iSER interface 242.
Each of the SAN interfaces illustrated in
Pseudo-target module 218 may talk directly to virtualization engine 208 or may initialize data transformation using transformation and storage module 220. After transformation and storage module 220 transforms the data, pseudo-target module 218 may transfer the data to pLUN_0217 (i.e., virtualization engine 208). In other embodiments, after transformation and storage module 220 transforms the data, pseudo-target module 218 may transfer the data to a different storage device, (e.g., pLUN_1219). Pseudo-target module 218 may also store the transformed data back out across the network (e.g., to a SCSI or InfiniBand network). Thus, pseudo-target module 218 may function as a mid-point data transformation and forward module.
In some embodiments, pseudo-target module 218 may perform device bridging. A LUN underneath pseudo-target module 218 may be able to talk to other LUNs in a manner that is transparent to an initiator of a storage access request. For example, pLUN_0217 may receive all the requests from the protocol translator 214. PLUN_0217 may talk to pLUN_1219 in an manner that is transparent to the initiator and to protocol translator 214. Thus, the initiator may not need to know about multiple devices on the network. In other words, pLUN_1219 may be hidden behind the pLUN_0217. As an example, an initiator may request a write to pLUN_0217, which may be a disk. PLUN_0 may also cause the data to be written to pLUN_1219, which may be a tape, but the initiator may not know that the data is being written to tape as well as to disk. This type of device bridging may reduce network traffic and provide efficient backup functionality. Device bridging may also facilitate cashing information or any other suitable device bridging function.
After receiving the storage-access command, the protocol translator may translate the storage-access command into a second protocol format (step 320). In some embodiments, the protocol translator may translate the storage-access command into the second protocol format by extracting essential information from the command it receives. The protocol translator may also encapsulate the essential information in a command understood by a virtualization engine of the storage device. Alternatively, the protocol translator may remove transport-specific information from the command. The protocol translator may then send the command to a first storage device in the storage system (step 330). The command may be sent from the protocol translator to the storage device through a pseudo-target module and/or a virtualization engine.
Storage system 400 may also include a protocol translator 414. In some embodiments, however, a storage system may not necessarily include a protocol translator. In storage system 400, protocol translator 414 may communicate with a pseudo-target module 418 through SCSI mid-level interface 416. Pseudo-target module 418 may comprise a pLUN database 419. Pseudo-target module 418 may also communicate with a transformation and storage module 420 through SCSI mid-level interface 416.
The previous example shows that pseudo-target module 506 may allow users to read data and render data though NAS 502 while the data is being received through SAN 504. In some embodiments, as the data is processed, the data may be sent back from NAS 502 to LUN_0508. In other words, as data is received from SAN 504, NAS users may process the data and send it back to LUN_0508. LUN_0508 may also provide data print functionality 510.
As illustrated in
Servers 940 and 945 may also be connected to a storage area network (SAN) fabric 980. SAN fabric 980 generally represents any type or form of computer network or architecture capable of facilitating communication between a plurality of storage devices. SAN fabric 980 may facilitate communication between servers 940 and 945 and a plurality of storage devices 990(1)-(N) and/or an intelligent storage array 995. SAN fabric 980 may also facilitate, via network 950 and servers 940 and 950, communication between client systems 910, 920, and 930 and storage devices 990(1)-(N) and/or intelligent storage array 995 in such a manner that devices 990(1)-(N) and array 995 appear as locally attached devices to client systems 910, 920, and 930. As with storage devices 960(1)-(N) and storage devices 970(1)-(N), storage devices 990(1)-(N) and intelligent storage array 995 generally represent any type or form of storage device or medium capable of storing data and/or other computer-readable instructions.
In certain embodiments, a communication interface may be used to provide connectivity between each client system 910, 920, and 930 and network 950. Client systems 910, 920, and 930 may be able to access information on server 940 or 945 using, for example, a web browser or other client software. Such software may allow client systems 910, 920, and 930 to access data hosted by server 940, server 945, storage devices 960(l)-(N), storage devices 970(1)-(N), storage devices 990(1)-(N), or intelligent storage array 995. Although
In at least one embodiment, all or a portion of one or more of the exemplary embodiments disclosed herein may be encoded as a computer program and loaded onto and executed by server 940, server 945, storage devices 960(1)-(N), storage devices 970(1)-(N), storage devices 990(1)-(N), intelligent storage array 995, or any combination thereof. All or a portion of one or more of the exemplary embodiments disclosed herein may also be encoded as a computer program, stored in server 940, run by server 945, and distributed to client systems 910, 920, and 930 over network 950. Accordingly, network architecture 900 may perform and/or be a means for performing, either alone or in combination with other elements, one or more of the detecting, storing, using, preventing, permitting, overwriting, editing, determining, ignoring, and hooking steps disclosed herein. Network architecture 900 may also be used to perform and/or be a means for performing other steps and features set forth in the instant disclosure.
For example, in certain embodiments the exemplary file systems disclosed herein may be stored on client systems 910, 920, and/or 930. Similarly, the exemplary file-system backups disclosed herein may be stored on server 940, server 945, storage devices 960(1))-(N), storage devices 970(1)-(N), storage devices 990(1)-(N), intelligent storage array 995, or any combination thereof.
According to various embodiments, the storage systems described herein may be part of network architecture 900 and/or the devices corresponding to network architecture 900. In some embodiments, a storage system may comprise a first storage device. The storage system may also comprise a protocol translator. The protocol translator may be programmed to receive a storage-access command formatted in a first protocol format. The protocol translator may also be programmed to translate the storage-access command into a second protocol format. The storage system may comprise a pseudo-target module coupled to the protocol translator. The pseudo-target module may be programmed to send the command to the first storage device after the command is translated into the second protocol format.
According to certain embodiments, the storage system may comprise a virtualization engine. The virtualization engine may provide an interface to the first storage device. The storage-access command may be sent to the first storage device through the virualization engine. According to at least one embodiment, the second protocol format may comprise a SCSI format. In at least one embodiment, the pseudo-target module may be configured to receive data from both storage-area-network devices and network-attacked-storage devices.
In some embodiments, the storage system of claim 1 may further comprise a SCSI mid-level interface configured to transfer the storage-access command from the protocol translator to the pseudo-target module. The pseudo-target module may be a kernel-level module. In some embodiments, the storage system may further comprise an internet iSCSI input and a fibre-channel input. The first protocol format may comprise a fibre-channel protocol format.
The storage system may comprise a target-mode-driver application programming interface configured to provide an interface between the protocol translator and a plurality of target mode drivers. In some embodiments, the plurality of target mode drivers may comprise at least one of: a fiber-channel target-mode driver, an iSCSI target mode driver, an infiniband target-mode driver, and/or an SAS target-mode driver.
In some embodiments, the storage system may comprise a data-storage enclosure. The storage system may also comprise a plurality of hard-disc drives positioned in the data-storage enclosure. The plurality of hard-disc drives may comprise the first storage device. In some embodiments, the storage device may comprise a front end. The front end may comprise the pseudo-target-module and the protocol translator.
According to at least one embodiment, the pseudo-target-module may be programmed to receive commands from both a SAN system and a NAS system. According to various embodiments, the pseudo-target-module may be programmed to receive a request to access the first physical storage device from an initiator. The pseudo-target-module may also be programmed to access both the first storage device and a second storage device in response to the request. Access to the second storage device may be transparent to the initiator.
According to certain embodiments, a computer-implemented method for managing access to a storage system may comprise receiving, at a protocol translator in a storage system, a storage-access command formatted in a first protocol format. The computer-implemented method may also comprise translating the storage-access command into a second protocol format and sending the command to a first storage device in the storage system.
In some embodiments, sending the storage-access command to the first storage device may comprise sending the storage-access command to a virtualization engine that provides an interface for the first storage device. The second protocol format may comprise a SCSI protocol format. In some embodiments, sending the command to the virtualization engine may comprise sending the command from the protocol translator to the virtualization engine through a pseudo-target-module.
In various embodiments, the pseudo-target-module may be configured to receive data from both SAN devices and NAS devices. In various embodiments, the pseudo-target-module may be a kernel-level module. In some embodiments, a storage system may comprise a first storage device. The storage system may also comprise a virtualization engine that provides an interface to the first storage device. The storage system may also comprise a pseudo-target-module coupled to the virtualization engine. The pseudo-target-module may be programmed to communicate with a SAN interface and a NAS interface.
In some embodiments, a NAS system may comprise the NAS interface and a network file system. The NAS system may also comprise a virtual file system. In some embodiments the storage system may comprise the SAN interface. The SAN interface may comprise at least one of: a fibre channel host-bus adaptor, an internet small-computer-system-interface card, a serial-attached internet small-computer-system-interface host-bus adaptor, and/or an infiniband host channel adaptor.
In at least one embodiment, the storage system may comprise a protocol translator. The protocol translator may be configured to receive a storage-access command formatted in a first protocol format. The protocol translator may also be programmed to translate the storage-access command into a second protocol format. The pseudo-target-module may be coupled to the protocol translator and configured to send a storage-access command to the first storage device after the storage-access command is translated into the second protocol format.
In some embodiments, the pseudo-target-module may be programmed to receive a request to access the first storage device from an initiator. The pseudo-target-module may also be programmed to access both the first storage device and a second storage device in response to the request. Access to the second storage device may be transparent to the initiator. According to certain embodiments, a storage system may comprise a first storage device and a virtualization engine. The virtualization engine may provide an interface to the first storage device. The storage system may also comprise a first pseudo-target-module coupled to the virtualization engine. The pseudo-target-module may be programmed to receive a request to access the first storage device from an initiator. The pseudo-target-module may also be programmed to access the first storage device and a second storage device in response to the request. Access to the second storage device may be transparent to the initiator.
In some embodiments, the pseudo-target module may be programmed to receive data from both SAN devices and NAS devices. The storage system may also comprise a small-computer-system-interface mid-level interface configured to transfer the command from a protocol translator to the pseudo-target module. In some embodiments, the pseudo-target module and the protocol translator may be kernel-level modules.
The storage system may further comprise a data-storage enclosure. The storage system may also comprise a plurality of hard-disc drives positioned in the data-storage enclosure. The plurality of hard-disc drives may comprise the first storage device. In some embodiments, the storage system may include a front end. The front end may comprise the pseudo-target module.
According to certain embodiments, a computer-implemented method may comprise receiving a request from an initiator to access a first storage device. The request may be received at a pseudo-target module in the front end of a storage system. The computer-implemented method may also comprise accessing the first storage device in response to the request. The computer-implemented method may comprise accessing the second storage device in response to the request. Access to the second storage device may be transparent to the initiator.
In some embodiments, the pseudo-target module may be configured to receive data from both SAN devices and NAS devices. In various embodiments, the storage system may further comprise a data-storage enclosure and a plurality of hard-disc drives positioned in the data-storage enclosure. The plurality of hard-disc drives may comprise the first storage device.
While the foregoing disclosure sets forth various embodiments using specific block diagrams, flowcharts, and examples, each block diagram component, flowchart step, operation, and/or component described and/or illustrated herein may be implemented, individually and/or collectively, using a wide range of hardware, software, or firmware (or any combination thereof) configurations. In addition, any disclosure of components contained within other components should be considered exemplary in nature since many other architectures can be implemented to achieve the same functionality.
The process parameters and sequence of steps described and/or illustrated herein are given by way of example only and can be varied as desired. For example, while the steps illustrated and/or described herein may be shown or discussed in a particular order, these steps do not necessarily need to be performed in the order illustrated or discussed. The various exemplary methods described and/or illustrated herein may also omit one or more of the steps described or illustrated herein or include additional steps in addition to those disclosed.
Furthermore, while various embodiments have been described and/or illustrated herein in the context of fully functional computing systems, one or more of these exemplary embodiments may be distributed as a program product in a variety of forms, regardless of the particular type of computer-readable media used to actually carry out the distribution. The embodiments disclosed herein may also be implemented using software modules that perform certain tasks. These software modules may include script, batch, or other executable files that may be stored on a computer-readable storage medium or in a computing system. In some embodiments, these software modules may configure a computing system to perform one or more of the exemplary embodiments disclosed herein.
The preceding description has been provided to enable others skilled in the art to best utilize various aspects of the exemplary embodiments disclosed herein. This exemplary description is not intended to be exhaustive or to be limited to any precise form disclosed. Many modifications and variations are possible without departing from the spirit and scope of the instant disclosure. The embodiments disclosed herein should be considered in all respects illustrative and not restrictive. Reference should be made to the appended claims and their equivalents in determining the scope of the instant disclosure.
This application claims priority to U.S. provisional patent application No. 61/032,865 entitled “STORAGE SYSTEM FRONT END,” and filed on Feb. 29, 2008, the entire disclosure of which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
61032865 | Feb 2008 | US |