In the art of computing, it is desirable to encrypt data stored on persistent storage media, such as hard disk drives. Encryption protects the data from unauthorized access, and theft of the media upon which the data is stored.
Data is encrypted using encryption keys, and it is desirable to periodically rotate encryption keys. For data that is already encrypted, the key rotation process comprises reading data encrypted with the old encryption key from the storage media, decrypting the data using the old key, encrypting the data with the new key, and writing the data encrypted with the new key back to the storage media.
In the art of computing, it is also desirable to provide redundancy so that operation of a computer system can continue after the failure of a component. One method known in the art for providing storage media redundancy is to mirror the data. In a mirrored configuration, two storage devices are provided, and the same data is stored on each device. If one device fails, the data is still available on the other device.
The Figures depict embodiments, examples, implementations, and configurations of the invention, and not the invention itself.
In the foregoing description, numerous details are set forth to provide an understanding of the present invention. However, it will be understood by those skilled in the art that the present invention may be practiced without these details. While the invention has been disclosed with respect to a limited number of embodiments and examples, those skilled in the art will appreciate numerous modifications and variations therefrom. It is intended that the appended claims cover such modifications and variations as fall within the true spirit and scope of the invention.
Examples of the present invention perform key rotation in computer systems having mirrored storage devices. In accordance with examples of the invention, when key rotation is desired for a particular storage device, a storage device is reinitialized with a new key. At this point, for all intents and purposes, the storage device is empty. A mirrored volume revive operation is initiated, and the data on another storage device that comprises the mirrored volume is copied to the storage device that has been initialized with the new key. When the revive operation is complete, key rotation is complete, and the storage device encrypted with the new key joins the mirrored volume. Accordingly, examples of the present invention leverage procedures provided to support mirrored volumes to also perform key rotation.
The process of encryption transforms plaintext data into encrypted data using an encryption key. The process of decryption transforms encrypted data back into plaintext form using a decryption key. Encrypted data is secure because it cannot be decoded into plaintext form without the decryption key. As used herein, the term “key rotation” includes transforming plaintext data to encrypted data, transforming encrypted data to plaintext data, and transforming data encrypted with a first encryption key into data encrypted with a second encryption key.
There are two types of encryption, asymmetric and symmetric. Asymmetric encryption uses an encryption key to encrypt the data, and a different decryption key to decrypt the data. Encryption keys can be public so that anyone can encrypt the data, and the decryption keys can be kept private so that only the key holder can decrypt the data. RSA encryption is an example of asymmetric encryption. Asymmetric encryption is especially useful for communication between remote entities or devices, since each entity or device does not need to know the secret key of the other entity or device. For example, secure communication between devices coupled by the Internet is typically performed using asymmetric communication.
Symmetric encryption uses the same key for both encryption and decryption. The key is kept secret. Blowfish, Defense Encryption Standard (DES), triple DES, and Advanced Encryption Standard (AES) are typical examples of symmetric encryption. Symmetric encryption is well suited for applications having large amounts of data accessed by the same device or entity since the device or entity can keep the key secret.
The algorithms used in symmetric encryption are bidirectional. Decryption is the reverse process of encryption. Symmetric block-level encryption, sometimes referred to as a block cipher, divides the data to be encrypted into blocks or groups of characters, and the encryption algorithm is applied to each block. Key length varies according to the cipher, with DES having 56-bit keys, and AES having 128-bit, 192-bit, or 256-bit keys. IEEE Standard 1619 provides for cryptographic protection of data on block-oriented storage devices, such as disk drives, flash memory, optical drives, and the like.
The discussion below assumes that symmetric encryption will be used when describing examples of the present invention. Accordingly, the terms “key” and “encryption key” are used interchangeably when referring to encryption and decryption processes. However, those skilled in the art will recognize that asymmetric encryption may be used with examples of the present invention. If asymmetric encryption is used, than a different decryption key is used to perform decryption operations.
Only connections and devices needed to understand examples of the present invention are shown in
During normal operation, storage media 22 is a primary storage device, and storage media 24 mirrors the data stored on storage media 22. In general, write operations must be performed to both storage devices, but read operations need only be serviced from one of the storage devices. Typically, the storage device that services read operations is the primary storage device, and the other storage device is the mirror storage device. However, the primary and mirror storage devices may service different read operations simultaneously to allow for load balancing.
Also note that each storage media is coupled to two CLIMs. Typically, the path between one CLIM and a storage device will be designated as an active path that will carry all I/O requests during normal operation, and the path between the other CLIM and the storage device will be designated as a backup path that will only carry I/O requests in the event that the active path fails.
Host 12 is responsible for managing the mirrored volume, and is responsible for sending data to be written to the mirrored volume to both storage media 22 and 24. CLIMs 14, 16, 18, and 20 are responsible for encrypting and decrypting data blocks as the data blocks are written to and read from storage media 22 and 24.
The encryption keys themselves are not stored on storage media 22 and 24. However, a key name is stored on each storage media. When the CLIMs are initialized, the CLIMs retrieve the key name from the storage media and provide the key name to key manager 28. Key manager 28, in turn, provides the encryption key to the CLIMs, which use the encryption key to access the data on the storage media. Although not shown in
For the purposes of understanding examples of the present invention, host 12, CLIMs 14, 16, 18, and 20, and key manager 28 can all be viewed as general purpose computers. Of course, in an actual deployment, the host, CLIMs, and key manager will have different capabilities. For example, host 12 may have a greater number of faster CPUs and significantly more memory than CLIMs 14, 16, 18, and 20, and key manager 28.
Although bus 32 is shown generically as a single bus, those skilled in the art will recognize that typically a variety of busses and fabrics are used to connect the components shown in
For the purposes of describing examples of the present invention, core logic 36 also includes other components found in a typical computer system, such as firmware and I/O components, disk controllers for local persistent storage, USB ports, video controllers, and the like. In a server, some of these components may not be utilized. Persistent storage 44 represents storage used to store local copies of the operating system, applications, and other programs and data. Persistent storage 44 may represent devices such as hard disk drives, solid state drives, tape drives, optical drives, and the like. Alternatively, persistent storage may be provided external to computer 30. Network interface controller connects computer 30 to a network, such as LAN 26 in
For host 12, storage controllers 42 represent the controllers that interface to the fabric coupling host 10 to the CLIMs 14, 16, 18, and 20. Examples of such fabrics are discussed above. For CLIMs 14, 16, 18, and 20, storage controllers 42 represent the controllers that couple the CLIMs to storage media 22 and 24. Examples of such connections are discussed above. In some configurations, these interfaces may be provided as part of core logic 36. Also note that key manager 28 may not require a storage controller 42 to access storage that is external to key manager 28.
Sectors 0-N are reserved for system information, such as the media volume, and other information that identifies the media. Within this reserved area is an area reserved for the CLIMs to store information, such as data indicating whether or not the media is encrypted, the key name, and an algorithm identifier that identifies the encryption algorithm. The key itself is not stored on the media. The key is stored in key manager 28, and the key name is used to identify the key. Typically, the CLIM area will not be encrypted so that a CLIM may retrieve the key name to provide to key manager 28.
CLIM memory 46 includes CLIM OS and applications 48. Within CLIM OS and applications 48 are media I/O module 50, key manager client module 52, and encryption/decryption client module 54.
Media I/O module 50 manages I/O between host 12 and storage media 22 or 24. Key manager client module 52 communicates with key manager 28. Key manager client module 52 provides a key name from storage media 22 or 24 to key manager 28, and key manager 28 returns the encryption key used to encrypt and decrypt data stored on storage media 22 or 24.
Encryption/decryption module 54 cooperates with key manager client module 52 to receive the encryption key. In cooperation with media I/O module 50, encryption/decryption module 54 encrypts data blocks being written to storage media 22 or 24, and decrypts data blocks being read from storage media 22 or 24.
Key manager memory 58 includes key manager OS and applications 60. Within key manager OS and applications 60 are key manager server module 62 and key table 64. Key manager server module 62 communicates with key manager client module 52. Encryption keys and key names are stored in key table 64. When a CLIM needs to receive an encryption key for the storage media attached to the CLIM, key manager client module 52 sends the key name to key manager server module 62, which in turn retrieves the key from key table 64 using the key name, and transmits the key to key manager module 52. Communication between key manager server module 62 and key manager client module 52 may occur over a secure channel, such as a channel using Hypertext Transfer Protocol Secure (HTTPS), or channels secured by Transport Layer Security (TLS) or Secure Sockets Layer (SSL).
Host memory 70 includes host and OS applications 72. Within host and OS applications 72 are mirrored volume I/O manager 74, key policy management module 76, and key rotation initiator module 78.
Mirrored volume I/O manager 74 manages media I/O transfers such that each read operation stores data on primary storage media 22, with the data mirrored at storage media 24. Mirrored volume I/O manager 74 also implements a mirror revive function. Should one of the storage media devices that comprise the mirror fail, the failed storage media device can be replaced, and a revive operation copies all data from the other mirrored storage device to the new storage device to restore the mirrored volume to mirrored operation. During the mirror revive operation, the storage device having a complete copy of the data is the revive source, and the new storage media that replaced the failed storage media is the revive target.
During the mirror revive operation, I/O requests continue to be serviced. Read requests may be serviced from the revive source. If the data block referenced in the read request has already been copied as part of the mirror revive, the read request could also be serviced by the revive target. Write requests from the host are written to the revive source. If the data block referenced in the write request has not been copied to the revive target, the data block need only be written to the revive source, and the block will later be copied to the target. On the other hand, if the data block that is referenced by the write request has already been copied to the target, the data block contained in the write request is also written to the target to ensure the integrity of the mirrored volume upon revive completion.
When key rotation is initiated, key rotation initiator module 78 signals CLIMs 14 and 16 to initialize storage media 22 with a new key. Accordingly, key manager 28 provides a new key and key name to CLIMs 14 and 16, and the new key and key name are stored in key table 64 of key manager 28.
At this point, storage media 22, for all intents and purposes, has been cleared of all data. While the data still exists on storage media 22 encrypted with the old key, the data is no longer accessible because CLIMs 14 and 16 are now accessing storage media 22 with the new key.
Key rotation initiator module 78 signals mirrored volume I/O manager 74 to initiate a mirror revive operation to restore data from storage media 24, as shown in
When the mirror revive operation is complete, key rotation is complete for storage media 22. Storage media 22 may now be returned to normal operation and participate in the mirrored volume with storage media 24. If key rotation is desired for storage media 24, the steps described above can be repeated for media 24, with storage media 24 being initialized with a new key, and a mirror revive operation being performed from storage media 22 to storage media 24.
Note that the revive operation can copy every block from storage media 24 to storage media 22. However, it is also possible to optimize the revive operation to reduce the amount of data that needs to be transferred. Using one optimization technique, a data block map is used to identify the data blocks that are in use, and only the data blocks in use need to be copied from storage media 24 to storage media 22. Using another optimization technique, a “high water mark” may be used, with all data blocks that are in use existing below the high water mark, and no data blocks in use existing above the high water mark. Using this technique, data blocks are copied from the beginning of host 12 data (sector N+1 in
Since storage media 24 continues to service I/O requests from host 12 during the revive operation, data block usage must be tracked using both optimization techniques because host 12 may write to a data block that was previously unused. Tracking data block usage when using the data block map optimization method tends to be complex because each unused block needs to be tracked. On the other hand, tracking disk block usage when using the high water mark optimization technique tends to be simpler since host 12 only has to compare write operations to the high water mark. If a write operation writes to a data block above the high water mark, the high water mark is simply reset to the location of the data block. The high water mark optimization technique can be further optimized by performing media storage defragmentation before key rotation to compact all used data blocks toward the beginning of the data area used by host 12, thereby lowering the high water mark.
In the example discussed above, the redundancy normally provided by the mirrored volume is not available during key rotation. Since key rotation is provided by a mirror revive operation from storage media 24 to storage media 22, only storage media 24 has a complete copy of the data stored by host 12 until key rotation is complete. The examples of the present invention shown in
Storage media bank 86 has multiple storage media devices. Typically, such a bank of storage media devices will be provided in a storage device rack. Any of the storage media devices can be allocated to host 82 via SAN 84, or to other hosts not shown in
Within storage media bank 86, storage media 88 is connected to host 82 via SAN 84 and is configured as a primary device in a mirrored volume. Storage media 90 is similarly connected and configured as a mirror. Also note that storage device 92 is not connected to a host and is allocated as a spare. The reminder of the storage devices are configured as mirrored volumes, and may be coupled to host 82, or other hosts not shown in
In accordance with examples of the present invention,
In
The examples of the invention described above provide many advantages. Mirrored volumes have been known in the art for a considerable period of time, and the various functions and I/O routines associated with maintaining mirrored volumes are stable and mature. Examples of the present invention leverage these functions and I/O routines to provide key rotation, thereby reducing the amount of time that it takes engineers and programmers to implement examples of the present invention. The volume continues to service I/O requests from the host during key rotation, and with the examples shown in
Flowchart 94 of
At block 98, key rotation is performed by performing a mirror revive operation from the first storage media to the second storage media. Control passes to block 100. At block 100, normal redundant operation of the mirrored volume resumes with the first and second storage media comprising the mirrored volume.
Flowchart 102 of
At block 106, key rotation is performed by performing a mirror revive operation from the first storage media to the target storage media. While the mirror revive operation is underway, full mirrored redundancy continues to be provided using the first and a second storage media. Control passes to block 108. At block 108, the mirrored volume is configured to use the first and target storage media, and the second storage media is allocated to be spare storage media.
In the foregoing description, numerous details are set forth to provide an understanding of the present invention. However, it will be understood by those skilled in the art that the present invention may be practiced without these details. While the invention has been disclosed with respect to a limited number of examples and embodiments, those skilled in the art will appreciate numerous modifications and variations therefrom. It is intended that the appended claims cover such modifications and variations as fall within the true spirit and scope of the invention.
Number | Name | Date | Kind |
---|---|---|---|
4888802 | Cooney | Dec 1989 | A |
5051887 | Berger et al. | Sep 1991 | A |
5933653 | Ofek | Aug 1999 | A |
6397307 | Ohran | May 2002 | B2 |
7240197 | Yamagami et al. | Jul 2007 | B1 |
7627756 | Fujibayashi et al. | Dec 2009 | B2 |
20050034013 | Yamamoto et al. | Feb 2005 | A1 |
20050102603 | Tapper et al. | May 2005 | A1 |
20060136732 | Vandermolen | Jun 2006 | A1 |
20070079119 | Mattsson et al. | Apr 2007 | A1 |
20070079140 | Metzger et al. | Apr 2007 | A1 |
20080240434 | Kitamura | Oct 2008 | A1 |
20080260159 | Osaki | Oct 2008 | A1 |
20090060201 | Rhodes et al. | Mar 2009 | A1 |
20090196414 | Mittal et al. | Aug 2009 | A1 |
20090199016 | Kishi | Aug 2009 | A1 |
20110113259 | Bilodi et al. | May 2011 | A1 |
Entry |
---|
(no stated author); RAID 1(+0): breaking mirrors and rebuilding drives; 2007; retrieved from the Internet <URL:nstor.ru/files/pdf/291966B21.pdf>; pp. 1-9 as printed. |
Ingrain Networks, Online Key Rotation with Ingrain, http://www.ingrian.com/resources/sol—briefs/Ingrian%20online%20key%20rotation.pdf, Jun. 4, 2007, 2 pages. |
Number | Date | Country | |
---|---|---|---|
20110188651 A1 | Aug 2011 | US |