System and method for providing key-encrypted storage in a cloud computing environment

Information

  • Patent Grant
  • 10230704
  • Patent Number
    10,230,704
  • Date Filed
    Monday, April 10, 2017
    7 years ago
  • Date Issued
    Tuesday, March 12, 2019
    5 years ago
Abstract
System and method for providing cloud computing services are described. In one embodiment, the system comprises a cloud computing environment comprising resources for supporting cloud workloads, each cloud workload having associated therewith an internal cloud address; and a routing system disposed between external workloads of an external computing environment and the cloud workloads, the routing system for directing traffic from an external address to the internal cloud addresses of the cloud workloads. A designated one of the cloud workloads obtains one key of a first pair of cryptographic keys, the first pair of cryptographic keys for decrypting encrypted storage hosted within the cloud computing environment.
Description
BACKGROUND

Cloud computing is a type of computing in which dynamically scalable and typically virtualized resources are provided as services via the Internet. As a result, users need not, and typically do not, possess knowledge of, expertise in, or control over the technology and/or infrastructure implemented in the cloud. Cloud computing generally incorporates infrastructure as a service (“IaaS”), platform as a service (“PaaS”), and/or software as a service (“SaaS”). In a typical embodiment, cloud computing services provide common applications online, which applications are accessed using a web browser and the software and data for which are stored on servers comprising the cloud.


Cloud computing customers typically do not own or possess the physical infrastructure that hosts their software platform; rather, the infrastructure is leased in some manner from a third-party provider. Cloud computing customers can avoid capital expenditures by paying a provider for only what they use on a utility, or resources consumed, basis or a subscription, or time-based, basis, for example. Sharing computing power and/or storage capacity among multiple lessees has many advantages, including improved utilization rates and an increase in overall computer usage.


With the advent of cloud computing and cloud storage, a challenge exists with respect to IP address usage and the sharing of cryptographic keys between a known and trusted location and the computing cloud.


SUMMARY

One embodiment is a system for providing cloud computing services. The system comprises a cloud computing environment comprising resources for supporting cloud workloads, each cloud workload having associated therewith an internal cloud address; and a routing system disposed between external workloads of an external computing environment and the cloud workloads, the routing system for directing traffic from an external address to the internal cloud addresses of the cloud workloads. A designated one of the cloud workloads obtains one key of a first pair of cryptographic keys, the first pair of cryptographic keys for decrypting encrypted storage hosted within the cloud computing environment.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 illustrates an exemplary IaaS cloud structure such as may be implemented in one embodiment.



FIG. 2 is a flow diagram of one embodiment of a process for implementing reduced cloud IP address utilization.





DETAILED DESCRIPTION

To better illustrate the advantages and features of the embodiments, a particular description of several embodiments will be provided with reference to the attached drawings. These drawings, and other embodiments described herein, only illustrate selected aspects of the embodiments and are not intended to limit the scope thereof. Further, despite reference to specific features illustrated in the example embodiments, it will nevertheless be understood that these features are not essential to all embodiments and no limitation of the scope thereof is thereby intended. Any alterations and further modifications in the described embodiments, and any further applications of the principles of the embodiments as described herein are contemplated as would normally occur to one skilled in the art. Furthermore, some items are shown in a simplified form, and inherently include components that are well known in the art. Further still, some items are illustrated as being in direct connection for the sake of simplicity and clarity. Despite the apparent direct connection, it is understood that such illustration does not preclude the existence of intermediate components not otherwise illustrated.


The embodiments described herein provide a mechanism for providing reduced cloud IP address utilization. To this end, one or more embodiments described herein provide a method and mechanism to enable the use of a single IP address to address many instances within a cloud infrastructure. Additionally, one or more such embodiments provide a method and mechanism to provide the keys necessary to secure traffic and storage in the cloud.



FIG. 1 illustrates an exemplary IaaS cloud structure. As shown in FIG. 1, the cloud structure includes a hardware layer 100 comprising storage assets 102, processing assets 104, and network assets 106. To facilitate usefulness of the cloud to a variety of enterprises, workloads are sponsored in the cloud as virtual machines possibly accessing virtualized storage and/or virtualized networks. This is accomplished via a virtualization layer 108. Thus, the hardware layer 100 is insulated from the actual workloads to be sponsored in the cloud at a layer 110 by the virtualization layer 108 hardware, storage, and networking so that the operating system selected by the enterprise can be sponsored on whatever hardware the cloud services provider makes available. Having established the hardware and virtualization layers 100, 108, the assets 102, 104, and 106 are available in a standardized way to workloads hosted in the workload layer 110, which is the layer the customer typically views as the “cloud”. It will be recognized that some of the workloads sponsored in the cloud, specifically, workloads 111, are workloads that are germane to the operation of the cloud and may consist of monitoring processes for enabling the cloud services provider to monitor the health of the cloud, management processes to enable the cloud services provider to ensure that service-level agreements are enforced, and so on.


Enterprises using the cloud are represented by virtualization processes and storage shown as workloads 112. These processes are typically started by an enterprise via a cloud portal or API utilized by administrative personnel or processes running at the enterprise or in the cloud. A typical cloud services provider may be using standard ITIL practices and may utilize a configuration management database (“CMDB”) 114, which affects the entire cloud infrastructure and which describes the practice and policies used for instantiating virtualized workloads and storage.



FIG. 2 is a flow diagram of one embodiment of a system 200 for providing reduced cloud IP address utilization. As shown in FIG. 2, one or more applications of an enterprise, represented in FIG. 2 by applications 202A-202C, hosted in a known and trusted environment 204 under the control of the enterprise. As will be described, the applications 202A-202C require access to storage and/or processes in a cloud 206; as a result, such storage and/or processes may be disposed in an unknown location and under an unknown trust model. In accordance with one embodiment, as will be described in detail hereinbelow, it is possible to annex portions of the cloud 206 so that the applications 202A-202C can utilize resources disposed within the cloud 206 in the same manner as if they were disposed in a trusted and known location, such as a data center (not shown) of the enterprise.


In the embodiment illustrated in FIG. 2, a secure bridge 208 provides a secure connection between applications 202A-202C and a virtual router 210, which secure connection can be created based upon keys that were previously traded between the provider of the cloud 206 (“the cloud services provider”) and the enterprise as is known in the art. The virtual router 210 lies within the infrastructure and under the control of the cloud services provider (IaaS) and as such, the public and/or private keys that the IaaS holds are secured by the IaaS infrastructure, data center security, physical security, and others.


As a result, because the secure bridge 208 and virtual router 210 possess mutually shared keys or mutually shared parts of key pairs, a secured connection can be created between the applications 202A-202C and the virtual router 210 via the secure bridge 208 as described in detail in U.S. patent application Ser. No. 12/612,841, which has been incorporated by reference in its entirety. In the embodiment shown in FIG. 2, each application 202A-202C has access to the keys mentioned hereinabove in connection with the secure bridge 208 such that endpoint security from the applications 202A-202C to an external address 212, shown in FIG. 2 as “174.65.x.x”, via the router 210 can exist without the need of the secure bridge 208.


As previously noted, the virtual router 210 lies within the infrastructure of the cloud services provider and acts as a Network Address Translator (“NAT”) to workloads within a specific domain. In a representative embodiment, the IP address is a private addresses, such as a 10-net, so that only the single external address 212 is necessary to access the cloud processes, as will be described. In such a case, as shown in FIG. 2, a distributor 214 forwards traffic from the external address 212 to internal addresses 216 (e.g., “10.1.1.x”) so that only one external address needs to be associated with the processes within the cloud 206. In one embodiment, the foregoing may be accomplished by matching port ranges to specific workloads, represented by workloads 218A-218D, so that if auto load balancing of each of the workloads is required, the port ranges can enable a distinction to be made between the workloads operating within the cloud 206 via a given 10-net.


In one embodiment, the distributor 214 maintains all port mappings in a distributor registry 226 so that requests from applications 202A-202C can be sent to the appropriate one of the workloads 218A-218D. Information may be split between the distributor registry 226 and the secure bridge 208 and further information, such as tokens from a Representational State Transfer (“REST”) call can be maintained with the port mapping such that better information can be provided during the mapping process.


In the embodiment shown in FIG. 2, the internal addresses 216 may be partitioned such that the “x” therein represents some kind of subnet IP address grouping (e.g., 10.1.1.10-20). Accordingly, instead of using a port, IP addresses may be used within the address space. In this embodiment, the distributor 214 may map a single external address to within the 10-net address space so that it is multiplexed into various types of workloads and or storage. In the illustrated embodiment, storage is also protected this way by allowing one of the workloads, such as the workload 218D, to hold keys and to process traffic for storage in the cloud 206. As a result, the storage can be encrypted and decrypted on-the-fly as needed by either an internal-to-the-cloud or external-to-the-cloud process.


Once the secure connection between the applications 202A-202C and the distributor 214 is established based on attestation by the virtual router 210 to the fact that the distributor has not changed and therefore may be trusted in its process model, cryptographic keys may be transmitted from the applications across to the distributor so that a process can receive keys, as represented in FIG. 2 by a dashed line 222. This process ensures that storage or other content and traffic can be protected via keys received external to the cloud 206. This is significant because it allows for the keys to be stored in a location other than the cloud 206, thereby providing a layer of protection generally not afforded in a public location such as a cloud computing environment.


It will be recognized that, as illustrated in FIG. 2, an additional distributor 224 may be provided. In such cases, the distributor registry 226 enables distribution address spaces to be properly managed. Each of the workloads 218A-218D communicates to with the distributor 214 via an address, such as, for example, a 10-net address 228, that is communicated to the workloads when they are started up so that any new processes that are initiated due to load balancing issues, load expansion issues, load contraction issues and the like can communicate their local address 216 to the distributor 214. It should be noted that what is communicated to the workloads may be the address of the distributor 214 or a token, such as a DNS name, that may be used by the workload to lookup the address of the distributor 214. In any event, it will be noted that the communicated address is one that is not hard-wired in the system; it is either provided as described or discovered via token dereferencing in a manner well known in the art. As a result, through implementation of some predetermined policy, the communicated local address and its associated port range 230 can be logged in to the distributor registry 226 so that the addresses can be correctly maintained according to address, port, and workload type.


The distributor 214 also provides configuration information to the workloads 218A-218D so that configuration information can be normalized and provided to new workloads that are being brought up as a result of load expansion or contraction. Additionally, the configuration described hereinabove is provided external to the cloud 206 via the same mechanism as was discussed with key distribution. This mechanism provides for a simpler method of keeping the workloads 218A-218D up to date and the startup or boot configuration normalized.


One embodiment is implemented using one or more embodiments described in U.S. patent application Ser. No. 12/197,833 (hereinafter the “'833 application), incorporated by reference hereinabove to find, analyze, and qualify clouds, such as the cloud 206, so that the required infrastructure for allowing the deployment of everything within the cloud 206 will function correctly. The embodiment described in the '833 application also keeps track of reputation of all clouds so that the best price, performance, stability, etc., can be selected for a deployment within the cloud.


In an alternative embodiment, the distributor 214 can reside external to the cloud 206 or in a different cloud. In this case, the virtual router 210 must attest to the validity of the workloads 218A-218D so that it is attested that no changes have been made. In the illustrated embodiment, each of the workloads 218A-218D has a secure connection through the virtual router 210 to the applications 202A-202C so that the annexation is still valid. It will be recognized, however, that this embodiment requires more traffic over the network.


In one embodiment, additional virtual routers, such as a virtual router 232, may be added. In this embodiment, an L4 switch or some other load-balancing mechanism (not shown) may be provided in a known manner to distribute traffic between the external addresses connected to the virtual routers 210, 232. In another embodiment, the information from the distributor registry 226 is available to the workloads 218A-218D such that the information provided by the distributor registry provides the workloads with information necessary to perform clustering, remedial clustering, and/or other types of cooperative computing and storage management.


In one embodiment, the secure bridge 208 may be replaced by a secure connection implemented using a pair of cryptographic keys held by both the trusted environment/enterprise 204 and the cloud 206.


It will be recognized that various ones of the elements and/or modules described herein may be implemented using one or more general purpose computers or portions thereof executing software applications designed to perform the functions described or using one or more special purpose computers or portions thereof configured to perform the functions described. The software applications may comprise computer-executable instructions stored on computer-readable media. Additionally, repositories described herein may be implemented using databases or other appropriate storage media.


While the preceding description shows and describes one or more embodiments, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present disclosure. For example, various steps of the described methods may be executed in a different order or executed sequentially, combined, further divided, replaced with alternate steps, or removed entirely. In addition, various functions illustrated in the methods or described elsewhere in the disclosure may be combined to provide additional and/or alternate functions. Therefore, the claims should be interpreted in a broad manner, consistent with the present disclosure.

Claims
  • 1. A method, comprising: routing a request to a cloud resource from a plurality of cloud resources within a cloud, wherein the request is directed to a single Internet Protocol (IP) address for the cloud, wherein routing further includes performing network address translation on a port portion of the IP address by translating the IP address to a subnet IP address comprising a range of IP addresses that are assigned to a plurality of instances of servers within the cloud resource within the cloud and distinguishing the cloud resource from the plurality of cloud resources;selecting a particular instance of the plurality of instance of servers to service the request based on processing loads associated with the instances and based on the performing network address translation on the port portion of the IP address that identifies the subnet IP address range for the instances;initiating the particular instance to service the request;providing a secure encrypted storage within the cloud that is shared between the cloud resources; andmanaging each cloud resource's access to a decryption key for decrypting the secure encrypted storage during access by the cloud resources to the secure encrypted storage.
  • 2. The method of claim 1, wherein providing further includes providing each cloud resource the decryption key as a unique key pair for decrypting the secure encrypted storage.
  • 3. The method of claim 2, wherein providing further includes providing one key of each unique key pair through a secure connection using a different key pair with each cloud resource.
  • 4. The method of claim 1, wherein routing further includes matching a port range defined in the IP address to the cloud resources.
  • 5. The method of claim 4, wherein routing further includes selecting the cloud resource based on a processing load of the cloud resources, wherein the cloud resources are multiple executing instances of a same cloud resource.
  • 6. The method of claim 5, wherein routing further includes identifying a private IP address for each of the cloud resources based on being within the port range.
  • 7. The method of claim 1, wherein managing further includes providing the decryption key as a key pair.
  • 8. The method of claim 7, wherein providing further includes obtaining a first key of the key pair from an external source to the cloud.
  • 9. The method of claim 8, wherein providing further includes using a designated cloud resource for interfacing with the external source to obtain the first key on behalf of the cloud resources.
  • 10. The method of claim 9, wherein using further includes providing a second key of the key pair during a secure connection using a different key pair with each of the cloud resource.
  • 11. The method of claim of claim 1 further comprising, ensuring that data storage traffic within the cloud is encrypted into and decrypted from the secure encrypted storage.
  • 12. The method of claim 1 further comprising enforcing communication traffic into and out of the cloud over secure communication channels.
  • 13. The method of claim 12, wherein each of the secure communication channels process cryptographic keys for communication with the cloud.
  • 14. A non-transitory computer-readable storage device with computer-executable instructions stored thereon that, when executed by one or more computer processors, cause the one or more computer processors to perform operations comprising: maintaining a plurality of executing instances of a cloud resource within a plurality of cloud resources within a secure cloud;receiving a request for an executing instance that utilizes a single Internet Protocol (IP) address shared by each of the executing instances, wherein maintaining further includes managing the single IP address for access to all of the instances;performing network address translation on a port portion of the single IP address by translating the single IP address to a subnet IP address comprising a range of IP addresses that are assigned to the plurality of executing instances of the cloud resource within the secure cloud and distinguishing the cloud resource from the plurality of cloud resources;selecting a particular instance to service the request based on processing loads associated with the instances and based on the performing network address translation on the port portion of the single IP address that identifies the subnet IP address range for the instances;initiating the particular instance to service the request; andmanaging data access for each of the instances from an encrypted storage within the cloud during processing of the instances with each instance having access to the encrypted storage through a unique encryption and decryption key pair.
  • 15. The non-transitory computer-readable storage device of claim 14, wherein managing further includes proving a first key of the unique encryption and decryption key pair to each of the instances during a secure connection to that instance and utilizing a different key pair for the secure connection.
  • 16. The non-transitory computer-readable storage device of claim 15, wherein managing further includes providing a second key of the unique encryption and decryption key pair to each of the instances through a designated cloud resource.
  • 17. The non-transitory computer-readable storage device of claim 16, wherein providing further includes configuring the designated cloud resource to obtain the second key from an external resource that is external to the cloud.
  • 18. The non-transitory computer-readable storage device of claim 14 further comprising, processing secure communication connections for any communication to and from the cloud.
  • 19. A system, comprising: a cloud comprising a plurality of cloud resources, the plurality of cloud resources comprising a plurality of executing instances of a cloud resource;an encrypted data storage; anda cloud router configured to: i) manage the plurality of executing instances of the cloud resource through a single port of a single Internet Protocol (IP) address that is provided for accessing any of the executing instances, ii) perform network address translation on the single port of the single IP address by translating the single IP address to a subnet IP address comprising a range of IP addresses that are assigned to the plurality of executing instances of the cloud resource within the cloud and distinguishing the cloud resource from the plurality of cloud resources, iii) select particular executing instances of the plurality of executing instances to service external requests for the cloud resource based on processing loads for the instances and based on the performing network address translation on the single port of the single IP address that identifies the subnet IP address range for the executing instances within a subnet, iv) select the particular instances from the single IP address based on the private IP addresses being within a port range included as part of the single IP address, v) provide a unique key pair for accessing the encrypted data storage to each of the instances, and vi) provide a first key of the unique key pair to each of the instances during a secure communication session that utilizes a different key pair.
  • 20. The system of claim 19, wherein the cloud router is further configured to: vi) provide a second key of the unique key pair through a designated cloud resource.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 12/613,098, filed Nov. 5, 2009, now issued as U.S. Pat. No. 9,658,891, which claims the benefit under Title 35, United States Code § 119(e) of U.S. Provisional Patent Application No. 61/160,030 filed on Mar. 13, 2009, the disclosure of which is incorporated herein by reference in its entirety. This application is related to the following commonly-assigned, co-pending applications, each of which is also incorporated herein by reference in its entirety: 1. U.S. patent application Ser. No. 12/612,807; 2. U.S. patent application Ser. No. 12/612,818; 3. U.S. patent application Ser. No. 12/612,834; 4. U.S. patent application Ser. No. 12/612,841; 5. U.S. patent application Ser. No. 12/612,882; 6. U.S. patent application Ser. No. 12/612,895; 7. U.S. patent application Ser. No. 12/612,903; 8. U.S. patent application Ser. No. 12/612,925; 9. U.S. patent application Ser. No. 12/613,077; 10. U.S. patent application Ser. No. 12/613,112; and 11. U.S. patent application Ser. No. 12/197,833

US Referenced Citations (70)
Number Name Date Kind
5428738 Carter et al. Jun 1995 A
5608903 Prasad et al. Mar 1997 A
5677851 Kingdon et al. Oct 1997 A
5758344 Prasad et al. May 1998 A
5784560 Kingdon et al. Jul 1998 A
5787175 Carter Jul 1998 A
5832275 Olds Nov 1998 A
5832487 Olds et al. Nov 1998 A
5870564 Jensen et al. Feb 1999 A
5878415 Olds Mar 1999 A
5878419 Carter Mar 1999 A
5956718 Prasad et al. Sep 1999 A
6067572 Jensen et al. May 2000 A
6108619 Carter et al. Aug 2000 A
6119230 Carter Sep 2000 A
6185612 Jensen et al. Feb 2001 B1
6219652 Carter et al. Apr 2001 B1
6275819 Carter Aug 2001 B1
6405199 Carter et al. Jun 2002 B1
6459809 Jensen et al. Oct 2002 B1
6519610 Ireland et al. Feb 2003 B1
6539381 Prasad et al. Mar 2003 B1
6601171 Carter et al. Jul 2003 B1
6647408 Ricart et al. Nov 2003 B1
6650777 Jensen et al. Nov 2003 B1
6697497 Jensen et al. Feb 2004 B1
6738907 Carter May 2004 B1
6742035 Zayas et al. May 2004 B1
6742114 Carter et al. May 2004 B1
6760843 Carter Jul 2004 B1
6772214 McClain et al. Aug 2004 B1
6826557 Carter et al. Nov 2004 B1
6862606 Major et al. Mar 2005 B1
6993508 Major et al. Jan 2006 B1
7043555 McClain et al. May 2006 B1
7107538 Hinckley et al. Sep 2006 B1
7152031 Jensen et al. Dec 2006 B1
7177922 Carter et al. Feb 2007 B1
7185047 Bate et al. Feb 2007 B1
7197451 Carter et al. Mar 2007 B1
7286977 Carter et al. Oct 2007 B1
7290060 Kong Oct 2007 B2
7299493 Burch et al. Nov 2007 B1
7316027 Burch et al. Jan 2008 B2
7334257 Ebrahimi et al. Feb 2008 B1
7356819 Ricart et al. Apr 2008 B1
7363577 Kinser et al. Apr 2008 B2
7376134 Carter et al. May 2008 B2
7386514 Major et al. Jun 2008 B2
7389225 Jensen et al. Jun 2008 B1
7426516 Ackerman et al. Sep 2008 B1
7467415 Carter Dec 2008 B2
7475008 Jensen et al. Jan 2009 B2
7505972 Wootton et al. Mar 2009 B1
7506055 McClain et al. Mar 2009 B2
7552468 Burch et al. Jun 2009 B2
7562011 Carter et al. Jul 2009 B2
8327017 Trost Dec 2012 B1
20020152307 Doyle et al. Oct 2002 A1
20030165121 Leung et al. Sep 2003 A1
20070019540 Biswas Jan 2007 A1
20090046728 Matthews Feb 2009 A1
20090232138 Gobara Sep 2009 A1
20090300719 Ferris Dec 2009 A1
20100125903 Devarajan et al. May 2010 A1
20100161926 Li et al. Jun 2010 A1
20100169497 Klimentiev Jul 2010 A1
20100180335 Smithson Jul 2010 A1
20100228819 Wei Sep 2010 A1
20100235630 Carter et al. Sep 2010 A1
Non-Patent Literature Citations (17)
Entry
U.S. Appl. No. 12/613,098, filed Nov. 5, 2009 System and Method for Providing Key-Encrypted Storage in a Cloud Computing Environment.
U.S. Appl. No. 12/613,098, Non Final Office Action dated May 25, 2012, 15 pgs.
U.S. Appl. No. 12/613,098, Response filed Aug. 27, 2012 to Non Final Office Action dated May 25, 2012, 7 pgs.
U.S. Appl. No. 12/613,098, Final Office Action dated Dec. 5, 2012, 15 pgs.
U.S. Appl. No. 12/613,098, Response filed Feb. 5, 2013 to Final Office Action dated Dec. 5, 2012, 7 pgs.
U.S. Appl. No. 12/613,098, Advisory Action dated Feb. 12, 2013, 3 pgs.
U.S. Appl. No. 12/613,098, Non Final Office Action dated Apr. 23, 2014, 15 pgs.
U.S. Appl. No. 12/613,098, Response filed Jul. 23, 2014 to Non Final Office Action dated Apr. 23, 2014, 7 pgs.
U.S. Appl. No. 12/613,098, Final Office Action dated Nov. 7, 2014, 18 pgs.
U.S. Appl. No. 12/613,098, Response filed Jan. 7, 2015 to Final Office Action dated Nov. 7, 2014, 8 pgs.
U.S. Appl. No. 12/613,098, Advisory Action dated Jan. 27, 2015, 3 pgs.
U.S. Appl. No. 12/613,098, Non Final Office Action dated Jul. 16, 2015, 19 pgs.
U.S. Appl. No. 12/613,098, Response filed Oct. 16, 2015 to Non Final Office Action dated Jul. 16, 2015, 8 pgs.
U.S. Appl. No. 12/613,098, Final Office Action dated Jan. 29, 2016, 18 pgs.
U.S. Appl. No. 12/613,098, Response filed Mar. 29, 2016 to Final Office Action dated Jan. 29, 2016, 9 pgs.
U.S. Appl. No. 12/613,098, Advisory Action dated May 10, 2016, 3 pgs.
U.S. Appl. No. 12/613,098, Notice of Allowance dated Feb. 3, 2017, 14 pgs.
Related Publications (1)
Number Date Country
20170214669 A1 Jul 2017 US
Provisional Applications (1)
Number Date Country
61160030 Mar 2009 US
Continuations (1)
Number Date Country
Parent 12613098 Nov 2009 US
Child 15483810 US