Patent Grant
10628197
OVA (open virtual appliance) template file is a single archive file in TAR file format that contains files for portability and deployment of virtualization appliances. An OVA template file may include an OVF (open virtual format) descriptor file, optional manifest and certificate files, optional disk images (such as VMware vmdk files), optional resource files (such as ISO's) and other supporting files, such as a message bundle file.
In order to deploy a virtual machine (VM) from an OVA template file, the files of the OVA template file, such as OVF descriptor, vmdk, manifest, certificate, and message bundle files, must be retrieved from the OVA template file at different stages of a deployment process, so that the OVA template file can be validated and any needed file is transferred to the destination host computer on which the VM is to be deployed. Thus, if the OVA template file is located at a remote storage location, the entire OVA template file may first have to be downloaded and the files in the OVA template extracted before the extracted files can be used for deployment. Since the OVA template file is typically a large file, this approach would require significant storage to temporary store the OVA template file.
A management system and method for deploying a virtual processing instance from an OVA template file involves accessing the OVA template file stored on a storage of a computer to stream at least one file from the storage of the computer for processing and to transmit a disk image file of the virtual processing instance in the OVA template file from the storage of the computer to a storage of a destination host computer on which the virtual processing instance is to be deployed.
A method for deploying a virtual processing instance from an OVA template file in accordance with an embodiment of the invention comprises accessing the OVA template file stored on a storage of a computer from a deployment module running on a computer system, locating, by the deployment module, a particular file in the OVA template file using at least one header of OVA entries in the OVA template file, streaming the particular file from the storage of the computer to the deployment module for processing, locating, by the deployment module, a disk image file of the virtual processing instance in the OVA template file using at least one header of the OVA entries in the OVA template file, and transmitting the disk image file of the virtual processing instance in the OVA template file from the storage of the computer to a storage of a destination host computer on which the virtual processing instance is to be deployed. In some embodiments, the steps of this method are performed when program instructions contained in a computer-readable storage medium are executed by one or more processors.
A management server in accordance with an embodiment of the invention comprises memory and a processor configured to access an OVA template file stored on a storage of a computer, locate a particular file in the OVA template file using at least one header of OVA entries in the OVA template file, stream the particular file from the storage of the computer to the management server for processing, locate a disk image file of a virtual processing instance in the OVA template file using at least one header of the OVA entries in the OVA template file, and transmit the disk image file of the virtual processing instance in the OVA template file from the storage of the computer to a storage of a destination host computer on which the virtual processing instance is to be deployed.
Other aspects and advantages of embodiments of the present invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrated by way of example of the principles of the invention.
Throughout the description, similar reference numbers may be used to identify similar elements.
It will be readily understood that the components of the embodiments as generally described herein and illustrated in the appended figures could be arranged and designed in a wide variety of different configurations. Thus, the following more detailed description of various embodiments, as represented in the figures, is not intended to limit the scope of the present disclosure, but is merely representative of various embodiments. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by this detailed description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
Reference throughout this specification to features, advantages, or similar language does not imply that all of the features and advantages that may be realized with the present invention should be or are in any single embodiment of the invention. Rather, language referring to the features and advantages is understood to mean that a specific feature, advantage, or characteristic described in connection with an embodiment is included in at least one embodiment of the present invention. Thus, discussions of the features and advantages, and similar language, throughout this specification may, but do not necessarily, refer to the same embodiment.
Furthermore, the described features, advantages, and characteristics of the invention may be combined in any suitable manner in one or more embodiments. One skilled in the relevant art will recognize, in light of the description herein, that the invention can be practiced without one or more of the specific features or advantages of a particular embodiment. In other instances, additional features and advantages may be recognized in certain embodiments that may not be present in all embodiments of the invention.
Reference throughout this specification to “one embodiment,” “an embodiment,” or similar language means that a particular feature, structure, or characteristic described in connection with the indicated embodiment is included in at least one embodiment of the present invention. Thus, the phrases “in one embodiment,” “in an embodiment,” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.
Turning now to
As shown in
Turning now to
In the illustrated embodiment, the VMs 220A, 220B . . . 220L run on “top” of a hypervisor 230, which is a software interface layer that enables sharing of the hardware resources of the host computer 200 by the VMs. However, in other embodiments, one or more of the VMs can be nested, i.e., a VM running in another VM. Any computer virtualization architecture can be implemented. For example, the hypervisor may run on top of the host computer's operating system or directly on hardware of the host computer. With the support of the hypervisor, the VMs provide virtualized computer systems that give the appearance of being distinct from the host computer and from each other. Each VM includes a guest operating system (OS) 232 and one or more guest applications (APP) 234. The guest operating system 232 manages virtual system resources made available to the corresponding VM by the hypervisor 230, and, among other things, the guest operating system forms a software platform on top of which the guest applications 234 run.
Similar to any other computer system connected to the network 102, the VMs 220A, 220B . . . 220L are able to communicate with other computer systems connected to the network using the network interface 228 of the host computer 200. In addition, the VMs are able to access the storage accessible by the host computer using the storage interface 226 of the host computer.
Turning back to
The cluster management server 106 may also perform operations to manage the virtual processing instances and the host computers H-1, H-2 . . . H-M. The cluster management server may be configured to perform various resource management operations for the cluster, including migration of virtual processing instances between the host computers in the cluster for load balancing. The cluster management server may also be configured to manage deployment of virtual processing instances in any of the host computers using templates, such as OVA files, as explained below.
In some embodiments, the cluster management server 106 may be a physical computer that includes at least memory and one or more processors, similar to the host computer 200. In other embodiments, the cluster management server may be implemented as software program running on a physical computer, such as the host computer 200 shown in
In the illustrated embodiment, the cluster management server 106 includes the intelligent deployment module 108, which performs various deployment-related operations so that virtual processing instances can be deployed in the host computers H-1, H-2 . . . H-M using OVA template files on servers, such as the host computers and the web server 104, without having to download and store the entire OVA files from their sources. As described in more detail below, the intelligent deployment module 108 selectively accesses files in an OVA template file, which is stored at a remote storage, i.e., storage that cannot be accessed directly by the cluster management server 106, at different times during a deployment process of a virtual processing instance, such as a VM, to perform deployment-related operations without having to download and store the entire OVA file. The largest file in the OVA file, which is a disk image file for the virtual processing instance being deployed, is streamed or downloaded directly to the destination host computer on which the virtual processing instance is to be deployed.
The cluster management server 106, including the intelligent deployment module 108, can be accessed via a user interface 112, which may be a web-based user interface. The user interface 112 allows a user to deploy virtual processing instances in any of the host computers H-1, H-2 . . . H-M using OVA template files, which may be stored in the storage of the computer system on which the user interface is running or may be stored in remote storages of servers, e.g., web servers. The user interface allows the user to select the OVA template file from which to deploy a virtual processing instance and the destination host computer to which the virtual processing instance is to be deployed. In an embodiment, for an OVA template file stored in a remote storage of a web server, the user may have to enter the URL of the stored OVA template file for deployment. As for an OVA template file stored in the storage 110 of one of the host computers H-1, H-2 . . . H-M, the user may have to enter the file address of the stored OVA template file for deployment.
The web server 104 operates to store, process and deliver content, such as web pages and files, e.g., OVA template files. In an embodiment, communications with the web server can be made using Hypertext Transfer Protocol (HTTP). The web server is connected to a storage 114 so that content stored in the storage can be delivered to a requesting entity, such as the intelligent deployment module 108. The storage 114 can be any type of computer data storage, such as local storage for the web server, a NAS or a SAN. Web servers, such as the web server 104, are well known in the art. Thus, the web server 104 is not described in more detail herein. Although only one web server is shown in
Using the intelligent deployment module 108, virtual processing instances can be deployed in any of the host computers H-1, H-2 . . . H-M in the distributed computer system 100 using OVA template files stored in the storages 110 of the host computers or the storages of the web servers, such as the storage 114 of the web server 104. In the following description, the deployment process executed in the distributed computer system 100 in accordance with embodiments of the invention will be described as deploying VMs. However, the deployment process may be used for deploying other virtual processing entities.
Turning now to
The process of deploying a VM from an OVA template file stored on a web server using the intelligent deployment module 108 in accordance with an embodiment of the invention is described using an example shown in
As shown in
Next, at step 504, the intelligent deployment module 108 creates a deployment session at the cluster management server 106 for the VM deployment. A deployment session is an entity to track the whole deployment operation that involves multiple stages and may take a significant amount of time. In an embodiment, the user can get the state of the deployment operation by calling get( ) API on the deployment session, and can call pre-deploy API to validate the deployment and deploy API to finish the deployment. If any error happens during the operation, the user can find out the reasons via the session. Once the deployment is done, the session state becomes completed and can be deleted.
Next, at step 506, the intelligent deployment module 108 opens a connection with the web server, such as the web server 104 shown in
Next, at step 508, the intelligent deployment module 108 streams a block of OVA file content of size equivalent to the size of the OVF descriptor file from the web server to download only the OVF descriptor file. This step is illustrated in
Next, at step 512, if the OVA file has a manifest file, a certificate file and/or a message bundle file, the intelligent deployment module 108 searches and reads each of these filed contained in the OVA file. In some OVA files, one or more these files may not be present. Thus, depending on the OVA file, the intelligent deployment module may not retrieve any manifest, certificate and message bundle files, or retrieve one or more of these files. The process of searching and reading the manifest, certificate or message bundle file may involve reading the header of the desired file to locate the desired file and to extract the size of the desired file, and then streaming a block of OVA file content of size equivalent to the size of the desired file from the web server to download only the desired file. In an embodiment, the header of the manifest, certificate or message bundle file may be found by streaming the predefined data block of each subsequent OVA entry of the OVA file until the header for the manifest, certificate or message bundle file is found, which is indicated by the file name contained in the header, and then pausing the stream to determine the size of the desired file. Each header of the subsequent OVA entry may be found by reading the header of the previous OVA entry and then jumping to the next OVA entry since the size of the previous OVA entry can be derived from its header. In this fashion, one or more of the manifest, certificate and message bundle files (if available in the OVA file) may be streamed to the intelligent deployment module. This step is illustrated in
Next, at step 514, the intelligent deployment module 108 parses the OVF descriptor file to extract data from the file, such as the checksum of the OVF descriptor file. Next, at step 516, the intelligent deployment module validates the checksum of the OVF descriptor file.
Next, at step 518, the intelligent deployment module 108 performs integrity and authenticity checks using the contents of the manifest file and/or certificate file (if available in the OVA file). In an embodiment, the intelligent deployment module may check to see if the manifest file and/or certificate file are in the same directory as the OVF descriptor and has the same base name. In addition, in this step, the checksum of the manifest file and/or the certificate may be validated.
Next, at step 520, the intelligent deployment module 108 performs message validation on the message bundle file (if available in the OVA file). In an embodiment, this step involves parsing the message bundle file to retrieve a message contained in the message bundle and also parsing the OVF descriptor file again to retrieve a message contained in the OVF descriptor file to determine if the messages match. In addition, in this step, the checksum of the message bundle file may be validated. Next, at step 522, the intelligent deployment module closes the connection with the web server 104.
Next, at step 524 (shown in
Next, at step 530, the user interface 112 call a deploy API of the cluster management server 106. Next, at step 532, in response to the deploy API, the intelligent deployment module 108 opens a connection with the web server 104 using the URL and reads the header for the virtual machine disk image file to locate the virtual machine disk image file and to extract the size of virtual machine disk image file.
Next, at step 534, the intelligent deployment module 108 facilitates the streaming of a block of OVA file content of size equivalent to the size of the virtual machine disk image file from the web server to the destination host computer, which stores the virtual machine disk image file in the storage of the destination host computer. This step is illustrated in
Next, at block 536, the intelligent deployment module 108 performs checksum verification of the streamed virtual machine disk image file. The checksum is calculated on the intelligent deployment module when streaming the content of the disk file. So when the streaming finishes, the intelligent deployment module will compare the calculated checksum of the disk file to the checksum in the manifest file to validate.
Next, at block 538, the intelligent deployment module 108 calls an API of the cluster management server 106 to configure the new VM deployed on the destination host computer and completes the deployment. Next, at step 540, the cluster management server 106 performs operations to configure the VM on the destination host computer. In an embodiment, this step involves three substeps. In the first substep, the cluster management server ends the deployment lease. In the second substep, the cluster management server applies customization on the guest operating system of the VM, such as customization of computer name, IP settings, etc., if specified by the cluster management server. In the third step, the cluster management server closes the deploy session.
The process of deploying a VM from an OVA template file stored on a client computer using the intelligent deployment module 108 in accordance with an embodiment of the invention is described using an example shown in
As shown in
Next, at step 704, the intelligent deployment module 108 creates a deployment session at the cluster management server 106 for the VM deployment.
Next, at step 706, the intelligent deployment module 108 provides one or more HTTPS upload URLs on an API to the user interface 112, which can be used to stream the OVA file from the source client computer to the intelligent deployment module to selectively transfer files in the OVA file needed for the VM deployment to the intelligent deployment module. These files in the OVA file include an OVF descriptor file and may include one or more of manifest, certificate and message bundle files.
Next, at step 708, the user interface 112 opens a connection to the upload URL on the intelligent deployment module 108 for the OVF descriptor file and the manifest and certificate files (if available in the OVA file). Next, at step 710, the intelligent deployment module pulls the OVF descriptor, manifest and/or certificate files of the OVA file using the connection. Next, at step 712, the intelligent deployment module closes the connection to the upload URL after the OVF descriptor, manifest and/or certificate files have been received by the intelligent deployment module. These steps are illustrated in
Next, at step 714, the intelligent deployment module 108 parses the OVF descriptor file to extract data from the file, such as the checksum of the OVF descriptor file. The parsing of the OVF descriptor will also allow the intelligent deployment module to determine whether the OVA file has a message bundle file. The OVF descriptor will also indicate the presence of a virtual machine disk image file in the OVA file. Next, at step 716, the intelligent deployment module validates the checksum of the OVF descriptor file.
Next, at step 718, the intelligent deployment module 108 performs integrity and authenticity checks using the contents of the manifest file and/or certificate file (if available in the OVA file). In an embodiment, the intelligent deployment module may check to see if the manifest file and/or certificate file are in the same directory as the OVF descriptor and has the same base name. In addition, in this step, the checksum of the manifest file and/or the certificate may be validated.
Next, at step 720, the user interface 112 opens a connection to the upload URL on the intelligent deployment module 108 for the message bundle file (if available in the OVA file as indicated in the OVF descriptor). Next, at step 722, the intelligent deployment module pulls the message bundle file of the OVA file using the connection. Next, at step 724, the user interface 112 closes the connection to the upload URL after the message bundle file has been received by the intelligent deployment module. These steps are illustrated in
Next, at step 726 (shown in
Next, at step 728, the user interface 112 calls a pre-deploy application programming interface (API) of the cluster management server 106. Next, at step 730, the cluster management server performs deployment validation operations in response to the deploy API. Deployment validation operations may include determining whether the host computer on which the VM is to be deployed meets the hardware requirements of the VM, such as memory and CPU, and/or policy requirements of the VM being deployed and any existing VMs running on the host computer, such as affinity and anti-affinity requirements. In addition, in response to the pre-deploy API, the cluster management server may return other information, such as the available resources on the target host computer to which the user can choose to deploy the VM. Next, at step 732, the cluster management server generates validation results that can be used for the deployment of the VM in the destination host computer.
Next, at step 734, the user interface 112 call a deploy API of the cluster management server 106. Next, at step 736, in response to the deploy API, the user interface opens a connection to the upload URL on the intelligent deployment module for a virtual machine disk image file of the OVA file.
Next, at step 738, the intelligent deployment module 108 facilitates the streaming of the virtual machine disk image file from the client computer to the destination host computer, which stores the virtual machine disk image file in the storage of the destination host computer. Next, at step 740, the user interface 112 closes the connection to the upload URL after the virtual machine disk image file has been received by the destination host computer. This step is illustrated in
Next, at block 742, the intelligent deployment module 108 performs checksum verification of the streamed virtual machine disk image file.
Next, at block 744, the intelligent deployment module 108 calls an API of the cluster management server 106 to configure the new VM deployed on the destination host computer and completes the deployment. Next, at step 746, the cluster management server performs operations to configure the VM on the destination host computer. In an embodiment, this step involves three substeps. In the first substep, the cluster management server ends the deployment lease. In the second substep, the cluster management server applies customization on the guest operating system of the VM, such as customization of computer name, IP settings, etc., if specified by the cluster management server. In the third step, the cluster management server closes the deploy session.
As described above, the use of the intelligent deployment module 108 allows virtual processing instances, e.g., VMs, to be deployed on host computers using OVA template files stored on web servers or on any client computers without having to transfer the entire OVA template files to the cluster management server 106 to open and use the various files in the OVA template files for deployment. Thus, significant storage and/or network resources can be conserved using the intelligent deployment module.
Although the intelligent deployment module 108 has been described herein as being included in the cluster management server 106, in other embodiments, the intelligent deployment module may be running as a stand-alone module on a different management server or computer system.
In a particular implementation, the intelligent deployment module 108 is part of a content library management module (not shown) running on the cluster management server 106. The content library management module is configured to create and manage one or more content libraries. A content library is a repository for consumable software items, such as virtual machine (VM) templates and virtual application (vApp) templates, as well as other software items, such as ISO files, scripts and text files, for example. A VM template is a master image of a virtual machine that can be used to create new virtual machines. This image typically includes an operating system, applications and configuration settings for the virtual machine. A vApp template is a VM image that is loaded with an operating system, applications and data. vApp templates ensure that virtual machines are consistently configured across an entire organization. Thus, consumable software items can be software items that are used to clone, convert or deploy processing entities. A content library may be a publishing content library, which functions as a source of software items for other content libraries that are subscribed to the publishing content library, i.e., subscribed content libraries. A subscribed content library is a content library that allows the users of the subscribed content library to easily access and use the software items of the publishing content library to which the subscribed content library is subscribed. A single publishing content library may have multiple subscribed content libraries. Thus, the use of content libraries managed by multiple content library management modules running on a distributed computer system easily allows users to share and use software items, in particular the consumable software items. In this implementation, the functionalities of the intelligent deployment module are provided as another service for the content library management module running on the cluster management server 106.
A method for deploying a virtual processing instance from an OVA template file in accordance with an embodiment of the invention is described with reference to a flow diagram of
Although the operations of the method(s) herein are shown and described in a particular order, the order of the operations of each method may be altered so that certain operations may be performed in an inverse order or so that certain operations may be performed, at least in part, concurrently with other operations. In another embodiment, instructions or sub-operations of distinct operations may be implemented in an intermittent and/or alternating manner.
It should also be noted that at least some of the operations for the methods may be implemented using software instructions stored on a computer useable storage medium for execution by a computer. As an example, an embodiment of a computer program product includes a computer useable storage medium to store a computer readable program that, when executed on a computer, causes the computer to perform operations, as described herein.
Furthermore, embodiments of at least portions of the invention can take the form of a computer program product accessible from a computer-usable or computer-readable medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer readable medium can be any apparatus that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
The computer-useable or computer-readable medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device), or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disc, and an optical disc. Current examples of optical discs include a compact disc with read only memory (CD-ROM), a compact disc with read/write (CD-R/W), a digital video disc (DVD), and a Blu-ray disc.
In the above description, specific details of various embodiments are provided. However, some embodiments may be practiced with less than all of these specific details. In other instances, certain methods, procedures, components, structures, and/or functions are described in no more detail than to enable the various embodiments of the invention, for the sake of brevity and clarity.
Although specific embodiments of the invention have been described and illustrated, the invention is not to be limited to the specific forms or arrangements of parts so described and illustrated. The scope of the invention is to be defined by the claims appended hereto and their equivalents.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6718373 | Bearden | Apr 2004 | B1 |
| 7356679 | Le | Apr 2008 | B1 |
| 8990809 | Jacob | Mar 2015 | B1 |
| 9081747 | Tabieros | Jul 2015 | B1 |
| 9965490 | Gerdts | May 2018 | B2 |
| 10048890 | Samad | Aug 2018 | B1 |
| 10108460 | Gopisetty | Oct 2018 | B2 |
| 20070294676 | Mellor | Dec 2007 | A1 |
| 20100332456 | Prahlad | Dec 2010 | A1 |
| 20130124702 | Shah | May 2013 | A1 |
| 20130152080 | Sachindran | Jun 2013 | A1 |
| 20140075021 | Revanuru | Mar 2014 | A1 |
| 20140075520 | Subramanian | Mar 2014 | A1 |
| 20140137114 | Bolte | May 2014 | A1 |
| 20140259014 | Watanabe | Sep 2014 | A1 |
| 20140373011 | Anderson | Dec 2014 | A1 |
| 20150040123 | Gerdts | Feb 2015 | A1 |
| 20160299708 | Yang | Oct 2016 | A1 |
| 20170220335 | Pink | Aug 2017 | A1 |
| 20170371567 | Piduri | Dec 2017 | A1 |
| 20180136962 | Kammampati | May 2018 | A1 |
| 20180181655 | Mateev | Jun 2018 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20190026138 A1 | Jan 2019 | US |
