Model-based virtual system provisioning

Information

  • Patent Grant
  • 10540159
  • Patent Number
    10,540,159
  • Date Filed
    Friday, September 29, 2017
    6 years ago
  • Date Issued
    Tuesday, January 21, 2020
    4 years ago
Abstract
Model-based virtual system provisioning includes accessing a model of a workload to be installed on a virtual machine of a system as well as a model of the system. A workload refers to some computing that is to be performed, and includes an application to be executed to perform the computing, and optionally includes the operating system on which the application is to be installed. The workload model identifies a source of the application and operating system of the workload, as well as constraints of the workload, such as resources and/or other capabilities that the virtual machine(s) on which the workload is to be installed must have. An installation specification for the application is also generated, the installation specification being derived at least in part from the model of the workload and the model of the virtual system.
Description
BACKGROUND

Computers have become increasingly commonplace in our world and offer a variety of different functionality. Some computers are designed primarily for individual use, while others are designed primarily to be accessed by multiple users and/or multiple other computers concurrently. These different functionalities are realized by the use of different hardware components as well as different software applications that are installed on the computers.


Although the variety of available computer functionality and software applications is a tremendous benefit to the end users of the computers, such a wide variety can be problematic for the developers of the software applications as well as system administrators that are tasked with keeping computers running. Such problems can arise, for example, because of differences in configurations or settings that are required by different software applications that a user may try to install on the same computer. Situations can arise where the settings required by one software application cause another software application to malfunction. By way of another example, situations can arise where two software applications have conflicting requirements on how the operating system on the computer should be configured. Such situations can cause one or both of the software applications, and possibly additional applications, to operate incorrectly if both are installed concurrently.


Accordingly, there is a need for an improved way to install software applications on computers.


SUMMARY

This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.


Model-based virtual system provisioning is described herein.


In accordance with certain aspects, a model of a workload to be installed on a virtual machine of a system as well as a model of the system are accessed. A workload refers to some computing that is to be performed, and includes an application to be executed to perform the computing, and optionally includes the operating system on which the application is to be installed. The workload model identifies a source of the application and operating system of the workload, as well as constraints of the workload, such as resources and/or other capabilities that the virtual machine(s) on which the workload is to be installed must have. An installation specification for the application is also generated, the installation specification being derived at least in part from the model of the workload and the model of the virtual system.





BRIEF DESCRIPTION OF THE DRAWINGS

The same numbers are used throughout the drawings to reference like features.



FIG. 1 illustrates an example system definition model (SDM) that can be used with the model-based virtual system provisioning described herein.



FIG. 2 illustrates an example use of types, configurations, and instances.



FIG. 3 is a flowchart illustrating an example process for provisioning a virtual system.



FIG. 4 illustrates an example workload installation specification m additional detail.



FIG. 5 is a flowchart illustrating an example of the generation of a workload installation specification for physical deployment in additional detail.



FIG. 6 illustrates an example general computer environment, which can be used to implement the techniques described herein.





DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

Model-based virtual system provisioning is described herein. An installation specification for provisioning a computing device(s) is generated and subsequently used to provision the computing device(s). The installation specification describes how to install a workload on the computing device(s), the workload referring to some computing that is to be performed. The workload is installed on a virtual machine of the computing device(s), which is typically created as part of the installation process. The installation specification is derived at least in part from a model of the workload to be installed on the computing device(s) and a model of the system in which the application is to be installed (the system including the computing device(s)).


As used herein, an application refers to a collection of instructions that can be executed by a processor, such as a central processing unit (CPU) of a computing device. An application can be any of a variety of different types of software or firmware, or portions thereof. Examples of applications include programs that run on an operating system, the operating system, operating system components, services, infrastructure, middleware, portions of any of these, and so forth.


A system definition model (SDM) describes a system that can be managed. Management of a system can include, for example, installing software on the system, monitoring the performance of the system, maintaining configuration information about the system, verifying that constraints within the system are satisfied, combinations thereof, and so forth. A system can be, for example, an application, a single computing device, multiple computing devices networked together (e.g., via a private or personal network such as a local area network (LAN) or via a larger network such as the Internet), and so forth.


The systems discussed herein can be virtual systems that include one or more virtual machines. A virtual machine can be thought of as a computing device implemented in software. A virtual machine typically emulates a computing device, including all of the hardware components of a computing device, although in some cases the physical devices may be assigned directly to a virtual machine without emulation. A virtual machine runs on a computing device in its own isolated and self-contained environment, having its own operating system and optionally other software installed on it. Multiple virtual machines can be run on the same computing device, each of the multiple virtual machines having its own isolated environment and its own operating system installed thereon. A virtual system includes one or more computing devices that run a virtual machine. A virtual system can include one or more computing devices that already run a virtual machine and/or one or more computing devices that are to have a virtual machine provisioned thereon. A virtual machine can be provisioned on a computing device as part of the virtual system provisioning described herein.


In addition to conventional virtual machines, other forms of containers for workloads are being contemplated or implemented in the industry, such as “sandboxes” that allow a workload to run within an operating system that is shared with other workloads but which nonetheless provide the workloads more isolation than if the workloads were running directly in the operating system. These different containers can be viewed as “lightweight” virtual machines, in the sense that they provide many of the same benefits as traditional virtual machines with less cost or operational overhead. The techniques described herein can be used for such containers as well as traditional virtual systems, and references to virtual machines herein include such other forms of containers.



FIG. 1 illustrates an example SDM 100 that can be used with the model-based virtual system provisioning described herein. SDM 100 includes a component corresponding to each of one or more software and/or hardware components being managed in a virtual system. These software and/or hardware components being managed refer to those software and/or hardware components that the author of SDM 100 and/or designers of the system desires to include in SDM 100. Examples of hardware and/or software components that could be in a system include an application (such as a database application, email application, file server application, game, productivity application, operating system, and so forth), particular hardware on a computer (such as a network card, a hard disk drive, one of multiple processors, and so forth), a virtual machine, a computer, a group of multiple computers, and so on. A system refers to a collection of one or more hardware and/or software components.


SDM 100 represents a system including component 102, component 104, component 106, component 108, component 110, component 112, and component 114. Although the example SDM 100 includes seven components, in practice a system, and thus the SDM, can include any number of components.


For example, component 106 could represent a particular computer, while component 104 represents an operating system running on that particular computer. By way of another example, component 106 could represent an operating system, while component 104 represents a database application running on the operating system. By way of yet another example, component 114 could represent a particular computer, while component 112 represents an operating system installed on that particular computer, component 110 represents a virtual machine running on the operating system, and component 108 represents an operating system running on the virtual machine. Note that the operating systems associated with component 112 and component 108 could be the same or alternatively two different operating systems.


The SDM is intended to be a comprehensive knowledge store, containing all information used in managing the system. This information includes information regarding the particular components in the system, as well as relationships among the various components in the system. Despite this intent, it is to be appreciated that the SDM may contain only some of the information used in managing the system rather than all of the information.


Relationships can exist between different components in a system, and these relationships are typically illustrated in SDM diagrams with lines connecting the related components. Examples of relationships that can exist between components include containment relationships, hosting relationships, and communication relationships. Containment relationships identify one component as being contained by another component—data and definitions of the component being contained are incorporated into the containing component. When a component is installed on a system, any components contained in that component are also typically installed on the system. In FIG. 1, containment relationships are illustrated by the diagonal lines connecting component 102 and component 104.


Hosting relationships identify dependencies among components. In a hosting relationship, the hosting component typically must be present in order for the guest component to be included in the system. In FIG. 1, hosting relationships are illustrated by the vertical lines connecting component 104 and component 106, connecting component 108 and component 110, connecting component 110 and 112, and connecting component 112 and 114.


Communication relationships identify components that can communicate with one another. Communication relationships may or may not imply that a dependency exists between the components. In FIG. 1, communication relationships are illustrated by the horizontal line connecting component 104 and component 108.


Associated with each component in SDM 100 is one or more information (info) pages. Information pages 122 are associated with component 102, information pages 124 are associated with component 104, information pages 126 are associated with component 106, information pages 128 are associated with component 108, information pages 130 are associated with component 110, information pages 132 are associated with component 112, and information pages 134 are associated with component 114. Each information page contains information about the associated component. Different types of information can be maintained for different components. One or more information pages can be associated with each component in SDM 100, and the particular information that is included in a particular information page can vary in different implementations. All the information can be included on a single information page, or alternatively different pieces of information can be grouped together in any desired manner and different types of information, such as one page containing installation information and another page containing constraint information. Alternatively, different types of information may be included on the same page, such as installation information and constraint information being included on the same page.


Examples of types of information pages include installation pages, constraint pages, monitoring pages, service level agreement pages, description pages, and so forth. Installation pages include information describing how to install the associated component onto another component (e.g., install an application onto a computer), such as what files to copy onto a hard drive, what system settings need to be added or changed (such as data to include in an operating system registry), what configuration programs to run after files are copied onto the hard drive, sequencing specifications that identify that a particular installation or configuration step of one component should be completed before an installation or configuration step of another component, and so forth.


Constraint pages include information describing constraints for the associated component, including constraints to be imposed on the associated component, as well as constraints to be imposed on the system in which the associated component is being used (or is to be used). Constraints imposed on the associated component are settings that the component should have (or alternatively should not have) when the component is installed into a system. Constraints imposed on the system are settings (or other configuration items, such as the existence of another application or a piece of hardware) that the system should have (or alternatively should not have) in order for the associated component to be used in that particular system.


It should also be noted that constraints can flow across relationships, example, constraints can identify settings that any component that is contained by the component, or that any component that contains the component, should have (or alternatively should not have). By way of another example, constraints can identify settings that any component that is hosted by the component, or that any component that hosts the component, should have (or alternatively should not have). By way of yet another example, constraints can identify settings that any component that communicates with the component should have (or alternatively should not have).


In addition, constraint pages may also include a description of how particular settings (or components) are to be discovered. For example, if a constraint indicates that an application should not co-exist with Microsoft® SQL Server, then the constraint page could also include a description of how to discover whether Microsoft® SQL Server is installed in the system. By way of another example, if a constraint indicates that available physical memory should exceed a certain threshold, then the constraint page could also include a description of how to discover the amount of available physical memory in the system. By way of still another example, if a constraint indicates that a security setting for Microsoft® SQL Server should have a particular value, then the constraint page could also include a description of how to discover the value of that security setting for Microsoft® SQL Server.


Constraint pages may also include a description of how particular settings are to be modified if they are discovered to not be in compliance with the constraints. Alternatively, the constraint pages could include specifications of some other action(s) to take if particular settings are discovered to not be in compliance with the constraints, such as sending an event into the system's event log, alerting an operator, starting a software application to take some corrective action, and so forth. Alternatively, the constraint pages could include a policy that describes what action to take under various circumstances, such as depending on the time of day, depending on the location of the system.


Constraint pages may also optionally include default values for at least some of these settings, identifying a default value to use within a range of values that satisfy the constraint. These default values can be used to assist in installation of an application, as discussed in more detail below.


Monitoring pages include information related to monitoring the performance and/or health of the associated component. This information can include rules describing how the associated component is to be monitored (e.g., what events or other criteria to look for when monitoring the component), as well as what actions to take when a particular rule is satisfied (e.g., record certain settings or what events occurred, sound an alarm, etc.).


Service level agreement pages include information describing agreements between two or more parties regarding the associated component (e.g., between the purchaser of the associated component and the seller from which the associated component was purchased). These can be accessed during operation of the system to determine, for example, whether the agreement reached between the two or more parties is being met by the parties.


Description pages include information describing the associated component, such as various settings for the component, or other characteristics of the component. These settings or characteristics can include a name or other identifier of the component, the manufacturer of the component, when the component was installed or manufactured, performance characteristics of the component, and so forth. For example, a description page associated with a component that represents a computing device may include information about the amount of memory installed in the computing device, a description page associated with a component that represents a processor may include information about the speed of the processor, a description page associated with a component that represents a hard drive may include information about the storage capacity of the hard drive and the speed of the hard drive, and so forth.


As can be seen in FIG. 1, an SDM maintains various information (e.g., installation, constraints, monitoring, etc.) regarding each component in the system. Despite the varied nature of these information pages, they are maintained together in the SDM and thus can all be readily accessed by various utilities or other applications involved in the management of the system.


An SDM can be generated and stored in any of a variety of different ways and using any of a variety of different data structures. For example, the SDM may be stored in a database. By way of another example, the SDM may be stored in a file or set of multiple files, the files being encoded in XML (Extensible Markup Language) or alternatively some other form. By way of yet another example, the SDM may not be explicitly stored, but constructed each time it is needed. The SDM could be constructed as needed from information existing in other forms, such as installation specifications.


In certain embodiments, the SDM is based on a data structure format including types, instances, and optionally configurations. Each component in the SDM corresponds to or is associated with a type, an instance, and possibly one or more configurations. Additionally, each type, instance, and configuration corresponding to a particular component can have its own information page(s). A type refers to a general template having corresponding information pages that describe the component generally. Typically, each different version of a component will correspond to its own type (e.g., version 1.0 of software component would correspond to one type, while version 1.1 of that software component would correspond to another type). A configuration refers to a more specific template that can include more specific information for a particular class of the type. An instance refers to a specific occurrence of a type or configuration, and corresponds to an actual physical component (software, hardware, firmware, etc.).


For types, configurations, and instances associated with a component, information contained in information pages associated with an instance can be more specific or restrictive than, but generally cannot contradict or be broader than, the information contained in information pages associated with the type or the configuration. Similarly, information contained in information pages associated with a configuration can be more specific or restrictive than, but cannot contradict or be broader than, the information contained in information pages associated with the type. For example, if a constraint page associated with a type defines a range of values for a buffer size, the constraint page associated with the configuration or the instance could define a smaller range of values within that range of values, but could not define a range that exceeds that range of values.


It should be noted, however, that in certain circumstances a model of an existing system as deployed (that is, a particular instance of a system) may violate the information contained in information pages associated with the type for that existing system. This situation can arise, for example, where the system was deployed prior to an SDM for the system being created, or where a user (such as a system administrator) may have intentionally deployed the system in noncompliance with the information contained in information pages associated with the type for that existing system.


The use of types, configurations, and instances is illustrated in FIG. 2. In FIG. 2, a type 202 corresponds to a particular component. Three different instances 204, 206, and 208 of that particular component exist and are based on type 202. Additionally, a configuration (config) 210 exists which includes additional information for a particular class of the particular component, and two instances 212 and 214 of that particular class of the particular component.


For example, assume that a particular component is a database application. A type 202 corresponding to the database application is created, having an associated constraint information page. The constraint information page includes various general constraints for the database application. For example, one of the constraints may be a range of values that a particular buffer size should be within for the database application. Type 202 corresponds to the database application in general.


Each of the instances 204, 206, and 208 corresponds to a different example of the database application. Each of the instances 204, 206, and 208 is an actual database application, and can have its own associated information pages. For example, each instance could have its own associated description information page that could include a unique identifier of the particular associated database application. By way of another example, the constraint information page associated with each instance could include a smaller range of values for the buffer size than is indicated in the constraint information page associated with type 202.


The information pages corresponding to the instances in FIG. 2 can be in addition to, or alternatively in place of, the information pages corresponding to the type. For example, two constraint information pages may be associated with each instance 204, 206, and 208, the first constraint information page being a copy of the constraint information page associated with type 202 and the second constraint information page being the constraint information page associated with the particular instance and including constraints for just that instance. Alternatively, a single constraint information page may be associated with each instance 204, 206, and 208, the single constraint information page including the information from the constraint information page associated with type 202 as well as information specific to the particular instance. For example, the range of values that the particular buffer size should be within for the database application would be copied from the constraint information page associated with type 202 to the constraint information page associated with each instance. However, if the constraint information page for the instance indicated a different range of values for that particular buffer size, then that different range of values would remain in the constraint information page associated with the instance rather than copying the range of values from the constraint information page associated with type 202.


Following this example of a database application, configuration 210 corresponds to a particular class of the database application. For example, different classes of the database application may be defined based on the type of hardware the application is to be installed on, such as different settings based on whether the computer on which the database application is to be installed is publicly accessible (e.g., accessible via the Internet), or based on whether an operating system is already installed on the server. These different settings are


Each of the instances 212 and 214 corresponds to a different example of the database application. Similar to instances 204, 206, and 208, each of instances 212 and 214 is an actual database application, and can have its own information page(s). However, unlike instances 204, 206, and 208, the constraint information pages associated with instances 212 and 214 each include the constraints that are in the constraint information page associated with configuration 210 as well as the constraints in the constraint information page associated with type 202.


It should be noted that, although the information pages are discussed as being separate from the components in the SDM, the data structure(s) implementing the SDM could alternatively include the information discussed as being included in the various information pages. Thus, the component data structures themselves could include the information discussed as being included in the various information pages rather than having separate information pages.


The installation page associated with a component can be used as a basis for provisioning a virtual system. Provisioning a virtual system refers to installing a workload on the virtual system, as well as making any necessary changes to the virtual system in order for the workload to be installed. Such necessary changes typically include creating a new virtual machine, and can also include other actions, such as installing an operating system on the computing device on which the new virtual machine runs or installing an operating system on the newly created virtual machine, setting configuration values for the operating system, installing one or more other applications, configuring a storage system to be accessible to the virtual machine, configuring networks to be accessible to the virtual machine, and so forth. In certain implementations, the workload is installed by creating a new virtual machine on a computing device and copying an image file to the storage device of the computing device. This image file includes an application(s) to be run to perform the computing of the workload, and also typically includes the operating system on which the application(s) is to be run.


In the discussions herein, reference is made to different classes of computing devices. Each of these different classes of computing devices refers to computing devices having particular common characteristics, so they are grouped together and viewed as a class of devices. Examples of different classes of devices include IIS (Internet Information Services) servers that are accessible to the Internet, IIS servers that are accessible only on an internal intranet, database servers, email servers, order processing servers, desktop computers, and so forth. Typically, each different class of computing device corresponds to one of the configurations in the system model.


These different classes of computing devices can be different classes of physical devices, as well as different classes of virtual machines. The classes may distinguish between virtual machine classes and physical device classes. For example, one class may be database virtual machines, another class may be database physical servers (not running the database on a virtual machine), another class may be an order processing virtual machine, another class may be an order processing physical server (not running the order processing application(s) on a virtual machine), and so forth. Alternatively, the classes may not distinguish between virtual machine classes and physical device classes. For example, a single database server class may be used for database servers regardless of whether the database application(s) are run on a virtual machine or a computing device without a virtual machine(s).


Provisioning of virtual systems is based in part on workloads. Generally, a workload is some computing that is to be performed. A workload typically includes an application to be executed to perform the computing, and can also include the operating system on which the application is to be installed. Various configuration information describing how the application and/or operating system is to be configured, as well as data to be used by the application and/or operating system when executing, can also be included in the workload. A model of the workload includes the application, operating system, configuration information, and/or data, as well as constraints of the workload such as resources and/or other capabilities that the virtual machine(s) on which the workload is to be installed must have. Examples of these constraints are discussed below.



FIG. 3 is a flowchart illustrating an example process 300 for provisioning a virtual system. Portions of process 300 can be implemented in software, firmware, and/or hardware.


Initially, a model of a workload is built (act 302). As discussed above, the workload typically includes the application to be installed on a virtual system, and can also include the operating system, configuration information, and/or data. Alternatively, the workload may not include an application, but may include an operating system (or components of an operating system), configuration information, and/or data. The model of the workload can also include one or more constraints.


This building process in act 302 is typically performed by the developer of the workload, although could alternatively be performed by others. This model is an SDM model of the workload, analogous to model 100 of FIG. 1, and includes one or more components. The model of the workload includes types and optionally configurations. As part of the building process in act 302, zero or more information pages are associated with each component in the model. Typically, at least a constraint information page is associated with each component in the model.


As part of the building process in act 302, types and optionally configurations are defined, along with associated information page(s). The types and configurations can be standard types or configurations that are copied or modified in act 302, or alternatively can be newly created in act 302. As discussed above, different constraints can be included in the configuration information page associated with the type and the configuration information page associated with the configuration. The specific constraints included in the configuration information page for a particular workload can vary based on the particular computing to be performed and/or the desires of the designer of the workload.


The constraints included on a constraint information page can take a variety of forms, such as: hardware requirements regarding the computing device(s) or other hardware on which the application is to be installed (e.g., a minimum processor speed, a minimum amount of memory, a minimum amount of free hard drive space, a minimum amount of network bandwidth available, particular security mechanisms available, and so forth), software requirements regarding the computing device(s) or other hardware or software on which the workload is to be installed (e.g., a particular operating system that should already be installed on the computing device(s), one or more other applications that should already be installed on the computing device(s), specifications regarding how particular hardware and/or the operating system is to be configured such as particular settings for the operating system that should already be made, a particular type of security or encryption that should be in use, and so forth), requirements regarding a virtual machine that should be created on a computing device as well as requirements regarding an operating system that should be installed on the virtual machine before the application can be installed thereon, other requirements regarding the computing device(s) on which the workload is to be installed (e.g., particular security keys available, data center policies that should be enforced, authentication that is used, system topology, etc.), and so on.


Constraints can be positive requirements specifying that something should be present (e.g., the processor should have at least a minimum processor speed, or the Windows® XP operating system should already be installed on the computing device). Constraints can also be negative requirements specifying that something should not be present (e.g., one or more particular applications should not already be installed on the computing device, or particular operating system settings should not be present).


One example constraint of the workload is a number and/or size of CPUs that the system on which the workload is to be installed must have. This constraint can identify a specific number of CPUs that the system must have (e.g., 1 CPU, 2 CPUs, 4 CPUs, etc.), or a range of CPUs that the system must have (e.g., 2 to 4 CPUs). The constraint can also specify the size of the CPUs that are needed, referring to the fraction of a CPU that is needed (e.g., a workload may require 100% of 1 CPU, or 50% of each of 2 CPUs). Both requirements and recommendations can be specified (e.g., a minimum of 2 CPUs is required, but 4 or more CPUs should be used if possible).


Another example constraint of the workload is an amount of memory (e.g., RAM). This constraint typically identifies a minimum amount of memory that the system on which the workload is to be installed must have. Both requirements and recommendations can be specified (e.g., a minimum of 2 GB of memory is required, but 4 GB or more of memory should be used if possible).


Another example constraint of the workload is an amount of storage space (e.g., hard disk space, optical disk space, etc.). This constraint typically identifies a minimum amount of storage space that the system on which the workload is to be installed must have. Both requirements and recommendations can be specified (e.g., a minimum of 10 GB of storage space is required, but 15 GB or more of storage space should be used if possible).


Another example constraint of the workload is the hardware type or architecture. For example, particular types of CPUs, particular bus or memory speeds, particular co-processors, and so forth may be required and/or recommended.


Another example constraint of the workload is the type of storage available to the system. This constraint can specify performance and reliability characteristics of the storage (e.g., RAID 1 or RAID 5 is required). This constraint can also specify that access to particular systems or databases is required. Both requirements and recommendations can be specified (e.g., RAID 1 or RAID 5 is required, but RAID 5 should be used if possible).


Another example constraint of the workload is the schedule for the workload, referring to when the computing that is to be performed should be started and/or ended. Both requirements and recommendations can be specified (e.g., the computing must end by 6:00 am, but should end by 5:00 am if possible).


Another example constraint is the events that should trigger the deployment of the workload, referring to when the computing that is to be performed should be started and/or ended. For example, when the same workload is operating on several computing devices with tasks assigned to the individual devices and/or virtual machines by a load balancing device, a monitoring system may determine that the number of incoming requests is exceeding the aggregate capacity of the devices and/or virtual machines, and may send an event indicating that another instance of that workload should be deployed to help carry the load. By way of another example, when a running workload fails because of a software or hardware problem, a monitoring system may send an event that indicates that a replacement copy of that workload should be deployed.


The constraints may also include a combination of events and schedules. For example, a workload may be started by a schedule, and the constraints specify that the workload should be ended and removed from the computing device when processing is finished, as indicated by an event; however, if the processing is not completed when the “batch window closes” at 6:00 am, the workload should be paused and removed from the computing device, and restarted to continue processing when the next “batch window” opens at the following midnight.


These constraints of the workload can refer to constraints on the physical hardware of the virtual system and/or constraints on the virtual hardware of a virtual machine of the virtual system. The model of the workload identifies whether the constraints refer to physical hardware or virtual hardware. Typically, the constraints of the workload identify constraints of the virtual hardware, and these constraints can be compared to the constraints of the system to verify that a virtual machine having virtual hardware satisfying these constraints of the workload can be created. Alternatively, the constraints of the workload can be compared to the constraints of currently running virtual machines to verify that a virtual machine having virtual hardware satisfying these constraints of the workload exists. In another alternative, the constraints of the workload identify constraints of the physical hardware, and these constraints can be compared to the constraints of the system to verify that a computing device satisfying these constraints exists.


Additionally, the workload may have different constraints that apply for different types of deployment. For example, if the workload is deployed and started from a state where it is not previously running, a certain set of constraints apply, but if the workload is started after having been previously executing, paused and saved in a virtual machine image file, another set of constraints apply, and if the workload is to be moved from one computing device to another through a migration process, yet another set of constraints apply.


Additionally, a model of the system where the application is to be installed is built (act 304). This building process in act 304 is typically performed by an administrator of the system where the application is to be installed, although could alternatively be performed by others. This model is an SDM model of the system analogous to model 100 of FIG. 1, and includes one or more components. The model of the virtual system includes types and instances, and optionally configurations.


The system in act 304 can be referred to as a virtual system, although the virtual machine(s) onto which the application and the operating system of the workload are to be installed may not yet be created. As such, the system in act 304 describes the physical computing devices on which virtual machines may be created, and describes virtual machines that have already been created, but does not describe virtual machines that have not yet been created.


The system in act 304 could be a single computing device, or alternatively multiple computing devices. For example, if the application will be installed on a virtual machine of a computing device in a data center having a thousand computing devices, then the model of the system where the application is to be installed will include those thousand computing devices. By way of another example, if the application will be installed on a virtual machine of a home computer that is not coupled to any other computers, then the model of the system where the application is to be installed will include just that home computer.


It should also be noted that the exact nature of a computing device can vary, and that any of a wide variety of computing devices can be a system in act 304. For example, “hierarchical” computers can exist, such as a rack that can contain multiple chassis, each chassis can contain multiple blades, each blade can contain multiple motherboards, each motherboard can contain multiple processors, and each processor can contain multiple cores. Any of these components of such a hierarchical computer can be viewed as a computing device (e.g., the rack can be a computing device, each chassis can be a computing device, each blade can be a computing device, each motherboard can be a computing device, each processor can be a computing device, and/or each core can be a computing device).


The characteristics of each computing device in the hierarchy, and the characteristics of the containment, hosting and communications relationships among them, are typically significant for the placement of virtual machines on those computing devices. For example, the speed of the connection may determine how a workload can be deployed, and therefore a constraint in the workload model indicates that the workload cannot be deployed across several computing devices at a level in the hierarchy where the connection speed is too slow. By way of another example, while it may be possible to deploy a workload down to the level of a single core, it may not be desirable to do so because of unpredictable performance interactions between workloads on the cores within one processor, and in this case the workload model has constraints that the workload should not be deployed on a computing device below the level of a processor in the hierarchy, or below a level where certain performance guarantees can be met, which would be described in the model of the computing device. By way of yet another example, a particular constraint on the workload may specify the software licensing requirements for various types of deployment, where operating systems and applications would have different rules about the licenses required when deploying the workload on a processor, or on a blade with many processors, or across several blades. Under these types of constraints, a particular computing device may not have enough licenses to allow the workload to be deployed, even though it may have enough processing power, memory and storage.


Oftentimes, the model of the system built in act 304 will be generated by the system administrator prior to the workload being designed and the model of the workload being built in act 302. In such situations, the previously generated model can be accessed and need not be re-built in act 304.


Components in the model of the system built in act 304 will include constraint information pages. These constraint information pages include constraints for each component in the virtual system. Such constraint information pages can identify constraints for the corresponding component, and optionally constraints that should be satisfied by any application to be installed on the corresponding component. Both the constraints on the workload and the characteristics of the system may be time-series data, in addition to the possibly time-based nature of the deployment schedule. For example, if once started the workload requires only 1 CPU for half an hour, and then needs 4 CPUs for half an hour, this sequence of values can be represented in the constraints. Similarly, if a computing device has 8 CPUs, but 2 of them are assigned to a workload for 1 hour, and 4 of them are assigned to a workload for 3 hours, and after that no more work is assigned to the computing device, the number of available CPUs can be calculated as 2 CPUs for 1 hour, 4 CPUs for 2 hours after that, and 8 CPUs after that. This time series of available CPUs can be recorded in the characteristics page of the system model


Based on the models built in acts 302 and 304, a logical deployment evaluation is performed (act 306). The logical deployment evaluation involves comparing the model of the workload (from act 302) to the model of the system (from act 304) to determine whether the application could be installed in the system. Typically, the application designer or system administrator will identify a particular class (or classes) of computing device on which he or she desires to install the application. Alternatively, the application may be compared to all classes of computing devices in the system.


The constraints and/or description information for the workload are compared to the constraints for that class of computing device to determine whether the workload satisfies the constraints of the class of computing device, and the constraints and/or description information for the class of computing device are compared to the constraints for the workload to determine whether the class of computing device satisfies the constraints of the workload. The constraints and description information for all components of the class of computing device; including any applications that are hosted by the class of computing device (e.g., an operating system as well as possibly other applications) are also accessed as part of the logical deployment evaluation. These constraints used in the logical deployment evaluation can include constraints that are flowed across relationships, as discussed above. These constraints used in the logical deployment evaluation can also include time-series based constraints, as discussed above. Accessing the constraints for the operating system and other applications allows verification that, if installed on a device of the class of computing device, settings made on the computing device for the workload would not conflict with current settings for other applications installed on the computing device. The verification can use the scheduled start time of the workload, and the time-series of constraints and system characteristics, and can verify that the time profile of resources available on the system satisfies the time profile of requirements of the workload. In embodiments in which a virtual machine is being installed onto which the application will be installed, the evaluation in act 306 includes evaluating that any constraints of the virtual machine are satisfied by the class of computing device in order to verify that the virtual machine can be installed on the class of computing device.


By way of example, a particular constraint on the class of computing device may indicate that a software firewall should always be running on the class of computing device. A description page associated with the workload would be accessed to verify that the workload does not require a software firewall to be deactivated.


By way of another example, a particular constraint on the workload may indicate that the computing device should have a minimum processor speed. A description page associated with the class of computing devise (or the processor of the class of computing device) would be accessed to verify that the speed of the processor is at least the minimum processor speed. As discussed above, this processor speed could refer to the speed of the virtual processor of the virtual machine on which the workload would be installed, or the speed of the physical processor of the class of computing device on which the virtual machine is installed. Furthermore, the fractional parts of the physical processor may be allocated to each virtual machine, and each such fractional part serves as the virtual processor for the virtual machine to which the part is allocated. As a fractional part of the physical processor could not be allocated as a virtual processor with a faster speed than the physical processor, a check would be made to ensure that the speed of the physical processor satisfies the constraint. Furthermore, a check would also be made that the fractional part of the physical processor can be allocated to the virtual machine to create a virtual processor that satisfies the constraint. This check can be performed by checking a description page associated with the system, or by communicating a request or query to a virtual system management component as to whether it would be able to create such a virtual machine having a virtual processor satisfying the constraint. It is to be appreciated that such speeds of virtual processors can vary depending on the number of other virtual machines that are already running on the computing device, as the presence of such other virtual machines will affect the fractional part of the physical processor that can be allocated to the virtual machine.


By way of yet another example, a particular constraint on the workload may indicate that the computing of the workload should be performed between midnight and 4:00 am. A description page associated with the class of computing device would be accessed to verify that the computing device has sufficient processing capacity (in light of other workloads already scheduled to be performed between midnight and 4:00 am) to have a new virtual machine (or alternatively an existing virtual machine) perform the computing of the workload.


It should be noted that, depending on the manner in which virtual machines are created and managed, it may be possible for a class of computing device to “overcommit” its resources. For example, three different virtual machines may each require 4 GB of memory, but a particular class of computing device may only have 8 GB of memory. In such situations, all three virtual machines could be run on that class of computing device by running only two of the three virtual machines concurrently, or all three virtual machines could be run simultaneously (on the assumption that the workloads will on the average share some memory pages that are used for read-only access). By way of another example, two different virtual machines may each require 100 GB of storage space, but a particular class of computing device may only have 160 GB of storage space. In such situations, both virtual machines could be run on that class of computing device by running the two virtual machines at separate times, or both virtual machines could be run simultaneously (on the assumption that they will not both make full demands on the storage space at the same time). The models of the workloads indicate whether such overcommitment is possible and whether it is desirable.


It should also be noted that whatever components are referenced by constraints in the SDM are evaluated in act 306, regardless of what those components are. Typically, constraints of the class of computing device are evaluated in act 306 down to the layer that is hosting the workload being installed, but may extend to other layers if referenced in the SDM. By way of example, assume that a virtual machine is being provisioned on a computing device, and a workload is being provisioned on the virtual machine. Typically, constraints of the virtual machine would be evaluated against the computing device and the operating system running on the computing device, while constraints of the workload would be evaluated against the virtual machine. However, if the workload had a constraint referencing the computing device itself (e.g., regarding physical protection of the computing device on which the workload is deployed), then that constraint of the workload would be evaluated against the computing device.


The results of the evaluation in act 306 can be returned to the workload designer and/or system administrator. An indication of success (if all of the constraints are satisfied) or failure (if all of the constraints are not satisfied) can be returned. In addition, if one or more of the constraints are not satisfied, then an indication of which constraint was not satisfied can be returned, as well as optionally an indication of which component caused the constraint to not be satisfied. Optionally, the evaluation can indicate whether the constraints that were not satisfied were mandatory or recommended constraints. Returning such information can assist the workload developer in modifying the workload so that it can be installed in the system, and in choosing which of the available systems would be most suited for the workload.


Process 300 then proceeds based on the results of the evaluation in act 306. If the evaluation indicates that the workload can be installed in the system, then different class of computing device in the system. However, if the evaluation indicates that the workload cannot be installed in the system, then the evaluation of act 306 can be repeated for a different class of computing device in the virtual system, or alternatively the workload may be modified in order to overcome the problem(s) identified in the evaluation of act 306, and process 300 can return to act 302 to build a model of the modified workload. If time-series based constraints are not met by the system, and if the scheduled start time is specified as a recommended rather than required start time, the verification can evaluate whether the constraints can be met by a later or earlier start time and can return a list of possible classes of computing devices with the possible start time for each one.


In act 308, physical deployment of the workload is determined. Determining physical deployment of the workload refers to identifying which particular computing device(s) will perform the computing of the workload (and optionally have a new virtual machine created thereon to perform the computing of the workload). The particular computing device(s) which will perform the computing of the workload can be identified in different manners. One way in which the particular computing device(s) will perform the computing of the workload can be identified is manually, such as by a system administrator or other party manually selecting a particular computing device(s). This manually selected computing device(s) could be a computing device already(s) in the system, or alternatively a new computing device(s) that needs to be purchased or a computing device(s) that needs to be removed from storage and added to the system (e.g., coupled to the network that the other computing devices in the system are coupled to).


Alternatively, the particular computing device(s) which will perform the computing of the workload can be identified automatically. An application running in the system can identify various characteristics of the computing devices on which a virtual machine could be created and the workload installed thereon (e.g., the computing devices of the particular class of computing device on which the application is to be installed), such as load characteristics of each computing device. The load characteristics could identify, for example, the average or maximum amount of processor usage, the average amount of memory usage, the amount of available network bandwidth being used, the amount of hard disk drive space being used, and so forth. Based on these load characteristics, the computing device(s) most likely to be able to support the new virtual machine and the workload would be identified as the computing device(s) on which the computing of the workload is to be performed (e.g., the computing device having the lightest load, such as the lowest average processor usage, the smallest amount of available network bandwidth being used, the most hard disk drive space available, and so forth). If no computing device can meet the recommended schedule, but several can meet the required schedule, the computing device that comes closest to meeting the recommended schedule could be identified.


It should be noted that typically a new virtual machine is created as part of installing the workload. Thus, the characteristics of the computing devices are evaluated for purposes of determining which computing device(s) will have the new virtual machine created thereon and will perform the computing of the workload. Alternatively, a new virtual machine may not be created, and the workload may be installed on an already running virtual machine. In such situations, the characteristics of the currently running virtual machines are evaluated for purposes of determining which virtual machine(s) will perform the computing of the workload.


Alternatively, the particular computing device(s) which will perform the computing of the workload can be identified in a semi-automatic manner. An application running in the system can identify various characteristics of the computing devices on which the virtual machine could possibly be created and the computing of the workload could possibly be performed (or characteristics of the virtual machines on which the workload could possibly be performed) analogous to the automatic manner, and then present those results to a user (such as the system administrator) for manual selection of one or more of the computing devices (or virtual machines). One or more of the computing devices may optionally be recommended to the user as the best candidate(s) for selection, but the ultimate selection would remain at the user's discretion.


Additionally, priorities of different workloads may be used as part of the physical deployment determining of act 308. Workloads can optionally be assigned priorities, allowing the importance of the workloads relative to one another to be identified. These priorities are typically included in the model of the workload or the workload itself, but alternatively may be maintained elsewhere. Higher priority workloads can be given access to resources of the virtual system before lower priority workloads. This can result in situations where, for example, higher priority workloads can be performed by a computing device(s), but there are insufficient resources for lower priority workloads to be performed. This can also result in situations where, for example, higher priority workloads are given the resources recommended by the constraints of the workload, whereas lower priority workloads are given only the resources required by the constraints of the workload.


In addition, selection of different sources of data and/or other systems to which access is needed may be performed as part of the physical deployment determining of act 308. For example, multiple sources may exist from which data identified as being required in the model of the workload can be obtained, or multiple replicated file servers may exist that can be a file server identified as being required in the model of the workload. Particular sources of data and/or other systems to which access is needed may be selected in act 308 based on various factors, such as the load on the various sources and/or other systems, the bandwidth of the connection to those sources and/or systems, and so forth. Alternatively, rather than being performed as part of act 308, selection of such sources of data and/or other systems to which access is needed may be performed as part of the physical deployment in act 312 discussed below.


It should be noted that one additional factor that can be optionally taken into account when identifying the characteristics of the various computing devices is that virtual machines can be rearranged to run on different computing devices. For example, a virtual machine running on one computing device could be moved to another computing device, thereby freeing up capacity on the original computing device. Such a process of moving or rearranging virtual machines is also referred to as migration of the virtual machines. Virtual machines can be migrated in any of a variety of manners, such as with the assistance of the Virtual Server Migration Toolkit (VEST) available from Microsoft Corporation of Redmond, Wash.


Accounting for the possibility of migrating virtual machines allows the load characteristics of the computing devices to be changed by migrating the virtual machines. For example, the situation may arise where none of the computing devices have the desired spare capacity to create a virtual machine on which the application could be installed, but that capacity of one of the computing devices could be released by moving a virtual machine from that one computing device to another of the computing devices. After the virtual machine is moved, however, the released capacity results in that one computing device having sufficient capacity so that the new virtual machine on which the application is to be installed can be created and the application installed on that new virtual machine.


This identification of which computing device should perform the is computing of the workload, and optionally which virtual machines should be migrated to different computing devices, is performed as part of the physical deployment determining of act 308.


A workload installation specification for physical deployment of the workload is then generated (act 310). The workload installation specification can be saved as an installation page associated with the component representing the workload in the workload model. The workload installation specification includes an identification, for each class of device in the virtual system on which the workload may be installed, of how to install the workload. As each of these identifications indicates how to install the workload on a particular class of devices, these identifications can also be referred to as device class installation specifications. The device class installation specifications can also identify which particular computing device(s) of that class the workload is to be installed on (the computing device(s) determined in act 308).


This identification of how to install the workload includes, for example, all of the settings for the virtual machine to be created on the device; the operating system to install on the virtual machine (including all of the settings of the operating system and the identification of all of the files that need to be copied to the virtual machine to install the operating system), all of the settings of the computing device that should be made or changed, an identification of all of the files that need to be copied to the computing device and where those files should be copied, an order in which files should be copied and/or settings made or changed, any initialization programs that need to be run after the files have been copied and/or settings made or changed, and so forth. This identification may also include installing an operating system and/or one or more additional applications on the computing device prior to creating the virtual machine on the device. For example, one class of computing device may be a bare computing device with no operating system installed on it. In such situations, the installation specification for that class of computing device would include initially installing the appropriate operating system on the computing device, followed by creating the virtual machine on the computing device, then installing an operating system on the virtual machine, and then installing the application on that operating system of the virtual machine.


In certain implementations, this identification of how to install the workload identifies a particular image file that is the image to be run to perform the computing of the workload. The image file can be created as part of the process of building the model of the workload in act 302, or alternatively can be created at other times (e.g., after the logical deployment evaluation has been performed in act 306). The image file includes the application files and data, and optionally the files and data for the operating system on which the application will be executed, for the workload. The image file can be copied to a disk drive or other storage device and executed by a virtual machine to perform the computing of the workload—no additional installation or configuration of the operating system or the application of the workload is typically required. The image file can be generated in any of a variety of conventional manners, such as by installing the application and operating system onto a virtual machine and generating a file that includes all the folders and files installed onto that virtual machine, by a user (e.g., the designer of the workload) manually identifying the folders and files to be included in the image file, and so forth. The image file can then be simply copied to the computing device(s) as part of the physical deployment in act 312 discussed below.


Additionally, if any migration of virtual machines is to be performed for a particular class of device, as identified in act 308, then the device class installation specification for that class of device includes an indication of the migration that is to be performed and the constraints that must be met for that type of migration.


At least a portion of each device class installation specification can be generated automatically based on the information contained in the information pages associated with the workload to be installed. As discussed above, the constraint information page can include various default values. These default values can be used during act 310 to identify the settings or configuration values that should be set when installing the workload, and thus which should be included in the device class installation specification. For example, a particular default value may be included in the configuration information page for a buffer size. This default value would be included in the device class installation specification so that when the workload is installed on a particular computing device, the computing device settings (such as in an operating system registry) can be modified to include this default value for the buffer size (possibly replacing another value for the buffer size previously stored in the computing device settings).


In addition to default values, other constraint information included in the constraint information page can be used in act 310 to identify the settings or configuration values that should be set when installing the workload. If a range of values for a particular setting were included in the constraint information page, then a setting to be used when installing the application can be derived from that range. For example, the lowest value in the range could be selected, the highest value in the range could be selected, the average of the highest and lowest values in the range could be computed and selected, a value in the range could be selected randomly, and so forth.


Furthermore, in addition to information contained in the information pages associated with the workload, information contained in the information pages associated with the virtual system (such as the computing device on which the application is to be installed) can be used as a basis for automatically generating at least a portion of each device class installation specification. Default values and/or ranges of values can be used to automatically generate values for the device class installation specification in the same manner as discussed above.


It should also be noted that different components can have different constraints and different default values for the same settings or configuration values. In such situations, even though there is overlap of the constraints so that the different components can all be installed on a computing device, one or more of the default values may violate the constraints of another component. Thus, a suitable value that is compliant with the constraints of all of the components is determined. This suitable value can be determined in different manners, including manually, automatically, and semi-automatically. A suitable value can be determined manually by a user (such as the system administrator) inputting a suitable value for the setting or configuration value.


A suitable value can be determined automatically by evaluating the various constraints and selecting a value that satisfies all the constraints. This selected value is then used as the suitable value. For example, if each constraint lists a range of acceptable values, then a value that falls within each range of acceptable values can be automatically identified and used as the suitable value.


A suitable value can be determined semi-automatically by evaluating the various constraints and selecting a value that satisfies all the constraints analogous to the automatic manner. However, rather than automatically using the selected value as the suitable value, the selected value can be presented to a user (such as the system administrator) for approval. The user can accept this selected value, or alternatively input a different value. Alternatively, rather than presenting a single selected value to the user, the range of possible values (or portion of the range of possible values) that satisfies the constraints of the different components may be presented to the user.


It should further be noted that at least a portion of a device class installation specification may be generated manually rather than automatically. This manual generation refers to user inputs (such as by the application developer or system administrator) rather than automatic generation by some component or module (e.g., development module 400 discussed below). For example, the particular files to be identified in the device class installation specification may be identified manually rather than automatically.


Additionally, an assignment record is generated in act 310 that maintains a record of which device class installation specifications are to be used for which device classes. This record can be, for example, a mapping of device class to device class installation specification. Thus, given the workload installation specification including multiple device class installation specifications, a determination as to which particular device class installation specification to use can be made based on the class of the device on which the workload is to be installed. The assignment record generated can also be stored as part of the workload installation specification.


Alternatively, rather than having a separate assignment record, an identification of which device class installation specification is associated with which particular class of device may be maintained in other manners. For example, the indication may be inherent in the naming convention used for the device class installation specification (e.g., each device class installation specification may be a separate file having a file name that identifies the particular class of device), or each device class installation specification may include an indication of the associated class of device.


The workload installation specification is generated after the logical deployment evaluation in act 306. Thus, the application installation specification is generated only after it is verified that the workload can be installed in the system. Additionally, the constraint information (such as default values) associated with the workload can be used to determine settings to be included in the workload installation specification. Thus, it can be seen that the workload installation specification generated in act 310 is derived at least in part from the model of the workload as well as the model of the system.


After the workload installation specification IS created, physical deployment of the workload is performed (act 312). The timing of the physical deployment can vary. Deployment may be triggered manually, such as by a user (such as the system administrator) specifying that deployment should begin “now” or at a particular time in the future. Deployment may also be triggered based on other events and/or schedules identified in the workload as discussed above.


In certain implementations, this physical deployment includes making the workload installation specification available to a deployment system and having the deployment system create a new virtual machine on the particular device identified in act 308, and also copy the image file identified by the workload on the particular device identified in act 308 for execution by the newly created virtual machine. In other implementations, this physical deployment includes making the workload installation specification available to a deployment system and having the deployment system create a new virtual machine on the particular device identified in act 308 and install the application on that new virtual machine following the installation instructions in the workload installation specification.


Once the deployment system is given the workload installation specification, the deployment system operates in a conventional manner to install the workload. If the application installation specification indicates that migration of any virtual machines is to be performed, then this migration can also be carried out by the deployment system (optionally with the assistance of another component, such as the Virtual Server Migration Toolkit discussed above). Any of a variety of deployment systems could be used in act 312, such as the Windows® Installer service or Microsoft® Systems Management Server, both available from Microsoft Corporation of Redmond, Wash.


Once the workload is installed on a computing device, the new virtual machine and the application installed thereon becomes part of the system and thus the workload model is incorporated into the system model and a component for the new virtual machine (as well as the operating system for the new virtual machine, and any other components running on the virtual machine) is added to the system model. Thus, after installation of the application, the SDM for the system includes the SDM of the workload. This includes modifying characteristics of the system such as available number of CPUs, which might be time-series based to reflect the allocation of CPUs to scheduled workloads and the time-series based requirements of CPUs of those workloads.


Alternatively, the evaluation in act 306 may be for a particular computing device or virtual machine rather than for a class of computing device. In this alternative, the evaluation in act 306 is the same as discussed above, except that constraint and description information for a particular instance of a computing device are used rather than constraint and description information for a class of computing device. In such situations, the identification of the particular computing device is made in, or prior to, act 306 rather than in act 308, and can be made in the same manner as discussed in act 308.


It should also be noted that a particular device class installation specification may indicate to install the whole workload or individual components of the workload on multiple different computing devices within the system. For example, the workload developer or system administrator may desire to install the workload on all of the computing devices of a particular class. By way of another example, the workload developer or system administrator may desire to install each part of the workload on a computing device of a specific class. In such a situation, an indication is included in the device class installation specification for that particular device class that the workload is to be installed on all of the computing devices of that particular class, or alternatively may identify the particular computing devices (e.g., by name or other unique identifier) on which the workload is to be installed. The installation instructions may also identify the sequence in which the parts of the workload are to be installed on each system, and how to coordinate the installation steps by waiting for the completion of one step before proceeding with the next, using conventional orchestration technologies. The deployment system used to install the workload receives this indication and installs the workload on the appropriate computing devices.



FIG. 4 illustrates an example workload installation specification m additional detail. An installation specification development module 400 generates a workload installation specification 402. Installation specification module 400 can be implemented in software, firmware, hardware, or combinations thereof, and can perform act 310 of FIG. 3, and optionally additional acts of FIG. 3 (such as act 306 and/or act 308). Workload installation specification 402 includes multiple (x) device class installation specifications 404(1), 404(2), . . . 404(x). Each of the device class installation specifications 404 identifies how the workload is to be installed on a particular class of computing device. Workload installation specification 402 also includes specification assignment record 406 to identify which specification 404 corresponds to which class of computing device.


Workload installation specification 402 is input to a deployment system 408 along with any necessary installation file(s) 410. Installation file(s) 410 include the file(s) that are to be installed on the computing device in order to install the application, such as one or more files of executable code, one or more files of data, an image file, and so forth. Alternatively, although illustrated separately, workload installation specification 402 and installation file(s) 410 may be stored together in a single package (e.g., a compressed file).



FIG. 5 is a flowchart illustrating the generation of a workload installation specification for physical deployment of act 310 of FIG. 3 in additional detail. FIG. 5 can be implemented in software, firmware, and/or hardware.


Initially, a device class on which the workload could be installed is selected (act 502). In certain embodiments the system administrator and/or workload developer (or alternatively some other party) may desire that the workload be installed only on certain classes of devices, in which case the devices on which the workload could be installed is less than all of the devices in the system. Alternatively, the workload may be able to be installed on any device in the system.


A device class installation specification for the selected device class is then generated, identifying how to install the workload and virtual machine on the selected device class (act 504). As discussed above, this generation can include using default values included in an information page associated with the workload in the workload model for setting values to include in the installation specification being generated.


In some situations, the device class installation specification is generated in a format that is expected and understood by a deployment system that will be installing the workload and the virtual machine. The device class installation specification may be generated in this format in act 504, or alternatively may be subsequently translated into this format (e.g., by a translation component of the distribution system).


It should be noted that different device installation specifications may be generated for computing devices that will have the same functionality but are currently configured differently, such as computing devices that do not yet have an operating system installed and computing devices that already have an operating system installed. Alternatively, such computing devices may be considered to be part of the same device class, but the device class installation specification would include a conditional portion to be used based on the configuration of the particular instance of the computing device on which the application is being installed (e.g., the conditional portion may be bypassed if the computing device already has an installed operating system, or used to install an operating system on the computing device if an operating system is not already installed on the computing device).


A check is then made as to whether there are any additional device class(es) in the virtual system for which no device class installation specification has been generated (act 506). If there are any such additional device class(es), then one such additional device class is selected (act 508) and the process returns to act 504 to generate a device class installation specification for the selected device class.


Returning to act 506, if device class installation specifications have been generated for all of the device class(es), then a specification assignment record is generated associating particular installation specifications with particular device classes (act 510). Alternatively, the specification assignment record may be generated in act 504 as the device class installation specifications are being generated, and an indication of which device class is associated with which device class installation specification added to the specification assignment record as the device class installation specification is generated.


The device class installation specifications generated in act 504 and the assignment record generated in act 510 are then combined into a workload installation specification for the application (act 512).



FIG. 6 illustrates an example general computer environment 600, which can be used to implement the techniques described herein. The computer environment 600 is only one example of a computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the computer and network architectures. Neither should the computer environment 600 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the example computer environment 600.


Computer environment 600 includes a general-purpose computing device in the form of a computer 602. Computer 602 can be, for example, a computing device on which an application is installed or a computing device on which at least portions of process 300 of FIG. 3 are implemented. Computer 602 can be, for example, a desktop computer, a handheld computer, a notebook or laptop computer, a server computer, a game console, and so on. The components of computer 602 can include, but are not limited to, one or more processors or processing units 604, a system memory 606, and a system bus 608 that couples various system components including the processor 604 to the system memory 606.


The system bus 608 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures can include an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnects (PCI) bus also known as a Mezzanine bus.


Computer 602 typically includes a variety of computer readable media. Such media can be any available media that is accessible by computer 602 and includes both volatile and non-volatile media, removable and non-removable media.


The system memory 606 includes computer readable media in the form of volatile memory, such as random access memory (RAM) 610, and/or non-volatile memory, such as read only memory (ROM) 612. A basic input/output system (BIOS) 614, containing the basic routines that help to transfer information between elements within computer 602, such as during start-up, is stored in ROM 612. RAM 610 typically contains data and/or program modules that are immediately accessible to and/or presently operated on by the processing unit 604.


Computer 602 may also include other removable/non-removable, volatile/non-volatile computer storage media. By way of example, FIG. 6 illustrates a hard disk drive 616 for reading from and writing to a non-removable, non-volatile magnetic media (not shown), a magnetic disk drive 618 for reading from and writing—to a removable, non-volatile magnetic disk 620 (e.g., a “floppy disk”), and an optical disk drive 622 for reading from and/or writing to a removable, non-volatile optical disk 624 such as a CD-ROM, DVD-ROM, or other optical media. The hard disk drive 616, magnetic disk drive 618, and optical disk drive 622 are each connected to the system bus 608 by one or more data media interfaces 626. Alternatively, the hard disk drive 616, magnetic disk drive 618, and optical disk drive 622 can be connected to the system bus 608 by one or more interfaces (not shown).


The disk drives and their associated computer-readable media provide nonvolatile storage of computer readable instructions, data structures, program modules, and other data for computer 602. Although the example illustrates a hard disk 616, a removable magnetic disk 620, and a removable optical disk 624, it is to be appreciated that other types of computer readable media which can store data that is accessible by a computer, such as magnetic cassettes or other magnetic storage devices, flash memory cards, CD-ROM, digital versatile disks (DVD) or other optical storage, random access memories (RAM), read only memories (ROM), electrically erasable programmable read-only memory (EEPROM), and the like, can also be utilized to implement the exemplary computing system and environment.


Any number of program modules can be stored on the hard disk 616, magnetic disk 620, optical disk 624, ROM 612, and/or RAM 610, including by way of example, an operating system 626, one or more application programs 628, other program modules 630, and program data 632. Each of such operating system 626, one or more application programs 628, other program modules 630, and program data 632 (or some combination thereof) may implement all or part of the resident components that support the distributed file system.


A user can enter commands and information into computer 602 via input devices such as a keyboard 634 and a pointing device 636 (e.g., a “mouse”). Other input devices 638 (not shown specifically) may include a microphone, joystick, game pad, satellite dish, serial port, scanner, and/or the like. These and other input devices are connected to the processing unit 604 via input/output interfaces 640 that are coupled to the system bus 608, but may be connected by other interface and bus structures, such as a parallel port, game port, or a universal serial bus (USB).


A monitor 642 or other type of display device can also be connected to the system bus 608 via an interface, such as a video adapter 644. In addition to the monitor 642, other output peripheral devices can include components such as speakers (not shown) and a printer 646 which can be connected to computer 602 via the input/output interfaces 640.


Computer 602 can operate in a networked environment using logical connections to one or more remote computers, such as a remote computing device 648. By way of example, the remote computing device 648 can be a personal computer, portable computer, a server, a router, a network computer, a peer device or other common network node, and the like. The remote computing device 648 is illustrated as a portable computer that can include many or all of the elements and features described herein relative to computer 602.


Logical connections between computer 602 and the remote computer 648 are depicted as a local area network (LAN) 650 and a general wide area network (WAN) 652. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets, and the Internet.


When implemented in a LAN networking environment, the computer 602 is connected to a local network 650 via a network interface or adapter 654. When implemented in a WAN networking environment, the computer 602 typically includes a modem 656 or other means for establishing communications over the wide network 652. The modem 656, which can be internal or external to computer 602, can be connected to the system bus 608 via the input/output interfaces 640 or other appropriate mechanisms. It is to be appreciated that the illustrated network connections are exemplary and that other means of establishing communication link(s) between the computers 602 and 648 can be employed.


In a networked environment, such as that illustrated with computing environment 600, program modules depicted relative to the computer 602, or portions thereof, may be stored in a remote memory storage device; By way of example, remote application programs 658 reside on a memory device of remote computer 648. For purposes of illustration, application programs and other executable program components such as the operating system are illustrated herein as discrete blocks, although it is recognized that such programs and components reside at various times in different storage components of the computing device 602, and are executed by the data processor(s) of the computer.


Various modules and techniques may be described herein in the general context of computer-executable instructions, such as program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Typically, the functionality of the program modules may be combined or distributed as desired in various embodiments.


An implementation of these modules and techniques may be stored on or transmitted across some form of computer readable media. Computer readable media can be any available media that can be accessed by a computer. By way of example, and not limitation, computer readable media may comprise “computer storage media” and “communications media.”


“Computer storage media” includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer.


“Communication media” typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier wave or other transport mechanism. Communication media also includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Combinations of any of the above are also included within the scope of computer readable media.


Alternatively, portions of the framework may be implemented in hardware or a combination of hardware, software, and/or firmware. For example) one or more application specific integrated circuits (ASICs) or programmable logic devices (PLDs) could be designed or programmed to implement one or more portions of the framework.


CONCLUSION

Although the invention has been described in language specific to structural features and/or methodological acts, it is to be understood that the invention defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as exemplary forms of implementing the claimed invention.

Claims
  • 1. A method for installing a workload on a virtual machine, wherein the virtual machine is created on a computing device to provide virtualized components of a system, comprising: accessing a model of a workload to be installed on the virtual machine of the system;accessing a model of the system;generating an installation specification for the workload, the installation specification being derived at least in part from the model of the workload and the model of the system; andinstalling an application and operating system on the virtual machine;wherein the installation specification includes information identifying how to install the workload, including: (1) settings for the virtual machine to be created on the computing device, (2) the operating system to install on the virtual machine, including settings of the operating system and identification of files to be copied to the virtual machine for installing the operating system; (3) settings of the computing device to be made or changed; (4) an identification of files to be copied to the computing device and where those files are to be copied; (5) an order in which files are to be copied and/or settings made or changed; and (6) any initialization programs to be run after the files have been copied and/or settings made or changed.
  • 2. The method of claim 1, wherein the workload includes the application and operating system installed on the virtual machine.
  • 3. The method of claim 1, wherein the installation specification identifies an image file of the workload that is to be copied to a storage device of the system.
  • 4. The method of claim 1, wherein the installation specification includes an indication to migrate another virtual machine from one computing device to another computing device.
  • 5. The method of claim 1, further comprising generating a plurality of device class installation specifications for the workload, each of the plurality of device class installation specifications being for a different one of a plurality of classes of devices in the system on which the workload could be installed.
  • 6. The method of claim 5, further comprising generating a record associating each of the plurality of device class installation specifications with one of the plurality of classes of devices.
  • 7. The method of claim 1, further comprising performing, prior to generating the installation specification, a logical deployment evaluation to determine whether the workload could be installed in the system, the performing comprising comparing constraints associated with the workload to constraints associated with the system.
  • 8. The method of claim 7, wherein the constraints associated with the workload include software licensing requirements.
  • 9. The method of claim 1, further comprising identifying, prior to generating the installation specification, which one or more computing devices of a plurality of computing devices in the system is to have the workload installed thereon.
  • 10. One or more computer readable storage media having stored thereon a plurality of instructions that, when executed by one or more processors, causes the one or more processors to: access a model of a workload to be installed on a virtual machine of a system wherein the virtual machine is created on a computing device to provide virtualized components of the system;access a model of the system; andgenerate an installation specification for the workload, the installation specification being derived at least in part from the model of the workload and the model of the system; andinstall an application and operating system on the virtual machine;wherein the installation specification includes information identifying how to install the workload, including: (1) settings for the virtual machine to be created on the computing device, (2) the operating system to install on the virtual machine, including settings of the operating system and identification of files to be copied to the virtual machine for installing the operating system; (3) settings of the computing device to be made or changed; (4) an identification of files to be copied to the computing device and where those files are to be copied; (5) an order in which files are to be copied and/or settings made or changed; and (6) any initialization programs to be run after the files have been copied and/or settings made or changed.
  • 11. The computer readable media of claim 10, wherein the workload includes the application and operating system installed on the virtual machine.
  • 12. The computer readable media of claim 10, wherein the virtual machine is created on a computing device to provide virtualized components of the system.
  • 13. The computer readable media of claim 10, wherein the installation specification identifies an image file of the workload that is to be copied to a storage device of the system.
  • 14. The computer readable media of claim 10, wherein the installation specification includes an indication to migrate another virtual machine from one computing device to another computing device.
  • 15. The computer readable media of claim 10, further comprising instructions that, when executed, cause the processor to: generate a plurality of device class installation specifications for the workload, each of the plurality of device class installation specifications being for a different one of a plurality of classes of devices in the system on which the workload could be installed; andgenerate a record associating each of the plurality of device class installation specifications with one of the plurality of classes of devices.
  • 16. The computer readable media of claim 10, further comprising instructions that, when executed, cause the processor to perform, prior to generating the installation specification, a logical deployment evaluation to determine whether the workload could be installed in the system, including comparing constraints associated with the workload to constraints associated with the system, wherein the constraints associated with the workload include software licensing requirements.
  • 17. The computer readable media of claim 10, further comprising instructions that, when executed, cause the processor to identify, prior to generating the installation specification, which one or more computing devices of a plurality of computing devices in the system is to have the workload installed thereon.
  • 18. A computing device comprising: a processor and a memory, coupled to the processor, storing instructions that, when executed by the processor, cause the processor to:access a model of a workload to be installed on a virtual machine of a system;access a model of the system; andgenerate an installation specification for the workload, the installation specification being derived at least in part from the model of the workload and the model of the system; andinstall an application and operating system on the virtual machine;wherein the workload includes the application and operating system installed on the virtual machine, wherein the installation specification identifies an image file of the workload that is to be copied to a storage device of the system, and wherein the installation specification includes an indication to migrate another virtual machine from one computing device to another computing device; andwherein the installation specification further includes information identifying how to install the workload, including: (1) settings for the virtual machine to be created on the computing device, (2) the operating system to install on the virtual machine, including settings of the operating system and identification of files to be copied to the virtual machine for installing the operating system; (3) settings of the computing device to be made or changed; (4) an identification of files to be copied to the computing device and where those files are to be copied; (5) an order in which files are to be copied and/or settings made or changed; and (6) any initialization programs to be run after the files have been copied and/or settings made or changed.
  • 19. The computing device of claim 18, further comprising instructions that, when executed, cause the processor to: generate a plurality of device class installation specifications for the workload, each of the plurality of device class installation specifications being for a different one of a plurality of classes of devices in the system on which the workload could be installed; andgenerate a record associating each of the plurality of device class installation specifications with one of the plurality of classes of devices; andperform, prior to generating the installation specification, a logical deployment evaluation to determine whether the workload could be installed in the system, including comparing constraints associated with the workload to constraints associated with the system, wherein the constraints associated with the workload include software licensing requirements.
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 14/857,480, filed Sep. 17, 2015, which is a continuation of U.S. patent application Ser. No. 14/042,619, filed Sep. 30, 2013, now U.S. Pat. No. 9,317,270, issued Apr. 19, 2016, which is a continuation of U.S. patent application Ser. No. 11/169,973, filed Jun. 29, 2005, now U.S. Pat. No. 8,549,513, issued Oct. 1, 2013, the contents of which are herein incorporated by reference in its entirety.

US Referenced Citations (537)
Number Name Date Kind
4200770 Hellman et al. Apr 1980 A
4218582 Hellman et al. Aug 1980 A
4405829 Rivest et al. Sep 1983 A
4424414 Hellman et al. Jan 1984 A
5031089 Liu et al. Jul 1991 A
5220621 Saitoh Jun 1993 A
5430810 Saeki Jul 1995 A
5490276 Doli et al. Feb 1996 A
5495610 Shing et al. Feb 1996 A
5499357 Sonty et al. Mar 1996 A
5504921 Dev et al. Apr 1996 A
5557774 Shimabukuro et al. Sep 1996 A
5579482 Einkauf et al. Nov 1996 A
5668995 Bhat Sep 1997 A
5686940 Kuga Nov 1997 A
5724508 Harple et al. Mar 1998 A
5748958 Badovinatz et al. May 1998 A
5758351 Gibson et al. May 1998 A
5768271 Seid et al. Jun 1998 A
5774689 Curtis et al. Jun 1998 A
5784463 Chen et al. Jul 1998 A
5790895 Krontz et al. Aug 1998 A
5818937 Watson Oct 1998 A
5822531 Gorczyca et al. Oct 1998 A
5826015 Schmidt Oct 1998 A
5835777 Staelin Nov 1998 A
5845124 Berman Dec 1998 A
5845277 Pfeil et al. Dec 1998 A
5867706 Martin et al. Feb 1999 A
5872928 Lewis et al. Feb 1999 A
5878220 Olkin et al. Mar 1999 A
5895499 Chu Apr 1999 A
5905728 Han et al. May 1999 A
5917730 Rittie et al. Jun 1999 A
5930798 Lawler et al. Jul 1999 A
5958009 Friedrich et al. Sep 1999 A
5968126 Ekstrom et al. Oct 1999 A
6035405 Gage et al. Mar 2000 A
6041054 Westberg Mar 2000 A
6047323 Krause Apr 2000 A
6049528 Hendel et al. Apr 2000 A
6052469 Johnson et al. Apr 2000 A
6059842 Dumarot et al. May 2000 A
6065058 Hailpern et al. May 2000 A
6075776 Tanimoto et al. Jun 2000 A
6076108 Courts et al. Jun 2000 A
6081826 Masuoka et al. Jun 2000 A
6085238 Yuasa et al. Jul 2000 A
6086618 Al-Hilali et al. Jul 2000 A
6108702 Wood Aug 2000 A
6112243 Downs et al. Aug 2000 A
6115393 Engel et al. Sep 2000 A
6118785 Araujo et al. Sep 2000 A
6125442 Maves et al. Sep 2000 A
6125447 Gong Sep 2000 A
6134594 Helland et al. Oct 2000 A
6147995 Dobbins et al. Nov 2000 A
6151688 Wipfel et al. Nov 2000 A
6167052 McNeill et al. Dec 2000 A
6167383 Henson Dec 2000 A
6178529 Short et al. Jan 2001 B1
6182275 Beelitz et al. Jan 2001 B1
6185308 Ando et al. Feb 2001 B1
6192401 Modiri et al. Feb 2001 B1
6195091 Harple et al. Feb 2001 B1
6195355 Demizu Feb 2001 B1
6208345 Sheard et al. Mar 2001 B1
6208649 Kloth Mar 2001 B1
6209099 Saunders Mar 2001 B1
6212559 Bixler et al. Apr 2001 B1
6226788 Schoening et al. May 2001 B1
6230312 Hunt May 2001 B1
6233610 Hayball et al. May 2001 B1
6236365 LeBlanc et al. May 2001 B1
6236901 Goss May 2001 B1
6237020 Leymann et al. May 2001 B1
6253230 Couland et al. Jun 2001 B1
6256773 Bowman-Amuah Jul 2001 B1
6259448 McNally et al. Jul 2001 B1
6263089 Otsuka et al. Jul 2001 B1
6266707 Boden et al. Jul 2001 B1
6269076 Shamir et al. Jul 2001 B1
6269079 Marin et al. Jul 2001 B1
6304972 Shavit Oct 2001 B1
6305015 Akriche et al. Oct 2001 B1
6308174 Hayball et al. Oct 2001 B1
6311144 Abu El Ata Oct 2001 B1
6311270 Challener et al. Oct 2001 B1
6330605 Christensen et al. Dec 2001 B1
6336138 Caswell et al. Jan 2002 B1
6338112 Wipfel et al. Jan 2002 B1
6351685 Dimitri et al. Feb 2002 B1
6353806 Gehlot Mar 2002 B1
6353861 Dolin et al. Mar 2002 B1
6353898 Wipfel et al. Mar 2002 B1
6360265 Falck et al. Mar 2002 B1
6367010 Venkatram et al. Apr 2002 B1
6370573 Bowman-Amuah Apr 2002 B1
6370584 Bestavros et al. Apr 2002 B1
6377996 Lumelsky et al. Apr 2002 B1
6389464 Krishnamurthy et al. May 2002 B1
6393386 Zager et al. May 2002 B1
6393456 Ambler et al. May 2002 B1
6393474 Eichert et al. May 2002 B1
6393485 Chao et al. May 2002 B1
6408390 Saito Jun 2002 B1
6418554 Delo et al. Jul 2002 B1
6424718 Holloway Jul 2002 B1
6424992 Devarakonda et al. Jul 2002 B2
6427163 Arendt et al. Jul 2002 B1
6427171 Craft et al. Jul 2002 B1
6434598 Gish Aug 2002 B1
6438100 Halpern et al. Aug 2002 B1
6442557 Buteau et al. Aug 2002 B1
6442713 Block et al. Aug 2002 B1
6449650 Westfall et al. Sep 2002 B1
6457048 Sondur et al. Sep 2002 B2
6463536 Saito Oct 2002 B2
6466985 Goyal et al. Oct 2002 B1
6470025 Wilson et al. Oct 2002 B1
6470464 Bertram et al. Oct 2002 B2
6473791 Al-Ghosein et al. Oct 2002 B1
6480955 DeKoning et al. Nov 2002 B1
6484261 Wiegel Nov 2002 B1
6502131 Vaid et al. Dec 2002 B1
6505244 Natarajan et al. Jan 2003 B1
6519615 Wollrath et al. Feb 2003 B1
6529953 Van Renesse Mar 2003 B1
6539494 Abramson et al. Mar 2003 B1
6546423 Dutta et al. Apr 2003 B1
6546553 Hunt Apr 2003 B1
6549934 Peterson et al. Apr 2003 B1
6564261 Gudjonsson et al. May 2003 B1
6570847 Hosein May 2003 B1
6570875 Hegde May 2003 B1
6574195 Roberts Jun 2003 B2
6584499 Jantz et al. Jun 2003 B1
6587876 Mahon et al. Jul 2003 B1
6597956 Aziz et al. Jul 2003 B1
6598033 Ross et al. Jul 2003 B2
6598077 Primak et al. Jul 2003 B2
6598173 Sheikh et al. Jul 2003 B1
6598223 Vrhel et al. Jul 2003 B1
6601101 Lee et al. Jul 2003 B1
6601233 Underwood Jul 2003 B1
6606708 Devine et al. Aug 2003 B1
6609148 Salo et al. Aug 2003 B1
6609213 Nguyen et al. Aug 2003 B1
6611522 Zheng et al. Aug 2003 B1
6628671 Dynarski et al. Sep 2003 B1
6631141 Kumar et al. Oct 2003 B1
6640303 Vu Oct 2003 B1
6651101 Gai et al. Nov 2003 B1
6651240 Yamamoto et al. Nov 2003 B1
6654782 O'Brien et al. Nov 2003 B1
6654796 Slater et al. Nov 2003 B1
6665714 Blumenau et al. Dec 2003 B1
6671699 Black et al. Dec 2003 B1
6675308 Thomsen Jan 2004 B1
6678821 Waugh et al. Jan 2004 B1
6678835 Shah et al. Jan 2004 B1
6681262 Rimmer Jan 2004 B1
6691148 Zinky et al. Feb 2004 B1
6691165 Bruck et al. Feb 2004 B1
6691168 Bal et al. Feb 2004 B1
6694436 Audebert Feb 2004 B1
6701363 Chiu et al. Mar 2004 B1
6717949 Boden et al. Apr 2004 B1
6718361 Basani et al. Apr 2004 B1
6718379 Krishna et al. Apr 2004 B1
6725253 Okano et al. Apr 2004 B1
6728885 Taylor et al. Apr 2004 B1
6735596 Corynen May 2004 B2
6738736 Bond May 2004 B1
6741266 Kamiwada et al. May 2004 B1
6742020 Dimitroff et al. May 2004 B1
6748447 Basani et al. Jun 2004 B1
6754716 Sharma et al. Jun 2004 B1
6754816 Layton et al. Jun 2004 B1
6757744 Narisi et al. Jun 2004 B1
6760765 Asai et al. Jul 2004 B1
6760775 Anerousis et al. Jul 2004 B1
6769008 Kumar et al. Jul 2004 B1
6769060 Dent et al. Jul 2004 B1
6779016 Aziz et al. Aug 2004 B1
6782408 Chandra et al. Aug 2004 B1
6789090 Miyake et al. Sep 2004 B1
6801528 Nassar Oct 2004 B2
6801937 Novaes et al. Oct 2004 B1
6801949 Bruck et al. Oct 2004 B1
6804783 Wesinger et al. Oct 2004 B1
6813778 Poli et al. Nov 2004 B1
6816897 McGuire Nov 2004 B2
6820042 Cohen et al. Nov 2004 B1
6820121 Callis et al. Nov 2004 B1
6823299 Contreras et al. Nov 2004 B1
6823373 Pancha et al. Nov 2004 B1
6823382 Stone Nov 2004 B2
6829639 Lawson et al. Dec 2004 B1
6829770 Hinson et al. Dec 2004 B1
6836750 Wong et al. Dec 2004 B2
6839348 Tang et al. Jan 2005 B2
6845160 Aoki Jan 2005 B1
6847970 Keller et al. Jan 2005 B2
6853841 St. Pierre Feb 2005 B1
6854069 Kampe et al. Feb 2005 B2
6856591 Ma et al. Feb 2005 B1
6862613 Kumar et al. Mar 2005 B1
6868062 Yadav et al. Mar 2005 B1
6868454 Kubota et al. Mar 2005 B1
6879926 Schmit et al. Apr 2005 B2
6880002 Hirschfeld et al. Apr 2005 B2
6886038 Tabbara et al. Apr 2005 B1
6888807 Heller et al. May 2005 B2
6895534 Wong et al. May 2005 B2
6898791 Chandy et al. May 2005 B1
6904458 Bishop et al. Jun 2005 B1
6907395 Hunt et al. Jun 2005 B1
6912568 Nishiki et al. Jun 2005 B1
6912657 Gehrmann Jun 2005 B2
6915338 Hunt et al. Jul 2005 B1
6922791 Mashayekhi et al. Jul 2005 B2
6928482 Ben Nun et al. Aug 2005 B1
6944183 Iyer et al. Sep 2005 B1
6944678 Lu et al. Sep 2005 B2
6944759 Crisan Sep 2005 B1
6947987 Boland Sep 2005 B2
6954930 Drake et al. Oct 2005 B2
6957186 Guheen et al. Oct 2005 B1
6963981 Bailey et al. Nov 2005 B1
6968291 Desai Nov 2005 B1
6968535 Stelting et al. Nov 2005 B2
6968550 Branson et al. Nov 2005 B2
6968551 Hediger et al. Nov 2005 B2
6971063 Rappaport et al. Nov 2005 B1
6971072 Stein Nov 2005 B1
6973620 Gusler et al. Dec 2005 B2
6973622 Rappaport et al. Dec 2005 B1
6976079 Ferguson et al. Dec 2005 B1
6976269 Avery et al. Dec 2005 B1
6978379 Goh et al. Dec 2005 B1
6983317 Bishop et al. Jan 2006 B1
6985956 Luke et al. Jan 2006 B2
6986135 Leathers et al. Jan 2006 B2
6987838 Winterbottom Jan 2006 B2
6990666 Hirschfeld et al. Jan 2006 B2
7003562 Mayer Feb 2006 B2
7003574 Bahl Feb 2006 B1
7012919 So et al. Mar 2006 B1
7013462 Zara et al. Mar 2006 B2
7016950 Tabbara et al. Mar 2006 B2
7024451 Jorgenson Apr 2006 B2
7027412 Miyamoto et al. Apr 2006 B2
7028228 Lovy et al. Apr 2006 B1
7032031 Jungck et al. Apr 2006 B2
7035786 Abu El Ata et al. Apr 2006 B1
7035930 Graupner et al. Apr 2006 B2
7043407 Lynch et al. May 2006 B2
7043545 Tabbara et al. May 2006 B2
7046680 McDysan et al. May 2006 B1
7047279 Beams et al. May 2006 B1
7047518 Little et al. May 2006 B2
7050961 Lee et al. May 2006 B1
7054943 Goldszmidt et al. May 2006 B1
7055149 Birkholz et al. May 2006 B2
7058704 Mangipudi et al. Jun 2006 B1
7058826 Fung Jun 2006 B2
7058858 Wong et al. Jun 2006 B2
7062718 Kodosky et al. Jun 2006 B2
7069204 Solden et al. Jun 2006 B1
7069337 Rawlins et al. Jun 2006 B2
7069480 Lovy et al. Jun 2006 B1
7069553 Narayanaswamy et al. Jun 2006 B2
7072807 Brown et al. Jul 2006 B2
7072822 Humenansky et al. Jul 2006 B2
7076552 Mandato Jul 2006 B2
7076633 Tormasov et al. Jul 2006 B2
7080143 Hunt et al. Jul 2006 B2
7082464 Hasan et al. Jul 2006 B2
7089281 Kazemi et al. Aug 2006 B1
7089293 Grosner et al. Aug 2006 B2
7089530 Dardinski et al. Aug 2006 B1
7093005 Patterson Aug 2006 B2
7093288 Hydrie et al. Aug 2006 B1
7096258 Hunt et al. Aug 2006 B2
7099936 Chase et al. Aug 2006 B2
7103185 Srivastava et al. Sep 2006 B1
7103874 McCollum et al. Sep 2006 B2
7113900 Hunt et al. Sep 2006 B1
7117158 Weldon et al. Oct 2006 B2
7117261 Kryskow et al. Oct 2006 B2
7117269 Lu et al. Oct 2006 B2
7120154 Bavant et al. Oct 2006 B2
7120797 Wheeler Oct 2006 B2
7124289 Suorsa Oct 2006 B1
7127625 Farkas et al. Oct 2006 B2
7130881 Volkov et al. Oct 2006 B2
7131123 Suorsa et al. Oct 2006 B2
7134011 Fung Nov 2006 B2
7134122 Sero et al. Nov 2006 B1
7139930 Mashayekhi et al. Nov 2006 B2
7139999 Bowman-Amuah Nov 2006 B2
7140000 Yucel Nov 2006 B2
7143420 Radhakrishnan Nov 2006 B2
7146353 Garg et al. Dec 2006 B2
7150015 Pace et al. Dec 2006 B2
7152109 Suorsa et al. Dec 2006 B2
7152157 Murphy et al. Dec 2006 B2
7154490 Yoneyama Dec 2006 B2
7155380 Hunt et al. Dec 2006 B2
7155490 Malmer et al. Dec 2006 B1
7162427 Myrick et al. Jan 2007 B1
7162509 Brown et al. Jan 2007 B2
7162634 Litwin et al. Jan 2007 B2
7174379 Agarwal et al. Feb 2007 B2
7181731 Pace et al. Feb 2007 B2
7188335 Darr et al. Mar 2007 B1
7188364 Volpano Mar 2007 B2
7191344 Lin et al. Mar 2007 B2
7191429 Brassard et al. Mar 2007 B2
7194439 Kassan et al. Mar 2007 B2
7194616 Axnix et al. Mar 2007 B2
7197418 Fuller et al. Mar 2007 B2
7200530 Brown et al. Apr 2007 B2
7200655 Hunt et al. Apr 2007 B2
7200665 Eshghi et al. Apr 2007 B2
7203911 Williams Apr 2007 B2
7210143 Or et al. Apr 2007 B2
7213231 Bandhole et al. May 2007 B1
7222147 Black et al. May 2007 B1
7225441 Kozuch et al. May 2007 B2
7231410 Walsh et al. Jun 2007 B1
7231430 Brownell et al. Jun 2007 B2
7237267 Rayes et al. Jun 2007 B2
7246351 Bloch et al. Jul 2007 B2
7254634 Davis et al. Aug 2007 B1
7257584 Hirschfeld et al. Aug 2007 B2
7257817 Cabrera et al. Aug 2007 B2
7272653 Levy-Abegnoli et al. Sep 2007 B2
7275156 Balfanz et al. Sep 2007 B2
7278273 Whitted et al. Oct 2007 B1
7281154 Mashayekhi et al. Oct 2007 B2
7302608 Acharya et al. Nov 2007 B1
7305549 Hunt et al. Dec 2007 B2
7305556 Slick et al. Dec 2007 B2
7305561 Hunt et al. Dec 2007 B2
7309498 Belenkaya et al. Dec 2007 B2
7313573 Leung et al. Dec 2007 B2
7313614 Considine et al. Dec 2007 B2
7315801 Dowd et al. Jan 2008 B1
7318216 Diab Jan 2008 B2
7333000 Vassallo Feb 2008 B2
7343601 Azagury et al. Mar 2008 B2
7349891 Charron et al. Mar 2008 B2
7350068 Anderson et al. Mar 2008 B2
7350186 Coleman et al. Mar 2008 B2
7356679 Le et al. Apr 2008 B1
7366755 Cuomo et al. Apr 2008 B1
7367028 Kodosky et al. Apr 2008 B2
7370103 Hunt et al. May 2008 B2
7370323 Marinelli et al. May 2008 B2
7376125 Hussain et al. May 2008 B1
7379982 Tabbara May 2008 B2
7383329 Erickson Jun 2008 B2
7386721 Vilhuber et al. Jun 2008 B1
7395320 Hunt et al. Jul 2008 B2
7403901 Carley et al. Jul 2008 B1
7404175 Lee et al. Jul 2008 B2
7406517 Hunt et al. Jul 2008 B2
7406692 Halpern et al. Jul 2008 B2
7409420 Pullara et al. Aug 2008 B2
7412502 Fearn et al. Aug 2008 B2
7415729 Ukeda et al. Aug 2008 B2
7421505 Berg et al. Sep 2008 B2
7428074 Kitahara et al. Sep 2008 B2
7436965 Sherman et al. Oct 2008 B2
7448079 Tremain et al. Nov 2008 B2
7461249 Pearson et al. Dec 2008 B1
7464147 Fakhouri et al. Dec 2008 B1
7478381 Roberts et al. Jan 2009 B2
7478385 Sierer et al. Jan 2009 B2
7480907 Marolia et al. Jan 2009 B1
7496911 Rowley et al. Feb 2009 B2
7500069 Hochmuth et al. Mar 2009 B2
7505872 Keller et al. Mar 2009 B2
7506034 Coates et al. Mar 2009 B2
7506338 Alpern et al. Mar 2009 B2
7512942 Brown et al. Mar 2009 B2
7543066 Colasurdo et al. Jun 2009 B2
7567504 Darling et al. Jul 2009 B2
7571082 Gilpin et al. Aug 2009 B2
7574343 Levi et al. Aug 2009 B2
7577722 Khandekar Aug 2009 B1
7587453 Bhrara et al. Sep 2009 B2
7590736 Hydrie et al. Sep 2009 B2
7594224 Patrick et al. Sep 2009 B2
7603442 Sen Oct 2009 B2
7606929 Gbadegesin et al. Oct 2009 B2
7613822 Joy et al. Nov 2009 B2
7621814 Garcia Nov 2009 B2
7624086 Keith et al. Nov 2009 B2
7630877 Brown et al. Dec 2009 B2
7636917 Darling et al. Dec 2009 B2
7653187 Darling et al. Jan 2010 B2
7653903 Purkeypile et al. Jan 2010 B2
7669235 Hunt et al. Feb 2010 B2
7689676 Vinberg et al. Mar 2010 B2
7743373 Avram et al. Jun 2010 B2
7765540 McCollum et al. Jul 2010 B2
8549513 Vinberg Oct 2013 B2
9317270 Vinberg Apr 2016 B2
9811368 Vinberg Nov 2017 B2
20010014158 Baltzley Aug 2001 A1
20010016909 Gehrmann Aug 2001 A1
20010020228 Cantu et al. Sep 2001 A1
20010039586 Primak et al. Nov 2001 A1
20010047400 Coates et al. Nov 2001 A1
20010051937 Ross et al. Dec 2001 A1
20020009079 Jungck et al. Jan 2002 A1
20020010771 Mandato Jan 2002 A1
20020022952 Zager et al. Feb 2002 A1
20020040402 Levy-abegnoli et al. Apr 2002 A1
20020049573 El Ata Apr 2002 A1
20020057684 Miyamoto et al. May 2002 A1
20020069267 Thiele Jun 2002 A1
20020069369 Tremain Jun 2002 A1
20020075844 Hagen Jun 2002 A1
20020082820 Ferguson et al. Jun 2002 A1
20020087264 Hills et al. Jul 2002 A1
20020090089 Branigan et al. Jul 2002 A1
20020120761 Berg Aug 2002 A1
20020131601 Ninomiya et al. Sep 2002 A1
20020138551 Erickson Sep 2002 A1
20020147862 Traut et al. Oct 2002 A1
20020152086 Smith et al. Oct 2002 A1
20020156900 Marquette et al. Oct 2002 A1
20020161839 Colasurdo et al. Oct 2002 A1
20020171690 Fox et al. Nov 2002 A1
20020184327 Major et al. Dec 2002 A1
20020188941 Cicciarelli et al. Dec 2002 A1
20020194342 Lu et al. Dec 2002 A1
20020194345 Lu et al. Dec 2002 A1
20020194369 Rawlins et al. Dec 2002 A1
20020198995 Liu Dec 2002 A1
20030008712 Poulin Jan 2003 A1
20030009559 Ikeda Jan 2003 A1
20030014644 Burns et al. Jan 2003 A1
20030028642 Agarwal et al. Feb 2003 A1
20030028770 Litwin et al. Feb 2003 A1
20030041142 Zhang et al. Feb 2003 A1
20030041159 Tinsley et al. Feb 2003 A1
20030046615 Stone Mar 2003 A1
20030051049 Noy et al. Mar 2003 A1
20030056063 Hochmuth et al. Mar 2003 A1
20030065743 Jenny et al. Apr 2003 A1
20030069369 Belenkaya et al. Apr 2003 A1
20030074395 Eshghi et al. Apr 2003 A1
20030101284 Cabrera et al. May 2003 A1
20030105963 Slick et al. Jun 2003 A1
20030120763 Volpano Jun 2003 A1
20030126464 McDaniel et al. Jul 2003 A1
20030130833 Brownell et al. Jul 2003 A1
20030138105 Challener et al. Jul 2003 A1
20030165140 Tang et al. Sep 2003 A1
20030200293 Fearn et al. Oct 2003 A1
20030204734 Wheeler Oct 2003 A1
20030214908 Kumar et al. Nov 2003 A1
20030217263 Sakai Nov 2003 A1
20030225563 Gonos Dec 2003 A1
20040002878 Maria Hinton Jan 2004 A1
20040049365 Keller et al. Mar 2004 A1
20040049509 Keller et al. Mar 2004 A1
20040059812 Assa Mar 2004 A1
20040068631 Ukeda et al. Apr 2004 A1
20040073443 Gabrick et al. Apr 2004 A1
20040073795 Jablon Apr 2004 A1
20040078787 Borek et al. Apr 2004 A1
20040111315 Sharma et al. Jun 2004 A1
20040117438 Considine et al. Jun 2004 A1
20040117476 Steele et al. Jun 2004 A1
20040160386 Michelitsch et al. Aug 2004 A1
20040161111 Sherman Aug 2004 A1
20040193388 Outhred et al. Sep 2004 A1
20040199572 Hunt et al. Oct 2004 A1
20040205179 Hunt et al. Oct 2004 A1
20040208292 Winterbottom Oct 2004 A1
20040220792 Gallanis et al. Nov 2004 A1
20040226010 Suorsa Nov 2004 A1
20040261079 Sen Dec 2004 A1
20040264481 Darling et al. Dec 2004 A1
20040267920 Hydrie et al. Dec 2004 A1
20040268357 Joy et al. Dec 2004 A1
20040268358 Darling et al. Dec 2004 A1
20050008001 Williams et al. Jan 2005 A1
20050021742 Yemini et al. Jan 2005 A1
20050055435 Gbadegesin et al. Mar 2005 A1
20050080811 Speeter et al. Apr 2005 A1
20050086502 Rayes et al. Apr 2005 A1
20050091078 Hunt et al. Apr 2005 A1
20050091227 McCollum et al. Apr 2005 A1
20050097082 Yan May 2005 A1
20050097097 Hunt et al. May 2005 A1
20050097146 Konstantinou et al. May 2005 A1
20050102154 Dodd et al. May 2005 A1
20050102388 Tabbara et al. May 2005 A1
20050102513 Alve May 2005 A1
20050102538 Hunt et al. May 2005 A1
20050125212 Hunt et al. Jun 2005 A1
20050138416 Qian et al. Jun 2005 A1
20050152270 Gomez Paredes et al. Jul 2005 A1
20050192971 Tabbara et al. Sep 2005 A1
20050193103 Drabik Sep 2005 A1
20050246529 Hunt et al. Nov 2005 A1
20050246771 Hunt et al. Nov 2005 A1
20050251783 Torone et al. Nov 2005 A1
20050257244 Joly et al. Nov 2005 A1
20050268325 Kuno et al. Dec 2005 A1
20060025984 Papaefstathiou et al. Feb 2006 A1
20060025985 Vinberg et al. Feb 2006 A1
20060031248 Vinberg et al. Feb 2006 A1
20060034263 Outhred et al. Feb 2006 A1
20060037002 Vinberg et al. Feb 2006 A1
20060048017 Anerousis et al. Mar 2006 A1
20060123040 McCarthy et al. Jun 2006 A1
20060149838 Hunt et al. Jul 2006 A1
20060155708 Brown et al. Jul 2006 A1
20060161879 Lubrecht et al. Jul 2006 A1
20060161884 Lubrecht et al. Jul 2006 A1
20060232927 Vinberg et al. Oct 2006 A1
20060235664 Vinberg et al. Oct 2006 A1
20060259609 Hunt et al. Nov 2006 A1
20060259610 Hunt et al. Nov 2006 A1
20060271341 Brown et al. Nov 2006 A1
20070006177 Aiber et al. Jan 2007 A1
20070112847 Dublish et al. May 2007 A1
20070192769 Mimura et al. Aug 2007 A1
20080059214 Vinberg et al. Mar 2008 A1
Foreign Referenced Citations (50)
Number Date Country
1368694 Sep 2002 CN
1375685 Oct 2002 CN
964546 Dec 1999 EP
1180886 Feb 2002 EP
1307018 May 2003 EP
1550969 Jul 2005 EP
H06250956 Sep 1994 JP
H08297567 Nov 1996 JP
H08305609 Nov 1996 JP
H0934723 Feb 1997 JP
H0991143 Apr 1997 JP
H10124343 May 1998 JP
H10150470 Jun 1998 JP
H10240576 Sep 1998 JP
H10285216 Oct 1998 JP
11007407 Jan 1999 JP
H11110256 Apr 1999 JP
11340980 Dec 1999 JP
H11345180 Dec 1999 JP
2000151574 May 2000 JP
2000268012 Sep 2000 JP
2000293497 Oct 2000 JP
2001339437 Dec 2001 JP
2001526814 Dec 2001 JP
2002084302 Mar 2002 JP
2002354006 Dec 2002 JP
2003006170 Jan 2003 JP
2003030424 Jan 2003 JP
2003058698 Feb 2003 JP
2003532784 Nov 2003 JP
2005155729 Jun 2005 JP
1020020026751 Apr 2002 KR
1020040008275 Jan 2004 KR
2111625 May 1998 RU
2156546 Sep 2000 RU
2189072 Sep 2002 RU
9728505 Aug 1997 WO
9853410 Nov 1998 WO
9930514 Jun 1999 WO
9963439 Dec 1999 WO
22526 Apr 2000 WO
31945 Jun 2000 WO
73929 Dec 2000 WO
0114733 Mar 2001 WO
185881 Nov 2001 WO
230044 Apr 2002 WO
237748 May 2002 WO
2085051 Oct 2002 WO
3027876 Apr 2003 WO
3039104 May 2003 WO
Non-Patent Literature Citations (95)
Entry
VMware ACE, “Configuring the Virtual Machines and Installing Software”, Apr. 2005, retrieved from https://web.archive.org/web/20050405122329/https://www.vmware.com/support/ace/doc/setpol_vmconfig_ace.html, 9 pages (Year: 2005).
“C.O.B.A.S. Centralized Out-Of-Band Authentication System”, in Southeast Europe Cybersecurity Conference, Sep. 8, 2003, 14 Pages.
“Core Principles of the Dynamic Systems Initiative: Leveraging System Knowledge, Captured in Software Models, to Address Challenges Across the IT Life Cycle”, Retrieved from <<http://web.archive.org/web/20041119174131/http://www.microsoft.com/windowsserversystem/dsi/dsicore.mspx>>, Nov. 15, 2004, 3 Pages.
“IBM Tivoli Workload Scheduler—Planning and Installation Guide”, IBM, Version 8.2, 3rd Edition, Dec. 2004,189 Pages.
“Integrated Security Management”, Retrieved from <<http://web.archive.org/web/20060313015701/http://www.objectsecurity.com/doc/openpmf-A4.pdf>>, Retrieved on: Apr. 23, 2007, 2 Pages.
“Remote Operating System Installation”, Retrieved from <<http://technet.microsoft.com/en-us/library/bb742501.aspx>>, Sep. 9, 1999, 28 Pages.
“Resource Description Framework (RDF)”, Retrieved from <<https://www.w3.org/RDF/>>, Feb. 10, 2004, 3 Pages.
“System Definition Model”, Retrieved from <<http://web.archive.org/web/20040405230803/www.microsoft.com/windowsserversystem/dsi/sdm.mspx>>, Dec. 15, 2003, 4 Pages.
“The Age Changed by Information Network and System: The Internet Releasing Enterprises and Society A? The New century Created by an E Service and a Terabit Network Service: Disappearance of Enterprise Servers, Service Components Behind the Internet”, Nikkei Business Publications, Inc, Dec. 22, 1999, 6 Pages.
“Search Report Issued in European Patent Application No. 04005431.4”, dated Sep. 1, 2006, 3 Pages.
“Final Office Action Issued in U.S. Appl. No. 11/169,973”, dated Jun. 9, 2010, 13 Pages.
“Final Office Action Issued in U.S. Appl. No. 11/169,973”, dated Jun. 23, 2009, 11 Pages.
“Final Office Action Issued in U.S. Appl. No. 11/169,973”, dated Mar. 26, 2012, 10 Pages.
“Non-Final Office Action Issued in U.S. Appl. No. 11/169,973”, dated Dec. 10, 2009, 11 Pages.
“Non-Final Office Action Issued in U.S. Appl. No. 11/169,973”, dated Dec. 11, 2008, 21 Pages.
“Non-Final Office Action Issued in U.S. Appl. No. 11/169,973”, dated Oct. 14, 2011, 9 Pages.
“Notice of Allowance Issued in U.S. Appl. No. 11/169,973”, dated May 15, 2013, 6 Pages.
“US Patent Application Filed as U.S. Appl. No. 11/427,041”, dated Jun. 28, 2006, 44 Pages.
“Final Office Action Issued in U.S. Appl. No. 14/042,619”, dated 24, 2014, 8 Pages.
“Non-Final Office Action Issued in U.S. Appl. No. 14/042,619”, dated May 8, 2014, 6 Pages.
“Notice of Allowance Issued in U.S. Appl. No. 14/042,619”, dated Jun. 19, 2015, 7 Pages.
“Non-final Office Action Issued in U.S. Appl. No. 14/857,480”, dated Feb. 24, 2017, 41 Pages.
“Notice of Allowance Issued in U.S. Appl. No. 14/857,480”, dated Jun. 30, 2017, 7 Pages.
“Translated Japanese Office Action Issued in Patent Application No. 2001-326848”, dated Jan. 26, 2007, 3 Pages.
“Translated Japanese Office Action Issued in Patent Application No. 2001-326848”, dated Dec. 14, 2007, 3 Pages.
“Translated Japanese Office Action Issued in Patent Application No. 2004-061396”, dated Jun. 24, 2008, 17 Pages.
“Translated Office Action Issued in Chinese Patent Application No. 200410033027.7”, dated Feb. 2, 2007, 11 Pages.
“Office Action Issued in Chinese Patent Application No. 200410088250.1”, dated Apr. 27, 2007, 3 Pages.
Araki., “Linux Security Diary, Use VLAN in Linux”, In National Academy Paper 200300158009, vol. 3, Issue 11, Linux Japan, Itsutsubashi Research Co. Ltd., Nov. 1, 2008, 5 Pages.
Barrett, et al., “Model Driven Distribution Pattern Design for Dynamic Web Services Compositions”, In Proceedings of the 6th International Conference on Web Engineering, Jul. 11, 2006, 8 Pages.
Burns, et al., “Allocation and Data Placement Using Virtual Contiguity”, Retrieved from <<https://www.researchgate.net/profile/Darrell_Long2/publication/2888127_Allocation_and_Data_Placement_Using_Virtual_Contiguity/links/0912f50cb72f719cc,8000000.pdf>>, Jul. 2004, 6 Pages.
Cardelli, L., “Type Systems”, In CRC Handbook of Computer Science and Engineering, 2nd Edition, Feb. 25, 2004, 41 Pages.
Chen, et al., “Performance Prediction of Component-based Applications”, In Journal of Systems and Software, vol. 74, Issue 1, Jan. 1, 2005, 12 Pages.
Chunxiao, et al., “Configure and Move Thee-Commerce Business Model by Utilizing XML”, In Proceedings of the Applications of Computer Systems, Issue 2, Feb. 28, 2002, 4 Pages.
Chunxiao, et al., “Using XML Schema to Configure Mobile E-Commerce Transaction Model”, In Proceedings of the Applications of Computer Systems, Issue 2, Feb. 28, 2002, 9 Pages.
Dekhil, et al., “Generalized Policy Model for Application and Service Management”, In Policy Workshop Hewlett-Packard Laboratories, Jan. 1999, 3 Pages.
Dolstra. et al., “Imposing a Memory Management Discipline on Software Deployment”, In Proceedings of the 26th International Conference on Software Engineering, May 23, 2004, 10 Pages.
Frolund, et al., “Design-Time Simulation of a Large-Scale, Distributed Object System”, In Proceedings of ACM Transactions on Modelling and Computer Simulation, vol. 8, Issue 4, Oct. 1, 1998, 28 Pages.
Garschhammer, et al., “Towards Generic Service Management Concepts a Service Model Based Approach”, In Proceedings of IEEE/IFIP International Symposium on Integrated Network Management, Jan. 2001, 14 Pages.
Harbour, et al., “MAST: An Open Environment for Modeling, Analysis, and Design of Real-Time Systems”, In 1st Workshop on Computer Aided Architectural Analysis of Real-Time Systems, Oct. 2002, 16 Pages.
Hardwick, et al., “Modeling the Performance of E-Commerce Site”, In Proceedings of 27th International Conference of the Computer Measurement Group, Jan. 2001, 11 Pages.
Heilala, et al., “Modeling and Simulation for Customer Driven Manufacturing System Design and Operation Planning”, In Proceedings of the 39th Conference on Winter Simulation, Dec. 9, 2007, 10 Pages.
Heinl, et al., “A Comprehensive Approach to Flexibility in Workflow Management Systems”, In ACM SIGSOFT Software Engineering Notes, vol. 24, Issue 2, Mar. 1, 1999, 10 Pages.
Howard, Michael, “Designing Secure Web-Based Applications for Microsoft Windows 2000”, In Book—by Microsoft Press, Jul. 2000, 526 Pages.
Iannamico, Mike, “Pretty Good Privacy PGP for Personal Privacy, Version 5.0 for Windows 95 Windows NT”, Pretty Good Privacy Inc., Jan. 1997,137 Pages.
Iwasaki, H., “IP Troubles Q&A—The Prevention of Network Troubles and the Risk Management”, In Computer & Network LAN, Japan Ohmsha, Ltd., vol. 18, Issue 8, Jul. 14, 2000, 11 Pages.
Kitjongthawonkul, et al., “Modeling Information Systems Using Objects, Agents, and Task-Based Problem Solving Adapters”, In Proceedings of 10th Australasian Conference on Information Systems, Jan. 1999, 10 Pages.
Kounev, Samuel D., “A Capacity Planning Methodology for Distributed E-Commerce Applications”, Retrieved from <<http://se2.informatik.uni-wuerzburg.de/pa/uploads/papers/paper-291.pdf>>, Jan. 2, 2001, 13 Pages.
Lee, et al., “Community Services: A Toolkit for Rapid Deployment of Network Services”, On Proceedings of the IEEE International Conference on Cluster Computing, Sep. 23, 2002, 4 Pages.
Lee, Donald C., “Enhanced IP Services for Cisco Networks”, Book by Cisco Press, Edition 1, Part of the Networking Technology Series, Sep. 23, 1999, 11 Pages.
Levillain, Philippe, “Switch-Based Server Load Balancing for Enterprises”, In Alcatel Telecommunications Review, No. 4, Jan. 2002, 8 Pages.
Sloman, Morris, “Policy Driven Management for Distributed Systems”, In Journal of Network and Systems Management, vol. 2, Issue 4, Dec. 1994, pp. 333-360.
“Non Final Office Action Issued in U.S. Appl. No. 11/169,502”, dated Mar. 4, 2009, 16 Pages.
“Non Final Office Action Issued in U.S. Appl. No. 11/169,502”, dated Sep. 3, 2009, 14 Pages.
“Notice of Allowance Issued in U.S. Appl. No. 11/169,502”, dated Feb. 17, 2010, 9 Pages.
“Notice of Allowance Issued in U.S. Appl. No. 11/169,502”, dated Jun. 1, 2010, 6 Pages.
“Notice of Allowance Issued in U.S. Appl. No. 11/169,502”, dated Oct. 7, 2010, 7 Pages.
“Final Office Action Issued in U.S. Appl. No. 11/622,978”, dated Mar. 31, 2009, 12 Pages.
“Final Office Action Issued in U.S. Appl. No. 11/622,978”, dated Jun. 2, 2009, 10 Pages.
“Non Final Office Action Issued in U.S. Appl. No. 11/622,978”, dated Aug. 7, 2009, 13 Pages.
“Non Final Office Action Issued in U.S. Appl. No. 11/622,978”, dated Jul. 23, 2008, 10 Pages.
“Notice of Allowance Issued in U.S. Appl. No. 11/622,978”, dated Oct. 20, 2009, 7 Pages.
“Notice of Allowance Issued in U.S. Appl. No. 11/622,978”, dated Jan. 28, 2010, 4 Pages.
“Supplemental Notice of Allowance in U.S. Appl. No. 11/622,978”, dated Oct. 21, 2009, 2 Pages.
Yuura, et al., “Component-Oriented Development Method and Environment for Advanced Enterprises Information Systems”, In Hitachi Review, vol. 47, No. 6, 1998, 13 Pages.
“Notice of Rejection Issued in Japanese Patent Application No. 2004-064566”, dated May 28, 2010, 13 Pages.
Hitchens, et al., “Design and Specification of Role Based Access Control Policies”, IEE Proceedings—Software, vol. 147, Issue 4, Aug. 2000, 13 Pages.
Michael, et al., “Natural-Language Processing Support for Developing Policy-Governed Software Systems”, In Proceedings of the 39th International Conference and Exhibition on Technology of Object-Oriented Languages and Systems, Jul. 29, 2001, pp. 263-274.
Siganos, et al., “Analyzing BGP Policies: Methodology and Tool”, In 23rd Annual Joint Conference of the IEEE Computer and Communications Societies, INFOCOM, Mar. 7, 2004, pp. 1640-1651.
“OMG Unified Modeling Language Specification”, Retrieved From http://deptinfo.cnam.fr/Enseignement/CycleSpecialisation/MAI/UML1.4.pdf, Sep. 2001, 572 Pages.
Toktar, et al., “RSVP Policy Control using XACML”, In Proceedings of the 5th IEEE International Workshop on Policies for Distributed Systems and Networks, Jun. 9, 2004, 10 Pages.
Yonezawa, Shinichi, “Feature Article UML—Compatible Modeling Tool Front Line, Ensure Consistence between Code and Model, Applicable to a Large-Scale Team Development”, In DB Magazine, Mar. 1, 2002, 9 Pages.
Lin, et al., “User-driven Scheduling of Interactive Virtual Machines”, In Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, Nov. 8, 2004, 8 Pages.
Liu, et al., “Visualization in Network Topology Optimization”, In Proceedings of the ACM Annual Conference on communications, Apr. 1, 1992, 7 Pages.
Mahon, Hugh, “Open View PolicyXpert: Heterogeneous Configuration and Control”, Open View Policy-Based Network Management, Feb. 1999, 4 Pages.
Meader, Patrick., “Build Distributed Apps a New Way”, Retrieved from <<http://web.archive.org/web/20040405024828/http://www.ftponline.com/reports/vslivesf/2004/whitehorse2/>>, Mar. 25, 2004, 4 Pages.
Meader, Patrick, “Model Apps More Effectively”, Retrieved from <<http://web.archive.org/web/20040415014151/http://www.ftponline.com/reports/vslivesf/2004/whitehorse/>>, Mar. 24, 2004, 3 Pages.
Meli, Roberto, “Measuring Change Requests to Support Effective Project Management Practices”, In ESCOM Conference, vol. 25, Apr. 2, 2001, 10 Pages.
Menezes, et al., “Handbook of Applied Cryptography”, In Book—by CRC Press, Oct. 16, 1996, 92 Pages.
Miyamoto, et al., “VLAN Management System of Large-scale Network”, In Journal of Information Processing Society of Japan, vol. 41, Issue 2, Dec. 15, 2000, 12 Pages.
Morimoto, et al., “Compatibility Testing for Windows Server 2003”, In Book—Microsoft Windows Server 2003 Unleashed, Chapter 18, Section 1, Jun. 14, 2004, 2 Pages.
Nerurkar, Uttara, “Security Analysis and Design”, In Dr. Dobb's Journal, Nov. 1, 2000, 4 Pages.
Nestor, John P., “Security Modeling Using Hierarchical State Machines”, In Proceedings of Seventh Annual Computer Security Applications Conference, Dec. 2, 1991, 11 Pages.
Norton, Tim R., “Simalytic Hybrid Modeling Planning the Capacity of Client/Server Applications”, In Proceedings of 15th IMACS World Congress, vol. 6, Aug. 24, 1997, 7 Pages.
“International Search Report & Written Opinion Issued in PCT Application No. PCT/US2006/038856”, dated Feb. 20, 2007, 4 Pages.
Sapuntzakis, et al., “Optimizing the Migration of Virtual Computers”, In Proceedings of the ACM SIGOPS Operating Systems Review, vol. 36, Issue SI, Dec. 31, 2002, 14 Pages.
Selic, Bran., “A Generic Framework for Modeling Resources with UML”, In Journal Computer, vol. 33, Issue 6, Jun. 2000, 6 Pages.
Shi, et al., “An Effective Model for Composition of Secure Systems”, In Journal of Systems and Software, vol. 43, Issue 3, Nov. 30, 1998, 13 Pages.
Somers, Fergal., “Hybrid: Unifying Centralised and Distributed Network Management using Intelligent Agents”, In Proceedings of IEEE Network Operations and Management Symposium, Apr. 15, 1996, 10 Pages.
Sultan, et al., “Migratory TCP: Connection Migration for Service Continuity in the Internet”, In Proceedings of 22nd International Conference on Distributed Computing Systems, Jan. 2002, 2 Pages.
Tofts, Chris, “HOLOS—A Stimulation and Multi Mathematical Modelling Tool”, Retrieved from <<http://www.hpl.hp.com/techreports/2001/HPL-2001-276.html>>, Jan. 2001, 16 Pages.
Vadim, Kotov, “On Virtual Data Centers and Their Operating Environments”, In HP Laboratories Technical Report, Mar. 8, 2001, 20 Pages.
Wang, Wen-Cheng, “How a SCVP Client Authenticates the SCVP Server”, Retrieved from <<https://www.imc.org/ietf-pkix/old-archive-03/msg01323.html>>, Sep. 12, 2003, 3 Pages.
Yamasaki, et al., “Model Based Resources Selection for Efficient Virtual Cluster Deployment”, In Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing, Article No. 6, Nov. 12, 2007, 7 Pages.
Yuhui, Yuan, “e-Commerce Based on ERP for Enterprize by Utilizing DNA and XML”, In Computer Engineering, vol. 27, Issue 6, Jun. 2001, 3 Pages.
Related Publications (1)
Number Date Country
20180095779 A1 Apr 2018 US
Continuations (3)
Number Date Country
Parent 14857480 Sep 2015 US
Child 15721338 US
Parent 14042619 Sep 2013 US
Child 14857480 US
Parent 11169973 Jun 2005 US
Child 14042619 US