Virtualization techniques have a long history in the development of hardware and software systems. Virtual memory, virtual (in-memory) disk storage, and operating system virtual machines are but a few examples of techniques that have long been employed in conventional computational systems. Generally, virtualization techniques seek to abstract underlying resources from layers of functionality (typically software) that employ the resources. Today, partitioning a physical resource for presentation (to multiple resource consumers) as an isolated, but functionally complete instance of the virtualized resource is employed in many modern software systems, including modern operating systems.
While virtualization has long been employed as a method for partitioning individual resources (e.g., in virtual memory or for multi-threaded software executed on a single preemptively scheduled processor), in recent years, virtualization techniques have been employed on a more comprehensive scale. As a result, commercially-available virtualization systems (such as those available from VMware, Microsoft and XenSource) seek to virtualize hardware systems more completely, for example, by presenting an operating system or other software system with a virtualization of underlying hardware.
Virtualization technology has proven useful in both personal and shared computing environments. For example, in data center deployments, virtualization technology facilitates server consolidation and has been used for server replication, downtime management, fault tolerance and disaster recovery. At the desktop, laptop or workstation, virtualization technology has been used to provide support multiple operating system instances and/or virtual machines. For example, support for concurrent execution of multiple operating system and/or virtual machines instances can provide a user, on a single machine, with capabilities normally associated with two or more dissimilar computer systems, e.g., a Microsoft® Windows based personal computer and an iMac® computer running OS X. Microsoft Windows is a trademark of Microsoft Corporation. iMac is a trademark of Apple Computer, Inc.
Often, a virtualization system is hosted as software whose execution is coordinated by a first operating system executing on underlying hardware. The virtualization system exposes resources of the underlying hardware as at least one virtual machine. The virtual machine, in turn, supports execution of a second operating system. Typically, in such configurations, the first operating system is referred to as a host operating system and the second as a guest operating system. Thus, a user that needs or wants access to facilities of two different operating systems (or supported applications) might configure his/her workstation to run both host and guest operating system instances using virtualization technology. In such case, the host operating system more directly interfaces with the hardware machine, while the guest operating system typically incurs at least some additional overhead running within a virtual machine. Improved techniques and flexibility are desired.
Embodiments of the present invention include methods, systems, apparati, computer program products and other tangible realizations of techniques to support interchange of role for guest and host operating system instances executed (or executable) within a virtualization system. In particular, one embodiment of the present invention is a method operating a computer system, the method comprising: (a) selecting a first operating system image from amongst plural operating system images accessible to a hardware machine; (b) booting the hardware machine using the first operating system image and executing code thereof as a host operating system; (c) providing a virtualization environment and instantiating therein a virtual machine using configuration data descriptive of a particular system virtualized, wherein the configuration data is stored separately from the first operating system image; and (d) loading from a second one of the operating system images, a guest operating system and executing code thereof in connection with the instantiated virtual machine.
One or more embodiments of the present invention are methods for supporting an interchange of role for guest and host operating system instances executed (or executable) within a virtualization system. Thus, in a hosted virtualization system that exposes a single virtual machine, some embodiments of the present invention facilitate the interchange (or swap) of guest and host operating system instances such that an operating system instance previously executed as a guest on a virtual machine instead executes as the host, and an operating system instance previously executed as the host is executed instead as a guest operating system on a virtual machine. One or more embodiments support such an interchange while avoiding the commingling of virtual machine metadata with host operating system state which in turn facilitates or allows isolation and encapsulation strategies that can enhance information security and may be important in some deployments. In addition, some embodiments are scalable to interchangeable configurations of three (3) or more operating system instances.
In one or more embodiments in accordance with the present invention, operating system images can be encoded and/or augmented in ways that facilitate interchangeability of corresponding guest and host operating system instances while maintaining or propagating configurational state across such an interchange. Thus, in one example, operating system instances employed in guest and host roles respectively may swap roles. In one example, the swap can be facilitated by in-place conversions that accommodate dissimilar virtual and physical machines. In some cases, coding techniques are employed for virtual machine metadata which facilitate encapsulation, portability and/or scalability of the described methods to embodiments in which three or more operating system instances are supported.
In one or more embodiments, an encoding of two (or more) operating system images may be transported between (or accessible by) two or more alternative physical machines such that guest and host roles employed on a first machine can be swapped (or interchanged) when executed on an alternative machine. For example, such an encoding may support an office configuration in which a Microsoft Windows operating system hosts an OS X guest operating system, but when copied, transported to or accessed from home (e.g., on removal media or through shareable storage) supports a swapped role configuration in which the OS X operating system instance hosts the Microsoft Windows instance as guest operating system.
Using the described techniques, flexible computational systems can be developed in which multiple operating system images are maintained and individual images are selected for execution either as the host operating system (on an underlying hardware machine) or as a guest operating system (on an exposed virtual machine). In some configurations, flexible options are presented to a computer system user as a multiplicity of boot options, as in a multiboot manager. In some configurations, a storage extent that encodes the multiple operating system images is transported (or transportable) amongst (or accessed or accessible by) multiple computer systems.
For example, in some embodiments of the present invention, a first operating system instance may execute natively (e.g., as host) on a first computer system while supporting a second operating system instance as a guest within an exposed virtual machine. The second operating system instance may then be executed as the host (i.e., natively) on the second computer system, while the first operating system instance is executed as a guest within an exposed virtual machine. Although it is not essential that underlying hardware configurations of the multiple computer systems differ in any significant way, one class of exploitations involves differing physical machine configurations. For example, the configuration exposed by a virtual machine executing on the first computer system may closely correspond to the hardware configuration of the second computer system, and similarly the configuration of a virtual machine on the second computer system may closely correspond to that of the second computer system.
Thus, one example is an office computer configuration in which a Microsoft Windows operating system hosts a virtual machine in which an OS X guest operating system executes, and when storage encoding the respective images is transported to or accessed from home (e.g., on removal media or through shareable storage) a home computer system is executed in a swapped role configuration in which the OS X guest operating system instance hosts a virtual machine in which the Microsoft Windows instance executes as a guest operating system. Persons of ordinary skill in the art will, of course, appreciate a wide range of additional exploitations and guest/host interchange scenarios based on the description herein.
In general, embodiments may use or include encodings of virtual machine data that employ any of a variety of underlying storage technologies, including local disk storage, network storage (including storage area network (SAN) mediated storage and network attached storage technologies), even portable and/or removable media. Using virtual-to-physical (V2P) techniques, it is possible to dynamically convert operating system images for an instance previously executed within a virtual machine (i.e., as a guest) into a form that may be booted or loaded on a physical machine. Similarly, operating system images for an instance previously executed on a hardware machine (e.g., as a host) may, in general, be converted for execution in a virtual machine using physical-to-virtual (P2V) techniques.
In some embodiments, methods allow a virtualization system to expose data that encodes an operating system partition, while still securing sensitive virtual machine metadata such as that which encodes swap state, virtual hardware configuration and/or snapshot or checkpoint states. Typically, such metadata includes backing state data corresponding to internal states of devices, memory and other system components virtualized by or for a given virtual machine. As such, even read access to such metadata (e.g., by a guest) can leak or compromise sensitive information, while write access may afford malicious code or users with an attractive vector for attack. Using encapsulation techniques, it is possible to encode virtual machine state in a way that provides isolation and/or security for certain types or portions of the virtual machine state data, while still allowing a virtualization system to expose other types or portions of such data to a guest application or operating system. Accordingly, in some embodiments, P2V and V2P transformation may operate on encapsulated and de-encapsulated operating system images consistent with the in-place conversions described in commonly-owned, co-pending U.S. patent application Ser. No. 12/051,664, filed on Mar. 19, 2008, entitled “IN-PLACE CONVERSION OF VIRTUAL MACHINE STATE,” and naming Hiltgen and Schmidt as inventors, which is incorporated herein by reference. Nonetheless, for simplicity of description and without loss of generality, the description herein is typically without regard to whether, in any particular embodiment, encapsulation operating system image and metadata are employed for any particular virtual machine.
Many embodiments of the present invention will be understood in the context of personal computers or workstations and storage volumes (often local disks or removable media) commonly employed thereby. Nonetheless, some embodiments in accordance with the present invention, particularly cluster-organized and/or enterprise scale systems may build upon or exploit data distribution, replication and management features of modern network storage technology, including storage virtualization, storage area networks (SANs), network attached storage (NAS), etc. In some embodiments, particularly those that employ SAN-type storage arrays, block-level I/O access to virtual machine state data can afford significant performance advantages. Similarly, in some embodiments, non-commingled, encapsulated representations of virtual machine state can be advantageously maintained in distinct storage volumes (or LUNs) of a SAN, such as described in greater detail in commonly-owned, co-pending U.S. patent application Ser. No. 11/960,524, filed Dec. 17, 2007, entitled “SECURING VIRTUAL MACHINE DATA,” naming Hiltgen and Schmidt as inventors, which is incorporated herein by reference. Nonetheless, for simplicity of description and without loss of generality, embodiments of the present invention are described primarily without regard to any particular storage technologies.
Finally, for concreteness, implementations are described herein based on facilities, terminology and operations typical of certain processor architectures and systems, and based on terminology typical of certain operating systems, virtualization systems, storage systems and network protocols and/or services. That said, the described techniques are general to a wide variety of processor and system architectures (including both single and multi-processor architectures based on any of a variety of instruction set architectures), to numerous operating system implementations and to systems in which both conventional and virtualized hardware may be provided. As described herein, the techniques are also general to a variety of storage architectures, including storage virtualization systems such as those based on storage area network (SAN) or network attached storage (NAS) technologies, as well as storage architectures that employ local disk media, removable media, etc.
Accordingly, in view of the foregoing and without limitation on the range of underlying processor, hardware or system architectures, operating systems, storage architectures or virtualization techniques that may be employed in realizations of the present invention, techniques are described primarily in the context of certain exemplary realizations. Based on these exemplary realizations, and on the claims that follow, persons of ordinary skill in the art will appreciate a broad range of suitable implementations and exploitations.
Interchange of Guest and Host Operating System Instances
Users of virtualization technology may wish to operate, at certain times, with a first host/guest configuration, while at other times, with a second host/guest configuration. For example, a user may wish to run a Microsoft® Windows operating system as his/her host operating system while supporting (through virtualization technology) a pair a virtual machines running Mac® OS X and Red Hat Linux as respective guest operating systems. At a later time, in a different situation or on different underlying hardware, the user may instead wish to run OS X as the host operating system and support Microsoft® Windows and/or Linux as guest operating systems. At still another time, in another situation or on other hardware, the user may instead wish to run Linux or a Solaris® operating system as the host, and support Microsoft® Windows and/or OS X as guest operating systems. Indeed, persons of ordinary skill in the art will appreciate many permutations based on the description herein. Microsoft Windows is a trademark of Microsoft Corporation, Mac is a trademark of Apple Inc., and Solaris is a trademark of Sun Microsystems, Inc.
Although a user could conceivably configure a single system with two alternative boot configurations, one executing a first instance of a Microsoft Windows operating system as host and a first instance of OS X as guest, and another with a second instance of OS X as host and a second instance of Microsoft Windows as guest, such a configuration may not be entirely satisfactory. For example, the user may wish to effectuate such a change without losing configuration state for the operating system instances despite a change in role, e.g., from guest-to-host or host-to-guest. Furthermore, any techniques employed to facilitate propagation of configurational state would preferably (i) be scalable to situations in which three (3) or more operating system images are supported and/or (ii) facilitate segregation of virtual machine metadata from a host operating system image. Accordingly, simplistic multi-boot adaptations of conventional virtualization techniques are less than ideal.
One or more embodiments are described by which operating system images can be encoded and/or augmented in ways that facilitate interchangeability of corresponding guest and host operating system instances while maintaining or propagating configurational state across such an interchange. Thus, in some embodiments in accordance with the present invention, operating system instances employed in guest and host roles respectively may swap roles by performing any necessary conversion of an operating system image in-place. In some cases, the in-place conversions may accommodate dissimilar virtual and physical machines, while in others, virtual machine configurations may closely align with the configuration of a physical (hardware) machine. In some cases, coding techniques are employed for virtual machine metadata which facilitate encapsulation, portability and/or scalability of the described techniques to embodiments in which three or more operating system instances are supported.
Some embodiments in accordance with the present invention will be understood with reference to
In a second (post-swap) arrangement 102, operating system “B” instead runs as the host operating system 116 on the same underlying physical machine 125. As before, virtualization software runs in coordination with the host operating system (here, an instance of operating system “B”) as virtualization system 112B. Virtualization system 112B exposes two virtual machines (VMs 113C and 113D), one of which, VM 113C, runs an instance of operating system “A” as guest operating system 118. As before, storage volume 122 encodes images of both operating system “A” and operating system “B.” Thus, the image of operating system “A” used to boot physical machine 125 and instantiated as host operating system 115 in arrangement 101 is also the image instantiated as guest operating system 118 in arrangement 102. Similarly, the image of operating system “B” instantiated as guest operating system 117 in arrangement 101 is also the image used to boot physical machine 125 and instantiated as host operating system 116 in arrangement 102. In the illustrated configuration, storage volume 122 also encodes virtual machine metadata that describes the configuration of at least VMs 113B and 113D.
Since, except for any appropriate in-place transformations, it is the same image that is booted (in one arrangement) as a host operating system and loaded (in the other arrangement) as a guest operating system, configurational state, e.g., device selections and configurations, registry entries, user configurations, network addresses, etc., may all be conveyed across a physical-to-virtual (P2V) or virtual-to-physical (V2P) transition. Note that, although
In-place physical-to-virtual (P2V) or virtual-to-physical (V2P) transformations of operating system images may be necessary (or desirable) in some implementations or for some situations in which characteristics of underlying physical machine 125 and exposed virtual machines (e.g., VMs 113B and 113C) differ significantly. Indeed, such transformations are described in greater detail elsewhere herein. Nonetheless, in many deployments, P2V and V2P transformations of a given operation system image will be minimal or even non-existent, particularly for virtualization system deployments in which configurations of exposed virtual machines (e.g., type and numbers of processors virtualized, type of virtual network adapter, amount of memory virtualized, type of host bus adapter, etc. of VMs 113B and 113C) closely mimic resources provided by underlying hardware (e.g., physical machine 125) or in which the particular operating systems deployed support run-time adaptation to particular hardware.
Finally, as a practical matter, software implementing virtualization system 112B is typically identical to that implementing virtualization system 112A, although minor configurational differences or variations to conform to the underlying host operating system (e.g., different drivers, memory management internals, etc.) are possible. That said, nothing in developed techniques necessarily requires that virtualization systems 112A and 112B be the same. Indeed, as long as virtual machine metadata is stored in a standard, portable format, virtualization systems 112A and 112B may be different virtualization platforms from the same or different vendors, or may be different versions of a given virtualization platform.
In some cases, an encoding of two (or more) operating system images may be transported between (or accessible by) two or more alternative physical machines such that guest and host roles employed on a first machine can be swapped (or interchanged) when executed on an alternative machine. For example, such an encoding may support an office configuration in which a Microsoft Windows operating system hosts an OS X guest operating system, but supports a swapped role configuration in which the OS X guest operating system instance hosts the Microsoft Windows instance as guest operating system when copied, transported to or accessed from home (e.g., on removal media or through shareable storage).
Accordingly,
As before, storage (222) encodes images of both operating system “A” and operating system “B.” Also as before, the storage encodes virtual machine metadata that describes the configuration of relevant virtual machines (here, VM 213B exposed by virtualization system 212A and VM 213C exposed by virtualization system 212B). However, in recognition of the possibility that physical machines 225 and 226 may be physically separated (e.g., across the room, across town or across the country) and may or may not have access to the same underlying storage media, a pair of apparent storage volumes 222A and 222B are illustrated (from the perspective of each arrangement). The illustration is therefore consistent with shared access to a single storage volume, replication (e.g., using SAN or other technology), or even physical media transfer. Whatever the particular vector of transfer or shared access, each of the virtualization systems accesses a copy of operating system images that faithfully replicate state available to the other. Thus, an image of operating system “A” is available (typically at different times) for use (in arrangement 201) in booting and executing host operating system 115 on physical machine 225 or (in arrangement 202) in loading and executing guest operating system 118 on virtual machine 213C. Similarly, an image of operating system “B” is available for use (in arrangement 201) in loading and executing guest operating system 117 on virtual machine 213B or in booting and executing host operating system 116 on physical machine 226.
As noted, physical machines 225 and 226 may be dissimilar in configuration. Therefore, in some deployments consistent with
Turning now to
In
Storage volume 322 includes a partition table 321, partition map or similar construct that identifies constituent partitions including e.g., partitions 330, 340 and 360. Metadata partition 350 (which will typically be identified in partition table 321 as well) encodes configuration information for a virtual machine (e.g., VM 113C or VM 213C, recall
Partition 330 encodes an image 332 of operating system “A” suitable for booting physical machine 325 and typically includes a boot loader (BL) 331 in accordance with any operative requirements or conventions of operating system “A.” Operating system boot loaders are well known in the art and boot loader 331 is of any suitable design. In the illustration of partition 330, two constituent elements OS and D1 are shown in which the operating system image and user data may respectively reside. Often, and in particular for Microsoft® Windows operating system deployments that follow standard partitioning schemes, a primary boot partition (illustrated as OS 332) encodes a “C: drive,” where the operating system, user data, applications, and operating system page file all reside, although other common schemes may segregate certain data (e.g., user data) in a separate partition (illustrated as optional user data D1333). Thus, if any such additional partition is employed, partition table 321 may individually identify partitions in which image 332 of operating system “A” user data D1333 reside. In Unix-type operating systems, including BSD, Linux, Solaris® and even Mac OS X operating system, other partitioning schemes are typically employed. Accordingly, persons of ordinary skill in the art will readily understand that one or more partitions corresponding to partition 330 of
Turning to those elements of storage volume 322 that support operating system “B,” an analogous partition 340 encodes an image 342 of operating system “B” suitable for load and execution in connection with virtual machine 313B. As before, user data D2343 (or other information) may optionally be represented in a separate partition if desired or if conventional for the particular operating system “B” deployed. Although an operating system boot loader (BL) is shown for partition 340 and operating system “B” image 342, the boot loader is typically unused (or dormant) in arrangements corresponding to
Metadata partition 360 encodes configuration data (VMX 362) that defines the hardware system virtualized by virtual machine 313B as well as a backing representation (SWAP 363) of state used by virtualization system 312A in its virtualization or emulation of resources of virtual machine 313B. Based on the particulars of virtual machine configuration data (e.g., type of processor virtualized, type of virtual network card, type of virtual storage host bus adapter (HBA), amount of memory virtualized, etc.), virtualization system 312A instantiates virtual machine 313B and exposes resources thereof to guest software, including the aforementioned guest operating system 117 and applications coordinated thereby. Exposed resources include virtual processor(s) including register states thereof, memory and paging spaces, virtual device and states thereof, etc. (as typical of virtualization systems known in the art), together with disk resources including at least operating system image 342 encoded in partition 340.
Backing representation SWAP 363 encodes execution state for virtual machine 313B at a particular time. For example, backing state data often includes an image (or other coding) of current data in all or a portion of a memory utilized by a virtual machine (e.g., instruction and/or value data in the virtual machine's RAM, cache, registers, etc.). Optionally, explicit or implicit snapshot (SS) data 364 may be encoded in connection with backing state data in metadata partition 360. Typically, snapshot data 364 will be maintained using facilities of a storage system (not separately shown) that transparently support snapshot, checkpointing, state cloning, rollback and/or other related operations without necessarily exposing underlying storage of data for incremental/successive states. For example, snapshot facilities available in modern commercial SANs are typically space efficient (employing copy-on-write and/or delta state technology) and typically provide transparent checkpointing and rollback support for a succession or hierarchy of states related to a baseline. Accordingly, snapshot data 364 is illustrated as an adjunct to backing state data 363, although other representations may be employed, if desired.
Metadata partition 360 also includes a virtual-to-physical (V2P) boot loader 361 that is employed to convert in-place image 342 for boot on a physical machine (e.g., the underlying physical machine 125 as in
Accordingly, in some embodiments of the present invention, to initiate V2P transformations, metadata partition 360 is identified as a boot or load partition in accordance with operative conventions of the target system, and V2P boot loader 361 defines or identifies at least an initial sequence of operations that performs (or initiates performance) of the desired transformations. For example, in an illustrative system conforming to BIOS conventions originated for IBM-compatible personal computers running Microsoft Windows operating systems, a master boot record or MBR (which may appear as the first sector of storage volume 322) identifies (using an appropriate type code) metadata partition 360 as an active primary partition and is employed to initiate V2P boot loader 361 in accordance with a volume boot record encoded in a first sector of metadata partition 360. In other embodiments, another boot vector may be employed to initiate V2P boot loader 361.
A transformative sequence of operations is initiated regardless of which execution vector is employed. Exemplary transformative sequences are described in greater detail below; however, for simplicity of the initial description, two transformative aspects are typical. First, V2P boot loader 361 (either itself or through code that it directly or indirectly initiates) modifies partition table 221 of storage volume 322 to identify partition 340 and to flag boot loader 341 thereof as bootable. Second, if necessary, V2P boot loader 361 (either itself or through code that it directly or indirectly initiates) executes operating system specialization code to conform the operating system “B” image 342 with particulars of a target hardware machine. In some embodiments or situations, partition 340 may be encapsulated as a virtual disk (not separately shown) that is exposed to virtual machine 313B as a primary virtual disk including constituent sub-partitions for the operating system image and data (D2) 343. In such embodiments or situations, V2P boot loader 361 (either itself or through code that it directly or indirectly initiates) may also de-encapsulate operating system “B” image 342 and any optional data 343 for use by the target hardware machine.
In some embodiments, operating system specialization code modifies registry or other configuration data consistent with differences between virtual machine 313B and the target physical system, such as differing processor, memory or device configurations. Note that in support of some transitions from virtual to physical hardware, few if any modifications may be necessary. Indeed, in some exploitations or transitions, differences between configurations of virtual machine 313B and the physical machine may be insignificant or limited to variances for which a given operating system implementation is capable of self configuring, e.g., through plug-and-play or other auto configuration mechanism, on boot.
Of course, persons of skill in the art of bootstrap configurations will recognize that it is often useful to employ a cascade of boot or load sequences; each less constrained by coding space or other resource limits than its predecessor. Accordingly, the operational description herein of boot loaders include, and will be understood to encompass, one or more sequences of operations that may be triggered or initiated responsive to V2P boot loader 361, whether or not coded entirely within a particular coding extent such as within the first sector of metadata partition 360.
Thus, in an arrangement corresponding to
Partition 340 encodes image 342 of operating system “B” now suitable for booting physical machine 425 and includes a boot loader (BL) 341 in accordance with any operative requirements or conventions of operating system “B.” As before, operating system boot loaders are well known in the art, and boot loader 341 is of any suitable design. An analogous partition 330 encodes an image 332 of operating system “A” now suitable for load and execution in connection with virtual machine 313C.
Metadata partition 350 encodes configuration data VMX 352 that defines the hardware system virtualized by virtual machine 313C as well as a backing representation (SWAP 353) of state used by virtualization system 312B in its virtualization or emulation of resources of virtual machine 313C. Based on the particulars of virtual machine configuration data, virtualization system 312B instantiates virtual machine 313C and exposes resources of underlying physical machine 325 to guest software, including the aforementioned guest operating system 118 and applications coordinated thereby. Metadata partition 350 also includes a virtual-to-physical (V2P) boot loader 351 that is employed to convert in-place image 332 for boot on a physical machine. If (or when) it is desirable to execute operating system “A” on a physical machine, rather than on virtual machine 313C, transformations can be initiated to conform or adapt information content of partition 330 (e.g., registry or other configuration state encoded in connection with operating system “A” image 332) to the particular needs or expectations of the hardware system. As before, in some embodiments, virtual-to-physical (V2P) boot loader 351 is introduced into metadata partition 350 and configured as part of a bootstrap vector.
Thus, in an arrangement corresponding to
Building on the forgoing, it will now be apparent that extension of these techniques to larger numbers of operating system (e.g., guest/host interchange amongst 3 or more operating system images) is straightforward. Indeed,
Thus, in arrangement 501, operating system “A” runs as a host operating system 115 drawing on operating system image OSA. Virtualization software runs as virtualization system 512A in coordination with host operating system 115, exposing two virtual machines (VMs 2 and 3) based on definitions encoded in respective metadata (see metadata VM2 and metadata VM3), which run instances of operating systems “B” and “C” as guest operating systems 117 and 119, respectively drawing on operating system images OSB and OSC. In arrangement 502, operating system “B” runs as a host operating system 116 drawing on operating system image OSB. Virtualization software runs as virtualization system 512B in coordination with host operating system 116, exposing two virtual machines (VMs 3 and 1) based on definitions encoded in respective metadata (see metadata VM3 and metadata VM1), which run instances of operating systems “C” and “A” as guest operating systems 119 and 118, respectively drawing on operating system images OSC and OSA. Finally, in arrangement 503, operating system “C” runs as a host operating system 114 drawing on operating system image OSC. Virtualization software runs as virtualization system 512C in coordination with host operating system 114, exposing two virtual machines (VMs 2 and 1) based on definitions encoded in respective metadata (see metadata VM2 and metadata VM1), which run instances of operating systems “B” and “A” as guest operating systems 117 and 118, respectively drawing on operating system images OSB and OSA. V2P boot loaders encode transformations, including operating system specialization if necessary, to prepare operating system images OSA, OSB and OSC for execution as a host operating system when previously executed as a guest operating system.
First, partition table 621 is used to identify the various constituent first-level partitions of storage volume 622. In general, consistent with operative bootstrapping conventions, one of the first-level partitions will typically be identified using a master boot record, MBR (which may appear as the first sector of storage volume 622) or similar construct as a primary active partition. A boot loader defined in the identified partition defines or identifies at least an initial boot sequence of operations. If the desired host operating system previously executed as the host, that boot loader will typically be the boot loader (BL) coded with the host operating system image itself (e.g., boot loader 641 for operating system “B”). If the desired host operating system previously executed as a guest, then the boot loader will typically be a virtual-to-physical (V2P) boot loader coded with the virtual machine metadata (e.g., V2P boot loader 623 for operating system “A”).
Second, as previously described, in some embodiments or situations, it may be desirable to encapsulate storage for an operating system image and related data in accordance with isolation goals. Thus, one of the first-level partitions is configured to encode information, including its own second-level partition table 631 in a way that encapsulates the information (including operating system “A” partitions 635 thereof) in a form suitable to exposure to a virtual machine as virtual disk 630. Although encapsulation and/or isolation techniques, such as those detailed in commonly-owned, co-pending U.S. patent application Ser. No. 11/960,524, filed Dec. 17, 2007, entitled “SECURING VIRTUAL MACHINE DATA,” naming Hiltgen and Schmidt as inventors and incorporated herein by reference, are neither necessary nor essential, some embodiments of the present invention may optionally include such features if desirable. Accordingly,
Building on the preceding description, two exemplary sequences of operations are now illustrated. The first, illustrated in
Turning now to
Whatever the execution vector and timing of the V2P conversion, at step 803, the illustrated sequence accesses storage volume 822 which encodes an image (in partition 830 thereof) of operating system “A”. Note that the image was previously executed as a guest operating on either the present or some other machine. Accordingly, at step 803, the illustrated sequence accesses a virtual-to-physical (V2P) conversion sequence 851 stored in metadata partition 850. In “V2P on boot” sequences in accord with the present description, the boot sequence is configured as V2P boot loader 851 and is identified in accordance with any operative convention as part of the boot sequence. For example, in accordance with certain exemplary partitioning and boot sequence conventions characteristic of BIOS originated for IBM-compatible personal computers running Microsoft Windows operating systems, a root partition table 821 may be configured to identify metadata partition 850 as a primary active (boot) partition and a V2P boot loader therein (e.g., 851) as an operative boot sequence. Typically, such a configuration would be established as part of a prior shutdown sequence and typically, placement of V2P conversion sequence 851 in an initial sector of storage that encodes the metadata partition will be sufficient to introduce the sequence as a V2P boot loader. Alternatively, a multiboot manager or some other mechanism may be employed to vector execution to V2P conversion sequence 851.
In any case, at step 804, V2P conversion is initiated and draws on the V2P conversion sequence 851 encoded in metadata partition 850. If necessary, at step 805, V2P conversion sequence 851 may execute operating system specialization code. In general, appropriate specializations are operating system specific; however, specializations typically include updates to registry or other configuration data consistent with differences between the configuration of the physical system on which V2P conversion sequence 851 is now executed and that of the previous virtual machine. For example, specialization for differing processor, memory and/or device configurations may often be appropriate. Typically, in migrations of Microsoft® Windows operating system deployments, updates to entries of the Windows Registry and installation (if necessary) of appropriate device drivers into the operating system image encoded in operating system “A” partition 830 may be coordinated using conventional setup and deployment facilities of the operating system itself. For example, persons of ordinary skill in the art of Windows® operating system deployments will be familiar with execution of the Windows setup manager (typically setupmgr.exe) and with execution sysprep-type utilities based on directives coded in a sysprep.inf file.
Thus, in some embodiments in accordance with the present invention, at step 805, operating system specializations are coded in accordance with conventional sysprep.inf syntax and execution is performed by initiating the sysprep utility with an appropriately populated sysprep.inf file and with referenced drivers (e.g., for mass storage devices, network adapters, etc. of the hardware machine) available for installation under control of the sysprep utility. In this way, the operating system image encoded in partition 830 may be re-specialized with appropriate drivers for the current physical system. If the physical system requires a different hardware abstraction layer than the previously executed virtual machine (e.g., if the target physical machine is a multiprocessor and the previously executed virtual machine was configured as a uniprocessor, or vice versa), the sysprep.inf file can include an appropriate UpdateHAL entry. Typical specializations may also include Active Directory domain memberships, IP addresses, etc.
Similar specializations may be applied in other operating system environments. In any case, once any appropriate operating system specialization is complete, boot of the resulting operating system image (e.g., that shown as image OS within partition 830) is initiated (at step 806), typically using an associated operating system boot loader (BL) coded therewith. Operating system boot loader BL is typically conventional and persons of ordinary skill in the art will appreciate a wide variety of suitable implementations.
As mentioned above, V2P conversion sequences akin to that just described may be initiated in any of a variety of manners and at any of a variety of times. For example (as illustrated by the collection 899 of operations and scenario just described), V2P conversion sequence 851 may be executed upon boot and embodied as a V2P boot loader. Alternatively, V2P conversion may be performed at another time, typically coincident with shutdown and prior to physical machine boot 807. V2P on shutdown (at step 808) is illustrated by collection 898 of operations. In such a configuration, V2P conversion need not be embodied in any boot sequence or loader and is performed prior to physical machine boot 807. In either case, boot of the operating system image (shown as OS within partition 830) is eventually initiated (806), typically using an associated operating system boot loader (BL) coded therewith. Thereafter, at step 809, virtual machines are started and appropriate operating system images loaded thereon.
This description initially presumes, for the sake of illustration, that physical-to-virtual (P2V) transformation coincident with virtual machine startup, at step 811. In general, selection of operating system “B” for use as a guest operating system can occur at any of a variety of times based on any of a variety of operations. For example, at step 812, operating system “B” may have been selected at or after the shutdown of a hardware machine that previously executed operating system “B” as a host. Optionally, some facility such as provided by a virtualization system itself may allow load-time selection (e.g., at step 812) of a particular operating system image for load as a guest.
Whatever the execution vector and timing of the P2V conversion, at step 813, the illustrated sequence accesses storage volume 822 which encodes an image (shown as OS within partition 840 thereof) of operating system “B”. Note that the image was previously executed as a host operating system on either the present or some other physical machine. Accordingly, at step 813, the illustrated sequence accesses a physical-to-virtual (P2V) conversion sequence. In general, the P2V sequence may be stored in any of a variety of places including partition 830 (which encodes operating system “A” currently executing as the host), in a metadata partition (e.g., metadata partition 860) or elsewhere. For purposes of illustration and without loss of generality, at step 814, a situation is illustrated in which P2V conversion is initiated drawing on a P2V conversion sequence encoded with operating system “A” in partition 830.
As with the previously described V2P conversion, at step 815, a P2V sequence may execute operating system specialization code, if necessary or desired. Note that in some deployments, configurational differences between a virtual machine on which operating system “B” is to be executed and the physical machine on which operating system “B” is executed, may be insignificant. In such cases, or for operating system implementations that are capable of self-configuring to hardware (or to apparent hardware exposed through virtualization), at step 815, operating system specialization need not be performed.
As before, appropriate specializations are, in general, operating system specific; however, specializations typically include updates to registry or other configuration data consistent with differences between the configuration of the virtual machine on which operating system “B” will be executed and that of the physical machine on which operating system “B” was previously executed. For example, specialization for differing processor, memory and/or device configurations may often be appropriate. As with the previously described V2P conversion, in migrations of Microsoft® Windows operating system deployments, updates to entries of the Windows Registry and installation (if necessary) of appropriate device drivers into the operating system image encoded in operating system “B” partition 840 may be coordinated using conventional setup and deployment facilities of the operating system itself. For example, persons of ordinary skill in the art of Windows® operating system deployments will be familiar with execution of the Windows setup manager (typically setupmgr.exe) and with execution sysprep-type utilities based on directives coded in a sysprep.inf file.
Thus, in some embodiments in accordance with the present invention, at step 815, operating system specializations are coded in accordance with conventional sysprep.inf syntax and execution is performed by initiating the sysprep utility with an appropriately populated sysprep.inf file and with referenced drivers (e.g., for mass storage devices, network adapters, etc. of the virtual machine) available for installation under control of the sysprep utility. In this way, the operating system image encoded in partition 840 may be re-specialized with appropriate drivers for the target virtual machine. If the virtual machine requires a different hardware abstraction layer than the previously executed physical machine (e.g., if the target virtual machine is a multiprocessor and the previously executed physical machine was configured as a uniprocessor, or vice versa), the sysprep.inf file can include an appropriate UpdateHAL entry. As before, specializations may also include Active Directory domain memberships, IP addresses, etc.
As mentioned above, P2V conversion sequences akin to that just described may be initiated in any of a variety of manners and at any of a variety of times. For example, P2V conversion sequence 852 may be at or about the time of virtual machine startup, just prior to or coincident with load of operating system “B” as a guest, or at another time, such as coincident with, or after, a prior shutdown of operating system “B” running in a host operating system role. P2V on shutdown is illustrated by the sequence of operations from step 818 to optional execution of OS specialization code at step 815. In such a P2V on shutdown configuration, conversion is typically performed prior to virtual machine startup (see step 809). In any case, at step 816, load of the operating system image (shown as OS within partition 840) is eventually initiated. Thereafter at step 819, the host-to-guest role change is complete and, in scenarios in which a corresponding guest-to-host role change has also been performed (e.g., as illustrated in
Virtualization System Technology and Variations
Although certain virtualization strategies/designs are described herein, virtualization systems 112A, 112B, 212A, 212B, 312A, 312B, 512A, 512B and 512C are representative of a wide variety of designs and implementations in which underlying hardware resources are presented to software (typically to operating system software and/or applications) as virtualized instances of computational systems that may or may not precisely correspond to the underlying physical hardware.
As is well known in the field of computer science, a virtual machine (VM) is a software abstraction—a “virtualization”—of an actual physical computer system.
In general, some interface is provided between the guest software within a VM and the various hardware components and devices in the underlying hardware platform. This interface—which can generally be termed “virtualization software”—may include one or more software components and/or layers, possibly including one or more of the software components known in the field of virtual machine technology as “virtual machine monitors” (VMMs), “hypervisors,” or virtualization “kernels.” Because virtualization terminology has evolved over time and has not yet become fully standardized, these terms (when used in the art) do not always provide clear distinctions between the software layers and components to which they refer. For example, “hypervisor” is often used to describe both a VMM and a kernel together, either as separate but cooperating components or with one or more VMMs incorporated wholly or partially into the kernel itself; however, “hypervisor” is sometimes used instead to mean some variant of a VMM alone, which interfaces with some other software layer(s) or component(s) to support the virtualization. Moreover, in some systems, some virtualization code is included in at least one “superior” VM to facilitate the operations of other VMs. Furthermore, specific software support for VMs is sometimes included in the host OS itself. Unless otherwise indicated, embodiments of the present invention may be used (and/or implemented) in (or in conjunction with) virtualized computer systems having any type or configuration of virtualization software.
In view of the above, and without limitation, an interface usually exists between a VM and the underlying platform which is responsible for actually executing VM-issued instructions and transferring data to and from the memory and storage devices or underlying hardware. Subject to the foregoing, certain commercially available virtualization systems employ a “virtual machine monitor” (VMM) in this role. A VMM is, in one or more embodiments, implemented as a thin piece of software that runs directly on top of a host, or directly on the hardware, and virtualizes at least some of the resources of the physical host machine. The interface exported to the VM is then the same as the hardware interface of a physical machine. In some cases, the interface largely corresponds to the architecture, resources and device complements of the underlying physical hardware; however, in other cases it need not.
Although the VM (and thus applications executing in the VM and their users) cannot usually detect the presence of the VMM, the VMM and the VM may be viewed as together forming a single virtual computer. They are shown and described herein as separate components for the sake of clarity and to emphasize the virtual machine abstraction achieved. However, the boundary between VM and VMM is somewhat arbitrary. For example, while various virtualized hardware components such as virtual CPU(s), virtual memory, virtual disks, and virtual device(s) including virtual I/O devices can be presented as part of previously described VMs (see
It should be noted that while VMMs can be viewed as executing on underlying system hardware, many implementations based on the basic abstraction may be implemented. In particular, some implementations of VMMs (and associated virtual machines) execute in coordination with a kernel that itself executes on underlying system hardware, while other implementations are hosted by an operating system executing on the underlying system hardware and VMMs (and associated virtual machines) execute in coordination with the host operating system. In a “hosted” configuration (such as illustrated in
Hosted Virtual Computers
Degrees of Virtualization
Different systems may implement virtualization to different degrees—“virtualization” generally relates to a spectrum of definitions rather than to a bright line, and often reflects a design choice in respect to a trade-off between speed and efficiency on the one hand and isolation and universality on the other hand. For example, “full virtualization” is sometimes used to denote a system in which no software components of any form are included in the guest other than those that would be found in a non-virtualized computer; thus, the guest OS could be an off-the-shelf, commercially available OS with no components included specifically to support use in a virtualized environment.
In contrast, another concept, which has yet to achieve a universally accepted definition, is that of “para-virtualization.” As the name implies, a “para-virtualized” system is not “fully” virtualized, but rather the guest is configured in some way to provide certain features that facilitate virtualization. For example, the guest in some para-virtualized systems is designed to avoid hard-to-virtualize operations and configurations, such as by avoiding certain privileged instructions, certain memory address ranges, etc. As another example, many para-virtualized systems include an interface within the guest that enables explicit calls to other components of the virtualization software. For some, para-virtualization implies that the guest OS (in particular, its kernel) is specifically designed to support such an interface. According to this view, having, for example, an off-the-shelf version of Microsoft Windows XP as the guest OS would not be consistent with the notion of para-virtualization. Others define para-virtualization more broadly to include any guest OS with any code that is specifically intended to provide information directly to the other virtualization software. According to this view, loading a module such as a driver designed to communicate with other virtualization components renders the system para-virtualized, even if the guest OS as such is an off-the-shelf, commercially available OS not specifically designed to support a virtualized computer system.
Unless otherwise indicated or apparent, virtualized computer system-based realizations of the present invention are not restricted to use in systems with any particular “degree” of virtualization and is not to be limited to any particular notion of full or partial (“para-”) virtualization.
While the invention(s) is (are) described with reference to various implementations and exploitations, it will be understood that these embodiments are illustrative and that the scope of the invention(s) is not limited to them. In general, virtual machines may be implemented consistent with hardware system now existing or hereafter defined. In addition, while the description of virtualization techniques has generally assumed that the virtual machines present interfaces consistent with a hardware system, persons of ordinary skill in the art will recognize that the techniques described may be used in conjunction with virtualizations that do not correspond directly to any particular hardware system.
Many variations, modifications, additions, and improvements are possible. For example, while particular boot sequencing and storage partitioning techniques characteristic of Microsoft® Windows operating system implementations on IBM-compatible personal computer designs have been described in detail herein, applications to other operating systems and computer systems will also be appreciated by persons of ordinary skill in the art. Plural instances may be provided for components, operations or structures described herein as a single instance. Finally, boundaries between various components, operations and data stores are somewhat arbitrary, and particular operations are illustrated in the context of specific illustrative configurations. Other allocations of functionality are envisioned and may fall within the scope of the invention(s). In general, structures and functionality presented as separate components in the exemplary configurations may be implemented as a combined structure or component. Similarly, structures and functionality presented as a single component may be implemented as separate components. These and other variations, modifications, additions, and improvements may fall within the scope of the invention(s).
This application claims the benefit of U.S. Provisional Application No. 60/984,304, filed Oct. 31, 2007. In addition, this application is related to commonly-owned, co-pending U.S. patent application Ser. No. 12/051,664, filed on Mar. 19, 2008, entitled “IN-PLACE CONVERSION OF VIRTUAL MACHINE STATE,” and naming Hiltgen and Schmidt as inventors.
Number | Name | Date | Kind |
---|---|---|---|
6178503 | Madden et al. | Jan 2001 | B1 |
7082598 | Le et al. | Jul 2006 | B1 |
7725893 | Jaeckel et al. | May 2010 | B2 |
7769720 | Armington | Aug 2010 | B2 |
8086836 | Chong et al. | Dec 2011 | B2 |
8555017 | McCann | Oct 2013 | B2 |
8561063 | Jaeckel et al. | Oct 2013 | B2 |
20030093658 | Wen et al. | May 2003 | A1 |
20030154337 | Ohno et al. | Aug 2003 | A1 |
20030191911 | Kleinschnitz et al. | Oct 2003 | A1 |
20050229175 | McCrory et al. | Oct 2005 | A1 |
20060089995 | Kerr et al. | Apr 2006 | A1 |
20080022068 | Taillefer | Jan 2008 | A1 |
20090037909 | Xu | Feb 2009 | A1 |
20090119778 | Bhuyan | May 2009 | A1 |
Entry |
---|
InfoWorld Virtualization Report “VMware isn't the only New Converter Tool in Town”, http://weblog.infoworld.com/virtualization archives/2007/01/vmware—isnt—the.html, Jan. 31, 2007, 2 pages. |
Vance, Ashlee, “VMware wallops Microsoft with white paper”, The Register, Feb. 26, 2007, 4 pages, http://www.theregister.co.uk/2007/02/26/vmware—ms—spat/print.html. |
Neiger, Gil et al., “Intel Virtualization Technology: Hardware Support for Efficient Processor Virtualization”, Intel Technology Journal, vol. 10, Issue 3, Aug. 10, 2006, pp. 167-178. |
VMware Converter 3, Product Datasheet, VMware, 2007, 2 pages. |
VMware Technical Note, “Virtual Machine to Physical Machine Migration”, 1998-2004, pp. 1-22. |
EasyVMXI:.vmx Config Generator, “EasyVMXI: Create Virtual Machine”, 2 pages, http://www.easyvmx.com/cgi-bin/vmcreate.cgi?filetime=2006-11-29-22%3A18T3A36&vmname=M . . . . |
VMware Technology Network, VMware Workstation 4.5, “Configuring Dual- or Multiple-Boot Systems to Run with VMware Workstation”, 3 pages, http://www.vmware.com/support/ws45/doc/disks—dualmult—ws.html. |
VMware Technology Network, VMware Workstation 4.5, “Installing an Operating System onto a Raw Partition from a Virtual Machine”, 3 pages, http://www.vmware.com/support/ws45/doc/disks—instraw—ws.html. |
VMware PV2 Assistant Product Datasheet, “Utility for physical-to-virtual machine migration”, 2006, 2 pages. |
InfoWorld Virtualization Report, “VMware Making P2V Easier with VMware Converter 3”, Jan. 29, 2007, 2 pages, http://weblog.infoworld.com/virtualization/archives/2007/01/vmware—making—p.html. |
VMware Technical Note, “VMware Virtual Disks Virtual Disk Format 1.0”, 1998-2006, pp. 1-13. |
Number | Date | Country | |
---|---|---|---|
20090113423 A1 | Apr 2009 | US |
Number | Date | Country | |
---|---|---|---|
60984304 | Oct 2007 | US |