Generally described, computing devices utilize a communication network, or a series of communication networks, to exchange data. Companies and organizations operate computer networks that interconnect a number of computing devices to support operations or provide services to third parties. The computing systems can be located in a single geographic location or located in multiple, distinct geographic locations (e.g., interconnected via private or public communication networks). Specifically, data centers or data processing centers, herein generally referred to as a “data center,” may include a number of interconnected computing systems to provide computing resources to users of the data center. The data centers may be private data centers operated on behalf of an organization or public data centers operated on behalf, or for the benefit of, the general public.
To facilitate increased utilization of data center resources, virtualization technologies may allow a single physical computing device to host one or more instances of virtual machines that appear and operate as independent computing devices to users of a data center. With virtualization, a single physical computing device can create, maintain, delete, or otherwise manage virtual machines in a dynamic matter. In the simplest embodiment, users can request single computing device computer resources from a data center. In more complex embodiments, users, such as system administrators, can request the configuration of virtual machine instances corresponding to a desired set of networked computing devices. In such embodiments, the data center can implement varying number of virtual machine instances to implement the functionality and configuration of the requested physical computing device network.
One advantage of virtualization technology is that it allows for visibility into the status and configuration of the hosted virtual machine network. Modern networks are often distributed systems, lacking a single management entity with the ability to directly monitor network devices and traffic. This lack of central oversight can lead not only to the waste of network resources through overbroad vulnerability scanning and compliance measures, but can cause potentially problematic network events and changes in configuration to go unnoticed. In contrast, a virtual machine network can provide visibility into the operation and status of the virtual network. This increased transparency can lead to greater opportunities for network management, particularly in the area of network security.
The foregoing aspects and many of the attendant advantages of this disclosure will become more readily appreciated as the same become better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein:
Generally described, aspects of the present disclosure relate to the management of virtual machine instances and other programmatically controlled networks. Specifically, embodiments of network data transmission analysis systems and methods are disclosed for managing security assessments of hosted virtual machine networks. Illustrative embodiments of the systems and methods may be implemented on a virtual network overlaid on one or more intermediate physical networks that are used as a substrate network. The hosted virtual machine networks are configured in a manner such that a virtual machine manager component may monitor activity such as user requests, network traffic, and the status and execution of various virtual machine instances to determine possible security assessments, such as vulnerabilities. The virtual machine manager component may determine a variety of assessment events on the basis of these user requests and virtual machine network activities. When an assessment event or triggering activity is detected, aspects of the virtual network may be assessed or scanned for vulnerabilities at varying levels of granularity and sophistication.
In one embodiment of the invention, a security assessment may be performed subsequent or simultaneous to a virtual machine instance execution in order to determine whether the execution has introduced or contributed to system vulnerabilities. In another embodiment of the invention, the virtual machine manager may delay execution of an activity or request for execution until after a security assessment is performed. In still another embodiment of the invention, the virtual machine manager may instantiate and cause the performance of a security assessment on a new set of virtual machine instances with a similar configuration to existing virtual machine instances in order to avoid disrupting the operation of a virtual network. Additionally, under various embodiments of the invention the virtual machine manager may be configured to prevent, delay, or reverse the execution of a virtual machine network activity or request for execution pending the results of a security assessment.
The following section discusses various embodiments of illustrative managed networks for network data transmission analysis. Following that is further discussion of network analysis systems and methods that can configure and implement virtual network security assessments. Accordingly, the description of the managed networks for network data transmission is included for purposes of illustrative embodiments and examples and should not be construed as limiting.
Managed Computer Networks for Network Data Transmission Analysis
With the advent of virtualization technologies, networks and routing for those networks can now be simulated using commodity hardware components. For example, virtualization technologies can be adapted to allow a single physical computing machine to be shared among multiple virtual networks by hosting one or more virtual machines on the single physical computing machine. Each such virtual machine can be a software simulation acting as a distinct logical computing system that provides users with the illusion that they are the sole operators and administrators of a given hardware computing resource. In addition, as routing can be accomplished through software, additional routing flexibility can be provided to the virtual network in comparison with traditional routing. As a result, in some implementations, supplemental information other than packet information can be used to determine network routing.
Aspects of the present disclosure will be described with regard to illustrative logical networking functionality for managed computer networks, such as for virtual computer networks that are provided on behalf of users or other entities. In at least some embodiments, the techniques enable a user to configure or specify a network topology, routing costs, routing paths, and/or other information for a virtual or overlay computer network including logical networking devices that are each associated with a specified group of multiple physical computing nodes. For example, a user (e.g., a network administrator for an organization) or service provider may configure a virtual or overlay network based on detected events, processing criteria, or upon request. With the network configuration specified for a virtual computer network, the functionally and operation of the virtual network can be simulated on physical computing nodes operating virtualization technologies. In some embodiments, multiple users or entities (e.g. businesses or other organizations) can access the system as tenants of the system, each having their own virtual network in the system. In one embodiment, a user's access and/or network traffic is transparent to other users. For example, even though physical components of a network may be shared, a user of a virtual network may not see another user's network traffic on another virtual network if monitoring traffic on the virtual network.
By way of overview,
Overlay Network Manager
The illustrated example includes an example data center 100 with multiple physical computing systems operated on behalf of the ONM system. The example data center 100 is connected to a global internet 135, or general communication network, external to the data center 100. The global internet 135 can provide access to one or more computing systems 145a via private network 140, to one or more other globally accessible data centers 160 that each have multiple computing systems, and to one or more other computing systems 145b. The global internet 135 can be a publicly accessible network of networks, commonly referred to as the Internet, and the private network 140 can be an organization's network that is wholly or partially inaccessible from computing systems external to the private network 140. Computing systems 145b can be home computing systems or mobile computing devices that each connects directly to the global internet 135 (e.g., via a telephone line, cable modem, a Digital Subscriber Line (“DSL”), cellular network or other wireless connection, etc.).
The example data center 100 includes a number of physical computing systems 105a-105d and a Communication Manager module 150 that executes on one or more other computing systems. The example data center further includes a System Manager module 110 that executes on one or more computing systems. In this example, each physical computing system 105a-105d hosts multiple virtual machine computing nodes and includes an associated virtual machine (“VM”) communication manager module (e.g., as part of a virtual machine hypervisor monitor for the physical computing system). Such VM communications manager modules and VM computing nodes include VM Communication Manager module 109a and virtual machines 107a on host computing system 105a, and VM Communication Manager module 109d and virtual machines 107d on host computing system 105d.
This illustrative data center 100 further includes multiple physical networking devices, such as switches 115a-115b, edge router devices 125a-125c, and core router devices 130a-130c. Switch 115a is part of a physical sub-network that includes physical computing systems 105a-105c, and is connected to edge router 125a. Switch 115b is part of a distinct physical sub-network that includes the System Manager module 110, and is connected to edge router 125b. The physical sub-networks established by switches 115a-115b, in turn, are connected to each other and other networks (e.g., the global internet 135) via an intermediate communication network 120, which includes the edge routers 125a-125c and the core routers 130a-130c. The edge routers 125a-125c provide gateways between two or more sub-networks or networks. For example, edge router 125a provides a gateway between the physical sub-network established by switch 115a and the interconnection network 120, while edge router 125c provides a gateway between the interconnection network 120 and global internet 135. The core routers 130a-130c manage communications within the interconnection network 120, such as by routing or otherwise forwarding packets or other data transmissions as appropriate based on characteristics of such data transmissions (e.g., header information including source and/or destination addresses, protocol identifiers, etc.) and/or the characteristics of the interconnection network 120 itself (e.g., routes based on the physical network topology, etc.).
The System Manager module 110 and Communication Manager module 109 can configure, authorize, and otherwise manage communications between associated computing nodes, including providing logical networking functionality for one or more virtual computer networks that are provided using the computing nodes. For example, Communication Manager module 109a and 109c manages associated virtual machine computing nodes 107a and 107c and each of the other Communication Manager modules can similarly manage communications for a group of one or more other associated computing nodes. The Communication Manager modules can configure communications between computing nodes so as to overlay a virtual network over one or more intermediate physical networks that are used as a substrate network, such as over the interconnection network 120.
Furthermore, a particular virtual network can optionally be extended beyond the data center 100, such as to one or more other data centers 160 which can be at geographical locations distinct from the first data center 100. Such data centers or other geographical locations of computing nodes can be inter-connected in various manners, including via one or more public networks, via a private connection such as a direct or VPN connection, or the like. In addition, such data centers can each include one or more other Communication Manager modules that manage communications for computing systems at that data. In some embodiments, a central Communication Manager module can coordinate and manage communications among multiple data centers.
Thus, as one illustrative example, one of the virtual machine computing nodes 107a1 on computing system 105a can be part of the same virtual local computer network as one of the virtual machine computing nodes 107d1 on computing system 105d. The virtual machine 107a1 can then direct an outgoing communication to the destination virtual machine computing node 107d1, such as by specifying a virtual network address for that destination virtual machine computing node. The Communication Manager module 109a receives the outgoing communication, and in at least some embodiments determines whether to authorize the sending of the outgoing communication. By filtering unauthorized communications to computing nodes, network isolation and security of entities' virtual computer networks can be enhanced.
The Communication Manager module 109a can determine the actual physical network location corresponding to the destination virtual network address for the communication. For example, the Communication Manager module 109a can determine the actual destination network address by dynamically interacting with the System Manager module 110, or can have previously determined and stored that information. The Communication Manager module 109a then re-headers or otherwise modifies the outgoing communication so that it is directed to Communication Manager module 109d using an actual substrate network address.
When Communication Manager module 109d receives the communication via the interconnection network 120, it obtains the virtual destination network address for the communication (e.g., by extracting the virtual destination network address from the communication), and determines to which virtual machine computing nodes 107d the communication is directed. The Communication Manager module 109d then re-headers or otherwise modifies the incoming communication so that it is directed to the destination virtual machine computing node 107d1 using an appropriate virtual network address for the virtual computer network, such as by using the sending virtual machine computing node 107a1's virtual network address as the source network address and by using the destination virtual machine computing node 107d1's virtual network address as the destination network address. The Communication Manager module 109d then forwards the modified communication to the destination virtual machine computing node 107d1. In at least some embodiments, before forwarding the incoming communication to the destination virtual machine, the Communication Manager module 109d can also perform additional steps related to security.
Further, the Communication Manager modules 109a and/or 109c on the host computing systems 105a and 105c can perform additional actions that correspond to one or more logical specified router devices lying between computing nodes 107a1 and 107c1 in the virtual network topology. For example, the source computing node 107a1 can direct a packet to a logical router local to computing node 107a1 (e.g., by including a virtual hardware address for the logical router in the packet header), with that first logical router being expected to forward the packet to the destination node 107c1 via the specified logical network topology. The source Communication Manager module 109a receives or intercepts the packet for the logical first router device and can emulate functionality of some or all of the logical router devices in the network topology, such as by modifying a TTL (“time to live”) hop value for the communication, modifying a virtual destination hardware address, and/or otherwise modify the communication header. Alternatively, some or all the emulation functionality can be performed by the destination Communication Manager module 109c after it receives the packet.
By providing logical networking functionality, the ONM system provides various benefits. For example, because the various Communication Manager modules manage the overlay virtual network and can emulate the functionality of logical networking devices, in certain embodiments specified networking devices do not need to be physically implemented to provide virtual computer networks, allowing greater flexibility in the design of virtual user networks. Additionally, corresponding modifications to the interconnection network 120 or switches 115a-115b are generally not needed to support particular configured network topologies. Nonetheless, a particular network topology for the virtual computer network can be transparently provided to the computing nodes and software programs of a virtual computer network.
Logical/Virtual Networking
In this example, computing nodes A 205a and H 255b are part of a single virtual computer network for entity Z. However, computing nodes can be configured to be part of two distinct sub-networks of the virtual computer network and the logical router devices 270a and 270b separate the computing nodes A and H in the virtual network topology. For example, logical router device J 270a can be a local router device to computing node A and logical router device L 270b can be a local router device to computing node H.
In
In this illustrative example, computing node A 205a first sends an address resolution protocol (ARP) message request 222-a for virtual hardware address information, where the message is expected to first pass through a logical device J before being forwarded to computing node H. Accordingly, the ARP message request 222-a includes the virtual network address for logical router J (e.g., “10.0.0.1”) and requests the corresponding hardware address for logical router J.
Illustratively, the Communication Manager module R intercepts the ARP request 222-a, and obtains a hardware address to provide to computing node A as part of spoofed ARP response message 222-b. The Communication Manager module R can determine the hardware address by, for example, looking up various hardware address information in stored mapping information 212, which can cache information about previously received communications. Communication Manager module R can communicate 227 with the System Manager module 290 to translate the virtual network address for logical router J.
The System Manager module 290 can maintain information 294 related to the topology and/or components of virtual computer networks and provide that information to Communication Manager modules. The Communication Manager module R can then store the received information as part of mapping information 212 for future use. Communication Manager module R then provides computing node A with the hardware address corresponding to logical router J as part of response message 222-b. While request 222-a and response message 222-b actually physically pass between computing node A and Communication Manager module R, from the standpoint of computing node A, its interactions occur with local router device J.
After receiving the response message 222-b, computing node A 205a creates and initiates the sending of a communication 222-c to computing node H 255b. From the standpoint of computing node A, the sent communication will be handled as if logical router J 270a were physically implemented. For example, logical router J could modify the header of the communication 265a and forward the modified communication 265b to logical router L 270a, which would similarly modify the header of the communication 265b and forward the modified communication 265c to computing node H. However, communication 222-c is actually intercepted and handled by Communication Manager module R, which modifies the communication as appropriate, and forwards the modified communication over the interconnection network 250 to computing node H by communication 232-3. Communication Manager module R and/or Communication Manager module S may take further actions in this example to modify the communication from computing node A to computing node H or vice versa to provide logical networking functionality. For example, Communication Manager module S can provides computing node H with the hardware address corresponding to logical router L as part of response message 247-e by looking up the hardware address in stored mapping information 262. In one embodiment, a communication manager or computing node encapsulates a packet with another header or label where the additional header specifies the route of the packet. Recipients of the packet can then read the additional header and direct the packet accordingly. A communication manager at the end of the route can remove the additional header.
A user or operator can specify various configuration information for a virtual computer network, such as various network topology information and routing costs associated with the virtual 270a, 270b and/or substrate network 250. In turn, the ONM System Manager 290 can select various computing nodes for the virtual computer network. In some embodiments, the selection of a computing node can be based at least in part on a geographical and/or network location of the computing node, such as an absolute location or a relative location to a resource (e.g., other computing nodes of the same virtual network, storage resources to be used by the computing node, etc.). In addition, factors used when selecting a computing node can include: constraints related to capabilities of a computing node, such as resource-related criteria (e.g., an amount of memory, an amount of processor usage, an amount of network bandwidth, and/or an amount of disk space), and/or specialized capabilities available only on a subset of available computing nodes; constraints related to costs, such as based on fees or operating costs associated with use of particular computing nodes; or the like.
Route Selection on Substrate Network
In
The communication manager modules in
In
As the Routing Manager module 336 directs network traffic on the substrate network 300, traffic can be directed flexibly and various network configurations and network costs can be considered. For example, routing paths can be determined based on specified performance levels for the virtual networks. In one embodiment, if the user for VN1 is entitled to a higher service level, such as for faster speed (e.g. lower latency and/or higher bandwidth), traffic associated with VN1 can be routed on a “fast” path of the substrate network 300. For example, in one embodiment, traffic for “platinum” users is prioritized over traffic for “gold” and “silver” users, with traffic from “gold” users prioritized over “silver” users. In one embodiment, at least some packets of the user with the higher service level are prioritized over packets of a user with a lower service level, for example, during times of network congestion. The user may be entitled to a higher level because the user has purchased the higher service level or earned the higher service level through good behavior, such as by paying bills, complying with the operator's policies and rules, not overusing the network, combinations of the same, or the like.
The Route Manager 336 can store user information or communicate with a data store containing user information in order to determine the target performance level for a virtual network. The data store can be implemented using databases, flat files, or any other type of computer storage architecture and can include user network configuration, payment data, user history, service levels, and/or the like. Typically, the Route Manager will have access to node and/or link characteristics for the substrate nodes and substrate links collected using various network monitoring technologies or routing protocols. The Route Manager can then select routes that correspond to a selected performance level for the virtual network and send these routes to the computing nodes. For example, network W 310 and Y 312 can be built on fiber optic lines while network Y 314 and Z 316 are built on regular copper wire. The Route Manager can receive network metrics data and determine that the optical lines are faster than the copper wires (or an administrator can designate the optical lines as a faster path). Thus, the Route Manager, in generating a route between node A 302 and node C 306 for “fast” VN1 traffic, would select a path going through network W and Y (e.g., path A-B-C).
In another situation, where the user for VN2 is not entitled to a higher service level, VN2 traffic from node A 302 to node B 306 can be assigned to a “slow” or default path through network Y 314 and Z 316 (e.g. path A-D-C). In order to track routing assignments, the Routing Manager can maintain the routes and/or route association in a data store, such as a Routing Information Base (RIB) or routing table 350. The Route Manager can also track the target performance criteria 351 associated with a particular virtual network.
In order to direct network traffic on the substrate network 300, the Routing Manager 336 can create forwarding entries for one or more of the Communication Manager modules 320, 322, 324, 326 that direct how network traffic is routed by the Communication Manager. The Communication Manager modules can store those entries in forwarding tables 352, 354, 356, or other similar data structure, associated with a Communication Manager. For example, for VN1, the Route Manager can generate a control signal or message, such as a forwarding entry 358, that directs VN1 traffic received or generated on node A 302 through network W 310 (on path A-B-C). Meanwhile, for VN2, the Route Manager can generate a control signal or message, such as a forwarding entry 360, which directs traffic received on node A through network Z. The Route Manager can send these forwarding entries to the node A Communication Manager 320, which can store them on its forwarding table 352. Thus, network traffic associated with VN1 and VN2, destined for node C 306 received or generated on node A can travel by either path A-B-C or path A-D-C based on the designated performance level for VN1 and VN2.
While the example of
In some embodiments, the Route Manager 424 or System Manager can optimize or otherwise improve network traffic using other techniques. For example, with reference to
In some situations, it can be desired that substrate routes reflect routes specified in the virtual table. For example, the virtual network user can wish to control how traffic is routed in the substrate network. However, rather than giving the user access to the substrate network, which could put other users at risk or otherwise compromise security, a data center operator can propagate network configuration or virtual network characteristics specified by the user for the virtual network to the substrate network. This propagated data can be used in generating routing paths in the substrate network, thus allowing the user to affect substrate routing without exposing the substrate layer to the user.
Route Selection on Overlay/Virtual Network
A user may wish to specify a route for various reasons. For example, routing costs through LN2 can be cheaper than LN3, such as when LN2 and LN3 are in different locations with different ISPs and one ISP charges lower rates than another. In another example, LN3 can be a backup virtual network for LN2, and used only in some situations, such as for handling overflow from LN2.
Referring back to
The network translation devices can serve as a gateway or entry/exit point into the virtual network. In some embodiments, the network translation devices can translate between a first addressing protocol and a second addressing protocol. For example, if the virtual network is using IPv6 and the external networks are using IPv4, the network translation devices can translate from one addressing protocol to the other for traffic in either direction. In one embodiment, users connect from their private networks to the data centers via a VPN or other connection to a network translation device, which translates and/or filters the traffic between networks.
Referring back to
From information associated with the virtual network, the Route Manager 510 can determine that the user wants to route traffic from LN1 to LN2. The Route Manager can then “favor” substrate routes associated with the LN1 to LN2 virtual path. For example, the Route Manager can specify a low routing cost (e.g. cost 1) for communications, such as data packets, travelling on Network C relative to Network D (e.g. cost 10) such that during route determination, routes through Network C are favored. In one embodiment, the Route Manager can apply a coefficient to stored substrate costs in order to favor one route over another. In another example, explicit routing paths can be set up corresponding to the virtual route. The Route Manager can identify routes in its routing table and communicate those routes with one or more Communication Managers.
Referring back to
By propagating virtual network configuration data to the substrate, and using that configuration data in substrate route calculation, a mechanism is provided for a virtual network user to affect substrate routing. In some embodiments, the virtual configuration data can be used in determining association of the virtual components with the substrate components. For example, components of the same virtual network can be associated with the same substrate computing node or on computing nodes connected to the same switch in order to minimize or otherwise improve substrate network traffic. Configuration data can also be provided the other way and, in some embodiments, the user and/or virtual network can be provided with additional substrate information, such as characteristics of the underlying associated substrate components (e.g., performance, costs) in order to make more informed routing decisions.
In
In some embodiments, the substrate component may not have a Communication Manager or a Route Determination module and other ways of coordinating routing can be used. For example, a substrate component, such as an ordinary router or a network translation device, can be set up multiply on separate paths. Using blacklists, network traffic for a particular virtual network can be allowed on one path but blocked on others. The Route Manager can send a control signal or message updating the blacklists to manage the data flow.
In other embodiments, substrate components can implement IP aliasing, where, for example, “fast” path packets use one set of IP addresses, while “slow” path packets use another set of IP addresses. When the substrate component receives the packet, it can determine which path to use based on the IP address. The Route Manager can send a control signal or message to assign IP addresses to the components based on the type of traffic handled.
Other ways of differentiating how packets are handled by substrate components include: tagging of packets, such as by Multiprotocol Label Switching (MPLS); MAC stacking where a packet could have multiple MAC addresses, the first MAC address for a substrate component, such as a switch, and a second MAC address for a next component either on the “fast” or the “slow” path; and using Network Address Translation (NAT) devices on both ends of a network in order to redirect traffic into the network, such as by spoofing or altering an destination address for an incoming packing and/or altering an the source address of an outgoing packet. In some embodiments, the Route Manager generates control signals or messages for coordinating traffic on the substrate network for the various techniques described above.
Virtual Network Route Selection Process
At block 705, the Route Manager module receives user configuration and/or network configuration data, such as, for example, policy based routing decisions made by the user. In some embodiments, a user interface is provided, allowing a user to specify configuration data. The Route Manager can receive the configuration data from a data store, for example, if user configuration and/or network configuration data are stored on the data store after being received on the user interface or otherwise generated. In some embodiments, the configuration data can include explicit routing paths through the virtual network. In some embodiments, the configuration data can specify associated costs for traversing components of the virtual network, such as links and/or nodes. These costs can be based on monetary costs, packet loss rates, reliability rate, and/or other metrics. These costs can be provided by the user to configure the virtual network provided by the data center operator. However, costs and other network configuration data can come from the data center operator themselves in addition to or instead of from the user. For example, the data center operator can use the virtual network to provide feedback to the user on routing costs, such as by associating monetary use costs for the substrate computing nodes and/or components. In one example, the data center operator can specify a high cost for a high speed network link or high powered computing node so that the virtual network user can take into account that cost in configuring the virtual network.
At block 710, the Route Manager module determines virtual network routes based on the user configuration and/or network configuration data. In some embodiments, routing protocols or the route determination algorithms of the routing protocols, such as BGP, OSPF, RIP, EIGRP or the like, can be used to determine virtual routes.
At block 715, the Route Manager determines one or more forwarding entries for substrate network components, such as computing nodes, network translation devices, or the like. As the Route Manager can determine routing paths and propagate routing decisions to the substrate components, the Route Manager can coordinate routing within a data center and/or between multiple data centers.
At block 720, the Route Manager transmits the forwarding entries to the substrate components. At block 725, the substrate component receives the forwarding entries. The substrate network components can store the forwarding entries in FIB tables or similar structures. Generally, a Communication Manager on the substrate component receives and processes the forwarding entry and manages communications of the substrate component. However, as discussed above, network traffic can also be coordinated for substrate components without a Communication Manager using instead, for example, a NAT device or the like. In some embodiments, the Route Manager can send blacklist updates, manage tagging of the packets, generate stacked MAC addresses, or the like.
At block 730, the substrate components route packets received or generated according to the stored forwarding entries. Generally, a Communication Manager on the substrate component manages the packet routing and refers to the forwarding entries to make forwarding decisions.
Substrate Network Route Selection Process
At block 755, the Route Manager receives characteristics of the substrate nodes and/or node links. The Route Manager can receive the characteristics data from a data store. In some embodiments, a user interface is provided, allowing a user to specify characteristics data. The characteristics can describe such things as monetary costs, network bandwidth, network security, network latency, network reliability and/or the like. These characteristics can be used in a cost function for determining substrate routing paths. This information can be kept by the Route Manager or data source accessible by the Route Manager.
At block 760, the Route Manager receives a target network performance for the virtual network. The target performance can be based on a purchased service level by the user, user history, security data or the like. For example, a service level purchased by a user can have minimum bandwidth, latency, or quality of service requirements. In another example, a user can be a new customer with an unknown payment history such that the user is provisioned on a “slow” virtual network in order to minimize incurred expenses in case the user fails to pay. In another example, a user identified as carrying dangerous or prohibited traffic, such as viruses, spam or the like, can be quarantined to particular substrate components. During quarantine, the virtual network components can be assigned to specialized substrate components with more robust security features. For example, the substrate components can have additional monitoring functionally, such as a deep-packet scanning ability, or have limited connectivity from the rest of the substrate network.
At block 765, the Route Manager determines substrate network routes based on the target network performance and/or characteristics of the substrate nodes and/or links. In one embodiment, the Route Manager can use the characteristic data in a cost function for determining routes. Which characteristic to use or what level of service to provide can be determined by the performance criteria or target performance. For example, for a “fast” route, the Route Manager can use bandwidth and/or latency data for the substrate network to generate routes that minimize latency, maximize available bandwidth, and/or otherwise improve network performance.
The Route Manager can re-determine routes as needed based on changes in the network, the configuration data, and/or the performance level. For example, if a user has purchased N gigabits of “fast” routing but has reached the limit, the Route Manager can generate new routes and shift the user to “slow” routing.
At block 770, the Route Manager transmits forwarding entries for one or more routes to one or more nodes and/or network translation devices. In some embodiments, the Route Manager determines forwarding entries for the substrate components and sends those forwarding entries to the substrate components on the path. In some embodiments, the Route Manager can send blacklist updates, manage tagging of data packets, and/or generate stacked MAC addresses.
At block 775, the Route Manager can optionally update the virtual routing table based on substrate network routes. By changing the virtual network routing table based on the substrate routes, the virtual network can stay logically consistent with the behavior of the substrate network. Thus, users won't necessarily be confused by discrepancies in the virtual routing.
Security Assessment Management within a Virtual Machine Network
With reference now to
With reference to
In communication with the ONM system manager 110 via the communication network 120 is a client computing device interface 802 for obtaining requests from various client computing systems 145 via the external communication network 135. The client computing device interface 802 can obtain various requests, such as requests for modifying or configuring sets of virtual machine instances 107, requests for virtual machine network assessment configurations as well as other requests. Illustratively, the client computing device interface 802 can facilitate interaction with client computing systems 145 via established Application Protocol Interfaces (“APIs”) provide by the substrate network 100.
Also in communication with the ONM system manager 110 is one or more storage nodes 804 for archiving or storing information associated with security assessments or other execution of virtual machine instances 107. The storage nodes 804 can correspond to various storage media including physical storage media associated specifically with the substrate network 100. Additionally, or alternatively, the storage nodes 804 can correspond to various network based storage networks accessible to the substrate network 110 via communication network 120.
With reference now to
In accordance with aspects of the present disclosure, the virtual machine instances 107A-107N can be associated into various sets of virtual machine instances. For example, the sets of virtual machine instances can be associated by affiliation to specific users or user accounts, affiliation to organizations (e.g., a corporate network), specific software applications executed by the virtual machine instances, specific operating systems executed by the virtual machine instances, as well as any number of additional organizational criteria. As will be explained in greater detail below, a virtual machine manager, such as the ONM system manager 110 can manage the performance of virtual machine network security assessments on sets of the virtual machine instances 107A-107N in response to requests from various client computing systems 145 or in response to the determination of an event, including the modification of virtual machine instances and the instantiation of new virtual machine instances. Additionally, the ONM system manager 110 can implement various processing and data collection techniques in response to the determination of an event.
With reference now to
The ONM system manager 110 can process the virtual machine network assessment configuration to generate one or more assessment profiles. In one embodiment, an assessment profile may contain information or executable code associating the assessment profile with a security assessment event or describing one or more assessment preferences.
In one aspect, security assessment events may include events corresponding to activities associated with the execution of a virtual network. In another aspect, security assessment events may include requests for execution of specific virtual machine network activities. Specifically, for the purpose of example, activities associated with security assessment events may include but are not limited to requests for or the execution of: specific network or virtual machine instance transactions; changes in network activity or traffic to a set of virtual machine instances or ports; opening or closing a network port; the addition or removal of a set of virtual machine instances; changes in configuration of a set of virtual machine instances; the joining or leaving of a hardware device on the virtual machine network; the reboot, shut down, or power on of a virtual machine instance or physical computing system; the installation or removal of a software package or application; requests for security assessments; the identification or determination of new internal or external security threats; the modification of a security posture value representing the likelihood of system vulnerability or attack; and/or time defined activities, such as the change of a timer value associated with the virtual machine network generally or with a specific set of virtual machine instances. It will be appreciated by one skilled in the relevant art that a security assessment event may correspond to one or a combination of these activities. For example, a security assessment event may be defined as a request for installation of a specific software package when a security posture value representing the likelihood of system attack is over a predetermined threshold.
Assessment preferences may include various categories of configuration information, including but not limited to assessment timing information, assessment type information, and assessment extent information, as will be explained in greater detail below with respect to
Referring back to
For purposes of illustration, assume that the virtual machine network activity request obtained by the ONM system manager 110 corresponds to a security assessment event. Accordingly, the ONM system manager 110 can process the activity request to determine the corresponding security assessment event as described above. The ONM system manager 110 may determine assessment preferences associated with the determined security assessment events based on assessment profiles or other criteria maintained by the ONM system manager 110. In some embodiments, the ONM system manager 110 can optionally determine whether the virtual machine network activity corresponding to the activity request should be executed before or after a security assessment has been run.
Referring back to
As previously described, the timing, extent, and type of the security assessment may illustratively be based on assessment preferences associated with one or more assessment profiles, or may be dynamically determined based on based on various criteria maintained by the ONM system manager 110. As illustrated in
The ONM system manager 110 may obtain assessment profiles or assessment preferences associated with the determined security assessment event. As previously described, the ONM system manager 110 can determine whether the virtual machine network activity corresponding to the activity request should be executed before or after a security assessment has been performed or otherwise such that the activity request is synchronous with the completion of the security assessment. For purposes of illustration, in the example interaction of
In still another embodiment, the ONM system manager 110 can cause the instantiation of a new set of virtual machine instances in order to perform one or more security assessments without affecting the state or performance of an extant virtual machine network (not shown). For the purpose of illustration, this new set of virtual machine instances may be configured with unique settings, or may be instantiated with settings and state corresponding to an existing set of virtual machine instances. The ONM system manager 110 can cause the execution of the new set of virtual machine instances and cause the performance of a security assessment on this new set of virtual machine instances to test for possible vulnerabilities. In one aspect, for the purpose of example, the ONM system manager 110 may cause performance of a security assessment on the new set of virtual machine instances before or after determining whether to cause the execution of a corresponding set of existing virtual machine instances. In another aspect, the ONM system manager may remove or delete one or more members of a new or existing set of virtual machine instances from the virtual machine network based on the results of the security assessment. These determinations may be based on various security criteria as described above.
In yet another embodiment, the ONM system manager 110 can identify and isolate a set of virtual machine instances before execution of the set of virtual machine instances. Specifically, for the purpose of example, isolation may include preventing contact or limiting access between any virtual machine instance associated with the identified set of virtual machine instances and other virtual machine instances or communication networks. The ONM system manager 110 may cause the performance of a security assessment on the isolated set of virtual machine instances to test for possible vulnerabilities before determining whether to restore the set of virtual machine instances. This determination may be based on various security criteria as described above.
With reference now to
At block 1208, the ONM system manager 110 obtains an assessment profile. In one aspect, the ONM system manager 110 may obtain an existing assessment profile to update with the configuration information. Illustratively, this existing assessment profile may be obtained from a variety of sources such as storage nodes 804 of
With reference now to
At block 1306 the ONM system manager 110 may identify one or more assessment profiles. Illustratively, the assessment profiles may be obtained from a variety of sources as described above with reference to
Returning to
If the ONM system manager 110 determines that the security assessment should be performed before the execution of the requested activity, the routine 1300 proceeds to block 1314 and the ONM system manager 110 causes the performance of a security assessment. Illustratively, this security assessment may be performed by a number of components of the virtual machine network, including but not limited to the ONM system manager 110, other systems of the virtual machine network, or any combination of third-party hardware or software. For the purposes of illustration, security assessment procedures may include procedures for performing security assessments, such as vulnerability scans, on any of various types of virtual network assets such as physical computing systems and devices, virtual machine instances, and virtual machine network configurations, among others. Specifically, for purposes of example, security assessment procedures may include procedures such as computer virus scans, tests against known exploits, software bug detection, input and validation checking, load testing, and the identification of flaws in hardware or software design or implementation, password handling, or privilege management, among a variety of others.
In one aspect, assessment procedures may have no effect on the set of virtual machine instances being scanned or assessed. In an alternate aspect, assessment procedures may change or destructively affect the internal configuration, data, or state of the set of virtual machine instances being scanned or assessed. For example, an assessment type may specify a thorough test of known exploits against a virtual machine instance that may modify or destroy some of the internal data of the virtual machine instance.
In another embodiment, the ONM system manager 110 may be configured to store the results of a security assessment along with a record of the associated security assessment event. The ONM system manager 110 may then subsequently obtain the stored results of a previous security assessment associated with a security assessment event rather than cause the performance of a new security assessment. Illustratively, the storage of security assessment results may allow the ONM system manager 110 to quickly and efficiently obtain assessment results in situations where a similar or identical assessment has previously been performed. Specifically, in an illustrative embodiment, the ONM system manager 110 may store the results of a security assessment performed on a newly instantiated virtual machine instance along with the associated virtual machine configuration or request to instantiate a new instance. For purposes of this example, the ONM system manager 110 may then obtain the stored results of the previous security assessment rather than cause the performance of a new assessment when a later request to instantiate a similar machine is detected.
Under one embodiment, the stored results of a security assessment may be associated with an expiration time or date. Illustratively, ONM system manager 110 may discard expired stored security assessment results when a triggering security assessment event is detected and cause the performance of a new security assessment to ensure that any stored results are accurate and valid under current network conditions. It will be appreciated that expiration times or dates may be associated with all or any subset of stored security assessment results. Expiration dates may be consistent or may vary across any combination of security assessment results, and may be determined dynamically or on the basis of one or more preconfigured values. It will further be appreciated that security assessment results may be stored at storage nodes 804 in
At block 1316 the ONM system manager 110 determines whether the results of the security assessment are satisfactory. In one embodiment, this determination may be based on various security criteria including the success of a particular set of tests performed as part of the security assessment, whether the security assessment identifies a certain number or combination of virtual machine network vulnerabilities, a security threat level value based on an assessment of potential threats and vulnerabilities, whether an aggregate security value based on the results of the assessment crosses a threshold value, among others. If the assessment results are satisfactory, the ONM system manager 110 proceeds to block 1312 and causes the execution of the requested virtual machine network activity.
Returning to block 1310, if the ONM system manager 110 determines that the requested activity should be executed before the performance of the security assessment, the routine proceeds to block 1312 and the ONM system manager 110 causes the execution of the requested virtual machine network activity. At block 1314 the ONM system manager 110 causes the performance of a security assessment. This security assessment may be performed before, after, or simultaneous with the execution of the requested virtual machine network activity as described above with reference to
At block 1318 the ONM system manager 110 logs the assessment results. Illustratively these result logs may be stored at storage nodes 804 in
The ONM system manager may additionally cause the user to be charged a fee (not shown) for the provision of a log or notification. In one embodiment, a security assessment may be performed automatically or continuously, but a user may be required to pay a fee in order to obtain a report of the results of the security assessment. In another embodiment, a user may be charged a fee on a per security assessment basis. Illustratively, this fee may vary based on a number of factors, including the extent, type, and timing of the security assessment, the user's service contract, and other criteria associated with the user, virtual machine network, or security assessment. In still another embodiment, a virtual machine network host may pay or reward a user for receiving regular security assessments. For example, users may be given a discount in the price of hosting if they submit to regular security assessments to ensure the security of their virtual network configuration.
In an additional embodiment, the ONM system manager may further take a corrective action based on the results of the security assessment (not shown). For purposes of illustration, this action may include any action to notify, modify, correct, isolate, or reveal any aspect of the virtual machine network based on the results of the security assessment. The routine ends at block 1322.
With reference now to
The user interface 1400 may further include an assessment event dropdown 1408 or other means for selecting a security assessment event associated with the assessment configuration. Security assessment events may be defined for any type of activity associated with the execution of the virtual machine network or request for execution of a virtual machine network activity, as described above with reference to
The user interface 1400 may further include an assessment type dropdown 1410 or other means for selecting a security assessment type assessment preference associated with the assessment configuration. An assessment type may correspond to any number of security assessment procedures. Illustratively, these security assessment procedures may be implemented and designed by the host of the virtual machine network, a user of one or more virtual machine instances within the virtual machine network, or a third party provider of assessment or scanning tools, among others.
In one embodiment, these security assessment procedures may include vulnerability scans or any procedure intended to potentially reveal or identify a vulnerability or configuration state of a virtual machine network asset, where a vulnerability may be understood as any weakness in design, implementation, operation, or internal control. For the purposes of illustration, security assessment procedures may include procedures for assessing any of various types of virtual network assets such as physical computing systems and devices, virtual machine instances, and virtual machine network configurations, among others. Specifically, for purposes of example, security assessment procedures may include procedures such as computer virus scans, tests against known exploits, software bug detection, input and validation checking, load testing, and the identification of flaws in hardware or software design or implementation, password handling, or privilege management, among a variety of others.
In one aspect, performance of a set of security assessment procedures may have no effect on the set of virtual machine instances being assessed. In an alternate aspect, assessment procedures may change or destructively affect the internal configuration, data, or state of the set of virtual machine instances being assessed. For example, an assessment type may specify a thorough test of known exploits against a virtual machine instance that may modify or destroy some of the internal data of the virtual machine instance. Illustratively, these destructive assessment procedures may allow for rigorous security assessments or vulnerability testing without affecting the configuration of the virtual machine network when performed on sets of virtual machine instances being removed from the virtual machine network, or on sets of virtual machine instances specifically instantiated for testing purposes.
The user interface 1400 may further include an assessment extent dropdown 1412 or other means for selecting a security assessment extent assessment preference associated with the assessment configuration. An assessment extent may specify any number of sets of virtual machine instances or network assets to assess. In one embodiment, sets of virtual machine instances to assess may be predetermined by a user or administrator. In another embodiment, sets of virtual machine instances may be determined dynamically based on criteria related to each of the sets of virtual machine instances. Illustratively, these criteria may include any property of hardware, software, or activity associated with the set of virtual machine instances. For example, these criteria may include a hardware profile of the physical computing systems hosting one or more virtual machine instances within the set of virtual machine instances, a software profile of the set of virtual machine instances, an activity or volume of activity associated with the set of virtual machine instances, or various other criteria. It will be appreciated by one skilled in the relevant art that an assessment extent may be defined to correspond to one or a combination of these criteria or predetermined sets. For example, an assessment extent may include a first predetermined set of virtual machine instances along with a second dynamically determined set of all virtual machine instances receiving more than a specified average volume of network traffic and hosted on a physical computing system with a particular brand of hardware network interface card.
It will further be appreciated by one skilled in the relevant art that an assessment extent may include a currently operational set of virtual machine instances, or may specify a new instantiation of a set of virtual machine instances. For example, a current set of virtual machine instances may be duplicated for the purposes of testing, and the duplicates may be removed once testing is complete to avoid affecting the state or data of the virtual machine network.
The user interface 1400 may further include an assessment timing dropdown 1412 or other means for selecting a security assessment timing assessment preference associated with the assessment configuration. An assessment timing may specify when to cause the performance of a security assessment. For the purposes of illustration, an assessment timing may specify an absolute amount of time to wait or an order of operations relative to the execution of a particular event. For example, an assessment timing may specify that a security assessment is to be performed before, after, or simultaneous to the execution of the activity associated with the security assessment event. In one embodiment, an assessment timing may additionally specify that the execution of the activity associated with the security assessment event is to be delayed, or is contingent on the results of the security assessment.
The user interface 1400 may further include a notify on security assessment failure check-box 1416 or other means for indicating a request for a user notification as described above with reference to
It will be appreciated by one skilled in the relevant art that a network system manager can be configured to manage security assessments in response to any network activity, request, or event discussed in the description of the virtual machine network above, and further may be configured to respond to any of a variety of other network activities, requests, or events available to a network system manager under various other configuration of virtual or programmatically controlled networks. It will be further appreciated by one skilled in the relevant art that the above embodiment and description of the invention in the context of a virtual machine network is provided for purposes of illustration only and that in accordance with aspects of the present disclosure the current invention can be implemented on any programmatically controlled network capable of providing network events to a network system manager. In some embodiments, for the purpose of example, the present invention can be implemented on any combination of hardware and software providing for detection of requests, events, or activities associated with the modification or execution of network resources. In some aspects, these network requests, events, and activities may be available to service providers, users or customers, or administrators of a virtual or programmatically controlled network. In other aspects these network requests, events, and activities may only be available or detectable by a service provider, and may not be available or detectable by a user or customer of the programmatically controlled network. In various embodiments, aspects of hardware and software implementing this invention may be provided by a network service provider, a network service provider customer, or any third-party provider of computing devices, software, or computing services.
It will be appreciated by those skilled in the art and others that all of the functions described in this disclosure may be embodied in software executed by one or more processors of the disclosed components and communications devices. The software may be persistently stored in any type of non-volatile storage.
Conditional language, such as, among others, “can,” “could,” “might,” or “may,” unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. Thus, such conditional language is not generally intended to imply that features, elements and/or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without user input or prompting, whether these features, elements and/or steps are included or are to be performed in any particular embodiment.
Any process descriptions, elements, or blocks in the flow diagrams described herein and/or depicted in the attached figures should be understood as potentially representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps in the process. Alternate implementations are included within the scope of the embodiments described herein in which elements or functions may be deleted, executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those skilled in the art. It will further be appreciated that the data and/or components described above may be stored on a computer-readable medium and loaded into memory of the computing device using a drive mechanism associated with a computer readable storing the computer executable components such as a CD-ROM, DVD-ROM, or network interface further, the component and/or data can be included in a single device or distributed in any manner. Accordingly, general purpose computing devices may be configured to implement the processes, algorithms and methodology of the present disclosure with the processing and/or execution of the various data and/or components described above.
It should be emphasized that many variations and modifications may be made to the above-described embodiments, the elements of which are to be understood as being among other acceptable examples. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.
Number | Name | Date | Kind |
---|---|---|---|
6088801 | Grecsek | Jul 2000 | A |
6205552 | Fudge | Mar 2001 | B1 |
8161479 | Sedukhin et al. | Apr 2012 | B2 |
20100115621 | Staniford et al. | May 2010 | A1 |
20100175108 | Protas | Jul 2010 | A1 |
20120072968 | Wysopal et al. | Mar 2012 | A1 |