Virtualization allows the abstraction and pooling of hardware resources to support virtual machines in a software-defined data center (SDDC). For example, through server virtualization, virtualized computing instances such as virtual machines
(VMs) running different operating systems may be supported by the same physical machine (e.g., host). Each VM is generally provisioned with virtual resources to run a guest operating system and applications. The virtual resources may include central processing unit (CPU) resources, memory resources, storage resources, network resources, etc. In practice, it is desirable to detect potential security threats that may affect the performance of hosts and VMs in the SDDC.
According to examples of the present disclosure, security threat analysis may be implemented to improve data center security. One example may involve a first computer system (e.g., host 210A in
Next, the test packet may be injected at the first network element and forwarded towards the second network element. The test packet may be detected by a security checkpoint (e.g., 218A/219A in
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof. In the drawings, similar symbols typically identify similar components, unless context dictates otherwise. The illustrative embodiments described in the detailed description, drawings, and claims are not meant to be limiting. Other embodiments may be utilized, and other changes may be made, without departing from the spirit or scope of the subject matter presented here. It will be readily understood that the aspects of the present disclosure, as generally described herein, and illustrated in the drawings, can be arranged, substituted, combined, and designed in a wide variety of different configurations, all of which are explicitly contemplated herein.
Although the terms “first” and “second” are used to describe various elements, these elements should not be limited by these terms. These terms are used to distinguish one element from another. For example, a first element may be referred to as a second element, and vice versa.
In the example in
Referring also to
For example, host-A 210A may support VM1231 and VM2232, while VM3233 and VM4234 are supported by host-B 210B. Hardware 212A/212B includes suitable physical components, such as central processing unit(s) (CPU(s)) or processor(s) 220A/220B; memory 222A/222B; physical network interface controllers (PNICs) 224A/224B; and storage disk(s) 226A/226B, etc.
Hypervisor 214A/214B maintains a mapping between underlying hardware 212A/212B and virtual resources allocated to respective VMs. Virtual resources are allocated to respective VMs 231-234 to support a guest operating system (OS; not shown for simplicity) and application(s); see 241-244, 251-254. For example, the virtual resources may include virtual CPU, guest physical memory, virtual disk, virtual network interface controller (VNIC), etc. Hardware resources may be emulated using virtual machine monitors (VMMs). For example in
Although examples of the present disclosure refer to VMs, it should be understood that a “virtual machine” running on a host is merely one example of a “virtualized computing instance” or “workload.” A virtualized computing instance may represent an addressable data compute node (DCN) or isolated user space instance. In practice, any suitable technology may be used to provide isolated user space instances, not just hardware virtualization. Other virtualized computing instances may include containers (e.g., running within a VM or on top of a host operating system without the need for a hypervisor or separate operating system or implemented as an operating system level virtualization), virtual private servers, client computers, etc.
Such container technology is available from, among others, Docker, Inc. The VMs may also be complete computational environments, containing virtual equivalents of the hardware and software components of a physical computing system.
The term “hypervisor” mayrefer generally to a software layer or component that supports the execution of multiple virtualized computing instances, including system-level software in guest VMs that supports namespace containers such as Docker, etc. Hypervisors 214A-B may each implement any suitable virtualization technology, such as VMware ESX® or ESXi™ (available from VMware, Inc.), Kernel-based Virtual Machine (KVM), etc. The term “packet” mayrefer generally to a group of bits that can be transported together, and may be in another form, such as “frame,” “message,” “segment,” etc. The term “traffic” or “flow” mayrefer generally to multiple packets. The term “layer-2” mayrefer generally to a link layer or media access control (MAC) layer; “layer-3” a network or Internet Protocol (IP) layer; and “layer-4” a transport layer (e.g., using Transmission Control Protocol (TCP), User Datagram Protocol (UDP), etc.), in the Open System Interconnection (OSI) model, although the concepts described herein may be used with other networking models.
SDN controller 280 and SDN manager 282 are example network management entities in SDN environment 100. One example of an SDN controller is the NSX controller component of VMware NSX® (available from VMware, Inc.) that operates on a central control plane. SDN controller 280 may be a member of a controller cluster (not shown for simplicity) that is configurable using SDN manager 282. Network management entity 280/282 may be implemented using physical machine(s), VM(s), or both. To send or receive control information, a local control plane (LCP) agent (not shown) on host 210A/210B may interact with SDN controller 280 via control-plane channel 201/202.
Through virtualization of networking services in SDN environment 100, logical networks (also referred to as overlay networks or logical overlay networks) may be provisioned, changed, stored, deleted and restored programmatically without having to reconfigure the underlying physical hardware architecture. Hypervisor 214A/214B implements virtual switch 215A/215B and logical distributed router (DR) instance 217A/217B to handle egress packets from, and ingress packets to, VMs 231-234. In SDN environment 100, logical switches and logical DRs may be implemented in a distributed manner and can span multiple hosts.
For example, a logical switch (LS) may be deployed to provide logical layer-2 connectivity (i.e., an overlay network) to VMs 231-234. A logical switch may be implemented collectively by virtual switches 215A-B and represented internally using forwarding tables 216A-B at respective virtual switches 215A-B. Forwarding tables 216A-B may each include entries that collectively implement the respective logical switches. Further, logical DRs that provide logical layer-3 connectivity may be implemented collectively by DR instances 217A-B and represented internally using routing tables (not shown) at respective DR instances 217A-B. Each routing table may include entries that collectively implement the respective logical DRs.
Packets may be received from, or sent to, each VM via an associated logical port (not shown for simplicity). Here, the term “logical port” or “logical switch port” may refer generally to a port on a logical switch to which a virtualized computing instance is connected. A “logical switch” mayrefer generally to a software-defined networking
(SDN) construct that is collectively implemented by virtual switches 215A-B, whereas a “virtual switch” mayrefer generally to a software switch or software implementation of a physical switch. In practice, there is usually a one-to-one mapping between a logical port on a logical switch and a virtual port on virtual switch 215A/215B. However, the mapping may change in some scenarios, such as when the logical port is mapped to a different virtual port on a different virtual switch after migration of the corresponding virtualized computing instance (e.g., when the source host and destination host do not have a distributed virtual switch spanning them).
A logical overlay network may be formed using any suitable tunneling protocol, such as Virtual eXtensible Local Area Network (VXLAN), Stateless Transport Tunneling (STT), Generic Network Virtualization Encapsulation (GENEVE), Generic Routing Encapsulation (GRE), etc. For example, VXLAN is a layer-2 overlay scheme on a layer-3 network that uses tunnel encapsulation to extend layer-2 segments across multiple hosts which may reside on different layer 2 physical networks. Hypervisor 214A/214B may implement virtual tunnel endpoint (VTEP) 219A/219B to encapsulate and decapsulate packets with an outer header (also known as a tunnel header) identifying the relevant logical overlay network (e.g., VNI). Hosts 210A-B may maintain data-plane connectivity with each other via physical network 205 to facilitate east-west communication among VMs 231-234.
One of the challenges in SDN environment 100 is improving the overall data center security. For example, to protect against security threats caused by unwanted packets, hypervisor 214A/214B may implement distributed firewall (DFW) engine 218A/218B and/or intrusion detection and prevention system (IDPS) engine 219A/219B as security controls to filter packets to/from associated VMs 231-234. In practice, packets may be filtered at any point along a datapath from a source (e.g., VM1231) to a physical NIC (e.g., 224A/224B) on host 210A/210B.
At host-A 210A, for example, hypervisor-A 214A implements DFW engine 218A and/or IDPS engine 219A to filter packets for VM1231 and VM2232. At host-B 210B, hypervisor-B 214B implements DFW engine 218B and/or IDPS engine 219B to filter packets for VM3233 and VM4234. DFW engine 218A/218B may filter packets based on any suitable security policies in the form of firewall rules. Additionally or alternatively, IDPS engine 219A/219B may be configured to filter packets according to any suitable security policies in the form of IDPS rules.
In practice, however, malicious actors typically employ a multitude of tactics and techniques to breach an organization's defenses. In more recent times, it is observed that security attacks increasingly rely on lateral movements within SDN environment 100. Here, attackers may pivot laterally between workloads and beyond their initial point of attack (i.e., patient zero) in order to gain access to valuable resources or to cause the greatest amount of damage. This highlights the importance of east-west security controls beyond the perimeter (i.e., north-south) of the data center.
Given the complexity of security attacks and the distributed nature of modern applications, it may be challenging to design and implement security policies to safeguard various entities in SDN environment 100.
According to examples of the present disclosure, security threat analysis may be implemented to improve data center security. Using examples of the present disclosure, test packets having malicious content may be forwarded from one network element to another to test the efficacy or effectiveness of various security policies (e.g.,
DFW and/or IDPS rules). As used herein, the term “malicious content” mayrefer generally to header and/or payload information in a packet that is associated with a security threat. The term “security threat” maybe used as an umbrella term to cover hostile or intrusive software, including but not limited to exploit codes, botnets, viruses, worms, Trojan horse programs, spyware, phishing, adware, riskware, rootkits, spams, scareware, ransomware, or any combination thereof. A test packet with “malicious content” maybe an unwanted packet that, for example, attempts to reach a particular destination to launch a security attack.
Examples of the present disclosure may be implemented as part of a breach and attack simulation (BAS) or distributed BAS (DBAS) solution to test the effectiveness of various security policies against substantially realistic and complicated security attacks. In general, BAS solutions are designed to test security performance by simulating an attack scenario and provide an analysis of how security controls perform. According to Gartner® Research, BAS technologies are defined as tools “that allow enterprises to continually and consistently simulate a full attack cycle (including insider threats, lateral movement and data exfiltration) against enterprise infrastructure, using software agents, virtual machines and other means.”
Examples of the present disclosure may be implemented to provide a substantially easy-to-use simulation capability without necessitating the deployment of additional proprietary agents that are required by conventional BAS solutions. Such agent-based approaches often come with several challenges. First, users may object to deploying agents on production workloads because it may require orchestration, cause additional overhead and require compliance sign-off, possibly delaying the roll-out of an effective BAS. Second, when agents are deployed, there is a non-zero risk that malicious packets may be delivered to, and adversely impact on, those production workloads. In some cases, compliance policies at various enterprises may not allow such conventional BAS solutions.
Some examples will be described using
SDN environment 100. Example process 300 may include one or more operations, functions, or actions illustrated by one or more blocks, such as 310 to 350. Depending on the desired implementation, various blocks may be combined into fewer blocks, divided into additional blocks, and/or eliminated.
In the following, various examples will be discussed using host 210A/210B as an example “computer system,” VM 231/233 as example “virtualized computing instance” and VNIC 261/263 as example “network element.” In practice, host 210A/210B may implement examples of the present disclosure using any suitable hardware and/or software. For example, host 210A/210B may include security threat analyzer 270A/270B (or security threat analysis module) may be configured to perform blocks 310-320. Host 210A/210B may further include security checkpoint(s) to perform blocks 330-350, such as DFW engine 218A/218B, IDPS engine 219A/219B, etc.
At 310 in
Using the example in
At 330-340 in
As used herein, the term “security checkpoint” mayrefer generally to any suitable component that is capable of applying one or more security policies on test packets that are being forwarded along a network path. In the example in
Depending on the desired implementation, security threat analysis may be applied to VNIC 261/262/263/264 of VM 231/232/233/234. This way, a security attack may be simulated between multiple workloads in a distributed manner regardless of their physical placement on physical host(s). Although first virtualized computing instance=VM1231 on host-A 210A and second virtualized computing instance=VM3233 on host-B 210B are used as examples in
First, blocks 410-420 in
At 410-415 in
In
In general, the content of a packet may be saved into a PCAP file using any suitable approach, such as a packet capture utility, etc. In the example in
Further, example UI 500 in
Blocks 420-470 in
(a) Test packet injection
At 420-425 in
At 430-435 in
At 440 in
Depending on the desired implementation, configuration steps 441-442 may be performed by host-A 210A and/or management entity 280/282. In one approach, block 440 may involve host-A 210A receiving a test packet from management entity 280/282, which configures the test packet to specify (SIP=IP-VM1, SMAC=MAC-VM1, DIP=IP-VM3, DMAC=MAC-VM3, UUID=X). In response, host-A 210A may configure an outer header of the test packet to specify FLAG=1 prior to test packet injection. Alternatively, block 440 may involve host-A 210A configuring the header and/or payload information of the test packet to specify (SIP=IP-VM1, SMAC=MAC-VM1, DIP=IP-VM3, DMAC=MAC-VM3, UUID=X, FLAG=1) based on control information 620 from management entity 280/282.
At 445 in
(b) Security checkpoints and policies
At 450 and 460 in
Alternatively or additionally, first IDPS engine 219A on host-A 210A and second IDPS engine 219B on host-B 210B may be configured as security checkpoints to apply security policies in the form of IDPS rules. Using signature-based IDPS, for example, a particular IDPS rule may specify (a) match field(s) specifying tuple information to be matched with a packet, (b) at least one signature to be matched with the test packet and (c) an action to be performed in case of a match.
Similarly, the tuple information may include SIP, DIP, SMAC, DMAC, SPN, DPN, protocol, or any combination thereof. In practice, a set of signature(s) may be defined as part of a security profile associated with the IDPS rule. A signature may be defined or expressed using a signature rule specifying one or more patterns. Each pattern may be expressed using any suitable string that is detectable from a packet that includes malicious content, such as a sequence of byte(s) and/or text character(s), etc.
For each firewall or IDPS rule, any suitable action may be defined, such as “detect only” (i.e., an alert will be raised, but the test packet is allowed to go through when malicious content is detected), “detect and prevent” (i.e., drop/block the test packet when malicious content is detected), etc. In other words, when action=“detect and prevent” is performed, the test packet may be dropped/blocked and it is not necessary to continue forwarding the test packet towards VNIC3263.
(c) Report information
At 455 and 465 in
VNIC3263 via the security checkpoints below.
In a first example, in response to detecting test packet 630 having FLAG=1, DFW engine 218A on source host-A 210A may apply a first set of firewall rule(s) denoted as DFWR1. Next, DFW engine 218A may generate and send, to management entity 280/282, first report information (“REPORT1”) indicating whether the malicious content in test packet 630 is detectable based on the firewall rule(s). REPORT1 includes the UUID extracted from test packet 630. See 640-645 in
In a second example, in response to detecting test packet 630 having FLAG=1, IDPS engine 219A may apply a first set of IDPS rule(s) denoted as IDPSR1. Next,
IDPS engine 219A may generate and send, to management entity 280/282, second report information (“REPORT2”) indicating whether the malicious content in test packet 630 is detectable based on the IDPS rule(s). REPORT2 includes the UUID extracted from test packet 630. See 650-655 in
In a third example, in response to detecting test packet 630 having FLAG=1, IDPS engine 219B may apply a second set of IDPS rule(s) denoted as IDPSR2. Next, IDPS engine 219B may generate and send, to management entity 280/282, third report information (“REPORT3”) indicating whether the malicious content in test packet 630 is detectable based on the IDPS rule(s). REPORT3 includes the UUID extracted from test packet 630. See 660-665 in
Depending on the desired implementation, a dvfilter channel may be used once a packet is matched to an IDPS rule within a kernel space and the packet needs to be punted to a user space. Once punted from the kernel space to the user space via the dvfilter channel, IPDS engine 219A/219B may process the packet to identify any malicious content in the packet.
In a fourth example, in response to detecting test packet 630 having FLAG=1, DFW engine 218B on source host-B 210B may apply a second set of firewall rule(s) denoted as DFWR2. Next, DFW engine 218B may generate and send, to management entity 280/282, fourth report information (“REPORT4”) indicating whether the malicious content in test packet 630 is detectable based on the firewall rule(s). REPORT4 includes the UUID extracted from test packet 630. See 670-675 in
(d) Test packet removal
At 470 in
INFRASEGMENT02704), which are in turn connected via a logical router in the form of a tier 1 gateway (see T1-GW 705).
Logical network elements 703-705, along with VNIC1261 and VNIC3263, may be configured as observation points to generate and send additional report information associated with test packet 630 to management entity 280/282. For example, source VNIC1261 may report that test packet 630 has been injected. Intermediate observation points (e.g., 703-705) may report that test packet 630 has been forwarded. Destination VNIC 263 may report that test packet has been dropped, thereby preventing it from reaching VM3233. See 710, 740-760 and 790.
Example UI 700 may also include UI elements to present report information generated by various security checkpoints. Note that example UI 700 in
Further, REPORT3 660 (see also 770) from IDPS engine 219B on host-B 210B may indicate that test packet 630 has been received and forwarded, and its malicious content detected. Here, a signature hit event is detected by applying an IDPS rule associated with signature ID=SID1. REPORT4 670 (see also 780) from DFW engine 218B indicates that test packet 630 has been received and forwarded, and its malicious content detected using a firewall rule associated with ID=R2.
Report information 640-670 may include any suitable details. For example,
When used as a pre-sales tool, examples of the present disclosure may facilitate a non-disruptive test of existing security controls as well as native security features in SDN environment 100. Report information associated with security threat analysis may assist user(s) 102 to design and implement security policies that achieve better segmentation and threat prevention. Beyond pre-sales, examples of the present disclosure may be implemented to provide a tool for customers to continuously validate the efficacy of their security controls throughout their virtualized data center.
Examples of the present disclosure may be implemented to simulate sophisticated full-cycle security attacks. In this case, the example test packet configuration and injection in
In the example in
(a) Multiple stages of a security attack
In practice, attacker 910 (i.e., malicious entity) in
At S3913 (discovery stage), VM1231 may be instructed by attacker 910 to discover vulnerabilities in other VMs, such as using horizontal and/or vertical port scanning, etc. For example, primary target=VM1231 may initiate a vertical port scan by sending requests to different ports on secondary target=VM3233 to look for system flaws. At S4914 (lateral movement stage), VM1231 may be instructed to initiate a remote desktop protocol (RDP) session with VM3233. At S5915 (i.e., collection stage), VM1231 may be instructed to access an organization's confidential data (e.g., customer account data) using the RDP session with VM3233.
At S6916 (data exfiltration stage), an unauthorized transfer may be initiated such that attacker 910 is able to gain access to the confidential data. In practice, data exfiltration is difficult to detect because it involves data transfer that resembles typical network traffic. Unfortunately, once the confidential data is in the hand of attacker 910, the damages may be significant.
(b) Security threat analysis
To strengthen data center security, examples of the present disclosure may be implemented to simulate multiple security attack stages and test the effectiveness of various security controls against each and every stage. In the example in
At 920-922 in
At 930 in
At 940 in
The above may be repeated for subsequent stages. At 950-970 in
At 980 in
Based on report information 990-992, users (e.g., network administrators) may assess whether security policies implemented by various security checkpoints are able to defend against the simulated multi-stage attack. In practice, users may be able to initiate scenario-based testing on-demand on a scheduled basis. Upon completing a scenario, management entity 280/282 may collect and present configuration and report information associated with the test. The report information may indicate whether each stage of the simulated attack is successful or not (i.e., desired outcome) along with the security policy or policies applied. In cases where these security policies are determined to be inadequate, improvements may be made to better safeguard various VMs against similar attacks in the future.
Although discussed using VMs 231-238, it should be understood that security threat analysis may be performed for other virtualized computing instances, such as containers, etc. The term “container” (also known as “container instance”) is used generally to describe an application that is encapsulated with all its dependencies (e.g., binaries, libraries, etc.). For example, multiple containers may be executed as isolated processes inside VM1231, where a different VNIC is configured for each container. Each container is “OS-less”, meaning that it does not include any OS that could weigh 10 s of Gigabytes (GB). This makes containers more lightweight, portable, efficient and suitable for delivery into an isolated OS environment. Running containers inside a VM (known as “containers-on-virtual-machine” approach) not only leverages the benefits of container technologies but also that of virtualization technologies.
The above examples can be implemented by hardware (including hardware logic circuitry), software or firmware or a combination thereof. The above examples may be implemented by any suitable computing device, computer system, etc. The computer system may include processor(s), memory unit(s) and physical NIC(s) that may communicate with each other via a communication bus, etc. The computer system may include a non-transitory computer-readable medium having stored thereon instructions or program code that, when executed by the processor, cause the processor to perform processes described herein with reference to
The techniques introduced above can be implemented in special-purpose hardwired circuitry, in software and/or firmware in conjunction with programmable circuitry, or in a combination thereof. Special-purpose hardwired circuitry may be in the form of, for example, one or more application-specific integrated circuits (ASICs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), and others. The term ‘processor’ is to be interpreted broadly to include a processing unit, ASIC, logic unit, or programmable gate array etc.
The foregoing detailed description has set forth various embodiments of the devices and/or processes via the use of block diagrams, flowcharts, and/or examples.
Insofar as such block diagrams, flowcharts, and/or examples contain one or more functions and/or operations, it will be understood by those within the art that each function and/or operation within such block diagrams, flowcharts, or examples can be implemented, individually and/or collectively, by a wide range of hardware, software, firmware, or any combination thereof.
Those skilled in the art will recognize that some aspects of the embodiments disclosed herein, in whole or in part, can be equivalently implemented in integrated circuits, as one or more computer programs running on one or more computers (e.g., as one or more programs running on one or more computing systems), as one or more programs running on one or more processors (e.g., as one or more programs running on one or more microprocessors), as firmware, or as virtually any combination thereof, and that designing the circuitry and/or writing the code for the software and or firmware would be well within the skill of one of skill in the art in light of this disclosure.
Software to implement the techniques introduced here may be stored on a non-transitory computer-readable storage medium and may be executed by one or more general-purpose or special-purpose programmable microprocessors. A “computer-readable storage medium”, as the term is used herein, includes any mechanism that provides (i.e., stores and/or transmits) information in a form accessible by a machine (e.g., a computer, network device, personal digital assistant (PDA), mobile device, manufacturing tool, any device with a set of one or more processors, etc.). A computer-readable storage medium may include recordable/non recordable media (e.g., read-only memory (ROM), random access memory (RAM), magnetic disk or optical storage media, flash memory devices, etc.).
The drawings are only illustrations of an example, wherein the units or procedure shown in the drawings are not necessarily essential for implementing the present disclosure. Those skilled in the art will understand that the units in the device in the examples can be arranged in the device in the examples as described or can be alternatively located in one or more devices different from that in the examples. The units in the examples described can be combined into one module or further divided into a plurality of sub-units.