This application claims the benefit of Foreign Application Serial No. 202041015268 filed in India entitled “SECURITY THREAT DETECTION DURING SERVICE QUERY HANDLING”, on Apr. 7, 2020, by VMWARE, Inc., which is herein incorporated in its entirety by reference for all purposes.
Virtualization allows the abstraction and pooling of hardware resources to support virtual machines in a software-defined data center (SDDC). For example, through server virtualization, virtualized computing instances such as virtual machines (VMs) running different operating systems may be supported by the same physical machine (e.g., referred to as a “host”). Each VM is generally provisioned with virtual resources to run a guest operating system and applications. The virtual resources may include central processing unit (CPU) resources, memory resources, storage resources, network resources, etc. In practice, it is desirable to detect potential security threats that may affect the performance of hosts and VMs in the SDDC.
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof. In the drawings, similar symbols typically identify similar components, unless context dictates otherwise. The illustrative embodiments described in the detailed description, drawings, and claims are not meant to be limiting. Other embodiments may be utilized, and other changes may be made, without departing from the spirit or scope of the subject matter presented here. It will be readily understood that the aspects of the present disclosure, as generally described herein, and illustrated in the drawings, can be arranged, substituted, combined, and designed in a wide variety of different configurations, all of which are explicitly contemplated herein.
Challenges relating to data center security will now be explained in more detail using
SDN environment 100 includes multiple hosts 110A-B that are inter-connected via physical network 105. Each host 110A/110B may include suitable hardware 112A/112B and virtualization software (e.g., hypervisor-A 114A, hypervisor-B 114B) to support various VMs. For example, hosts 110A-B may support respective VMs 131-134. Hardware 112A/112B includes suitable physical components, such as central processing unit(s) (CPU(s)) or processor(s) 120A/120B; memory 122A/122B; physical network interface controllers (NICs) 124A/124B; and storage disk(s) 126A/126B, etc. In practice, SDN environment 100 may include any number of hosts (also known as a “host computers”, “host devices”, “physical servers”, “server systems”, “transport nodes,” etc.), where each host may be supporting tens or hundreds of virtual machines (VMs).
Hypervisor 114A/114B maintains a mapping between underlying hardware 112A/112B and virtual resources allocated to respective VMs. Virtual resources are allocated to respective VMs 131-134 to support a guest operating system (OS; not shown for simplicity) and application(s) 141-144. For example, the virtual resources may include virtual CPU, guest physical memory, virtual disk, virtual network interface controller (VNIC), etc. Hardware resources may be emulated using virtual machine monitors (VMMs). For example in
Although examples of the present disclosure refer to VMs, it should be understood that a “virtual machine” running on a host is merely one example of a “virtualized computing instance” or “workload.” A virtualized computing instance may represent an addressable data compute node (DCN) or isolated user space instance. In practice, any suitable technology may be used to provide isolated user space instances, not just hardware virtualization. Other virtualized computing instances may include containers (e.g., running within a VM or on top of a host operating system without the need for a hypervisor or separate operating system or implemented as an operating system level virtualization), virtual private servers, client computers, etc. Such container technology is available from, among others, Docker, Inc. The VMs may also be complete computational environments, containing virtual equivalents of the hardware and software components of a physical computing system.
The term “hypervisor” may refer generally to a software layer or component that supports the execution of multiple virtualized computing instances, including system-level software in guest VMs that supports namespace containers such as Docker, etc. Hypervisors 114A-B may each implement any suitable virtualization technology, such as VMware ESX® or ESXi™ (available from VMware, Inc.), Kernel-based Virtual Machine (KVM), etc. The term “packet” may refer generally to a group of bits that can be transported together, and may be in another form, such as “frame,” “message,” “segment,” etc. The term “traffic” or “flow” may refer generally to multiple packets. The term “layer-2” may refer generally to a link layer or media access control (MAC) layer; “layer-3” to a network or Internet Protocol (IP) layer; and “layer-4” to a transport layer (e.g., using Transmission Control Protocol (TCP), User Datagram Protocol (UDP), etc.), in the Open System Interconnection (OSI) model, although the concepts described herein may be used with other networking models.
Hypervisor 114A/114B implements virtual switch 115A/115B and logical distributed router (DR) instance 117A/117B to handle egress packets from, and ingress packets to, corresponding VMs. In SDN environment 100, logical switches and logical DRs may be implemented in a distributed manner and can span multiple hosts. For example, logical switches that provide logical layer-2 connectivity, i.e., an overlay network, may be implemented collectively by virtual switches 115A-B and represented internally using forwarding tables 116A-B at respective virtual switches 115A-B. Forwarding tables 116A-B may each include entries that collectively implement the respective logical switches. Further, logical DRs that provide logical layer-3 connectivity may be implemented collectively by DR instances 117A-B and represented internally using routing tables (not shown) at respective DR instances 117A-B. The routing tables may each include entries that collectively implement the respective logical DRs.
Packets may be received from, or sent to, each VM via an associated logical port. For example, logical switch ports 171-174 are associated with respective VMs 131-134. Here, the term “logical port” or “logical switch port” may refer generally to a port on a logical switch to which a virtualized computing instance is connected. A “logical switch” may refer generally to a software-defined networking (SDN) construct that is collectively implemented by virtual switches 115A-B in
Through virtualization of networking services in SDN environment 100, logical networks (also referred to as overlay networks or logical overlay networks) may be provisioned, changed, stored, deleted and restored programmatically without having to reconfigure the underlying physical hardware architecture. A logical network may be formed using any suitable tunneling protocol, such as Virtual extensible Local Area Network (VXLAN), Stateless Transport Tunneling (STT), Generic Network Virtualization Encapsulation (GENEVE), etc. For example, VXLAN is a layer-2 overlay scheme on a layer-3 network that uses tunnel encapsulation to extend layer-2 segments across multiple hosts which may reside on different layer 2 physical networks. In the example in
SDN controller 180 and SDN manager 184 are example network management entities in SDN environment 100. One example of an SDN controller is the NSX controller component of VMware NSX® (available from VMware, Inc.) that operates on a central control plane. SDN controller 180 may be a member of a controller cluster (not shown for simplicity) that is configurable using SDN manager 184 operating on a management plane. Network management entity 180/184 may be implemented using physical machine(s), VM(s), or both. Logical switches, logical routers, and logical overlay networks may be configured using SDN controller 180, SDN manager 184, etc. To send or receive control information, a local control plane (LCP) agent (not shown) on host 110A/110B may interact with central control plane (CCP) module 182 at SDN controller 180 via control-plane channel 101/102.
Hosts 110A-B may also maintain data-plane connectivity with each other via physical network 105 to facilitate communication among VMs located on the same logical overlay network. Hypervisor 114A/114B may implement a virtual tunnel endpoint (VTEP) (not shown) to encapsulate and decapsulate packets with an outer header (also known as a tunnel header) identifying the relevant logical overlay network (e.g., using a VXLAN (or “virtual” network identifier (VNI) added to a header field). For example in
One of the challenges in SDN environment 100 is improving the overall network security. To protect VMs 131-134 against security threats caused by unwanted packets, hypervisor 114A/114B implements distributed firewall (DFW) engine 118A/118B to filter packets to and from associated VMs. For example, at host-A 110A, hypervisor 114A implements DFW engine 118A to filter packets for VM1131 and VM2132. SDN controller 180 may be used to configure firewall rules that are enforceable by DFW engine 118A/118B. In practice, network packets may be filtered according to firewall rules at any point along the datapath from a source (e.g., VM1131) to a physical NIC (e.g., 124A). In one embodiment, a filter component (not shown) may be incorporated into each VNIC 141-144 to enforce firewall rules that are associated with the VM (e.g., VM1131) corresponding to that VNIC (e.g., VNIC 161). The filter components may be maintained by DFW engines 118A-B. In practice, however, DFW engine 118A/118B might not be able to defend against all possible security threats.
Service Query Handling
In the following, an example security threat during service query handling will be explained in relation to Domain Name System (DNS) query handling. In particular, consider a scenario where APP1141 (“client”) running VM1131 wishes to communicate with a target server (not shown) associated with a domain name (e.g., www.xyz.com). Prior to initiating the communication, the domain name needs to be resolved into an IP address. VM1131 may generate and send a DNS query to DNS resolver 210 to request for a translation of a domain name (e.g., www.xyz.com) to a routable network address (e.g., IP address=IP-xyz). To improve performance, DNS resolver 210 and clients (e.g., VM1131) generally use caching. For example, based on a DNS reply to the DNS query, VM1131 may store mapping information identifying (domain name, IP address) in DNS cache 230.
During DNS query handling, one potential security threat in SDN environment 100 is DNS cache poisoning (also known as DNS spoofing). Here, an attacker may attempt to divert Internet traffic away from legitimate servers towards malicious servers by exploiting vulnerabilities in the DNS protocol. DNS poisoning attacks typically target DNS resolver 210 by injecting malicious mapping information into a DNS cache of DNS resolver 210. If successful, clients may be redirected to access a malicious server. In practice, DNS resolver 210 may implement various defense mechanisms to counter such resolver-side attacks.
A newer class of DNS cache poisoning attack targets the client-side cache, such as DNS cache 230 of VM1131 (see also
Security Threat Detection
According to examples of the present disclosure, security threat detection may be performed during service query handling to improve data center security. Examples of the present disclosure may be implemented to reduce the risk of malicious attacks that exploit vulnerabilities in a service protocol such as DNS. Using enclave-based technologies, security agents 151-156 may be implemented by respective VMs 131-136 to detect potential security threats. Using VM1131 for example, security agent 151 may be configured to operate in a “secure enclave” that is isolated from other processes running on VM1131. This way, during service query handling, security agent 151 may independently and securely verify whether query replies have been poisoned or compromised.
In the following, various examples will be explained using
At 310 in
At 340 in
Enclave-Based Security Agent
At 410 in
In the example in
Once attested by SDN controller 180, security agent 151 may be configured to run in the same context as VM1131, but remain isolated from all other processes running on VM1131, including privileged processes such as a guest OS kernel of VM1131, etc. Security agent 151 may be assigned with at least one reserved port number (see “P2” 502) that is invisible to all other processes on VM1131. In other words, no process running on VM1131 is able to access the reserved port, except for security agent 151. The reserved port number(s) may be TCP and/or UDP port number(s) that are hidden from the guest OS of VM1131.
At 415 in
Any suitable event trapping mechanism(s) may be implemented at block 415. One example may involve registering for callbacks relating to DNS queries and replies, such as using Windows Filtering Platform (WFP), etc. Using WFP, an event trap may be developed to detect DNS queries and replies by interacting with packet processing operations at one or more layers of the networking stack of a guest OS of VM1131. Another example is to configure distributed virtual filter(s) supported by hypervisor 114A/114B to trap DNS queries and responses.
Secure Verification
At 420 and 425 in
DNS resolver 210 may process first DNS query 510 using any suitable approach. For example, in response to detecting first DNS query 510, DNS resolver 210 may retrieve DNS record specifying mapping information (domain name=www.xyz.com, IP address=IP-xyz). DNS resolver 210 may first check whether DNS query 510 may be satisfied using cached information. If not (i.e., cache miss), DNS query 510 will be forwarded to authoritative controller 212.
Authoritative controller 212 may represent an authoritative name server that maintains DNS records and responds to DNS queries for domain names for a particular DNS zone it is responsible for. In practice, DNS resolver 210 may be a “recursive resolver” (also known as a “DNS recursor”) that operates as the first stop for a DNS query. After receiving first DNS query 510, a recursive resolver will either respond with cached data, or execute a sequence of iterative queries in the case of a cache miss. In the latter case, DNS resolver 210 may send respective queries to a root name server (not shown), a top-level domain (TLD) name server (not shown), and finally to authoritative controller 212. After receiving a DNS reply from authoritative controller 212, DNS resolver 210 may send DNS reply 520 containing the requested IP address (e.g., IP-xyz) to APP1141 for use in subsequent traffic to a target server.
DNS resolver 210 and/or authoritative controller 212 may maintain DNS record information in any suitable format. For example, an address (A, AAAA) record specifies an IP version 4 (IPv4) address or IP version 6 (IPv6) address that is mapped to a domain name. A CNAME record specifies redirection to another domain name. A reverse-lookup pointer (PTR) record specifies a domain name associated to an IP address. A host information (HINFO) record specifies general information about a host (e.g., OS information). A name server (NS) record specifies an authoritative name server for a given host. A service (SRV) record specifies a hostname and a port number of a particular service, etc.
At 430 and 435 in
At 440 and 445 in
At 445 (no) and 450 in
Security Threat Detection
Once infected by malware, APP1141 may start consuming all available port numbers, except for one port number “P1” 501. The malware then informs an off-path attacker of the unused port, such as rogue system 220 that is capable of spoofing the IP address of DNS resolver 210. Next, the malware may start accessing sites (www.xyz.com) for which the malware wishes to corrupt in DNS cache 230. To resolve the domain name into an IP address, first DNS query 610 will be sent via unused port number “P1” 501. Rogue system 220 may then send a large number of malicious DNS replies 620 to VM1131 on “P1” 501 to divert traffic to a malicious server. Note that DNS resolver 210 might also reply with the correct IP address (not shown in
According to examples of the present disclosure, security agent 151 may detect first DNS query 610 specifying query input=www.xyz.com and first DNS reply 620 specifying query output=IP-abc associated with the malicious server. In response, security agent 151 may perform an independent verification by generating and sending second DNS query 630 from reserved port number “P2” 502. Since security agent 151 operates in secure enclave 240 that is isolated from APP1141, security agent 151 is protected against the malware running on APP1141. In response to second DNS query 630, security agent 151 may receive second DNS reply 640 from DNS resolver 210 via reserved port number “P2” 502. See corresponding blocks 420-440 in
Next, security agent 151 may compare first DNS reply 620 with second DNS reply 640. In the example in
Based on the comparison, security agent 151 may determine that first DNS reply 620 is suspicious. This is because of a discrepancy between (a) IP-abc in first DNS reply 620 and (b) IP-xyz in second DNS reply 640 even though the same DNS query input=www.xyz.com is used. As such, security agent 151 may determine that there is a potential security threat (see 650 in
In the example in
If confirmed to be suspicious, SDN controller 180 may instruct (see 670) host-A 110A to isolate VM1131. One approach is to configure firewall rule(s) that are enforceable by DFW engine 118A on host-A 110A. In practice, firewall rules may be defined using five tuples to match a specific packet flow, such as source IP address, source port number (PN), destination IP address, destination PN, and protocol, in addition to an action (e.g., allow or block). To block access to the malicious server, DFW engine 118A may be configured to drop any packet specifying destination or source IP address=IP-abc.
Additionally or alternatively, security agent 151 may be configured to monitor any subsequent attempt to access the malicious server using IP address=IP-abc. For example, security agent 151 may capture all three phases of a TCP handshake and block any packets to and from an IP address specified in a poisoned entry in DNS cache 230. This way, the risk of illegitimate TCP connections may be reduced. Using examples of the present disclosure, client-side DNS cache poisoning attack may be detected to initiate the appropriate remediation action. Although explained using DNS, it should be understood that examples of the present disclosure may be implemented for other scenarios that require independent and secure verification of query replies.
Container Implementation
Although explained using VMs, it should be understood that public cloud environment 100 may include other virtual workloads, such as containers, etc. As used herein, the term “container” (also known as “container instance”) is used generally to describe an application that is encapsulated with all its dependencies (e.g., binaries, libraries, etc.). In the examples in
Computer System
The above examples can be implemented by hardware (including hardware logic circuitry), software or firmware or a combination thereof. The above examples may be implemented by any suitable computing device, computer system, etc. The computer system may include processor(s), memory unit(s) and physical NIC(s) that may communicate with each other via a communication bus, etc. The computer system may include a non-transitory computer-readable medium having stored thereon instructions or program code that, when executed by the processor, cause the processor to perform process(es) described herein with reference to
The techniques introduced above can be implemented in special-purpose hardwired circuitry, in software and/or firmware in conjunction with programmable circuitry, or in a combination thereof. Special-purpose hardwired circuitry may be in the form of, for example, one or more application-specific integrated circuits (ASICs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), and others. The term ‘processor’ is to be interpreted broadly to include a processing unit, ASIC, logic unit, or programmable gate array etc.
The foregoing detailed description has set forth various embodiments of the devices and/or processes via the use of block diagrams, flowcharts, and/or examples. Insofar as such block diagrams, flowcharts, and/or examples contain one or more functions and/or operations, it will be understood by those within the art that each function and/or operation within such block diagrams, flowcharts, or examples can be implemented, individually and/or collectively, by a wide range of hardware, software, firmware, or any combination thereof.
Those skilled in the art will recognize that some aspects of the embodiments disclosed herein, in whole or in part, can be equivalently implemented in integrated circuits, as one or more computer programs running on one or more computers (e.g., as one or more programs running on one or more computing systems), as one or more programs running on one or more processors (e.g., as one or more programs running on one or more microprocessors), as firmware, or as virtually any combination thereof, and that designing the circuitry and/or writing the code for the software and or firmware would be well within the skill of one of skill in the art in light of this disclosure.
Software and/or to implement the techniques introduced here may be stored on a non-transitory computer-readable storage medium and may be executed by one or more general-purpose or special-purpose programmable microprocessors. A “computer-readable storage medium”, as the term is used herein, includes any mechanism that provides (i.e., stores and/or transmits) information in a form accessible by a machine (e.g., a computer, network device, personal digital assistant (PDA), mobile device, manufacturing tool, any device with a set of one or more processors, etc.). A computer-readable storage medium may include recordable/non recordable media (e.g., read-only memory (ROM), random access memory (RAM), magnetic disk or optical storage media, flash memory devices, etc.).
The drawings are only illustrations of an example, wherein the units or procedure shown in the drawings are not necessarily essential for implementing the present disclosure. Those skilled in the art will understand that the units in the device in the examples can be arranged in the device in the examples as described, or can be alternatively located in one or more devices different from that in the examples. The units in the examples described can be combined into one module or further divided into a plurality of sub-units.
Number | Date | Country | Kind |
---|---|---|---|
202041015268 | Apr 2020 | IN | national |
Number | Name | Date | Kind |
---|---|---|---|
20050257264 | Stolfo | Nov 2005 | A1 |
20180088976 | Leslie-Hurd | Mar 2018 | A1 |
20180203801 | Leslie-Hurd | Jul 2018 | A1 |
20180212966 | Costa | Jul 2018 | A1 |
20180262387 | Mathew | Sep 2018 | A1 |
20190251257 | McKeen | Aug 2019 | A1 |
20200021618 | Smith | Jan 2020 | A1 |
20210124823 | Lidzborski | Apr 2021 | A1 |
20210209201 | Ge | Jul 2021 | A1 |
20210232681 | Tsirkin | Jul 2021 | A1 |
20220156390 | Karame | May 2022 | A1 |
Entry |
---|
Alharbi et al., Collaborative Client-Side DNS Cache Poisoning Attack, Jun. 17, 2019, IEEE, pp. 1153-1161. (Year: 2019). |
Fatemah Alharbi et al. Collaborative Client-Side DNS Cache Poisoning Attack. |
Number | Date | Country | |
---|---|---|---|
20210314237 A1 | Oct 2021 | US |