Unless otherwise indicated herein, the approaches described in this section are not admitted to be prior art by inclusion in this section.
Virtualization allows the abstraction and pooling of hardware resources to support virtual machines in a Software-Defined Networking (SDN) environment, such as a Software-Defined Data Center (SDDC). For example, through server virtualization, virtualization computing instances such as virtual machines (VMs) running different operating systems may be supported by the same physical machine (e.g., referred to as a “host”). Each virtual machine is generally provisioned with virtual resources to run an operating system and applications. The virtual resources may include central processing unit (CPU) resources, memory resources, storage resources, network resources, etc. In practice, multicasting refers to the transmission of information from a source to a group of destinations simultaneously. In an SDN environment, however, multicast packets are generally treated as unknown unicast packets or broadcast packets, which is inefficient and undesirable.
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof. In the drawings, similar symbols typically identify similar components, unless context dictates otherwise. The illustrative embodiments described in the detailed description, drawings, and claims are not meant to be limiting. Other embodiments may be utilized, and other changes may be made, without departing from the spirit or scope of the subject matter presented here. It will be readily understood that the aspects of the present disclosure, as generally described herein, and illustrated in the drawings, can be arranged, substituted, combined, and designed in a wide variety of different configurations, all of which are explicitly contemplated herein.
Challenges relating to multicast packet handling will now be explained in more detail using
In the example in
Hypervisor 114A/114B/114C maintains a mapping between underlying hardware 112A/112B/112C and virtual resources allocated to respective VMs 131-136. Hardware 112A/112B/112C includes suitable physical components, such as central processing unit(s) or processor(s) 120A/120B/120C; memory 122A/122B/122C; physical network interface controllers (NICs) 124A/124B/124C; and storage disk(s) 126A/126B/126C, etc. Virtual resources are allocated to each VM to support a guest operating system (OS) and applications (not shown for simplicity). Corresponding to hardware 112A/112B/112C, the virtual resources may include virtual CPU, guest physical memory, virtual disk, virtual network interface controller (VNIC), etc. Hardware resources may be emulated using virtual machine monitors (VMMs) 141-146, which may be considered as part of corresponding VMs 131-136, or alternatively, separated from VMs 131-136. In the example in
Although examples of the present disclosure refer to VMs, it should be understood that a “virtual machine” running on a host is merely one example of a “virtualized computing instance” or “workload.” A virtualized computing instance may represent an addressable data compute node or isolated user space instance. In practice, any suitable technology may be used to provide isolated user space instances, not just hardware virtualization. Other virtualized computing instances may include containers (e.g., running within a VM or on top of a host operating system without the need for a hypervisor or separate operating system or implemented as an operating system level virtualization), virtual private servers, client computers, etc. Such container technology is available from, among others, Docker, Inc. The VMs may also be complete computational environments, containing virtual equivalents of the hardware and software components of a physical computing system. The term “hypervisor” may refer generally to a software layer or component that supports the execution of multiple virtualized computing instances, including system-level software in guest VMs that supports namespace containers such as Docker, etc.
Hypervisor 114A/114B/114C further implements virtual switch 115A/115B/115C and a logical distributed router (DR) instance (not shown for simplicity) to handle egress packets from, and ingress packets to, corresponding VMs 131-136. In SDN environment 100, logical switches and logical distributed routers may be implemented in a distributed manner and can span multiple hosts to connect VMs 131-136. For example, logical switches that provide logical layer-2 connectivity may be implemented collectively by virtual switches 115A-C and represented internally using forwarding tables 116A-C at respective virtual switches 115A-C. Forwarding tables 116A-C may each include entries that collectively implement the respective logical switches. Further, logical distributed routers that provide logical layer-3 connectivity may be implemented collectively by DR instances and represented internally using routing tables (not shown for simplicity) at respective DR instances. Routing tables may each include entries that collectively implement the respective logical distributed routers.
Virtual switch 115A/115B/115C also maintains any suitable information to forward packets to and from corresponding VMs 131-136. Packets are received from, or sent to, each VM via an associated logical port. For example, logical ports 161-166 are associated with respective VMs 131-136. The term “packet” may refer generally to a group of bits that can be transported together, and may be in another form, such as “frame,” “message,” “segment,” etc. The term “traffic” may refer generally to multiple packets. The term “layer-2” may refer generally to a link layer or Media Access Control (MAC) layer; “layer-3” to a network or Internet Protocol (IP) layer; and “layer-4” to a transport layer (e.g., using Transmission Control Protocol (TCP), User Datagram Protocol (UDP), etc.), in the Open System Interconnection (OSI) model, although the concepts described herein may be used with other networking models.
As used herein, the term “logical port” may refer generally to a port on a logical switch to which a virtualized computing instance is connected. A “logical switch” may refer generally to an SDN construct that is collectively implemented by virtual switches 115A-C in the example in
Through SDN, benefits similar to server virtualization may be derived for networking services. For example, logical overlay networks may be provided that are decoupled from the underlying physical network infrastructure, and therefore may be provisioned, changed, stored, deleted and restored programmatically without having to reconfigure the underlying physical hardware. SDN controller 170 and SDN manager 180 are example network management entities that facilitate implementation of logical networks in SDN environment 100. One example of an SDN controller is the NSX controller component of VMware NSX® (available from VMware, Inc.) that may be a member of a controller cluster (not shown) and configurable using SDN manager 180. One example of an SDN manager is the NSX manager component that provides an interface for end users to perform any suitable configuration in SDN environment 100.
SDN controller 170 and SDN manager 180 support central control plane (CCP) module 172 and management plane module 182, respectively. To send and receive the control information (e.g., configuration information), each host 110A/110B/110C may implement local control plane (LCP) agent 119A/119B/119C to interact with SDN controller 170. For example, control-plane channel 101/102/103 may be established between SDN controller 170 and host 110A/110B/110C using TCP over Secure Sockets Layer (SSL), etc. Management entity 170/180 may be implemented using physical machine(s), virtual machine(s), a combination thereof, etc.
A logical overlay network (also known as “logical network”) may be formed using any suitable tunneling protocol, such as Virtual eXtensible Local Area Network (VXLAN), Stateless Transport Tunneling (STT), Generic Network Virtualization Encapsulation (GENEVE), etc. For example, VXLAN is a layer-2 overlay scheme on a layer-3 network that uses tunnel encapsulation to extend layer-2 segments across multiple hosts. In the example in
Each host 110A/110B/110C also maintains data-plane connectivity with other host(s) via physical network 105 to facilitate communication among VMs located on the same logical overlay network. Hypervisor 114A/114B/114C may implement a virtual tunnel endpoint (VTEP) to encapsulate and decapsulate packets with an outer header (also known as a tunnel header) identifying the relevant logical overlay network (e.g., VNI=100). For example in
Conventionally, in SDN environment 100, multicast packets are treated as unknown unicast packets or broadcast packets. This means multicast packets that are addressed to a particular multicast group address will be sent it to all known VTEPs, regardless of whether they interested in the multicast packets. For example in
The above conventional approach is undesirable because, in the example in
One example approach to improve multicast packet handling has been described in a related U.S. patent application Ser. No. 15/460,198 entitled “Multicast packet handling in a logical network,” which is incorporated herein by reference. This approach may involve a source host leveraging the multicast capability of multicast-enabled network device(s) in physical network 105. In response to detecting an egress multicast packet having an inner header addressed to a multicast group address, the source host may generate an encapsulated multicast packet with an outer header that is addressed to the same multicast group address. The encapsulated multicast packet may then be sent to interested receivers in SDN environment 100.
In practice, some multicast-enabled network device(s) in physical network 105 may have limited snooping capability, in that they may only learn a limited number of multicast group addresses. For example, physical switches may support snooping of, say, 256 multicast group addresses due to application-specific intergrated circuit (ASIC) limitations, etc. Once a table that stores these multicast group addresses is full, the multicast-enabled network device(s) may cause flooding of multicast packets in SDN environment 100, which wastes network resources and is therefore undesirable. As such, some users may prefer a multicast packet handling approach that considers the limitation of the underlay hardware's capability.
Multicast Packet Handling
According to examples of the present disclosure, multicast packet handling in SDN environment 100 may be improved by leveraging the multicast capability of multicast-enabled network device(s) in physical network 105, as well as considering limitations in their snooping capability. For example in
As used herein, the term a “multicast-enabled network device” may refer generally to a layer-2 switch, layer-3 router, etc., implementing any suitable multicast-enabling protocol. For example, multicast-enabled switches may support Internet Group Management Protocol (IGMP) for Internet Protocol version 4 (IPv4) systems, Multicast Listener Discovery (MLD) for IP version 6 (IPv6) systems, etc. Multicast-enabled routers may support Protocol Independent Multicast (PIM), Distance Vector Multicast Routing Protocol (DVMRP), Multicast Open Shortest Path First (MOSPF), etc. Such multicast-enabled network devices are capable of pruning multicast traffic from links or routes that do not have a multicast destination.
In practice, any suitable protocol may be used to report multicast group membership to multicast-enabled network device(s). For example, using IGMP version 1 (IGMPv1) or IGMP version 2 (IGMPv2), the join request may represent an IGMP host membership report. IGMP version 3 (IGMPv3) uses a different packet format, in which case an IGMP report packet may be used as a join request. For simplicity, the term “multicast group address” is used to represent a multicast group address used in IGMPv1 and IGMPv2, or a multicast routers group address used in IGMPv3. MLD (e.g., version 1 or version 2) may be used for IPv6 systems.
In more detail,
At 210 and 220 in
In the example in
At 240 and 250 in
According to examples of the present disclosure, multicast packet handling may be performed in a more scalable manner in SDN environment 100 by assigning one outer multicast group address to multiple (N) inner multicast group addresses. This way, multicast-enabled network device(s) in physical network 105 may learn M number of outer multicast group addresses to support overlay multicast traffic of M×N inner multicast group addresses, thereby improving scability and reducing the likelihood of multicast packet flooding. In practice, the “outer multicast group address” may be referred to as an “underlay multicast group address” to represent multicasting within underlay physical network 105. The “inner multicast group address” may be referred to as an “overlay multicast group address” to represent multicasting within logical overlay networks. In the following, various examples will be described using
Detailed Process
The example in
(a) Joining Inner Multicast Group Address
At 305 in
In a first example in
In a second example in
In a third example in
In a fourth example in
In a fifth example in
(b) Obtaining Outer Multicast Group Address
Referring to
Depending on the desired implementation, the size (M) of the address pool may be configured based on a number of factors. For example, address pool may have a range of addresses that does not conflict with other non-overlay multicast applications in SDN environment 100. Another factor may be the IGMP snooping capability of the underlay network, such as the number of multicast group addresses that may be learned by multicast-enabled network device(s) in physical network 105. In this case, the size of the address pool may be limited by the underlay hardware's capability.
In practice, any suitable assignment policy may be used. For example, using a round robin policy, SDN controller 170 assigns IP-OUT1 to IP-IN1 specified in first report 412 from host-A 110A and fourth report 442 from host-D 110D. IP-OUT2 is assigned to IP-IN2 specified in third report 432 from host-B 110B. Next, IP-OUT1 is also assigned to IP-IN3 specified in second report 422 from host-A 110A. Further, IP-OUT 2 is assigned to to IP-IN4 specified in fifth report 452 from host-D 110D. As such, IP-OUT1 is assigned to inner multicast group addresses IP-IN1 and IP-IN3, and IP-OUT 2 to both IP-IN2 and IP-IN4. In practice, IP addresses IP-OUT1 and IP-OUT2 may be associated with respective MAC addresses MAC-OUT1 and MAC-OUT2.
Although an example is shown in
In practice, one outer multicast group address may be mapped to or associated with N inner multicast group addresses. When N is large, less replication is required but more receivers might receive unwanted multicast traffic (i.e., traffic to inner multicast group address that has not been joined). When N is very small, more replication is required but most receivers will only receive wanted multicast traffic. Examples of the present disclosure may be used with any suitable optimization strategy for multicast routing, such as approaches discussed in a related U.S. patent application Ser. No. 15/868,871 that is filed on Jan. 11, 2018 and entitled “Methods to Optimize Multicast Routing in Overlay Networks,” which is incorporated herein by reference. This way, multicast routing may be improved by reducing bandwidth usage in physical network 105 and unnecessary processing at hosts 110A-D.
At 330 in
In the example in
Similarly, host-D 110D stores (LP7, IP-7, IP-IN1, IP-OUT1) and (LP8, IP-8, IP-IN4, IP-OUT2), where “LP7” identifies LP7167 via which request 440 to join IP-IN1 is received from VM7137 and “LP8” identifies LP8168 via which request 450 to join IP-IN4 is received from VM8138. See corresponding 474-475. SDN controller 170 and hosts 110A-D also keep track of the association between an inner multicast group address and an outer multicast group address, including (IP-OUT1, IP-IN1), (IP-OUT1, IP-IN3), (IP-OUT2, IP-IN2), (IP-OUT4, IP-IN4). See corresponding 476-477. Although not shown in
(c) Joining Outer Multicast Group Address
Referring also to
It should be understood that, once host 110A/110B/110D has joined a particular outer multicast group address, any subsequent VM's request to join an inner multicast group address that is associated with the same outer multicast group address may be suppressed. For example, referring to host-B 110B again, a subsequent join request identifying (source address=IP-4, inner multicast group address=IP-IN4) may be received from VM4134 via LP4164. In this case, since IP-IN4 is associated with IP-OUT2 and host-B 110B has already joined IP-OUT2 on behalf of VM2132, the join request from VM4134 is suppressed. In this case, according to 310 and 340 in
Since a hypervisor may support tens or hundreds of VM, the join request suppression reduces the number of multicast report packets sent to physical network 105. This in turn reduces the processing burden on multicast-enabled network device(s) on physical network 105 to perform snooping and learn the associated multicast mapping information. In practice, a multicast querier (i.e., device that sends queries) may also be elected to periodically broadcast a membership query packet at predetermined time intervals to trigger the join packets.
(d) Multicast-Enabled Network Device(s)
At 345 and 350 in
In the example in
Referring first to S1401, in response to receiving first join request 510 via port P1 connected with host-A 110A, S1401 performs IGMP snooping to learn multicast mapping information (port ID=P1, source address=IP-A, multicast group address=IP-OUT1); see 561 in
In response to receiving third join request 530 via port P6 connected with host-D 110D, S2402 learns multicast mapping information (P6, IP-D, IP-OUT1); see 573 in
Multicast Packet Handling
Example multicast packet handling will be explained using blocks 360-395 in
(a) Multicast Packets from VM5135 to IP-IN1
In a first example in
Instead of sending the egress muticast packet to all known destination VTEPs according to the conventional approach, host-C 110C leverages the multicast-enabled network device(s) in physical network 105. At 370 in
At switch S2402, encapsulated multicast packet 620 is received via port P5 connected with host-C 110C. Based on multicast mapping information (P4, IP-A, IP-OUT1) and (P6, IP-D, IP-OUT1) shown at 571, 573 in
At switch S1401, encapsulated multicast packet 620 is received via port P3. Based on multicast mapping information (P1, IP-A, IP-OUT1) and (P3, IP-D, IP-OUT1) at respective 561, 563 in
At host-A 110A, in response to receiving encapsulated multicast packet 620, host-A 110A examines encapsulated multicast packet 620 and performs decapsulation to generate decapsulated multicast packet 630 by removing outer header 622. Based on multicast mapping information (LP1, IP-1, IP-IN1, IP-OUT1) at 471 in
At host-D 110D, in response to receiving encapsulated multicast packet 620, host-D 110D examines encapsulated multicast packet 620 and performs decapsulation to generate decapsulated multicast packet 630 by removing outer header 622. Based on multicast mapping information (LP7, IP-7, IP-IN1, IP-OUT1) at 474 in
In the the example in
(b) Multicast Packets from VM6136 to IP-IN2
In a second example in
Again, instead of sending the egress muticast packet to all known destination VTEPs according to the conventional approach, host-C 110C leverages the multicast-enabled network device(s) in physical network 105 to reach destination(s) associated with the outer multicast group address. At 370 in
At switch S2402, encapsulated multicast packet 720 is received via port P5 connected with host-C 110C. Based on multicast mapping information (P4, IP-B, IP-OUT2) and (P6, IP-D, IP-OUT2) shown at 572, 574 in
At switch S1401, encapsulated multicast packet 720 is received via port P3. Based on multicast mapping information (P2, IP-B, IP-OUT2) and (P3, IP-D, IP-OUT2) at respective 562, 564 in
At host-B 110B, in response to receiving encapsulated multicast packet 720 from switch S1401, host-B 110B examines encapsulated multicast packet 720 and performs decapsulation to generate decapsulated multicast packet 730 by removing outer header 722. Based on multicast mapping information (LP3, IP-3, IP-IN2, IP-OUT2) at 473 in
At host-D 110D, in response to receiving encapsulated multicast packet 720 from switch S2402, host-D 110D examines encapsulated multicast packet 720. Based on multicast mapping information 476-477 in
In the the example in
Compared to the conventional approaches that send multicast traffic in a unicast manner, examples of the present disclosure provide a more efficient and scalable solution that reduces the likelihood of unnecessary multicast traffic flooding and network resource wastage. Further, examples of the present disclosure may be implemented without any modification at the multicast-enabled network device(s) in underlying physical network 105. Instead, their existing multicast capability is leverage to improve network performance when forwarding multicast traffic.
Leaving a Multicast Group Address
In a second example, consider the scenario where VM1131 leaves IP-IN1 (see 830). In response to detecting leave request 830 via LP1161, host-A 110A removes multicast mapping information (LP1, IP-1, IP-IN1, IP-OUT1); see 831 in
Container Implementation
Although explained using VMs 131-138, it should be understood that SDN environment 100 may include other virtual workloads, such as containers, etc. As used herein, the term “container” (also known as “container instance”) is used generally to describe an application that is encapsulated with all its dependencies (e.g., binaries, libraries, etc.). In the examples in
Computer System
The above examples can be implemented by hardware (including hardware logic circuitry), software or firmware or a combination thereof. The above examples may be implemented by any suitable computing device, computer system, etc. The computer system may include processor(s), memory unit(s) and physical NIC(s) that may communicate with each other via a communication bus, etc. The computer system may include a non-transitory computer-readable medium having stored thereon instructions or program code that, when executed by the processor, cause the processor to perform processes described herein with reference to
The techniques introduced above can be implemented in special-purpose hardwired circuitry, in software and/or firmware in conjunction with programmable circuitry, or in a combination thereof. Special-purpose hardwired circuitry may be in the form of, for example, one or more application-specific integrated circuits (ASICs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), and others. The term ‘processor’ is to be interpreted broadly to include a processing unit, ASIC, logic unit, or programmable gate array etc.
The foregoing detailed description has set forth various embodiments of the devices and/or processes via the use of block diagrams, flowcharts, and/or examples. Insofar as such block diagrams, flowcharts, and/or examples contain one or more functions and/or operations, it will be understood by those within the art that each function and/or operation within such block diagrams, flowcharts, or examples can be implemented, individually and/or collectively, by a wide range of hardware, software, firmware, or any combination thereof.
Those skilled in the art will recognize that some aspects of the embodiments disclosed herein, in whole or in part, can be equivalently implemented in integrated circuits, as one or more computer programs running on one or more computers (e.g., as one or more programs running on one or more computing systems), as one or more programs running on one or more processors (e.g., as one or more programs running on one or more microprocessors), as firmware, or as virtually any combination thereof, and that designing the circuitry and/or writing the code for the software and or firmware would be well within the skill of one of skill in the art in light of this disclosure.
Software and/or to implement the techniques introduced here may be stored on a non-transitory computer-readable storage medium and may be executed by one or more general-purpose or special-purpose programmable microprocessors. A “computer-readable storage medium”, as the term is used herein, includes any mechanism that provides (i.e., stores and/or transmits) information in a form accessible by a machine (e.g., a computer, network device, personal digital assistant (PDA), mobile device, manufacturing tool, any device with a set of one or more processors, etc.). A computer-readable storage medium may include recordable/non recordable media (e.g., read-only memory (ROM), random access memory (RAM), magnetic disk or optical storage media, flash memory devices, etc.).
The drawings are only illustrations of an example, wherein the units or procedure shown in the drawings are not necessarily essential for implementing the present disclosure. Those skilled in the art will understand that the units in the device in the examples can be arranged in the device in the examples as described, or can be alternatively located in one or more devices different from that in the examples. The units in the examples described can be combined into one module or further divided into a plurality of sub-units.
Number | Name | Date | Kind |
---|---|---|---|
7478173 | Delco | Jan 2009 | B1 |
8619771 | Lambeth et al. | Dec 2013 | B2 |
9014007 | Bhikkaji et al. | Apr 2015 | B2 |
9306837 | Jain | Apr 2016 | B1 |
9350657 | Gross, IV et al. | May 2016 | B2 |
9432204 | Shen et al. | Aug 2016 | B2 |
10567187 | Mathew et al. | Feb 2020 | B2 |
10649805 | Mishra et al. | May 2020 | B1 |
20030217183 | Rimmer et al. | Nov 2003 | A1 |
20030231629 | Banerjee et al. | Dec 2003 | A1 |
20060184695 | Monette et al. | Aug 2006 | A1 |
20070104192 | Yoon et al. | May 2007 | A1 |
20070183418 | Riddoch et al. | Aug 2007 | A1 |
20070217416 | Okuda | Sep 2007 | A1 |
20110085548 | Fernández Gutiérrez | Apr 2011 | A1 |
20120281697 | Huang | Nov 2012 | A1 |
20140192804 | Ghanwani et al. | Jul 2014 | A1 |
20140314079 | Jain | Oct 2014 | A1 |
20150009992 | Zhang | Jan 2015 | A1 |
20150103679 | Tessmer | Apr 2015 | A1 |
20150124586 | Pani | May 2015 | A1 |
20150127701 | Chu | May 2015 | A1 |
20150236871 | Kang | Aug 2015 | A1 |
20160094353 | Sreeramoju et al. | Mar 2016 | A1 |
20160232019 | Shah et al. | Aug 2016 | A1 |
20160285641 | He et al. | Sep 2016 | A1 |
20170237650 | Beeram et al. | Aug 2017 | A1 |
20170250954 | Jain et al. | Aug 2017 | A1 |
20170302464 | Hu et al. | Oct 2017 | A1 |
20180006930 | Du | Jan 2018 | A1 |
20180167320 | Huang et al. | Jun 2018 | A1 |
20180234259 | Du | Aug 2018 | A1 |
20180270146 | Jiang et al. | Sep 2018 | A1 |
20190068555 | Tsirkin et al. | Feb 2019 | A1 |
20190081899 | Mundkur et al. | Mar 2019 | A1 |
20190273625 | Tessmer | Sep 2019 | A1 |
20200036646 | Mathew et al. | Jan 2020 | A1 |
Number | Date | Country | |
---|---|---|---|
20200036552 A1 | Jan 2020 | US |