The present disclosure relates to the provisioning of networking devices, and in particular to systems and methods for Zero-Touch Provisioning (ZTP) of a switch.
Various objects and advantages of the disclosure will be apparent upon consideration of the following detailed description, taken in conjunction with the accompanying drawings, in which like reference characters refer to like parts throughout, and in which:
Newly installed switches often require initial provisioning in order to be onboarded into a network environment. Traditionally, switches are provisioned by an on-site technician who installs the configurations and software of each device individually. For example, a switch, such as an access switch, is first taken to a wiring closet by an on-site technician. An access switch may be any switch that connects hosts to a network. The technician then powers up the access switch and, using a console cable and/or USB, configures the switch. The technician then checks to make sure the right image is loaded onto the switch. This process can be error prone and usually requires substantial amounts of time and money. The complicated process can be exacerbated when a network has a large number of switches that require provisioning. To help expedite this process, many networks utilize Zero-Touch Provisioning (ZTP). ZTP is a mechanism that allows network devices (switches, routers, etc.) to be provisioned and configured automatically, eliminating most of the manual labor involved when adding network devices to a network. In most cases, a device using ZTP needs to be able to reach a dynamic host configuration protocol (DHCP) server to both receive an IP address for itself and an IP address for the ZTP server. Once the device receives the IP address for the ZTP server and connects to the ZTP server, the ZTP server will be able to provision the connected device.
Data center environments rely on dedicated management networks to facilitate ZTP. A dedicated management network is separate from the production network and often uses an entirely separate infrastructure (switches, cabling, etc.) to network the management ports on the devices that are managed by the dedicated management network. A dedicated management network allows for operations, such as ZTP, to occur without depending on the normal production network. For example, a switch is able to easily access the correct DHCP server using the dedicated management network.
There are many deficiencies that exist in current ZTP implementations because many network types lack viable options for a switch to reach a DHCP server. For example, because many non-data centers lack a dedicated management network (due, in part, to the limited number of uplink fibers available in non-data centers), switches cannot easily access the DHCP server. If a switch cannot reach the DHCP server, then the switch will not be able to reach the correct ZTP server, making ZTP impossible. For example, main distribution frames (MDFs) and intermediate distribution frames (IDFs) lack dedicated management networks, making ZTP deployment particularly challenging.
Various systems and methods described herein address these problems by providing a method of ZTP where a first switch receives a VLAN identifier (VLAN ID) from a second switch, allowing the first switch to reach the DHCP server. The first and second switches may be access switches, aggregation switches, or any similar such switches and may be in any combination. An aggregation switch may be any switch that connects other switches (e.g., access switches) to a core switch, where the core switch facilitates communication to the DHCP server. In many embodiments of the systems and methods described herein the first switch is an access switch that receives a VLAN ID from an aggregation switch (the second device); however, any combination of switch types may be used. For example, an access switch may receive a VLAN ID from another access switch, and an aggregation switch may receive a VLAN ID from an access switch or another aggregation switch.
A first switch may receive a first message from a second switch. In some embodiments, the second switch is configured to advertise unsolicited messages to the network at regular time intervals and the first message is one of these messages. In some embodiments, the second switch may be responding to a request for bootup information received from the first switch. The first message received from the second switch may be any message type that is encapsulated in ethernet frames for the purpose of giving devices a means of announcing basic information to other devices on a LAN, with one example being a link layer discovery protocol (LLDP) message. The first message also includes a VLAN ID, which identifies the specific VLAN, allowing the first switch to reach the DHCP server by sending a DHCP request on said VLAN. In some embodiments, the first message also includes additional ZTP-related information. For example, the first message may contain multiple VLAN IDs (where multiple VLAN headers are required), authentication information, and similar such ZTP-related information. The first switch sends out a DHCP discover message where the discover message is tagged with the VLAN ID. The discover message is able to reach the DHCP server because the discover message is tagged with the VLAN ID. The VLAN ID tag ensures that the discover message is routed onto a VLAN corresponding to the VLAN ID. For example, a network device that receives traffic tagged with a VLAN ID will forward the traffic using the VLAN that has that identifier corresponding to the VLAN ID or route the traffic to another VLAN that has reachability to the DHCP server. In some embodiments, the VLAN corresponding to the VLAN ID will have reachability to the DHCP server because the VLAN is the VLAN where the DHCP server resides. In some embodiments, the VLAN corresponding to the VLAN ID will have reachability to the DHCP server because the VLAN will route the DHCP discover message to the DHCP server. The DHCP server is reachable through the VLAN that has the identifier corresponding to the VLAN ID received from the second switch. After the first switch contacts the DHCP server, the DHCP server will assign the first switch an IP address. The DHCP server will also send reachability information (e.g., IP address and/or the uniform resource locator (URL)) corresponding to the ZTP server to the first switch. In an embodiment, the correct ZTP server may be managed by workload orchestration software. In an embodiment, the workload orchestration software may be CloudVision® Portal (CVP), which is offered by Arista Networks™. The first switch uses the reachability information to connect to the correct ZTP server. After the first switch connects to the ZTP server, the ZTP server provisions the first switch. This approach allows for seamless introduction of a first switch into a network and allows for more centralized control of switches in the network.
In the shown embodiment, switch 102 is a newly installed switch that requires provisioning. In some embodiments, switch 102 may be an existing switch that requires updated provisioning. Switch 102 may be an access switch, aggregation switch, or any similar such switch. Switch 102 may receive an LLDP message from switch 104. In some embodiments, the message may be any message type that is encapsulated in ethernet frames for the purpose of giving devices a means of announcing basic information to other devices on a LAN. Switch 104 may send the LLDP message in response to a request for bootup information received from switch 102. For example, upon bootup, switch 102 may determine that switch 102 does not have a startup configuration file and requests bootup information from switch 104 using link 114. In some embodiments, bootup information can include start-up configuration files, boot records, a VLAN ID for a VLAN that can be used to reach a DHCP server and/or similar such information for configuring a switch. In some embodiments, switch 104 is configured to advertise unsolicited LLDP messages to the network at regular time intervals. The LLDP message may also include a VLAN ID that identifies the specific VLAN where a switch can reach the DHCP server 110. In some embodiments, the LLDP message also includes additional ZTP-related information (e.g., multiple VLAN IDs, authentication information, and/or similar such ZTP-related information).
After receiving the LLDP message, switch 102 may transmit a DHCP discover message along link 114, where the discover message is tagged with the VLAN ID provided by the LLDP message. The discover message reaches DHCP server 110 because the discover message is tagged with the VLAN ID provided by the LLDP message. The VLAN ID tag ensures that the discover message is routed onto a VLAN corresponding to the VLAN ID. For example, when switch 104 receives traffic tagged with a first VLAN ID, switch 104 will forward the traffic to the VLAN that has that corresponding identifier. In some embodiments, the DHCP discover message is forwarded to the DHCP server using the VLAN that has the identifier corresponding to the VLAN ID provided by the LLDP message. Although link 114 is shown as a single link connecting switch 102 to the network, switch 102 may have other links to other switches that are not shown to avoid overcomplicating the drawings. For example, switch 102 may be connected to any number of other switches (e.g., aggregate switches, access switches, etc.). In some embodiments, switch 102 may use links other than link 114 to reach both DHCP server 110 and ZTP server 112.
In some embodiments, in response to the DHCP discover message, DHCP server 110 assigns switch 102 an IP address. DHCP server 110 may also send reachability information (e.g., IP address and/or the uniform resource locator (URL)) corresponding to ZTP server 112 to switch 102. Switch 102 is configured to use the reachability information to connect to ZTP server 112. After switch 102 connects to ZTP server 112, ZTP server 112 provisions switch 102. In an embodiment, ZTP server 112 is managed by workload orchestration software (e.g., CVP).
In the shown embodiment, switch 102 is a newly installed switch that requires provisioning. In some embodiments, switch 102 may receive an LLDP message from switch 106. As mentioned above, the LLDP may be any message type that is encapsulated in ethernet frames for the purpose of giving devices a means of announcing basic information to other devices on a LAN. Switch 106 may send the LLDP message in response to a request for bootup information received from switch 102. For example, upon bootup, switch 102 may determine that switch 102 does not have a startup configuration file and requests bootup information from switch 106 using link 116. In some embodiments, switch 106 is configured to advertise unsolicited LLDP messages to the network at regular time intervals. The LLDP message may also include a VLAN ID that identifies a VLAN where a switch can reach the DHCP server 110.
After receiving the LLDP message, switch 102 sends out a DHCP discover message along link 116, where the discover message is tagged with the VLAN ID provided by the LLDP message. The discover message reaches DHCP server 110 because the discover message is routed onto a VLAN corresponding to the VLAN ID tag. The VLAN corresponding to the VLAN ID will have reachability to the DHCP server. For example, when switch 106 receives traffic tagged with a first VLAN ID, switch 106 will forward the traffic to the VLAN that has that corresponding identifier. In some embodiments, the VLAN corresponding to the VLAN ID will have reachability to the DHCP server because the VLAN is the VLAN where the DHCP server resides. In some embodiments, the VLAN corresponding to the VLAN ID will have reachability to the DHCP server because the VLAN will route the DHCP discover message to the DHCP server. As described above, link 116 is shown as a single link connecting switch 102 to the network, but switch 102 may have other links to other switches that are not shown to avoid overcomplicating the drawings. In some embodiments, switch 102 may use links other than link 116 to reach both DHCP server 110 and ZTP server 112.
In some embodiments, in response to the DHCP discover message, DHCP server 110 assigns switch 102 an IP address. DHCP server 110 may also send reachability information (e.g., IP address and/or the URL) corresponding to ZTP server 112 to switch 102. Switch 102 is configured to use the reachability information to connect to ZTP server 112. After switch 102 connects to ZTP server 112, ZTP server 112 provisions switch 102. In an embodiment, ZTP server 112 is managed by workload orchestration software (e.g., CVP).
The ethernet frame 200 also comprises a Boot VLAN advertisement header that includes an organizationally unique identifier (OUI) field 206 and a subtype field 208. Subtype field 208 is shown as being defined by subtype 1, but further subtypes can be defined for other purposes such as authentication. For example, a subtype may be defined to send a root of trust. In some embodiments, an aggregate switch (e.g., switch 104) may send a root of trust for an instance of a workload orchestration software (e.g., CVP) using subtype field 208 to a newly connected switch (e.g., switch 102). In another example, a subtype may be defined to include information to uniquely identify a new device to the network (e.g., organization identification (ORG-ID) tokens). In some embodiments, a subtype may be defined to include both the information to uniquely identify a new device and a root of trust.
The ethernet frame 200 also comprises a Boot VLAN that includes a Reserved (RSVD) field 210 and a Boot VLAN ID field 212. In some embodiments, the Boot VLAN ID field includes a VLAN identifier, where the VLAN identifier identifies the VLAN that a switch can use to reach a DHCP server. In some embodiments, the VLAN identifier may be unique to a switch that requested the VLAN ID. In some embodiments, information to uniquely identify a new device and a root of trust may be included as optional parameters after the Boot VLAN ID field 212. For example, the subtype field 208 may have a value of 1, but an extension field may be added after the Boot VLAN ID field 212. In some embodiments, when the extension field is set to a value of 1, a root of trust may be included within the ethernet frame 200. In other embodiments, when the extension field is set to a value of 2, a root of trust and an ORG-ID token may be included within the ethernet frame 200. In another embodiment, when the extension field is set to a value of 0, this may indicate that neither a root of trust nor an ORG-ID token is included within the ethernet frame 200.
Device 300 may receive data via data network interface 310 and provide the received data to control circuitry 304 via an input/output (I/O) path 302. Control circuitry 304 includes processing circuitry 306 and storage 308. Storage 308 may include volatile memory (such as random-access memory (RAM), for example, static RAM and/or dynamic RAM), which does not retain its contents when power is turned off, and non-volatile memory (such as, for example, a solid state drive (SSD), a hard disk drive (HDD), electrically erasable programmable read-only memory (EEPROM), etc.), which does retain its contents when power is turned off. Control circuitry 304 may send and receive commands, requests, and other suitable data using I/O path 302. As noted above, I/O path 302 connects control circuitry 304 (and specifically processing circuitry 306) to network interface 310, which in turn connects device 300 to one or more other devices. For example, I/O path 302 may provide route packets to next hops listed in a forwarding table.
Control circuitry 304 may be based on any suitable processing circuitry, such as processing circuitry 306. As referred to herein, processing circuitry should be understood to mean circuitry based on one or more microprocessors, microcontrollers, digital signal processors, programmable logic devices, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), etc., and may include a multi-core processor (e.g., dual-core, quad-core, hexa-core, octa-core, or any suitable number of cores). In some embodiments, processing circuitry is distributed across multiple separate processors or processing units, for example, multiple of the same type of processing units (e.g., two INTEL CORE i7 processors) or multiple different processors (e.g., an INTEL CORE i5 processor and an INTEL CORE i7 processor). In some embodiments, control circuitry 304 executes instructions suitable to implement any of the techniques described above or below.
Storage 308 may be an electronic storage device that is part of control circuitry 304. As referred to herein, the phrase “electronic storage device” or “storage device” should be understood to mean any device for storing electronic data, computer software, instructions, and/or firmware, such as RAM, content-addressable memory (CAM), hard disk drives (HDDs), optical drives, solid state devices (SSDs), quantum storage devices, or any other suitable fixed or removable storage devices, and/or any combination of the same. The circuitry described herein may execute instructions included in software running on one or more general purpose or specialized processors. In some embodiments, storage 308 may include a MAC table. Multiple circuits may be provided to handle simultaneous processing functions. In some embodiments, device 300 may be a virtual device, wherein components 304, 306, 308, 302 and 310 are virialized on top of another physical device.
At step 402, control circuitry receives a VLAN identifier from a switch. The VLAN identifier may be included in a first message received from the switch. In some embodiments, the switch is configured to advertise unsolicited messages to the network at regular time intervals and the first message is one of these messages. In some embodiments, the switch may be responding to a request for bootup information received from the control circuitry. The first message may be any message type that is encapsulated in ethernet frames for the purpose of giving devices a means of announcing information to other devices on a LAN, with one example being an LLDP message (e.g., the ethernet frame of
At step 404, control circuitry transmits a DHCP message to a DHCP server using the VLAN identifier. The DHCP message may be a DHCP discover message that is tagged with the VLAN identifier. The discover message is able to reach the DHCP server because the discover message is tagged with the VLAN ID. The VLAN ID tag ensures that the discover message is routed onto a VLAN corresponding to the VLAN ID. For example, a network device that receives the discover message that comprises the VLAN identifier tag will forward the discover message according to the VLAN identifier tag. In some embodiments, a network device that receives the discover message will transmit the discover message to all ports on the network device associated with the VLAN identifier. In some embodiments, the DHCP server is reachable through the VLAN that is associated with the VLAN identifier received from the switch at step 402.
At step 406, control circuitry receives reachability information for a ZTP server from the DHCP server. In some embodiments, the DHCP server receives the discover message from the control circuitry and assigns the control circuitry an IP address. The DHCP server may also send reachability information (e.g., IP address and/or the URL) corresponding to a ZTP server to the control circuitry.
At step 408, control circuitry establishes a provisioning session between the control circuitry and the ZTP server using the reachability information provided by the DHCP server. The control circuitry is configured to use the reachability information to connect to the ZTP server. After the control circuitry connects to the ZTP server, the ZTP server provisions the control circuitry. In some embodiments, the ZTP server is managed by workload orchestration software (e.g., CVP).
At step 504, control circuitry requests bootup information. In some embodiments, control circuitry transmits a bootup request to the network. The bootup request may be a message or a part of any message type that is encapsulated in ethernet frames for the purpose of giving devices a means of announcing information to other devices on a LAN, with one example being an LLDP message. The control circuitry may transmit the bootup request using one or more data plane ports. In some embodiments, the control circuitry advertises the bootup request using all ports available to the control circuitry. In some embodiments, the control circuitry transmits the bootup request using a port with a link that indicates connectivity to the LAN.
At step 506, control circuitry receives a VLAN identifier from a switch. The VLAN identifier may be included in a message received from the switch. The switch may be responding to the bootup request transmitted by the control circuitry in step 504. The message may be any message type that is encapsulated in ethernet frames for the purpose of giving devices a means of announcing information to other devices on a LAN, with one example being an LLDP message (e.g., the ethernet frame of
At step 508, control circuitry transmits a DHCP message to a DHCP server using the VLAN identifier. The DHCP message may be a DHCP discover message that is tagged with the VLAN identifier. In some embodiments, the DHCP server is reachable through the VLAN that is associated with the VLAN identifier received from the switch at step 506.
At step 510, control circuitry receives reachability information for a ZTP server from the DHCP server. In some embodiments, the DHCP server receives the discover message from the control circuitry and assigns the control circuitry an IP address. The DHCP server may also send reachability information (e.g., IP address and/or the URL) corresponding to a ZTP server to the control circuitry.
At step 512, control circuitry establishes a provisioning session between the control circuitry and the ZTP server using the reachability information. The control circuitry is configured to use the reachability information to connect to the ZTP server. After the control circuitry connects to the ZTP server, the ZTP server provisions the control circuitry. In some embodiments, the ZTP server is managed by workload orchestration software (e.g., CVP).
At step 602, control circuitry generates a message that includes a VLAN identifier corresponding to a VLAN where a DHCP server can be reached. In some embodiments, the control circuitry is configured to advertise unsolicited messages to the network at regular time intervals and the message is one of these messages. In some embodiments, the switch may be responding to a request for bootup information received from a switch. The generated message may be any message type that is encapsulated in ethernet frames for the purpose of giving devices a means of announcing information to other devices on a LAN, with one example being an LLDP message (e.g., the LLDP message of
At step 604, control circuitry transmits the message comprising the VLAN identifier to a switch. In some embodiments, the control circuitry is configured to advertise unsolicited messages to the network at regular time intervals and the message arrives at one or more switches unsolicited. In some embodiments, the control circuitry may transmit the message to one or more switches in response to the one or more switches requesting bootup information.
At step 704, control circuitry determines that the received message is requesting bootup information for the switch that sent the message. In some embodiments, the control circuitry can authenticate the switch that sent the message before proceeding to step 706. For example, the control circuitry may perform a MAC-based authentication (MBA). In some embodiments, prior to performing an MBA, the control circuitry may be configured for an LLDP bypass, allowing an operating system on the switch to review the received message. The switch can use the source MAC-address of the received message to perform an MBA.
At step 706, control circuitry generates a message that includes a VLAN identifier corresponding to a VLAN where a DHCP server can be reached. The generated message may be any message type that is encapsulated in ethernet frames for the purpose of giving devices a means of announcing information to other devices on a LAN, with one example being an LLDP message (e.g., the LLDP message of
As discussed above, additional ZTP-related information may also include authentication information.
At step 708, control circuitry transmits the generated message comprising the VLAN identifier to a switch. The control circuitry transmits the message to the switch that sent the LLDP message requesting bootup information.
The processes 400, 500, 600, and 700 described above are intended to be illustrative and not limiting. More generally, the above disclosure is meant to be illustrative and not limiting. Only the claims that follow are meant to set bounds as to what the present invention includes. Furthermore, it should be noted that the features and limitations described in any one embodiment may be applied to any other embodiment herein, and flowcharts or examples relating to one embodiment may be combined with any other embodiment in a suitable manner, done in different orders, or done in parallel. In addition, the systems and methods described herein may be performed in real time. It should also be noted, the systems and/or methods described above may be applied to, or used in accordance with, other systems and/or methods.
It will be apparent to those of ordinary skill in the art that methods involved in the present disclosure may be embodied in a computer program product that includes a non-transitory computer-usable and/or -readable medium. For example, such a non-transitory computer-usable medium may consist of a read-only memory device, such as a CD-ROM disk or conventional ROM device, or a random-access memory, such as a hard drive device or a computer diskette, having a computer-readable program code stored thereon. It should also be understood that methods, techniques, and processes involved in the present disclosure may be executed using processing circuitry.
Number | Name | Date | Kind |
---|---|---|---|
10785094 | Thubert | Sep 2020 | B1 |
10797968 | Suthar | Oct 2020 | B2 |
10938855 | Waldie | Mar 2021 | B1 |
11277283 | Hegde | Mar 2022 | B2 |
20070211730 | Cuthbert | Sep 2007 | A1 |
20070297396 | Eldar | Dec 2007 | A1 |
20090165099 | Eldar | Jun 2009 | A1 |
20100287266 | Asati | Nov 2010 | A1 |
20140013324 | Zhang | Jan 2014 | A1 |
20150355934 | Yin | Dec 2015 | A1 |
20180034698 | Perez | Feb 2018 | A1 |
20190132322 | Song | May 2019 | A1 |
20190334865 | Nagarajan | Oct 2019 | A1 |
20200042365 | Tanna | Feb 2020 | A1 |
20200162348 | Suthar | May 2020 | A1 |
20200169516 | Patel | May 2020 | A1 |
20200322838 | Thubert | Oct 2020 | A1 |
20210067380 | Hegde | Mar 2021 | A1 |
20210184930 | Mutnuru | Jun 2021 | A1 |
20210184936 | Mutnuru | Jun 2021 | A1 |
20210255876 | Puhan | Aug 2021 | A1 |
20210297409 | Rahn | Sep 2021 | A1 |
20210351948 | Lewis | Nov 2021 | A1 |
Entry |
---|
International Search Report in International Patent Application No. PCT/US2021/050561 dated Oct. 14, 2021; 6 pages. |
Number | Date | Country | |
---|---|---|---|
20220086040 A1 | Mar 2022 | US |