Modern datacenters employ optical transceivers and fibers for high bandwidth connections over relatively long distances. Optical transmitters take electrical signals and encode them into optical signals that are carried over optical fibers to optical receivers that reproduce the electrical signals and the information they carry. An optical fiber generally has multiple lanes, each of which carries optical signals. Optical fiber connections are also used to connect different chassis or systems together in a network.
Certain examples are described in the following detailed description and in reference to the drawings, in which:
The present disclosure relates to techniques for routing signals through an optical cable. More specifically, the present disclosure describes an electro-optical transceiver that provides routing capabilities and is referred to herein as a dynamic electro-optical shuffle (DEOS) transceiver. The DEOS transceiver can include an electrical switch coupled to an optical transceiver. The signal path through the optical transceiver can be controlled by controlling the electrical switch. In some examples, two DEOS transceivers can be coupled through an optical cable to create a DEOS link between a transmitting device to the receiving device. The control of the switches at each end of the DEOS link can be coordinated to control the routing path of the data from the transmitting device to the receiving device. Various capabilities can be achieved by coordinating the control of the switches at each end of the DEOS link. For example, the DEOS transceiver can be used in conjunction with over-provisioning an optical cable with extra optical fibers and a built-in failure mechanism that is transparent to the devices coupled by the optical cable. In some examples, the DEOS transceiver can be used to control routing in a network or a data center.
As shown in
Each electrical switch 104 may contain a transmitter switch 104A and a receiver switch 1048. The transmitter switch 104A may contain multiple ports. In some examples, one transmitter switch 104A has two sets of ports 112 and 114 and a receiver switch 1048 also has two sets of ports 116 and 118. In addition, each optical transceiver 106 may actually include multiple optical transmitters 106A and optical receivers 1068. An optical transceiver 106 may also contain circuitry that enables it to detect pre-failure or failed conditions.
In some examples, at a port 112, transmitter switch 104A receives an electrical signal from a sending device. This electrical signal corresponds to data to be sent to a receiving device. Transmitter switch 104A then connects the electrical signal to an optical transmitter 120A via a port 114. The optical transmitter 120A then converts the first electrical signal into an optical signal and transmits the optical signal through an optical cable 110 to a respective optical receiver 122A. The optical receiver of 122A then converts the optical signal back into the second electrical signal and sends the electrical signal to a port 116 of receiver switch 1048. Receiver switch 1048 connects this electrical signal to a corresponding port 118 to complete the path of the electrical signal to the receiving device. A sending device and a receiving device may be a network interface controller (NIC) or a network switch.
As previously mentioned, an optical transceiver 106 may also contain circuitry that enables it to detect pre-failure or failed conditions. In some examples, the DEOS transceiver 102 can be used to provide an optical cable with over-provisioned optical fibers and a built-in failure detection and recovery mechanism that is transparent to the devices coupled by the optical cable. In some examples, the DEOS system may itself be integrated into the optical cable, and is referred to as a DEOS cable 124.
In some examples of the fail-over feature, transmitter switch 104A had initially connected the electrical signal to optical transmitter 120C through corresponding port 114. However, for example, a pre-failure or failed condition was detected on optical transmitter 120C. This pre-failure or failed condition is indicated in
Because the route of initial electrical signals entering port 112 of transmitter switch 104 and the corresponding second electrical signals of output ports 118 remain constant, the functionality of the DEOS system 100 may be transparent to both the sending device and receiving device.
Furthermore, in some examples, this entire system may reside in a single DEOS cable assembly 124 having two DEOS transceivers 102 at either end. In some examples, the system may have two separate DEOS transceivers 102 connected together via an optical cable 110.
In the example, electrical switch 104 is connected to optical transceiver 106, which itself is connected optical cable 110. In some examples, an initial 16 electrical signal lanes may be connected to an electrical switch 104. The electrical switch 104 may be connected to optical transmitter by 24 electrical signal lanes, representing 8 extra lanes or 50% over-provisioned for redundancy.
In some examples, the first electrical switch 104 may route these 16 electrical signal lanes to any 16 of the 24 electrical lanes that connect the first electrical switch 104 to optical transmitter 106. In this example, eight optical transmitters and eight optical fibers have been over-provisioned in optical cable 110 to provide a form of redundancy in case of optical transmitter or optical receiver failures. More or fewer over-provisioned fibers may be included depending on the amount of redundancy sought.
In this example, an electrical gearbox 302 is connected to an electrical switch 104, which is connected to an optical transceiver 106. The addition of an electrical gearbox 302 communicatively connected to the electrical switch 104 may allow the DEOS transceiver 120 to use faster signaling rates on fewer signal paths.
In this example, the input to the gearbox 302 may be comprised of 32 signal lanes which the gearbox 302 may convert to 16 electrical lanes having signal rates that are twice as fast. In this example, it is still possible to use 8 over-provisioned lanes to achieve the same redundancy as in the previous configuration 200. Thus, 24 total electrical lanes exist between the electrical switch 104 and optical transceiver 106 even though an initial 32 electrical lanes are being routed. In this example, the electrical switch would have to operate at a higher speed than the switch in configuration 200.
In this example, the electrical gearbox 302 and the electrical switch 104 are ordered such that the electrical switch 104 is connected to the electrical gearbox 302, which is connected to the optical transceiver 106. The Optical transceiver 106 is also connected to an optical cable 110.
In some examples, 32 electrical lanes are input into electrical switch 104, which is communicatively connected to electrical gearbox 302 via 48 lanes. The electrical gearbox 302 is communicatively connected to optical transmitter 106 via electrical 24 lanes. By arranging the electrical switch and the electrical gearbox as shown in this example, the electrical switch 104 may operate at an incoming data rate while the optical transceiver 106 may operate at twice the incoming data rate. The gearbox in this example needs to convert higher number of lanes in comparison to configuration 300.
As discussed above, fiber optic cables include multiple lanes through which data signals pass. The number of lanes in a high lane-count optical transceiver is typically in the several dozens. When an optical transceiver malfunctions, a failed connection causes service outage. It is a common practice to replace the transceiver without replacing the corresponding optical cable, if the cable is not at fault. Identifying and replacing these failed high lane-count optical transceivers not only takes a long time, but is also expensive. This is especially true when replacing a high lane-count transceiver due to the malfunction of a single lane. Examples described herein provide a fail-over technique that avoids service outages due to some number of transceivers failures or fiber connection failures and makes such replacement unnecessary.
For example, two systems 502A and 502B may be connected via an optical cable 110 that joins two DEOS transceivers 102 operatively connected to each system as in
As shown in
In some examples, controllers 504 and 506 coordinate to control electrical switches 104 and optical transceivers 106. In some examples, controllers 504 and 506 coordinate so that electrical switches 104 may route signals around optical transceivers displaying pre-failure or failed conditions. In determining whether a dark optical transmitter 120D should be used, first controller 504 may communicate with second controller 506 via control signals sent through optical cable 110. In some examples, these may be in-band control signals that may be transmitted using a low-speed signal modulated with high-speed signals. In some examples, the in-band control signals may be transmitted using different wavelengths. In a further example, the control signals are side-band control signals transmitted on an independent channel. In some examples, one purpose of the DEOS system 500 is to preserve the lifespan of the extra optical transceivers 106 by turning them off. In these examples, the respective controller 504 or 506 may turn on the dark optical transceiver 106 when an active optical transmitter or optical receiver within an optical transceiver 106 begins to fail due to lifetime reliability. In some examples, a benefit of keeping dark optical transceivers 106 off when not in use may be to prevent eye injuries during when the optical cables are disconnected, for example, during repair. In some examples, the purpose of the DEOS system 500 may be to detect and recover from an optical fiber failure, where a dark transceiver 106 may be turned on and an over-provisioned optical fiber within optical cable 110 used when needed.
In some examples, control signals are passed back and forth through optical cable 110 between optical transceivers 106. For example, when a pre-failure condition is detected by controller 504, controller 504 causes a signal to be sent by optical transceiver 106 over optical cable 110 to optical transceiver 106 to communicate the pre-failure condition to controller 506. This communication also includes a request to controller 506 to change the optical signal path to an available optical fiber of over-provisioned optical cable 110. Controller 506 then sends an acknowledgment to change the optical signal path to controller 504. When controller 504 receives this acknowledgment, both controllers 504 and 506 change the optical signal path to utilize the same selected over-provisioned optical cable and operation resumes to normal.
In some examples, system 500 may be contained within a single integrated DEOS cable 124. In this example, a DEOS transceiver may be integrated into each connector end of the DEOS cable 124. In some examples, the optical transmitters and optical receivers within the cable may be capable of failure detection. In some examples, a passive optical cable may be modularly attached to the DEOS transceivers 102 by using optical connector on each end of the optical cable. In yet another example, there may be multiple optical connectors and cables between two DEOS transceivers 102.
In some examples, the control signals may be in-band control signals sent through cable 110 between optical receivers 106. In another example, the control signals may be side-band control signals, sent over an independent optical lane between optical receivers 106. In yet another example, the control signals may use a dedicated electrical path for short cables. For example, a heartbeat control signal may be sent between optical transceivers 106. The absence of the heartbeat signal on either optical transceiver 106 may indicate a failure or pre-failure condition. In this case, first controller 504 and second controller 506 may communicate the failure or pre-failure condition via an independent channel and cause their corresponding electrical switches 104 to connect to another available optical transmitter 106A and optical receiver 1068. After the networking protocol layers retransmit information due to signal loss during the channel change-over, the signal from the sending device may be sent through this new route to the receiving device.
In some examples, the controllers 504 and 506 may communicate and reroute the signal path in a host-transparent manner. Thus, after operation resumes to normal, network data loss that occurred during the process may be quickly and easily handled by networking layers.
In some examples, the rerouting may be host-aware. In this example, the hosts would be aware of the intermediate path change taking place and wait until the path change is finished before resuming the sending or receiving of data. For example, in the Ethernet context, flow control standard protocols may be used. In the system configuration context, other common methods may be used to make the host wait.
In some example, the controllers 504 and 506 may be parts of a sending device controller, a receiving device controller, or a system controller. In some examples, the controllers 504 and 506 may be communicatively coupled to other system controllers.
In the example shown in system topology 600, four hosts 606A through 606D are connected to four devices 608A through 608D via two DEOS transceivers 102 that are themselves linked together by an optical cable 110. In some examples, any device port can be connected to any host port via a DEOS cable 124. Each DEOS transceiver 102 may include two electrical switches 104A and 1048, an optical transmitter 106A and an optical receiver 1068.
The switches 104A and 1048, optical transmitters 106A and optical receivers 1068 are connected to management mechanisms 602. The management mechanisms 602 may perform functions similar to the controllers 504 and 506 as described in 500. The management mechanisms 602 may, for example, allow system administrators to change system topology remotely. In this example, the switching functionality of electrical switches 104A and 1048 is controlled by management mechanisms 602. In some examples, the electrical switching may be done on the transmit side for ease of management. In other examples, this switching may be done on the receiving side. In some examples, the electrical switching may be done on both sides. In some examples, one of the hosts may be managing the system topology. In some examples, this may be done through the switch ports. In some examples, the management signals are sent and received through a separate side channel.
In some examples, eight systems 702A through 702H are connected through two DEOS transceivers 102, which are themselves connected via optical cable 110. In some examples, the electrical switches within each DEOS transceiver 102 may also be operatively connected. In some examples, electrical switches 104 may be multiplexed output type switches or multiplexed input type switches. For example, a multiplexed input switch 104 may be able to receive electrical signals from multiple sources. In some examples the sources may be a sending device and another electrical switch. In some examples, the sources may be multiple switches. In some examples, a multiplexed output switch 104 may be able to send electrical signals to multiple destinations. In some examples, the destinations may be another switch and a system. In some examples, the destinations may be multiple switches or systems.
As shown in network topology 700, a system may connect to any other system on the same side or opposite sides of a DEOS cable 124. For example, system 702A connects across DEOS cable 124 to system 702F. System 702B may connect to system 702C without going through the DEOS cable 124, instead connecting through two electrical switches 114 within a single DEOS transceiver 102.
As mentioned above, fiber optic cables may be used in a network environment. In some examples, these networks may have high lane-count links, especially between inter-switch links. In these examples, an advantage of using DEOS connections in 700 is that traditional redundant links that require redundant switches can be avoided. In some examples, the system of 700 may use relatively inexpensive optical transceivers 106 to achieve a relatively reliable connection. In these examples, an additional benefit of system 700 in the network setting is the use of cheaper optical transceivers 106 to reduce costs.
In the example of
In some examples, each chassis may have four DEOS transceivers 102 connected to each other and to four electrical switches 104. The DEOS transceivers 102 and electrical switches 104 of each chassis may also be connected to management mechanisms 602. Connected to the electrical switches 104, are a group of systems, of which 808A through 808F are a few examples in
In some examples, multiple designs may be used. For example, in
At step 904, the method 900 continues by routing the first electrical signal to an optical transmitter. In some examples, the first electrical switch 104 routes the first electrical signal to an optical transmitter 120A. In routing the electrical signal, for example, the first electrical switch 104A may communicate with first controller 504.
At step 906, the method continues by converting the first electrical signal to an optical signal. In some examples, an optical transmitter 120A converts the first electrical signal into an optical signal.
At step 908, the method continues by sending the optical signal through the optical cable 110. In some examples, an optical transmitter 120A sends the optical signal through optical cable 110. In some examples, optical cable 110 may be over-provisioned with extra fibers.
At step 910, the optical signal is received. In some examples, an optical receiver 122A may receive the optical signal.
At step 912, the optical signal is converted to a second electrical signal. In some examples, optical receiver 122A converts the optical signal into a second electrical signal.
At step 914, the method continues by routing a second electrical signal to the receiving device. In some examples, this electrical signal is received by a second electrical switch 1048. The second electrical switch 1048 may communicate with a second controller 506 to determine which electrical transmitters on second electrical switch 1048 correspond with the receiving device.
In some examples, the method of 900 is accomplished transparently to both the sending device and the receiving device. In some examples, the method of 900 is performed when the first controller or the second controller detect a pre-failure or failure condition on an optical fiber or optical transceiver.
While the present techniques may be susceptible to various modifications and alternative forms, the exemplary examples discussed above have been shown only by way of example. It is to be understood that the technique is not intended to be limited to the particular examples disclosed herein. Indeed, the present techniques include all alternatives, modifications, and equivalents falling within the true spirit and scope of the appended claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2014/013529 | 1/29/2014 | WO | 00 |