Server systems generally include a chassis having an interconnecting circuit board, such as a backplane or a mid-plane, that connects one or more server circuit boards to other server system components such as hard drives, power supplies and the like. Changing an input-output architecture and associated cabling of the server system to accommodate a new server circuit board may be difficult and costly.
Server system 20 comprises enclosure 24, mid-plane 26, memory device backplane 28, internal memory devices 30, server circuit board 32, server adapter 34, input-output module 36 and modular control auxiliary or daughter cards 38, 40. Enclosure 24 and mid-plane 26 form chassis 42 for receiving and being connected to the remaining components of server system 20. Enclosure 24 comprises an outer casing, housing and the like which encloses and supports mid-plane 26 as well as the other components of server system 20. Mid-plane 26 comprises a circuit board including electrically conductive traces and electronic components by which power and data signals are transmitted or routed between those components connected to mid-plane 26. Although illustrated as including mid-plane 26, in other implementations with other architectures or layouts, server system 20 may alternatively use a backplane or other circuit board for interconnecting components of server system 20.
Memory device backplane 28 comprises a circuit board upon which internal memory devices 30 are removably mounted for use by server system 20. Memory device backplane 28 includes electrical traces and electronic components to connect such internal memory devices to mid-plane 26 and facilitates multiplexing of data or communication to and from each of internal memory devices 30. Memory device backplane 28 includes connectors 44 and 46. Connectors 44 are supported or mounted to backplane 28 and facilitate connection of internal memory devices 30 to backplane 28. Connector 46 comprises a connector, such as an electronic plug, extending from backplane 28 to connect to a corresponding connector or port of mid-plane 26. Although illustrated as comprising a single memory device backplane, in other implementations, server system 20 may include multiple memory device memory device backplanes. Although schematically illustrated as supporting two internal memory devices 30, in most other implementations, memory device memory device backplane 28 may support well more than two internal memory devices 30.
Internal memory devices 30 comprise devices for storing and retrieving digital information, such as computer data, that are releasably mounted or connected to memory device backplane 28. Internal memory devices 30 comprise one or more of nonvolatile, random access, magnetic, digital or data storage devices. In one implementation, internal memory devices 30 comprise hard disk drives or disk drives, rigid or hard rotating discs or platters coated with magnetic material, wherein magnetic head is read and write data to such surfaces. In another implementation, internal memory devices 30 may comprise other non-transient computer-readable mediums, such as solid state memory devices. In some implementations, internal memory devices 30 may be fixed to memory device backplane 28.
Server circuit board 32, also referred as a server board, comprises a circuit board supporting server components for use by server system 20. Server circuit board 32 carries server or blade components such as processors, connectors, server-storage array controllers, ethernet controllers, dual in-line memory devices (DIMMs), switches, routers, gateways and input-output interfaces or ports. Server circuit board 32 along with the server blade components (processors, memory and the like) form a server or node. As will be described hereafter, in some implementations, some components of server board 32 may be omitted where such components are now provided by adapter circuit board 34, input-output module 36 and/or modular control daughter cards 38, 40. Server circuit board 32, and its components, facilitate the use of server system 20 to host one or more services or computational tasks on behalf of clients. Depending upon the type of services provided by the server formed by server circuit board 32, server system 20 may comprise an application server, a catalog server, the communication server, a fax server, a database server, a file server, a game server, a name server, a print server, a proxy server, a sound server, a web server and the like.
As schematically shown by
Connector 52 comprises an interface to facilitate releasable or removal connection of server circuit board 32 to mid-plane 26 or another interconnecting board (such as a backplane) for the supply of power and the communication of data to and from server circuit board 32 and its components. In the example illustrated, connector 52 may or may not be specifically configured to mate with a corresponding connector or connection portion of mid-plane 26. In the example illustrated, connector 52 is not utilized as connection with mid-plane 26 is facilitated by adapter 34. In some implementations, connector 52 may be omitted.
Adapter 34 comprises a custom interface between server circuit board 32 and an interconnect circuit board, such as mid-plane 26.
As shown by
Riser 58 comprises a printed circuit board or card projecting from adapter circuit board 56 which includes an edge connector having electrical contacts or connections for being received within bus slot 50 of server circuit board 32. Riser 58 includes electrical traces for distributing and routing data and power signals from bus slot 50 of server circuit board 32 to adapter circuit board 56. In one implementation, riser 58 comprises a PCIe card. In one implementation, riser 58 has an edge opposite to the edge connector that is permanently fixed or attached to adapter circuit board 56. In another implementation, adapter circuit board 56 may itself include a bus slot, wherein riser 58 has two edge connectors, with one of the edge connectors position in the bus slot of the adapter circuit board 56 and the other of the edge connectors receivable within bus slot 50 of server circuit board 32. Riser 58 facilitates connection of adapter circuit board 56 to server circuit board 32 using an existing bus slot 50 on server circuit board 32. Riser 58 facilitates the use of adapter 34 with a variety of different server circuit boards.
In one implementation, riser 58 comprises a card extending perpendicular to adapter circuit board 56. In another implementation, riser 58 comprises a card extending parallel to but spaced from adapter circuit board 56. In the example illustrated, adapter 34 is illustrated as including a single riser 58 for use with a server circuit board developed to use an Advance Micro Devices (AMD) processor architecture. However, in other implementations, adapter 34 may include a plurality of risers 58. For example, adapter 34 may include a pair of risers 58 for being simultaneously received within a pair of bus slot 50 where the circuit board 32 has an INTEL processor architecture.
Connector 66 comprises an interface for connecting adapter 34, and in particular, adapter circuit board 56, to an interconnecting circuit board, such as mid-plane 26. Connector 66 mates and connects with a corresponding connector portion of mid-plane 26. In one implementation, connector 66 is configured so as to connect to mid-plane 26 using the same connecting portion of mid-plane 26 that would otherwise be connected to an interface or connector of a server circuit board 32. In other implementations, connector 66 may be configured to be connected to other connectors of mid-plane 26.
As shown by
In one implementation, repeaters 76 comprise a PCIe driver. In one example, repeaters 76 each comprise a low-power, four-lane repeater with four stage input equalization and output de-emphasis driver, referred to as a 6 DS80PCI800 and commercially available from TEXAS INSTRUMENTS. In one implementation, adapter 74 comprises 6 6 DS80PCI800 chips, accommodating 24 PCIe communication lanes in both directions. Each lane is composed of a transmit and receive pair of differential lines composed of four wires or signal paths to provide a full-duplex byte stream in both directions simultaneously. In other implementations, adapter 74 may comprise a greater or fewer of such repeaters 76, accommodating a different number of communication lanes. In other implementations, adapter 34 may include repeaters 76 having other configurations, accommodating a same or a different number of such communication lanes.
In one implementation, adapter 74 additionally includes one or more reference clock buffers 77 for re-driving a reference clock. In one implementation, such buffers may comprise three zero-delay buffer supports commercially available under the identification ICS9 DB102. Each buffer 77 is driven by a differential SRC output pair from an ICS CK410/CK505-compliant main clock to attenuate jitter on an input clock to maximize performance. In one implementation, adapter 74 comprises three of such chips. In other implementations, adapter 74 may omit such clock buffers or may utilize other clock buffers or repeaters.
Input-output module 36 comprises a device that facilitates modularity and adaptability of inputs and outputs for server system 20. Input-output module 36 facilitates the exchange, service or upgrade of server circuit board 32 by relocating input-output interfaces and controllers for server circuit board 32 onto a separately mounted structure such that the server circuit board 32 may be exchanged, serviced or upgraded with fewer, if any, changes to the input-output architecture or layout including the associated cabling. In other words, server circuit board 32 may be upgraded, repaired or redeployed with reduced disturbance to an existing external cabling system without a loss of input-output, such as a storage array (i.e. Smart Array Controller), an Ethernet, Infiniband or other Input-Output module connected interface component. In some implementations, server system 20 facilitates replacement of a server circuit board 32 without imposing the burden of replacing other server system infrastructure such as server-storage array controllers, ethernet controllers or ports and the like.
In addition, module 36 further facilitate changes to the input-output for a server circuit board 32 independent of the server circuit board 32. In other words, the input-output components for a particular server circuit board may be upgraded or exchanged while the existing server circuit board 32 remains in place. By relocating input-output interfaces and controllers from server circuit board 32, additional area or space is provided along server circuit board 32 for enhanced airflow and enhanced cooling of the processors or other heat generating components on server circuit board 32.
As shown by
Input-output port 84 comprise a port by which input-output signals may be transmitted to and from module 36 from external sources through components on the base assembly (module 36) or by another assembly attached to the module 36. In the example illustrated, input-output 84 comprises one or more ports located at a rear 96 of enclosure 24. In one implementation, input-output port 84 comprises an ethernet input-output port. Examples of such an ethernet input-output port 84 include, but are not limited to, 10/100/1000 base T ethernet and 10 gigabyte ethernet ports. In another implementation, input-output port 84 comprises a 40 GB Infiniband port. In yet other implementations, input-output 44 may comprise other input-output ports having a capacity of at least 10 GB. In one implementation, port 84 may comprise an SFP+ module a QSFP module or both each capable of supporting 10 Gb per second data transfer rate along with 10/100/1000 base-T ethernet. In another implementation port 84 may comprise an SFP+ module capable of 10 Gb/sec Ethernet along with a QSFP module capable of 40 Gb/Sec INFINIBAND. In yet other implementations, port 84 may comprise an InfiniBand port which is a switched fabric communication link. In yet other implementations, port 84 may comprise other presently available or future available ports are connectors supporting high rates of data transfer.
Input-Output controller 86 comprises a communication protocol device to transfer and format data received through port 84 to the server chip set or in reverse from the chip set to port 84. In other implementations, controller 86 may comprise other controllers or switches.
Auxiliary connectors 92 comprise connectors extending from base circuit board 80 to facilitate connection of modular control daughter cards 38, 40. Connectors 92 are offset from one another on circuit board 80 to facilitate concurrent connection of each of modular control daughter cards 38, 40. As will be described hereafter, modular control daughter cards 38, 40 provide additional or supplemental componentry relocated from server control board 32 for enhanced modularity.
As shown by
As shown by
In one implementation, daughter cards 38, 40 each comprise a PCIe mezzanine card manufactured to the IEEE P1386.1 standard. In such an implementation, connectors 90, 92 each comprise a mezzanine connector. In other implementations, daughter cards 38, 40 may be manufactured pursuant other standards and may have other configurations.
Server-storage array controller 99 comprises a device that manages physical disk drives and present such drives to server circuit board 30 as logical units. In the example illustrated, server-storage array controller 99 may manage a portion of internal memory devices 30. In one implementation, server-storage array controller 99 comprises a RAID (redundant arrays of independent disks) controller. In other implementations, server-storage array controller 99 make comprise other forms of devices for managing internal memory devices 30 and interfacing between such internal memory devices 30 and server circuit board 32.
Although module 36 is illustrated as including a pair of connectors 90, 92 for connection to a pair of cards 38, 40, in other implementations, module 36 may be connected to a greater or fewer of such cards 38, 40. For example, in some implementations, a single card 38, 40 may be configured to manage all of drives 30. In such an implementation, one of cards 38, 40 may be omitted. In other implementations, server system 20 may include multiple server circuit boards connected to mid-plane 26. In such an implementation, that 36 may include multiple cards 38, 40, with each card 38, 40 serving a different server circuit board.
As schematically shown in
Overall, module 36 (or module 96) offers several advantages or benefits. First, because module 36 offloads or relocates input-output port 84 and input-output controller 86 from server circuit board 32 to circuit board 80, module 36 provides enhanced flexibility and modularity to facilitate upgrading, repairing or redeployment of server circuit board 32, provides a mechanism for input-output modification independent of server circuit board 32 and offers enhanced cooling are providing more space along server circuit board 32.
Second, because module 36 provides a modular or distributed architecture, module 36 may offer high-frequency input and output (greater than 10 GB) with improved signal integrity. In particular, because the chipset data transfer physical layer used to directly connect to the input-output protocol devices (serial attached SCSI (SAS), Serial ATA (SATA), 10 G Ethernet, Infiniband) is close to the external connect point (port 84), signal integrity is enhanced. Because module 36 offers a wider port count to storage interface devices, module 36 offers improved bandwidth for storage interfaces such as SAS.
Third, module 36 may reduce the overall cost for server system 20. For example, since circuit server board 32 may omit input-output ports and controllers which are now provided on module 36, circuit server boards may be less complex and less expensive. Repeating devices for the 10 GB input-output ports may further be omitted from the server circuit board. By using a PCIe to 10 GB Ethernet and Infiniband (IB) adapter or controller 86, IB repeating devices may also be omitted from the server circuit board.
External storage drives 225 comprise external drives, such as hard disk drives, solid state drives and the like which are accessible external to chassis 224. External storage drives 225 are connected to an associated server circuit board 232. In the example illustrated, storage drives 225 are accessible at a front end 297 of server system 220 and enclosure 242. In some implementations, storage drives 225 may be omitted.
Power supplies 227 are located at a rear 296 of server system 220 and include interfaces for connection to external power sources such as an AC outlet. Power supplies 227 convert and deliver power at appropriate voltages to fans 231 and to the remaining components of server system 220.
Memory device backplanes 228 each comprises a circuit board upon which internal memory devices 30 are removably mounted for use by server system 220. Memory device backplane 228 includes electrical traces and electronic components to connect such memory devices to mid-plane 226 and facilitates multiplexing of data or communication to and from each of internal memory devices 30. Memory device backplane 228 includes connectors 244, expander rule 245 and mid-plane connector 246. Connectors 244 are supported or mounted to backplane 228 and facilitate connection of hard drives 230 to backplane 228. Connector 246 comprises a connector, such as an electronic plug, extending from backplane 228 to connect to a corresponding connector or port of mid-plane 226. Although illustrated as comprising two memory device backplanes 228A and 228B, in other implementations, server system 220 may include more than two memory device backplanes. Although each backplane 228 is illustrated as including 30 connectors 244, in other implementations, backplanes 228 may include other numbers of connectors 244 for supporting other numbers of memory devices 230.
Memory devices 230 comprise devices for storing and retrieving digital information, such as computer data that are releasably mounted or connected to memory device backplane 228. Memory devices 230 comprise one or more of nonvolatile, random access, magnetic, digital or data storage devices. In one implementation, memory devices 230 comprise hard drives—rigid or hard rotating discs or platters coated with magnetic material, wherein magnetic head is read and write data to such surfaces. In another implementation, memory devices 230 may comprise other non-transient computer-readable mediums, such as solid state memory devices. In some implementations, memory devices 230 may be fixed to memory device backplane 228.
Fans 231 are located at rear 296 of server system 20 and create airflow through server system 220 to cool internal components of server system 20 such as processors on server circuit boards 232. As shown by
Server circuit board 232, also referred as a server board, comprises a circuit board supporting server components (processors, memory and connectors) which, together, form a server or computing node for use by server system 220. Server circuit board 232 carries server or blade components such as processors, connectors, server-storage array controllers, ethernet controllers, dual in-line memory devices (DIMMs), switches, routers, gateways and input-output interfaces or ports. As will be described hereafter, in some implementations, some components of server board 232 may be omitted where such components are now provided by adapter circuit board 274, input-output module 236 and/or modular control daughter cards 240. Server circuit board 232, and its components, facilitate the use of server system 220 to host one or more services or computational tasks on behalf of clients. Depending upon the type of services provided by the server formed by server circuit board 232, server system 220 may comprise an application server, a catalog server, the communication server, a fax server, a database server, a file server, a game server, a name server, a print server, a proxy server, a sound server, a web server and the like.
As shown by
Processors 251 comprise processing units that perform the services of server system 220. Memory slots 252 comprise slots for receiving memory modules, such as dual in-line memory modules (DIMMs). In other implementations, server circuit board 232 may carry fewer or greater number of processors, memory slots and memory. Although not illustrated, server circuit board 232 may support other components such as heat sinks, fixed memory units and other electronic circuitry. In other implementations, server circuit board 232 may carry and utilize any of a variety of memory or processors.
Adapter 274 comprises a custom interface between server circuit board 232 and an interconnect circuit board, such as mid-plane 226. Adapter 274 may be provided as part of system 220 or may be provided separately from system 220 after prior acquisition of system 220 to facilitate use of different server circuit boards having a differently configured mid-plane connector interface.
Riser 258 comprises a printed circuit board or card projecting from adapter circuit board 256 which includes an edge connector 259 having electrical contacts or connections for being received within bus slot 250 of server circuit board 232. Riser 258 includes electrical traces for distributing and routing data and power signals from bus slot 250 of server circuit board 232 to adapter circuit board 256. In one implementation, riser 258 comprises a PCIe card. In one implementation, riser 258 has an edge opposite to the edge connector that is permanently fixed or attached to adapter circuit board 256. In another implementation, adapter circuit board 56 may itself include a bus slot, wherein riser 258 has two edge connectors, with one of the edge connectors position in the bus slot of the adapter circuit board 256 and the other of the edge connectors receivable within bus slot 250 of server circuit board 32. Riser 258 facilitates connection of adapter circuit board 256 to server circuit board 32 using an existing bus slot 50 on server circuit board 232. Riser 258 facilitates the use of adapter 274 with a variety of different server circuit boards.
In one implementation, riser 258 comprises a card extending perpendicular to adapter circuit board 56. In another implementation, riser 258 comprises a card extending parallel to but spaced from adapter circuit board 256. In the example illustrated, adapter 274 is illustrated as including a single riser 258 for use with server circuit board such as provided by ADVANCE MICRO DEVICES. However, in other implementations, adapter 34 may include a plurality of risers 258. For example, with some server circuit boards or server boards commercially provided by INTEL, adapter 274 may include a pair of risers 258 (the second riser 258′ being shown in broken lines in
Connector 266 comprises an interface for connecting adapter 274, and in particular, adapter circuit board 256, to an interconnecting circuit board, such as mid-plane 226. Connector 266 mates and connects with a corresponding connector portion of mid-plane 226. In one implementation, connector 266 is configured so as to connect to mid-plane 226 using the same connecting portion of mid-plane 226 that would otherwise be connected to an interface or connector of a server circuit board 232. In other implementations, connector 266 may be configured to be connected to other connectors of mid-plane 226.
Repeaters 276 comprise electronic circuit chips carried by adapter circuit board 256 which receive signals that are received by riser 258 and re-drive such signals before such signals are passed on to connector 266. Repeaters 276 repeat signals to preserve signal integrity over large transmission distances. Repeaters 276 preserve signal integrity despite the longer signal transmission distances resulting from the use of adapter 274 where such signals are transmitted across riser 258 and across adapter circuit board 256 prior to reaching mid-plane 226.
In one implementation, repeaters 276 comprise a PCIe driver. In one example, repeaters 276 each comprise a low-power, eight-lane repeater with four stage input equalization and output de-emphasis driver, referred to as a DS80PCI800 and commercially available from TEXAS INSTRUMENTS. In one implementation, adapter 274 comprises 6 DS80 pci402 chips, accommodating 24 PCIe communication lanes in both directions. Each lane is composed of a transmit and receive pair of differential lines composed of four wires or signal paths to provide a full-duplex byte stream in both directions simultaneously. In other implementations, adapter 274 may comprise a greater or fewer of such repeaters 276, accommodating a different number of communication lanes. In other implementations, adapter 274 may include repeaters 276 having other configurations, accommodating a same or a different number of such communication lanes.
In the illustrated example, adapter 274 additionally comprise one or more reference clock buffers 277 for re-driving a reference clock. In one implementation, buffers 277 comprise three zero-delay buffer supports commercially available under the identification ICS9 DB102. Each driver buffer support is driven by a differential SRC output pair from an ICS CK410/CK505-compliant main clock to attenuate jitter on an input clock to maximize performance. In one implementation, adapter 274 comprises three of such chips.
Rear signal transfer connectors 292, 293, 294 comprise connectors or headers that connect to cables extending from server circuit board 232. Connectors 292, 293, 294 transfer or route signals from server circuit board 32, across adapter circuit board 256 to connector 266 and to mid-plane 226 for connection to external ports. Connectors to 92, 293, 294 reduce cabling or cabling clutter within enclosure 224 and simplify exchange of server circuit board 232. In the example illustrated, connector 292 is configured to connect to the cable transmitting management signals for the server circuit board 232. Connector 293 is connectable to a cable from server circuit board 232 to receive signals pertaining to server management (ILO). Connector 294 comprises a pair of connectors connectable to a pair of cables from server circuit board 232 for transmitting 1 gigabyte data signals between server circuit board 232 and two 1 GB ethernet external ports at the rear 296 of enclosure 224.
Front signal transfer connectors 295, 298 comprise connectors or headers which are connectable to cables from server circuit board 232 which are to be routed to a front 297 of enclosure 224. Connector 295, 298 transfer or route signals from server circuit board 32, across adapter circuit board 256 to another connector or header 300 which is connectable to another cable that is connected to ports proximate to the front 297 of enclosure 224. Connectors 295, 298 reduce cabling or cabling clutter within enclosure 224 and simplify exchange of server circuit board 232. In the example illustrated, connector 295 comprises a video/USB/RS232 (a serial port for binary single-ended data and control signals connecting between a DTE (Data Terminal Equipment) and a DCE (Data Circuit-terminating Equipment) connector for transmitting such signals. Connector 298 comprises a power switch and user interface diagnostic (UID) health connector for transmitting signals from corresponding switches or controls at the front of enclosure 224 to server circuit board 232 for turning on or off circuit board 232 and for providing information regarding the health of server circuit board 232. In other implementations, additional or fewer of such connectors and corresponding routings may be provided on adapter 274.
Power control scheme or system 299 transmits or delivers electrical power across adapter 274 to an electrical cable that is connected to server circuit board 232. In the example illustrated, power control system 290 additionally monitors or facilitates monitoring of the power that is being delivered and consumed. As shown by
In addition, each module 236 further facilitate changes to the input-output for a server circuit board 232 independent of the server circuit board 232. In other words, the input-output components for a particular server circuit board may be upgraded or exchanged while the existing server circuit board 232 remains in use and in place. By relocating input-output interfaces and controllers from server circuit board 232, additional area or space is provided along server circuit board 232 for enhanced airflow and enhanced cooling of the processors or other heat generating components on server circuit board 232.
As shown by
Input-output ports 284 comprise ports by which input-output signals may be transmitted to and from module 236 from external sources. In the example illustrated, ports 284 comprise a dual 1 gigabyte RJ45 connector 308, a QSFP module, copper direct connect or fiber optic transceiver capable of supporting a 10 GB per second data transfer rate as Ethernet or 40 Gb/s when configured as INFINIBAND, an SFP+ connector 312 capable of a transferring data at 10 Gb per second Ethernet and a RJ45 serial port 314. In other implementations, ports 284 may include a fewer or greater of connectors or ports as well as alternative types of connectors or ports for facilitating the input and output of data. For example, in yet other implementations, ports 284 may comprise an InfiniBand port which is a switched fabric communication link. In yet other implementations, port 284 may comprise other presently available or future available ports or connectors supporting high rates of data transfer.
Input-output controller 286 comprises communication protocol device to transfer and format data received through ports 284 to the server chip set or in reverse from the chip set to ports 284. For example, controller 286 handles all protocol for communications through ports 284. In one implementation, controller 286 comprises a PCIe GEN3 end point with a dual 10 GB Ethernet or single 10 GB ethernet and 40 gigabyte Infiniband (IB) controller. In one implementation, controller 286 may comprise a MELLANOX CX3 Virtual Protocol Interface (VPI) device. In other implementations, controller 286 may comprise other controllers or switches.
Auxiliary connectors 290, 292 comprise connectors extending from base circuit board 280 to facilitate connection of modular control daughter cards 240 (shown in
In the example illustrated in
Although the present disclosure has been described with reference to example embodiments, workers skilled in the art will recognize that changes may be made in form and detail without departing from the spirit and scope of the claimed subject matter. For example, although different example embodiments may have been described as including one or more features providing one or more benefits, it is contemplated that the described features may be interchanged with one another or alternatively be combined with one another in the described example embodiments or in other alternative embodiments. Because the technology of the present disclosure is relatively complex, not all changes in the technology are foreseeable. The present disclosure described with reference to the example embodiments and set forth in the following claims is manifestly intended to be as broad as possible. For example, unless specifically otherwise noted, the claims reciting a single particular element also encompass a plurality of such particular elements.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US2012/035311 | 4/26/2012 | WO | 00 | 10/23/2014 |