Techniques for segmented CRC design in high speed networks

Abstract

Embodiments of the present invention provide techniques for efficient generation of CRC values in a network environment. Specific embodiments of the present invention enable CRC processing circuits that can generate CRC values at high data throughput rates (e.g., 100 Gbps or greater), while being capable of being implemented on currently available FPGAs. Accordingly, embodiments of the present invention may be used in network devices such as routers, switches, hubs, host network interfaces and the like to support high speed data transmission standards such as 100G Ethernet and beyond.

Description

CROSS-REFERENCES TO RELATED APPLICATIONS

The present disclosure is related to the following commonly assigned co-pending U.S. patent application, which is incorporated herein by reference in its entirety for all purposes: application Ser. No. 11/779,714, filed concurrently with the present application, entitled “Segmented CRC Design In High Speed Networks.”

BACKGROUND OF THE INVENTION

Embodiments of the present invention relate to data processing, and more particularly relate to techniques for efficient generation of Cyclical Redundancy Check (CRC) values in network devices.

A Cyclical Redundancy Check, or CRC, is a type of function that is used to detect errors in digital data. A typical n-bit CRC (e.g., CRC-16, CRC-32, etc.) receives as input a data block represented as a binary value, and divides the binary value by a predetermined n-bit binary divisor to generate a remainder that is characteristic of the data block. The remainder may be used as a checksum to determine, for example, if the data block is later altered during transmission or storage. In the art, the term CRC is often used to refer to both the function and its generated remainder; however, for clarity, the present disclosure will refer to the function as the CRC and the remainder as the CRC value.

In the field of data communications, network protocols such as Ethernet, ATM, and the like employ CRCs to detect transmission errors in messages (i.e., packets or frames) that are sent from one network device to another. For example, in a conventional Ethernet implementation, a transmitting network device (e.g., router, switch, host network interface, etc.) generates a CRC-32 value for each outgoing Ethernet frame, and appends the value to the frame prior to transmission. When the frame is received at a receiving network device, the CRC-32 value is stripped and a new CRC-32 value is generated for the frame. The new CRC-32 value is then compared to the received CRC-32 value to verify the integrity of the data contained within the frame.

A problem with conventional CRC processing circuit implementations is that they cannot efficiently support the high data throughput rates demanded by emerging wire transmission standards such as 100 G (i.e., 100 Gigabits per second (Gbps)) Ethernet. The data throughput of a CRC processing circuit is a function of its data line width and its clock speed. For example, a conventional parallel CRC circuit may process 64-bit wide data lines per clock cycle at a speed of 300 Megahertz (Mhz), thereby achieving a theoretical data throughput rate of approximately 64 bits*300 Mhz=19 Gbps, which is sufficient to support 10 G (i.e., 10 Gbps) Ethernet. However, achieving a data throughput rate of 100 Gbps and beyond is difficult for conventional CRC processing circuits.

There are several reasons why conventional CRC processing circuits cannot efficiently support high throughput rates such as 100 Gbps. 100 Gbps generally requires a 10 X or greater increase in either data line width or clock speed in a conventional 10 Gbps CRC processing circuit design, which is difficult to physically implement in hardware using currently available technologies. Implementing a large data line width also introduces timing issues at the gate level. Further, conventional parallel CRC designs require that the data lines of the input data stream be processed in order. Accordingly, in the case of Ethernet, an entire frame must be received by a receiving network device before a CRC value for the frame can be generated. This imposes a latency that makes it difficult to achieve theoretical data throughput rates, thereby further adversely affecting scalability.

BRIEF SUMMARY OF THE INVENTION

Embodiments of the present invention provide techniques for efficient generation of CRC values in a network environment. Embodiments of the present invention include CRC processing components (e.g., circuits) that can generate CRC values at high data throughput rates (e.g., 100 Gbps or greater), while being capable of being implemented on currently available FPGAs. Accordingly, embodiments of the present invention may be used in network devices such as routers, switches, hubs, host network interfaces and the like to support high speed data transmission standards such as 100 G Ethernet and beyond.

In one set of embodiments, a network device receives a set of one or more data lines, where the data lines represent portions of a message. Each data line has a width, and at least one data line in the set of data lines is a residue line containing a portion of the message that is smaller in size than the width of the residue line. The portion of the message in the residue line is shifted from one boundary of the residue line to a second boundary of the residue line. A data line CRC value for each data line in the set of data lines is generated, and a message CRC value for the message is generated based on the data line CRC values. In this manner, a CRC value for a message such as an Ethernet frame may be efficiently generated by a network device.

In one set of embodiments, the message CRC value is generated by aggregating the data line CRC values using a logical operator. For example, the logical operator may be the exclusive-or (XOR) operator.

In various embodiments, generating the message CRC value comprises retrieving a first transformation matrix for one or more data lines in the set of data lines (excluding the residue line), multiplying the data line CRC value by its corresponding first transformation matrix, and generating a partial, accumulated message CRC value by aggregating the transformed CRC values for the data lines excluding the residue line. In one set of embodiments, the first transformation matrix may depend on the position of the data line relative to the other data lines in the set of data lines. Additionally, the first transformation matrix may be pre-computed and retrieved from memory. The embodiment further includes receiving a second transformation matrix, multiplying the partial, accumulated message CRC value by the second transformation matrix, and generating a final message CRC value based on the partial, accumulated message CRC value and the CRC value of the residue line. In one set of embodiments, the second transformation matrix may depend on the size of the message portion in the residue line. Additionally, the first and second transformation matrices may be pre-computed and retrieved from memory.

In one set of embodiments, the final message CRC value is generated by combining the transformed partial, accumulated message CRC value and the CRC value for the residue line using a logical operator. For example, the logical operator may be the XOR operator.

In further embodiments, a CRC value is generated for each data line by splitting each data line into a plurality of sublines, concurrently calculating a CRC value for each subline, and generating a data line CRC value for the data line based on the subline CRC values. Depending on the implementation, the sublines may be of equal or unequal sizes. In various embodiments, the step of generating a data line CRC value for the data line based on the subline CRC values may include retrieving a transformation matrix for each subline where the subline is not the last subline in the data line, multiplying the subline CRC value by its corresponding transformation matrix, and aggregating the transformed subline CRC values and the CRC value for the last subline to generate a data line CRC value. In one set of embodiments, the transformation matrix for a subline may depend on the position of the subline relative to the other sublines of the data line. Additionally, the transformation matrix for a subline may be pre-computed and retrieved from memory.

According to another embodiment of the present invention, a technique for generating a CRC value in a network device comprises receiving a set of one or more data lines, each data line in the set of data lines having a width and comprising a portion of a message, where at least one data line in the set of data lines is a residue line and where each data line in the set of data lines has a data granularity of X bits. The technique further includes calculating a CRC value for each data line in the set of data lines using a set of CRC generators, where each CRC generator is configured to take as input a value that is larger than X bits in size.

According to another embodiment of the present invention, a method for generating a CRC value in a network device comprises receiving a set of one or more data lines, each data line in the set of data lines having a width and comprising a portion of a message, where at least one data line in the set of data lines is a residue line. The method further comprises calculating a CRC value for each data line in the set of data lines using a set of CRC generators, where each CRC generator is configured to take as input a value that is the same size.

According to another embodiment of the present invention, a method for generating a CRC value in a network device comprises receiving a set of one or more data lines, each data line in the set of data lines having a width and comprising a portion of a message, and calculating a CRC value for each data line in the set of data lines using a set of CRC generators, the calculating being independent of the position of the data line relative to the other data lines in the set of data lines. In various embodiments, the calculating of a CRC value for each data line is performed concurrently. In further embodiments, at least one data line in the set of data lines is a residue line containing a portion of the message that is smaller than a width of the residue line.

According to another embodiment of the present invention, a technique for generating a CRC value in a network device includes receiving a set of one or more data lines, each data line in the set of data lines having a width of X bits and comprising a portion of a message, where at least one data line in the set of data lines is a residue line, and where each data line in the set of data lines has a data granularity of Y bits. The technique further includes calculating a CRC value for each data line in the set of data lines using a set of CRC generators, the number of CRC generators in the set of CRC generators being less than X divided by Y.

The foregoing, together with other features, embodiments, and advantages of the present invention, will become more apparent when referring to the following specification, claims, and accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B are simplified block diagrams of a system and network environment that may incorporate an embodiment of the present invention.

FIG. 2 illustrates a data stream that may be processed in accordance with an embodiment of the present invention.

FIG. 3 illustrates the steps performed in generating a CRC value for a message in accordance with an embodiment of the present invention.

FIG. 4 illustrates a data line that may be processed in accordance with an embodiment of the present invention.

FIGS. 5A and 5B illustrate the steps performed in generating a CRC value for a data line in accordance with an embodiment of the present invention.

FIG. 6 is a simplified block diagram of a logic circuit configured to generate a CRC value for a data line in accordance with an embodiment of the present invention.

FIG. 7 illustrates the steps performed in aggregating the data line CRC values for a message to generate a message CRC value in accordance with an embodiment of the present invention.

FIG. 8 is a simplified block diagram of a first logic circuit configured to generate a CRC value for a message in accordance with an embodiment of the present invention.

FIG. 9 is a simplified block diagram of a second logic circuit configured to generate a CRC value for a message in accordance with an embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide an understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without some of these specific details. In other instances, well-known structures and devices are shown in block diagram form.

Embodiments of the present invention provide techniques for generating CRC values in an efficient manner. The CRC generation techniques described below may be applied to different domains and contexts. In one embodiment, the techniques may be used in the networking or data communication domain. In the networking environment, the CRC generation techniques may be employed by network devices such routers, switches, hubs, host network interfaces, etc. that use CRC-based error detection techniques to verify the integrity of data received by the devices. The CRC generation techniques of the present invention are scalable and can support high data throughput rates such as 100 Gbps and greater that are required by many high-speed data transmission standards.

FIG. 1A is a simplified block diagram of a system that may incorporate an embodiment of the present invention. As shown, system 100 comprises a transmitting device 102 coupled to a receiving network device 110 via a data link 106. Receiving network device 110 may be a router, switch, hub, host network interface, or the like. Transmitting device 102 may also be a network device, or may be some other hardware and/or software-based component capable of transmitting data. Although only a single transmitting device and receiving network device are shown in FIG. 1A, it should be appreciated that system 100 may incorporate any number of these devices. Additionally, system 100 may be part of a larger system environment or network, such as a computer network (e.g., a local area network (LAN), wide area network (WAN), the Internet, etc.) as shown in FIG. 1B.

Transmitting device 102 may transmit a data stream 104 to network device 110 using data link 106. Data link 106 may be any transmission medium(s), such as a wired (e.g., optical, twisted-pair copper, etc.) or wireless (e.g., 802.11, Bluetooth, etc.) link(s). Various different protocols may be used to communicate data stream 104 from transmitting device 102 to receiving network device 110. In one embodiment, data stream 104 comprises discrete messages (e.g., Ethernet frames, IP packets) that are transmitted using a network protocol (e.g., Ethernet, TCP/IP, etc.). An embodiment of data stream 104 is described in further detail with respect to FIG. 2 below.

Network device 110 may receive data stream 104 at one or more ports 108. The data stream may comprise one or more messages received by network device 110. The data stream received over a port may then be routed to an interface 112, for example, a Media Access Controller (MAC) as found in Ethernet-based networking equipment. Interface 112 may be configured to perform various processing operations on the data stream, such as buffering of the data stream for forwarding to other components in the network device, updating header information in a message, determining a next destination for a received message, etc. Interface 112 may be implemented, for example, in one or more FPGAs and/or ASICs.

According to an embodiment of the present invention, interface 112 is configured to perform CRC-based error detection on data stream 104. To facilitate this, interface 112 may employ one or more CRC processing components 114. A CRC processing component is configured to generate a CRC value for data block input to the component. A CRC processing component may be implemented in hardware (e.g., microprocessor, logic device such as an FPGA or ASIC, etc.), in software, or combinations of hardware and software. In one embodiment, CRC processing component 114 is a logic-based circuit that is configured to generate a CRC value for a message received in data stream 104 by network device 110. In some embodiments, CRC processing component 114 may further include logic for verifying if the CRC value generated by the component for a received message matches a CRC value that is received from transmitting device 102 for the message. For example, as shown, transmitting device 102 may include a CRC generation component 116 configured to generate a CRC value for a message sent by transmitting device 102. The CRC value may then be appended to the message and extracted by network device 110 from the message in data stream 104. In this manner, CRC processing component 114 may be configured to generate a CRC value for the received data and use the generated value to verify the data integrity of the message received from the transmitting device.

In the example of FIG. 1A, CRC processing component 114 is shown as a subcomponent of interface 112. However, in alternative embodiments CRC processing component 114 may be implemented as a standalone component that is structurally separate from interface 112. In one embodiment, CRC processing component 114 is configured to process data stream 104 at a data throughput rate of 100 Gbps or more. In further embodiments, CRC processing component 114 may be implemented as a single FPGA or ASIC.

FIG. 1B is a simplified block diagram of a network environment that may incorporate an embodiment of the present invention. Network environment 150 may comprise any number of transmitting devices, data links, and receiving devices as described above with respect to FIG. 1A. As shown, network environment 150 includes a plurality network devices 152, 154, 156 and a plurality of sub-networks 168, 176 coupled to a network 164. Additionally, sub-networks 168, 176 include one or more nodes 170, 178.

Network devices 152, 154, 156 and nodes 170, 178 may be any type of device capable of transmitting or receiving data via a communication channel, such as a router, switch, hub, host network interface, and the like. Sub-networks 168, 176 and network 164 may be any type of network that can support data communications using any of a variety of protocols, including without limitation Ethernet, ATM, token ring, FDDI, 802.11, TCP/IP, IPX, and the like. Merely by way of example, sub-networks 168, 176 and network 164 may be a LAN, a WAN, a virtual network (such as a virtual private network (VPN)), the Internet, an intranet, an extranet, a public switched telephone network (PSTN), an infra-red network, a wireless network, and/or any combination of these and/or other networks.

Data may be transmitted between any of network devices 152, 154, 156, sub-networks 168, 176, and nodes 170, 178 via one or more data links 158, 160, 162, 166, 174, 172, 180. Data links 158, 160, 162, 166, 174, 172, 180 maybe configured to support the same or different communication protocols. Further, data links 158, 160, 162, 166, 174, 172, 180 may support the same or different transmission standards (e.g., 10 G Ethernet for links between network devices 152, 154, 156 and network 164, 100 G Ethernet for links 172 between nodes 170 of sub-network 168).

In one embodiment, at least one data link 158, 160, 162, 166, 174, 172, 180 is configured to support 100 G Ethernet. Additionally, at least one device connected to that link (e.g., a receiving device) is configured to support a data throughput of at least 100 Gbps. In this embodiment, the receiving device may correspond to receiving device 110 of FIG. 1A, and may incorporate a CRC processing component in accordance with an embodiment of the present invention.

As indicated above, data stream 104 may comprise data corresponding to one or more messages that are received by receiving network device 110. In the case of the Ethernet protocol, a message corresponds to an Ethernet frame. Messages received via data stream 104 may be of the same size or of variable size. For example, Ethernet supports message sizes up to 1.4 kilobytes. In one embodiment, data stream 104 is received by interface 112, which may be a MAC, and then presented to CRC processing component 114 for generation of a CRC value for a message. In one embodiment, the data stream is presented to CRC processing component 114 in the form of data lines.

FIG. 2 illustrates an example of how data stream 104 is presented to CRC processing component 114 according to an embodiment of the present invention. As depicted in FIG. 2, data stream 104 is provided to a CRC processing component as a set of one or more data lines 206, 208, 210, 212, and 214. As used herein, a data line is a fixed-size unit of data that is received and processed by a CRC processing component in a fixed unit of time (usually one clock cycle). For example, as depicted in FIG. 2, line L₁ 206 is received at clock cycle T₁, line L₂ 208 is received at clock cycle T₂, line L₃ 210 is received at clock cycle T₃, line L₄ 212 is received at clock cycle T₄, and line L₅ 214 is received at clock cycle T₅.

The width (i.e., size) of a data line may vary from one embodiment to another. The width of the data line is independent of the size of a message supported by a particular transmission protocol. The width of a data line corresponds to the maximum size of data that can be provided as input to CRC processing component 114 per unit of time (e.g., per clock cycle). In the embodiment depicted in FIG. 2, the width of each data line is assumed to be 640 bits.

A message may be contained in one data line or may be spread over multiple data lines with each data line containing a portion of the message. If the size of a message is larger that the data line width, the message will be spread over multiple data lines that may be received and processed over a number of clock cycles. In FIG. 2, a message 202, which is assumed to be 2080 bit long, is spread across four data lines L₁ 206, L₂ 208, L₃ 210, and L₄ 212 that are received at clock cycles T₁, T₂, T₃, and T₄ by CRC processing component 114. The multiple data lines corresponding to message 202 may be received in order or out of order. In some embodiments, the data lines corresponding to a message may be received interspersed with data lines comprising other data. For the purposes of the example depicted in FIG. 2, data stream 104 is assumed to be received from right to left. Accordingly, L₁ (206) is the first data line of message 202 and L₄ (212) is the last data line of message 202.

In certain instances, a data line for a message may contain message data that is smaller in size that the width of the data line. This may occur, for instance, if the total size of the message is smaller than the data line width or is not a multiple of the data line width (i.e., the message has a data granularity that is not aligned with the data line width). As used herein, data granularity refers to the smallest physical unit of data that is transmitted using a particular transmission protocol. In the case of Ethernet protocol, the data granularity is generally 8 bits. Thus, an Ethernet frame may vary in size from 8 bits to 1.4 kilobytes (the maximum frame size) in 8 bit increments (the data granularity). Returning to FIG. 2, message 202 has a data granularity of 8 bits and a total size of 2080 bits, which is not a multiple of 640 bits (the data line width). Accordingly, the last data line for message 202—line L4 (212)—contains an amount of message data (160 bits) (depicted by shading in FIG. 2) that is less than the data line width (640 bits). Such a line wherein the message data included in the data line is smaller than the full width of the data line is known as a residue line for the message. Thus, line L₄ (212) is a residue line for message 202.

According to an embodiment of the present invention, the data lines corresponding to a message are provided to CRC processing component 114 for generating a CRC value for the message. FIG. 3 depicts a flowchart 300 showing a method for generating a CRC value for a message in accordance with an embodiment of the present invention. The processing depicted in FIG. 3 may be performed by software modules (e.g., program of code, instructions), hardware modules (e.g., microprocessors, logic circuits implemented in programmable or custom logic devices, etc.), or combinations thereof. The software modules may be stored on a computer-readable medium. The method depicted in FIG. 3 is merely illustrative of an embodiment of the present invention and is not intended to limit the scope of the present invention. Other variations, modifications, and alternatives are also within the scope of the present invention. In one embodiment, method 300 is performed by one or more CRC processing components, such as component 114 of FIG. 1A.

At step 302, a set of one or more data lines is received, where each data line in the set comprises a portion of a message. Generally, the width of each data line is fixed, and is determined by the data line width supported by the CRC processing component. Thus, if method 300 is performed by a CRC processing component that supports a data line width of 64 bits, the width of each received data line will be 64 bits. Similarly, if method 300 is performed by a CRC processing component that supports a data line width of 640 bits, the width of each received data line will be 640 bits.

If there is a residue line in the set of data lines, the portion of the message in the residue line is shifted from a first boundary of the residue line to a second boundary of the residue line (step 304). In an embodiment, shifting is a bitwise shift operation, where one or more bits in the residue line are moved one or more bit positions and the vacated bit positions are filled in with zeroes. For example, assume that the residue line has a width of 8 bits and contains the binary value 11010000, where the message data is 1101, and where the most significant bit (MSB) boundary is on the left side and the least significant bit boundary (LSB) is on the right side. The data in the residue line may be shifted from the MSB boundary to the LSB boundary such that the binary value in the residue line becomes 00001101. Alternatively, the data in the residue line may be shifted from the LSB boundary to the MSB boundary.

Performing the above shift facilitates computation of a CRC value for the residue line. In the above example, the CRC value for 1101 (i.e., the message data included in the residue line) cannot be directly computed using bit string 11010000 as an input to a CRC generator because the trailing four zeros alter the CRC calculation resulting in a different (incorrect) CRC value being generated. However, if 11010000 is shifted to produce 00001101, the correct CRC value for 1101 can be directly computed using bit string 00001101 because the leading fours zeros do not affect the CRC computation.

In one embodiment, the shifting in step 304 may be performed using a conventional barrel shifter. In other embodiments, other hardware and/or software-based methods known to those skilled in the art may be used for shifting.

At step 306, a CRC value (referred to as a data line CRC value) for each data line in the set of data lines corresponding to the message is independently generated. In other words, the calculation of a CRC value for one data line is not dependent on the CRC value for any other data line in the set of data lines for the message. In one embodiment, CRC processing component 114 is configured to generate one data line CRC value per a unit of time (e.g., clock cycle) for the data line received in the unit of time.

Different techniques may be used for calculating a data line CRC value for a data line. In one embodiment, each data line is segmented into sublines, and CRC values are generated for each subline. Each subline may be processed by a separate CRC generator to generate a CRC for the subline. The CRC value for the data line is then calculated based upon the CRC values calculated for the sublines. In alternative embodiments, each data line may be processed as a whole (e.g., passed to a single CRC generator) to generate a data line CRC value.

Once CRC values for each data line including the residue line are generated, a message CRC value for the message is generated based upon the data line CRC values (step 308). In one embodiment, the CRC for the message is calculated by aggregating the CRC values calculated for the data lines using a logical operator such as the exclusive-or (XOR) operator. In another embodiment, one or more of the CRC values generated for the data lines (excluding the residue data line) may be transformed using a transformation matrix and the transformed values may be aggregated using a logical operator, such as the exclusive-or (XOR) operator, to generated a partial, accumulated message CRC value. The partial, accumulated message CRC value may then be transformed using a residue transformation matrix and aggregated with the CRC value of the residue line to generate a message CRC value. This embodiment is discussed in further detail with respect to FIG. 7 below.

In some embodiments, the message CRC value generated in 308 may optionally be used to verify the integrity of the message (step 310). This may be done by comparing the CRC generated in 308 with a previously calculated message CRC value. The previously calculated message CRC may be communicated from the transmitting device and may be appended to the message received by the receiving network device. The receiving network device is able to extract this previously calculated CRC value and compare it to the message CRC value generated in 308 in order to determine the integrity of the message. In one embodiment, integrity of the message is confirmed if the message CRC value generated in 308 matches the previously calculated CRC value.

It should be appreciated that the specific steps illustrated in FIG. 3 provide a particular method for generating a CRC value for a message according to an embodiment of the present invention. Other sequences of steps may also be performed according to alternative embodiments. For example, alternative embodiments of the present invention may perform the steps outlined above in a different order. Moreover, the individual steps illustrated FIG. 3 may include multiple sub-steps that may be performed in various sequences as appropriate to the individual step. Furthermore, additional steps may be added or removed depending on the particular applications. One of ordinary skill in the art would recognize many variations, modifications, and alternatives.

As indicated above, different techniques may be used to calculate a data line CRC value for a data line. In one embodiment, the data line is subdivided into sublines and CRC values calculated for the sublines. The CRC value for the data line is then calculated based upon the subline CRC values. FIG. 4 illustrates an example of how a data line may be subdivided into sublines for computation of a CRC value for the data line according to an embodiment of the present invention. In FIG. 4, the data line is assumed to be line L₁ 206 depicted in FIG. 2. The processing may also be applied to other data lines. As depicted in FIG. 4, data line 206 is split into multiple sublines SL₁₁ (402), SL₁₂ (404), SL₁₃ (406), SL₁₄ (408), and SL₁₅ (410). The sublines may be of the same size or different sizes. As shown, data line L₁ is split into sublines of equal size (128 bits). A CRC value may be calculated independently for each subline. A CRC value for the data line is then calculated based upon the CRC values for the sublines. In one embodiment, the subline CRC values are calculated concurrently, thereby speeding up the CRC generation process.

FIGS. 5A and 5B depict flowcharts showing a method 500 for generating a CRC value for a data line in accordance with an embodiment of the present invention. As such, method 500 represents one possible implementation of step 306 of FIG. 3. The processing depicted in FIGS. 5A and 5B may be performed by software modules (e.g., program of code, instructions) hardware modules (e.g., microprocessors, logic circuits implemented in programmable or custom logic devices, etc.), or combinations thereof. The software modules may be stored on a computer-readable medium. The method depicted in FIGS. 5A and 5B is merely illustrative of an embodiment of the present invention and is not intended to limit the scope of the present invention. Other variations, modifications, and alternatives are also within the scope of the present invention. In one embodiment, the method is performed by CRC processing component 114.

At step 502, a data line containing data for a message is received (i.e., the current data line L_C of the message). At step 504, the data line is segmented into N sublines SL_C1, SL_C2, . . . SC_CN. The sizes of the sublines may be the same or may be different. For example, as shown in FIG. 4, data line L₁ (640 bits wide) is split into five equal-sized sublines (SL₁₁ (402), SL₁₂ (404), SL₁₃ (406), SL₁₄ (408), SL₁₅ (410)), each 128 bits wide.

At step 506, a CRC value is calculated for each subline generated in 504. In one embodiment, the CRC values for the sublines are calculated concurrently (for example, using N CRC generators).

At step 508, a data line CRC value for the current data line L_C is generated based upon the subline CRC values calculated in step 506. Various other techniques may be used for generating a CRC value for the data line based upon CRC values calculated for the sublines.

The processing in step 508 may include multiple sub-steps as shown in FIG. 5B. As depicted in FIG. 5B, these sub-steps may include retrieving a transformation matrix for each subline (step 552). This may be done concurrently in one embodiment. In one embodiment, transformation matrices are retrieved for each subline excluding the last subline for the data line, i.e. SL_CN (step 552 of FIG. 5B). For the purposes of this embodiment, the last subline is considered the subline that is aligned with the LSB boundary of data line L_C. However, in other embodiments, the last subline may be the subline that is aligned with the MSB boundary of L_C.

The CRC value generated for each subline in 506 (excluding the last subline SL_CN) is then transformed by multiplying the CRC value with the transformation matrix retrieved for the subline in 552 (step 554). The multiplication yields a transformed CRC value for each subline (except the last subline). Step 554 is performed to mathematically adjust each subline CRC value (excluding the subline value of for the last subline SL_CN) based on the offset of the subline in data line L_C. This allows each subline CRC value to be generated independently of each other and then adjusted based upon the position of the subline.

The transformation matrices for the sublines may be pre-calculated and stored in memory from where they can be accessed during processing. The transformation matrix for each subline CRC is based on the position of the subline relative to the other sublines of L_C. Since the last subline SL_CN has no offset, the CRC value for SL_CN does not need to be adjusted and hence there is no need to retrieve a transformation matrix for the last subline.

The transformed CRC values and the CRC value for the last subline are then aggregated to generate a CRC for the data line (step 556). Various different techniques may be used for aggregating the sublines. In one embodiment, the aggregation is performed using a logical operator such as the exclusive-or (XOR) operator.

It should be appreciated that the specific steps illustrated in FIGS. 4A and 4B provide a particular method for generating a CRC value for a data line according to an embodiment of the present invention. Other sequences of steps may also be performed according to alternative embodiments. For example, alternative embodiments of the present invention may perform the steps outlined above in a different order. Moreover, the individual steps illustrated in FIGS. 4A and 4B may include multiple sub-steps that may be performed in various sequences as appropriate to the individual step. Furthermore, additional steps may be added or removed depending on the particular applications. One of ordinary skill in the art would recognize many variations, modifications, and alternatives.

FIG. 6 is a simplified block diagram of a logic circuit 600 configured to generate a CRC value for a data line in accordance with an embodiment of the present invention. Specifically circuit 600 of FIG. 6 illustrates one possible hardware-based implementation of method 500. FIG. 6 is merely illustrative of an embodiment incorporating the present invention and is not intended to limit the scope of the invention as recited in the claims. One of ordinary skill in the art would recognize other variations, modifications, and alternatives. It is assumed that circuit 600 receives data in data lines having a width of 640 bits. The data widths of the data lines may be different in alternative embodiments.

As shown, circuit 600 receives as input a data line 602 having a width of 640 bits, and routes data line 602 to a residue line shift unit 604. If data line 602 is a residue line, the contents of data line 602 are shifted from one boundary to another as previously described with respect to step 304 of FIG. 3. Residue shift unit 604 may be implemented as a barrel shifter or any other mechanism for performing bitwise shifts of data.

Data line 602 is then segmented into five 128-bit sublines (606, 608, 610, 612, 614). The sublines are concurrently passed into five 128-bit-in CRC generators 616, 618, 620, 622, 624, and the CRC generators output a fixed-size CRC value for each subline (e.g., 32 bits for CRC-32).

As shown, the generated CRC values for the first four sublines 606, 608, 610, 612 are routed to subline CRC transform units 626, 628, 630, 632 to be transformed. In this embodiment, the first four sublines are the four sublines that are most closely aligned to the MSB boundary of data line 602. Each CRC transform unit is configured to retrieve a transformation matrix for the subline whose CRC value is input to the CRC transform unit and multiply the subline CRC value by the retrieved matrix. In one embodiment, the transformation matrices are retrieved from a transformation matrix lookup table 634. Table 634 may be implemented in memory (such as an EEPROM, Flash ROM, etc.), and may consist of one or more physical or logical memory units.

Once the CRC values for sublines 606, 608, 610, 612 have been adjusted or transformed via transform units 526, 528, 530, 532, the output from those transform units represent the transformed CRC values for the sublines. As described above, the CRC value for the last subline 614 does not need to be adjusted.

The transformed CRC values for the sublines and the non-transformed CRC value for the last subline are then aggregated using an XOR unit 636. The output 638 from XOR unit 636 corresponds to the generated CRC value for data line 602. In one embodiment, circuit 600 is configured to generate data line CRC value 638 from input data line 602 in a single clock cycle.

It should be appreciated that diagram 600 illustrates one exemplary circuit for generating a data line CRC value, and other alternative configurations are contemplated. For example, although input data line 602 is shown as having a width of 640 bits, circuit 600 may be configured to take as input a data line of any other width. Additionally, although five 128-bit-in generators are shown, circuit 600 may be configured to incorporate any other number and types of CRC generators, such as ten 64 bit-in CRC generators. One of ordinary skill in the art would recognize many variations, modifications, and alternatives.

FIG. 7 depicts a flowchart showing a method 700 for generating a CRC value for a message based upon the CRC values calculated for the data lines comprising the message in accordance with an embodiment of the present invention. The processing depicted in FIG. 7 may be performed by software modules (e.g., program of code, instructions), hardware modules (e.g., microprocessors, logic circuits implemented in programmable or custom logic devices, etc.), or combinations thereof. The software modules may be stored on a computer-readable medium. The method depicted in FIG. 7 is merely illustrative of an embodiment of the present invention and is not intended to limit the scope of the present invention. Other variations, modifications, and alternatives are also within the scope of the present invention. In one embodiment, the method is performed by CRC processing component 114 depicted in FIG. 1A. Method 700 of FIG. 7 receives as input the data line CRC values generated by method 500 of FIGS. 5A and 5B, and generates a final message CRC value based upon the data line CRC values. Method 700 may be considered one possible implementation of step 308 of FIG. 3.

At step 702, the CRC values for one or more data lines in the set of data lines (excluding the residue line) are multiplied by corresponding transformation matrices to generate transformed CRC values for the one or more data lines. This step is used to mathematically adjust the CRC value for each of the one or more data lines based on the position of the data line in the message. This allows each data line CRC value to be calculated independently of each other and then transformed using the transformation matrices. In various embodiments, the transformation matrix for each data line is pre-computed and is dependent on the position of the data line relative to other data lines of message. These pre-computed matrices may be stored and retrieved from one or more tables in memory.

A partial, accumulated message CRC value is then generated based on the CRC values for all of the data lines in the set of data lines excluding the residue line (step 704). In one embodiment, the partial, accumulated message CRC value is generated by aggregating the transformed CRC values for one or more data lines (excluding the residue line) with the non-transformed CRC values for one or more data lines (excluding the residue line). For example, for message 202 of FIG. 2 that is segmented into four data lines L₁, L₂, L₃, and L₄ (of which L₄ is a residue line), the transformed CRC values for lines L₁ and L₂ would be aggregated with the non-transformed CRC value of L₃ to produce a partial, accumulated message CRC value for message 202.

At steps 706 and 708, a residue transformation matrix is retrieved from memory and the partial, accumulated message CRC value generated in 704 is multiplied by the residue transformation matrix. In various embodiments, the residue transformation matrix is used to mathematically adjust the partial, accumulated message CRC value based on the offset of the second-to-last data line (i.e., the data line before the residue line) from the end of the message. Assuming a message spread over M data lines, this step allows the first M-1 data lines to be computed independently of the residue (i.e., Mth) data line. In various embodiments, the residue transformation matrix is pre-computed and is dependent on the size of the message portion in the residue line. In some embodiments, the residue transformation matrix is retrieved from the same table(s) as the data line transformation matrices of step 702. In alternative embodiments, the residue transformation matrix is stored in a separate table in memory.

A final message CRC value is then generated by aggregating the result of 708 with the CRC value of the residue line (step 710). This aggregation may be performed using a logical operator such as the XOR operator.

It should be appreciated that the specific steps illustrated in FIG. 7 provide a particular method for aggregating the data line CRC values for a message to generate a message CRC value according to an embodiment of the present invention. Other sequences of steps may also be performed according to alternative embodiments. For example, alternative embodiments of the present invention may perform the steps outlined above in a different order. Moreover, the individual steps illustrated in FIG. 7 may include multiple sub-steps that may be performed in various sequences as appropriate to the individual step. Furthermore, additional steps may be added or removed depending on the particular applications. One of ordinary skill in the art would recognize many variations, modifications, and alternatives.

FIG. 8 is a simplified block diagram of a logic circuit configured to generate a CRC value for a message in accordance with an embodiment of the present invention. Specifically, circuit 800 of FIG. 8 represents one possible implementation of method 700 depicted in FIG. 7. As shown, circuit 800 receives as input a CRC value 802 for a current data line L_C. Circuit 800 also receives as input a current line count C 806, a total line count 808, and a pad value 804. Current line count C 806 represents the line number of the current line being processed by circuit 800. Total line count 808 represents the total number of lines containing the message. Pad value 804 is a fixed value that is used in some CRC implementations to add a default leading or trailing bit string to each message prior to generating a CRC value for the message. For example, Ethernet requires that the leading 32 bits of a message are 1-bits.

If the current line L_C is not a residue line of the message, the CRC value 802 for L_C is routed to line CRC transform unit 814. Based on current line count C and total line count 808, an appropriate transformation matrix for L_C is retrieved from transformation matrix lookup table 816 and the matrix is multiplied with the CRC value to generate a transformed CRC value for the data line. In one embodiment, a transformation matrix is not retrieved for the second-to-last data line of the message. The output of line CRC transform unit 814 is then passed to XOR unit 818, which stores a partial, accumulated CRC value for the message. If C=1, then the output of line CRC transform unit 814 is simply stored in XOR unit 818. If C>1, then the output of line CRC transform unit 814 is XOR'ed with the partial, accumulated message CRC value already stored in unit 818 to generate a new partial, accumulated message CRC value, and this new value is stored in unit 818.

The above process is repeated over successive clock cycles for successive data lines of the message until a residue line is reached (i.e., current line count C=total line count 808). Once the current line becomes a residue line, the CRC value for the residue line 802 is passed to a delay unit 824. Concurrently, pad value 804 is passed to line CRC transform unit 814, multiplied with an appropriate transformation matrix from table 816, and aggregated with the partial, accumulated message CRC value in XOR unit 818. The partial, accumulated message CRC value is then routed to an accumulated message CRC transform unit 820. Unit 820 retrieves a residue transformation matrix from a second transformation matrix lookup table 822, and multiplies the residue transformation matrix with the partial, accumulated message CRC value. In an exemplary embodiment, the residue transformation matrix is based on the size of the message portion in the residue line.

Finally, the output of unit 820 is aggregated (e.g., XOR'ed) with residue line CRC value 802 at XOR unit 728, and a final message CRC value 828 is generated.

In various embodiments, circuit 800 may be configured to interoperate with circuit 600 of FIG. 6. For example, the circuits may be linked such that the output L_C CRC value 638 generated by circuit 600 is used as the input L_C CRC value 802 of circuit 800 at every clock cycle. In these embodiments, circuits 800 and 600 may be implemented on a single integrated circuit or on an FPGA. Alternatively, circuits 800 and 600 may be implemented on separate physical circuit dies and connected via an electrical bus or other type of interconnect.

It should be appreciated that circuit 800 illustrates one example of a circuit for generating a message CRC value, and other alternative configurations are contemplated. For example, although circuit 800 aggregates data line CRC values incrementally (via partial, accumulated message CRC value), circuit 800 may be configured to postpone the aggregation of the data line CRC values until the last data line of the message has been received. Additionally, although circuit 800 is shown as receiving a pad value 804, other embodiments may not require a pad value. One of ordinary skill in the art would recognize many variations, modifications, and alternatives.

To further clarify the operation of circuit 800, the following table shows examples of values for (1) received L_C CRC value 802, (2) the partial, accumulated message CRC value stored in unit 818, and (3) final message CRC value 828 as circuit 800 processes message 202 of FIG. 2. This example assumes that the data line width of circuit 800 is 640 bits. Therefore, message 202 (which is 2080 bits wide) is processed as four data lines L₁ through L₄ with L₄ being a residue line, and over four clock cycles T₁ through T₄.

		Partial, accumulated message
Time	LC CRC value	CRC value	Final message CRC value
T1	L1CRC	L1CRC * T2L	N/A
T2	L2CRC	L1CRC * T2L ⊕ L2CRC * T1L	N/A
T3	L3CRC	L1CRC * T2L ⊕ L2CRC * T1L ⊕	N/A
		L3CRC
T4	L4CRC	L1CRC * T2L ⊕ L2CRC * T1L ⊕	(L1CRC * T2L ⊕ L2CRC * T1L
		L3CRC ⊕ 32′hFFFF_FFFF * T3L	⊕ L3CRC ⊕ 32′hFFFF_FFFF * T3L) * TRes
			⊕ L4CRC

At time T₁, the CRC value for data line L₁ (L₁CRC) is received. Since L₁ is offset from the beginning of residue line L₄ by two full data lines, L₁CRC is multiplied by a corresponding transformation matrix T^2L, and the product of this multiplication is stored as the partial, accumulated message CRC value.

At time T₂, the CRC value for data line L₂ (L₂CRC) is received. Since L₂ is offset from the beginning of residue line L₄ by one full data line, L₂CRC is multiplied by a corresponding transformation matrix T^1L. The product of this multiplication is then XOR'ed (denoted by the symbol ⊕) with the partial, accumulated message CRC value to generate a new partial value L₁CRC*T^2L⊕L₂CRC*T^1L.

At time T₃, the CRC value for data line L₃ (L₃CRC) is received. Since L₃ is the second-to-last data line in message 202, L₃ has no offset from the beginning of residue line L₄. Accordingly, L₃CRC is not multiplied by any transformation matrix. Rather, L₃CRC is simply XOR'ed with the partial, accumulated message CRC value to generate a new partial value L₁CRC*T^2L⊕L₂CRC*T^1L⊕L₃CRC.

At time T₄, the CRC value for residue line L₄ (L₄CRC) is received. Since L₄ is the final data line in message 202, a pad value (32h′FFFF_FFFF for Ethernet) is multiplied by a corresponding transformation matrix T^3L and XOR'ed with the partial, accumulated message CRC value to generate a new partial value L₁CRC*T^2L⊕L₂CRC*T^1L⊕L₃CRC⊕32′hFFFF_FFFF*T^3L. The new partial, accumulated message CRC value is then multiplied by a residue transformation matrix T^Res. Finally, the product of that multiplication is XOR'ed with the residue line CRC value L₄CRC to generate the message CRC value for message 202.

FIG. 9 illustrates an alternative embodiment of circuit 800. As shown, circuit 900 of FIG. 9 is substantially similar to circuit 800 in structure, but does not require a total line count 808. Rather, circuit 900 takes as input max lines-C (902) where max lines represents the maximum number of data lines that a message may span, and C represents the line number of the current data line. Max lines may be computed by dividing the maximum size of a message by a circuit's data line width.

Since, in various embodiments, circuit 900 does not require as input the total number of data lines for a message, circuit 900 can begin processing the message before all of the data lines of the message have been received. In one set of embodiments, circuit 900 may be implemented by modifying the transformation matrices used by circuit 800. For example, the modified matrices used by circuit 900 may be based on the offset of a data line from the maximum size of a message, rather than the offset of the data line from the residue line. Further, circuit 900 may employ an additional inverse transformation matrix (stored in transformation matrix lookup table 904). The inverse matrix may be used to transform the partial, accumulated message CRC value prior to being multiplied by the residue transformation matrix.

Embodiments of the present invention provide solutions for generating CRC values. Since the residue line of a message is handled by shifting the contents of the line (rather than by incorporating multiple CRC generators to account for each possible size of the message data in the residue line as done in the prior art), embodiments of the present invention may be implemented with a number of CRC generators that is independent of data line width, thus improving scalability. For example, circuit 600 of FIG. 6 illustrates an embodiment that uses five 128-bit-in CRC generators to process a data line 640-bits wide. If the data line width is increased to 1280 bits, circuit 600 can still be implemented using only five generators (each 256-bit-in). As such, circuit 600 will not dramatically increase in gate size as data throughput requirements increase. This enables the development of network devices that support high data throughput rates such as 100 Gbps using currently available programmable logic devices (e.g., FPGAs) and process technologies.

Additionally, shifting the contents of the residue line allows embodiments of the present invention to be implemented with one or more CRC generators where (1) the input for each CRC generator is larger than the data granularity of an input message, (2) the input for each CRC generator is smaller than the data line width of a CRC processing circuit; and/or (3) the input for each CRC generator is the same size. For example, circuit 600 of FIG. 6 illustrates an embodiment that uses five 128-bit-in CRC generators to process a data line 640-bits wide. Assume that the data granularity of an input message is 8 bits (which is the data granularity of Ethernet frames). Note that the input size of each CRC generator (128 bits) in circuit 600 is (1) larger than the data granularity of an input message (8 bits), (2) smaller than the data line width of circuit 600 (640 bits), and (3) all of the same size (128 bits).

Further, since the CRC values for the data lines (and sub lines) of a message are mathematically adjusted by an appropriate transformation matrix prior to being aggregated, the data lines can be processed out of order. In the case of Ethernet, this allows a CRC processing component to begin processing a frame before the entire frame has been received over the wire, thereby further increasing performance and scalability.

Although specific embodiments of the invention have been described, various modifications, alterations, alternative constructions, and equivalents are also encompassed within the scope of the invention. The described invention is not restricted to operation within certain specific data processing environments, but is free to operate within a plurality of data processing environments. Additionally, although the present invention has been described using a particular series of transactions and steps, it should be apparent to those skilled in the art that the scope of the present invention is not limited to the described series of transactions and steps.

Further, while the present invention has been described using a particular combination of hardware and software, it should be recognized that other combinations of hardware and software are also within the scope of the present invention. The present invention may be implemented only in hardware, or only in software, or using combinations thereof.

The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. It will, however, be evident that additions, subtractions, deletions, and other modifications and changes may be made thereunto without departing from the broader spirit and scope of the invention as set forth in the claims.

Claims

1. A method comprising: receiving, by a network device, a set of one or more data lines, each data line in the set of data lines having a width and comprising a portion of a message, wherein at least one data line in the set of data lines is a residue line containing a portion of the message that is smaller than the width of the residue line;shifting, by the network device, the portion of the message in the residue line from a first boundary of the residue line to a second boundary of the residue line;generating, by the network device, a data line CRC value for each data line in the set of data lines; andgenerating, by the network device, a message CRC value for the message based on the data line CRC values.

2. The method of claim 1 wherein generating a message CRC value for the message based on the data line CRC values comprises aggregating the data line CRC values with a logical operator.

3. The method of claim 2 wherein the logical operator is an XOR operator.

4. The method of claim 1 wherein generating the message CRC value comprises: for one or more data lines in the set of data lines excluding the residue line: retrieving a first transformation matrix for each of the one or more data lines, wherein the first transformation matrix is dependent on the position of the data line relative to the other data lines in the set of data lines; andmultiplying a CRC value for the data line by the first transformation matrix to generate a transformed CRC value for the data line;generating a partial accumulated message CRC value by aggregating the transformed CRC values for the data lines in the set of data lines excluding the residue line;retrieving a second transformation matrix, wherein the second transformation matrix is dependent on a size of the portion of the message in the residue line;multiplying the partial accumulated message CRC value by the second transformation matrix to generate a transformed partial accumulated message CRC value; andgenerating the message CRC value by aggregating the transformed partial accumulated message CRC value with the CRC value of the residue line.

5. The method of claim 4 further comprising storing the first transformation matrix and the second transformation matrix in a memory accessible to the network device, wherein retrieving the first transformation matrix and the second transformation matrix comprises reading the first transformation matrix and the second transformation matrix from the memory.

6. The method of claim 1 wherein generating a data line CRC value for each data line in the set of data lines comprises: splitting the data line into a plurality of sublines;concurrently calculating a CRC value for each subline; andgenerating a data line CRC value for the data line based on the subline CRC values.

7. The method of claim 6 wherein generating a data line CRC value for the data line based on the subline CRC values comprises: if the subline is not the last subline in the data line: retrieving a transformation matrix for the subline, wherein the transformation matrix is dependant on the position of the subline relative to the other sublines of the data line;multiplying a CRC value for the subline with the transformation matrix retrieved for the subline to generate a transformed subline CRC value; andaggregating the transformed subline CRC values and the CRC value for the last subline to generate the data line CRC value.

8. The method of claim 7 wherein aggregating the transformed subline CRC values and the CRC value for the last subline comprises combining the transformed subline CRC values and the CRC value for the last subline using a logical operator.

9. The method of claim 8 wherein the logical operator is an XOR operator.

10. The method of claim 7 further comprising storing the transformation matrix for the subline in a memory, wherein retrieving a transformation matrix for each subline comprises reading the transformation matrix for the subline from the memory.

11. A method comprising: receiving, by a network device, a set of one or more data lines, each data line in the set of data lines having a width and comprising a portion of a message, wherein at least one data line in the set of data lines is a residue line containing a portion of the message that is smaller than the width of the residue line, and wherein each data line in the set of data lines has a data granularity of X bits;calculating, by the network device, a CRC value for each data line in the set of data lines using a set of CRC generators, each CRC generator in the set of CRC generators being configured to calculate a CRC value for an input, wherein the input for each CRC generator is larger than X bits in size; andgenerating, by the network device, a CRC value for the message based on the data line CRC values.

12. A method comprising: receiving, by a network device, a set of one or more data lines, each data line in the set of data lines having a width and comprising a portion of a message, wherein at least one data line in the set of data lines is a residue line containing a portion of the message that is smaller than the width of the residue line;calculating, by the network device, a CRC value for each data line in the set of data lines using a set of CRC generators, each CRC generator in the set of CRC generators being configured to calculate a CRC value for an input, wherein the input for each CRC generator is the same size; andgenerating, by the network device, a CRC value for the message based on the data line CRC values.

13. A method comprising: receiving, by a network device, a set of one or more data lines, each data line in the set of data lines comprising a portion of a message;calculating, by the network device, a CRC value for each data line in the set of data lines using a set of CRC generators, the calculating being independent of the position of the data line relative to the other data lines in the set of data lines; andgenerating, by the network device, a CRC value for the message based on the data line CRC values.

14. The method of claim 13 wherein the calculating a CRC value for each data line is performed concurrently.

15. The method of claim 14 wherein at least one data line in the set of data lines is a residue line containing a portion of the message that is smaller than a width of the residue line.

16. A method comprising: receiving, by a network device, a set of one or more data lines, each data line in the set of data lines having a width of X bits and comprising a portion of a message, wherein at least one data line in the set of data lines is a residue line containing a portion of the message that is smaller than the width of the residue line, and wherein each data line in the set of data lines has a data granularity of Y bits;calculating, by the network device, a CRC value for each data line in the set of data lines using a set of CRC generators, the number of CRC generators in the set of CRC generators being less than X divided by Y; andgenerating, by the network device, a CRC value for the message based on the data line CRC values.