Patent Grant
7839876
The present invention relates generally to data communications. More particularly, the present invention relates to packet aggregation.
Multiple-input multiple-output (MIMO) data communication systems enable physical-layer (PHY) transmission rates as high as 300 Mbps. At such high rates, the total transmission time for a typical 1500-byte packet is very short, and the other per-packet overheads such as preambles, PHY header, inter-packet gap, and the like start to limit the achievable throughput of such systems.
One solution is to aggregate multiple application-level packets into a single aggregated packet. For example, the draft IEEE standard 802.11n describes aggregating multiple Media Access Control (MAC) Service Data Units (MSDUs) into a single Aggregate MSDU (A-MSDU). But when aggregation should occur, and how many packets should be aggregated at a time, remain open questions.
In general, in one aspect, the invention features an apparatus comprising: an input circuit to receive packets of data; an output circuit to receive the packets of data from the input circuit when aggregation of the packets of data is not enabled; a queue to receive the packets of data from the input circuit when aggregation of the packets of data is enabled; a control circuit to enable aggregation of the packets of data on occurrence of at least one of a rate of receiving the packets of data into the queue is greater than a predetermined threshold rate, and a number of the packets of data present in the output circuit is greater than a first predetermined threshold number; and an aggregation circuit to generate aggregate packets each comprising a plurality of the packets of data received into the queue, to transfer each aggregate packet to the output circuit when a number of the packets of data in the aggregate packet is greater than a second predetermined threshold number, and to transfer the aggregate packet to the output circuit when a number of the packets of data in the aggregate packet is less than, or equal to, the second predetermined threshold number, on occurrence of at least one of a predetermined interval elapses, wherein the predetermined interval begins when the queue is empty when receiving one of the packets of data, and a number of the aggregate packets present in an input circuit of a further apparatus receiving the aggregate packets from the output circuit is less than a third predetermined threshold number.
In some embodiments, the control circuit modifies the second predetermined threshold number based on at least one of durations of intervals between the packets of data received by the input circuit, and a burst size of the packets of data received by the input circuit. In some embodiments, the control circuit executes a timer to implement the predetermined interval. Some embodiments comprise the further apparatus, wherein the further apparatus comprises a further control circuit to execute a timer to implement the predetermined interval, and to generate a timeout signal when the predetermined interval elapses, wherein the aggregation circuit receives the timeout signal. In some embodiments, wherein the further control circuit modifies a duration of the predetermined interval based on at least one of the group consisting of a rate of elapsing of the predetermined interval, and durations of intervals between elapsing of the predetermined interval and receiving a subsequent one of the aggregation packets. Some embodiments comprise the further apparatus, wherein the further apparatus comprises a media access control circuit (MAC) to receive the data, and a physical-layer circuit (PHY) to transmit a signal representing the data. In some embodiments, the control circuit modifies the second predetermined threshold number based on at least one of a transmit data rate of the PHY, a maximum allowed duration of transmission of the aggregate packets, and a packet error rate reported by the further apparatus. Some embodiments comprise a wireless network device which is compliant with at least one standard selected from the group consisting of IEEE standards 802.11, 802.11a, 802.11b, 802.11g, 802.11n, 802.16, and 802.20. Some embodiments comprise a wireless network device selected from the group consisting of: a switch; a router; and a network interface controller. In some embodiments, each of the packets of data comprises a respective Media Access Control (MAC) Service Data Units (MSDUs); and wherein each of the aggregate packets comprises a respective Aggregate MSDU (A-MSDU).
In general, in one aspect, the invention features an apparatus comprising: input means for receiving packets of data; output means for receiving the packets of data from the input means when aggregation of the packets of data is not enabled; queue means for receiving the packets of data from the input means when aggregation of the packets of data is enabled; control means for enabling aggregation of the packets of data on occurrence of at least one of a rate of receiving the packets of data into the queue means is greater than a predetermined threshold rate, and a number of the packets of data present in the output means is greater than a first predetermined threshold number; and aggregation means for generating aggregate packets each comprising a plurality of the packets of data received into the queue means, transferring each aggregate packet to the output means when a number of the packets of data in the aggregate packet is greater than a second predetermined threshold number, and transferring the aggregate packet to the output means when a number of the packets of data in the aggregate packet is less than, or equal to, the second predetermined threshold number, on occurrence of at least one of a predetermined interval elapses, wherein the predetermined interval begins when the queue means is empty when receiving one of the packets of data, and a number of the aggregate packets present in an input circuit of a further apparatus receiving the aggregate packets from the output means is less than a third predetermined threshold number.
In some embodiments, the control means modifies the second predetermined threshold number based on at least one of durations of intervals between the packets of data received by the input means, and a burst size of the packets of data received by the input means. In some embodiments, the control means executes a timer to implement the predetermined interval. Some embodiments comprise the further apparatus, wherein the further apparatus comprises further control means for executing a timer to implement the predetermined interval, and generating a timeout signal when the predetermined interval elapses, wherein the aggregation means receives the timeout signal. In some embodiments, the further control means modifies a duration of the predetermined interval based on at least one of the group consisting of a rate of elapsing of the predetermined interval, and durations of intervals between elapsing of the predetermined interval and receiving a subsequent one of the aggregation packets. Some embodiments comprise the further apparatus, wherein the further apparatus comprises a media access control (MAC) means for receiving the data, and a physical-layer (PHY) means for transmitting a signal representing the data. In some embodiments, the control means modifies the second predetermined threshold number based on at least one of a transmit data rate of the PHY means, a maximum allowed duration of transmission of the aggregate packets, and a packet error rate reported by the further apparatus. Some embodiments comprise a wireless network device which is compliant with at least one standard selected from the group consisting of IEEE standards 802.11, 802.11a, 802.11b, 802.11g, 802.11n, 802.16, and 802.20. Some embodiments comprise a wireless network device according to claim 16 and selected from the group consisting of: a switch; a router; and a network interface controller. In some embodiments, each of the packets of data comprises a respective Media Access Control (MAC) Service Data Units (MSDUs); and wherein each of the aggregate packets comprises a respective Aggregate MSDU (A-MSDU).
In general, in one aspect, the invention features a method comprising: receiving packets of data; transferring the packets of data to an output circuit when aggregation of the packets of data is not enabled; transferring the packets of data to a queue when aggregation of the packets of data is enabled; enabling aggregation of the packets of data on occurrence of at least one of a rate of receiving the packets of data into the queue is greater than a predetermined threshold rate, and a number of the packets of data present in the output circuit is greater than a first predetermined threshold number; and generating aggregate packets each comprising a plurality of the packets of data received into the queue, transferring each aggregate packet to the output circuit when a number of the packets of data in the aggregate packet is greater than a second predetermined threshold number, and transferring the aggregate packet to the output circuit when a number of the packets of data in the aggregate packet is less than, or equal to, the second predetermined threshold number, on occurrence of at least one of a predetermined interval elapses, wherein the predetermined interval begins when the queue is empty when receiving one of the packets of data, and a number of the aggregate packets present in a device receiving the aggregate packets from the output circuit is less than a third predetermined threshold number.
Some embodiments comprise modifying the second predetermined threshold number based on at least one of durations of intervals between the packets of data received by the input circuit, and a burst size of the received packets of data. Some embodiments comprise timing the predetermined interval. In some embodiments, the device times the predetermined interval, and generates a timeout signal when the predetermined interval elapses. Some embodiments comprise modifying a duration of the predetermined interval based on at least one of the group consisting of a rate of elapsing of the predetermined interval, and durations of intervals between elapsing of the predetermined interval and receiving a subsequent one of the aggregation packets at the device. Some embodiments comprise transmitting a signal representing the data. Some embodiments comprise modifying the second predetermined threshold number based on at least one of a transmit data rate of the signal representing the data, a maximum allowed duration of transmission of the aggregate packets, and a packet error rate reported by a receiver of the data. In some embodiments, the method is compliant with at least one standard selected from the group consisting of IEEE standards 802.11, 802.11a, 802.11b, 802.11g, 802.11n, 802.16, and 802.20. In some embodiments, each of the packets of data comprises a respective Media Access Control (MAC) Service Data Units (MSDUs); and wherein each of the aggregate packets comprises a respective Aggregate MSDU (A-MSDU).
In general, in one aspect, the invention features a computer program comprising: causing received packets of data to be transferred to an output circuit when aggregation of the packets of data is not enabled; causing the received packets of data to be transferred to a queue when aggregation of the packets of data is enabled; enabling aggregation of the packets of data on occurrence of at least one of a rate of receiving the packets of data into the queue is greater than a predetermined threshold rate, and a number of the packets of data present in the output circuit is greater than a first predetermined threshold number; and causing aggregate packets to be generated, each aggregate packet comprising a plurality of the packets of data received into the queue, causing each aggregate packet to be transferred to the output circuit when a number of the packets of data in the aggregate packet is greater than a second predetermined threshold number, and causing the aggregate packet to be transferred to the output circuit when a number of the packets of data in the aggregate packet is less than, or equal to, the second predetermined threshold number, on occurrence of at least one of a predetermined interval elapses, wherein the predetermined interval begins when the queue is empty when receiving one of the packets of data, and a number of the aggregate packets present in a device receiving the aggregate packets from the output circuit is less than a third predetermined threshold number.
Some embodiments comprise modifying the second predetermined threshold number based on at least one of durations of intervals between the packets of data received by the input circuit, and a burst size of the received packets of data. Some embodiments comprise timing the predetermined interval. In some embodiments, the device times the predetermined interval, and generates a timeout signal when the predetermined interval elapses. Some embodiments comprise modifying a duration of the predetermined interval based on at least one of the group consisting of a rate of elapsing of the predetermined interval, and durations of intervals between elapsing of the predetermined interval and receiving a subsequent one of the aggregation packets at the device. Some embodiments comprise causing a signal representing the data to be transmitted. Some embodiments comprise modifying the second predetermined threshold number based on at least one of a transmit data rate of the signal representing the data, a maximum allowed duration of transmission of the aggregate packets, and a packet error rate reported by a receiver of the data. In some embodiments, each of the packets of data comprises a respective Media Access Control (MAC) Service Data Units (MSDUs); and wherein each of the aggregate packets comprises a respective Aggregate MSDU (A-MSDU).
The details of one or more implementations are set forth in the accompanying drawings and the description below. Other features will be apparent from the description and drawings, and from the claims.
The leading digit(s) of each reference numeral used in this specification indicates the number of the drawing in which the reference numeral first appears.
Embodiments of the present invention provide packet aggregation according to several techniques, which can be used alone or in combination.
Wireless network device 102 comprises a host 106 and a device 108. Host 106 comprises a control circuit 110, an aggregation circuit 112, an output circuit 114, an input circuit 116, and a queue 118. Device 108 comprises a control circuit 120, an input circuit 122, a WLAN media access controller (MAC) 124, and a WLAN physical-layer device (PHY) 126. Output circuit 114 of host 106 and input circuit 122 of device 108 communicate over a data channel 128. Control circuits 110 and 120 communicate over a control channel 130.
Host 106 can be implemented, for example, as a general-purpose computer, with control circuit 110 implemented as a general-purpose processor executing a non-real-time operating system. Device 108 is preferably implemented as a system-on-a-chip with control circuit 120 implemented as a special-purpose processor executing a real-time operating system. Data channel 128 and control channel 130 can be implemented as one or more interfaces according to a standard such as Peripheral Component Interconnect (PCI), PCI Express, Mini PCI, PC card, Universal Serial Bus, Firewire, and the like. Wireless network device 102 can be implemented as a switch, router, network interface controller (NIC), and the like.
Referring to
Control circuit 110 of host 106 determines whether the MSDU should be aggregated as an A-MSDU with other MSDUs prior to transfer to device 108, preferably by monitoring one or more conditions, such as characteristics of the MSDU traffic. One such condition is the rate at which the MSDUs are received by input circuit 116. Preferably the receive rate is determined by defining a temporal evaluation window having a fixed duration. The evaluation window should be long enough to discount short traffic bursts and short enough to enable aggregation quickly after MSDU traffic begins to arrive. For example, the duration of the evaluation window can be on the order of one second.
When the MSDU receive rate exceeds a predetermined receive rate threshold, control circuit 110 enables MSDU aggregation. The receive rate threshold should be large enough that aggregation is not enabled for typical periodic traffic scenarios. For example, the receive rate threshold can be on the order of one thousand MSDUs per second.
Another condition control circuit 110 can monitor to determine whether MSDUs should be aggregated is the occupancy level of output circuit 114. Output circuit 114 preferably comprises a queue to store MSDUs and A-MSDUs for transfer to device 108, preferably under the control of control circuit 120 of device 108. When a number of the MSDUs present in output circuit 114 is greater than a predetermined threshold amount, control circuit 110 enables MSDU aggregation. In various embodiments control circuit 110 uses one or both of these conditions (receive rate and output circuit 114 occupancy level) to determine when aggregation should be enabled. In some embodiments, to enable MSDU aggregation, control circuit 110 asserts an aggregation enable signal over control channel 130, which is received by aggregation circuit 112 and input circuit 116.
When MSDU aggregation is not enabled (step 204), input circuit 116 simply transfers the MSDU to output circuit 114 (step 206) and returns to step 202. But when MSDU aggregation is enabled (step 204), input circuit 116 transfers the MSDU to queue 118 for aggregation. Aggregation circuit 112 adds the MSDU to the A-MSDU currently being generated (step 208), which then comprises that MSDU and zero or more other MSDUs.
As each A-MSDU is generated, aggregation circuit 112 monitors one or more conditions to determine whether aggregation is complete for that A-MSDU (step 210). If one or more further MSDUs are to be aggregated into the current A-MSDU, process 200 resumes at step 202. But if aggregation is done, aggregation circuit 112 transfers the A-MSDU to output circuit 114 (step 212).
One condition aggregation circuit 112 can monitor is the size of the A-MSDU being generated relative to a maximum allowed size for the A-MSDU. The maximum allowed size can be predetermined, but is preferably negotiated with the recipient of the A-MSDU. For example, the maximum allowed size for the A-MSDU can be on the order of 8 kB or 4 kB. When traffic flows at a steady rate, this is sufficient to ensure that A-MSDUs are transferred in a timely manner. However, this is rarely the case. Any interruption in traffic flow can cause the A-MSDU being generated to stay in queue 118 long enough to increase latency and possibly reduce throughput. Aggregation circuit 112 therefore preferably monitors one or more other conditions to determine when to transfer the A-MSDU being generated to output circuit 114 for transfer to device 108.
Another condition aggregation circuit 112 can monitor is an aggregation timeout, which occurs when a maximum interval allowed for generation of an A-MSDU elapses. The aggregation timeout interval preferably begins when queue 118 is empty when receiving a MSDU. When the aggregation timeout interval elapses, aggregation circuit 112 transfers the A-MSDU being generated to output circuit 114 for transfer to device 108. The aggregation timeout interval can be fixed in advance based on empirical analysis, or can be adaptively determined during run-time based on traffic conditions.
In some embodiments the timer that implements the aggregation timeout interval is implemented in host 106. However, when control circuit 110 of host 106 is implemented as a processor executing a non-real-time operating system, timer granularity can be on the order of 10 milliseconds, which is too coarse for high-speed communications. Therefore the timer is preferably implemented by control circuit 120 of device 108, which preferably operates in real time, thereby permitting aggregation timeout intervals on the order of 500 microseconds. Control circuit 120 preferably asserts a timeout signal at the end of each aggregation timeout interval. The timeout signal is preferably received by aggregation circuit 112 of host 106 over control channel 130.
In some embodiments, control circuit 120 of device 108 modifies the duration of the aggregation timeout interval during run-time based on one or more conditions. One such condition is the timeout rate, which is the rate at which the aggregation timeout interval elapses. Another such condition is the gap (that is, the duration of the interval) between an aggregation interval timeout and the time at which input circuit 122 of device 108 receives the next A-MSDU. If the timeout rate is high, and the gap is small, then the aggregation timeout interval is preferably increased until the timeout rate becomes very low. One possible implementation is given by the code listed below.
Initialize timeout to a low value
While (1)
{
}
Another condition that aggregation circuit 112 can monitor to determine when to transfer the A-MSDU being generated to output circuit 114 is the number of aggregate packets present in input circuit 122 of device 108. Preferably input circuit 122 comprises a queue which device 108 fills by transferring MSDUs or A-MSDUs (depending on whether aggregation is enabled) from output circuit 114 of host 106. When the number of A-MSDUs present in input circuit 122 falls below a predetermined threshold, control circuit 120 of device 108 preferably asserts a “hungry” signal over control channel 130. In response, aggregation circuit 112 can flush queue 118 by transferring the A-MSDU therein to output circuit 114, where the A-MSDU becomes available to device 108.
In some embodiments of the present invention, control circuit 110 of host 106 modifies the maximum allowed size for the A-MSDU based on one or more conditions during run time in order to increase performance. One such condition is a burst size of the MSDUs received by input circuit 116 of host 106. For example, if the current maximum allowed size for an A-MSDU is 5 MSDUs, but the MSDUs are arriving in bursts of 2 or 3 separated by substantial intervals, the result can be many timeouts and an increase in latency. In such cases, reducing the maximum allowed size for the A-MSDU to 2 or 3 MSDUs can reduce latency. MSDU burst size is preferably monitored by measuring the inter-packet gaps between the MSDUs.
Another condition on which control circuit 110 of host 106 can base the maximum allowed size for an A-MSDU is the transmit data rate of WLAN PHY 126 of device 108, which is preferably reported to control circuit 110 over control channel 130. The instantaneous supported PHY rate in an 802.11 wireless system depends on the distance between the communicating devices and other factors influencing the radio channel. A PHY rate adaptation algorithm adapts continuously monitors these conditions to select the optimal PHY transmit rate, as is well-known in the relevant arts.
Another condition on which control circuit 110 of host 106 can base the maximum allowed size for the A-MSDU is the maximum allowed duration of transmission of an A-MSDU, which can be set to comply with applicable standards, to increase performance, and the like. For example, control circuit 110 can select the maximum allowed size for the A-MSDU as the product of the maximum allowed duration of transmission of an A-MSDU and the current PHY transmit rate.
Another condition on which control circuit 110 of host 106 can base the maximum allowed size for the A-MSDU is the packet error rate reported by a device receiving the data. The packet error rate can be used to limit the maximum allowed size for an A-MSDU, the maximum allowed duration of transmission of an A-MSDU, and the like.
The HDTV 312 may communicate with mass data storage 315 that stores data in a nonvolatile manner such as optical and/or magnetic storage devices. The HDD may be a mini HDD that includes one or more platters having a diameter that is smaller than approximately 1.8″. The HDTV 312 may be connected to memory 316 such as RAM, ROM, low latency nonvolatile memory such as flash memory and/or other suitable electronic data storage. The HDTV 312 also may support connections with a WLAN via a WLAN network interface 317.
Referring now to
The present invention may also be implemented in other control systems 322 of the vehicle 318. The control system 322 may likewise receive signals from input sensors 323 and/or output control signals to one or more output devices 324. In some implementations, the control system 322 may be part of an anti-lock braking system (ABS), a navigation system, a telematics system, a vehicle telematics system, a lane departure system, an adaptive cruise control system, a vehicle entertainment system such as a stereo, DVD, compact disc and the like. Still other implementations are contemplated.
The powertrain control system 319 may communicate with mass data storage 325 that stores data in a nonvolatile manner. The mass data storage 325 may include optical and/or magnetic storage devices for example hard disk drives HDD and/or DVDs. The HDD may be a mini HDD that includes one or more platters having a diameter that is smaller than approximately 1.8″. The powertrain control system 319 may be connected to memory 326 such as RAM, ROM, low latency nonvolatile memory such as flash memory and/or other suitable electronic data storage. The powertrain control system 319 also may support connections with a WLAN via a WLAN network interface 327. The control system 322 may also include mass data storage, memory and/or a WLAN interface (all not shown).
Referring now to
The cellular phone 328 may communicate with mass data storage 335 that stores data in a nonvolatile manner such as optical and/or magnetic storage devices for example hard disk drives HDD and/or DVDs. The HDD may be a mini HDD that includes one or more platters having a diameter that is smaller than approximately 1.8″. The cellular phone 328 may be connected to memory 336 such as RAM, ROM, low latency nonvolatile memory such as flash memory and/or other suitable electronic data storage. The cellular phone 328 also may support connections with a WLAN via a WLAN network interface 337.
Referring now to
The set top box 338 may communicate with mass data storage 343 that stores data in a nonvolatile manner. The mass data storage 343 may include optical and/or magnetic storage devices for example hard disk drives HDD and/or DVDs. The HDD may be a mini HDD that includes one or more platters having a diameter that is smaller than approximately 1.8″. The set top box 338 may be connected to memory 342 such as RAM, ROM, low latency nonvolatile memory such as flash memory and/or other suitable electronic data storage. The set top box 338 also may support connections with a WLAN via a WLAN network interface 343.
Referring now to
The media player 344 may communicate with mass data storage 349 that stores data such as compressed audio and/or video content in a nonvolatile manner. In some implementations, the compressed audio files include files that are compliant with MP3 format or other suitable compressed audio and/or video formats. The mass data storage may include optical and/or magnetic storage devices for example hard disk drives HDD and/or DVDs. The HDD may be a mini HDD that includes one or more platters having a diameter that is smaller than approximately 1.8″. The media player 344 may be connected to memory 350 such as RAM, ROM, low latency nonvolatile memory such as flash memory and/or other suitable electronic data storage. The media player 344 also may support connections with a WLAN via a WLAN network interface 351. Still other implementations in addition to those described above are contemplated.
Embodiments of the invention can be implemented in digital electronic circuitry, or in computer hardware, firmware, software, or in combinations of them. Apparatus of the invention can be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a programmable processor; and method steps of the invention can be performed by a programmable processor executing a program of instructions to perform functions of the invention by operating on input data and generating output. The invention can be implemented advantageously in one or more computer programs that are executable on a programmable system including at least one programmable processor coupled to receive data and instructions from, and to transmit data and instructions to, a data storage system, at least one input device, and at least one output device. Each computer program can be implemented in a high-level procedural or object-oriented programming language, or in assembly or machine language if desired; and in any case, the language can be a compiled or interpreted language. Suitable processors include, by way of example, both general and special purpose microprocessors. Generally, a processor will receive instructions and data from a read-only memory and/or a random access memory. Generally, a computer will include one or more mass storage devices for storing data files; such devices include magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and optical disks. Storage devices suitable for tangibly embodying computer program instructions and data include all forms of non-volatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM disks. Any of the foregoing can be supplemented by, or incorporated in, ASICs (application-specific integrated circuits).
A number of implementations of the invention have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. Accordingly, other implementations are within the scope of the following claims.
This application claims the benefit of U.S. Provisional Patent Application Ser. No. 60/761,904, filed Jan. 25, 2006, and U.S. Provisional Patent Application Ser. No. 60/801,844, filed May 19, 2006, the disclosures thereof incorporated by reference herein in their entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4901277 | Soloway et al. | Feb 1990 | A |
| 5799305 | Bortvedt et al. | Aug 1998 | A |
| 6870812 | Kloth et al. | Mar 2005 | B1 |
| 7523188 | Teraslinna | Apr 2009 | B2 |
| 20040064582 | Raghunath et al. | Apr 2004 | A1 |
| 20040264396 | Ginzburg et al. | Dec 2004 | A1 |
| 20070014268 | Kim et al. | Jan 2007 | A1 |
| 20080049654 | Otal et al. | Feb 2008 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 60761904 | Jan 2006 | US | |
| 60801844 | May 2006 | US |
