The present invention relates to the field of digital transmission, and more particularly to the staggercasting of streams of packetized data.
Many transmission systems, such as mobile wireless broadcast systems are subject to a difficult physical channel. In addition to fading and Doppler effects, the signal may be entirely obstructed by buildings, trees, poles, and overpasses, among other obstructions. This can easily cause signal loss for a period of a second or more. Staggercasting offers a method of protection against signal loss by transmitting a second, redundant stream which is time-shifted with respect to the primary stream. This allows a receiver to pre-buffer packets of the secondary stream to replace packets of the primary stream lost in transmission.
Techniques exist that allow a network stream to be coded so that it may carry Type of Service (TOS) information. In an Internet Protocol (IP) network, for example, this is accomplished by setting the TOS bits in the headers of IP packets. This additional information is passed on to other network devices downstream in the transmission path and can be used by those devices to determine the optimal path for the IP packet to reach its destination.
In most cases, the TOS information is used for network reliability, such as by routing packets differently. Doing so, however, will not necessarily have an impact on service if the number of network devices is minimal. For example, using the TOS bits will not impact any service that has only one router in its network since no other paths would be available.
In accordance with the principles of the invention, a staggercasting method and apparatus manipulates Type of Service (TOS) information in staggercast packets in accordance with bandwidth conditions and/or packet importance. Downstream network devices can use the TOS information to handle packets accordingly. In an exemplary embodiment, a downstream network multiplexer can use the TOS information in determining the allocation of bandwidth to a primary stream of packets and a secondary or staggered stream of packets that are copies of the packets in the primary stream.
In a further exemplary embodiment, the TOS information of packets is manipulated in accordance with other information in the packets, such as Network Abstraction Layer (NAL) information. The staggered stream copies of more important packets, as indicated by their NAL information, will have their TOS information set so that a network multiplexer (MUX) will forward such staggered packets in addition to the primary stream packets, thereby providing redundancy and error protection for such packets.
The aforementioned and other features and aspects of the present invention are described in greater detail below.
During normal operation, the staggercast transmission from the transmitter 110 to the MUX 120 comprises two streams. One stream, the primary stream, corresponds to the original stream from the source 101 and the other stream, the secondary stream, is a redundant copy of the primary stream. Note that for the purposes of the present invention, the headers of the primary stream packets can be different from the headers of the corresponding original stream packets, and the headers of the secondary stream packets can be different from the headers of the corresponding primary stream packets. Thus a primary stream packet may contain a payload that is the same as the payload of the corresponding original stream packet and a secondary stream packet may contain a payload that is the same as the payload of the corresponding primary stream packet.
The secondary stream is time-shifted or staggered relative to the primary stream, in which it will be referred to as a “staggered” stream. For example, the primary stream may be delayed with respect to the staggered stream. This allows the receiver 151 to pre-buffer packets of the staggered stream so that they may replace corresponding packets in the primary stream that may have been lost or corrupted in transmission.
Note that in the arrangement shown in
Additionally, in some applications, a secondary stream as contemplated by the present invention may already be available, as opposed to generating it with a stagger transmitter, as shown. For example, a specification may define multiple profiles for the transmission of content to mobile devices. These profiles can vary from very low resolution/frame rate/bitrate streams for viewing on simple mobile phones with small screens to higher resolution/frame rate/bitrate streams for mobile devices better capable of presenting video (having a larger screen, more powerful decoder, etc.) A system may simultaneously transmit a given video program in both profiles on the same channel so that users of either type of device may receive video that is optimal for their respective devices.
The MUX 120 receives the primary and secondary streams from the transmitter 110 and switches them through to its output for serial transmission via the network 150 to the receiver 151. Typically, the MUX 120 will also receive input streams from other sources (not shown) which it will selectively switch through to its output along with the streams from the transmitter 110. The bandwidth requirements of the various sources served by the MUX 120 will vary and may exceed the available bandwidth at the output of the MUX. When there is sufficient available bandwidth, the MUX 120 will be able switch both streams from the stagger transmitter 110 through to its output. In cases where the available channel bandwidth is insufficient, however, the MUX 120 may not be able to send both streams in their entirety. The MUX 120 could drop some packets in either or both streams due to this constraint. The determination by the MUX 120 of which packets to drop can be done in accordance with the Type of Service (TOS) information contained in the packet headers. The TOS information in the packet headers can be set by the stagger transmitter 110.
As shown in
The D bit (bit 3) represents a request for low delay, the T bit (bit 4) a request for high throughput, and the R bit (bit 5) a request for high reliability.
The last two bits (bits 6 and 7) are reserved for Extension Congestion Notification (ECN). This is an extension to the Internet Protocol which allows end-to-end notification of network congestion without dropping packets.
In addition, or alternatively. Differentiated Services (or DiffServ) fields, as defined by RFC2474, can be used for TOS purposes. DiffServ fields contain DiffServ Code Points (DSCP) bits, an amalgamation of the previously defined TOS precedence bits and new DiffServ bits. This information is contained in a six-bit field that can be used to specify the priority of an IP packet.
It should be noted that the aforementioned protocols are presented by way of illustration and not limitation of the present invention. For simplicity, any “type of service” information, such as TOS or DSCP bits (or that of any other “type of service” standard) is referred to herein generically as TOS information.
Preferably, the stagger transmitter 110 sets the TOS information in the headers of individual packets in the secondary stream, as well as in the primary stream. The stagger transmitter 110 sets the TOS information of packets in accordance with the packets' relative importance.
The stagger transmitter 110 sets the TOS information to prioritize packets from the two streams differently. In an exemplary embodiment, the stagger transmitter 110 manipulates the TOS information so that packets in the primary stream will always get through a downstream network device, such as the MUX 120, and so that none, some or all packets in the secondary stream will get through. This can be done, for example, with the use of the three precedence bits in the TOS byte, as shown in
There may be cases, however, where it is desirable for certain packets or groups of packets (or at least their payloads) in the primary stream to have duplicates thereof sent in the secondary stream. Such would be the case, for example, where due to the importance of the packets it is desirable to maintain a level of error correction for such packets. In such a case, the stagger transmitter 110 sets the TOS information equal for both streams so that the MUX 120 will not choose one stream over the other, but rather, will forward them both.
It is also possible to provide varying degrees of error protection by setting the TOS information of selected packets in the secondary stream to various levels so that the MUX 120 will pass them on to the output stream under different bandwidth conditions. For example, if the stagger transmitter 110 sets the priority level of a secondary stream packet to the highest level (e.g., 7), it will, or most likely will, be forwarded by the MUX 120 under all bandwidth conditions, and if it set to the lowest level (e.g., 0) it will most likely be forwarded by the MUX only when there is sufficient available bandwidth. If the stagger transmitter 110 sets the priority level of a secondary stream packet to an intermediate level (e.g., 4), however, there will be some bandwidth conditions during which the packet will be forwarded and others in which it will not, with the likelihood of it being forwarded increasing as bandwidth availability increases. By transmitting some of the secondary stream packets along with the primary stream packets, a level of error protection is maintained, with the level of protection increasing as the number of secondary stream packets transmitted increases.
In a video implementation, the TOS information of a packet can be set in accordance with the type of the video stream packet. For example, as shown in
A stagger transmitter that is NAL-aware, can read the information in the NAL header of a packet and determine the importance of a packet. The NAL-aware stagger transmitter can then set the TOS information of the packet accordingly. In addition, the stagger transmitter can also set the TOS information of a secondary stream copy of the packet accordingly.
For example, because an I-Frame is important to a video decoder for decoding video, it may be desirable, even in a condition of low bandwidth availability, to provide the decoder with a staggered copy of the I-frame. To accomplish this, the stagger transmitter 110 sets the TOS information for secondary stream copies of such packets to a priority value as high as that of the primary stream packets so that the MUX 120 will pass those packets on through to its output. As such, the secondary stream is allocated some of the available bandwidth for transmission from the MUX 120. Other, less important types of frame data can receive a lower precedence or DSCP priority standing from the stagger transmitter 110, so that the MUX 120 could determine to drop some or all of such packets if need be.
Additionally, there may be circumstances in which it is desirable or necessary to ensure the transmission through the MUX 120 of a sequence of multiple packets in the staggered stream. For example, an I-Frame may be comprised of more than one packet. The stagger transmitter 110 sets the TOS information in packets containing parts of an I-Frame to a high priority level in order to ensure that those packets are passed on by the MUX 120 for transmission. This can apply to packets in both the primary and secondary streams so as to ensure that the entire I-Frame as well as a staggered copy thereof are passed on by the MUX 120.
In the high bandwidth scenario of
In the low bandwidth scenario of
If conditions are such that the available bandwidth can only allow one stream, the stagger transmitter 110 sets the TOS precedence or DSCP bits of the staggered stream in such a way that only the primary stream gets through the MUX 120. In such a case, the stagger transmitter 110 gives the staggered stream packets a TOS precedence value of 0 or equivalent DSCP value. With no staggered stream packets, however, there would be no protection against errors in the channel.
As shown in
Note that while a video implementation has been described above for illustration of the present invention the present invention can be applied to a variety of packetized streams with TOS information, including, for example, audio and file-transfer applications. Thus, for example in an audio application, the stagger transmitter can parse network data contained in an audio stream and use that to manipulate the TOS information in packets of the audio stream. Moreover, although an embodiment has been described in which NAL information is used to determine packet importance in a video implementation, for other codec applications analogous codec-related header information will be used for this purpose.
It is understood that the above-described embodiments are illustrative of only a few of the possible specific embodiments which can represent applications of the invention. Numerous and varied other arrangements can be made by those skilled in the art without departing from the spirit and scope of the invention.
This application claims the benefit of U.S. Provisional Application No. 61/132,315, filed Jun. 17, 2008.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US09/00512 | 1/27/2009 | WO | 00 | 12/16/2010 |
Number | Date | Country | |
---|---|---|---|
Parent | 61132315 | Jun 2008 | US |
Child | 12737193 | US |