Apparatus and method for applying unequal error protection during wireless video transmission

Abstract

A method for wireless transmission of video including component data bytes representing components of a video block includes applying transmission bit coding adapted to provide relatively greater error protection to wireless transmission bits of a wireless transmission frame corresponding to bits of the component data byte which are more visually significant than to those transmission bits of the transmission frame corresponding to bits of the component data byte which are less visually significant.

Description

FIELD OF THE INVENTION

The invention relates to the transmission and reception of video over a wireless link. More specifically, the invention relates to the transmission and reception of high-definition video over a wireless link during varying link condition, by applying an unequal error protection to the video data.

DISCUSSION OF THE PRIOR ART

In many houses, television and/or video signals are received through cable or satellite links at a set-top box at a fixed point in the house. In many cases, it is desired to place a screen at a point a distance from the set-top box by a few meters. This trend is becoming more common as flat-screen using plasma or liquid crystal display (LCD) televisions are hung on a wall. Connection of the screen to the set-top box through cables is generally undesired for aesthetic reasons and/or installation convenience. Thus, wireless transmission of the video signals from the set-top box to the screen is preferred. Similarly, it may be desired to place a computer, game controller, VCR, DVD, or other video source that generates images to be displayed on a screen a distance from the screen.

Generally, the data are received at the set-top box compressed in accordance, for example, with the motion picture expert group (MPEG) format and are decompressed by the set-top box to a high quality raw video signal. The raw video signal may be in an analog format or a digital format, such as the digital video interface (DVI) format or the high definition multimedia interface (HDMI) format. These digital formats generally have a high definition television (HDTV) data rate of up to about 1.5 Giga bits per second (Gbps).

To transmit a video image having such high bit rates it is necessary either to use sophisticated techniques for sending essentially uncompressed high-definition video or use a variety of compression technologies made available through standard or non-standard specification. A technique for sending essentially uncompressed high-definition video is described in detail in U.S. patent application Ser. No. 11/551,641, entitled Apparatus and Method for Uncompressed, Wireless Transmission of Video, assigned to a common assignee and incorporated herein in its entirety by reference thereto. Compression technologies include a variety of MPEG standards such as MPEG2, MPEG4, JPEG2000, wavelet technology, and the like. According to these technologies a transform is performed, for example a discrete cosine transform (DCT), resulting in a various coefficients representing the transformed image.

Wireless conditions may change over time, becoming worse or better, depending on a plurality of reasons. The changing conditions may result in a degradation of the video signal as conditions worsen. Regardless of the methods used above, it is well known that the coefficients generated by the variety of methods used have a varying degree of importance. For example, the coefficients representing lower spatial frequencies are more important for the creation of the reconstructed video at the receiver end than the coefficients representing the high spatial frequencies. Therefore, to ensure quality reception of wireless transmission of video, and, in particular, high-definition video it is important to ensure that as many of the lower-frequency coefficients as possible are received correctly.

In view of a variety of limitations of the prior art, it would be advantageous to provide a solution that enables reliable wireless transmission of high-definition video giving priority to the correct reception of those components of the transmission representing the higher importance components of the video image being transmitted.

SUMMARY OF THE PRESENT INVENTION

There is provided, in accordance with a preferred embodiment of the present invention a wireless transmitter for wireless transmission of video including component data bytes representing components of a video block. The transmitter includes a transmission bit coding unit adapted to apply relatively greater error protection to wireless transmission bits of a wireless transmission frame corresponding to bits of the component data byte which are more visually significant than to transmission bits of the wireless transmission frame corresponding to bits of the component data byte which are less visually significant.

Moreover, in accordance with a preferred embodiment of the present invention, the wireless transmitter includes a color converter for converting an uncompressed video signal to uncompressed video block components; and an antenna for transmitting over a wireless link.

Further, in accordance with a preferred embodiment of the present invention, the wireless transmitter includes a luminance component and chrominance components.

Still further, in accordance with a preferred embodiment of the present invention the antenna includes a multiple-input multiple-output (MIMO) antenna.

Moreover, in accordance with a preferred embodiment of the present invention, the wireless transmitter can be further adapted to perform a de-correlating transform-selected from the group consisting of a discrete cosine transform (DCT) and a wavelet transform.

Further, in accordance with a preferred embodiment of the present invention, the relatively greater error protection enables error recovery of a larger number of corrupted bits than is enabled by relatively lower error protection.

Moreover, in accordance with a preferred embodiment of the present invention, the relatively lower error protection is provided to transmission bits corresponding to lower order bits of a component data byte than is provided to transmission bits corresponding to higher order bits of the component data byte.

Additionally in accordance with a preferred embodiment of the present invention, the relatively higher error protection is provided to transmission bits corresponding to higher order bits of a component data byte than is provided to transmission bits corresponding to lower order bits of the component data byte.

Further, in accordance with a preferred embodiment of the present invention, the relatively lower error protection is provided to bits associated with component data bytes representing relatively higher spatial frequencies of the video block than to bits associated with component data bytes representing relatively lower spatial frequencies components of the video block.

There is also provided, in accordance with a preferred embodiment of the present invention, a method for wireless transmission of video including component data bytes representing components of a video block. The method includes applying transmission bit coding adapted to provide relatively greater error protection to wireless transmission bits of a wireless transmission frame corresponding to bits of the component data byte which are more visually significant than to those transmission bits of the transmission frame corresponding to bits of the component data byte which are less visually significant.

Moreover, in accordance with a preferred embodiment of the present invention, the method also includes converting an input uncompressed video signal to uncompressed video component blocks.

Additionally, in accordance with a preferred embodiment of the present invention, the method also includes performing a de-correlating transform selected from the group consisting of a discrete cosine transform (DCT) and a wavelet transform.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a transmitter configured to apply unequal error protection during the transmission of video according to the invention;

FIG. 2 is a flowchart showing a scheme for unequal error protection during wireless transmission of video according to the invention;

FIG. 3 is a block diagram of a receiver configured to receive transmissions of an unequal error protection scheme according to the invention;

FIG. 4 is a flowchart showing a scheme for unequal error protection during wireless reception of a video according to the invention; and

FIG. 5 is a table depicting a UEP scheme in accordance with the invention.

DETAILED DESCRIPTION OF EMBODIMENTS

Wireless transmission of high-definition video, whether essentially uncompressed or compressed, is prone to errors in the reception due to the conditions of the wireless link. To ensure video quality during changing link conditions it is important that those portions of the video that represent the more important components of the video signal, such as the lower spatial frequencies or most significant bits, are correctly received at the receiver. Bandwidth limitations of the wireless link limit the amount of data that can be sent over the link. Hence, using a high level error recovery scheme for all the information is not feasible. Accordingly, an unequally error protection is implemented that provides a higher level of error protection to the most important elements in the transmission, while affording loss error protection to the other elements in the transmission.

Video information may be considered to be divided into layers, where data each layer has different importance and certain layers contribute more to the quality of the image than others. Typically, video images pass a transform, such as a discrete cosine transform (DCT), wavelet, or others. This results in a plurality of coefficients where there are coefficients that are more important and other coefficients which are less important. In a DCT, for example, coefficients of the lower frequencies are most important, while in a wavelet transform the stronger wavelet coefficients are more important. In addition, in each representation the most significant bits (MSB) are more important than the least significant bits (LSB). When using, for example, the JPEG2000 compression, the layers are defined by the standard.

In accordance with the invention, the bits in these layers go through unequal error protection (UEP). UEP means that the more important layers are protected more than the less important layers. Better protection may be achieved by the use of a stronger error correction code (ECC), i.e., a code that is particularly resilient and that can correct errors even if all or most of the bits are incorrectly received. Another way of providing a higher degree of protection is by using an appropriate modulation scheme. In one embodiment of the invention, the outcome of the coding may be combined with an appropriate modulation. Less important layers are sent with lesser degrees of protection. This can be, for example, a capability of correcting up to a predefined number of bits, where a more important layer is able to recover with more bits in error than in the case of a less important layer. The least important layers may be sent with a simple error detection scheme and, upon detection of an error at the receiver side the layer is not-used. The modulated signal is sent over the wireless channel. Due to fading the level of noise varies. Hence, in this case of weak fading, all the data is transferred because the noise does not impact even the low importance layers. In case of stronger fading in the wireless channel, only the important layers are actually used because their better error protection allows for their reconstruction even when the channel conditions are significantly less than acceptable.

The techniques disclosed herein may also be implemented with a video system such as that disclosed in U.S. patent application Ser. No. 11/551,641 entitled Apparatus and Method for Uncompressed, Wireless Transmission of Video, assigned to a common assignee, and that is incorporated herein by this reference thereto. In accordance with the invention, the most significant layers are referred to as the digital or coarse portion of the video signal. Less significant layers are referred to as the analog or fine portion of the video signal. While the analog transmission naturally provides a version of UEP, the apparatus and method disclosed herein provide further capabilities to such UEP.

FIG. 1 shows an exemplary and non-limiting block diagram of a transmitter 100 configured for UEP transmission. A video signal may be received, for example, with RGB components that are transformed to Y, Cr, and Cb components by a color converter 110. A de-correlating transform, for example a discrete cosine transform (DCT), is performed as a transform unit 120 to generate certain coefficients respective of the video signal. The data stream received has various components and bits that have different levels of importance. For example, components receptive of a lower frequency of the video signal have generally a higher importance that the components having higher frequencies. Within a number represented by a plurality of bits, the most significant bits (MSBs) are of higher importance than the least significant bits (LSBs). Because a wireless channel is prone to certain transmission errors, it would be advantageous to send the data stream in a fashion that allows a receiver to perform an error correction that results in a complete recovery from the errors introduced by, for example, the channel conditions. The performance of full error correction requires the use of additional bits which may be more than can be used to send the video signal over the channel. Therefore, in accordance with the invention, an unequal error protection (UEP) coding unit 130 is used. The UEP coding unit 130 receives from the transform unit 120 an indication respective of the importance of the components and the bits that allows for a decision to be made concerning how to perform the coding.

The resulting signal is then modulated by a modulator 140 and transmitted by an antenna 150, which may be a multiple-input multiple-output (MIMC) antenna.

FIG. 5 is a table of exemplary types of UEP. The first column refers to the importance level of the components and bits, the second column refers to the type of UEP used. For the most important components and bits, a UEP that enables full error correction is used. Such an error correction requires a relatively large number of redundancy bits. When an error in the group of bits received is detected, the error correction mechanism is capable of correcting a large number of errors in the received data. For less important bits a partial error correction scheme may be introduced, allowing for the detection and correction of a limited number of bits received in error. In such cases, at times the error is both detected and corrected, while in others only a detection is made but no correction is possible. The number of errors to be corrected impacts the amount of data required to perform a correction. The higher the number of bits, the more additional data are needed. The least important components and bits may have a UEP that only provides a detection mechanisms, thereby allowing the detection of an error but without a capability actually to correct such error. In one embodiment of the invention, correction is performed by using a history buffer on the receiver side, an embodiment described in more detail in a U.S. provisional patent application entitled An Apparatus for Enhanced Wireless Transmission and Reception of Uncompressed Video, assigned to a common assignee and which is incorporated herein in its entirety by this reference thereto. A person skilled in the art would recognize that a variety of error correction and error detection mechanism may be used to satisfy the UEP requirements disclosed herein and these are within the scope of the invention.

FIG. 2 shows an exemplary flowchart 200 for the transmission of a video signal using UEP in accordance with the invention. In step S210, a video signal is received and in step S220, a de-correlating transform, such as a discrete cosine transform (DCT), is performed, resulting in a data stream. In step S230, the importance level respective of components and bits is generated. In step S240, a UEP coding is performed on the data stream using, for example, the scheme suggested with respect to FIG. 5, discussed in more detail above. However, a person skilled in the art would note that other UEP schemes may be used which are still within the scope of the invention. In step S250, the UEP data stream is sent for signal modulation for the purpose of wireless transmission.

FIG. 3 is an exemplary block diagram of a portion of a receiver 300 that is configured for UEP reception. A demodulator 310 is configured to receive a wireless signal from an antenna 330, which may be a multiple-input multiple-output (MIMO) antenna and generate a UEP data stream. A UEP decoding unit 320 is configured to generate a de-correlated video stream based on the knowledge of the UEP scheme used, for example the UEP scheme discussed with respect of FIG. 5. A person skilled in the art would recognize that a variety of error correction and error detection mechanisms may be used to satisfy the UEP requirements disclosed herein and that these are within the scope of the invention. The UEP scheme used must be consistent between the transmitter and the receiver.

FIG. 4 shows an exemplary flowchart 400 for the reception of a video signal using UEP in accordance with the invention. In step S410, a UEP data stream is received from a demodulator. In step S420, error detection and correction is performed for the purpose of handling errors in the received UEP data stream. The error detection and correction is performed in accordance with a predetermined UEP scheme, for example the UEP scheme discussed in more detail with respect to FIG. 5 above. However, a person skilled in the art would note that other UEP schemes may be used within the scope of the invention. In step S430, the de-correlated and error-corrected data stream of the video signal is reconstructed and in step S440, a video signal is generated from the reconstructed de-correlated data stream.

Although the invention is described herein with reference to several embodiments, including the preferred embodiment, one skilled in the art will readily appreciate that other applications may be substituted for those set forth herein without departing from the spirit and scope of the invention. The invention may be further implemented in hardware, software, or any combination thereof. Accordingly, the invention should only be limited by the following claims.

Claims

1. A wireless transmitter for wireless transmission of video including component data bytes representing components of a video block, said transmitter comprising: a transmission bit coding unit adapted to apply relatively greater error protection to wireless transmission bits of a wireless transmission frame corresponding to bits of the component data byte which are more visually significant than to transmission bits of the wireless transmission frame corresponding to bits of the component data byte which are less visually significant.

2. The wireless transmitter of claim 1, further comprising: a color converter for converting an uncompressed video signal to uncompressed video block components; and an antenna for transmitting over a wireless link.

3. The wireless transmitter of claim 2, wherein the components comprise a luminance component and chrominance components.

4. The wireless transmitter of claim 2, wherein the antenna comprises a multiple-input multiple-output (MIMO) antenna.

5. The wireless transmitter of claim 1 further adapted to perform a de-correlating transform selected from the group consisting of a discrete cosine transform (DCT) and a wavelet transform.

6. The wireless transmitter of claim 1, wherein relatively greater error protection enables error recovery of a larger number of corrupted bits than is enabled by relatively lower error protection.

7. The wireless transmitter of claim 1, wherein relatively lower error protection is provided to transmission bits corresponding to lower order bits of a component data byte than is provided to transmission bits corresponding to higher order bits of the component data byte.

8. The wireless transmitter of claim 1, wherein relatively higher error protection is provided to transmission bits corresponding to higher order bits of a component data byte than is provided to transmission bits corresponding to lower order bits of the component data byte.

9. The wireless transmitter of claim 1, wherein relatively lower error protection is provided to bits associated with component data bytes representing relatively higher spatial frequencies of the video block than to bits associated with component data bytes representing relatively lower spatial frequencies components of the video block.

10. A method for wireless transmission of video including component data bytes representing components of a video block, said method comprising: applying transmission bit coding adapted to provide relatively greater error protection to wireless transmission bits of a wireless transmission frame corresponding to bits of the component data byte which are more visually significant than to those transmission bits of the transmission frame corresponding to bits of the component data byte which are less visually significant.

11. The method of claim 10, further comprising the step of: converting an input uncompressed video signal to uncompressed video component blocks.

12. The method of claim 11, wherein the component block comprise a luminance component and chrominance components.

13. The method of claim 10 further comprising the step of performing a de-correlating transform selected from the group consisting of a discrete cosine transform (DCT) and a wavelet transform.