Patent Application
20100027614
The present invention relates generally to video or audio decoding, more specifically the present invention relates to error awareness in video/audio decoding.
Digital television (DTV) receivers can receive signal either on a fix point basis, or on a mobile basis. The DTV that receives on the mobile basis or in the wireless environment pose challenges. The challenges include that in the mobile environment, receiving conditions such as signal noise ratio (SNR) and bit error ratio (BER) fluctuate significantly. As a result, the final bit streams can be erroneous from time to time and have some obvious gaps in the seconds range (˜1 s) when the users are temporally blacked out (e.g. a mobile device in a automobile driving through a freeway underpass) even though the average signal strength and SNR are good. This is especially true in the case when interleaving memory is not really big enough to overcome the issue in single carrier communications systems in such cases as ATSC DTV signals.
Therefore, it is desirous to decode the DTV signal jointly using both channel decoding and source decoding to thereby improve the audio/video quality and enhance users' experience.
A DTV receiver is provided such that the receiver decodes the DTV signal jointly using both channel decoding and source decoding to thereby improve the audio/video quality and enhance users experience.
A DTV receiver having method using elastic decoding method is provided. The method comprises the steps of: receiving a signal for processing; decoding the signal using a source decoder; determining a portion of the signal that are problematic; and using elastic decoding to remedy the portion of the signal that are problematic.
The accompanying figures, where like reference numerals refer to identical or functionally similar elements throughout the separate views and which together with the detailed description below are incorporated in and form part of the specification, serve to further illustrate various embodiments and to explain various principles and advantages all in accordance with the present invention.
Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of embodiments of the present invention.
Before describing in detail embodiments that are in accordance with the present invention, it should be observed that the embodiments reside primarily in combinations of method steps and apparatus components related to power estimation for uplink or downlink using at least part of decoded information for an estimation of errors in a single carrier receiver and remedying same. Accordingly, the apparatus components and method steps have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.
In this document, relational terms such as first and second, top and bottom, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms “comprises,” “comprising,” or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by “comprises . . . a” does not, without more constraints, preclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.
It will be appreciated that embodiments of the invention described herein may be comprised of one or more conventional processors and unique stored program instructions that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of using known sequences within the guard intervals being used for power estimation for uplink or downlink using at least part of decoded information for an estimation of errors in a single carrier receiver and remedying same. The non-processor circuits may include, but are not limited to, a radio receiver, a radio transmitter, signal drivers, clock circuits, power source circuits, and user input devices. As such, these functions may be interpreted as steps of a method to power estimation for uplink or downlink using at least part of decoded information for an estimation of errors in a single carrier receiver and remedying same. Alternatively, some or all functions could be implemented by a state machine that has no stored program instructions, or in one or more application specific integrated circuits (ASICs), in which each function or some combinations of certain of the functions are implemented as custom logic. Of course, a combination of the two approaches could be used. Thus, methods and means for these functions have been described herein. Further, it is expected that one of ordinary skill, notwithstanding possibly significant effort and many design choices motivated by, for example, available time, current technology, and economic considerations, when guided by the concepts and principles disclosed herein will be readily capable of generating such software instructions and programs and ICs with minimal experimentation.
In using at least part of decoded information for an estimation of errors in a single carrier receiver (error-awareness decoding), three situations exist. They are: situation one in which the packets of the bistreams have no error or the errors are all corrected using forward error correction (FEC) of the receiver. In this case, the decoding is conducted normally in that no extra action is required. Situation two in which the signal quality is reasonably good, but some errors in the packets are not fully corrected. Typically, under situation two nine (9) errors or more occur per instance. In this case, it would be very beneficial if the positions of the error can be identified. In this case, FEC is used to predict the positions of the error. Situation three in which the signal quality is not acceptable. In this case, the packets of data will not be reliably used.
In an exemplified embodiment of the present invention, each packet has twenty-two (22) bytes of quality indication, which amounts to one-tenth ( 1/10th) overhead. The following table 1 contains elements that denote a practical transport stream (TS) data format being employed.
In a device of the present invention such as a receiver, the demodulation block typically inform upon the conditions of the TS packet. For example, the Reed-Solomon (RS) decoder in a typical Advanced Television System Committe (ATSC) system has information about error correcting results to indicating the TS packets are clean or not. Some parameters like signal noise ratio (SNR) or signal strength can also be used to judge the qualities of the bitstreams and MPEG decoder can accordingly take different strategies. The decoder acts accordingly based on the qualities of the bitstream, in order to prevent the visual impairment or artifacts from happening in the final presentation or display. The decoder of the present invention is adapted to known the position or being aware of the portion of the bitstreams that are problematic. When the decoder is aware of the portion of the bitstreams that are problematic, it will not try to decode but to conceal that portion of the picture data using some other known good data in the neighborhood. For example, the decoder may abandon rather than to show a not-so-good picture. However, if the not-so-good picture is abandoned, a viewer may perceive a blank or other undesirable display. A means for remedying same is described infra.
Referring to
Another approach is to use time elastic decoding. Part of the TS can be stored in a buffer and used according to the present invention. One of the methods to overcome temporal loss of data that occurs occasionally is to have some buffer for the bitstream as well as to filter out the gaps during decoding. This becomes feasible in the situation when inexpensive SDRAM (DDR) becomes increasingly available. For example, a 256 Mbits DDR memory can easily store eight (8) seconds of data associated with HDTV bistreams, as well as the memory required to decode the HDTV signals.
Time elastic decoding may be advantageously used to decode/playback the good portion of the bitstream of DTV signals at lower speed to keep the subjective video/audio results in as good/same quality as that of the normal speed as possible. Further, for the video portion, both methods of repeat frame or the interpolation of the frames may be selectively used. For the audio portion, time stretching may be used as long as changing of the pitch does not occur.
Referring to
Regarding the technical aspects of the present invention, some features are helpful. For the error-awareness decoding, one needs to let the decoder remember the positions of the bitstream that at least one Audio/Video failure occurs. Whereby the decoder can take some actions to remedy the failure. Therefore: (1) The flags (indicator bits) may be implemented throughout the decoding data chain. firmware and control logic are needed. (2) Frame Rate Conversion may be required including: When the gap in the signal quality is too big to be concealed, e.g. 1-2 second, normal audio and video data should be stretched to a slower rate without creating any noticeable artifacts. (3) Temporal Image Scaling may be required including: The images (pictures) are interpolated in time domain using motion vectors; Over-lapped (occluded) region has to be taken care of or addressed. (4) Temporal Audio Scaling may be required including: The audio can be played at a slower or faster speed without changing the associated pitch. See Table 2
Referring to
Referring to
Referring to
Referring to
The present invention pertains to error awareness to inform source decoder up the byte or even smaller units so that error can be avoided. Further, the present invention pertains to elastic decoding of video and audio signals so that user experience can be improved. One example in which the present invention pertains to is that when black out spots occur. Black out spots includes locations such as a freeway underpath.
In the foregoing specification, specific embodiments of the present invention have been described. However, one of ordinary skill in the art appreciates that various modifications and changes can be made without departing from the scope of the present invention as set forth in the claims below. Accordingly, the specification and figures are to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope of present invention. The benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential features or elements of any or all the claims. The invention is defined solely by the appended claims including any amendments made during the pendency of this application and all equivalents of those claims as issued.
Terms and phrases used in this document, and variations thereof, unless otherwise expressly stated, should be construed as open ended as opposed to limiting. As examples of the foregoing: the term “including” should be read as mean “including, without limitation” or the like; the term “example” is used to provide exemplary instances of the item in discussion, not an exhaustive or limiting list thereof; and adjectives such as “conventional,” “traditional,” “normal,” “standard,” and terms of similar meaning should not be construed as limiting the item described to a given time period or to an item available as of a given time, but instead should be read to encompass conventional, traditional, normal, or standard technologies that may be available now or at any time in the future. Likewise, a group of items linked with the conjunction “and” should not be read as requiring that each and every one of those items be present in the grouping, but rather should be read as “and/or” unless expressly stated otherwise. Similarly, a group of items linked with the conjunction “or” should not be read as requiring mutual exclusivity among that group, but rather should also be read as “and/or” unless expressly stated otherwise.
The following applications of common assignee and filed on the same day herewith are related to the present application, and are herein incorporated by reference in their entireties: U.S. patent application Ser. No. ______ with attorney docket number LSFFT-113.
