This application makes reference to U.S. patent application Ser. No. 10/871,758 entitled “DETECTION AND PHASE LOCK OF PULL-DOWN VIDEO” filed on Jun. 17, 2004, the complete subject matter of which is incorporated herein by reference in its entirety.
[Not Applicable]
[Not Applicable]
When an analog video decoder decodes a composite video signal, the decoder may be unable to successfully determine whether the signal is luma or chroma. If the video decoder interprets the signal as chroma when in fact it was luma, an artifact known as cross-chroma results. Cross-chroma results in characteristic rainbow patterns on the screen. Given the alternating phase of a chroma subcarrier between subsequent fields, localized features on the screen can result in alternating and opposite cross-chroma colors.
If the source material is a movie, often 3:2 pulldown has been performed. If this is detected, it is known between which fields motion is possible. Between fields where it is known that no motion is possible, filtering may be used to cancel out the alternating opposite cross-chroma. However, cross-chroma may still be present.
The limitations and disadvantages of conventional and traditional approaches will become apparent to one of skill in the art, through comparison of such systems with some aspects of the present invention as set forth in the remainder of the present application with reference to the drawings.
Aspects of the invention provide at least a system and a method for reducing cross-chroma artifacts when deinterlacing pull-down video as substantially shown in and/or described in connection with at least one of the following figures, as set forth more completely in the claims.
These and other advantages, aspects, and novel features of the present invention, as well as details of illustrated embodiments, thereof, will be more fully understood from the following description and drawings.
Various aspects of the invention provide at least a system and method of reducing cross-chroma artifacts when displaying movie material using a decoder or deinterlacer. The aspects of the invention may be applied to deinterlacers (or decoders) used in NTSC 3:2 pull-down video or PAL 2:2 pull-down video, for example. Cross chroma is a video artifact that occurs when a composite video decoder or deinterlacer (i.e., including a comb filter) incorrectly interprets luma information (luminance) to be chroma information (chrominance).
As may be referenced in U.S. patent application Ser. No. 10/871,758 entitled “DETECTION AND PHASE LOCK OF PULL-DOWN VIDEO” filed on Jun. 17, 2004, the field phase or execution stage field phase, as described in reference to
Again referring to the extended pixel constellation provided by
In a preferred representative embodiment, the following equations shown in Tables 1 and 2 may be used to compute adjusted chroma values for each present pixel in either a top field or bottom field of interlaced 3:2 (pull-down) video. The equations may be used to provide a more accurate computation of present pixel chroma and absent pixel chroma. The computations may be used to eliminate or minimize cross-chroma artifacts that are typically generated during deinterlacing of video using reverse 3:2 pull-down.
Each equation is used to compute an adjusted chroma that provides reduced cross-chroma artifacts when a video, such as a movie, is displayed. Each equation is defined in terms of the chroma associated with one or more available pixels, as defined by the pixel constellation (A, B, C, D, E, F, G, H, J, K, L, M, N, P, Q, R, S, T, W, Z) shown in
For execution stage field phase 0, the adjusted chroma from a present pixel for a corresponding present top field may be computed by way of solving the equation:
obtained from Table 1. As shown, the adjusted chroma is computed by taking the average of the chroma obtained from pixels E and T of the extended constellation shown in
obtained from Table 1. As shown, the adjusted chroma is computed by taking the average of the chroma obtained from pixels F and W of the extended constellation shown in
as obtained from Table 2. Hence, one obtains the chroma for the absent pixel by taking the average of the chroma associated with pixels at spatial locations E, T, F, and W.
For execution stage field phase 1, the adjusted chroma from a present pixel from a corresponding present top field may be computed by way of solving the equation:
obtained from Table 1. The adjusted chroma is computed by summing one-half of the chroma of a pixel represented by spatial location E, one-quarter of the chroma of a pixel represented by spatial location N, and one-quarter of the chroma of a pixel represented by spatial location B. The present pixel represented by spatial location E (i.e., present pixel E) originates from a present top field while the pixels at locations N and B originate from a bottom field one field phase later than the present top field. The pixels at N and B are spatially vertically adjacent to an absent pixel that corresponds to present pixel E. Likewise, for execution stage field phase 1, the adjusted chroma from a present pixel from a corresponding present bottom field may be computed by way of solving the equation:
The adjusted chroma is computed by summing one-half of the chroma of a pixel represented by spatial location F, one-quarter of the chroma of a pixel represented by spatial location B, and one-quarter of the chroma of a pixel represented by spatial location P. The present pixel represented by spatial location F (i.e., present pixel F) originates from a present bottom field while the pixels at locations B and P originate from a top field one field phase later than the present bottom field. The pixels at B and P are spatially vertically adjacent to an absent pixel that corresponds to present pixel F. For execution stage field phase 1, the absent pixel chroma may be computed by way of the following equation:
as obtained from Table 2. The absent pixel chroma may be computed by summing one-half of the chroma represented by spatial location B, one-quarter of the chroma represented by spatial location E, and one-quarter of the chroma represented by spatial location F. Pixels at E and F are vertically adjacent to absent pixel O, as shown in
For execution stage field phase 2, the adjusted chroma from a present pixel from a corresponding present top field may be computed by way of solving the equation:
obtained from Table 1. The adjusted chroma is computed by summing one-half of the chroma of a pixel represented by spatial location E, one-quarter of the chroma of a pixel represented by spatial location Q, and one-quarter of the chroma of a pixel represented by spatial location G. The present pixel represented by spatial location E (i.e., present pixel E) originates from a present top field while the pixels at locations Q and G originate from a bottom field one field phase earlier than the present top field. The pixels at Q and G are spatially vertically adjacent to an absent pixel that corresponds to present pixel E. Likewise, for execution stage field phase 2, the adjusted chroma from a present pixel from a corresponding present bottom field may be computed by way of solving the equation:
The adjusted chroma is computed by summing one-half of the chroma of a pixel represented by spatial location F, one-quarter of the chroma of a pixel represented by spatial location G, and one-quarter of the chroma of a pixel represented by spatial location R. The present pixel represented by spatial location F (i.e., present pixel F) originates from a present bottom field while the pixels at locations B and P originate from a top field one field phase earlier than the present bottom field. The pixels at G and R are spatially vertically adjacent to an absent pixel that corresponds to present pixel F. For execution stage field phase 1, the absent pixel chroma may be computed by way of the following equation:
as obtained from Table 2. The absent pixel chroma may be computed by summing one-half of the chroma represented by spatial location G, one-quarter of the chroma represented by spatial location E, and one-quarter of the chroma represented by spatial location F. Pixels at E and F are vertically adjacent to absent pixel O, as shown in
For execution stage field phase 3, the adjusted chroma from a present pixel from a corresponding present top field may be computed by way of solving the equation:
obtained from Table 1. As shown, the adjusted chroma is computed by taking the average of the chroma obtained from pixels E and C of the extended constellation shown in
obtained from Table 1. As shown, the adjusted chroma is computed by taking the average of the chroma obtained from pixels F and D of the extended constellation shown in
as obtained from Table 2. Hence, one obtains the chroma for the absent pixel by taking the average of the chroma associated with pixels at spatial locations C, E, D, and F.
For execution stage field phase 4, the adjusted chroma from a present pixel from a corresponding present top field may be computed by solving the equation:
obtained from Table 1. As shown, the adjusted chroma is computed by taking the average of the chroma obtained from pixels N, B, Q, and G of the extended constellation shown in
obtained from Table 1. As shown, the adjusted chroma is computed by taking the average of the chroma obtained from pixels B, P, G, and R of the extended constellation shown in
as obtained from Table 2. Hence, one obtains the chroma for the absent pixel by taking the average of the chroma obtained from corresponding pixels associated with spatial locations B and G.
Cross-chroma may be generated, for example, when video is modulated by a subcarrier and filtered through a comb filter. Given the alternating phase of a chroma subcarrier between subsequent fields (or output frames), localized features on the screen may result in alternating and opposite cross-chroma colors. Referring back to the equations presented in Tables 1 and 2, the adjusted chroma computed for present pixels in the top field or bottom field for execution stage field phases 0, 3, and 4 results in perfect cross-chroma cancellation because the terms used in the computation originate from two identical fields of the interlaced 3:2 pull-down video. These two identical fields may comprise two top fields or two bottom fields. Because there are an odd number of lines (e.g., 525 lines in NTSC formatted video) per output frame (e.g., progressive frame) and because of the way in which subcarrier modulation and demodulation of the video occurs (at 227.5 subcarrier periods per line), there is a 180 degree phase shift when the video is modulated or demodulated by the subcarrier frequency. As a consequence, the cross-chroma of successive fields or frames alternate in sign such that the cross-chroma between two identical top or bottom fields are exactly opposite of each other. As a result of this information, the various aspects of the invention perform an averaging of corresponding pixel chroma between the two identical top or bottom fields such that any cross-chroma perfectly cancels out.
In order to provide a reduced cost version of the implementation disclosed by the equations in Tables 1 and 2, the extended constellation of
In the representative embodiment, provided by Tables 3 and 4, two out of five field phases (i.e., execution stage field phase 3 and 4) provide perfect cross-chroma cancellation for present top field originated frames. However, for bottom field originated frames, cross-chroma is completely cancelled for execution stage field phase 3 while cross-chroma is mostly cancelled for execution stage field phase 4. For execution stage field phases 0, 1, and 2, perfect or complete cancellation is not possible in this “reduced cost” embodiment. For execution field phases 0, 1, and 2, the adjusted chroma is obtained by averaging chroma from top and bottom fields sourced from an originating source film frame. With respect to Table 4, the equations are the same as that for Table 2 except for the equation corresponding to execution stage field phase 0. For this equation, the chroma from G is used to replace the chroma obtained from pixel locations T and W. Although not described, it is contemplated that other variations of extended pixel constellations may be used in generating adjusted chroma for present pixels and absent pixels when deinterlacing pull-down video.
While the invention has been described with reference to certain embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from its scope. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed, but that the invention will include all embodiments falling within the scope of the appended claims.
Number | Name | Date | Kind |
---|---|---|---|
5027194 | Scheffler | Jun 1991 | A |
6704055 | He et al. | Mar 2004 | B1 |
7202907 | Chow | Apr 2007 | B2 |
7327398 | Hall | Feb 2008 | B2 |
7397515 | Walls et al. | Jul 2008 | B2 |
7466361 | Wyman | Dec 2008 | B2 |
7551232 | Winger et al. | Jun 2009 | B2 |
7557861 | Wyman | Jul 2009 | B2 |
7586540 | Ogino et al. | Sep 2009 | B2 |
7630870 | Chen et al. | Dec 2009 | B2 |
20050018087 | Lee | Jan 2005 | A1 |
20060244868 | Jia et al. | Nov 2006 | A1 |
Number | Date | Country | |
---|---|---|---|
20080012984 A1 | Jan 2008 | US |