The present invention generally relates to color correction, and more particularly, to systems and methods for color correction of displays having different modulation transfer function behavior.
Many displays have a dependency between video bandwidth and picture-brightness. This relationship is represented by a Modulation Transfer Function (MTF). MTF can be described as a frequency sweep from zero frequency to a maximum spatial Nyquist frequency of a display varied in luminance. As the luminance is increased or decreased, a breakpoint moves towards lower or higher frequencies. In the case of a horizontal sweep, the spatial Nyquist frequency would be determined to be pixels per line/2. As the luminance is varied, the breakpoint, that is, the point where the discrete frequency can be pinpointed before it becomes flat, travels from left to right.
In a cathode ray tube (CRT), issues with MTF can be illustrated mainly as a problem of the electron beam hitting an anode. As the beam current increases, the dot size increases, causing a pixel overlap. This topic has been examined by Nic P. Lyons and Joyce B. Farrell in “Linear Systems Analysis of CRT Displays”, SID 89 Digest, pages 220-223, 1989.
In Plasma displays or DLP displays (digital displays), a grey level is achieved by flashing constant light over a certain period of time, and the time integral then determines the grey level. These grey levels are called “discrete levels”. A display that uses such time multiplexing has a maximum refresh speed and can only produce a limited number of grey levels. The remaining grey levels which are needed to reconstruct a video picture are usually produced by using dithering. Dithering is a way to trade contrast for spatial resolution. For example, if high spatial resolution is not required, luminance and/or color resolution can be improved by dithering at the cost of spatial resolution.
Embodiments of the present invention include a system and method for color correction of displays having different modulation transfer function behavior. In one embodiment, a modulation frequency function (MTF) simulation module is configured to receive the color corrected picture content and simulate the reference display using the color corrected picture content for a display with MTF characteristics other than the reference display.
In one embodiment of the present invention, a method for adjusting a modulation transfer function includes color correcting a source picture content based upon a reference to output color corrected picture content, and simulating the reference by applying a compensated modulation transfer function (MTF) to the color corrected picture content for a display with MTF characteristics different than the reference.
In an alternate embodiment of the present invention, a system for adjusting a modulation transfer function includes a color correction module configured to adjust source picture content based upon a reference display to output color corrected picture content. A modulation frequency function (MTF) compensation module is configured to receive the color corrected picture content and transform the color corrected picture content for a display with MTF characteristics that are different than the reference display. The system can include an MTF simulation module coupled to the color correction module to store color correction metadata employed to transform the color corrected picture content by the MTF compensation module.
The teachings of the present invention can be readily understood by considering the following detailed description in conjunction with the accompanying drawings, in which:
It should be understood that the drawings are for purposes of illustrating the concepts of the invention and are not necessarily the only possible configuration for illustrating the invention. To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures.
Embodiments of the present invention advantageously provide methods and systems for color correction that implement a modulation transfer function (MTF) used in production of content in a reproduction display. Embodiments in accordance with the present principles provide that MTF characteristics used during the content production process are employed to predict/produce a desired spatial reproduction on reproduction displays. One reason that an exact reproduction of a given MTF behavior specification cannot be realized on the content production side is due to the existence of a large variety of such MTF behavior specifications. In fact, each particular model of a display manufacturer may have a different characteristic.
An exact reproduction is not required, as long as the content that is produced using the approximation will produce a better match to the original intent than pictures created without such model. To further improve the result, a reproduction display can calibrate to a “reference” model or display. There exist displays with many different MTF characteristics; in many cases, those MTF characteristics are designed into the display by means of signal processing. However, different display technologies exhibit their own characteristic MTF characteristic.
Referring now in specific detail to the drawings in which like reference numerals identify similar or identical elements throughout the several views, and initially to
Referring to
Thus, the characteristic MTF behavior of a CRT can be described as a lowpass filter with a decreasing cut-off frequency with increasing luminance. There is an independent function for each of the colors. However, there may be crosstalk from other effects like power limitations leading to different electron beam speeds resulting in different point spreads.
Referring to
Displays using plasma technology generally exhibit a behavior of reduced spatial resolution with decreasing local brightness (see
In the present disclosure, comparisons are made between a picture version for displays with an MTF behavior different from the MTF behavior of a reference display, and a picture version for displays with an MTF behavior equal to the MTF behavior of the reference display, or metadata for reconstructing the picture for displays with an MTF behavior different to the MTF behavior of the reference display. It should be noted that there are several MTF specifications that should be regarded, e.g., at least one specification for the CRT behavior, and at least one specification for Plasma or DLP type of behavior.
When editing the colors of a picture on a display other than a target display, a potential problem arises where spatial appearance on the target display may be different than expected. The present embodiments advantageously edit colors (color correct, color grade) in anticipation of the behavior of the target displays and provide practical ways of implementing methods for performing the same.
The functions of the various elements shown in the figures can be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage. Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (i.e., any elements developed that perform the same function, regardless of structure).
Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein represent conceptual views of illustrative system components and/or circuitry embodying the principles of the invention. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudocode, and the like represent various processes which may be substantially represented in computer readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
Referring to
A content creation side 101 includes the facilities needed to provide color correction or other adjustments to video content. A content consumer side 103 includes equipment to view the video content.
When color correcting on display 102 with the reference MTF behavior, the spatial reproduction will be incorrect on a display 106 with an MTF behavior different from the MTF behavior of the reference display 102. Two displays 106 and 108 are illustratively compared; both have the same number of pixels. Display 106 includes MTF behavior different from the MTF behavior of the reference display 102, and display 108 includes MTF behavior equal to the MTF behavior of the reference display 102. In CRTs, pictures with higher brightness will look significantly sharper on the display 108 with an MTF behavior different from the MTF behavior of the reference display 102. For a plasma display, the display 108 with MTF behavior different from the MTF of the reference display 102 will be less sharp than for the display 106.
Dark pictures, on the other hand, can look smoother on the plasma display than they look on the CRT display. As a result, details in the picture that are felt to be important can get lost or, artifacts that the content creators were not aware of, like noise or film grain, will be over accentuated on the plasma display, for example.
Referring to
The MTF compensation module 202 may include the ability to determine the type of reference display 102 where the color corrected picture content 114 was produced. Then, the inverse characteristic is referenced for the display type of display 106. Next, the inverse characteristic is applied to the MTF for the referenced display 102 to provide a better match between the reference display 102 and the content consumer display 106.
It should be understood that the FIGS. include a content creation side 101 and a content consumer side 103. However, the elements depicted on the content consumer side 103 may be implemented and the content creation side 101 and vice versa. In addition, content creation 101 may include production facilities for rendering video for cable or other networks, television, movie studios, DVD's, VHS tapes or any other content production. The content consumer 103 may include movie theatres, televisions, or any other content consumer. The MTFs may be embodied in a look up table, analytical transfer function, data graph or any other relationship between spatial resolution and brightness. The color correction process provides changes to this curve which may be employed in MTF compensation 202. Alternately, MTF compensation may be performed by comparing MTFs between the consumer display (106) and the reference display and counteracting the differences to achieve the same or similar result as the reference display 102.
Referring to
Differences in look on displays (106) with MTF behavior different from the MTF behavior of the reference display 102, and displays 108 with MTF behavior equal to the MTF behavior of the reference display, or other displays with different types of MTF behavior can be addressed during content creation 101. In accordance with one embodiment, MTF differences can be predicted, and color decisions and spatial enhancement decisions can be made to make sure that the artistic intent is not compromised by one of the displays taken into consideration. In this embodiment, during content creation, a reference display 102 with an MTF is compared to a different reference display 102′ with the same MTF. An MTF simulation module 302 includes the capability to adjust the MTF to arrive at a satisfactory picture appearance. The adjustments made in the MTF simulation module 302 may be employed to create an inverse characteristic curve or a new MTF to be employed with consumer displays (e.g., display 106 in
The simulation employed by simulation module 302 helps to achieve the best compromise for all displays. This may mean that not all wanted color compositions are possible although some displays would have the potential to support them. The resultant picture material (content 114) would be color corrected to meet the least common denominator among all displays expected for viewing. In accordance with this implementation, a single corrected picture content 114 may be sent to all display types with the settings designed to provide a negotiated appearance that is satisfactory for all display types.
Display 106 with an MTF behavior different from the MTF behavior of the reference display 102′ used during content creation could be a reference display of that type with a well characterized and documented specification, or display 102′ could be a reference display of another type, for example, with an MTF behavior equal to the MTF behavior of the reference display 102, with MTF simulation circuitry 302. Advantageously, using the simulation circuitry 302 in this way offers the opportunity of having different display characteristics on one display without the need of an arrangement of several displays in a color correction suite.
As shown in
Referring to
In this example, there is a singular specification for the display 102 with the reference display MTF behavior, and yet multiple MTF behavior specifications will have to be considered for versions of displays with different (e.g., display 106) MTF behaviors from the MTF behavior of the reference display 102. It would be advantageous if the initial version of the MTF master was the version for a display 102 with reference MTF behavior.
To find a compromise, a colorist may, for example, blur or noise reduce an image that shows too much grain or noise. The colorist may also change the color of one particular object to change it to a brightness level where the details can be better reproduced on one of the displays.
In contrast to the embodiment described with reference to
Referring to
The term “metadata” refers to data such as, for example, integer, non-integer values, and/or Boolean values, used to control, turn on or turn off color processing mechanisms, and to modify the functionality of such. Furthermore, metadata may include a specification of a mapping table.
One difference between the embodiment of
Referring to
Referring to
A two step color correction is advantageously performed. In a first step, color correction 112 is applied where the colors are corrected for the reference display 102 with reference MTF behavior. Then, the picture is put onto the display 102′ with an MTF behavior different from the MTF behavior of the reference display 102 (or its corresponding simulation 502), accepting the spatial resolutions to fall where they may fall. In a secondary color correction process 112′, the colorist is given the ability to adjust the colors and spatial parameters in a way to preserve artistic intent on the display 106 with an MTF behavior different to the MTF behavior of the reference display 102′. However, in this scenario it is accepted that the two versions of the picture for display 106 and display 108 may not completely match. The two versions are then stored as separate masters 516 and 514.
Display properties of the different displays may not be fully exploited, namely the picture may not be as sharp in dark regions as it could get on a display with an MTF behavior equal to the MTF behavior of the reference display, and the picture may not be as sharp in bright regions as it could get with an MTF behavior different than the MTF behavior of the reference display. This problem is solved by providing the second color correction process 112′, which permits particular features of a given display to be exploited using additional color correction adjustments.
Referring to
A frequency response transform specification calculation 808 is performed to generate MTF compensation and color change metadata 804. The combined metadata 804 would then be provided to a consumer device in the form of the color transform 806 which is then able to reconstruct the version for displays with an MTF behavior different to the MTF behavior of the reference display 102′ using a signal transform that uses the transform specification 806.
In some applications, it may not be preferable to have separate or multiple masters for different MTF characteristics. In such cases, it is preferable to have a single source of content and metadata describing a color transform 806 that is necessary to retrieve the MTF characteristic version needed. On the consumer side, transform 806 may be provided that connects a signal source with a display (106) with an MTF behavior different than the MTF behavior of the reference display 102. Transform 806 can be implemented in hardware (circuitry) or in software, and can provide the signal transform to generate the version of MTF specification needed out of the signal for displays with an MTF characteristic equal to the reference display 102. This transform 806 may be provided with the signal transform specification from the content provider by means of metadata 804. The signal transform specification (806) may include two major components, a specification of the color change from the subsequent color correction 112′, which is basically a spatial domain operation, and a specification of an MTF compensation plus spatial picture manipulations from simulation 502, which are frequency domain operations (see
Referring to
Spatial modifications performed by color correction (112′) are specified to block 906 by, e.g., a LUT of FFT coefficients for different intensity levels. These coefficients are used to attenuate frequency bands. The inversion of the MTF simulation 904 and a spatial transform specification 908 are input to block 906, where the application of the inverse MTF simulation to an input spatial transform specification is performed. The color modifications from input color transform specification 910 made by color correction 112′ are specified by a 1-D LUT (e.g., one per color component). An output color transform 910 and spatial transform 912 result from the operations performed.
Referring to
Having described preferred embodiments for a color correction system and method for matching colors on displays with different modulation transfer function behavior (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the invention disclosed which are within the scope and spirit of the invention as outlined by the appended claims. While the forgoing is directed to various embodiments of the present invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US2007/015183 | 6/29/2007 | WO | 00 | 12/28/2009 |