Patent Application
20100194769
This application is based upon and claims the benefit of priority from prior Japanese Patent Application No. 2008-202070, filed Aug. 5, 2008, the entire contents of which are incorporated herein by reference.
1. Field of the Invention
The present invention relates to a picture processing method and a mobile communication terminal equipped with a display module such as a PDP (Plasma Display Panel) or an OLED (Organic Light Emitting Diode) panel.
2. Description of the Related Art
It is known that power consumption varies according to a displayed scene in a self-luminous display panel such as the PDP and the OLED panel, and there is a method to cut electric power consumption by controlling peak brightness according to the displayed scene. For example, Jpn. Pat. Appln. KOKAI Publication No. 2007-147868 (Tada et al.) discloses that a base peak luminance value is adjusted so that electric power consumption is kept below a predetermined consumption of electrical energy for each base period. Concretely, for each picture frame, the peak luminance ratio is obtained according to an average gradation value of a picture frame and a norm peak luminance value is calculated by multiplying the base peak luminance value by the peak luminance ratio. Thereafter, the norm peak luminance is adjusted if the electric power consumption, which is calculated by multiplying the average gradation value by the norm peak luminance value, exceeds the predetermined electrical energy consumption for each base period.
Also, Jpn. Pat. Appln. KOKAI Publication No. 2004-266755 (Fujishima) discloses that correction intensity is obtained based on an index value calculated from averaged luminance signals of two consecutive frames and a Gamma correction function is obtained according to the correction intensity. Thereafter, luminance correction is executed based on the Gamma correction function.
However, the present inventors recognized these publications do not consider colorfulness when correcting luminance signal, and therefore, brightness varies unnaturally. Especially, JP 2004-266755 (Fujishima) is silent about electric power consumption.
Exemplary embodiments of the present invention provide a picture processing method which enables to cut power consumption without degrading picture quality of a sense of brightness.
A picture processing method includes: receiving picture data including a luminance signal and chrominance signals for each pixel of a picture frame; calculating a saturation value based on the chrominance signals; obtaining a weight coefficient corresponding to the saturation value by referring to a weight coefficient storage; calculating a first value by multiplying the luminance signal by the weight coefficient for the each pixel; accumulating the first values for the each pixels; calculating a picture level value of the picture frame by dividing the accumulated first values by the number of pixels contained in the picture frame; obtaining a peak luminance corresponding to the picture level value by referring to a gain storage area; and converting the luminance signal included in the picture data based on the obtained peak luminance.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments of the invention, and together with the general description given above and the detailed description of the exemplary embodiments given below, serve to explain the principles of the invention. In the drawings:
Exemplary embodiments of the present invention will be described hereinafter with reference to the accompanying drawings.
The picture processing apparatus in the cellular phone 10 corresponds to a picture processing function 100 in
As a human visual feature, there is a well-known feature known as the Helmholtz-Kohlrausch effect. This feature indicates that images are perceived to be brighter as the saturation increases in the images even though the brightness does not change. Namely, a colorful image is perceived to be brighter than an achromatic image by people even though both images have the same luminance level.
Consequently, in this embodiment, when an APL (average picture level) value indicates a picture frame is colorful, a permissible luminance level for the picture frame is controlled not to use a given number of luminance levels within the highest luminance level. In this case, since relatively lower luminance levels are used, power consumption can be reduced; however, since the image is colorful the image will still be perceived by a human user to have adequate brightness. On the other hand, when an APL value indicates a picture frame is achromatic, the highest luminance levels or almost the highest luminance levels are used for displaying the monochrome picture frame, so that picture frame is still perceived by a human operator as adequately bright.
The picture processing function 100 includes an APL calculation function 110, a weight calculation function 120, a peak luminance calculation function 130, a gain calculation function 140, and a picture correction function 150.
The picture generation unit 2 decodes a coded bit stream such as a video elementary stream that is demultiplexed from a multiplexed stream contained in the TS (transport stream) packets at a multiplexed stream demultiplexer (not shown) located between the digital terrestrial broadcasting receiving unit 3 and the picture generation unit 2, and generates luminance signal Y and chrominance signals U and V as picture data for each pixel of a picture frame. The multiplexed stream can be a stream contained in a data file downloaded from a server.
The APL calculation function 110, via the weight calculation function 120, refers to a weight look-up table (LUT) 121 in a storage area managed by the weight calculation function 120 and obtains a weight coefficient according to the chrominance signals U and V output from the picture generation unit 2. Thereafter, the APL calculation function 110 weights the luminance signal Y with the extracted weight coefficient and calculates an APL value for the picture frame.
The weight LUT 121, for example, is a table storing a relationship between the chrominance signals (U and V) and corresponding weight coefficients W(U,V). Namely, the table shows the relationship between color phase and saturation. In this embodiment, so as not to degrade picture quality, the weight coefficient decreases as the chrominance signal indicates more sensitivity to change of luminance. For example, when displaying an achromatic picture frame, perceived brightness of the displayed picture frame becomes darker as a luminance level becomes lower; therefore, a smaller weight coefficient is assigned to the achromatic picture frame.
For this reason, the APL calculation function 110, by weighting, reduces an APL value calculated from an achromatic picture frame, which is composed of relatively achromatic pixels, more than an APL value calculated from a colorful picture frame, which is composed of relatively colorful pixels.
Hereinafter, how to set the weight coefficients W (U,V) is explained.
Concretely, the weight coefficient W(U,V) is calculated based on the following function Ws(u,v).
Saturation=squr(u2+v2)
if) Saturation<THs
W
s(u,v)=a(Saturation)+b
else)
W
s(u,v)=1
THs=64
wherein, a is a gradient, b is a weight coefficient for the purely achromatic color, and THs is a threshold. The weight coefficient b and the threshold THs are determined in accordance with an experimental rule. The gradient a is calculated if the weight coefficient b and the threshold THs are determined since two coordinates of a linear function are specified.
Namely, as shown in
By setting the weighting feature according to the saturation into the weight LUT 121, as described above, the APL value of a colorful picture frame, e.g. a frame of a moving picture, calculated by the APL calculation function 110 relatively gets higher than the APL value of an achromatic picture frame. Subsequently, peak luminance Y-peak (maximum luminance level) becomes lower for the colorful picture frame, and thereby power consumption is lowered.
From the Helmholtz-Kohlrausch effect it is also known to vary perceived brightness according to color phase. For example, as for a yellow color, a sense of brightness is flat even if the saturation varies. However, as fora color phase of a short-wavelength color such as blue or purple, or a color phase of a long-wavelength color such red, the perceived sense of brightness increases as the saturation increases; therefore, as shown in
Concretely, the weight coefficient W(U,V) is calculated based on the following function Wθ(u,v).
if) θ<THθ
W
θ(u,v)=c(π−θ)+d
else)
W
θ(u,v)=c(θ−π)+d
THθ=π
wherein, c and d are constant values, and π is the circle ratio.
Namely, the weight feature as shown in
Furthermore, the weight feature can be expressed by combining two weight features. For example, the weight feature defined by a following weight function W(u,v) can be set into the weight LUT 121.
W(u,v)=Ws(u,v)*Wθ(u,v)
Now, returning to the explanation regarding
The peak luminance calculation function 130, via the gain calculation function 140, refers to a gain look-up table (LUT) 141 in a storage area managed by the gain calculation function 140, and determines a peak luminance corresponding to the APL received from the APL calculation function 110. Consequently, the peak luminance calculation function 130 determines the peak luminance suitable for displaying the picture frame.
The gain LUT 141 is a table defining a relationship between the APL value and the gain, and has a feature that the gain decreases as the APL value increases as shown in
The picture correction function 150 of
The display control unit 20 receives the picture data of the corrected luminance signal Y′ and the chromatic signals (U and V) from the picture correction function 150, and, based on the corrected luminance signal Y′ and chrominance signals (U and V), controls a self-luminous display panel such as an OLED panel or a PDP so as to display a picture such as a still image or a moving picture on the display panel 30.
Next, processing executed by the picture processing apparatus having the above functions is explained.
The processing is explained with reference to
In step 6a, the APL calculation function 110 first initializes apl and N, wherein apl is a variable to be used in a later processing and N is a variable indicating the number of pixels (the number of pixels on a row times the number of pixels on a column) contained in a picture frame, and goes to a step 6b. In this case, 0 is set to the variable apl as an initial value.
In step 6b, the APL calculation function 110 first selects one pixel designated by coordinate (x,y) on a picture frame to be processed. No same pixel is selected twice from one picture frame by the APL calculation function 110. Then, the APL calculation function 110, via the weight calculation function 120, obtains a weight coefficient W (U (x,y), V (x,y)) corresponding to chrominance signals U(x,y) and V (x,u) calculated from the pixel on the selected coordinate (x,y), and multiplies the luminance signal Y, corresponding to the coordinate (x,y), by the obtained weight coefficient. Subsequently, the APL calculation function 120 adds the result of the multiplication to the variable apl, and the processing goes to step 6c.
In step 6c, the APL calculation function 120 checks whether all multiplications for all pixels contained in the picture frame to be processed have been calculated. If the multiplications for all pixels have been executed, Yes in step 6c, the processing goes to step 6d, if not, if No in step 6c, the processing goes back to step 6b and the calculations for the remaining pixels are executed.
In step 6d, the APL calculation function 120 calculates an APL value by dividing the variable apl calculated at steps 6b and 6c by the variable N (N indicating the total number of pixels), and the processing goes to step 6e. Thus, the APL value for the frame to be processed is determined.
In step 6e, the peak luminance calculation function 130, via the gain calculation function 140, refers to the gain LUT 141 managed by the gain calculation function 140, and obtains a gain value GainLUT [APL] corresponding to the APL value calculated in step 6d. When the GainLUT[APL] is obtained, the peak luminance calculation function 130 determines the peak luminance Ypeak by multiplying the maximum luminance level of the display panel 30 by the obtained gain value GainLUT[APL], and the processing goes to step 6f. For example, when the luminance of the display panel 30 is represented by an 8 bit signal, the luminance can be represented by 256 levels. In this case, if the obtained gain value GainLUT[APL] is 0.9, a peak luminance Ypeak is 229. Therefore, luminance levels 0 (lowest luminance level) through 229 (highest luminance level) are used for displaying a corresponding frame. The maxGain and the MinGain in
Subsequently, when a suitable peak luminance for the picture frame to be processed is determined, picture correction function 150 generates a correction look-up table (LUT) based on a reproducible range of the luminance signal and the peak luminance Ypeak. In this case, the reproducible range of the luminance signal is assumed to be 256 levels since the luminance signal is also represented by 8 bits, in this embodiment.
In step 6f, the picture correction function 150 initializes a counter value y identifying a luminance signal Y in the control unit 1.
As described above, the peak luminance Ypeak of a frame with high APL level is reduced a greater amount compared with that of a frame with a low APL value, and the picture frame with the smaller APL value is displayed on display panel 30 with a reproducible peak luminance Ypeak of the display panel 30. On the other hand, the picture frame with the higher APL value is displayed on the display panel 30 with the peak luminance Ypeak below the reproducible peak luminance of the display panel 30.
In step 6g, the picture correction function 150 generates a correction look-up table (LUT) 151 for luminance signals, Y=0 through Y=255 in the reproducible luminance range, based on the peak luminance Ypeak calculated in step 6e. The correction LUT 151 defines the relationship between the each luminance signal Y in the reproducible luminance range and the converted luminance signal Y-LUT [y]. First, the picture correction function 150 reads out the counter value y=0 from the counter and calculates Y-LUT [0] corresponding to 0. Thereafter, the picture correction function 150 increases the counter value y by 1. Subsequently, the picture correction function 150 reads out the counter value y=1 from the counter and calculates Y-LUT[1] corresponding to 1. The process in step 6g continues until the picture correction function 150 detects that the counter value y exceeds 255, in step 6h. For example, if the peak luminance Ypeak is 229, as is described above, the Y-LUT [0] is calculated by (229/255) *0 and the Y-LUT[0] corresponds to 0, the Y-LUT[1] is calculated by (229/255)*1 and the Y-LUT [1] corresponds to 0 because of half adjust, and the Y-LUT [255] is calculated by (229/255) *255 and the Y-LUT [255] corresponds to 229.
Thus, the correction LUT 151 including relationship luminance signals Y, 0 through 255, in the reproducible range and the converted luminance signals Y-LUT [0] through Y-LUT [255] is completed.
Namely, the corrected luminance signal Y-LUT [y] is the value obtained by reducing a gradation of the luminance by the ratio of the peak luminance Ypeak to 255 (the maximum luminance level). However, it is not limited to the above method to obtain the corrected luminance signal Y-LUT [y]. The luminance can be reduced in the actual brightness of display panel 30 in view of an inverse Gamma feature of the display panel 30, or can be reduced by controlling a Gamma feature of an RGB signal in place of the luminance signal.
In step 6i, the picture correction function 150 selects one pixel in the picture frame to be processed. No same pixel is selected twice from one picture frame in the loop processing consisting of step 6i and step 6j.
The picture correction function 150 extracts the corrected luminance signal Y-LUT[Y(x,y)] corresponding to the luminance signal Y(x,y), which is designated by the coordinate (x,y), from the correction LUT 151, thereafter, outputs the corrected luminance signal Y-LUT[Y(x,y)] as luminance signal Y′(x,y) corresponding to the coordinate (x,y), and the processing goes to step 6j. Thus, the luminance signal Y(x,y) is converted into the corrected luminance signal Y-LUT[Y(x,y)]. Also, the picture correction function 150 outputs the luminance signals U(x,y) and V (x,y) together with the luminance signal Y′ (x,y) to the display control unit 20.
In step 6j, the picture correction function 150 checks whether all pixels contained in the picture frame to be processed are processed according to the processing designated by step 6i. If all pixels in the frame are processed, Yes in step 6j, the processing is finished; however, if at least one pixel remains unprocessed, No in step 6j, then, the processing goes back to step 6i and the processing designated by step 6i is executed until all of the pixels are processed.
As described above, in the picture processing function 100, first, the value is obtained by multiplying the luminance signal by the weight coefficient corresponding to the chrominance signals for all pixels contained in the picture frame, then, the average value is calculated from the value, and finally, the peak luminance is determined based on the average value. Subsequently, the luminance signals are corrected based on the peak luminance.
Therefore, since the luminance signal is corrected in view of the chrominance signals on a frame to frame basis by the picture processing function 100, the electric power consumption of the self-luminous display panel can be cut according to the displayed scene without degradation of the sense of brightness.
In brief, the present invention is not limited to the above embodiments, and constituent elements can be variously modified and embodied at the execution stage within the spirit and scope of the invention. Various inventions can be formed by proper combinations of a plurality of constituent elements disclosed in the above embodiments. For example, several constituent elements may be omitted from the all the constituent elements in each embodiment. In addition, constituent elements of the different embodiments may be combined as needed.
Obviously, numerous modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2008-202070 | Aug 2008 | JP | national |
