The present application claims priority from Japanese Application JP 2021-095528, the content to which is hereby incorporated by reference into this application.
The present disclosure relates to image processing devices.
In recent years, a display panel unit has been developed that includes three layers of a color liquid crystal panel, a monochrome liquid crystal panel, and a backlight as disclosed in Japanese Unexamined Patent Application Publication No. 2018-054679. A liquid crystal display device includes an image processing device that enables such a display panel unit to display an image.
The image processing device transmits control data to each of the color liquid crystal panel, the monochrome liquid crystal panel, and the backlight separately. The image processing device enables the display panel unit to display an image on the basis of the three types of control data transmitted to the three respective layers.
According to the technology disclosed in Japanese Unexamined Patent Application Publication No. 2018-054679 described above, the control data for the backlight is determined on the basis of a maximum luminance of those subpixels in the color liquid crystal panel which are in an imaginary region opposite one of the light-emitting regions of the backlight. In addition, the control data for specifying an aperture ratio for a subsequent panel is determined on the basis of previously determined control data, in the order of the backlight, the color liquid crystal panel, and the monochrome liquid crystal panel. Therefore, there is a low degree of freedom in selecting a combination of the three types of control data.
On the other hand, there are intrinsically numerous combinations of the three types of control data. In other words, it is considered that there should be a high degree of freedom in selecting a combination of the three types of control data. Therefore, it should be possible to increase variations in the display characteristics of the liquid crystal display device in accordance with the selected three types of control data.
However, according to the control method for the liquid crystal display device disclosed in Japanese Unexamined Patent Application Publication No. 2018-054679 described above, it is not possible to obtain an effect of increasing variations in the display characteristics by utilizing the high degree of freedom in selecting a combination of the three types of control data. Therefore, the capability of the liquid crystal display device including the three layers is not thoroughly exploited.
The present disclosure has been made in view of the above-described problem and its object is to provide an image processing device that enables to increase variations in the display characteristics of a liquid crystal display device.
The present disclosure is directed to an image processing device that has a display panel unit display an image, the display panel unit including: a first liquid crystal panel including a plurality of picture elements; a second liquid crystal panel opposite the first liquid crystal panel and including a plurality of pixels; and a backlight opposite the second liquid crystal panel and having a plurality of light-emitting regions, the image processing device including: a backlight data generation unit configured to generate backlight data from input image data to control outputs of the plurality of light-emitting regions; a backlight data correction unit configured to correct the backlight data; a backlight luminance distribution generation unit configured to generate luminance distribution data for the backlight from the backlight data that is corrected; a second panel data generation unit configured to generate second panel data from the input image data to control aperture ratios of the plurality of pixels; a second panel data correction unit configured to correct the second panel data; a second panel luminance distribution generation unit configured to generate luminance distribution data for the second liquid crystal panel from the second panel data that is corrected and the luminance distribution data for the backlight; and a first panel data generation unit configured to generate first panel data from the input image data and the luminance distribution data for the second liquid crystal panel to control aperture ratios of the plurality of picture elements.
The following will describe an image processing device in accordance with the present disclosure with reference to drawings. Identical and equivalent elements are denoted by the same reference numerals throughout the drawings, and description thereof is not repeated.
Referring to
The display panel unit 10 includes a first liquid crystal panel CL, a first panel drive circuit 11, a second liquid crystal panel WB, a second panel drive circuit 12, a backlight BL, and a backlight drive circuit 13.
The first liquid crystal panel CL (see
The combination of color filters for the plurality of picture elements PE in each pixel 1PX in the first liquid crystal panel CL is not necessarily limited to a red, a green, and a blue color filter. As an alternative example, the combination may be a yellow, a magenta, and a cyan color filters. The plurality of picture elements PE in the first liquid crystal panel CL have a resolution of, for example, 1,920×1,080 for each color.
The first panel drive circuit 11 drives each liquid crystal layer in the plurality of picture elements PE in the first liquid crystal panel CL in such a manner that each of the plurality of picture elements PE can have the aperture ratios specified by first panel data generated by the image processing device 100. In the present specification, the “aperture ratio” of the picture element PE refers to the actual opening area of the picture element PE as opposed to a maximum opening area of the picture element PE.
The second liquid crystal panel WB is a so-called monochrome liquid crystal panel capable of black and white displays (see
The second panel drive circuit 12 drives each liquid crystal layer in the plurality of pixels 2PX in the second liquid crystal panel WB in such a manner that the plurality of pixels 2PX can have the aperture ratios specified by corrected second panel data generated by the image processing device 100. In the present specification, the “aperture ratio” of the pixel 2PX refers to the actual opening area of the pixel 2PX as opposed to a maximum opening area of the pixel 2PX.
The backlight BL is located opposite the second liquid crystal panel WB (see
The backlight drive circuit 13 drives each of the plurality of light-emitting regions LER of the backlight BL in such a manner that the plurality of light-emitting regions LER can make the outputs specified by corrected backlight data generated by the image processing device 100.
The image processing device 100 has the display panel unit 10 display an image on the basis of externally fed input image data. The input image data has a resolution of 1,920×1,080, which is equal to the resolution of the plurality of picture elements PE. The input image data can specify a plurality of input gray scales for each of the plurality of picture elements PE in the first liquid crystal panel CL. The input image data can specify an input image by way of a plurality of input gray scales. The input image specified by the input image data is an equivalent of the output image displayed on the display panel unit 10.
The image processing device 100 includes a backlight data generation unit 1, a backlight data correction unit 2, a backlight luminance distribution generation unit 3, a second panel data generation unit 4, a second panel data correction unit 5, a second panel luminance distribution generation unit 6, and a first panel data generation unit 7. The backlight data generation unit 1, the backlight data correction unit 2, the backlight luminance distribution generation unit 3, and the second panel data generation unit 4 in the present embodiment are all implemented by electronic circuitry dedicated to image processing in accordance with the present embodiment. The second panel data correction unit 5, the second panel luminance distribution generation unit 6, and the first panel data generation unit 7 are also all implemented by electronic circuitry dedicated to image processing in accordance with the present embodiment.
Alternatively, the backlight data generation unit 1, the backlight data correction unit 2, the backlight luminance distribution generation unit 3, and the second panel data generation unit 4 may be all implemented by a general-purpose semiconductor device called a CPU (central processing unit), in which case the functions of the backlight data generation unit 1, the backlight data correction unit 2, the backlight luminance distribution generation unit 3, and the second panel data generation unit 4 are achieved by the image processing programs installed in respective units. The backlight data generation unit 1, the backlight data correction unit 2, the backlight luminance distribution generation unit 3, the second panel data generation unit 4, the second panel data correction unit 5, the second panel luminance distribution generation unit 6, and the first panel data generation unit 7 in the present embodiment are structured by physically distinguishable components.
The input image data is fed to the image processing device 100 from the outside of the liquid crystal display device 1000. The input image data, that is, the input gray scales for each of the plurality of picture elements PE in the first liquid crystal panel CL, are fed inside the image processing device 100 to the first panel data generation unit 7, the second panel data generation unit 4, and the backlight data generation unit 1.
The backlight data generation unit 1 generates backlight data for controlling the outputs the plurality of light-emitting regions LER on the basis of the input image data. The backlight data matches a 6×4 resolution. The backlight data generation unit 1 generates, from the input image data, uncorrected output values for the plurality of light-emitting regions LER of the backlight BL (e.g., ON Ratio=Actual Luminance Value/Maximum Luminance Value). The backlight data generation unit 1, as an example, acquires a representative value of the input gray scales for those picture elements PE, that is, those subpixels, which are in an imaginary region opposite one of the light-emitting regions LER. The representative value is, for example, a maximum, an average, a median, or 80% of the maximum of the input gray scales of the picture elements PE in an imaginary region opposite one of the light-emitting regions LER. Thereafter, the backlight data generation unit 1 generates, as an output value of that one of the light-emitting regions LER, a value obtained by dividing the representative value of the input gray scales for those picture elements PE in one of the imaginary regions by the upper limit value of the input gray scales. The upper limit value of the input gray scales is a maximum input gray scale.
The backlight data generation unit 1 contains a LUT (lookup table) defining the correspondence between the input grayscale data and the backlight data. Alternatively, the backlight data generation unit 1 may generate the backlight data by computation from the input image data, instead of using such a data table.
The backlight data generation unit 1 may generate smoothed (blurred) backlight data.
The backlight data correction unit 2 corrects the backlight data. For instance, the backlight data correction unit 2 increases the output value for each of the plurality of light-emitting regions LER specified by the backlight data. The backlight data correction unit 2 contains a LUT defining the correspondence between the uncorrected backlight data and the corrected backlight data. Alternatively, the backlight data correction unit 2 may calculate the corrected backlight data by computation from the uncorrected backlight data, instead of using such a data table. The backlight data correction unit 2 feeds the corrected backlight data to the backlight drive circuit 13. The corrected backlight data matches a 6'4 resolution.
The backlight luminance distribution generation unit 3 generates luminance distribution data for the backlight BL on the basis of the corrected backlight data. This backlight luminance distribution data is the luminance distribution data for the light, of the light emitted by the backlight BL, that reaches the locations of the plurality of pixels 2PX in the second liquid crystal panel WB.
The value of the backlight luminance distribution data may be determined taking into account a PSF (point spread function) from the light-emitting regions LER of the backlight BL to the pixels 2PX in the second liquid crystal panel WB. The backlight luminance distribution generation unit 3 contains a LUT defining the correspondence between the corrected backlight data and the luminance distribution data for the backlight BL. Alternatively, the backlight data correction unit 2 may generate the luminance distribution data for the second liquid crystal panel WB by computation from the corrected backlight data, instead of using such a data table.
The second panel data generation unit 4 generates the second panel data for controlling the aperture ratios of the plurality of pixels 2PX on the basis of the input image data. The second panel data matches a 240×135 resolution. The second panel data generation unit 4 generates an uncorrected aperture ratio for each of the plurality of pixels 2PX in a second liquid crystal panel CL from the input image data.
The second panel data generation unit 4, first of all, as an example, acquires a representative value of the input gray scales for those picture elements PE, that is, those subpixels, which are in an imaginary region opposite one of the pixels 2PX. The representative value is, for example, a maximum, an average, a median, or 80% of the maximum of the input gray scales of the picture elements PE in an imaginary region. Thereafter, the second panel data generation unit 4 generates, as an aperture ratio for that one of the pixels 2PX, a value obtained by dividing the representative value of the input gray scales for those picture elements PE in one of the imaginary regions by the upper limit value of the input gray scales. The upper limit value of the input gray scales is a maximum input gray scale that may be specified by the input image data.
The second panel data generation unit 4 contains a LUT defining the correspondence between the input image data and the second panel data. The second panel data generation unit 4 may generate the second panel data by computation from the input image data, instead of using such a data table.
The second panel data generation unit 4 may generate a smoothed (perspective-angle filtered) aperture ratio as the aperture ratio for this one of the pixels 2PX.
The second panel data correction unit 5 corrects the second panel data. The corrected second panel data matches a 240×135 resolution. For instance, the second panel data correction unit 5 increases the aperture ratio for each of the plurality of pixels 2PX specified by the second panel data. The second panel data correction unit 5 contains a LUT defining the correspondence between the uncorrected second panel data and the corrected second panel data.
The second panel data correction unit 5 may correct the corrected second panel data by computation from the uncorrected second panel data, instead of using such a data table. The second panel data correction unit 5 feeds the corrected second panel data to the second panel drive circuit 12.
The second panel luminance distribution generation unit 6 generates luminance distribution data for the second liquid crystal panel WB on the basis of the corrected second panel data and the luminance distribution data for the backlight BL. Specifically, the second panel luminance distribution generation unit 6 calculates, for each of the plurality of pixels 2PX, the product of an aperture ratio for one pixel 2PX and a luminance for the backlight BL in the location of the one pixel 2PX. This procedure estimates luminance in the location of each of the plurality of pixels 2PX in the second liquid crystal panel WB.
The value of the second liquid crystal panel luminance distribution data may be determined taking into account a PSF (point spread function) from the pixels 2PX in the second liquid crystal panel WB to the picture elements PE in the first liquid crystal panel CL. The second panel luminance distribution data is the luminance distribution data for the light, of the light emitted by the backlight BL, that reaches the locations of the plurality of picture elements PE in the first liquid crystal panel CL.
The second panel luminance distribution generation unit 6 contains a LUT defining the correspondence between the corrected second panel data and the luminance distribution data for the second liquid crystal panel WB. The second panel luminance distribution generation unit 6 may generate the luminance distribution data for the second liquid crystal panel CL by computation from the corrected second panel data, instead of using such a data table.
The first panel data generation unit 7 generates the first panel data for controlling the aperture ratios of the plurality of picture elements PE on the basis of the input image data and the luminance distribution data for the second liquid crystal panel WB. The first panel data generation unit 7 contains a LUT defining the correspondence between the input image data, the luminance distribution data for the second liquid crystal panel WB, and the first panel data.
The first panel data generation unit 7 may generate the first panel data by computation from the input image data and the luminance distribution data for the second liquid crystal panel WB, instead of using such a data table. The first panel data generation unit 7 feeds the first panel data to the first panel drive circuit 11.
The image processing device 100 is capable of generating separate control data for each of the backlight BL and the second liquid crystal panel WB for the following reasons. (1) Two separate data paths are provided to generate the corrected backlight data and the corrected second panel data. More particularly, the corrected backlight data is generated by the backlight data generation unit 1 and the backlight data correction unit 2 processing the input image data. The corrected second panel data is generated by the second panel data generation unit 4 and the second panel data correction unit 5 processing the input image data. The backlight data and the second panel data are not at all related in these two data paths. In other words, the backlight data and the second panel data are processed independently from each other. The processing of any of the backlight data and the second panel data therefore does not affect the processing of the other of the backlight data and the second panel data. (2) Additionally, particularly, the backlight data correction unit 2 and the second panel data correction unit 5 correct the corrected backlight data and the corrected second panel data respectively and independently from each other. The backlight data generation unit 1 and the backlight data correction unit 2 can therefore change the properties of the corrected backlight data and the properties of the corrected second panel data respectively, independently from each other, and freely.
This mechanism provides an increased degree of freedom in selecting a combination of the two types of control data (i.e., the second panel data and the backlight data). The liquid crystal display device 1000 can hence provide increased variations in display characteristics.
However, the picture elements PE in the first liquid crystal panel CL could produce an insufficient luminance because if the control data for the backlight BL and the control data for the second liquid crystal panel WB are independently generated, the output values for the backlight BL and the aperture ratios for the second liquid crystal panel WB can be independently and arbitrarily selected. When the picture elements PE in the first liquid crystal panel CL produce an insufficient luminance, the input image specified by the input image data cannot be displayed.
Accordingly, in the liquid crystal display device 1000, the backlight data correction unit 2 and the second panel data correction unit 5 correct the backlight data and the second panel data respectively in such a manner as to meet correction conditions that for each one of the plurality of picture elements PE, the luminance that can be specified for the location corresponding to one picture element PE that can be specified by the luminance distribution data for the second liquid crystal panel WB is greater than or equal to the luminance that can be specified for the one picture element PE by the input image data.
Specifically, the backlight data correction unit 2 and the second panel data correction unit 5 correct the backlight data and the second panel data respectively so as to meet the conditions represented by Bx×Mx≥Ix, where 0≤Bx≤1, 0≤Mx≤1, and 0≤Ix≤1.
Bx is the ratio of the actual luminance of the backlight BL to the maximum luminance of the backlight BL in a location corresponding to each of the plurality of picture elements PE. Mx is the aperture ratio of the pixel 2PX in the second liquid crystal panel WB in a location corresponding to each of the plurality of picture elements PE. Ix is the ratio of the input gray scale actually fed to the corresponding one of the plurality of picture elements PE to the maximum input gray scale that can be fed to each of the plurality of picture elements PE, that is, the ratio of the actual luminance of the corresponding picture element PE to the maximum luminance of the corresponding picture element PE.
The image processing device 100 in accordance with the present embodiment performing such control can prevent an inconvenient situation where the picture element PE fails to achieve a luminance corresponding to the input gray scale even if the picture element PE has an aperture ratio of 100%.
In the present embodiment, the backlight data correction unit 2 and the second panel data correction unit 5 correct the backlight data and the second panel data respectively in the following manner. For each of the plurality of light-emitting regions LER of the backlight BL, the output of one light-emitting region LER that can be specified by the corrected backlight data is greater than or equal to the output of one light-emitting region LER that can be specified by the uncorrected backlight data. In addition, for each of the plurality of pixels 2PX in the second liquid crystal panel WB, the aperture ratio of one pixel 2PX that can be specified by the corrected second panel data is greater than or equal to the aperture ratio of one pixel 2PX that can be specified by the uncorrected second panel data. Owing to these, the backlight data correction unit 2 and the second panel data correction unit 5 can easily meet the correction conditions for the backlight data and the second panel data respectively.
In other words, the backlight data correction unit 2 increases the corrected output more than the uncorrected output for the plurality of light-emitting regions LER of the backlight BL. In addition, the second panel data correction unit 5 increases the corrected aperture ratio more than the uncorrected aperture ratio for the plurality of pixels 2PX in the second liquid crystal panel WB.
Meanwhile, the first panel data generation unit 7 determines an aperture ratio for the plurality of picture elements PE on the basis of the luminance distribution data for the second liquid crystal panel CL and the aperture ratios of the plurality of picture elements PE in such a manner that the display panel unit 10 can display an input image specified by the input image data. Therefore, the luminances of a plurality of rays of light passing through the plurality of picture elements PE generally match the respective luminances in a plurality of locations in the input image corresponding respectively to the plurality of picture elements PE specified by the input image data. The display panel unit 10 can hence easily display an input image specified by the input image data.
A comparison of
Each pixel 2PX in the second liquid crystal panel WB is controlled by the image processing device 100 so as to, for example, achieve a maximum luminance for the input gray scale for those picture elements PE which are in a single imaginary region opposite the pixel 2PX that can be specified by the input image data.
Each light-emitting region LER of the backlight BL is controlled by the image processing device 100 so as to, for example, achieve a maximum luminance for the input gray scale for those picture elements PE which are in a single imaginary region opposite the light-emitting region LER that can be specified by the input image data.
Referring to
For each of the plurality of pixels 2PX, the aperture ratio of one pixel that can be specified by the corrected second panel data is greater than the luminance ratio in the location of one pixel that can be specified by the luminance distribution data for the backlight. In such a case, the luminance ratio is the ratio of the actual luminance of the backlight BL to a maximum output luminance of the backlight BL in the location of one pixel 2PX. Specifically, Bx<Mx, where 0≤Bx≤1 and 0≤Mx≤1. Bx is the ratio of the actual luminance of the backlight BL to a maximum luminance of the backlight BL in the location of each of the plurality of pixels 2PX. Mx is the aperture ratio of each of the plurality of pixels 2PX. Referring to
The correction by the backlight data correction unit 2 and the second panel data correction unit 5 enables maintaining the gray scales of the second liquid crystal panel WB at relatively high values while restraining the output (ON Ratio=Actual Luminance/Maximum Luminance Value) of the backlight BL at relatively low values. Accordingly, the power consumption of the liquid crystal display device 1000 can be reduced without having to lose the advantage of improved contrast between the picture elements PE when the three layers of the first liquid crystal panel CL, the second liquid crystal panel WB, and the backlight BL are used.
The following will describe a liquid crystal display device 1000 in accordance with Embodiment 2 with reference to
For each of the plurality of pixels 2PX, the aperture ratio of one pixel that can be specified by the corrected second panel data is smaller than the luminance ratio in the location of one pixel 2PX that can be specified by the luminance distribution data for the backlight BL. In such a case, the luminance ratio is the ratio of the actual luminance of the backlight BL to a maximum output luminance of the backlight BL in the location of one pixel 2PX. Specifically, Bx>Mx, where 0≤Bx≤1 and 0≤Mx≤1. Bx is the ratio of the actual luminance of the backlight BL to a maximum luminance of the backlight BL in the locations of the plurality of pixels 2PX. Mx is the aperture ratio each of the plurality of pixels 2PX. Referring to
This configuration can maintain the output (ON ratio) of the backlight BL at relatively high values. The output of the backlight BL and the aperture ratio of the second liquid crystal panel WB (monochrome liquid crystal panel) are only significantly changed when the input gray scale is extremely small. Accordingly, the configuration can reduce to a minimum the adverse effects of halo effect that occurs at a boundary where the output of the backlight BL significantly changes.
The following will describe a liquid crystal display device 1000 in accordance with Embodiment 3 with reference to
For each of the plurality of picture elements PE, the aperture ratio of one picture element that can be specified by the first panel data is greater than or equal to the aperture ratio of one pixel 2PX in a location corresponding to one picture element PE. Specifically, Bx>Mx, and Mx≤Cx, where 0≤Bx≤1, 0≤Mx≤1, and 0≤Cx≤1. Bx is the ratio of the actual luminance of the backlight BL to the maximum luminance of the backlight BL in the locations corresponding to the plurality of picture elements PE. Mx is the aperture ratio of the pixel 2PX in the location corresponding to the location of each of the plurality of picture elements PE. Cx is the aperture ratio of each of the plurality of picture elements PE. Referring to
The liquid crystal display device 1000 in accordance with Embodiment 3 preferentially determines gray scales for the second liquid crystal panel WB (monochrome liquid crystal panel), and only when the input grayscale data specified by the input image data is small, significantly changes aperture ratios for the first liquid crystal panel CL (color liquid crystal panel). This configuration can make the most use of the capability of the first liquid crystal panel CL to fine-tune gray scales. The configuration thus enhances the gray scale properties, particularly, in dark portions of the image. To describe in further detail, the gray scale control in the liquid crystal display device 1000 in accordance with Embodiment 3 comes from the concept that the gray scales are roughly adjusted by the second liquid crystal panel WB and finely adjusted by the first liquid crystal panel CL. For instance, when some input gray scales are small in the input image data, and the luminance values for the plurality of pixels 2PX in the second liquid crystal panel WB are somewhat close to the targeted low luminance values, the luminance of the picture element PE can be fine-tuned as a final step by using all the 255 gray scales (for 8-bit data) for the first liquid crystal panel CL. The liquid crystal display device 1000 in accordance with Embodiment 3 can hence display an image with smoother luminance changes.
The liquid crystal display device 1000 in accordance with the present embodiment differs from the liquid crystal display device 1000 in accordance with Embodiment 1 in that in the former, all the units in the image processing device 100 are provided by control processes performed by image processing programs. The liquid crystal display device 1000 in accordance with the present embodiment is otherwise the same as the liquid crystal display device 1000 in accordance with Embodiment 1.
More specifically, the backlight data generation unit 1, the backlight data correction unit 2, the backlight luminance distribution generation unit 3, and the second panel data generation unit 4 are provided by control processes performed by image processing programs. In addition, the second panel data correction unit 5, the second panel luminance distribution generation unit 6, and the first panel data generation unit 7 are also provided by control processes performed by image processing programs.
In other words, the computer serving as the image processing device 100 includes, as a main hardware element, a processor that operates under image processing programs, for example, a CPU (central processing unit). The processor may be of any type so long as the processor is capable of implementing functions by executing image processing programs. The processor includes one or more electronic circuits including a semiconductor integrated circuit, for example, an IC (integration circuit) or an LSI (large scale integration) circuit. The electronic circuits may be integrated into a single chip and may be provided in a plurality of chips. The plurality of chips may be combined into a single device and may be provided in a plurality of devices.
The image processing programs are contained in a non-transitory storage medium such as a computer-readable ROM (read-only memory), an optical disc, or a hard disk drive. A content provision program may be stored in a storage medium in advance and may be delivered to a storage medium over a wide-area communication network such as the Internet.
Number | Date | Country | Kind |
---|---|---|---|
2021-095528 | Jun 2021 | JP | national |