The present disclosure relates to a display driver, a display device and an image processing circuitry, more particularly, to subpixel rendering.
The subpixel rendering is a technique for displaying an image with a resolution higher than the original resolution of a display device, such as OLED (organic light emitting diode) display panels and LCD (liquid crystal display) panels, by performing image data processing on image data of the original image. In the following, image data process for achieving subpixel rendering may be referred to as subpixel rendering process. A subpixel rendering process involves generating image data used for driving M pixels of a display device from image data associated with N pixels of the original image, where N and M are natural numbers satisfying N>M.
A subpixel rendering process is achieved in light of gamma characteristics of the display device. Discussed below is the case where image data used for driving one pixel of a display device is generated from image data associated with two pixels of the original image through a subpixel rendering process, while the grayscale value of each subpixel is represented by eight bits in the image data of the original image and the image data used for driving each pixel of the display device. When the grayscale values of the R subpixels of first and second pixels are described as being “255” and “0”, respectively, in the image data of the original image, and the grayscale value of the R subpixel of the corresponding pixel of the display device is calculated by simply averaging the grayscale values of the R subpixels of first and second pixels in the subpixel rendering process, the result is a grayscale value of “127.5”. When the R subpixel of the corresponding pixel of the display device is driven with the grayscale value of “127.5”, the brightness of the R subpixel becomes 22% for a gamma value γ of 2.2. However, in one embodiment, the R subpixel of the corresponding pixel of the display device is driven so that the brightness of the R subpixel becomes 50%, since the grayscale value of “255” corresponds to the brightness of 100% and the grayscale value of “0” corresponds to the brightness of 0%. When the gamma value γ of the display device is 2.2, the grayscale value of the R subpixel of the corresponding pixel of the display device is calculated as “186” in the subpixel rendering process.
Accordingly, a subpixel rendering process generally includes performing gamma conversion on the grayscale values described in image data of the original image (that is, calculating the γ powers of the grayscale values of the image data), calculating image data associated with M pixels of the display device on the basis of the image data obtained by the gamma conversion, and then performing inverse gamma conversion (that is, calculating the 1/γ powers of the grayscale values of the image data).
Such subpixel rendering process may cause an increase in the circuit size. The gamma conversion and the inverse gamma conversion involve calculation of a power. As widely known to persons skilled in the art, a circuit performing calculation of a power has a large circuit size. For example, to perform a gamma conversion or an inverse gamma conversion is to use an LUT (lookup table); however, use of an LUT to achieve gamma conversion or inverse gamma conversion increases the circuit size.
Thus, there is a technical need of reducing the circuit size of a circuit which performs a subpixel rendering process.
In one embodiment, a display driver includes: a subpixel rendering circuitry configured to generate, from input image data describing input grayscale values which are grayscale values of subpixels of N pixels of an input image, output image data describing output grayscale values which are grayscale values of subpixels of M corresponding pixels of an output image corresponding to the N pixels of the input image, N being an integer of two or more and M being an integer satisfying 1≤M<N; and a drive circuitry configured to drive a display panel in response to the output image data. The subpixel rendering circuitry is configured to calculate input-side squared grayscale values which are squares of the input grayscale values for the respective N pixels of the input image, calculate correction values associated with the M corresponding pixels from a correction parameter determined in response to a gamma value set to the display driver and the input grayscale values, and generate the output image data by processing the input-side squared grayscale values based on the correction values.
In another embodiment, an image processing circuitry includes a subpixel rendering circuitry configured to generate, from input image data describing input grayscale values associated with N pixels of an input image, output image data describing output grayscale values associated with M corresponding pixels of an output image corresponding to the N pixels of the input image, N being an integer of two or more and M being an integer satisfying 1≤M<N. The subpixel rendering circuitry includes: a square calculation circuitry configured to calculate input-side squared grayscale values which are squares of the input grayscale values for the respective N pixels of the input image, and a processing circuitry configured to calculate correction values associated with the M corresponding pixels from a correction parameter determined in response to a gamma value set to the display driver and the input grayscale values, and generate the output image data by processing the input-side squared grayscale values based on the correction values.
In still another embodiment, a display device includes a display panel and a display driver driving the display panel. The display driver includes: a subpixel rendering circuitry configured to generate, from input image data describing input grayscale values associated with N pixels of an input image, output image data describing output grayscale values associated with M corresponding pixels of an output image corresponding to the N pixels of the input image, N being an integer of two or more and M being an integer satisfying 1≤M<N; and a drive circuitry configured to drive the display panel in response to the output image data. The subpixel rendering circuitry is configured to calculate input-side squared grayscale values which are squares of the input grayscale values for the respective N pixels of the input image, calculate correction values associated with the M corresponding pixels from a correction parameter determined in response to a gamma value set to the display driver and the input grayscale values, and generate the output image data by processing the input-side squared grayscale values based on the correction values.
In still another embodiment, a display driver for driving a display panel includes: a subpixel rendering circuitry configured to perform a subpixel rendering process on first image data to generate second image data; an eight-color halftoning circuitry configured to perform an eight-color halftoning process on the second image data to generate third image data which describe a grayscale value of each of an R subpixel, a G subpixel and a B subpixel of each pixel with one bit; and a drive circuitry configured to drive the display panel in response to the third image data. The eight-color halftoning circuitry includes a storage circuitry configured to store a dither table, and is configured to generate the third image data by performing a dithering process on the second image data using a dither value selected from elements of a dither table. The frequency distribution of values of the elements of the dither table is uneven.
In still another embodiment, a display device includes a display panel and a display driver. The display driver includes a subpixel rendering circuitry configured to perform a subpixel rendering process on first image data to generate second image data; an eight-color halftoning circuitry configured to perform an eight-color halftoning process on the second image data to generate third image data which describe a grayscale value of each of an R subpixel, a G subpixel and a B subpixel of each pixel with one bit; and a drive circuitry configured to drive the display panel in response to the third image data. The eight-color halftoning circuitry includes a storage circuitry configured to store a dither table, and is configured to generate the third image data by performing a dithering process on the second image data using a dither value selected from elements of a dither table, when the third image data associated with a pixel of interest of the display panel is generated. The frequency distribution of values of the elements of the dither table is uneven.
In the following, a description is given of embodiments of the present disclosure with reference to the attached drawings.
The display panel 1 includes gate lines 4, data lines 5, pixel circuits 6 and gate line drive circuitries 7. Each pixel circuit 6 is disposed at an intersection of a gate line 4 and a data line 5 and configured to display one of the red, green and blue colors. Pixel circuits 6 which display the red color are used as R subpixels. Similarly, pixel circuits 6 which display the green color are used as G subpixels, and pixel circuits 6 which display the blue color are used as B subpixels. When an OLED display panel is used as the display panel 1, in one embodiment, the pixel circuits 6 which display the red color may include an light emitting element which emits red light, the pixel circuits 6 which display the green color may include an light emitting element which emits green light, and the pixel circuits 6 which display the blue color may include an light emitting element which emits blue light.
As illustrated in
Referring back to
The display driver 2 drives the display panel 1 in response to image data 32 and control data 33 received from a host 3 to display images on the display panel 1. The image data 32 describe the grayscale value of each subpixel of each pixel of an image to be displayed (or an original image). The control data 33 include commands and parameters used for controlling the display driver 2. An application processor, a CPU (central processing unit), a DSP (digital signal processor) or the like may be used as the host 3.
The interface control circuitry 11 operates as follows. First, the interface control circuitry 11 forwards the image data 32 received from the host 3 to the image processing circuitry 12. The interface control circuitry 11 further stores various parameters included in the control data 33 into the register 16 and controls the respective circuitries of the display driver 2 in response to commands included in the control data 33.
The image processing circuitry 12 performs a desired image data process on the image data 32 received from the interface control circuitry 11 to generate display data 34 used for driving the display panel 1. As described later In one embodiment, the image data process performed in the image processing circuitry 12 includes a subpixel rendering process. Details of the subpixel rendering process performed in the image processing circuitry 12 will be described later. The image data process performed in the image processing circuitry 12 may include processes other than the subpixel rendering process (e.g. color adjustment).
The latch circuitry 13 latches the display data 34 from the image processing circuitry 12 and forwards the latched display data 34 to the data line drive circuitry 15.
The grayscale voltage generator circuitry 14 generates a set of grayscale voltages respectively corresponding to the allowed values of the grayscale values described in the display data 34.
The data line drive circuitry 15 drives the respective data lines 5 with the grayscale voltages corresponding to the values of the display data 34. In one embodiment, the data line drive circuitry 15 selects ones of the grayscale voltages received from the grayscale voltage generator circuitry 14 corresponding to the values of the display data 34, and drives the respective data lines 5 to the selected grayscale voltages.
The register 16 stores therein various control parameters used to control the operation of the display driver 2. The register 16 is configured to be rewritable from outside of the display driver 2, for example, from the host 3. The control parameters stored in the register 16 include a correction parameter α used to control the subpixel rendering process performed in the image processing circuitry 12. The content and technical meaning of the correction parameter α will be described later In one embodiment.
The input image data DIN supplied to the subpixel rendering circuitry 20 may be the image data 32 supplied to the image processing circuitry 12 from the interface control circuitry 11. Alternatively, image data obtained by performing desired image data processing on the image data 32 may be used as the input image data DIN. The output image data DOUT output from the subpixel rendering circuitry 20 may be used as the display data 34 supplied to the data line drive circuitry 15. Alternatively, image data obtained by performing desired image data processing on the output image data DOUT may be used as the display data 34 and supplied to the data line drive circuitry 15.
In this embodiment, the subpixel rendering circuitry 20 includes a square calculation circuitry 21, a subpixel rendering calculation circuitry 22, a square root calculation circuitry 23, a correction value calculation circuitry 24 and an adder circuitry 25.
The square calculation circuitry 21 calculates the square of the input grayscale value for each subpixel of each pixel of the input image. The value of the square of an input grayscale value may be referred to as the input-side squared grayscale value.
The subpixel rendering calculation circuitry 22 calculates SPR-processed (subpixel rendering processed) squared grayscale value for each subpixel of each pixel of the output image, from the input-side squared grayscale value calculated for each subpixel of each pixel of the input image. The SPR-processed squared grayscale value approximately corresponds to the square of the grayscale value of each subpixel of each pixel of the output image. It should be noted however that, as will be understood from the following description, the square root of the SPR-processed squared grayscale value calculated for each subpixel of each pixel of the output image may not be used as the grayscale value of each subpixel of each pixel of the output image. The SPR-processed squared grayscale value of a subpixel of a specific color (for example, red, green or blue) of a specific pixel of the output image is calculated from the input-side squared grayscale values calculated for the subpixels of the specific color of the pixels of the input image corresponding to the specific pixel of the output image.
The square root calculation circuitry 23 calculates the square root (that is, ½ power) of the SPR-processed squared grayscale value calculated for each subpixel of each pixel of the output image.
The correction value calculation circuitry 24 calculates a correction value ΔD for each subpixel of each pixel of the output image. The correction parameter α stored in the register 16 is used to calculate the correction value ΔD. The calculated correction value ΔD is supplied to the adder circuitry 25.
The adder circuitry 25 adds the correction value ΔD calculated for each subpixel of each pixel of the output image to the square root of the SPR-processed squared grayscale value calculated for each subpixel of each pixel of the output image. The output of the adder circuitry 25 is the output image data DOUT. The grayscale value of a specific subpixel of a specific pixel of the output image described in the output image data DOUT is calculated as the sum of the square root of the SPR-processed squared grayscale value calculated for the specific subpixel and the correction value ΔD calculated for the specific subpixel.
As described above, a commonly-used subpixel rendering process includes a gamma conversion, an arithmetic process of image data, and an inverse-gamma conversion. The gamma conversion includes calculation of a γ power, and the inverse gamma conversion includes calculation of a 1/γ power, where γ is the gamma value. The circuit size of a circuit which performs the gamma conversion or the inverse gamma conversion is large as described above.
The subpixel rendering circuitry 20 of this embodiment is configured so that square calculation (e.g., calculation to obtain a square) is performed in place of the gamma conversion and square root calculation (e.g., calculation to obtain a square root) is performed in place of the inverse gamma conversion, while the error caused by these calculations is compensated by adding the correction value ΔD. The square calculation and square root calculation can be implemented by a circuit of a smaller circuit size than that of a circuit which calculates a power. Although the use of the square calculation and the square root calculation in place of the gamma conversion and the inverse gamma conversion may cause an error, this error can be compensated by adding the correction value ΔD. Accordingly, the configuration of the subpixel rendering circuitry 20 of this embodiment effectively reduces the circuit size.
In the following, the operation of the subpixel rendering circuitry 20 to generate the output image data DOUT is described for the case where the ratio of the number of the pixels of the input image to that of the output image is 3:2. In other embodiments, other ratios may be used.
In the subpixel rendering process illustrated in
For the case where k is zero, that is, for the calculation of the output image data DOUT associated with the leftmost pixel Pout #0 of the output image, pixel Pin #0 of the input image is positioned leftmost in the horizontal direction and pixel Pin #(−1) does not exist. To address this, the output image data DOUT associated with pixel Pout #0 of the output image is calculated by using the input image data DIN associated with pixel Pin #1, in place of the input image data DIN associated with pixel Pin #(−1). In other words, the output image data DOUT associated with pixel Pout #0 of the output image is calculated from the input image data DIN associated with pixels Pin #1, Pin #0, Pin #1 and Pin #2 of the input image. Also in this case, the output image data DOUT associated with two pixels Pout #0 and #1 of the output image can be virtually considered as being calculated from the input image data DIN associated with four pixels Pin #1, Pin #0, Pin #1 and Pin #2 of the input image.
In various embodiment, the subpixel rendering process performed by the subpixel rendering circuitry 20, comprises calculating the output image data DOUT associated with two pixels Pout #(2k) and Pout #(2k+1) from the input image data DIN associated with four pixels Pin #(3k−1), Pin #(3k), Pin #(3k+1) and Pin #(3k+2). For example, the output image data DOUT of two pixels Pout #2 and Pout #3 of the output image are calculated from four pixels Pin #2, Pin #3, Pin #4 and Pin #5 of the input image in this subpixel rendering process. In various embodiments, for the case where k=0, the input image data DIN associated with pixel Pin #1 is used in place of the input image data DIN associated with pixel Pin #(−1).
In one or more embodiments, the input image data DIN associated with the four pixels Pin #(3k−1), Pin #(3k), Pin #(3k+1) and Pin #(3k+2) of the input image may be referred to as the input image data DIN0, DIN1, DIN2 and DIN3, respectively. The input image data DIN0 describes the grayscale value R0 of the R subpixel of the pixel Pin #(3k−1), the grayscale value G0 of the G subpixel, and the grayscale value B0 of the B subpixel, and the input image data DIN1 describes the grayscale value R1 of the R subpixel of the pixel Pin #(3k), the grayscale value G1 of the G subpixel, and the grayscale value B1 of the B subpixel. Similarly, the input image data DIN2 describes the grayscale value R2 of the R subpixel of the pixel Pin #(3k+1), the grayscale value G2 of the G subpixel, and the grayscale value B2 of the B subpixel, and the input image data DIN3 describes the grayscale value R3 of the R subpixel of the pixel Pin #(3k+2), the grayscale value G3 of the G subpixel, and the grayscale value B3 of the B subpixel. In the various embodiments, the grayscale value Ri of the R subpixel described in the input image data DINi, the grayscale value Gi of the G subpixel and the grayscale value Bi of the B subpixel may be referred to as input grayscale values Ri, Gi and Bi, respectively, where i is an integer from zero to three.
In some embodiments, the output image data DOUT associated with two pixels Pout #(2k) and Pout #(2k+1) of the output image may be referred to as the output image data DOUT0 and DOUT1. The output image data DOUT0 describes the grayscale value NewR0 of the R subpixel of the pixel Pout #(2k) of the output image, the grayscale value NewG0 of the G subpixel and the grayscale value NewB0 of the B subpixel, and the output image data DOUT1 describes the grayscale value NewR1 of the R subpixel of pixel Pout #(2k+1) of the output image, the grayscale value NewG1 of the G subpixel and the grayscale value NewB1 of the B subpixel. In one or more embodiments, the grayscale value NewRj of the R subpixel described in the output image data DOUTj, the grayscale value NewGj of the G subpixel and the grayscale value NewBj of the B subpixel may be referred to as output grayscale values NewRj, NewGj and NewBj, respectively, where j is zero or one.
Input-side squared grayscale values R02, R12, R22 and R32, which are the squares of the input grayscale values R0, R1, R2 and R3, respectively (that is the grayscale values R0, R1, R2 and R3 of the R subpixels of pixels Pin #(3k−1), Pin #(3k), Pin #(3k+1) and Pin #(3k+2) of the input image) are calculated by the square calculation circuitry 21.
SPR-processed squared grayscale values RSUB02 and RSUB12 of the R subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image are further calculated from the input-side squared grayscale values R02, R12, R22 and R32 by the subpixel rendering calculation circuitry 22. The SPR-processed squared grayscale values RSUB02 and RSUB12 are calculated in accordance with the following expressions (1a) and (1b):
Furthermore, the square roots RSUB0 and RSUB1 of the SPR-processed squared grayscale values RSUB02 and RSUB12 of the R subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image are calculated by the square root calculation circuitry 23.
Further, in some embodiments, the correction value calculation circuitry 24 calculates correction values ΔR0 and ΔR1 for the respective R subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image in accordance with the following expressions (2a) and (2b):
The correction parameter α used in expressions (2a) and (2b) is stored in the register 16, and the correction value calculation circuitry 24 calculates the correction values ΔR0 and ΔR1 using the correction parameter α received from the register 16. The correction parameter α is calculated in accordance with the following expression (3a):
where γ is the gamma value of the display panel 1 (the gamma value set to the display driver 2), and MAX is the allowed maximum value of the grayscale value of each subpixel of each pixel in the input image data DIN and the output image data DOUT. In some embodiments, when both of the input image data DIN and the output image data DOUT describe the grayscale value of each subpixel of each pixel with eight bits, it holds:
MAX=255(=28−1).
In this case, expression (3a) can be rewritten into the following expression (3b):
The adder circuitry 25 calculates the output grayscale values NewR0 and NewR1 (that is, the grayscale values NewR0 and NewR1 of the R subpixels of pixels Pout #(2k) and Pout #(2k+1)) by adding the correction values ΔR0 and ΔR1 to the square roots RSUB0 and RSUB1 calculated for the R subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image, respectively. In other words, the adder circuitry 25 calculates the output grayscale values NewR0 and NewR1 in accordance with the following expressions (4a) and (4b):
NewR0=RSUB0+ΔR0, and (4a)
NewR1=RSUB1+αR1 (4b)
According to the calculation described above, the output grayscale values NewR0 and NewR1 are resultantly calculated in accordance with the following expressions (5a) and (5b), as a whole of the subpixel rendering circuitry 20:
In various embodiments, the calculation of the output grayscale values NewR0 and NewR1 in accordance with expressions (5a) and (5b) allows obtaining grayscale values approximate to those obtained by strictly performing a subpixel rendering process based on gamma conversion and inverse gamma conversion.
In one or more embodiments, when a subpixel rendering process is strictly performed using gamma conversion and inverse gamma conversion, the output grayscale value NewR0 and NewR1 of the R subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image are calculated in accordance with the following expressions (6a) and (6b):
When γ is approximately equal to two, the following approximation expressions (7a) and (7b) hold:
The right sides of expressions (5a) and (5b) can be obtained by substituting R0, R1, R2 and R3 into A, B, C and D of the right sides of expressions (7a) and (7b), respectively. This implies that an approximation can be achieved with a sufficient accuracy by calculating the output grayscale value NewR0 and NewR1 in accordance with expressions (5a) and (5b). According to an inventors' study, for a gamma value γ from 2.0 to 3.0, a sufficient accuracy can be achieved by calculating the output grayscale values NewR0 and NewR1 with a correction parameter α of seven bits in accordance with expressions (5a) and (5b).
Expressions 8a and 8b illustrate a calculation example for the case where the gamma value γ of the display panel 1 is 2.2. When the gamma value γ is 2.2, the correction parameter α is set to “44” as understood from
The calculated output grayscale values NewR0 and NewR1 are equal to the values obtained by strictly performing the subpixel rendering process with gamma conversion and inverse gamma conversion.
When the gamma value γ is 2.0, the correction parameter α calculated in accordance with expression (3a) or (3b) is infinite. In this case, in one embodiment, the correction values ΔR0 and ΔR1 may be calculated as zero by the correction value calculation circuitry 24. To achieve such operation, the display driver 2 may be configured such that a flag which is asserted when the gamma value γ is 2.0 is prepared in the register 16 and the correction value calculation circuitry 24 is configured to unconditionally set the correction values ΔR0 and ΔR1 to zero when the flag is asserted.
The grayscale values NewG0 and NewG1 of the G subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image and the grayscale values NewB0 and NewB1 of the B subpixels are calculated in a similar way.
In one embodiment, input-side squared grayscale values G02, G12, G22 and G32, which are squares of the grayscale values G0, G1, G2 and G3 of the G subpixels of pixels Pin #(3k−1), Pin #(3k), Pin #(3k+1) and Pin #(3k+2) of the input image, and input-side squared grayscale values B02, B12, B22 and B32, which are squares of the grayscale values B0, B1, B2 and B3 of the B subpixels, are calculated by the square calculation circuitry 21.
SPR-processed squared grayscale values GSUB02 and GSUB12 of the G subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image are further calculated from the input-side squared grayscale values G02, G12, G22 and G32 by the subpixel rendering calculation circuitry 22, and SPR-processed squared grayscale values BSUB02 and BSUB12 of the B subpixels are calculated from the input-side squared grayscale values B02, B12, B22 and B32. The SPR-processed squared grayscale values GSUB02, GSUB12, BSUB02 and BSUB12 are calculated in accordance with the following expressions (9a), (9b), (10a) and (10b):
Furthermore, the square roots GSUB0 and GSUB1 of the SPR-processed squared grayscale values GSUB02 and GSUB12 of the G subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image and the square roots BSUB0 and BSUB1 of the SPR-processed squared grayscale values BSUB02 and BSUB12 of the B subpixels are calculated by the square root calculation circuitry 23.
Further, in some embodiments, the correction value calculation circuitry 24 calculates correction values ΔG0 and ΔG1 for the respective G subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image in accordance with the following expressions (11a) and (11b) and calculates correction values ΔB0 and ΔB1 for the respective B subpixels in accordance with the following expressions (12a) and (12b):
The adder circuitry 25 calculates the grayscale values NewG0 and NewG1 of the G subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image by adding the correction values ΔG0 and ΔG1 to the square roots GSUB0 and GSUB1 calculated for the G subpixels of pixels Pout #(2k) and Pout(2k+1) of the output image, respectively. Similarly, the adder circuitry 25 also calculates the grayscale values NewB0 and NewB1 of the B subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image by adding the correction values ΔB0 and ΔB1 to the square roots BSUB0 and BSUB1 calculated for the B subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image, respectively.
In other words, the adder circuitry 25 calculates the grayscale values NewG0 and NewG1 of the G subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image and the grayscale values NewB0 and NewB1 of the B subpixels in accordance with the following expressions (13a), (13b) (14a) and (14b):
NewG0=GSUB0+ΔG0 ,(13a)
NewG1=GSUB1+ΔG1 ,(13b)
NewB0=BSUB0+ΔB0, and (14a)
NewB1=BSUB1+ΔB1 .(14b)
According to the calculation described above, the grayscale values NewG0 and NewG1 of the G subpixels of pixels Pout #(2k) and Pout #(2k+1) of the output image and the grayscale values NewB0 and NewB1 of the B subpixels are resultantly calculated in accordance with the following expressions (15a), (15b), (16a) and (16b), as a whole of the subpixel rendering circuitry 20:
In various embodiments, the calculation of the grayscale values NewG0 and NewG1 of the G subpixels of pixels Pout #(2k) and Pout #(2k+1) and the grayscale values NewB0 and NewB1 of the B subpixels in accordance with expressions (15a), (15b), and (16a) and (16b) achieves a sufficiently accurate approximation.
As described above, the subpixel rendering circuitry 20 of this embodiment is configured to perform square calculation in place of gamma conversion and perform square root calculation in place of inverse gamma conversion, while compensating the error caused by such operation by adding a correction value. Such configuration of the subpixel rendering circuitry 20 of this embodiment effectively reduces the circuit size thereof.
In one embodiment, the subpixel rendering circuitry 20 of this embodiment also offers an advantage that the gamma value γ can be easily modified by modifying the correction parameter α stored in the register 16. When the register 16 can be rewritten from the host 3, the host 3 may access the register 16 to modify the correction parameter α stored in the register 16. For example, as is understood from
Although the above-described embodiment recites the configuration in which output image data DOUT associated with two pixels of the output image are calculated from input image data DIN associated with four pixels of the input image, a subpixel rendering process may be generally achieved in a similar procedure also for the case where output image data DOUT associated with M pixels of the output image are calculated from input image data DIN associated with N pixels of the input image, for N being an integer two or more, and M being an integer satisfying 1≤M<N.
In the subpixel rendering process illustrated in
For the case where k is zero, that is, for the calculation of the output image data DOUT associated with the leftmost pixel Pout #0 of the output image, pixel Pin #0 of the input image is positioned leftmost in the horizontal direction and pixel Pin #(−1) does not exist. In various embodiments, to address this, the output image data DOUT associated with pixel Pout #0 of the output image is calculated by using the input image data DIN associated with pixel Pin #1, in place of the input image data DIN associated with pixel Pin #(−1). In other words, the output image data DOUT associated with pixel Pout #0 of the output image is calculated from the input image data DIN associated with pixels Pin #1, Pin #0 and Pin #1 of the input image. Also in this case, the output image data DOUT associated with pixel Pout #0 of the output image can be virtually considered as being calculated from the input image data DIN associated with three pixels Pin #1, Pin #0 and Pin #1 of the input image.
Input-side squared grayscale values R02, R12 and R22, which are the squares of the grayscale values R0, R1 and R2 of the R subpixels of pixels Pin #(2k−1), Pin #(2k) and Pin #(2k+1) of the input image (the input grayscale values R0, R1 and R2) are calculated by the square calculation circuitry 21.
An SPR-processed squared grayscale values RSUB2 of the R subpixel of pixel Pout #k of the output image is then calculated from the input-side squared grayscale values R02, R12 and R22 by the subpixel rendering calculation circuitry 22. The SPR-processed squared grayscale values RSUB2 is calculated in accordance with the following expression (17):
Furthermore, the square root RSUB of the SPR-processed squared grayscale values RSUB2 of the R subpixel of pixel Pout #k of the output image is calculated by the square root calculation circuitry 23.
Meanwhile, the correction value calculation circuitry 24 calculates a correction value ΔR in accordance with the following expression (18):
The correction parameter α in expression (18) is stored in the register 16, and the correction value calculation circuitry 24 calculates the correction value ΔR using the correction parameter α received from the register 16.
The adder circuitry 25 calculates the output grayscale value NewR (that is, the grayscale value NewR of the R subpixel of pixel Pout #k) by adding the correction values ΔR to the square root RSUB calculated for the R subpixel of pixel Pout #k of the output image. In other words, the adder circuitry 25 calculates the output grayscale value NewR in accordance with the following expressions (19):
NewR=RSUB+ΔR. (19)
According to the calculation described above, the output grayscale value NewR is resultantly calculated in accordance with the following expression (20), as a whole of the subpixel rendering circuitry 20:
The grayscale value NewG of the G subpixel of pixel Pout #k and the grayscale value NewB of the B subpixel are calculated in a similar way. It would be easily understood by a person skilled in the art from the above-described discussion that the calculation of the grayscale value NewR of the R subpixel of pixel Pout #k, the grayscale value NewG of the G subpixel and the grayscale value NewB of the B subpixel in this way achieves a sufficiently accurate approximation.
In one embodiment, as illustrated in
As illustrated, the display driver 2A includes an interface control circuitry 41, an image processing circuitry 42, a grayscale voltage generator circuitry 43, a data line drive circuitry 44, a timing control circuitry 45 and a panel interface circuitry 46.
In various embodiments, the interface control circuitry 41 forwards the image data 32 received from the host 3 to the image processing circuitry 42. Additionally, the interface control circuitry 41 controls the respective circuitries of the display driver 2 in response to control parameters and commands included in the control data 33. The image processing circuitry 42 generates display data 34 used to drive the display panel 1 by performing image data processing on the image data 32 received from the interface control circuitry 41. The grayscale voltage generator circuitry 43 generates a set of grayscale voltages V0 to VM respectively corresponding to the allowed values of the grayscale values described in the display data 34. The data line drive circuitry 44 drives the respective data lines 5 with the grayscale voltages corresponding to the grayscale values described in the display data 34. In one embodiment, the data line drive circuitry 44 selects the grayscale voltages corresponding to the grayscale values described in the display data 34 for the respective data lines 5, from among the grayscale voltages V0 to VM received from the grayscale voltage generator circuitry 43, and drives the respective data lines 5 to the selected grayscale voltages. The timing control circuitry 45 performs timing control of the respective circuitries of the display driver 2 in response to control signals received from the interface control circuitry 41. The panel interface circuitry 46 supplies the gate control signals 31 to the gate line drive circuitries 7 of the display panel 1 to thereby control the gate line drive circuitries 7.
In this embodiment, the grayscale voltage generator circuitry 43 is configured to stop generating the grayscale voltages corresponding to intermediate grayscale values (that is, the grayscale voltages other than the grayscale voltages corresponding to the allowed maximum and minimum grayscale values). Out of the grayscale voltages V0 to VM, the grayscale voltage V0 corresponds to the allowed minimum grayscale value and the grayscale voltage VM corresponds to the allowed maximum grayscale value. Accordingly, the grayscale voltages V1 to VM-1 respectively correspond to the intermediate grayscale values. In response to an instruction by the grayscale voltage control signals supplied from the interface control circuitry 41, the grayscale voltage generator circuitry 43 stops generating the grayscale voltages V1 to VM-1, which correspond to the intermediate grayscale values.
In one or more embodiments, the gamma characteristics of the data line drive circuitry 44 depend on the distribution of the voltage levels of the grayscale voltages V0 to VM supplied from the grayscale voltage generator circuitry 43. To set the data line drive circuitry 44 to desired gamma characteristics, the distribution of the voltage levels of the grayscale voltages V0 to VM is determined in accordance with the desired gamma characteristics. The grayscale voltages V0 to VM generated by the grayscale voltage generator circuitry 43 are controlled by grayscale voltage control signals supplied from the interface control circuitry 41.
The gamma characteristics of the entire display driver 2 are determined as a superposition of the gamma characteristics of the image processing performed in the image processing circuitry 42 and the gamma characteristics of the data line drive circuitry 44. To display an image with appropriate brightness, the gamma characteristics of the entire display driver 2 may be set to match the gamma characteristics of the display panel 1.
In this embodiment, the image processing circuitry 42 is configured to perform a subpixel rendering process and an eight-color halftoning process. More specifically, the image processing circuitry 42 includes a subpixel rendering circuitry 47, an eight-color halftoning circuitry 48 and a selector 49 in this embodiment.
The subpixel rendering circuitry 47 performs a subpixel rendering process on the image data 32 received from the interface control circuitry 41 to generate SPR-processed image data 35 and supplies the generated SPR-processed image data 35 to the eight-color halftoning circuitry 48 and the selector 49. Hereinafter, the image corresponding to the SPR-processed image data may be referred to as SPR-processed image. The subpixel rendering circuitry 47 also supplies the address indicating the position of each pixel in the SPR-processed image to the eight-color halftoning circuitry 48. When supplying an SPR-processed image data 35 associated with a certain pixel to the eight-color halftoning circuitry 48, the subpixel rendering circuitry 47 supplies the address of the pixel to the eight-color halftoning circuitry 48 in synchronization with the supply of this SPR-processed image data 35.
In one embodiment, the subpixel rendering circuitry 47 may be configured similarly to the subpixel rendering circuitry 20 illustrated in
The eight-color halftoning circuitry 48 generates binary image data 36 by performing an eight-color halftoning process on the SPR-processed image data 35.
The selector 49 selects one of the SPR-processed image data 35 received from the subpixel rendering circuitry 47 and the binary image data 36 received from the eight-color halftoning circuitry 48, and supplies the selected image data to the data line drive circuitry 44 as the display data 34. The data line drive circuitry 44 drives the display panel 1 in response to the display data 34 received from the selector 49.
In one or more embodiments, when causing the image processing circuitry 42 to perform the eight-color halftoning process, the interface control circuitry 41 supplies an image processing control signal to the image processing circuitry 42 to instruct to perform the eight-color halftoning process. The selector 49 selects the binary image data 36 in response to the image processing control signal. Additionally, the interface control circuitry 41 supplies the grayscale voltage control signals to the grayscale voltage generator circuitry 43 to instruct to stop generating the grayscale voltages V1 to VM-1, which correspond to the intermediate grayscale values. The grayscale voltage generator circuitry 43 stops generating the grayscale voltages V1 to VM-1, which correspond to the intermediate grayscale values, in response to the grayscale voltage control signals. This allows reducing the power consumption of the grayscale voltage generator circuitry 43. Note that, in some embodiments, the generation of the grayscale voltages V0 and VM, which correspond to the allowed minimum and maximum grayscale values, respectively, is continued even when the generation of the grayscale voltages V1 to VM-1, which correspond to the intermediate grayscale values, is stopped.
Although
In some embodiments, to achieve an eight-color halftoning process on multi-grayscale-level image data may be to determine whether each subpixel is to be “turned-on” or “turned off”, depending on the most significant bit of data indicating the grayscale value of the subpixel; note that the SPR-processed image data 35 are a sort of multi-grayscale-level image data. By “turning on” each subpixel of the pixel of interest when the most significant bit of the data indicating the grayscale value of the subpixel is “1” and “turning off” each subpixel when the most significant bit of the data indicating the grayscale value of the subpixel is “0”, it is possible to display an image in which the number of the allowed colors of each pixel is eight. This eight-color halftoning process, however, largely deteriorates the image quality, because spatial changes in the grayscale values in the image cannot be sufficiently represented.
The eight-color halftoning process can be considered as a color reduction process which reduces an increased number of bits. Therefore, a dithering process, which is known as one of color reduction processes which effectively suppress image quality deterioration, may be a potential eight-color halftoning process. Performing a dithering process allows representing spatial changes in the grayscale values in the image and thereby reducing image quality deterioration. In some embodiments, a dithering process is achieved by adding a dither value determined in a random manner to image data and then truncating one or more lower bits. The term “random” referred herein means that the probabilities in which the dither value takes the respective allowed values are the same. For example, an eight-color halftoning process with respect to image data which represents the grayscale value of each subpixel with eight bits can be achieved by adding an eight-bit dither value to the image data of each subpixel (note that the resultant value is nine bits), and extracting the most significant bit (that is, truncating the lower eight bits).
In various embodiments, generation of a dither value used in the dithering process is achieved by reading out a dither value from a dither table describing allowed dither values as elements, in response to the address of the pixel of interest.
It should be noted that the setting of the gamma characteristics of the data line drive circuitry 44 with the distribution of the voltage levels of the grayscale voltages V0 to VM the does not work when an image is displayed in response to image data obtained through an eight-color halftoning process, because the displayed image only includes subpixels of the allowed maximum grayscale value and the allowed minimum value. When the eight-color halftoning process is performed, the grayscale voltages V1 to VM-1, which correspond to intermediate grayscale values, are not used and therefore the setting of the grayscale voltages V1 to VM-1 does not have any effects on the gamma characteristics of the data line drive circuitry 44.
It should be also noted that, when an eight-color halftoning process is achieved through a dithering process with a dither value determined in a random way, such eight-color halftoning process is equivalent to image processing of a gamma value γ of one.
When a dither processing is performed on image data associated with a certain subpixel with a dither value determined in a random manner, the probability in which the subpixel is “turned on” increases in proportion to the grayscale value specified by the image data associated with the subpixel. When the grayscale value specified for a certain subpixel is “0”, the probability in which the subpixel is “turned on” is 0%, and, when the grayscale value is “255”, the probability is 100%. For a grayscale value of “128”, the subpixel is “turned off” when the dither value is zero to 127, and “turned on” when the dither value is 128 to 255. In other words, for a grayscale value of “128”, the subpixel is “turned on” with a probability of 50% and “turned off” with a probability of 50%. Accordingly, the effective brightness level of the subpixel in the displayed image is 50% of the allowed maximum brightness level. As thus discussed, the probability in which a subpixel is “turned on” increases in proportion to the grayscale value specified for the subpixel and the effective brightness level of the subpixel in the displayed image also increases in proportion to the grayscale value specified for the subpixel. This implies that the gamma value of the dithering process with a dither value determined in a random way is one.
Accordingly, the eight-color halftoning process achieved through a dithering process with a dither value determined in a random way may cause mismatching of the gamma characteristics of the entire display driver 2 and those of the display panel 1, and results in that the brightness level of each subpixel may not be appropriately represented in the displayed image, although the eight-color halftoning process can represent spatial changes in the grayscale values in the displayed image.
The eight-color halftoning circuitry 48 of this embodiment is configured to perform an eight-color halftoning process based on a dithering process, while addressing this problem. In the following, a description is given of the configuration and operation of the eight-color halftoning circuitry 48 in this embodiment.
The LUT circuitry 51 is a storage circuitry storing a dither table 53. The LUT circuitry 51 selects a dither value DDITHER from the elements of the dither table 53 in response to the X address and Y address of the pixel of interest supplied from the subpixel rendering circuitry 47 and supplies the selected dither value DDITHER to the adder circuitry 52. In
In this embodiment, in which the grayscale values DSPRR, DSPRG and DSPRB of the R, G and B subpixels of each pixel are described with eight bits in the SPR-processed image data 35, each element of the dither table 53 takes an eight-bit value selected from “0” to “255”. The dither table 53 has elements of 16 rows and 16 columns. It should be noted however that, as described later In one embodiment, two or more elements may take the same value in the dither table 53 of the eight-color halftoning circuitry 48 illustrated in
The adder circuitry 52 receives the SPR-processed image data 35 from the subpixel rendering circuitry 47 and adds the dither value supplied from the LUT circuitry 51 to the grayscale value of each subpixel of each pixel described in the SPR-processed image data 35. In one embodiment, for the R, G and B subpixels of the pixel of interest described in the SPR-processed image data 35, the adder circuitry 52 calculates the sums SUMR, SUMG and SUMB in accordance with the following expressions (21a) to (1c):
SUMR=DSPRR+DDITHER ,(21a)
SUMG=DSPRG+DDITHER, and (21b)
SUMB=DSPRB+DDITHER ,(21c)
where DSPRR is the grayscale value of the R subpixel of the pixel of interest described in the SPR-processed image data 35, DSPRG is the grayscale value of the G subpixel of the pixel of interest, and DSPRB is the grayscale value of the B subpixel of the pixel of interest. The most significant bits of the sums SUMR, SUMG and SUMB are output as the binary image data 36. It should be noted that each of the sums SUMR, SUMG and SUMB is a nine-bit value in this embodiment, in which each of the grayscale values DSPRR, DSPRG and DSPRB of the R, G and B subpixels described in the SPR-processed image data 35 is an eight-bit value and the dither value DDITHER is also an eight-bit value. The binary image data 36 indicates whether each of the R, G and B subpixels of each pixel is to be “turned on” or “turned off” with one bit, and the bits DBNR, DBNG and DBNB of the binary image data 36, which respectively correspond to the R, G and B subpixels of the pixel of interest, can be represented by the following expressions (22a) to (22c):
DBNR=MSB[SUMR], (22a)
DBNG=MSB[SUMG], and (22b)
DBNB=MSB[SUMB]. (22c)
In the eight-color halftoning circuitry 48 illustrated in
Discussed below is an example in which an eight-color halftoning process based on a dithering process is performed on the SPR-processed image data 35 which describe the grayscale values DSPRR, DSPRG and DSPRB of the R, G and B subpixels, by using an m-bit dither values DDITHER. The bit BBNk of the binary image data 36 is calculated as the most significant bit of the sum DSPRk+DDITHER, where k is any of “R”, “G” and “B”. In this case, the effective brightness level of a subpixel in the display image becomes (q/2m) times of the allowed maximum brightness level when the values of the elements of the dither table 53 are determined so that q of the 2m elements of the dither table 53 have a value equal to or more than 2m−p, for any allowed value p of the grayscale value DSPRk of each subpixel. In some embodiments, it is possible to achieve an eight-color halftoning process of the gamma characteristics of a gamma value γ, by defining q in accordance with the following expression (23):
where floor(x) is the floor function which gives the greatest integer that is less than or equal to x. The addition of the value 0.5 and the floor function floor(x) are merely introduced to provide rounding to an integer. The rounding may be achieved with a different method.
When m is eight and the grayscale value DSPRk of a certain subpixel is 186, the brightness level of the subpixel is to be set to 0.5 (=128/256) times of the allowed maximum brightness level, to achieve the gamma characteristics of a gamma value of 2.2. In this case, the desired brightness level can be achieved for the subpixel, by defining p as 186 and q as 128, and designing the dither table 53 so that 128 of the 256 elements of the dither table 53 have a value equal to or more than 70.
More specifically, the dither table 53 illustrated in
where α(i, j) is the value of the element in the i-th row and the j-th column of the dither table illustrated in
In some embodiments, when the grayscale value DSPRk of each subpixel described in the SPR-processed image data 35 is an m-bit value and the dither value is also an m-bit value, a dither table 53 which achieves a dithering process of a gamma value γ can be generated through the following procedure:
(1) Generate a first dither table in which the number of elements taking each allowed value is one (that is, N(p)=1 for any q), through a commonly-used method. Note that the first dither table has 2m elements; and
(2) perform conversion on the first dither table thus generated in accordance with the following expression (26):
where α(i, j) is the value of the element in the i-th row and the j-th column of the first dither table, and β(i, j) is the value of the element in the i-th row and the j-th column of the second dither table obtained by this conversion.
An eight-color halftoning process is then performed on the SPR-processed image data 35 by the eight-color halftoning circuitry 48. In the eight-color halftoning circuitry 48, the eight-color halftoning process is performed with the gamma characteristics of a gamma value of 2.2. As described above, when the grayscale value DSPRk of each subpixel is described as 186 in the SPR-processed image data 35, the brightness level of each subpixel is to be 50% (≈128/255) for the gamma characteristics of the gamma value of 2.2.
In this embodiment, the LUT circuitry 51 selects the dither value DDITHER to be supplied to the adder circuitry 52 from the elements of the dither table 53 illustrated in
Discussed in the following is the case where the above-described process is performed on the grayscale value DSPRk of each subpixel described in the SPR-processed image data 35 for pixels arrayed in 16 rows and 16 columns. When the dither table 53 illustrated in
As discussed above, this embodiment provides image data processing technology which achieves both of a subpixel rendering process and an eight-color halftoning process. The eight-color halftoning of this embodiment allows representing spatial changes in the grayscale value in the displayed image and appropriately representing the brightness level of each pixel in the displayed image.
Although embodiments of the present disclosure have been specifically described in the above, it would be understood to a person skilled in the art that the technologies of the present disclosure may be implemented with various modifications.
Number | Date | Country | Kind |
---|---|---|---|
JP2017003271 | Jan 2017 | JP | national |
JP2017004528 | Jan 2017 | JP | national |
This application is a continuation of U.S. patent application Ser. No. 15/868,317 filed Jan. 11, 2018, which claims priority of Japanese Patent Application No. 2017-003271, filed on Jan. 12, 2017, and Japanese Patent Application No. 2017-004528, filed on Jan. 13, 2017, the disclosures of which are incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
5189407 | Mano et al. | Feb 1993 | A |
5563623 | Barrett, Jr. | Oct 1996 | A |
5598179 | Orlen | Jan 1997 | A |
5644329 | Asari et al. | Jul 1997 | A |
6496536 | Mollenkopf | Dec 2002 | B2 |
7248268 | Brown Elliott et al. | Jul 2007 | B2 |
7598965 | Brown Elliott et al. | Oct 2009 | B2 |
7920154 | Brown Elliott et al. | Apr 2011 | B2 |
8390646 | Brown Elliott et al. | Mar 2013 | B2 |
20060038920 | Kondo et al. | Feb 2006 | A1 |
20060209054 | Someya et al. | Sep 2006 | A1 |
20120281028 | Orlick | Nov 2012 | A1 |
20160379543 | Furihata et al. | Dec 2016 | A1 |
20170061847 | Kim et al. | Mar 2017 | A1 |
20170236466 | Spitzer et al. | Aug 2017 | A1 |
20210210009 | Jun | Jul 2021 | A1 |
20220208069 | Jun | Jun 2022 | A1 |
Number | Date | Country |
---|---|---|
H09101771 | Apr 1997 | JP |
2002208018 | Jul 2002 | JP |
2011118000 | Jun 2011 | JP |
Entry |
---|
Notice of Reasons for Refusal, with translation, issued for Japanese Patent Application ON. 2017-004528, dated Jun. 10, 2021, 4 pages. |
Notice of Reasons for Refusal, with translation, issued for corresponding Japanese Patent Application No. 2017-004528, dated Jan. 12, 2022 (4 pages). |
Number | Date | Country | |
---|---|---|---|
20200273395 A1 | Aug 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15868317 | Jan 2018 | US |
Child | 15930011 | US |