Patent Application
20170098432
This application claims the benefit of Korean Patent Application No. 10-2015-0140013 filed on Oct. 5, 2015, the entire contents of which is incorporated herein by reference for all purposes as if fully set forth herein.
Field of the Invention
The present invention relates to a display device and an image rendering method thereof in consideration of a saturation of a text image.
Discussion of the Related Art
Flat panel display devices such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a field emission display (FED) and a plasma display panel (PDP) are known.
A rendering algorithm converts data of an input image into data suitable for the pixel arrangement and structure of a display panel when the resolution of the input image differs from the physical resolution of the display panel. Such a rendering algorithm is applied to display devices.
When the resolution of an input image is different from the resolution of the display device, the quality of an image reproduced by the display device may deteriorate. It may not be difficult to process the input image into a high resolution image without loss of picture quality. However, when the resolution of the input image is converted into a lower resolution image matching the physical resolution of the display device, and the input image is reproduced with the converted resolution through the display device, a data distortion or loss may occur and thus, the picture quality may deteriorate.
Particularly, when a text in the input image is reproduced through a display device having a lower resolution than the input image, text legibility may deteriorate due to an omission or distortion of the data constituting the text. Various rendering algorithms have been proposed in order to enhance text legibility when the resolution of the display device is lower than that of the input image. The applicant proposed a rendering algorithm for improving text legibility in consideration of a difference between neighboring pieces of data when the resolution of a display device is lower than that of an input image (Korea Patent Application 10-2013-0139770 filed on 2013 Nov. 18).
When a text data is converted using conventional rendering algorithms, the legibility of the text data may deteriorate. Particularly, conventional rendering algorithms typically do not consider the saturation of text, focusing on an achromatic text data. Accordingly, the legibility of chromatic data may further deteriorate when conventional rendering algorithms are applied.
Accordingly, the present invention is directed to a display device and an image rendering method thereof that substantially obviate one or more problems due to limitations and disadvantages of the related art.
An advantage of the present invention is to provide a display device with improved legibility of text image.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. These and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described, a display device may, for example, include a display panel in which data lines intersect scan lines and pixels are arranged in a matrix form, an image rendering device for calculating saturation of each piece of pixel data of an input image, adjusting a sub-pixel rendering application ratio and a direct rendering application ratio for the pixel data using a weight in proportion to the saturation and converting the pixel data, and a display panel driving circuit for writing data converted by the image rendering device to the pixels of the display panel.
Sub-pixel rendering adjusts values of input image pixel data related to a pixel according to an area ratio of the pixel, sums the pixel data values and converts the pixel data into data to be written to the pixel.
Direct rendering selects pixel data having a center point closest to the center point of the pixel from among the pixel data and converts the selected pixel data into data to be written to the pixel.
The direct rendering application ratio is decreased by a sub-pixel rendering application ratio increase, and the sub-pixel rendering application ratio is reduced by a direct rendering application ratio increase.
In another aspect of the present disclosure, an image rendering method of a display device includes calculating a saturation of each piece of pixel data of an input image, adjusting a sub-pixel rendering application ratio and a direct rendering application ratio for the pixel data using a weight in proportion to the saturation and converting the pixel data.
In yet another aspect of the present disclosure, a display device may, for example, include a display panel in which a plurality of data lines cross a plurality of scan lines to define a plurality of pixels arranged in a matrix; an image rendering circuit that receives a plurality of pixel data of an input image, determines whether the input image is closer to a chromatic data or an achromatic data, and adjusts a ratio of a sub-pixel rendering application or a ratio of a direct rendering application based on a result of the determination and converts the plurality of pixel data into a plurality of display data; and a display panel driving circuit that writes the plurality of display data into the plurality of pixels of the display panel.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention. In the drawings:
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. In the following description, a detailed description of known functions and configurations incorporated herein will be omitted when it may obscure the subject matter of the present invention.
A display device according to an embodiment of the present invention may be implemented as a flat panel display, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP) and a field emission display (FED). While the following embodiments will be described with an LCD, the present invention is not limited thereto.
To express colors, a pixel data includes a red sub-pixel data R, a green sub-pixel data G and a blue sub-pixel data B. When such a pixel data is rendered to correspond to a pixel structure of a display device, an amount of loss of an achromatic pixel data is relatively small since the achromatic pixel data is typically present in each of colors R, G and B. On the other hand, in the case of an chromatic data, a data value difference between colors is large or a data of a certain color may not be present and thus, be processed as a black grayscale data. As a result, when a chromatic data value is converted through a rendering, a line-shaped edge in the text may be seen as dots due to a black grayscale data, and thus, the legibility of the text composed of a chromatic data may deteriorate.
A rendering method according to an embodiment of the present invention is to reduce a data loss by analyzing a degree of saturation of a text data corresponding to an input image and increasing a sub-pixel rendering application ratio for a high-saturation data, and improve the legibility of both chromatic and achromatic texts by increasing a direct rendering application ratio for a low-saturation data.
A sub-pixel rendering method will be described with reference to
A rendering method according to an embodiment of the present invention is to increase the legibility of a text rendered when an RGB pixel data is converted into an RGBW pixel data, as illustrated in
Referring to
The image (referred to as “converted image” hereinafter) in the second resolution J×K is a display image data that is converted to correspond to a pixel structure or a resolution J×K of the display device and is to be reproduced through the display device. J×K refers to a number of pixel data arranged in a matrix. Also, J is a positive integer equal to or greater than 2 and less than M, and K is a positive integer equal to or greater than 2 and less than N. The converted image data includes J×K target pixel data Pt. The target pixel data Pt are written into respective pixels of the display device.
When the input image data Pi are converted in accordance with a screen size of the display device, and when the pixel data Pi of the input image are mapped to the pixels of the display device, more than one input image pixels related to a target pixel (one pixel) overlap due to a difference in the number of pixels between the input image and the display device. An area ratio of the input image data for one target pixel may vary. The sub-pixel rendering method calculates an area ratio of each of the more than one input pixel data Pi related to the target pixel data Pt in order to determine a value (or grayscale) of the target pixel data Pt.
The sub-pixel rendering method multiplies the area ratios of the input pixel data Pi for the target pixel data Pt by values of the input pixel data Pi and divides the result by the sum of the area ratios. For example, the value of the target pixel data Pt is obtained by respectively multiplying the area ratios, 9:3:3:1, of the input pixels related to the target pixel data Pt by values 32, 64, 64 and 96 of the input pixel data Pi, summing the multiplication results and dividing the result by the sum of the area ratios, 16, {(32*9+64*3+64*3+96*1)/16}.
Referring to
The direct rendering method determines a target pixel data Pt by selecting a data value of an input image pixel of which center point is closest to a center point Pc of the target pixel from among the more than one input pixel data Pi that overlap and are related to the target pixel data Pt.
Referring to
The input image data includes first to third RGB pixel data from the left in
As described above, according to the sub-pixel rendering method, a plurality of input pixel data Pi related to a target pixel are reflected in the target pixel data. As a result, data values of the converted image data are widely spread at a text edge, and the sub-pixel rendering method can thus reduce or minimize data loss even in the case of a chromatic data in which a data of one or more colors is not present. This is because neighboring data related to the target pixel are reflected in the target pixel data, which depends on the area ratios of the neighboring data when the input image data is rendered. Accordingly, the sub-pixel rendering method can represent a chromatic text data closer to its original image, that is, the input image, as compared to the direct rendering method. In the sub-pixel rendering method, an edge of the rendered text may be blurred due to a small difference in data values.
On the contrary, as described above, the direct rendering method selects a data value of an input pixel data having its center point closest to a center point of the target pixel as the target pixel data. Accordingly, a spread width of the converted image data is narrow at a text edge. In the case of a chromatic data, when an input image data is rendered using the direct rendering method, a black grayscale data is selected as the target data, and thus, black dots, which may not be present in the input image, may be seen. In the case of an achromatic text having no color difference, the direct rendering method can represent a text edge line close to the input image without black dots since the colors of RGB pixel data have an identical data value or similar data values. Accordingly, it may be desirable to render an achromatic text data using the direct rendering method.
According to an embodiment of the present invention, the target pixel data converted through the sub-pixel rendering method or the direct rendering method is respectively multiplied by weights and adaptively varies the weights on a basis of a degree of saturation of an input pixel data. As a result, the legibility of both achromatic and chromatic text data can be improved by increasing a direct rendering application ratio for the achromatic text data and by increasing a sub-pixel rendering application ratio for the chromatic text data.
Referring to
Here, “Pixelsaturation” indicates a degree of saturation of pixel data, and “max(RGB)” indicates a maximum value from among a red sub-pixel data R, a green sub-pixel data G and a blue sub-pixel data B. In addition, “min(RGB)” represents a minimum value from among the red sub-pixel data R, the green sub-pixel data G and the blue sub-pixel data B, and “mean(RGB)” represents a mean value of the red sub-pixel data R, the green sub-pixel data G and the blue sub-pixel data B.
As another example of the saturation calculation method, a data can be determined as a high-saturation data Pixelsaturation when a difference between the maximum value max(R,G,B) and the minimum value min(R,G,B) of the red sub-pixel data R, the green sub-pixel data G and the blue sub-pixel data B of the corresponding data is large. Alternatively, a degree of saturation can be calculated using a transform formula for converting an RGB color space into a HIS (Hue, Intensity, Saturation) or HSV (Hue, Saturation, Value) color space.
Pixelsaturation=max(R,G,B)−min(R,G,B).
In a sub-pixel rendering algorithm, a plurality of input pixel data of the original image can be reflected in one piece of target data after conversion. In this case, the highest saturation value of a plurality of pixels can be selected as a representative saturation value of the corresponding pixels.
The image rendering method according to an embodiment of the present invention increases a sub-pixel rendering application ratio when the input image pixel data is a chromatic data (S3 and S4). The sub-pixel rendering application ratio increases as a degree of saturation increases. The image rendering method according to an embodiment of the present invention increases a direct rendering application ratio when the input image pixel data is close to an achromatic data (S4 and S5). The direct rendering application radio increases as a degree of saturation decreases. Steps S4 and S5 can be implemented as a method of controlling a weight α according to a degree of saturation, as illustrated in
A converted image data rendered through the image rendering method is transmitted to a display panel driving circuit. The display panel driving circuit writes the converted image data to pixels of the display panel to display the input image on the display panel (S6).
Referring to
The saturation calculation unit 10 calculates a degree of saturation of each piece of pixel data of an input image. The sub-pixel rendering processing unit 11 adjusts values of a plurality of pieces of input image data related to a pixel according to an area ratio of the pixel and sums the data values to output a first target pixel data. The direct rendering processing unit 12 outputs an input image pixel data having a center point closest to a center point of the pixel as a second target pixel data.
The weight calculation unit 13 calculates a weight α in proportion to a saturation input from the saturation calculation unit 10. The weight calculation unit 13 calculates a weight 1−α in inverse proportion to the saturation on a basis of the weight α. The weight α becomes close to 1 as the saturation becomes close to 1. The weight α is generated as a value between 0 and 1 and varies according to a degree of saturation.
The first weight application unit 14 multiplies the first target pixel data by the weight α and outputs the multiplication result. The second weight application unit 15 multiplies the second target pixel data by the weight 1−α in inverse proportion to the saturation and outputs the multiplication result. Because “1−α” decreases as a increases and “1−α” increases as a decreases, a sub-pixel rendering application ratio increases according to the weight α and a direct rendering application ratio decreases as the sub-pixel rendering application ratio increases, in the case of a chromatic pixel data. Conversely, the direct rendering application ratio increases according to the weight α and the sub-pixel rendering application ratio decreases as the direct rending application ratio increases, in the case of an achromatic pixel data.
The addition unit 16 sums an output data A of the first weight application unit 14 and an output data B of the second weight application unit 15 and outputs the result. Image data output from the addition unit 16 is transmitted to the display panel driving circuit and written to the pixels of the display panel.
As shown in
The image rendering method according to an embodiment of the present invention can adaptively control the sub-pixel rendering application ratio and the direct rendering application ratio in consideration of neighboring pixel data values, as illustrated in
Referring to
The image rendering method according to another embodiment of the present invention calculates a difference between neighboring pixel data values. The image rendering method increases a direct rendering application ratio when a difference between neighboring pixel data values is large and the pixel data is an achromatic data (S13 and S14). The image rendering method increases a sub-pixel rendering application ratio when a difference between neighboring pixel data values is small and the pixel data is a chromatic data (S12 to S15). Steps S12 and S15 may be implemented as a method of controlling weight α according to a degree of saturation, as illustrated in
A converted image data rendered through the image rendering method according to another embodiment of the present invention is transmitted to a display panel driving circuit. The display panel driving circuit writes the converted image data to the pixels of the display panel so as to display the input image on the display panel (S16).
Referring to
The data difference & saturation calculation unit 20 calculates a difference between neighboring pixel data values in an input image and saturation of each piece of pixel data of the input image. The sub-pixel rendering processing unit 11 adjusts values of a plurality of pieces of input image data related to a pixel according to an area ratio of the pixel and sums the data values to output a first target pixel data. The direct rendering processing unit 12 outputs an input image pixel data having its center point closest to a center point of the pixel as a second target pixel data.
The weight calculation unit 13 calculates a weight α which is inversely proportional to the data difference and proportional to the saturation, input from the data difference & saturation calculation unit 20. The weight calculation unit 13 calculates a weight 1−α which is proportional to the difference between neighboring pixel data values and inversely proportional to the saturation on a basis of the weight α. The weight α increases as the data difference decreases, and the saturation increases and decreases as the data difference increases and the saturation decreases, respectively. The weight α is generated as a value between 0 and 1 and varies according to the difference between neighboring pixel data values and the saturation.
The first weight application unit 14 multiplies the first target pixel data by the weight α and outputs the multiplication result. The second weight application unit 15 multiplies the second target pixel data by the weight 1−α in inverse proportion to saturation and outputs the multiplication result. Herein, 1−α decreases as a increases, whereas 1−α increases as a decreases.
The addition unit 16 sums an output data A of the first weight application unit 14 and an output data B of the second weight application unit 15 and outputs the result. An image data output from the addition unit 16 is transmitted to the display panel driving circuit and written to pixels of the display panel.
Referring to
The display panel driving circuit includes a data driver 102, a gate driver 104 and a timing controller 110. The display panel driving circuit writes the pixel data (or target data) converted by the image rendering device to pixels.
In the pixel array of the display panel 200, a plurality of data lines DL intersects a plurality of scan lines (or gate lines) GL and pixels are arranged in a matrix. An input image pixel data is converted through the aforementioned image rendering method and displayed on the pixel array. Each pixel includes a sub-pixel R, a sub-pixel G and a sub-pixel B. Each pixel may further include a sub-pixel W.
The data driver 102 converts the pixel data received from the timing controller 110 into an analog gamma compensation voltage to generate a data voltage and outputs the data voltage to the data lines DL. The pixel data input to the data driver 102 is a digital video data of the input image.
The gate driver 104 supplies a scan pulse (or gate pulse) synchronized with the output voltage of the data driver 102 to the scan lines GL under the control of the timing controller 110. The gate driver 104 sequentially shifts the scan pulse per line to sequentially select pixels to which data is written.
The timing controller 110 includes an image rendering device 100 as illustrated in
The timing controller 110 receives an input image pixel data and timing signals synchronized with the input image pixel data from a host system (not shown). The timing signals include a vertical synchronization signal Vsync, a horizontal synchronization signal Hsync, a data enable signal DE and the like. The timing controller 110 transmits a data output from the image rendering device 100 to the data driver 102.
The timing controller 110 controls an operation timing of the data driver 102 and the gate driver 104 on a basis of the timing signals synchronized with the input image pixel data and input thereto. The timing controller 110 generates a data timing control signal and a gate timing control signal on a basis of the timing signals so as to synchronize the data driver 102 with the gate driver 104. The data timing control signal defines an operation timing and an output timing of the data driver 102. The gate timing control signal defines an operation timing and an output timing of the gate driver 104.
The host system may be implemented by one of a TV system, a set-top box, a navigation system, a DVD player, a Blu-ray player, a personal computer, a home theater system, a phone system, and the like.
As described above, the legibility of achromatic and chromatic text data can be improved, for example, by increasing a direct rendering application ratio for the achromatic text data and increasing a sub-pixel rendering application ratio for the chromatic text data.
Although embodiments have been described with reference to a number of illustrative embodiments thereof, it should be understood that numerous other modifications and embodiments can be devised by those skilled in the art that will fall within the scope of the principles of this disclosure. More particularly, various variations and modifications are possible in the component parts and/or arrangements of the subject combination arrangement within the scope of the disclosure, the drawings and the appended claims. In addition to variations and modifications in the component parts and/or arrangements, alternative uses will also be apparent to those skilled in the art.
It will be apparent to those skilled in the art that various modifications and variation can be made in the present invention without departing from the concepts and scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2015-0140013 | Oct 2015 | KR | national |
