The present application claims priority from Japanese patent application serial No. JP 2007-220494, filed on Aug. 28, 2007, the content of which is hereby incorporated by reference into this application.
The present invention relates to an image display device for displaying an image while increasing the resolution of the image, and an image processing circuit of such an image display device. In particular, the invention relates to an image display device such as a cathode ray tube display device, a liquid crystal display device, a plasma display device, an organic electroluminescent (EL) display device, or an electric discharge display device, and an image processing circuit of such an image display device.
Proposed as a pseudo-impulse display method for obtaining an effect of reducing motion blur caused by the hold-type display method used by liquid crystal display devices and the like, in particular, as a method for avoiding a reduction in luminance or the limitation on the number of gray levels due to black frame insertion and obtaining an effect of reducing motion blur is a method for displaying only high spatial frequency components related to the occurrence of motion blur among spatial frequency components of an image in the form of impulses and displaying low spatial frequency components thereamong using the hold-type display method (Smooth Frame Insertion Method for Motion-Blur Reduction in LCDs, Euro Display 2005 (Samsung Electronics)). Specifically, in this method, the image display cycle is doubled to alternately display an image in which high spatial frequency components are eliminated and the image in which high spatial frequency components are emphasized (doubled). As a result, motion blur is reduced and the luminance reduction problem or gray level number limitation problem is resolved. Also, the configuration of the image processing device is simplified.
However, the above-described method, which has an effect of reducing motion blur, has no effect of increasing the resolution. That is, there is no description of a processing method for reducing motion blur while increasing the resolution in “Smooth Frame Insertion Method for Motion-Blur Reduction in LCDs.”
An advantage of the present invention is to provide a device, a circuit and a method that each reduce motion blur while increasing the resolution.
For that purpose, in an image display method according to the present invention, a resolution-increased image obtained by creating components in a spatial frequency range wider than the original spatial frequency range of a displayed image by performing a resolution increasing process and an image that does not include the high spatial frequency components are alternately displayed.
Specifically, there are provided a resolution increasing circuit for performing a resolution increasing process on an input displayed pixel, an enlargement circuit for performing a process for matching the input displayed image with an output pixel configuration, and a frame control circuit for alternately outputting an output from the resolution increasing circuit and an output from the enlargement circuit according to an input synchronizing signal. As a key feature, a super-resolution process is performed in the resolution increasing process.
The super-resolution process here refers to a process for matching displayed image portions common to images in consecutive multiple frames with one another using motion compensation and, from an image including multiple sampling points obtained in this way, newly creating a resolution-increased image with a high spatial resolution.
According to the present invention, by performing a resolution increasing process, components in a spatial frequency range wider than the original spatial frequency range of a displayed image is displayed in the form of impulses. This reduces motion blur while increasing the resolution.
These and other features, objects, and advantages of the present invention will become more apparent from the following description when taken in conjunction with the accompanying drawings wherein:
In view of the foregoing, in embodiments of the present invention, an enlargement process for creating interpolation pixel data from pixel data in an identical frame so that the spatial frequency is not changed and a super-resolution process that serves as a resolution increasing process and creates interpolation pixel data from changes in pixel data in multiple frames so that the spatial frequency is increased are used. Then, a super-resolution process-subjected image and an enlargement process-subjected image are alternately displayed in such a manner that high-frequency components of the super-resolution process-subjected image are emphasized and high-frequency components of the enlargement process-subjected image are left intact without being eliminated. Thus, even if the resolution is increased, a perceived image with less motion blur and less luminance reduction is obtained. Also, in this embodiment, a process for increasing the resolution, and a process for emphasizing high spatial frequency components and a process for eliminating high spatial frequency components are not performed separately. That is, in this embodiment, after a process for increasing the resolution is performed, a process for emphasizing high spatial frequency components or a process for eliminating high spatial frequency components is not performed. Or after a process for emphasizing high spatial frequency components and a process for eliminating high spatial frequency components, a process for increasing the resolution is not performed. Instead, a process for emphasizing high spatial frequency components is combined with a process for increasing the resolution so that there is no need to perform a process for eliminating high spatial frequency components. As a result, the number of processes is reduced. Hereafter, an embodiment in which the number of pixels of the original image is doubled in the vertical direction and doubled in the horizontal direction will be described. Note that the number of pixels need not always be doubled in the vertical and horizontal directions.
First Embodiment
By displaying the enlarged image D and high spatial frequency-emphasized image E alternately every half frame using the pseudo-impulse display method, the displayed images F and G are perceived as a perceived image H by the observer. The perceived image H has the same spatial frequency spectrum as that of the resolution-increased image B. Therefore, the perceived image H is perceived as an image with increased resolution and no luminance reduction by the observer. Without being limited to every half frame, the enlarged image D and high spatial frequency-emphasized image E may be displayed alternately every frame, every one-third frame, or one-fourth frame. Or, without being limited to every half frame, the proportion of the display period of the high spatial frequency-emphasized image E in a frame may be increased. Conversely, the proportion of the display period of the enlarged image D may be increased.
From
In the display panel 1, data lines are disposed in the column direction and scan lines are disposed in the row direction. A pixel is disposed at the intersection of a data line and a scan line in such a manner that the data line and scan line are coupled to the pixel. The display element of a pixel is a liquid crystal element, a plasma element, an organic EL element, an electric discharge element, or the like. The high-resolution display control circuit 3 receives a vertical synchronizing signal for determining the period (timing) of one screen, a horizontal synchronizing signal for determining the period (timing) of one line, data enable indicating that display data is to be input, display data, and a synchronizing clock for determining the period (timing) of a pixel, from other apparatuses (e.g., a television tuner, a display memory, a hard disk, a personal computer main body). The size of the display data may be either of 8 bits and 10 bits. Then, the high-resolution display control circuit 3 creates a high-resolution data line control signal and a high-resolution scan line control signal corresponding to the resolution of the display panel 1 from the received display data and synchronizing signal. The data line drive circuit 4 receives the high-resolution data line control signal to create a data line drive signal corresponding to display data included in the high-resolution data line control signal. The scan line drive circuit 5 receives the high-resolution scan line control signal to apply a scan line drive signal to one or more scan lines sequentially from top to bottom according to the received high-resolution scan line control signal. Then, the data line drive signal is applied to a pixel to which the scan line drive signal has been applied. The pixel indicates the luminance according to the magnitude of the data line drive signal. If the display element of the pixel is a liquid crystal element, the pixel indicates the luminance according to a potential difference between the data line drive signal and a counter voltage. Therefore, the same luminance is indicated whether the data line drive signal is larger than the counter voltage (positive polarity) or the data line drive signal is smaller than the counter voltage (negative polarity). Also, the positive polarity and negative polarity may be switched every frame. For example, the high spatial frequency-emphasized image and enlarged image may be both displayed with positive polarity in a frame (N-th frame) and these images may be both displayed with negative polarity in the next frame ((N+1)-th frame).
The high-resolution display control circuit 3 receives a vertical synchronizing signal, a horizontal synchronizing signal, data enable, a synchronizing clock, and display data and inputs the vertical synchronizing signal, horizontal synchronizing signal, data enable, synchronizing clock, and display data to the resolution increasing circuit 6 and enlargement circuit 8, as well as outputs the vertical synchronizing signal, horizontal synchronizing signal, data enable, and synchronizing clock to the frame control circuit 7.
The enlargement circuit 8 creates interpolation pixel data from display data of an adjacent pixel with respect to each of pixels of the display data, and creates enlarged pixel data by interpolating the created interpolation pixel in the corresponding original pixel and outputs the enlarged pixel data. In this case, the enlargement circuit 8 may create the interpolation pixel data from data indicating a pixel adjacent to the original pixel in the horizontal or vertical direction in an identical frame (simple enlargement method) or from the average value of data indicating such an adjacent data, or may create the interpolation pixel data using a linear function or a spline function with respect to data indicating an adjacent pixel (halftone interpolation method).
Also, if the high spatial frequency-emphasized image data and enlarged image data are displayed alternately every half frame, the enlargement circuit 8 creates a high-resolution horizontal start signal by doubling the cycle of the horizontal synchronizing signal, creates a high-resolution horizontal shift clock by doubling the cycle of the synchronizing clock, creates a high-resolution vertical start signal by doubling the cycle of the vertical synchronizing signal, creates a high-resolution vertical shift clock by doubling the cycle of the horizontal synchronizing signal, and outputs the created signals.
The resolution increasing circuit 6 creates a resolution-increased image by subjecting the display data to a super-resolution process. In the super-resolution process, multiple frames (two or three or more frames) are combined to create a new frame. In order to obtain multiple frames, it is preferable to use a frame memory allowed to store pixel data for one frame. For example, the super-resolution process includes three processes: (1) position estimation; (2) wide range interpolation; and (3) weighted sum. The (1) position estimation is a process for estimating differences between sampling phases (sampling positions) of pieces of pixel data in input multiple frames. The (2) wide range interpolation is a process for performing interpolation using a wide-range low-pass filter that transmits all high-frequency components of the original signal, including aliasing components of each pixel data, so as to increase the number of pixels (sampling points) to increase the density of pixel data. The (3) weighted sum is a process for obtaining a weighted sum using a weighted factor corresponding to the sampling phase of each density-increased data so as to cancel and eliminate aliasing components that occur when a pixel is sampled and simultaneously restoring high-frequency components of the original signal. For example, it is assumed that a frame #1, a frame #2, and a frame #3 on the time axis are input and these frames are synthesized to obtain an output frame. Also, for simplicity, it is assumed that, first, a subject moves in the horizontal direction and then the subject is subjected to a one-dimensional signal process on the horizon so that the resolution is increased. In this case, the signal waveform is displaced according to the amount of movement of the subject in the frame #2 and frame #1. Then, by performing the above-described position estimation process, the amount of the displacement is obtained. Then, the frame #2 is subjected to motion compensation so as to eliminate the displacement and a phase difference θ between sampling phases of pixels in the frames is obtained. By performing the above-described wide range interpolation process and (3) weighted sum process according to the phase difference θ, a new pixel is created in the exactly intermediate (phase difference θ=π) position of the original pixel. Thus, the resolution is increased. Note that when increasing the resolution, all the three processes, that is, (1) position estimation, (2) wide range interpolation, and (3) weighted sum are not always required.
Subsequently, the resolution increasing circuit 6 creates high spatial frequency-emphasized image data by emphasizing high-frequency components of the resolution-increased image, and outputs the created data. In this case, the resolution increasing circuit 6 subtracts the enlarged image created in the enlargement circuit 8 from the resolution-increased image obtained by performing the super-resolution process so as to extract (high-frequency image) high-frequency components of the resolution-increased image, as shown
The frame control circuit 7 creates a frame control signal from a vertical synchronizing signal, a horizontal synchronizing signal, data enable, and a synchronizing clock. If the high spatial frequency-emphasized image data and enlarged image data is displayed alternately every half frame, the frame control circuit 7 creates a frame control signal using the first half of one period of the vertical synchronizing signal as high (or low) and the second half thereof as low (or high).
The data line control signal switching circuit 9 receives the high spatial frequency-emphasized image data and enlarged image data and outputs these pieces of image data alternately according to the frame control signal. Specifically, when the frame control signal is high (low), the data line control signal switching circuit 9 outputs the high spatial frequency-emphasized image data as high-resolution display data. When the frame control signal is low (high), the data line control signal switching circuit 9 outputs the enlarged image data as high-resolution display data. That is, the data line control signal switching circuit 9 outputs the high spatial frequency-emphasized image data and enlarged image data alternately every half frame. In this case, the data line control signal switching circuit 9 may first output either of the high spatial frequency-emphasized image data and enlarged image data in one frame.
Then, the high-resolution display control circuit 3 outputs the high-resolution display data, high-resolution horizontal start signal, and high-resolution horizontal shift clock as a high-resolution data line control signal and outputs the high-resolution vertical start signal and high-resolution vertical shift clock as a high-resolution scan line control signal.
Second Embodiment
A second embodiment of the present invention is characterized in that the display proportion of the enlarged image is made smaller than that in the first embodiment and the display proportion of the resolution-increased image is made larger than that in the first embodiment. Thus, motion blur is reduced to a greater extent than in the first embodiment.
Then, as shown in
From
As is understood from the above-description, the embodiments of the present invention are applicable to liquid crystal televisions and liquid crystal monitors.
While we have shown and described several embodiments in accordance with our invention, it should be understood that disclosed embodiments are susceptible of changes and modifications without departing from the scope of the invention. Therefore, we do not intend to be bound by the details shown and described herein but intend to cover all such changes and modifications within the ambit of the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
2007-220494 | Aug 2007 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
7002540 | Aoki | Feb 2006 | B2 |
7106350 | Baba et al. | Sep 2006 | B2 |
7133157 | Ito | Nov 2006 | B2 |
7356254 | Aoyama | Apr 2008 | B2 |
7379624 | Hoshi | May 2008 | B2 |
7489350 | De Haan et al. | Feb 2009 | B2 |
7599568 | Aoyama | Oct 2009 | B2 |
7844128 | Toyooka et al. | Nov 2010 | B2 |
Number | Date | Country |
---|---|---|
2000137469 | May 2000 | JP |
2002333859 | Nov 2002 | JP |
2005151306 | Jun 2005 | JP |
2006184896 | Jul 2006 | JP |
Number | Date | Country | |
---|---|---|---|
20090060365 A1 | Mar 2009 | US |