This invention relates to image display apparatus and, more especially, this invention relates to image display apparatus having at least two modulators for modulating light.
Image display apparatus with at least two modulators for modulating light is known. The known image display apparatus uses a primary modulator and an auxiliary modulator to modulate picture elements of an image. In such known image display apparatus, the contrast range of the projected image is able to be extended as a result of the finite minimum image brightness above true black being reduced. GB 2317290 shows how the contrast of images is able to be improved.
Single monochrome primary modulators can be used with colour sequential illumination in order to produce a full colour image. However, this type of colour sequential illumination can produce temporal artifacts which may not be reduced if an auxiliary modulator were to be used.
GB 2396072 describes apparatus in which a first primary modulator for modulating red light, a second primary modulator for modulating green light and a third primary modulator for modulating blue light are optically relayed to an auxiliary modulator which further modulates the light to enhance contrast and increase the dynamic range of the image display apparatus. Also described is a method for controlling the operation of the primary and auxiliary modulators such that the enhancements to contrast and dynamic range can be achieved.
Consideration also needs to be given to the optical means which is used in the image display apparatus and which is for relaying the image from the primary modulator or primary modulators to the auxiliary modulator. If the primary modulator or modulators and the auxiliary modulator are of the same size, then the image must be relayed with a unity magnification. Preferably, the image should be relayed such that each pixel in the primary modulator is imaged onto the equivalent pixel in the auxiliary modulator. Alternatively each pixel in the primary modulator may be imaged onto the equivalent group of pixels in the auxiliary modulator. This applies to both reflective and transmissive light modulators. Refractive systems for relaying the image can be used, and when they are designed, they need to take into account performance in terms of resolution, scatter and colour correction. Compromises have to be made with such systems. In order to reduce scatter and hence a lowering of contrast in the image display apparatus, the number of refractive elements needs to be kept to a minimum, but more lenses are needed to provide sufficient resolution and colour correction, which in turn increases any scatter. Also, refractive systems that provide sufficient resolution and colour correction are longer as a result of the increased number of lenses, and they are consequently more expensive. Reflective optical means may also be used to relay the light from the primary modulator to the auxiliary modulator. Reflective optical means include a curved mirror in combination with refractive optical components. The number of components again depends on the performance required for relaying the image from the primary modulator to the auxiliary modulator, the number of components increasing with increased performance.
If optical relay means, which may be refractive or reflective optical relay means, is designed to give the desired performance then other factors may influence the performance of the image display apparatus. Manufacturing methods and tolerances in certain circumstances are not able to give the desired performance which can be shown in the image display apparatus as a misalignment between modulators or a magnification error for example. Also cost limitations may influence design which in turn reduces performance. As a result, the image may not be relayed from the primary modulator to the auxiliary modulator with the required accuracy, giving rise to undesirable image artifacts in the final projected image such as moiré fringing, defocusing and light point dimming.
It is an aim of the present invention to obviate or reduce the above mentioned problems.
Accordingly, the present invention provides image display apparatus comprising a light source, at least one primary modulator for modulating light, an auxiliary modulator for modulating the light modulated by the primary modulator, optical means for relaying the light modulated by the primary modulator to the auxiliary modulator, control means for controlling the primary modulator and the auxiliary modulator, and projector means for projecting light modulated by the auxiliary modulator, characterized in that:
Controlling the auxiliary modulator as a function of each pixel in the second array of pixels and the pixels which are adjacent to the selected pixel, with the primary modulator being controlled as a function of the pixel shows significant improvements over known technology. In particular, there are improvements in local brightness of displayed images, especially in the instances when there are few pixels from the complete pixel array shown to a bright, full-on or near full-on level. In contrast, with known apparatus, any slight misalignment will result in these images showing the bright points or pixels at a reduced brightness. This can have implications in certain applications such as flight simulation. Also misalignment can cause other effects such as colour fringe effects and blurring of the image to occur. This invention also advantageously contributes to the manufacturing process involved in producing the projector means as the accuracy to which alignment has to be achieved is no longer the most critical factor in the process. Moiré fringing is another visible artifact which is reduced significantly.
The image display apparatus may be one in which the primary modulator and the auxiliary modulator are transmissive spatial light modulators. Alternatively, the image display apparatus may be one in which the primary modulator and the auxiliary modulator are reflective spatial light modulators.
The primary modulator and the auxiliary modulator may be the same type of spatial modulator. Alternatively, the primary modulator and the auxiliary modulator may be different types of spatial modulator.
The image display apparatus may comprise a first primary modulator to modulate a first wavelength of light, a second primary modulator to modulate a second wavelength of light, and a third primary modulator to modulate a third wavelength of light.
The image display apparatus may be one in which the primary modulator is, or the primary modulators are, compensated to correct any anomalies in the resultant image introduced by selection means for the auxiliary modulator.
The optical means may be a refractive optical relay. Alternatively, the optical means may be a reflective optical relay.
The pixels in the second array of pixels of the auxiliary modulator may be controlled to be full-on or full-off.
Embodiments of the invention will now be described solely by way of example and with reference to the accompanying drawings, in which:
If the misalignment is greater than two pixel dimensions then further next closest adjacent pixels can be added to the window or shaded area on the auxiliary modulator to guarantee complete overlap with the single pixel imaged from the primary modulator onto the auxiliary modulator.
A consequence of this arrangement is that the light modulated by the primary modulator must be very accurately relayed optically to the auxiliary modulator to ensure that the image of each pixel of the primary modulator when optically relayed onto the auxiliary modulator is overlapped precisely with the equivalent pixel of the auxiliary modulator. As the resolution of the micro-displays used in such applications has increased, the pixel size has reduced and consequently alignment has become more demanding. This is the case for all types of micro-displays including liquid crystal and digital micro-mirror device type displays. The same would be true for any micro-display with small, approximately less than 25 microns pixel dimensions. Pixel dimensions are now regularly less than 8 microns.
The simplest example which can be identified for this embodiment is if the primary modulator is driven with a function which is a unity multiplication function with the equivalent pixel and adjacent pixels of the auxiliary modulator being driven to a fully on level. As mentioned, the primary modulator and/or the auxiliary modulator may be a digital light modulator such as a digital micro-mirror device or any other digital light modulator. Digital micro-mirror devices use temporal switching techniques to modulate light and generate greyscales. In image display apparatus in which the primary modulator and the auxiliary modulator are both digital micro-mirror devices, it would usually be required to synchronise the timing of equivalent pixels or groups of pixels. This example described above overcomes problems which may arise when the primary modulator is a digital micro-mirror device and the auxiliary modulator is also a digital micro-mirror device as the timing of both modulators is not required to be precisely aligned. The precise alignment would be needed as the digital modulators act as ‘gates’ for the light and require both ‘gates’ to be open at the same time for light to pass.
Although the accompanying diagrams and text show the primary modulator receiving light from the light source, it is also possible that the locations of the auxiliary and primary modulators in the image display apparatus could be reversed such that the auxiliary modulator receives light from the light source. The functions applied to the modulators by the control means would be the same.
If a single pixel has a misalignment which means that only 50% of the area of the pixel overlaps the corresponding pixel of the auxiliary modulator, then the control scheme disclosed will significantly increase the light transmitted to the screen for viewing.
The other eight pixels indicate the closest adjacent pixels to the reference pixel. The controller drives these nine pixels as a function of the video image data. Broken line 128 shows a section across the modulator from which pixel intensities can be shown.
Other functions may be used to control the reference pixel and the adjacent pixels. It can also be seen that each of the adjacent pixels is itself a reference pixel and this will have to be taken into account when a full image is displayed and the control functions calculated for the auxiliary modulator. The control function will be the product of the function when applied to all pixels which have an influence on any pixel of the auxiliary modulator, namely the reference pixel and the adjacent pixels.
More complex control can be used to also improve dynamic range whilst also overcoming the artifacts caused by misalignment of the image from the primary modulator on to the auxiliary modulator.
Video image data which in this embodiment is either monochrome video data or colour image data using known colour sequential techniques is input to look up table (LUT) 162 which may be used to apply gamma correction to the video data input. Corrected video image data is output to filter control means 164 and time delay means 170. Filter control means 164 applies a function to the video image data which is a function of the video image data to each pixel and to each adjacent pixel. Filter control means 164 uses framestore means 176 to access and obtain pixel data for the adjacent pixels. If the closest adjacent pixels are considered then the function is a function of the video input to each pixel and the video input to the adjacent eight pixels. Filter control 164 determines the output to the auxiliary modulator which is output via a time delay means 166 which enables correct synchronization of the primary and auxiliary modulators. As the filter control 164 applies a function to each pixel dependent on the pixel and the adjacent pixels it can be seen that a slight delay is introduced which depends on the number of adjacent pixels taken into account. The output to a particular pixel has to wait until at least the next line of video information is received by the filter control means, as each of the adjacent pixels taken into consideration each in turn depend on the adjacent pixels. Time delay means 170 is used to delay the video image data to the control for the auxiliary modulator 172. The delayed video image data from the time delay means 170 is combined the pixel output image data for each pixel from 168 to determine the drive level for each pixel in the primary modulator. LUTs 174 and 178 may be used for any gamma correction needed.
Previous embodiments have included only one primary modulator and an auxiliary modulator. The image display apparatus may also include more than one primary modulator for modulating light from a light source. In a modification of the image display apparatus 102 shown in
In known image display apparatus which has a red primary modulator, a green primary modulator and a blue primary modulator and an auxiliary modulator, there are known methods by which the individual modulators are controlled in order to project a satisfactory image on to the screen. However these known methods do not include the invention as disclosed in which the primary modulators are controlled as a function of the video input data for each pixel and the auxiliary modulator is controlled as a function of the video input data for each pixel and each adjacent pixel.
The schematic diagram shows first, second and third video inputs which are typically red, green and blue video inputs. Other inputs are known such as cyan, yellow and magenta and also more than three video inputs and corresponding primary modulators could be used. A plurality of video inputs is used to form a final colour image which is projected on to the screen. Other video inputs such as an infrared video data input channel are also known.
First video data inputs to LUT 200 which may be used to adjust any gamma present in the video signal. First video data is also input to LUT 202 which also adjusts any gamma present in the video signal. Using separate LUTs enables flexibility in the design allowing different functions to be applied in LUT 200 and LUT 202 if desired. The same function may also be applied to each of the LUTs 200 and 202. LUTs 220 and 222 perform likewise for the second video data input with LUTs 240 and 242 repeating this for the third video data input. LUTs 202, 222 and 242 may also be used to apply a correction function to the first, second and third video data inputs. Selection means 182 is used to select the dominant signal from the first, second and third video data inputs. The dominant signal is normally the signal with the highest numerical input demand, but alternative schemes may be used which use other criteria such as visual sensitivity or colour preference to determine the dominant signal. The dominant signal is used to determine the drive signal to the auxiliary modulator. Control means 184 outputs control data to the auxiliary modulator as a function of each pixel and the adjacent pixels. Control means 184 uses linestore means 186 to access and obtain pixel data for the adjacent pixels. Time delay means 196 is located between control means 184 and the auxiliary modulator. A LUT 198 is also located before the auxiliary modulator. This LUT may be used to apply gamma correction to the output to the auxiliary modulator if required.
Control means 184 also outputs to LUTs 204, 224 and 244. These LUTs determine the compensation which has to be applied to each of the primary modulators to compensate for any functions which have been applied by the control means 184 to the auxiliary modulator.
The amount of light transmitted through to the projection screen is dependent on both the primary modulators and the auxiliary modulator. The effect of the modulators on the transmitted light is a multiplicative effect. Therefore as the auxiliary modulator is driven as a function of the dominant signal to the first, second and third primary modulators then some compensation is needed to maintain the correct characteristics in terms of brightness and colour for example of the displayed image and to correct for any anomalies which may have been introduced. This is achieved by the use of further LUTs located in the output from the control means 184 to the primary modulators.
LUTs 204, 222 and 244 are used to compensate the drive signal to the first, second and third primary modulators respectively. The LUT applies an inverse function to the drive function output from the control means 184. LUT 204 applies an inverse function to the drive signal which is fed to multiplier means 206. The video input data having undergone any gamma correction needed by LUT 200 is also fed via time delay means 210 to the multiplier means 206. The time delay means is needed to compensate for possible delays caused by the control means 184 having to access data from the linestore means 186. Multiplier means 206 outputs to a further LUT 208. This LUT 208 is also used for gamma correction to the video data output if needed. The multiplier means effectively compensates for any variation in video drive signal which may be introduced by the selection means 182 and control means 184 by applying an inverse function, which is the inverse of the function which is applied to the drive to the auxiliary modulator, to the video drive signal to the primary modulators.
The control means also outputs to LUT 224 which applies an inverse function to the drive signal which is in turn input to multiplier means 226. Second video data input to the apparatus undergoes any gamma correction needed at LUT 220 and has time delay applied by time delay means 230 if needed, again to compensate for any delay introduced by the control means accessing linestore 186. Multiplier means 226 is used to multiply this video data input by the output from LUT 224 which again compensates for any variation introduced by selection means 182 and control means 184.
The control means also outputs to LUT 244 which applies an inverse function to the drive signal which is in turn input to the multiplier means 246. Third video data input to the apparatus undergoes any gamma correction needed at LUT 240 and has time delay applied by time delay means 250 if needed, again to compensate for any delay introduced by the control means accessing linestore 186. Multiplier means 246 is used to multiply this video data input by the output from LUT 244 which again compensates for any variation introduced by selection means 182 and control means 184.
The embodiment shows that in projector means which has more than one primary modulator, in this case first, second and third primary modulators, the method by which the primary modulators are controlled as a function of the video input to each pixel and the auxiliary modulator is controlled as a function of the video input to each pixel and each adjacent pixel is still able to provide a satisfactory image as compensation means can be included to correct any anomalies introduced by the selection means 186 which selects the dominant signal to the primary modulator.
It is to be appreciated that the embodiments of the invention described above with reference to the accompanying drawings have been given by way of example only and that modifications may be effected.
Number | Date | Country | Kind |
---|---|---|---|
0719721.3 | Oct 2007 | GB | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/GB2008/003176 | 9/19/2008 | WO | 00 | 4/6/2010 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2009/048476 | 4/16/2009 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5757411 | Florence | May 1998 | A |
6985272 | Bridgwater et al. | Jan 2006 | B2 |
Number | Date | Country |
---|---|---|
0 709 802 | May 1996 | EP |
WO 9820475 | May 1998 | WO |
Number | Date | Country | |
---|---|---|---|
20100253863 A1 | Oct 2010 | US |