Patent Application
20110001881
1. Field of the Invention
The present invention relates to an image projection apparatus and a method of controlling the same.
2. Description of the Related Art
Recently, liquid crystal projectors that can simply and easily display a large screen by projection have come to be used widely in making presentations in meetings or displaying movie content at home. The liquid crystal projectors are used in various lighting environments, and it is desirable to carry out color reproduction according to actual lighting in projection environments. On the other hand, CIECAM02 (CAM: Color Appearance Model), which is a chromatic adaptation model, published by CIE and other models have been developed for color matching technology. Using these techniques and taking into consideration the lighting environments and the like of liquid crystal projectors, color reproduction is becoming a possibility.
To apply color reproduction to a liquid crystal projector by taking such visual adaptation into consideration, it is necessary to acquire information about illuminating light (ambient light) as viewing environment information. Existing techniques for measuring such illuminating light includes, for example, spectroscopic instruments that use diffracting gratings and color sensors which use color filters or the like. Furthermore, it is necessary to install an integrating sphere or diffuser on the front of the sensors in order to sense the illuminating light properly.
Such equipment, if used, will allow the illuminating light to be measured accurately, but is not desirable from the viewpoint of product costs. If the liquid crystal projector is equipped with a screen color measurement sensor (color sensor) for automatic screen color correction, desirably the illuminating light is sensed using the color sensor. Examples of measuring illuminating light using a color sensor includes a technique, described in U.S. Pat. No. 7,314,283, for projecting one or more calibration images and acquiring color information about the one or more calibration images using the color sensor. The technique performs color conversion in such a way as to match appearances of colors based on color information about an input image and color information about the projected image on a projection plane, thereby changes colors of the input image, and consequently obtains colors for use to output to the projector.
The method described in U.S. Pat. No. 7,314,283 measures the calibration image in advance and thereby obtains color conversion characteristics which realize both color correction on the projection plane and correction for the influence of ambient environment light. However, complicated computations are required in order to generate a 3D-LUT which realizes both color correction on the projection plane and correction for the influence of ambient environment light at the same time. Furthermore, if ambient illuminating light (ambient light) changes during projection, it becomes necessary to regenerate the 3D-LUT which realizes both color correction on the projection plane and correction for the influence of ambient environment light at the same time. This makes it necessary to carry out complicated computations again.
An aspect of the present invention is to eliminate the above-mentioned problems with the conventional technology.
It is a feature of the present invention to provide an image projection apparatus and a method of controlling the same which can accurately and quickly generate color correction information for use to correct for the influence of ambient environment light even when a projection plane is colored.
According to an aspect of the present invention, there is provided an image projection apparatus comprising:
an image projection unit configured to project an image on a projection plane based on image data;
a sensor configured to sense a color on the projection plane; and
a controller configured to control the image projection unit and the sensor and to correct the image data;
wherein the controller makes the image projection unit project a first image for a wall color correction, makes the sensor sense color on the projection plane during projecting the first image, and obtains first correction information based on the sensed color on the projection plane during projecting the first image,
wherein the controller makes the image projection unit project a second image based on image data obtained by correcting the first image for an ambient light correction based on the first correction information, makes the sensor sense color on the projection plane during the projecting the second image, and obtains second correction information according to the sensed color on the projection plane during the projecting the second image, and
wherein the controller corrects the image data based on the first and second correction information and causes the image projection unit to project an image based on the corrected image data.
Further features and aspects of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
Embodiments of the present invention will now be described hereinafter in detail, with reference to the accompanying drawings. It is to be understood that the following embodiments are not intended to limit the claims of the present invention, and that not all of the combinations of the aspects that are described according to the following embodiments are necessarily required with respect to the means to solve the problems according to the present invention.
The image projection apparatus 100, which is a projection display apparatus adapted to display an image using a projector, receives a video signal from an image supply device (not shown) such as a personal computer, DVD player, or TV tuner via a connector 101. The video signal is converted into a digital signal by an A/D converter 102. However, if a digital video signal is received from the image supply device (not shown), the A/D conversion by an A/D converter 102 is unnecessary. A resolution conversion unit 103 converts the video signal into a video signal having resolution suitable for red, green, and blue liquid crystal display devices 107. A color correction circuit 104 applies color correction to the video signal whose resolution has been converted by the resolution conversion unit 103. A display device driving circuit 105 performs double-speed conversion, VT gamma correction, and the like needed to drive the liquid crystal display devices 107, on the video signal subjected to color correction, and thereby generates drive signals for the liquid crystal display devices 107. The liquid crystal display devices 107 receive a luminous flux emitted from an illumination optical system 106 and transmit the luminous flux to a projection optical system 108 under the control of the drive signals from the display device driving circuit 105. The projection optical system 108 performs a zoom operation using a lens 109 and projects the luminous fluxes from each of the liquid crystal display devices 107 onto a screen 201 (
A table storage unit 110 implemented by a RAM or the like stores a three-dimensional lookup table (3D-LUT) for ambient light correction created by a lookup table calculation unit (LUT calculation unit) 114. A ROM 111 prestores programs executed by a central processing unit (CPU) 112, data on the ideal white for the screen 201, and the like. When a user operates a switch 113, switching information is sent to the CPU 112 via a data bus 131. The LUT calculation unit 114 performs calculations to generate a 3D-LUT for color correction through operations described later in response to color sensed results produced by a sensor unit 130 by sensing colors on the projection plane. The sensor unit 130 includes a red (R) sensor 116, green (G) sensor 117, and blue (B) sensor 118 each of which has relative spectral sensitivity as shown in
In
Data sensed (measured) by the R sensor 116, G sensor 117, and B sensor 118 are converted into digital signals by A/D converters 119, 120, and 121, respectively, and sent to a sensor control unit 115. The sensor control unit 115 receives output data from the A/D converters 119, 120, and 121 and converts the output data into a format suitable for processing by the CPU 112. Also, the sensor control unit 115 drives the sensor unit 130 on instructions from the CPU 112.
The image projection apparatus 100 configured as shown in
Output of the resolution conversion unit 103 is inputted in a selector 302. Output of a pattern generation circuit 301 which generates a calibration pattern for use to sense the color of the projection plane is also inputted in the selector 302. On instructions from the CPU 112, the selector 302 selects the output of the pattern generation circuit 301 when outputting a calibration pattern for use to sense the color of the screen 201. On the other hand, when a normal image is projected, the selector 302 selects the output of the resolution conversion unit 103. A coefficients storage unit 307 stores red gain (Ar), green gain (Ag), and blue gain (Ab) determined by undermentioned operations and received from the CPU 112. A multiplier 303 multiplies output of the selector 302 by output of the coefficients storage unit 307 and thereby adjusts the gains. Incidentally, although only a single signal line is shown as joining each pair of components in
The process described in the flowchart is started when power is turned on or the switch 113 is operated. First in step S402, the image projection apparatus 100 generates all-white image data (a first image) using the pattern generation circuit 301 and projects the white color image onto the screen 201. The white color image is projected for two reasons described below. The first reason is that even if the screen 201 is colored, by projecting white color image and correcting to display a white color image on the screen 201, it is possible to eliminate the effect of coloring of the screen 201 and obtain correct white color on the screen 201. The second reason is that when bright light such as white is projected, light reflected by the screen 201 is affected greatly by a light source in the illumination optical system 106, reducing the effect of the illuminating light 204 from the lighting apparatus 202 and thereby making it possible to perform wall color correction without being affected by the illuminating light 204 (ambient light). Although all-white image data is generated in the example described above, another color may be used partially, and it is not strictly necessary to use a completely white color.
At this point, a 3D-LUT for ambient light correction has not been created yet, and thus no 3D-LUT is used. Therefore, the selector 306 selects the output signal of the multiplier 303. Next, in step S403, the image projection apparatus 100 acquires color data Rw, Gw, and Bw of the screen 201 produced by projection of white color, from the R sensor 116, G sensor 117, and B sensor 118, respectively. Next, in step S404, the image projection apparatus 100 acquires first color data R0, G0, and B0 from the ROM 111, where the first color data R0, G0, and B0 represents ideal white value stored in the ROM 111. Next, in step S405, the image projection apparatus 100 computes gains Ar, Ag, and Ab which will equalize a ratio of Rw, Gw, and Bw of second color data acquired from the sensor unit 130 with a ratio of R0, G0, and B0 of the ideal white value acquired in step S404. In the example described above, the gains Ar, Ag, and Ab are computed as correction information through calculation of first color correction, that is, wall color correction, and multiplication is performed by the multiplier 303. However, the present invention is not limited to this, and another method may be used alternatively, such as a method which adjusts the gains after matching black levels of each color using offset values.
Next, in step S406, the image projection apparatus 100 sends the gains Ar, Ag, and Ab computed in step S405 to the multiplier 303. At the same time, the pattern generation circuit 301 generates an all-gray pattern (a second image) which is a pattern for sensing of the illuminating light 204 and projects the pattern onto the screen 201. The reason why a gray image is projected instead of a white image is to accurately sense the illuminating light 204 reflected by the screen 201 by reducing the effect of the light source in the illumination optical system 106. Also, at this time, wall color correction is applied to the projected image using the gains Ar, Ag, and Ab to eliminate the effect of the coloring of the screen 201. Next, in step S407, the image projection apparatus 100 acquires color data Re, Ge, and Be of the screen 201 subjected to wall color correction, from the R sensor 116, G sensor 117, and B sensor 118, respectively. Incidentally, although an all-gray image is projected in the example described above, another color may be used partially, or a color other than gray may be used as long as the color contains each of R, G, and B components.
Next, in step S408, the image projection apparatus 100 substitutes the color data Re, Ge, and Be acquired in step S407 into Eqs. (1) and (2) and thereby computes chromaticity of the illuminating light 204.
r=Re/(Re+Ge+Be) Expression (1)
g=Ge/(Re+Ge+Be) Expression (2)
An example of the chromaticity computed here is shown in 810 of
Next, in step S409, the image projection apparatus 100 estimates the illuminating light 204 based on the chromaticity computed in step S408. The ROM 111 prestores center values of rg chromaticity and major-component information for use to determine likelihood of 15 types of standard light source—F1 to F12 (fluorescent lamps), A (white light source), D50 (5000K), and D65 (daylight). The CPU 112 reads the data for likelihood determination. Incidentally, although 15 types of standard light source are used in the present embodiment, naturally more than or less than 15 types of standard light source may be used.
Next, in step S410, based on the type of the illuminating light determined in step S409, the image projection apparatus 100 performs calculations for second color correction in order for the LUT calculation unit 114 to generate a 3D-LUT containing color correction information for ambient light correction. The process of creating the three-dimensional lookup table 3D-LUT in step S410 is performed according to a flowchart in
First, in step S502, the LUT calculation unit 114 acquires a set of RGB values corresponding to an LUT lattice point. Next, in step S503, the LUT calculation unit 114 converts the acquired RGB values into XYZ values based on a source device model. The source device model may be one of various models including sRGB and AdobeRGB. Although sRGB is used as an example of the source device model in the first embodiment, the present invention is not limited to this.
Next, in step S504, the LUT calculation unit 114 converts the XYZ values computed in step S503 into JCh values based on CIECAM02 published by the Commission Internationale de l'Eclairage (CIE; or the International Lighting Commission). Next, in step S505, based on a source color gamut and destination color gamut, the LUT calculation unit 114 does color gamut mapping so as to map colors outside the destination color gamut to a destination color gamut surface with the shortest distance without converting colors in the destination color gamut. The source color gamut and destination color gamut are computed in advance before this process. Next, in step S506, the LUT calculation unit 114 converts the JCh values computed in step S504 into XYZ values based on CIECAM02. Next, in step S507, the LUT calculation unit 114 converts the XYZ values computed in step S506 into RGB values based on a destination device model. Incidentally, the destination profile used in step S507 is selected from the 16 kinds of profiles described above. In S508, the LUT calculation unit 114 determines whether conversion into RGB values has been completed at all LUT lattice points. If computations of RGB values have been completed, the LUT calculation unit 114 advances the process to step S509. Otherwise, the process returns to step S502. In step S509, the LUT calculation unit 114 stores the 3D-LUT for conversion in the table storage unit 110, and finishes processing.
Once the processing is finished, the image projection apparatus according to the present embodiment is ready to project an image obtained by applying ambient light correction and wall color correction to the inputted image data.
Specifically,
In the flowchart in
In the first embodiment, the LUT calculation unit 114 is provided to generate a 3D-LUT on a hardware basis on instructions from the CPU 112 as an example. However, the method for generating a 3D-LUT is not limited to this, and the CPU 112 may generate a 3D-LUT through calculations according to software instead of using the LUT calculation unit 114. Anyway, there is no difference between hardware and software in that the image projection apparatus operates according to the flowcharts in
In the first embodiment, the LUT calculation unit 114 generates the 3D-LUT for ambient light correction based on the type of illuminating light determined. However, the present invention is not limited to this, and 3D-LUTs for each type of illuminating light may be prestored in the ROM 111 to allow selection of the 3D-LUT corresponding to the illuminating light determined in step S410 in
As described above, according to the first embodiment, the image projection apparatus first senses the color of the projection plane using a sensor, then performs screen color correction (wall color correction), does a projection, senses the color of the projection plane using a sensor again in this state, and estimates illuminating light (ambient light). This makes it possible to estimate the illuminating light accurately even if the screen is colored and furthermore to accurately generate a 3D-LUT for illuminating light correction based on the estimated illuminating light.
Also, in generating the 3D-LUT, since it is only necessary to create a table which is used only for correction for illuminating light and which does not have a wall color correction function, it is possible to reduce calculation time. Furthermore, even if the type or state of illuminating light changes during projection, since the wall color correction has been completed in the previous state of the illuminating light, a 3D-LUT for illuminating light correction can be generated accurately by estimating the illuminating light quickly.
A second embodiment of the present invention will be now described with reference to
The generation or change of the 1D-LUT is done in step S405 of the flowchart in
Output of the resolution conversion unit 103 is inputted in the selector 302. Output of a pattern generation circuit 301 which generates a calibration pattern for use to sense the projection plane is also inputted in the selector 302. On instructions from the CPU 112, the selector 302 selects the output of the pattern generation circuit 301 when a calibration pattern for color measurement of the screen 201 is used, and selects the output of the resolution conversion unit 103 when a normal image is projected. Output of the selector 302 is sent to a selector 310 and an address generation circuit 308. The address generation circuit 308 converts an output signal of the selector 302 into an address in the table storage unit 110 and sends the address to the table storage unit 110 via the data bus 131. The table storage unit 110 reads data out of the inputted address and sends the data to a data storage unit 309 via the data bus 131. The data storage unit 309 extracts a signal value from the data received from the table storage unit 110 and sends the signal value to the selector 310, where the signal value corresponds to a value obtained by applying predetermined correction to the output signal of the selector 302. The address generation circuit 308 and data storage unit 309 exchange addresses and data related to the 1D-LUT. On instructions from the CPU 112, the selector 310 selects the output signal of the data storage unit 309 when wall color correction is performed using the 1D-LUT, and selects the output signal of the selector 302 when the wall color correction is not performed using the 1D-LUT.
Output of the selector 310 is sent to a selector 306 and an address generation circuit 304. The address generation circuit 304 converts an output signal of the selector 310 into an address in the table storage unit 110 and sends the address to the table storage unit 110 via the data bus 131. The table storage unit 110 reads data out of the inputted address and sends the data to the data storage unit 305 via the data bus 131. The data storage unit 305 extracts a signal value from the data received from the table storage unit 110 and sends the signal value to the selector 306, where the signal value corresponds to a value obtained by applying predetermined correction to the output signal of the selector 310. The address generation circuit 304 and a data storage unit 305 exchange addresses and data related to the 3D-LUT. On instructions from the CPU 112, the selector 306 selects the output of the data storage unit 305 when ambient light correction is performed using the 3D-LUT, and selects the output signal of the selector 310 when ambient light correction is not performed.
As described above, according to the second embodiment, the image projection apparatus first senses the color of the projection plane using a sensor, then performs screen color correction (wall color correction) using a 1D-LUT, does a projection, senses the color of the projection plane using the sensor again in this state, and thereby estimates illuminating light (ambient light). This makes it possible to estimate the illuminating light accurately even if the screen is colored and furthermore to accurately generate a 3D-LUT for illuminating light correction based on the estimated illuminating light.
Also, in generating the 3D-LUT, since it is only necessary to create a table which is used only for illuminating light correction and which does not have a wall color correction function, it is possible to reduce calculation time. Furthermore, even if the type or brightness of illuminating light changes during projection, since wall color correction has been completed in the previous state of the illuminating light, a 3D-LUT for illuminating light correction can be generated accurately by estimating the illuminating light quickly.
Aspects of the present invention can also be realized by a computer of a system or apparatus (or devices such as a CPU or MPU) that reads out and executes a program recorded on a memory device to perform the functions of the above-described embodiment(s), and by a method, the steps of which are performed by a computer of a system or apparatus by, for example, reading out and executing a program recorded on a memory device to perform the functions of the above-described embodiment(s). For this purpose, the program is provided to the computer for example via a network or from a recording medium of various types serving as the memory device (e.g., computer-readable medium).
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2009-157313, filed Jul. 1, 2009, which is hereby incorporated by reference herein in its entirety.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2009-157313 | Jul 2009 | JP | national |
