Patent Grant
8064125
1. Field of the Invention
The present invention relates generally to the system configuration and methods for controlling and operating a projection apparatus. More particularly, this invention related to an image projection apparatus implemented with a plurality of spatial light modulators and light sources with a controller to control the modulators in different modulations states in coordination with the light sources emitting pulsed emissions to achieve optimal quality of image display.
2. Description of the Related Art
After the dominance of CRT technology in the display industry for over 100 years, Flat Panel Display (hereafter FPD) and Projection Display became popular because of its smaller form-factor and larger size of the screen. Among several types of projection displays, projection displays using micro-display are gaining recognition by consumers because of higher picture quality as well as lower cost than FPDs. There are two types of micro-displays used for projection displays in the market: micro-LCD (Liquid Crystal Display) and micro-mirror technology. Because a micro-mirror device uses the randomly polarized light, it is brighter than a micro-LCD, which uses polarized light.
Even though there have been significant advances made in recent years on the technologies of implementing electromechanical micro-mirror devices as spatial light modulator, there are still limitations and difficulties when these are employed to display high quality images. Specifically, when the display images are digitally controlled, the image quality is adversely affected because the image is not displayed with a sufficient number of gray scales.
The on-and-off states of micro-mirror control schemes, as that implemented in the U.S. Pat. No. 5,214,420 and by most of the conventional display systems such as that disclosed in U.S. Pat. No. 5,285,407 impose a limitation on the quality of the display. Specifically, with conventional configurations of the control circuit, the gray scale of conventional systems (PWM between ON and OFF states) is limited by the LSB (least significant bit, or the least pulse width). Due to the On-Off states implemented in the conventional systems, there is no way to provide a shorter pulse width than the LSB. The least brightness, which determines the gray scale, is the light reflected during the least pulse width. A limited gray scale leads to lower image quality.
In a simple example, and assuming n bits of gray scales, the frame time is divided into 2n−1 equal time slices. For a 16.7 milliseconds frame period and n-bit intensity values, the time slice is 16.7/(2n−1) milliseconds
Having established these times for each pixel of each frame, pixel intensities are quantified, such that black is 0 time slices, the intensity level represented by the LSB is 1 time slice, and the maximum brightness is 2n−1 time slices. Each pixel's intensity determines it's the length of time the pixel is turned on during a frame period. Thus, during a frame period, each pixel with a value of more than 0 is on for the number of time slices that correspond to its intensity. The viewer's eye integrates the pixel's brightness so that the image appears the same as if it were generated with analog levels of light.
For addressing deformable mirror devices, PWM receives the data formatted into “bit-planes”. Each bit-plane corresponds to a bit weight of the intensity value. Thus, if each pixel's intensity is represented by an n-bit value, each frame of data has n bit-planes. Each bit-plane has a 0 or 1 value for each display element. In the example described above, each bit-plane is separately loaded during a frame, and the display elements are addressed according to their associated bit-plane values. For example, the bit-plane representing the LSBs of each pixel is displayed for 1 time slice.
Projection apparatuses, such as those described above, generally use a light source such as a high-pressure mercury lamp or a xenon lamp. However, these types of light sources perform poorly in high-speed switching that alternate between the ON and OFF states. Because of this, these lamps are commonly controlled to be in a continuous ON state while the apparatus is in operation. Thus, it is not possible to accurately control the light intensity in the transition state, between an ON state and an OFF state, for an ON/OFF modulation of a mirror. This causes a degradation of image quality in the modulation control of a video image when using a spatial light modulator.
Furthermore, when the intensity of light modulated by a spatial light modulator is only controlled by the ON/OFF operation of the mirror, the oscillation speed of the mirror needs to be increased in order to implement a finer control of the light intensity. Increasing the oscillation speed of the mirror, however, is limited by a number of factors including the strength of a hinge constituting the mirror and the frequency of the control signal used for the tilt (i.e., oscillation) control, such as the ON/OFF control. Thus, there will be a limitation in controlling light intensity when only the ON/OFF controls of the mirror are used to control the modulation of light intensities.
In order to control the color temperature and/or color balance, the input video signal needs to be processed. Because of this, further technical problems, such as an unnecessarily complex process circuit for the video, are introduced.
A purpose of the present invention is to provide a system configuration and control process to more accurately control the intensity of the modulated light without being influenced by the transition state between the ON and OFF states of the ON/OFF modulation of a mirror.
Another purpose of the present invention is to provide a system configuration and control process to more accurately control the intensity of the modulated light independent of the speed of the tilt control of a mirror.
Yet another purpose of the present invention is to provide a system configuration and control process to more accurately control a color temperature and a color balance without requiring an input video signal to be changed.
A first exemplary embodiment of the present invention provides a display apparatus, comprising: a light source or light sources for emitting a luminous flux or luminous fluxes having a plurality of colors; a spatial light modulator for modulating the luminous flux(es) having a plurality of colors incoming from the light sources; and controller for processing video image input data, and controlling the light source(s) and the spatial light modulator, wherein the controller generates a plurality of video image signals of colors constituting a video image on the basis of the video image input data, and controls the light source(s) to project at least two colors, from among the light source(s) having a plurality of colors, to perform pulse emission in sequence and modulate the pulse emission during a period shorter than a period of a modulation state controlled under the spatial light modulator by applying the video image signal of one color from among the video image signals.
A second exemplary embodiment of the present invention provides the display apparatus according to the first exemplary embodiment, wherein a period of a modulation state controlled under the spatial light modulator is a minimum unit time for controlling the spatial light modulator under a modulation state on the basis of the video image information.
A third exemplary embodiment of the present invention provides the display apparatus according to the first exemplary embodiment, wherein the minimum unit time is a period of time in accordance with a period of time in accordance with a period of time for loading, onto the pixel of the spatial light modulator, a minimum unit of data to control the gradation of the brightness of the spatial light modulator on the basis of the video image information.
A fourth exemplary embodiment of the present invention provides the display apparatus according to the first exemplary embodiment, wherein the light source is a light emitting diode (LED) or laser light source.
A fifth exemplary embodiment of the present invention provides the display apparatus according to the first exemplary embodiment, wherein the spatial light modulator is controlled under a plurality of modulation states in accordance with a control signal from the controller.
A sixth exemplary embodiment of the present invention provides the display apparatus according to the first exemplary embodiment, further comprising projector, wherein the spatial light modulator is a mirror device comprising a plurality of micromirrors, and the projector projects the modulation light of the spatial light modulator.
A seventh exemplary embodiment of the present invention provides the display apparatus according to the sixth exemplary embodiment, wherein the spatial light modulator is controlled under any of an ON state for guiding the luminous flux emitted from the light source to the projector, of an OFF state for guiding the luminous flux emitted from the light source away from the projector and of an oscillation state that is between the ON state and OFF state, with a control signal from the controller.
An eighth exemplary embodiment of the present invention provides the display apparatus according to the first exemplary embodiment, wherein the controller converts an inputted binary video signal into a non-binary video signal, and the modulation of the spatial light modulator is controlled on the basis of the non-binary signal.
A ninth exemplary embodiment of the present invention provides the display apparatus according to the first exemplary embodiment, wherein the modulation of the pulse emission is the modulation of a pulse width.
A tenth exemplary embodiment of the present invention provides the display apparatus according to the first exemplary embodiment, wherein the modulation of the pulse emission is the modulation of a pulse intensity.
An eleventh exemplary embodiment of the present invention provides the display apparatus according to the first exemplary embodiment, wherein the controller adjusts the color balance of a video image to be displayed by controlling the modulation of the pulse emission.
A twelfth exemplary embodiment of the present invention provides the display apparatus according to the eleventh exemplary embodiment, further comprising video image analysis means for analyzing the brightness of each color of an inputted video image signal, wherein the controller adjusts the color balance by controlling the modulation of the pulse emission in accordance with a control signal from the video image analysis means.
A thirteenth exemplary embodiment of the present invention provides the display apparatus according to the eleventh exemplary embodiment, wherein the modulation of the pulse emission is different between a time when the brightness data of each pixel is that of a dark pixel and a time when the bright brightness of each pixel is that of a bright pixel.
A fourteenth exemplary embodiment of the present invention provides the display apparatus according to the eleventh exemplary embodiment, further comprising a mirror device comprising a plurality of micromirrors as spatial light modulator, wherein the sets of sequential emission of respective colors are repeated for a plurality of times to change at least either of the pulse widths and pulse intensities of the pulse emission of the respective colors in each of the aforementioned sets within the display period of one frame in which the durations of the ON state of the micromirror are changed in accordance with the brightness data.
A fifteenth exemplary embodiment of the present invention provides the display apparatus according to the fourteenth exemplary embodiment, wherein the ratio of light intensities of individual colors within each set of the sequential emission is controlled to be constant.
A sixteenth exemplary embodiment of the present invention provides the display apparatus according to the fourteenth exemplary embodiment, wherein the ratio of light intensities of individual colors within each set of the sequential emission is controlled to be variable.
The following is a detailed description of the preferred embodiments of the present invention with reference to the accompanying drawings. More specifically, the following description is provided for the application of the present invention to a projection apparatus as an example of display apparatuses.
The projection optical system 5400 is implemented with a spatial light modulator 5100 and TIR prism 5300 disposed on the optical axis of the projection optical system 5400, and the light source optical system 5200 is placed with a configuration to have an optical axis matches the optical axis of the projection optical system 5400.
The TIR prism 5300 receives the incoming illumination light 5600 projected from the light source optical system 5200 and directs the light to transmit as incident light 5601 to the spatial light modulator 5100 at a prescribed inclination angle. The SLM 5100 further reflects and transmits a reflection light 5602 towards the projection optical system 5400.
The projection optical system 5400 projects the reflection light 5602 from the SLM 5100 and TIR prism 5300 onto a screen 5900 as projection light 5603. The light source optical system 5200 comprises a adjustable light source 5210 for generating the illumination light 5600, a condenser lens 5220 for focusing the illumination light 5600, a rod type condenser body 5230 and a condenser lens 5240.
The adjustable light source 5210, condenser lens 5220, rod type condenser body 5230 and condenser lens 5240 are sequentially placed in the aforementioned order in the optical axis of the illumination light 5600 emitted from the adjustable light source 5210 and incident to the side face of the TIR prism 5300.
The projection apparatus 5010 employs a single spatial light modulator 5100 for implementing a color display on the screen 5900 by means of a sequential color display method.
Specifically, the adjustable light source 5210, comprising a red 5211, a green 5212, and a blue laser light source 5213 (not shown in the drawing), allows independent control of the light emission states. The controller of the adjustable light source divides one frame of display data into a plurality of sub-fields (i.e., three sub-fields, specifically, red (R), green (G) and blue (B) in the present case) and makes each of the laser light sources, the red 5211, green 5212 and blue 5213, emit each respective light in time series at the time band corresponding to the sub-field of each color, as will be described later.
The projection apparatus 5020 is commonly referred to as a multi-plate projection apparatus comprising a plurality of spatial light modulators 5100 instead of a single SLM included in the single-panel projection apparatus 5010 described above. Furthermore, the projection apparatus 5020 comprises a control unit 5502 in place of the control unit 5500.
The projection apparatus 5020 comprises a plurality of spatial light modulators 5100, and further includes a light separation/synthesis optical system 5310 between the projection optical system 5400 and each of the spatial light modulators 5100.
The light separation/synthesis optical system 5310 comprises a plurality of TIR prisms, i.e., TIR prism 5311, TIR prism 5312, and TIR prism 5313.
The TIR prism 5311 functions to direct the illumination light 5600, projected along the optical axis of the projection optical system 5400, to the spatial light modulator 5100 as incident light 5601.
The TIR prism 5312 functions to separate the red (R) light from an incident light 5601, projected by way of the TIR prism 5311, transmitting the red light incident to the red light-use spatial light modulators 5100, and further directs the reflection light 5602 of the red light to the TIR prism 5311.
Likewise, the TIR prism 5313 functions to separate the blue (B) and green (G) lights from the incident light 5601, projected by way of the TIR prism 5311, and transmits them to the blue color-use spatial light modulator 5100 and green color-use spatial light modulator 5100, and further functions to direct the reflection light 5602 of the green light and blue light to the TIR prism 5311.
Therefore, the spatial light modulations of these three colors of R, G and B are simultaneously performed at three spatial light modulators 5100, respectively. The reflection lights, resulting from the respective modulations, are projected onto the screen 5900 as the projection light 5603 by way of the projection optical system 5400, and thus a color display is carried out.
Note that the system may implement various modifications by using a light separation/synthesis optical system instead of being limited to the light separation/synthesis optical system 5310 described above.
The sequencer 5540 includes a microprocessor to control the operation timing of the entire control unit 5500 and the spatial light modulators 5100.
In one exemplary embodiment, the frame memory 5520 one frame of input digital video data 5700 received from an external device (not shown figure) connected to a video signal input unit 5510. The input digital video data 5700 is updated, in real time, every time the display of one frame is completed.
The SLM controller 5530 processes the input digital video data 5700 read from the frame memory 5520, as described later. The SLM controller 5530 separates the read data into a plurality of sub-fields 5701 through 5703, and outputs them to the spatial light modulators 5100 as binary data 5704 and non-binary data 5705, which are used for implementing an ON/OFF control and an oscillation control (which are described later) of a mirror 5112 of the spatial light modulator 5100.
The sequencer 5540 outputs a timing signal to the spatial light modulators 5100 in sync with the generation of the binary data 5704 and non-binary data 5705 at the SLM controller 5530.
The video image analysis unit 5550 outputs a video image analysis signal 6800 used for generating various light source patterns (which are described later) corresponding to the input digital video data 5700 inputted from the video signal input unit 5510.
The light source control unit 5560 controls the light source drive circuit 5570 to control the operation of the adjustable light source 5210 by using a light source profile control signal in emitting the illumination light 5600. The light source profile control signal is generated from the video image analysis signal 6800 by the video image analysis unit 5550 using data from the light source pulse patterns 5801 through 5811 generated by the sequencer 5540, as will be further described below.
The light source drive circuit 5570 operates to drive the red 5211, green 5212 and blue 5213 laser light sources of the adjustable light source 5210 to emit light. The light source generates the light source pulse patterns 5801 through 5811 (which are described later) received from the light source control unit 5560.
The control unit 5502 comprises a plurality of SLM controllers 5531, 5532 and 5533 that are used for controlling each of the spatial light modulators 5100. Each of the modulators is implemented for modulating the respective colors R, G and B, and the configuration of the controllers is the main difference between the control unit 5502 and the control unit 5500 described in
Specifically, each of the SLM controllers 5531, 5532 and 5533 is implemented to process the modulation of its respective color R, G, and B. Each modulator is supported on the same substrates as those of the respective spatial light modulators 5100. This configuration makes it possible to place the individual spatial light modulators 5100 and the corresponding SLM controllers 5531, 5532 and 5533 close to each other, thereby enabling a high-speed data transfer rate. Furthermore, a system bus 5580 is used to connect the frame memory 5520, light source control unit 5560, sequencer 5540 and SLM controllers 5531 through 5533, in order to speed up and simplify the connection path of each connecting element.
The light source drive circuit shown in
The switching circuits 5570b each carries out a switching in accordance with a desired emission profile of the light source optical system 5200 (i.e., the red 5211, green 5212 or blue 5213 laser light source).
The setup values of the output current of the constant current circuits 5570a (i.e., constant current circuits I (R,G,B)n), when the gray scale of the emission intensity of the light source optical system 5200 is designated at N bits (where N≧n), are as follows:
I(R,G,B)1=Ith+LSB
I(R,G,B)2=LSB+1
I(R,G,B)3=LSB+2
. . .
. . .
I(R,G,B)n=MSB
In this exemplary embodiment, a gray scale display is controlled on the basis of the emission intensity. A similar gray scale display is achievable even if the emission period (i.e., an emission pulse width) and the emission interval (i.e., an emission cycle) are variable.
The relationship between the emission intensity Pn of the adjustable light source and drive current for each color in this case is as follows. Note that “k” is an emission efficiency corresponding to the drive current:
P1=k*(Ith+I1)
P2=k*(Ith+I1+I2)
. . .
. . .
Pn=k*(Ith+I1I2+. . . +In-1+In)
For simplicity,
As described later, the light source drive circuits 5570, according to the present embodiment, are configured to control the individual constant current circuit 5570a (i.e., I (R,G,B)1 in this case) to supply a current value equivalent to the threshold current Ith of the light source optical system 5200. Alternately, the individual constant current circuit supplies a current close to the aforementioned threshold current, as a bias current Ib when a semiconductor laser or similar light source is used as the light source optical system 5200. By using a high-speed current drive, the respective switching operations of the light source drive circuits 5570 are stabilized to provide a high-speed emission.
The light source drive circuits 5570 (i.e., the light source drive circuits 5571, 5572, and 5573) shown in
Furthermore, the connection of the constant current circuits 5570a to the light source optical systems 5200 is configured through a switching circuit 5570d (SWpulse) formed on the downstream side of the switching circuits 5570b.
In the case of the configuration shown in
Pb=k*Ib(Ib∞Ith)
P1=k*(Ith+I1)
P2=k*(Ith+I1+I2)
. . .
. . .
Pn=k*(Ith+I1+I2+. . . +In-1+In)
Specifically, the relationship between each switching operation and emission output is as follows:
SWpulse=OFF:Pb=k*Ib≈0[mW] (where Ib≈Ith)
SW1:P1=k*(Ib+I1)
SW2:P2=k*(Ib+I1+I2)
. . .
. . .
SWn:Pn=k*(Ib+I1+I2+. . . In-1+In)
With this, it is possible to attain an emission profile possessing an emission intensity Pb that is nearly zero.
While the bias current value is designated at a fixed current value in the configuration of
Note that the descriptions for
The following detail description explains the configuration of the spatial light modulator 5100 according to the present embodiment.
The spatial light modulator 5100 according to the present embodiment is a deflectable mirror device with an array of mirror elements.
As shown in
An OFF electrode 5116 (and an OFF stopper 5116s) and an ON electrode 5115 (and an ON stopper 5115s) are placed symmetrically across the hinge 5113 on the substrate 5114.
The OFF electrode 5116 attracts the mirror 5112 with a coulomb force by applying a predetermined voltage and tilts the mirror 5112 to make contact with the OFF stopper 5116s. This causes the incident light 5601, incident to the mirror 5112, to be reflected to the light path of an OFF position, offset from the optical axis of the projection optical system 5400. The state of a mirror (or mirror element) in this condition is called the OFF state.
The ON electrode 5115 attracts the mirror 5112 with a coulomb force by applying a predetermined voltage and tilts the mirror 5112 to make contact with the ON stopper 5115s. This causes the incident light 5601, incident to the mirror 5112, to be reflected to the light path of an ON position, matching the optical axis of the projection optical system 5400. The state of a mirror (or mirror element) in this condition is called the ON state.
Furthermore, in
The first and second memory cells 5115a and 5116a each has a dynamic random access memory (DRAM) structure comprising gate transistors (i.e., gate transistors 5115c and 5116c) and a capacitor (i.e., ON capacitor 5115b and OFF capacitor 5116b) in this configuration. The structures of the individual memory cells 5115a and 5116a are not limited as such and may instead be, for example, a static random access memory (SRAM) structure or the like.
Furthermore, the individual memory cells 5115a and 5116a are connected to the respective address electrodes 5115 and 5116, a COLUMN line 1, a COLUMN line 2 and a ROW line.
In the first memory cell 5115a, the gate transistor 5115c is connected between the address electrode 5115 and ROW line, and between the COLUMN line 1 and ROW line. An ON capacitor 5115b is connected between the address electrode 5116 and GND (i.e., the ground). Likewise in the second memory cell 5116a, a gate transistor 5116c is connected between the address electrode 5116 and COLUMN line 2, and between the COLUMN line 2 and ROW line. An OFF capacitor 5116b is connected between the address electrode 5116 and GND.
Controlling the signals on the COLUMN line 1 and ROW line applies a predetermined voltage to the address electrode 5115, thereby making it possible to tilt the mirror 5112 towards the address electrode 5115. Likewise, controlling the signals on the COLUMN line 2 and ROW line applies a predetermined voltage to the address electrode 5116, thereby making it possible to tilt the mirror 5112 towards the address electrode 5116.
Specifically, the ON/OFF of the gate transistors 5116c and 5115c are controlled by ROW line. Specifically, the mirror elements 5111 disposed on one horizontal row along a designated ROW line are simultaneously selected, and the charging and discharging of electrical charge to and from the ON capacitor 511b and 5116b are controlled, thereby turning ON and OFF the mirrors 5112 of individual mirror elements on one horizontal row.
Note that a drive circuit for each of the memory cells 5116a and 5116a is commonly formed in the device substrate 5114. Controlling the respective memory cells 5115a and 5116a in accordance with the signal of image data enables control of the deflection angle of the mirror 5112 and carries out the modulation and reflection of the incident light.
Next is a description of the deflecting operation of the mirror 4003 of the mirror element 4001 shown in
Specifically the present patent application defines the deflection angles of the mirror 4003 as “+” (positive) for clockwise (CW) direction and “−” (negative) for counterclockwise (CCW) direction, with “0” degrees as the initial state of the mirror 4003. Furthermore, an insulation layer 4006 is provided on the device substrate 4004, and a hinge electrode 4009, connected to the elastic hinge 4007, is grounded through the insulation layer 4006.
In
The total intensity of light reflected during free oscillation towards the projection optical system is certainly lower than the intensity that is produced when the mirror 4003 is continuously in the ON light state and higher than the intensity that is produced when it is continuously in the OFF light state. Specifically, it is possible to produce an intermediate intensity between the intensities of the ON light state and OFF light state. Therefore, by finely adjusting the light intensity as described above, a higher gradation image can be projected than with the conventional technique.
Although not shown in a drawing, an alternative configuration may be such that only a portion of light is made to enter the projection optical system by reflecting an incident light in the initial state of a mirror 4003. Configuring as such makes the reflection light enter the projection optical system with a higher intensity than when the mirror 4003 is continuously in the OFF light state and with a lower intensity than when the mirror 4003 is continuously in the ON light state, thus controlling the mirror 4003 to operate in an intermediate light state.
A mirror device with an oscillation state and an intermediate light state is more preferable than the conventional mirror device capable of controlling in only two states (i.e., the ON light state and OFF light state) as a device for displaying a next generation image with a higher level of gradation.
The following are descriptions of various preferred embodiments, with the configurations and operations of the projection apparatuses shown in
A projection apparatus according to the present embodiment may be implemented according the apparatuses described as a single-panel projection apparatus 5010, that includes the optical system as depicted in the above described
Specifically, the SLM controller 5530 of the control unit 5500 as that implemented by the projection apparatus 5010 generates a light source profile control signal 5800 based on the input digital video data 5700. The light source profile control signals are then inputted to a light source control unit 5560 through a sequencer 5540A.
The light source control unit 5560 controls the pulse width to project pulse emission from the red laser light source 5211, green laser light source 5212 and blue laser light source 5213 of a light source 5210 as flashing lights. The speed of flashing rates controlled by the light source profile control signal 5800 for switching between different colors of laser lights has a higher speed than the rate of state changes of the mirrors 4003 implemented in spatial light modulator 5100 for modulating the lights of different colors. Specifically,
Therefore, the mirror ON period T0 includes a rise time tr, a mirror stable ON time Tnet and a fall time tf. The mirror 4003 is unstable during the period of the rise time tr and fall time tf. The operation of the mirror during these unstable ON time periods generates a noise in reflection light 5602.
In order to minimize the adverse effects of the reflection during the unstable ON time periods, the present embodiment implements a light source control to turn on the light source 5210 only for a period of time of the mirror stable ON time Tnet. The light source is controlled by a light source pulse pattern 8010. With properly arranged light source control signals, the reflection light during the unstable ON periods including the rise time tr and fall time tf are eliminated because the light source is turned off during these periods. Therefore, accurate control of the intensity of the reflection light 5602 is achievable by controlling the projection periods the incident light 5601 from the light source incident to the spatial light modulator 5100.
Furthermore, the control method for controlling the mirror 4003 can also be applied to an apparatus implemented with an oscillation control. With oscillation control schemes, in addition the ON/OFF mirror states as depicted in
With the reduced amount of light that is controllable, accurate control of the intensity of the reflection light 5602 (i.e., projection light 5603) down to an amount of about ⅓ unit and ¼ unit is achievable by controlling the pulse emission of the light source 5210 with different pulse width. The pulse width may be flexibly controlled in a period in which the change amount of the intensities of the reflection light 5602 reflected from the mirror 4003. Generally, the smallest amount of controllable light is achievable when the mirror 4003 of the spatial light modulator 5100 is operated in the oscillation state.
The following is a description of an exemplary embodiment for improving a degree of freedom in a color expression. Improvements of the color temperature and color balance are achievable for a projection image by controlling the pulse emission projection of the light source 5210 without changing the input digital video data 5700.
Step 1: the control signal inputted to SLM controller 5530 as control words, shown as one frame of input digital video data 5700, are divided into R, G and B pieces of data, noted as “RBG data” hereinafter.
Step 2: the SLM controller 5530 further divides the RGB data into a plurality of pieces, e.g., 31 pieces when the input data is for a 5-bit gray scale; 127 pieces when the input data is for 7-bit gray scale.
Step 3: the SLM controller 5530 processes the RGB data now divided according to the R, G and B colors as sub-fields, rearranges the sub-fields in order of R, G and B, and generates a one-frame control signal (Data) (i.e., a mirror ON/OFF control pattern 8021a shown in
Step 4: the SLM controller 5530 generates a control signal, i.e., a light source pulse pattern 8011 shown in
Furthermore, the SLM controller 5530 generates the light source pulse pattern 8011 to increase the emission time length of the light source of the main color for image display in each sub-field and decreases the emission time lengths of the light source of the remaining colors. As an example, for displaying the color red (R) of the light source pulse pattern 8011 of the sub-field as shown in
Furthermore, the exemplary embodiment provides controllable lengths of time for controlling the red light source turn-on time TR, green light source turn-on time TG and blue light source turn-on time TB. These controllable lengths of time are the respective emission time lengths of the light sources of the main color (i.e., red in this case) and other colors, are set within the mirror stable ON time Tnet. Other then the main color, the lengths of time are controlled to have a shorter length than the control unit time (i.e., the mirror ON period T0) of the mirror 4003 implemented in the spatial light modulator 5100. These subfields for each color are controlled to carry out a sequential emission of the respective colors R, G and B, or two colors from among R, G and B during the display period of sub-frames on an as required basis.
Step 5: the SLM controller 5530 receives and applies the light source pulse pattern 8011 corresponding to the light source profile control signal 5800 to control the light source 5210 and also controls the spatial light modulator 5100 using the above described control signal (Data) of the spatial light modulator 5100.
According to the control processes, the projection apparatus 5010 controlled with a color sequential method using the input digital video data 5700 and implementing the projection optical system 5400 to project a color video image on a screen 5900 using the color sequential display method.
Specific benefits of the present embodiment are summarized and discussed below. Changing the ratio of the time lengths (i.e., the red light source turn-on time TR, green light source turn-on time TG and blue light source turn-on time TB) of the respective color lights, i.e., R, G and B, emitted during the display period of sub-frames can achieve the desired color balance of the color video image by using the projection light 5603 projected on the screen 5900 by way of the projection optical system 5400. The color balance is achieved without changing a control signal (Data) for the spatial light modulator 5100.
Alternatively, each of the red light source turn-on time TR, green light source turn-on time TG and blue light source turn-on time TB can be set at respectively a predetermined time length.
Furthermore, the red light source turn-on time TR, green light source turn-on time TG and blue light source turn-on time TB can respectively be controlled as flexibly adjustable time lengths. Or, by changing the ratios appropriately among the red light source turn-on time TR, green light source turn-on time TG and blue light source turn-on time TB can further adjust the color balance. Specifically, the changing the ratios among the red light source turn-on time TR, green light source turn-on time TG and blue light source turn-on time TB, is equivalent to changing the color coordinates on a chromaticity diagram (not shown in a drawing herein). The image projection apparatus enables the control system to control the color temperature of a color video image displayed on the screen 5900 using the projected light 5603 by appropriately changing the ratio among the red light source turn-on time TR, green light source turn-on time TG and blue light source turn-on time TB.
It is possible to enhance brightness by controlling the green light source turn-on time TG and blue light source turn-on time TB to overlap with the time period of the red light source turn-on time TR during the display period of one main color (i.e., red in this case) according to the light source pulse pattern 8011 shown in the above described
Specifically, the green light source turn-on time TG (i.e., white light/green component TWG) and blue light source turn-on time TB (i.e., white light/blue component TWB) are controlled to overlap with the time period of the main red light source turn-on time TR during the mirror stable ON time Tnet. The colors are synthesized with the white light/red component TWR contained in the red light source turn-on time TR, thereby generating a white component to proportionately enhance the brightness of the projection image.
Specifically,
Specifically,
There are three bit for each color for controlling the mirror 4003 to operate at an ON state in the seven ON periods during the display period of one frame of a display video image according to the mirror ON/OFF control pattern 8021. Specifically, the mirror projects in each ON period a brightness equivalent to the LSB of the upper 3-bit of respective colors according to the input data during the respective ON period. In the ON periods for each color, the mirror 4003 is repeatedly operated at an ON state multiple times (i.e., two times in this configuration) of the pulse emission of the red laser light source 5211, green laser light source 5212 and blue laser light source 5213 of the respective colors R, G and B for a shorter time length than the ON period. The ratio of the pulse emission of the respective colors are set to maximize the ratio of the main color displayed through reflecting from a mirror 4003 that is controlled to synchronously operate at an ON state. Following each ON time for different colors, the mirror oscillation control pattern 8022 controls the mirror to operate in one oscillation state and the pulse emission (i.e., white light/red component TWR) of the main color (i.e., red (R) is projected at the beginning of the frame, as shown in
This control process causes a white component projected as the sum of the pulse emission (e.g., white light/red component TWR) corresponding to the oscillation state and the plus emissions (i.e., the white light/green component TWG and white light/blue component TWB) of the two lights (i.e., G and B). The projection light is brighter than the main color emitted during the previous ON time, thereby increasing the brightness of the video image. After the mirror 4003 is controlled to operate at an ON state, the mirror is controlled to operate at an oscillation state according to the 3-bit for the respective colors, that is, 7 times of oscillation, during the display period of one frame.
Specifically, the brightness is therefore equivalent to the LSB of the lower 3-bit of each color of the input data in each oscillation period. In each oscillation control, the pulse projections of a laser light source of either color of R, G and B project to the mirror 4003 during length of time that is shorter than each oscillation time length (i.e., the mirror oscillation period Tosc).
The control process described above applies a 6-bit gray scale display control for each color during the display period of one frame.
Meanwhile,
During each ON period the pulse projection from the red 5211, green 5212 and blue 5231 laser light source of the respective colors R, G and B projects light to the mirror 4003 a plurality of times according to the mirror ON/OFF control pattern 8021, i.e., two times in the example of
Subsequent to the ON time corresponding to the mirror ON/OFF control pattern 8021 for each color, the mirror is controlled to operate at one oscillation state according to the mirror oscillation control pattern 8022. The pulse width of the main color (i.e., R in the example of the head side of
The color balance of the display video image is adjusted by the ratio of the pulse width for each color (i.e., the white light/red component TWR) corresponds to the oscillation state. The color balance is further adjusted by taking into account the pulse width of two colors other than the main color emitted during the previous ON time, i.e., G and B, or the white light/green component TWG and white light/blue component TWB) of two colors. Subsequently the mirror is controlled to operate at an ON state, the mirror 4004 is controlled to operate at an oscillation state according to a 3-bit oscillation control signal for the respective colors, that is, 7 times of oscillation, during the display period of one frame. Therefore, a brightness equivalent to the brightness according to the LSB of the lower 3-bit of each color of the input data is achieved during the respective oscillation periods.
In the respective periods when the mirror is operated in the oscillation state, the mirror 4003 is irradiated by repeating a plurality of times (i.e., one time in this case) of pulse emission (i.e., the white light/blue component TWB, white light/red component TWR and white light/green component TWG) of laser light sources of three colors R, G and B. The pulse emission for each color is projected in a shorter time length than the respective oscillation time lengths.
The ratio of the pulse emission of the respective colors is set to maximize the main color light projection by controlling a mirror 4003 operated in an oscillation state. The pulse emission of the mirror is controlled to be at a timing coinciding with the center of the oscillation state. The color balance of the display video image is adjusted by adjusting the ratio of the reflection light intensities of the light of the colors R, G and B and adjusting the intensities reflected during the oscillation period. The control processes as described above allows the flexibility of adjusting the color balance of a displayed video image in addition to a 6-bit gray scale display for each color during the display period of one frame.
As described above, an image projection apparatus employs a spatial light modulator 5100 implemented as a mirror device. According to the present embodiment, the mirror device is configured to carry out a linear gray scale display that is different from a conventional display apparatus, such as a cathode ray tube (CRT) display.
Therefore,
In such a case, a mathematical operation related to the input digital video data 5700, as it is performed in a conventional display apparatus, causes the circuit scale of the control unit 5500 to increase, leading to a higher production cost.
The present embodiment is configured so that the above described video image analysis unit 5550 changes the emission pattern of the illumination light, emitted from the adjustable light source 5210, to the profile as indicated by a gamma correction light intensity variation 7800a so as to correspond to the above described gamma correction curve 7700b, as illustrated in
Note that this configuration makes it possible not only to restore the linearity by negating the influence of the input data γ curve 7700a, but also to change, intentionally and nonlinearly, the emission intensities of the adjustable light source 5210 within one frame, as described below. This enables various and highly precise gray scale displays, exceeding the original gray scale capability of the spatial light modulator 5100 adjustable light source.
For example, a video image output (i.e., input digital video data 5700) contains various scenes, such as a dark scene, a bright scene, a generally bluish scene, and a generally reddish scene, such as sunset. The projection apparatus according to the present embodiment is configured to control the gray scale of the emission output of the adjustable light source 5210 optimally for each scene (with actual control carried out in units of frame), thereby making it possible to attain higher quality video images than with the conventional method.
When a gamma correction for input digital video data 5700 (i.e., an input data γ curve 7700a) is implemented by means of a temporal change in emission intensities of the adjustable light source 5210 as described above, a precise emission control of the adjustable light source 5210 is difficult if an ON/OFF control of the mirror 5112 is carried out through a pulse width modulation (PWM,) which uses binary data 7704 included in the input digital video data 5700 adjustable light source.
Thus, the SLM controller 5530, according to the present embodiment, is configured to carry out an ON/OFF control for the mirror 5112 using non-binary data 7705 obtained by converting the binary data 7704, as shown in
Note that
Furthermore,
When the ON/OFF of the mirror 5112 is controlled by the non-binary data 7705 as described above, the ON period of the mirror 5112 becomes continuous, and therefore, control of the emission intensity of the adjustable light source 5210 synchronously with the aforementioned ON period be more easily achieved.
For simplicity, while
Note that the example of
Furthermore, the light source pulse pattern 7804 exemplifies the gradual increase of the emission pulse width tp between the beginning and end of the display period of one frame.
The light source pulse pattern 7805 exemplifies the gradual decrease of the emission pulse intervals ti and also the gradual increase of the emission pulse width tp between the beginning and end of the display period of one frame.
Furthermore, the light source pulse pattern 7806 exemplifies the gradual increase of both the emission pulse width tp and emission light intensity H2 between the beginning and end of the display period of one frame.
As in the case of the light source pulse patterns 7803, 7804, 7805 and 7806, illustrated in
The following is a description of an exemplary modification of a modulation of pulse emission of the adjustable light source 5210 with reference to
Furthermore, the pulse emission pattern 7813 illustrated in
The time sequences of the pulsed emissions described in
The light source pulse pattern 7807 shown in
The human eye is highly sensitive to light in the mid-range of low and high brightness. Accordingly, the gamma correction is performed by controlling the adjustable light source 5210 with the light source pulse pattern 7808 which 1.) Causes emission pulses to have the same emission pulse width tp with a small emission pulse interval ti at the center of the display period of one frame and 2.)
This control achieves a gamma correction using a gamma correction curve 7700f that is smaller than the conversion line 7700L on the lower brightness side and larger than that on the higher brightness side, thereby making it possible to obtain a modulated and clear projection image, i.e., darker on low brightness side and brighter on high brightness side.
Note that the present patent application has disclosed specific preferred embodiments of the present invention. However, various modifications and changes may be applied to these embodiments within the scope and/or concept of the present invention. Therefore, the present patent application and figures shall be construed as specific embodiment instead of being limited to these particular descriptions.
The present invention provides a technique to achieve an accurate modulation light intensity without being influenced by the transition between the ON state and OFF state in the ON/OFF modulation of a mirror.
The present invention also provides a technique to achieve control of a modulation light intensity independent of the speed of the tilt control of a mirror.
The present invention further provides a technique of controlling a color temperature and a color balance without requiring a change in the inputted video image signal.
Although the present invention has been described in terms of the presently preferred embodiment, it is to be understood that such disclosure is not to be interpreted as limiting. Various alternations and modifications will no doubt become apparent to those skilled in the art after reading the above disclosure. Accordingly, it is intended that the appended claims be interpreted as covering all alternations and modifications as fall within the true spirit and scope of the invention.
This application is a Non-provisional Application claiming a Priority date of Oct. 2, 2007 based on a previously filed Provisional Application 60/997,476 and a Non-provisional patent application Ser. No. 11/121,543 filed on May 3, 2005 issued into U.S. Pat. No. 7,268,932. The application Ser. No. 11/121,543 is a Continuation In Part (CIP) Application of three previously filed Applications. These three applications are Ser. No. 10/698,620 filed on Nov. 1, 2003, Ser. No. 10/699,140 filed on Nov. 1, 2003 now issued into U.S. Pat. No. 6,862,127, and Ser. No. 10/699,143 filed on Nov. 1, 2003 now issued into U.S. Pat. No. 6,903,860 by the Applicant of this patent applications. The disclosures made in these patent applications are hereby incorporated by reference in this patent application.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4229732 | Hartstein et al. | Oct 1980 | A |
| 4769713 | Yasui | Sep 1988 | A |
| 5192946 | Thompson et al. | Mar 1993 | A |
| 5214420 | Thompson et al. | May 1993 | A |
| 5287096 | Thompson et al. | Feb 1994 | A |
| 5448314 | Heimbuch et al. | Sep 1995 | A |
| 5589852 | Thompson et al. | Dec 1996 | A |
| 5617243 | Yamazaki et al. | Apr 1997 | A |
| 5619228 | Doherty | Apr 1997 | A |
| 5668611 | Ernstoff et al. | Sep 1997 | A |
| 5767828 | McKnight | Jun 1998 | A |
| 5831588 | Hotto | Nov 1998 | A |
| 5917558 | Stanton | Jun 1999 | A |
| 5986640 | Baldwin et al. | Nov 1999 | A |
| 6232963 | Tew et al. | May 2001 | B1 |
| 6975366 | Flint | Dec 2005 | B2 |
| 6991336 | Matsui | Jan 2006 | B2 |
| 7154458 | Nakanishi | Dec 2006 | B2 |
| 7232224 | Penn | Jun 2007 | B2 |
| 7232227 | Yamasaki et al. | Jun 2007 | B2 |
| 20060285136 | Shin et al. | Dec 2006 | A1 |
| 20070200806 | Vestal et al. | Aug 2007 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20090128704 A1 | May 2009 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60997476 | Oct 2007 | US |
