This application is a Non-provisional Application claiming a Priority date of Mar. 2, 2007 based on a previously filed Provisional Application 60/904,565 filed by the common Applicants of this Application and the disclosures made in Provisional Application 60/904,565 are further incorporated by reference.
1. Field of Invention
The present invention relates to an image display system. Particularly, the present invention relates to a display system with spatial light modulator(s) including micromirrors controlled to operate with an intermediate oscillating state.
2. Prior Art
As disclosed by the U.S. Pat. No. 5,287,096 the technique by applying the pulse width modulation (PWM) control according to the digital picture data for controlling the micromirrors of a digital mirror device (DMD) for displaying a projected picture is well known in the art. The optical modulation is carried out depending on the digital picture data by balancing the incoming light from a light source to each micromirror between two states. These two states are the ON state when the incoming light is reflected toward a projective optical system and an OFF state when the incoming light deviates from the projective optical system. The luminance of each pixel of a projected picture depends on the total length of time in which each micromirror stays in the ON state in each frame period of the picture. Therefore, there is a technological challenge to process increase amount of digital picture data in one frame period, and a higher mirror speed for modulating and controlling the mirror into the ON state in order to represent images with higher number of gray scales.
Therefore, to present images with higher number of gray scales without increasing the speed of modulation-controlling a micromirror into the ON state, it is necessary to increase or decrease the quantity of light of a light source in addition to the modulation-control by balancing the micromirror in the DMD as disclosed U.S. Pat. No. 5,589,852, thereby complicating the controlling operation.
For these reasons, even though there are significant advances made in recent years on the technologies of implementing electromechanical micromirror devices as spatial light modulator, there are still limitations and difficulties when the image display system implements the electromechanical micromirrors as spatial light modulator to provide high quality images display. Specifically, when the micromirrors are implemented as the spatial light modulator for a color sequential display system to project the display images, the images have an undesirable “rainbow” effect.
Particularly, the rainbow effects become even more pronounced in the display system based on the HDTV format. The HDTV display format becomes popular while the image size for display on a screen becomes ever bigger such as exceeding 100″ in diagonal size. The pixel size on the screen is more than 1 mm when specification is that 100″-size image includes 1920×1080 pixels. Similarly for image displayed on a screen of 50″ diagonal-size according to the XGA format, the pixel size is also 1 mm. For such larger size of display pixels, an observer can see each of the pixels on the screen. For these reasons, the display systems require a high number of gray scales of more than 10 bit or 16 bit in order to eliminate the rainbow effect to provide a high quality display system. Furthermore, when the display images are digitally controlled, the image qualities are adversely affected due to the fact that the image is not displayed with sufficient number of gray scales.
Electromechanical micromirror devices have drawn considerable interest because of their application as spatial light modulators (SLMs) that can be conveniently digitally controlled. A spatial light modulator requires an array of a relatively large number of micromirror devices. In general, the number of devices required ranges from 60,000 to several millions for each SLM. Referring to
The on- and off-states of micromirror control scheme as implemented in the U.S. Pat. No. 5,214,420 and by most of the conventional display system impose a limitation on the quality of the display. Specifically, an application a conventional configuration of a control circuit is faced with a limitation that the gray scale of conventional system with the micromirrors controlled by applying a pulse-width modulation (PWM) between an ON and OFF states, is limited by the minimum controllable amount of incremental illumination determined by the LSB (least significant bit, or the least pulse width). Due to the On-Off states implemented in the conventional systems, there is no way to provide shorter pulse width than LSB. The least amount of incremental brightness controllable by the spatial light modulator determines the resolution of the gray scale and that in turn is determined by the light reflected during the length of time controlled by the least pulse width. The limited gray scales lead to degradations of image display.
Specifically,
When adjacent image pixels are displayed with a great degree of different gray scales due to a very coarse scale of controllable gray scale, artifacts are shown between these adjacent image pixels. That leads to image degradations. The image degradations are specially pronounced in bright areas of display when there are “bigger gaps” of gray scales between adjacent image pixels. It was observed in an image of a female model that there were artifacts shown on the forehead, the sides of the nose and the upper arm. The artifacts are generated by a technical limitation that the digitally controlled display does not provide a sufficient number of gray scales. At the bright spots of display, e.g., the forehead, the sides of the nose and the upper arm, the adjacent pixels are displayed with visible gaps of light intensities.
As the micromirrors are controlled to have a fully ON and fully OFF positions, the light intensity is determined by the length of time the micromirror is at the fully ON position. In order to increase the number of gray scales of display, the speed of the micromirror must be increased to the extent that the digitally controlled signals can be increased to a higher number of bits. However, when the speed of the micromirrors is increased, a stronger hinge is necessary for the micromirror to sustain a required number of operational cycles for a designated lifetime of operation. In order to drive the micromirrors supported on a further strengthened hinge, a higher voltage is required. The higher voltage may exceed twenty volts and may even be as high as thirty volts. The micromirrors manufactured by applying the CMOS technologies probably is not suitable for operation at such higher range of voltages and therefore the DMOS micromirror devices may be required. In order to achieve higher degree of gray scale control, a more complicated manufacturing process and larger device areas are necessary when DMOS micromirror is implemented. Conventional modes of micromirror control are therefore faced with a technical challenge that the gray scale accuracy must be sacrificed for the benefits of smaller and more cost effective micromirror display due to the operational voltage limitations.
There are many patents related to a light intensity control. These Patents include the U.S. Pat. Nos. 5,589,852, 6,232,963, 6,592,227, 6,648,476, and 6,819,064. There are further patents and patent applications related to different shapes of light sources. These patents include the U.S. Pat. Nos. 5,442,414, 6,036,318 and Application 20030147052. The U.S. Pat. No. 6,746,123 discloses special polarized light sources for preventing a light loss. However, these patents or patent application do not provide an effective solution to overcome the limitations caused by insufficient gray scales in the digitally controlled image display systems.
There are several patents related to display systems that apply non-binary data for image control. These patents include the U.S. Pat. Nos. 5,315,540, 5,619,228, 5,969,710, 6,052,112, 6,970,148, and U.S. Patent Application US 2005/0190429. Furthermore, there are many patents related to a spatial light modulation that includes the U.S. Pat. Nos. 2,025,143, 2,682,010, 2,681,423, 4,087,810, 4,292,732, 4,405,209, 4,454,541, 4,592,628, 4,615,595, 4,728,185, 4,767,192, 4,842,396, 4,907,862, 5,214,420, 5,287,096, 5,506,597, 5,489,952, 5,827,096, 6064,366, 6535,319, 6,719,427, 6,880,936, and 6,999,224. However, these inventions do not address or provide direct resolutions for a person of ordinary skills in the art to overcome the above-discussed limitations and difficulties.
Therefore, a need still exists in the art of image display systems applying digital control of a micromirror array as a spatial light modulator to provide new and improved systems such that the above-discussed difficulties can be resolved.
An advantage of the present invention is to realize more delicate gray scale in the picture display using a spatial light modulation element to display a picture depending on the modulation state of a plurality of micromirrors without increasing the speed of modulation-controlling the micromirrors into the ON state.
Another advantage of the present invention is to realize more delicate gray scale in the picture display using a spatial light modulation element to display a picture depending on the modulation state of a plurality of micromirrors without complicated control of the quantity of light of a light source or an additional circuit.
The present invention provides a displaying technique of controlling the intermediate oscillation having amplitude smaller than the maximum amplitude of a micromirror in the spatial light modulation element in an optional time duration or frequency.
The first aspect of the present invention is a display system including: a light source; a spatial light modulation element having a plurality of micromirrors and forming a image to be displayed from the light from the light source by modulating the plurality of micromirrors; and a control device for controlling the spatial light modulation element. With the configuration, the control device includes a modulation-control device for generating a modulation control signal for the plurality of micromirrors depending on the digital image data input to the display system, and controlling the spatial light modulation element; the modulation state of the micromirrors by the modulation control signal includes the modulation by the oscillation of the micromirrors; and the modulation-control device controls a time duration of the modulation control signal to be applied to a driving electrode of the micromirror so that the amplitude of the oscillation can be equal to or smaller than the maximum amplitude of the micromirrors in the modulation by the oscillation of the micromirrors.
The second aspect of the present invention is based on the display system according to the first aspect. The control device includes a data conversion device for converting a part or all of the digital picture data input to the display system into non-binary data; and the modulation-control device generates a modulation control signal of the micromirrors depending on the non-binary data, and controls the spatial light modulation element.
The third aspect of the present invention is based on the display system according to the first aspect. In the display system, the time duration of the modulation control signal is shorter than a quarter of the free oscillation period of the micromirrors.
The fourth aspect of the present invention is based on the display system according to the first aspect. In the display system, the time duration of the modulation control signal is shorter than a quarter of a least significant bit (LSB) period for control of the micromirrors.
The fifth aspect of the present invention is based on the display system according to the first aspect. In the display system, the oscillation having the amplitude includes free oscillation, which decreases its amplitude with time.
The sixth aspect of the present invention is based on the display system according to the first aspect. In the display system, the time duration is longer than one oscillation period of said micromirrors.
The seventh aspect of the present invention is based on the display system according to the first aspect. In the display system, a number of times at which the oscillation of the micromirrors is repeated in the time duration are two times or more in one frame period of the digital image data.
The eight aspect of the present invention is based on the display system according to the first aspect. In the display system, an oscillating state having an amplitude equal to or smaller than the maximum amplitude of the micromirrors is controlled to turn from an ON state of the micromirrors.
The ninth aspect of the present invention is based on the display system according to the first aspect. In the display system, an oscillating state having an amplitude equal to or smaller than the maximum amplitude of the micromirrors is controlled to turn from an OFF state of the micromirrors.
The tenth aspect of the present invention is based on the display system according to the first aspect. In the display system, an oscillating state having an amplitude equal to or smaller than the maximum amplitude of the micromirrors is controlled to turn to an ON state of the micromirrors.
The eleventh aspect of the present invention is based on the display system according to the first aspect. In the display system, an oscillating state having an amplitude equal to or smaller than the maximum amplitude of the micromirrors is controlled to turn to an OFF state of the micromirrors.
The twelfth aspect of the present invention is based on the display system according to the first aspect. In the display system, the modulation control signal is a digital control signal for providing a 1-bit control signal for at least one driving electrode for controlling said micromirrors.
The thirteenth aspect of the present invention is based on the display system according to the first aspect. In the display system, the modulation-control device generates a modulation control signal to perform modulation by the oscillation of the micromirrors based on at least 1-bit data other than a most significant bit (MSB) in a plurality of bits forming the digital image data input to the display system.
The embodiments of the present invention are described below in detail with reference to the attached drawings.
A display system 100 according to the embodiments of the present invention includes a spatial light modulation element 200, a control device 300, a light source 510, and a projective optical system 520.
As shown in
An OFF capacitor 215b is connected to the OFF electrode 215, and the OFF capacitor 215b is connected to a bit line 221-1 through a gate transistor 215c. An ON capacitor 216b is connected to the ON electrode 216. The ON capacitor 216b is connected to the bit line 221-2 through a gate transistor 216c. The word line 231 controls the opening and closing operations of the gate transistor 215c and the gate transistor 216c. Specifically, a horizontal row of the pixel unit 211 connected to any of the word lines 231 is simultaneously selected, and the charge/discharge of electric charge with respect to the OFF capacitor 215b and the ON capacitor 216b is controlled by the bit line 221-1. The bit line 221-2, thereby individually controls the ON/OFF of the micromirror 212 in each pixel unit 211 in the horizontal row.
The light source 510 irradiates the spatial light modulation element 200 with incoming light 511. The light is reflected as reflected light 512 by each micromirror 212, and the reflected light 512 in the optical path through the 520 is projected as projected light 513 on the screen (not specifically shown in the attached drawings).
The timing control unit 323 calculates the time required to operate the micromirror 212 in the ON state and the time duration required to operate the micromirror 212 in the oscillating state in each frame for forming the binary picture signal 400 with respect to each micromirror 212 configuring a pixel of an image based on the synchronization signal 430 generated by the binary picture signal 400. The synchronization signal 430 controls the first state control unit 321 and the second state control unit 322, and outputs a control signal 431 to the selector 324.
The selector 324 switches the output of the non-binary data 411 or the non-binary data 421 to the spatial light modulation element 200 according to the control signal 431. The control of the micromirror 212 from the ON/OFF modulation by the first state control unit 321 using the non-binary data 411 is switched to the oscillation modulation by the second state control unit 322 applying the non-binary data 421. Or alternately the selector controls a switch from the oscillation modulation to the ON/OFF modulation. The data splitter 310, the first state controller 321, the second state controller 322, the timing control unit 323 and the selector 324 can be implemented with an integrated processor.
The binary data and the non-binary data are implemented for controlling the mirror and described below with reference to
When the pulse width modulation (PWM) is implemented to control the gray scale of the image display, the weight of each bit represents a relative time duration of the ON state of each data segment represented as a sub-frame in a display frame.
The basic control methods of the micromirror 212 of the spatial light modulation element 200 are described below according to embodiments of the present invention.
Special mathematical symbols are employed in the following descriptions. Namely, Va (1, 0) indicates a predetermined voltage Va is applied to the OFF electrode 215, and not applied to the ON electrode 216. Va (0, 1) indicates that no voltage is applied to the OFF electrode 215, and the voltage Va is applied to the ON electrode 216. Va (0, 0) indicates that no variation Va is applied to the OFF electrode 215 or the ON electrode 216. Va (1, 1) indicates that the voltage Va is applied to both of the OFF electrode 215 and the ON electrode 216.
Specifically, in the ON state of the micromirror 212 shown in
In the examples shown in
Furthermore, in the examples shown in
In these embodiments and as will be described later, the amplitude of the tilt displacement of the micromirror 212 is controlled by generating free oscillation of the amplitude A1 and the amplitude A2 smaller than the maximum amplitude A0 between the ON and the OFF by applying Va (0, 1), Va (1, 0), and Va (0, 0) in appropriate timing during the tilt displacement of the micromirror 212 between ON and OFF. Greater number of grayscale levels is therefore achieved.
A method of displaying a picture using the display system 100 is described below. The control device 300 receives the binary picture signal 400 and divides the data into the separated data 410 and the separated data 420. Applying the separated data 410 and the separated data 420 of the picture signal, the first state control unit 321 and the second state control unit 322 calculate the time duration for the micromirror 212 to operate in the ON state in one frame of a picture. Accordingly, with the controlled durations, the micromirrors 212 of the spatial light modulation element 200 projects the image corresponding to the pixel of a picture. Thus, the time duration in which the micromirror 212 is controlled in the oscillating state depending on the frequency of oscillating the micromirror 212.
The first state control unit 321 and the second state control unit 322 of the control device 300 calculate the time durations. These durations are applied to control the micromirror 212 to operate in the ON state, the oscillating state. Furthermore, the frequency of oscillations of the micromirror 212 and the ratio of the quantity of light of the projected light 513 obtained by the oscillation in the oscillation time T of a predetermined micromirror 212 determine the quantity of light of the projected light 513 the same as the quality of light obtained by placing the mirror in the ON state in the oscillation time T. Using the calculated time duration or value of the frequency, the ON/OFF control and the oscillation-control are carried out on each micromirror 212 to project one frame of a image for one image pixel.
A control device 300 is described below as an exemplary embodiment to control free oscillation in the intermediate position between the ON state and the OFF state According to a time control diagram shown in
The first method is to control the micromirror by applying two voltages, zero volt and Va, to the electrodes while the micromirror is at a GND state or zero volt.
The period between t1a to t1c is shorter than half of the free oscillation period of the micromirror 212, and also shorter than the half of the period defined by a least significant bit (LSB) in the control word applied in the PWM control. Especially, the period between t1a to t1b is shorter than the quarter of the free oscillation period of the micromirror 212, and is also shorter than the quarter of the period defined by a LSB in the control word applied in the PWM control. The time t1a through time t1d and the value of the voltage Va are determined by the first state control unit 321 and the second state control unit 322 of the data converter 320.
In this embodiment, the driving circuit of each electrode is simplified by making the voltage Va the same as the voltage applied in the PWM control for controlling ON/OFF states of the micromirror such that multiple levels of driving voltages are not required.
The Coulomb force generated by the voltage applied to the electrodes and the micromirror 212 governs the acceleration of the micromirror 212 moving between ON state and OFF state. Three levels of voltages, namely 0 volt, Va and Vb, are applied in the second method of controlling the micromirror 212. The micromirror 212 is set to zero volts or in GND state in this embodiment as well.
In this control method, the timing of t1a, t1b and t1c are fixed and the voltage applied in the period between t1b and t1c are adjusted to govern the amplitude A2 or the initial speed of the free oscillation of the micromirror 212. The control voltage can control the amplitude A without changing the timing of t1a, t1b and t1c.
It is also understood that the same effect is achievable by applying other value than zero volts to the micromirror 212 in addition to the above description that implements the method by applying voltage to the electrodes.
The free oscillation period T3, or oscillation modulation period, is predefined to control the mirror for projecting images with a predefined levels of gray scale. The levels of the gray scale is determined by the number of the free oscillation cycles and the light intensity contributing to the image display in one cycle of the free oscillation, or from the time calculated by the light intensity per arbitrary free oscillation period T. The timing of t2a, t2b and t2c governs the amplitude A or the initial speed of the free oscillation of the micromirror 212. It is understood that adjustments to the timing of t2a, t2b and t2c determine the oscillation amplitude A. The first state control unit 321 and the second state control unit 322 of the data converter 320 determine the time t2a through time t2d and the value of the voltage Va.
The method to control the mirror oscillation amplitude A that is smaller than the maximum oscillation amplitude A0 by controlling the timing has been described. As described earlier, it is also possible to apply three or more levels of voltage to the electrode or controlling a voltage offset to obtain the same effect.
The control methods as illustrated in
Thus, by adjusting the amplitude A of oscillation, the micromirror is controlled to project an image light with an luminance of 1/n (n is an integer) of the full light luminance Lon when the micromirror 212 is controlled in the ON state for the same time duration T.
Combining the operation of the mirror at ON state and the oscillating state increases the levels of gray scale of the display images. In addition to the above-mentioned value of n, the mirror can be controlled to adjust the ratios of the light illumination by adjusting the oscillation amplitude to obtain the values of n=1.33(as the luminance ratio of the ¾ of Lon), n=2, n=3, n=5, and n=10.
A functional relationship between the luminance Losc according to the oscillation-control in one frame period of picture data in a period of time Tosc for oscillation-control can be represented by the following equation.
Losc=Lon×(1/n)×(Tosc/T)
In order to display an image with the same luminance Losc, the micromirror can be controlled by either increasing the value of the integer n, extending the modulation time Tosc, or decreasing the value of the integer n to shorten the modulation time Tosc. Thus, reduction of the motion artifacts and color artifacts of a picture is achievable in an image display system implements a plurality of spatial light modulation elements by setting substantially equal timing of the control time for each of the spatial light modulation elements.
Furthermore, it is possible to control the oscillations of the micromirrors such that the luminance of the image display projected in one oscillation of the in the oscillation period T1 may be controlled to be 1/n of the luminance Lon2 projected in the ON state in the same oscillation period T1.
Accordingly, the relationship between the luminance Losc projected by micromirror with the oscillation-control in a frame period of the image display data and the number of oscillation time m of the micromirror can be represented by the following equation.
Losc=Lon2×(1/n)×m
Therefore, in order to project the same luminance Losc, the micromirror may be controlled to increase the value of an integer n to increase the number of oscillation time m, or decreasing the value of the integer n to decrease the number of oscillation time of the modulation. Thus, reduction of the motion artifacts and color artifacts of a picture to be displayed the image display system can be achieved by using a plurality of spatial light modulation elements can be controlled to set substantially equal timing of the control time for each of the spatial light modulation elements.
As described above, according to the display system 100 of the present embodiment, image display with higher resolution of gray scale can be realized by using a spatial light modulation element 200 to display a picture by controlling and adjusting the modulation states of a plurality of micromirrors 212 without increasing the amount of data of the digital picture data (binary picture signal 400).
In addition, higher resolution of gray scale for image display can be achieved without requiring a complicated control such as increase/decrease of the quantity of light of the light source 510 or add an additional circuit. The higher resolution of gray scale may be achieved by using the spatial light modulation element 200 for displaying a picture by controlling the modulation states of the plurality of micromirror 212.
Higher resolution of gray scale can also be read in the picture display using a spatial light modulation element to display a picture by controlling and adjusting the modulation states of a plurality of micromirrors without increasing the speed of modulation-controlling the micromirrors into the ON state.
In addition, higher resolution of gray scale can be read in the picture display using a spatial light modulation element to display a picture by controlling and adjusting the modulation states of a plurality of micromirrors without requiring complicated control methods such as adjusting the intensity of the light sources or implementing additional circuits. The present invention is not limited to the configurations according to the above-mentioned embodiments, but various changes can be made within the gist of the invention.
Although the present invention has been described by exemplifying the presently preferred embodiments, it shall be understood that such disclosure is not to be interpreted as limiting. Various alternations and modifications will no doubt become apparent to those skilled in the art after reading the above disclosure. Accordingly, it is intended that the appended claims be interpreted as covering all alternations and modifications as falling within the true spirit and scope of the invention.
Number | Date | Country | |
---|---|---|---|
60904565 | Mar 2007 | US |