The invention relates generally to minimizing motion blur in display systems and, more particularly, to apparatus and method to minimize blur in imagery presented on a multi-display system.
An example of a 3D display system (also sometimes referred to as a stereo or stereoscopic display system or as a three dimensional display system) is available commercially under the trademark StereoMirror™. Such a 3D display system is a multi-display system in that it includes two displays. Such multi-display systems are available from Fergason Patent Properties, LLC of Menlo Park, Calif. and/or Planar Systems, Inc. of Beaverton, Oreg. As such example of a 3D displays system, it is typically based on commercially available flat panel, liquid crystal displays (LCDs). As a consequence, the StereoMirror display inherits both the advantages and the limitations of the underlying LCD technology. One such limitation is the tendency of fast moving objects within a video image sequence to appear slightly blurred (sometimes referred to as “motion blur,” “smear” or “motion smear,” etc.). Addressing this problem is useful because there are applications in which blur is considered undesirable.
For additional background reference is made to
Although the displays 11, 12 are shown such that one is above the other, it will be appreciated that features of the invention may be achieved using displays 11, 12 that are relatively positioned in side by side relation.
Examples of several embodiments of multi-displays that may be used as 3D displays are presented in U.S. Pat. No. 6,703,988, U.S. Design Pat. No. D533,524, and published PCT patent application publication No. WO 2006/060236. The disclosures of these are incorporated in their entireties by this reference.
As illustrated in
In normal operation, the pixel arrays in the two displays 11, 12 are aligned. In presenting images, the upper display 11 presents (for example) a right eye perspective image. In this case, the lower display 12 will present a left eye perspective image. As will be appreciated and as is described in the above-mentioned documents, the image on one of the displays is inverted to align with the image from the other display. For example, the image on the upper display 11 is inverted for viewing via reflection by the beam combiner and, thus, is pixel aligned with respect to the lower display (image alignment with the lower display 12). Both displays simultaneously and continually present their respective images.
In an embodiment the displays 11, 12 may be identical. In an embodiment the pixel arrays of the displays 11, 12 may be identical. In an embodiment polarization of light, e.g., the direction of the plane of polarization of plane polarized light or other polarization characteristics of the light may be identical. Also, for example, in an embodiment if the displays 11, 12 are the same, e.g., identical, and they are aligned such that the respective tops are adjacent and the respective bottoms are relatively remote, as is illustrated in
The viewer 19 (
Note that there is a second mode of operation possible with the StereoMirror display 10 in which it produces a 2D image. In this configuration, both LCDs 11, 12 display identical images and the viewer 19 does not wear polarizing glasses 20.
Since it is built from commercially available flat panel liquid crystal displays, both the 2D and 3D images produced by the StereoMirror display (sometimes referred to as monitor) is dependent on the image qualities of the component LCDs 11, 12. This directly leads to production of an image with good brightness, a wide color gamut, high contrast as well as other superior image qualities. On the other hand, the StereoMirror display 10 is limited by other image metrics of the component LCDs 11, 12. Of relevance, is the “slow” response time of LCDs, as is discussed further below, e.g., relative to some other types of displays, e.g., cathode ray tube (CRT) displays.
One example or possible definition of LCD response time is illustrated in the two graphs 30, 31 of
Brightness state, e.g., bright/white or dark, concerns light transmission characteristic of a transmissive type of LCD itself (or reflection characteristic for a reflective LCD); brightness state does not necessarily mean the brightness of the light source that illuminates the LCD.
Some commercially available LCDs are typically made with the unpowered state as the dark state. This is called “normally dark”. An LCD can, however, be made with the unpowered state as the bright state. This is called “normally bright”. In the discussion that follows, the text and illustrations of
In commercial quality LCDs, the turn off response time is on the order of 2-5 milliseconds, e.g., represented in the graphs of
One consequence of the “slow” response time in a LCD is that objects moving rapidly within a video frame sequence can appear blurred or smeared (“motion blur” or “motion smear” as was mentioned above). This is explained with reference to
Next in this discussion, consider a specific but representative example of an application in which blur is an issue. The application is the identification and analysis of small objects on a large map that is shown on a display, for example, a StereoMirror display that can be operated both in 2d (two-dimensional) mode or 3D mode. In this application, the common procedure is to first locate the object. In actual practice this is done by rapidly panning across a 2D image of the large map. Once the object's location has been identified, the display is switched to 3D mode for detailed analysis of the object. The salient point is that blur is not an issue when the operator is using the StereoMirror display in the 3D mode in which there may be no motion or slow motion. Blur is an issue only when the StereoMirror display is panning in the 2D mode. Similar motion blur may occur in a 2D display
It will be appreciated that there is a need to reduce or to overcome motion blur in displays.
There also is a need to minimize blur in the 2D image panning mode of a StereoMirror display.
An aspect of the present invention relates to a method of reducing blur in a displays system, comprising using at least two displays displaying a sequence of frames representing an image on respective displays, including displaying one part of an image on one display and a second part of an image on a different display, and combining the images; and repeating the foregoing in subsequent frames.
Another aspect relates to the respective parts of the image are groups of odd lines and groups of even lines of the image.
Another aspect relates to said displaying comprising alternately displaying at least part of an image on one display while blanking at least part of the image from the other display and vice versa.
Another aspect relates to alternately displaying comprising alternately and sequentially displaying.
Another aspect relates to the blanking comprising turning off a light source that illuminates a respective display.
Another aspect relates to the blanking further comprising driving respective lines of the display to a condition such that light is not primarily transmitted or reflected at such lines.
Another aspect relates to the blanking comprising driving respective lines of the display to a condition such that light is not primarily transmitted or reflected at such lines.
Another aspect relates to the blanking comprising displaying one group of lines on one display wile displaying imagery on another group of lines of the display and vice versa for the other display.
Another aspect relates to the blanking comprising using eyeglasses having respective lenses alternately and sequentially to transmit or to block, respectively, images from respective displays based on optical polarization.
Another aspect relates to the using eyeglasses comprising using active light shutter lenses.
Another aspect relates to the using active light shutter lenses further comprising providing a delay period for stabilizing of an image on a display prior to opening a respective lens to transmit light from such display.
Another aspect relates to using the at least two displays to display a sequence of frames representing images to provide a combined 2D image.
Another aspect relates to using the at least two displays to display a sequence of respective frames representing images to provide a combined 3D image.
Another aspect relates to the images on both displays are substantially the same but are differentiated as respective left eye and right eye views to provide a 3D image.
Another aspect relates to the images on both displays are substantially the same and combine as one image via the combining step, and while one part of the image is displayed by one display the other part of the image is displayed by the other display, and vice versa.
Another aspect relates to a display apparatus comprising a plurality of displays, an image combiner to combine images from the two displays, and a control for controlling operation of the displays to display respective images or portions of images for viewing in such matter as to reduce blur.
Another aspect relates to the control comprising a computer, circuitry and/or programming selectively to provide for showing sequentially at least respective parts of an image on one display while blanking the showing of at least other respective parts of an image on said one display, and vice versa with respect to the other display.
Another aspect relates to the control controls operation of the displays to display respective portions differentiated by respective lines.
Another aspect relates to the control is adapted to drive respective display lines to dark.
Another aspect relates to the control is adapted to turn off respective light sources to respective displays.
Another aspect relates to a method of displaying images, comprising providing images on two displays controlled to display respective images or portions of images for viewing to reduce blur.
Another aspect relates to the displays present respective images in alternating sequential relation.
Another aspect relates to a display system comprising a pair of displays, a pair of active shutter lenses, and a control for controlling the opening and closing of the active shutter lenses in relation to the operation of the displays to reduce motion blur.
To the accomplishment of the foregoing and related ends, the invention, then, comprises the features hereinafter fully described and particularly pointed out in the claims. The following description and the annexed drawings set forth in detail certain illustrative embodiments of the invention. These embodiments are indicative, however, of but a few of the various ways in which the principles of the invention may be employed. Other objects, advantages and novel features of the invention will become apparent from the following detailed description of the invention when considered in conjunction with the drawings.
Features that are described and/or illustrated with respect to one embodiment may be used in the same way or in a similar way in one or more other embodiments and/or in combination with or instead of the features of the other embodiments.
It should be emphasized that the term “comprises or comprising” when used in this specification is taken to specify the presence of stated features, integers, steps or components but does not preclude the presence or addition of one or more other features, integers, steps, components or groups thereof.
In the annexed drawings,
In the drawings like reference numerals designate like parts in the several drawing figures; and primed numerals are used to designate parts that are similar to other parts, which in turn are designated by the same unprimed reference numerals.
There are several approaches to the suppression of motion blur in a StereoMirror display.
Referring to
According to an exemplary embodiment of the invention, during a first frame, the image is displayed by the upper LCD 11 while the lower LCD 12 is blanked. Blanked means that all pixels are driven to the full black state. Both eyes see the image; the image arrives by reflection by the combiner 13 from the upper LCD 11; although the viewer 19 also may see the lower LCD 12, the screen of that LCD is blanked and, therefore, is black, and, thus, would not contribute image information to the viewer. During a subsequent, second frame, the upper LCD 11 is blanked and the lower LCD 12 displays the image. Once again, both eyes see the image, this time from the lower LCD 12 that is viewed by transmission through the combiner 13, rather than being reflected by reflected. The LCDs continue to alternate, presenting images frame sequentially. The human eye and brain integrate the alternating images into a continuous video sequence. This operation is summarized in Chart 1.
Chart 1—depicts the above-described method, as follows:
The reason that this approach reduces blur is that at the end of the frame, the LCD presenting an image has its image removed by a transition from the bright state to the full dark, blanked state. This transition is the faster, e.g., turn off time in a drive to dark display. By forcing the transition to be completed as fast as possible there is a reduction in the amount of light “leakage” into the subsequent frame thus reducing the size and visibility of the comet tail.
Turning to
In operation of the multi-display system 50, the computer 52 may be suitably programmed or operated to provide signals to the LCDs 11, 12 to operate them in the manner described above. Suitable computer program software for the computer 52 to carry out the functions described above may be written by a person having ordinary skill in the art to obtain such operation. Also, it will be appreciated that the computer 52 may be used in connection with other embodiments of the invention; and suitable computer program software may be written by a person having ordinary skill in the art to carry out the various operations and functions that are described with respect to such other embodiments and equivalents thereof.
In another exemplary embodiment of the invention, an alternative to blanking the respective displays 11, 12, which was described above, is to turn off the back light for the respective LCD 11, 12 that is to be dark while the other LCD is providing an image output. This approach has the potential advantage, especially when the backlight is light emitting diode (LED) based, of an even faster transition to the dark state than blanking an LCD. The result is an even greater reduction of the size and visibility of the above-described comet tail. The time required for a back light, e.g., an LED, to turn on or off may be shorter than the time required for an LCD to switch from one light transmitting state to the other, especially compared to the relatively long time required for many LCDs to relax to its undriven condition, e.g., to bright in a drive to dark type LCD.
Chart 2—depicts the above-described method, as follows:
A multi-display system 50′, which is similar to the multi-display system 50 described above, provides for the computer 52 to operate respective light sources 11a, 12a, for example, according to Chart 2 above. The light sources may be one or more light emitting diodes (LEDs) or may be another type of light source. The computer 52 is coupled to the LEDs 11a, 12a, e.g., by suitable electrical connections 55′, 56′ to provide power from the power source 54, for example, to operate them by turning one on to provide a light output to illuminate a respective display and the other off during one frame of the sequence of images from the video input 51, for example. In the next frame the LEDs are reversed in that the one that had been on is off and the one that had been off is on to provide light to the respective display that it illuminates. Each LED 11a, 12a may be a number of LEDs, as may be needed to illuminate the respective LCD 11, 12. During such operation it may be that the video input is provided by the computer 52 simultaneously to both displays and the sequential operation allowing a viewer 19 to see one and then the other display in continuing sequence is provided by the alternate sequential energization of the respective LEDs 11a, 12a to provide light or to be dark. Ordinarily, when an LED is off such that an LCD is not being illuminated, the viewer would not see an image on that LCD (or at least if an image were seen due to some light leakage, the image likely would be rather dim or dark) even if image data were being provided to that LCD while the LED is off.
In operation of the multi-display system 50′, the computer 52 may be suitably programmed or operated to cause the LEDs 11a, 12a sequentially alternately to be on to provide light output or to be off, as was described above.
In another exemplary embodiment of the invention it is further possible both to blank the display and to turn off the back light at the end of the display frame, e.g., the frame that was being shown by and viewed from a respective LCD. Thus, the features and operation described above with respect to both
A somewhat different approach to those described above is described below using selective line blanking.
In this exemplary embodiment the viewer 19 (see
During a subsequent, e.g., second, frame, the upper LCD 11 presents the odd rows of the image and the lower LCD 12 presents the even rows of the image. As before, the human eye and brain will integrate these two images into a single, complete 2D image. The computer 52 and associated components thereof, e.g., video input 51, I/O 53, power supply 54, and connections 55, 56, e.g., as is illustrated in
Note that whether the odd rows are blanked before the even rows or the even rows before the odd rows would not be critical.
To continue with the example, the way that this approach can be made to reduce blur is, at the end of the first frame, to blank the even rows of the upper LCD 11 and the odd rows of the lower LCD 12 while at the same time writing the odd rows of the upper LCD 11 and the even rows of the lower LCD 12. The rows that are written to (and are not blanked) will display image. Blanking may be carried out, for example, as was described above, although instead of blanking an entire LCD, only odd numbered or even numbered lines (rows) would be blanked, as described; and image data would be provided the other lines of the LCD. The procedure continues in a similar manner at the end of each frame. As before, by proceeding in this way, the image is removed by a transition from the bright state to the dark state. This transition is the faster, turn off time. By rapidly completing the transition there is a reduction in the amount of light “leakage” into the subsequent frame, thus reducing the size and visibility of the comet tail.
In another exemplary embodiment the viewer 19 does wear glasses 20 with passive polarized lenses 21, 22, e.g., as is illustrated schematically in
With reference to
During a subsequent, second frame, the upper LCD 11 presents the odd rows of the image and the lower LCD 12 presents the even rows of the image. As before, the human eye and brain will integrate these two images into a single, complete image.
To continue with the example, the way that this approach can be made to reduce blur is, at the end of the first frame, to blank the even rows of the upper LCD 11 and the odd rows of the lower LCD 12 while at the same time writing the odd rows of the upper LCD 11 and the even rows of the lower LCD 12. The procedure continues in a similar manner at the end of each frame. As before, by proceeding in this way, the image is removed by a transition from the bright state to the dark state. This transition is the faster, turn off time in a drive to dark display. By rapidly completing the transition there is a reduction in the amount of light “leakage” into the subsequent frame thus reducing the size and visibility of the comet tail.
One characteristic of the time sequential approaches presented in the above-described embodiments with reference to
In this embodiment the viewer 19 wears active glasses 20′, as are described just below. Blur reduction can be applied to both the 2D and 3D modes. Once again, the explanation is made by use of an example.
The right lens 21′ is an optical device such that in one voltage state it transmits to a user's right eye light that is linearly polarized with the axis of linear polarization at −45°, e.g., to transmit light from the display 11 (
As a practical matter, the lenses 21′, 22′ may be a type of liquid crystal device. The desired device type is one that can quickly switch between states, e.g., as was described just above. One such device is a shutter based on the so called surface mode effect, e.g., as is disclosed in U.S. Pat. Nos. 4,385,806, 4,436,376, 4,540,243, and Re 32,521, which are incorporated by this reference in their entireties.
In this approach both the upper and lower LCDs 11, 12 present images simultaneously. While the LCDs 11, 12 are presenting images the shutter lenses 21′, 22′ are open and images are transmitted to both eyes. At the end of the frame, the images on the LCDs 11, 12 switch and the shutters 21′, 22′ close. At the start of the next frame new images are displayed on the LCDs 11, 12. The shutters 21′, 22′, however, do not open until the image state transition is substantially complete, e.g., see
It is, in principle, possible to optimize the trade off between image brightness and blur reduction by adjusting the opening and closing of the shutters “on the fly” in response to the content of the image. When the image contains essentially static objects, the shutters are open during substantially the entire frame. When the image contains rapidly moving objects, the shutters would open later during the frame. One means by which such image content information could be provided to the glasses synchronization system is through the use of metadata information that is transmitted along with the video signal.
The computer 52 and parts associated therewith may be used to control both the LCDs 11, 12 and the active lenses (shutters) 21′, 22′ in the manner described above. Connections 60, 61 from the computer 52 are shown to provide for operation of the active lenses (shutters) 21′, 22′. The metadata may be information provided in the video stream that is supplied to the video input 51 (see
As will be appreciated by one of ordinary skill in the art, computer program elements and/or circuitry elements of the invention may be embodied in hardware and/or in software (including firmware, resident software, micro-code, etc.). The invention may take the form of a computer program product, which can be embodied by a computer-usable or computer-readable storage medium having computer-usable or computer-readable program instructions, “code” or a “computer program” embodied in the medium for use by or in connection with the instruction execution system. In the context of this document, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium such as the Internet. Note that the computer-usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner. The computer program product and any software and hardware described herein form the various means for carrying out the functions of the invention in the example embodiments.
Also, although the invention is described with respect to use of liquid crystal displays as the displays 11, 12, for example, the invention may be used with other types of displays that encounter motion blur. Also, although the invention is described with respect to LCDs and linear polarization, it will be appreciated that features of the invention may be used with other than linear polarization, e.g., circular polarization, examples of which are described in several of the above-mentioned patent and patent application documents. Further, although detailed description is presented for displays that have a characteristic of being normally bright and are driven to dark, the invention may be used with displays that are normally dark and are driven to bright.
Although the invention has been shown and described with respect to certain preferred embodiments, it is obvious that equivalents and modifications will occur to others skilled in the art upon the reading and understanding of the specification. The present invention includes all such equivalents and modifications, and is limited only by the scope of the following claims.
This application claims the benefit of U.S. Provisional Patent Application Ser. Nos. 60/886,800, filed Jan. 26, 2007, 60/887,144, filed Jan. 29, 2007 and 60/975,382, filed Sep. 26, 2007, the entire disclosures of which are hereby incorporated by reference. Examples of several embodiments of multi-displays that may be used in connection with the present invention are presented in U.S. Pat. No. 6,703,988, U.S. Design Pat. No. D533,524, and published PCT patent application publication No. WO 2006/060236. The disclosures of these are incorporated in their entireties by this reference.
Number | Date | Country | |
---|---|---|---|
60886800 | Jan 2007 | US | |
60887144 | Jan 2007 | US | |
60975382 | Sep 2007 | US |