The present disclosure relates to a backlit liquid crystal display apparatus and particularly to displaying stereo 3D images with 2D images.
A stereoscopic 3D display usually presents an observer with images with parallax from individual right and left eye viewpoints. There are two methods of providing the two eyes of the observer with the parallax images in a time sequential manner. In one method, the observer utilizes a pair of shutter or 3D glasses which transmit or block light from the viewer's eyes in synchronization with alternating the left/right image display. Similarly, in another method, right eye and left eye viewpoints are alternatively displayed and presented to the respective eyes of the observer but without the use of 3D glasses. This second method is referred to as autostereoscopic and is sometimes desirable for stereo 3D viewing because separate glasses are not needed though there is limited permissible head motion.
A liquid crystal display (LCD) is a sample and hold display device such that the image at any point or pixel of the display is stable until that pixel is updated at the next image refresh time, typically 1/60 of a second or faster. In such a sample and hold system, displaying different images, specifically displaying alternating left and right images for an autostereoscopic display, requires careful timing sequencing of the light sources so that, for example, the left eye image light source is not on during the display of data for the right eye and vice versa.
The present disclosure relates to a backlit liquid crystal display apparatus and particularly to displaying stereo 3D images with 2D images using an embedded 3D film stack.
The invention may be more completely understood in consideration of the following detailed description of various embodiments of the invention in connection with the accompanying drawings, in which:
The figures are not necessarily to scale. Like numbers used in the figures refer to like components. However, it will be understood that the use of a number to refer to a component in a given figure is not intended to limit the component in another figure labeled with the same number.
In the following description, reference is made to the accompanying drawings that form a part hereof, and in which are shown by way of illustration several specific embodiments. It is to be understood that other embodiments are contemplated and may be made without departing from the scope or spirit of the present invention. The following detailed description, therefore, is not to be taken in a limiting sense.
All scientific and technical terms used herein have meanings commonly used in the art unless otherwise specified. The definitions provided herein are to facilitate understanding of certain terms used frequently herein and are not meant to limit the scope of the present disclosure.
Unless otherwise indicated, all numbers expressing feature sizes, amounts, and physical properties used in the specification and claims are to be understood as being modified in all instances by the term “about.” Accordingly, unless indicated to the contrary, the numerical parameters set forth in the foregoing specification and attached claims are approximations that can vary depending upon the desired properties sought to be obtained by those skilled in the art utilizing the teachings disclosed herein.
The recitation of numerical ranges by endpoints includes all numbers subsumed within that range (e.g. 1 to 5 includes 1, 1.5, 2, 2.75, 3, 3.80, 4, and 5) and any range within that range.
As used in this specification and the appended claims, the singular forms “a”, “an”, and “the” encompass embodiments having plural referents, unless the content clearly dictates otherwise. As used in this specification and the appended claims, the term “or” is generally employed in its sense including “and/or” unless the content clearly dictates otherwise.
The term “autostereoscopic” refers to displaying three-dimensional images that can be viewed without the use of special headgear or glasses on the part of the user or viewer. These methods produce depth perception for the viewer even though the image is produced by a flat device. The term stereoscopic 3D incorporates the field of autostereoscopic devices but also includes the stereoscopic 3D display case in which special headgear, typically shutter glasses, are need to see stereoscopic 3D from a flat device.
The liquid crystal display panel 20 and/or backlight 30 can have any useful shape or configuration. In many embodiments, the liquid crystal display panel 20 and backlight 30 has a square or rectangular shape. However, in some embodiments, the liquid crystal display panel 20 and/or backlight 30 has more than four sides or is a curved shape. While the present disclosure is directed to any stereoscopic 3D backlight including those requiring shutter glasses or more than a single lightguide and associated liquid crystal display panel, the present disclosure is particularly useful for autostereoscopic displays.
A synchronization driving element 50 is electrically connected to the backlight 30 plurality of first and second light sources 32, 34 and the liquid crystal display panel 20. The synchronization driving element 50 synchronizes activation and deactivation (i.e., modulation) of the right eye image solid state light source 32 and the left eye image solid state light source 34 as image frames are provided at a rate of, in many embodiments, 90 frames per second or greater to the liquid crystal display panel 20 to produce a flicker-free still image sequence, video stream or rendered computer graphics. An image (e.g., video or computer rendered graphics) source 60 is connected to the synchronization driving element 50 and provides the images frames (e.g., right eye images and left eye images) to the liquid crystal display panel 20.
The liquid crystal display panel 20 can be any useful transmissive liquid crystal display panel. In many embodiments, liquid crystal display panel 20 has a frame response time of less than 16 milliseconds, or less than 10 milliseconds, or less than 5 milliseconds. Commercially available transmissive liquid crystal display panels having a frame response time of less than 10 milliseconds, or less than 5 milliseconds, or less than 3 milliseconds, are for example Toshiba Matsushita Display's (TMD) optically compensated bend (OCB) mode panel LTA090A220F (Toshiba Matsushita Display Technology Co., Ltd., Japan).
The backlight 30 can be any useful backlight that can be modulated between a right eye image solid state light source 32 and left eye image solid state light source 34 at a rate of, in many embodiments, at least 90 Hertz, or 100 Hertz, or 110 Hertz, or 120 Hertz, or greater than 120 Hertz.
The illustrated backlight 30 includes a first side 31 or first light input surface 31 adjacent to the plurality of first light sources 32 or right eye image solid state light source 32 and an opposing second side 33 or second light input surface 33 adjacent to the plurality of second light sources 34 or left eye image solid state light source 34. A first surface 36 extends between the first side 31 and second side 33, and a second surface 35, opposite the first surface 36, extends between the first side 31 and second side 33. The first surface 36 substantially re-directs (e.g., reflects, extracts, and the like) light and the second surface 35 substantially transmits light. In many embodiments, a highly reflective surface is on or adjacent to the first surface 36 to assist in re-directing light out through the second surface 35.
In many embodiments, the first surface 36 includes a plurality of extraction elements such as, for example, linear prism or lenticular features as shown. In many embodiments, the linear prism or lenticular features can extend in a direction parallel to the first side 31 and second side 33 or parallel to the linear prism and lenticular features of the double sided prism film 40. In some embodiments, the linear prism or lenticular features are not parallel to the first side 31 or second side 33.
The solid state light sources can be any useful solid state light source that can be modulated at a rate of, for example, at least 90 Hertz. In many embodiments, the solid state light source is a plurality of light emitting diodes such as, for example, Nichia NSSW020B (Nichia Chemical Industries, Ltd., Japan). In other embodiments, the solid state light source is a plurality of laser diodes or organic light emitting diodes (i.e., OLEDs). The solid state light sources can emit any number of visible light wavelengths such as red, blue, and/or green, or range or combinations of wavelengths to produce, for example, white light. The backlight can be a single layer of optically clear material with light sources at both ends or two (or more) layers of optically clear material with a light source per layer which preferentially extract light in a desired direction for each layer.
The double sided prism film 40 can be any useful prism film having a linear lenticular structure on a first side and a linear prismatic structure on an opposing side. The linear lenticular structure and the linear prism structure are parallel. The double sided prism film 40 transmits light from the scanning backlight to the liquid crystal display panel 20 at the proper angles such that a viewer perceives depth in the displayed image. Useful, double sided prism films are described in United States Patent Publication Nos. 2005/0052750 and 2005/0276071, which are incorporated herein to the extent they do not conflict with the present disclosure.
The image source 60 can be any useful image source capable of providing images frames (e.g., right eye images and left eye images) such as, for example, a video source or a computer rendered graphic source. In many embodiments, the video source can provide image frames from 50 to 60 Hertz or greater. In many embodiments, the computer rendered graphic source can provide image frames from 100 to 120 Hertz or greater.
The computer rendered graphic source can provide gaming content, medical imaging content, computer aided design content, and the like. The computer rendered graphic source can include a graphics processing unit such as, for example, an Nvidia FX5200 graphics card, a Nvidia GeForce 9750 GTX graphics card or, for mobile solutions such as laptop computers, an Nvidia GeForce GO 7900 GS graphics card. The computer rendered graphic source can also incorporate appropriate stereo driver software such as, for example, OpenGL, DirectX, or Nvidia proprietary 3D stereo drivers.
The video source can provide video content. The video source can include a graphics processing unit such as, for example, an Nvidia Quadro FX1400 graphics card. The video source can also incorporate appropriate stereo driver software such as, for example, OpenGL, DirectX, or Nvidia proprietary 3D stereo drivers.
The synchronization driving element 50 can include any useful driving element providing synchronizing activation and deactivation (i.e., modulation) of the right eye image solid state light source 32 and the left eye image solid state light source 34 with image frames provided at a rate of, for example, 90 frames per second or greater to the liquid crystal display panel 20 to produce flicker-free video or rendered computer graphics. The synchronization driving element 50 can include a video interface such as, for example, a Westar VP-7 video adaptor (Westar Display Technologies, Inc., St. Charles, Mo.) coupled to custom solid state light source drive electronics.
The light sources 32, 34 can be air coupled or index matched to the backlight light guide. For example, a packaged light source device (e.g., LED) can be edge-coupled without index matching material into the light guide. Alternatively, packaged or bare die LEDs can be index matched and/or encapsulated in the edge of the light guide for increased efficiency. This feature may include additional optical features, e.g., injection wedge shapes, on the ends of the light guide to efficiently transport the input light. The LEDs can be alternatively embedded in the edge or side 31, 33 of the light guide with appropriate features to efficiently collect and collimate the LED light into TIR (i.e., total internal reflection) modes of the light guide.
Liquid crystal display panels 20 have a refresh or image update rate that is variable, but for the purposes of this example, a 60 Hz refresh rate is presumed. This means that a new image is presented to the viewer every 1/60 second or 16.67 milliseconds (msec). In the 3D system this means that at time t=0 (zero) the right image of frame one is presented. At time t=16.67 msec the left image of frame one is presented. At time t=2*16.67 msec the right image of frame two is presented. At time t=3*16.67 msec the left image of frame two is presented, and this process is thus repeated. The effective frame rate is half that of a normal imaging system because for each image a left eye and right eye view of that image is presented.
In this example, turning the first plurality of light sources on to light the right (or left) image at time t=0 provides light to the right (or left) image, respectively. At time t=16.67 msec the second image left or right, starts to be put in place. This image replaces the “time t=0 image” from the top of the LCD panel to the bottom of the LCD, which takes 16.67 msec to complete in this example. Non-scanned solutions turn off all the first plurality of light sources and then turn on all the second plurality of light sources sometime during this transition.
Providing at least 45 left eye images and at least 45 right eye images (alternating between right eye and left eye images and the images are possibly a repeat of the previous image pair) to a viewer per second provides a flicker-free 3D image to the viewer. Accordingly, displaying different right and left viewpoint image pairs from computer rendered images or images acquired from still image cameras or video image cameras, when displayed in synchronization with the switching of the light sources 32 and 34, enables the viewer to visually fuse the two different images, creating the perception of depth from the flat panel display. A limitation of this visually flicker-free operation is that, as discussed above, the backlight should not be on until the new image that is being displayed on the liquid crystal display panel has stabilized; otherwise cross-talk and a poor stereoscopic image will be perceived.
The backlight 30 and associated light sources 32, 34 described herein can be very thin (thickness or diameter) such as, for example, less then 5 millimeters, or from 0.25 to 5 millimeters, or from 0.5 to 4 millimeters, or from 0.5 to 2 millimeters.
Embedded 3D-2D Film Stack
An embodiment includes an article incorporating a 3D film, such as the double sided prism film described and identified above, incorporated into an autostereoscopic 3D display as part of the backlight for an embedded 2D and 3D display. “Embedded” in this case means that the 2D portion(s) of the display and the 3D portion(s) of the display use a common backlight comprising a 3D backlight using 2-sided 3D film and that the 2D portions of this display use the same backlight with the addition of, for example, diffusers, reflective polarizers, brightness enhancement film, turning film, gain enhancement diffusers, and possibly other films used between the backlight and an LCD panel. An advantage of this embodiment is that a conventional optical stack of films will work with the 3D backlight and that the creation of the 2D portions of the backlight does not degrade the performance of the 3D portion(s) of the display. Also, this combination of 3D and 2D displays can produce a visually appealing display with autostereoscopic 3D in particular regions for conspicuity, improved human response time, and generally a more immersive type display.
One particular embodiment includes an embedded or combined 2D and 3D display unit as part of an automobile dashboard. Visually the 3D portion of the display is compelling because the otherwise flat display is made to have apparent depth. Some automobile makers attempt to provide a 3D effect in the instrument cluster by making, for example, the speedometer number be a transparent lightguide with a needle mounted in front of or behind the lightguide. This technique is a static feature or simply changing 3D effect compared to the autostereoscopic 3D effect demonstrated with the embedded solution.
An illustrative example is shown in
The optical paths for the 3D display region 110 and the 2D display regions 112, 114 are shown in cross-section in
The stereoscopic 3D display and 2D display 100 includes, for example, a liquid crystal display panel 20, drive electronics configured to drive the liquid crystal display panel with alternating left eye and right eye images (shown in
A diffuser film 140 is positioned between the liquid crystal display panel 20 and the embedded 3D film 40. The diffuser film 140 scatters light and disrupts angular orientation of light passing through the 2D section 112, 114 providing for visual information in a 2D format. However, this construction provides a stereoscopic 3D display and 2D display 100 having a uniform brightness.
3D-2D Display Transition Zone
An embodiment includes a display with stereoscopic 3D content in one section and 2D content in other sections with a narrow transition zone between the 2D and 3D sections, possibly made using a physical barrier between the 2D and 3D sections. In some embodiments, the 3D film that creates the 3D effect is covered over in the 2D sections by a diffuser stack or diffuser film. The 2D-3D sections are split by the edge of the diffuser stack, which is a very narrow zone, perhaps one pixel wide. This area can be covered over by a very narrow bezel to separate the two sections and assist the viewer in transition between the two views.
One particular embodiment includes a 2D-3D-2D display with one backlight and one LCD display that shows 3D content only in the center section and 2D content in sections on either side of the 3D section. The 3D film that transmits light to one or the other eye to allow a 3D effect is attached to a rigid film frame (e.g., metal film frame) in the center of the display with other turning films attached to the rigid film frame on either side. Alternatively, there can be the one 3D film all along the bottom of the frame. These films are situated on top of a single backlight with a minimum air gap between the light guide and the 3D films. The light guide is illuminated on the left and right sides by several side-emitting LEDs. The left and right side LEDs are alternately turned on in synchronization with their corresponding left or right image, as described above. The 3D film transmits light from the left LEDs into the viewer's left eye while the left image is presented on the LCD display. Similarly, the 3D film transmits light from the right LEDs into the viewer's right eye while the right image is presented on the LCD display.
The 2D sections provide two identical images on the LCD panel. The 3D section provides two different images from two different viewpoints on the LCD panel at two different times, generating the 3D effect. The 2D sections also have one or more diffuser films between the LCD panel and the turning film to improve the view angle performance and uniformity of the 2D sections and to minimize cosmetic blemishes. Thus, the 2D sections will not show stereoscopic 3D.
If the diffuser films are separated from the turning film with a large air gap, then a physical barrier can be between the 2D and 3D sections to prevent stray light from the 2D from entering the 3D area and contaminating the directional 3D light. If the diffuser films are in close proximity to the 3D film, a physical barrier may not be needed because the 2D scattered light is extracted through the display very quickly and will be less likely to bounce into the 3D zone.
The frame 155 can be formed of any useful material and in many embodiments is a rigid material such as, for example, aluminum. The illustrated frame 155 includes a center section, a left section adjacent a first side of the center section, and a right section adjacent a second side of the center section opposite the first side, wherein the center section corresponds with the 3D section 110 and wherein the left section corresponds to a 2D section 112 and right section correspond with the 2D section 114.
One particular embodiment of a film frame for the display has about a ½ inch gap between the LCD and the diffuser so that the 3D film is spaced from the LCD panel to prevent moire visual effects. A narrow metal barrier has been included between the 2D and 3D areas lined with specular reflective material to reflect light within the 2D areas in order to prevent it from being absorbed and to maintain the 2D areas brighter. The light in the 3D section is also contained between the barriers. The frame can be composed of aluminum, for example. This film frame design for this embodiment is shown in
The width of the bezel 180 (see
The transition zone between the 2D sections 112, 114 and 3D section 110 is a narrow area at the inner edges of the diffuser film 140. This transition zone can be covered by a narrow bezel 180 located above the LCD panel 20. The bezel 180 will also cover the narrowest area of the film frame 155 and any other portions of the LCD 20 that are not needed.
Techniques to Avoid Depth Cue Conflict in 3D Display
The following description illustrates how to avoid some commonly occurring depth cue conflicts that can occur with 3D display systems. This disclosure of techniques to avoid depth cue conflict in 3D display is applicable to any 3D display in general. In some embodiments a good 3D display is obtained when content is designed to avoid conflicting depth cues. Such content includes stereoscopic content such that the disparity depth cue content that does not conflict with the visual depth of the display bezel visual depth (see
Another depth cue conflict that often occurs with stereoscopic displays results from the common stereoscopic content generation practice that leads to the content being perceived as a limited number of discrete depth layers, referred to as a “cardboarding” effect. For example, when stereoscopic content is generated that in the real world would cross numerous depth layers, designers often will take stimulus generation shortcuts that lead to the content component being perceived as a single depth layer in terms of parallax whereas other depth cues such as linear perspective or texture gradient suggest that the same component should. Such depth cue conflicts can be avoided by generating stereoscopic content using actual geometries whenever possible, for example using 3D rendering programs.
Another depth cue conflict that can be very subtle, but potentially devastating in terms of its impact on a viewer's ability to fuse stereoscopic content, results from surfaces in the content lacking sufficient features for the visual system to determine relative disparity. Thus, one component of the present disclosure illustrates how to design stereoscopic content to effectively utilize disparity to confer a sense of depth to a viewer by designing all stereoscopic content with sufficient features to allow the viewer's system to effectively discern disparity information.
The availability of surface features by which the viewer's visual system can determine surface disparity is key to a viewer being able to effectively fuse a stereoscopic image pair.
In fact fusing an image has been found to be significantly easier if all of the layers in a piece of stereoscopic content contain sufficient features to determine relative disparity. If a single layer in a piece of stereoscopic content lacks sufficient disparity features to determine relative disparity, it not only affects the viewer's ability to fuse that layer but also the other layers in the piece as well due to the resulting conflict in depth cues that often are partially due to the lack of sufficient surface features to accurately judge disparity. If a surface lacks sufficient surface features by which one can accurately infer disparity information, then as a result that surface has zero disparity and is perceived as being at the display level. Such phenomenon can result in a depth cue conflict if one or more depth cues suggest the layer is located at one depth plane whereas other depth cue suggests the layer is located at another depth plane.
If stereoscopic content is generated incorrectly, one depth cue may provide the viewer with one type of visual information and a second depth cue may provide a different type of visual information. For example, disparity information may indicate to the viewer that it is to be perceived in front of the bezel, whereas if the bezel itself is blocking off part of that same content a different depth cue, occlusion, may indicate to the viewer the bezel must be in front. When this condition occurs, two depth cues are in conflict and the viewer may have difficulty fusing the two images and thus fail to perceive depth in the display. Such depth cue conflict is believed to be one of the main causes of visual strain or fatigue.
The present embodiment illustrates a method of stereoscopic content generation or presentation involving physically separating the content from the display bezel so as to prevent depth cue conflict resulting from disparity/occlusion mismatch. The distance to maintain the 3D content from the bezel depends on the depth of the bezel, the maximum amount of disparity in the display, and the perceived distance of the content above the bezel, tiled surfaces, edges or any physical edges touching or immediately adjacent to the stereoscopic portion of the display. The present embodiment can apply to any stereoscopic 3D display system with a bezel in which it is possible for bezel occlusion of display content to create depth cue conflict.
For all the anaglyphs (
One particular embodiment includes a stereoscopic display where there is a no content zone directly interior to the display bezel's left and right edge and the bezel's size is defined by the maximum amount of disparity to be displayed.
Another particular embodiment includes stereoscopic content that dynamically determines the screen size where the presence and size of a no content zone is determined by whether the content to be displayed in that region of the screen would lead to depth cue conflict.
With artificial stereoscopic content (e.g., drawn or render stereoscopic image pairs), surfaces may be generated in such a way as to lack sufficient stereoscopic disparity determining features.
The features need not be noticeably or consciously discernable in order for a viewer's visual system to use them to determine relative disparity, which is illustrated in
Another particular embodiment includes a rendering tool that assesses whether a given surface has sufficient features to judge relative disparity. Words or logo could be used as disparity feature enhancers, or patterns (e.g., sinusoidal pattern) could also be used as disparity feature enhancers. Such feature enhancers could be either consciously perceptible or only subjectively perceptible in nature.
Uniform Light Guide
An embodiment includes a display with stereoscopic 3D content in one section and 2D content in other sections, as described above for example, with a high degree of perceived uniformity and no neutral density filters. The perceived brightness or luminance uniformity of the display among all the 2D-3D-2D sections does not waste light and includes a single light guide. As used herein the phrase “uniformed perceived luminance or brightness” refers to the lack of noticeable perceived luminance change across a space (e.g., for a given display or image a photometer might measure luminance changes across a space (or across the display or image) that the average human visual system lacks the sensitivity to perceive the luminance changes.) This disclosure of uniform light guide is also applicable to any 3D display in general.
One particular embodiment includes a 2D-3D-2D display with one backlight and one LCD panel which displays 3D content only in the center section and 2D content on either side, as described above with respect to
As shown in
The variables of the light guide are selected to balance the on-axis brightness of the 2D and 3D zones. The variables include the extractor angle and the thickness. These variables effect the rate the light is extracted from the light guide. The rate of light extraction determines the uniformity of the backlight. The rate of the extraction is selected so the amount of light extracted along the length of the light guide is within an acceptable range of perceived luminance uniformity. The rate of extraction for the light guide is very aggressive (see
The final on-axis brightness or luminance of the 2D-3D-2D display was measured and recorded (see
Thus, embodiments of the EMBEDDED STEREOSCOPIC 3D DISPLAY AND 2D DISPLAY FILM STACK are disclosed. One skilled in the art will appreciate that the present invention can be practiced with embodiments other than those disclosed. The disclosed embodiments are presented for purposes of illustration and not limitation, and the present invention is limited only by the claims that follow.
This application claims the benefit of U.S. Provisional Application No. 60/977,482, filed Oct. 4, 2007, the disclosure of which is incorporated by reference herein in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
5801705 | Kato et al. | Sep 1998 | A |
5897184 | Eichenlaub et al. | Apr 1999 | A |
7173760 | Adachi et al. | Feb 2007 | B2 |
7210836 | Sasagawa et al. | May 2007 | B2 |
7477331 | Lin et al. | Jan 2009 | B2 |
7530721 | Mi et al. | May 2009 | B2 |
20020054434 | Florczak et al. | May 2002 | A1 |
20050030301 | Harrold et al. | Feb 2005 | A1 |
20050052750 | King et al. | Mar 2005 | A1 |
20050276071 | Sasagawa et al. | Dec 2005 | A1 |
20060023143 | Lee | Feb 2006 | A1 |
Number | Date | Country |
---|---|---|
10-268805 | Oct 1998 | JP |
2003-185966 | Jul 2003 | JP |
2004-109258 | Apr 2004 | JP |
2004-153489 | May 2004 | JP |
Number | Date | Country | |
---|---|---|---|
20090091667 A1 | Apr 2009 | US |
Number | Date | Country | |
---|---|---|---|
60977482 | Oct 2007 | US |