The present invention relates generally to a method used to combine dual streams of video into a standard single stream of video. More particularly, the present invention relates to a method of combining a dual stream of standard video, to occupy a single stream of standard video, providing a means to enhance a viewers experience in several ways.
A TV or projector based on a single-chip Spatial Light Modulator, such as a DMD (Digital Micromirror Device), typically uses a color wheel to render red, green and blue primary colors separately onto the screen, at a very fast-interleaved sequence. A color wheel is an -opto-mechanical assembly that contains colored arc segments mounted to a motor, which rotates at a specified speed, typically a multiple of the video frame-rate. White light is aimed at the color wheel, which causes red, green or blue light to be filtered through. These colors are then projected onto the DMD chip, which modulates the intensities for each pixel based on the brightness for each color, to be displayed on a screen. A typical color wheel rotates 4 to 6 times for every frame (or field) of video, so the viewer does not observe color sequencing; the brain integrates these sub-frames as a single full color image. Using a single Spatial Light Modulator, and a single source of white light, in combination with a color wheel, reduces the overall cost of a TV or projector.
A typical color wheel also has a multiple of RGB (Red, Green, Blue) segments, or RGB groups, to simplify different sub-frame rates being rendered.
There is various prior art covering various means to display stereoscopic imagery on a TV, including field sequential shuttering methods, dual projection methods, lenticular and other optical methods, and cross-polarized methods using electronically-controlled liquid-crystal polarizing filters.
While many of these methods perform with some limitation, such as cost, or the “shuttering” effect, this invention takes advantage of the existing capabilities of specific TVs and projectors, to produce a good quality stereoscopic display.
At the present time, TVs and projectors based on a Spatial Light Modulator, such as the DMD, have a longer operational life than other TV technologies, and it is hoped by the inventors of this application that the DMD will become the de facto standard for new TVs, which will enable them to be stereoscopic “3D-Capable” by this invention.
This invention creates a Stereoscopic 3D display, consisting of a single screen, by adding a layer of polarizing material to the color wheel of a TV based on a Spatial Light Modulator, such as a DMD, and using the sub-frame renderings to perform a rapid “left-eye” and “right-eye” interleaving, at a rate higher than the video frame rate. The Spatial Light Modulator in conjunction with the color wheel creates a “shutter” for not only the primary-color sub-frames of each frame, but also to interleave the “left-eye” and “right-eye” sub-frames to be displayed on the screen. The color wheel can therefore be considered now a color/polarizing wheel.
The synchronization of the color segments of the color wheel are used to synchronize the sequence of “left-eye” and “right-eye” views of the stereoscopic display. Passive polarizing material (linear and/or circular polarization) is added as a layer to the color wheel, rendering polarized primary color sub-frames on the screen.
Passive polarized glasses are worn by the viewer of this screen, which separates the polarized light using polarized filters, so that each eye sees its respective “left-eye” and “right-eye” view.
A typical color wheel rotates a multiple of times per video frame, and has a multiple of RGB (Red, Green, Blue) segments, or RGB groups, therefore a flicker-free stereoscopic display is realized.
This invention takes advantage of existing prior art, and by the enhancements to these existing elements, creates a Stereoscopic 3D display.
The foregoing needs are met, to a great extent, by the present invention, wherein in one aspect an apparatus is provided that in some embodiments
There has thus been outlined, rather broadly, certain embodiments of the invention in order that the detailed description thereof herein may be better understood, and in order that the present contribution to the art may be better appreciated. There are, of course, additional embodiments of the invention that will be described below and which will form the subject matter of the claims appended hereto.
In this respect, before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction and to the arrangements of the components set forth in the following description or illustrated in the drawings. The invention is capable of embodiments in addition to those described and of being practiced and carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein, as well as the abstract, are for the purpose of description and should not be regarded as limiting.
As such, those skilled in the art will appreciate that the conception upon which this disclosure is based may readily be utilized as a basis for the designing of other structures, methods and systems for carrying out the several purposes of the present invention. It is important, therefore, that the claims be regarded as including such equivalent constructions insofar as they do not depart from the spirit and scope of the present invention.
For a better understanding of the present invention, reference is made to the following descriptions taken in conjunction with the accompanying drawings, in which, by example:
The segments are aligned symmetrically around the axis of rotation, such that when the wheel rotates and light passes through each segment, the same polarizing orientation exist for each of the three polarizing segments for their respective left-eye and right eye views. Exploded views of each segment indicate the polarizing orientations. If there are “white” segments in the color wheel, each alternate “white” segment of the color wheel is overlaid by polarizing material of alternating polarizing orientation.
A single-chip Spatial Light Modulator (such as a DMD: Digital Micromirror Device, a DLP technology by Texas Instruments) based TV or projector using a color wheel to render red, green and blue primary colors separately onto the screen as sub-frames [
The DMD will be used as an example for this invention, even though other technologies such as GLV (Grating Light Valve) may be substituted for the Spatial Light Modulator.
The DMD is a device used in which each pixel of the sub-frame is rendered by an associated mirror having two states, “on” and “off”. The “on” and “off” time is controlled by pulse-width modulation, created by support circuitry of the DMD, whereby the intensity or brightness of the pixel is proportional to the averaged “on” time, over all the sub-frames for its associated primary color within each frame of video.
The color wheel [
To prevent a viewer from observing color sequencing of the sub-frames, the color wheel is rotated at a multiple of the frame-rate, typically four to six times. The color wheel also has a number of RGB groups, typically two or an even number, to accommodate varying frame rates, typically thirty or sixty frames per second while maintaining a constant rotational speed, as well as to reduce the rotational speed.
It is therefore common for a DMD based TV, displaying 30 fps video to generate:
(30 fps)×(3 RGB_Arcs)×(2 RGB groups per color wheel)×(4 rotates)=720 sub-frames per second
For stereoscopic applications, the RGB groups are divided evenly between “left-eye” and “right-eye” assignments, so from the above calculation, 360 sub-frames per second will be presented to each eye. In other words 120 full-color RGB frames will be presented to each eye.
[
All the polarizing arc segments are combined to create a single layer of polarizing material. The arc segments are aligned symmetrically around the axis of rotation, such that when the wheel rotates and light passes through each adjacent arc segment, the same polarizing orientation exists for each of the three polarizing arc segments for their respective left-eye and right eye views, as shown by the direction of shading lines in [
The polarizing orientation for each eye needs to be cross-polarized. For one embodiment of this invention where the polarizing material is linearly polarized, the second orientation will be perpendicular to the first orientation. For another embodiment of this invention where the polarizing material is circularly polarized, the second orientation will be the reverse direction to the first orientation.
The polarizing layer [
The color/polarizing wheel described in this invention, in conjunction with the DMD, becomes a shutter for rendering the primary color images on the screen as well as a shutter for rendering polarized light of these colors on the screen.
Polarized primary-color sub-frames are therefore rendered on the screen at a multiple of the frame rate.
The following table represents a typical example the sequence of light filtered through the color/polarizing wheel, as it rotates four times during a single frame of video, and assumes a six-segment color wheel, thereby producing 24 sub-frames. This example is the typical speed of a DMD based TV or projector:
Because the color wheel in this tabulated example rotates four times per frame of video, and the color wheel consists of two RGB groups, the resultant rendering frame rate for each eye is 120 frames per second, assuming a video input frame rate of 30 frames per second.
This multi-sub-frame rendering is already being done by the DMD and support chips for regular “2D” video. This invention uses this existing sub-frame interleaving principle now to render stereoscopic “3D”, without the need for shutter glasses. Passive polarized glasses are all that are required.
The rendering of the RGB color sequence is synchronized with the DMD using the DMD support circuitry. This synchronizes the rotation of the color wheel to the sub-frames rendered into the DMD for each primary color as the associated color segment passes over the beam of white light to be filtered, and ultimately synchronized to the incoming video signal.
The DMD support circuitry typically generates the multiple sub-frames required, from each full frame of video residing in an associated memory buffer.
In one embodiment of this invention, this memory buffer is doubled in size, such that the capacity can fit two frames of video for the “left-eye” and “right-eye” stereoscopic pair of frames, and bank switched when reading each alternating RGB group. The memory will need to be loaded in a FIFO arrangement where the input data bus will have double the data rate.
In another embodiment of this invention, where there is sufficient memory capacity to hold two frames of video, the pulse-width-modulation signals sent to the DMD are assigned in groups separately for “left-eye” and “right-eye” sub frames, instead of spread evenly across each sub-frame for each associated color. This technique would lose one least-significant bit of each color bit depth. A typical DMD has the capacity to render ten bits per color per pixel, so this would become 9 bits. This can be performed by firmware in the DMD support circuitry.
In another embodiment of this invention, the support circuitry of the DMD may store in memory, a higher resolution image frame, which is spatially multiplexed between two smaller (lower resolution) frames consisting of the “left-eye” and the “right-eye” frame stereo-pair. The input to the DMD will then be presented with the lower resolution sub-frames consisting of “left-eye” and “right-eye” images, consistent with this invention, except taking advantage of memory capable of higher resolution, and also ensuring the stereo pair is maintained together as a pair, and effectively as a single tiled frame holding the stereo pair. This enhanced embodiment also has the benefit of allowing a single higher resolution tiled frame to be encoded as a single video stream, for transport or storage.
In another embodiment of this invention, there are two sets of identical DMD support circuitry, each with its own associated memory buffer. One set is dedicated to the “left-eye” view, and the other set is dedicated to the “right-eye” view. These two sets of support circuitry is then multiplexed to a single DMD device, and synchronized to the incoming stereoscopic image streams, which need to be gen-locked together.
The light path this DMD based stereoscopic display, starts out as a beam of white light, typically concentrated down a “light-pipe”, which shines onto the spinning color/polarizing wheel, which filters the primary-color and polarization orientation of the light as it passes through. This light now impinges upon the surface of the DMD, whose surface is covered by an array of vibrating mirrors controlled by pulse-width modulators. The light reflected off the DMD then goes through a series of lenses to magnify the image to the desired size required on the surface of a screen.
Whether the screen is “rear-projection” or “front-projection”, it will need to be made of a material that does not alter the polarizing properties of light shining through it or onto it, respectively.
The screen is viewed as a regular TV, and when “Stereoscopic 3D” mode is enabled, the viewer needs to wear a pair of passive cross-polarized glasses, which separates the polarized light using polarizing filters, so that each eye sees its respective “left-eye” and “right-eye” view, which matches the polarization generated by the color wheel.
This invention takes advantage of the existing capabilities of specific TVs and projectors, to produce a good quality Stereoscopic 3D display, at a low cost.
The many features and advantages of the invention are apparent from the detailed specification, and thus, it is intended by the appended claims to cover all such features and advantages of the invention which fall within the true spirit and scope of the invention. Further, since numerous modifications and variations will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation illustrated and described, and accordingly, all suitable modifications and equivalents may be resorted to, falling within the scope of the invention.
This application claims priority to and is a non-provisional of U.S. provisional patent application entitled, Stereoscopic 3D TV System: End-to-End Solution, filed May 7, 2003, having a Ser. No. 60/468,260, the disclosure of which is hereby incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
60468260 | May 2003 | US |