The invention relates to a stereoscopic display apparatus comprising means for producing a display, the stereoscopic display apparatus comprising laterally separated picture elements in a first plane and optical directory means comprising a group of optical directory elements each of which is associated with a respective group of picture elements, the optical directory means overlying the picture elements in the first plane for directing the outputs of the picture elements in mutually different angular directions relative to the first plane.
The invention further relates to a method of computing a display value to be provided to such a stereoscopic display apparatus.
The invention further relates to a computer program product to be loaded by a computer arrangement, comprising instructions to compute a display value to be provided to such a stereoscopic display apparatus
Stereoscopic display apparatuses of the kind described in the opening paragraph are increasingly used both in hand held applications like telephones and in (TV) monitors, where multiple views are used.
The picture elements may correspond to single pixels, such as in monochrome devices, but generally (color-devices) correspond to sub-pixels of a color picture element.
A stereoscopic display apparatus of the kind mentioned above is described in U.S. Pat. No. 6,064,424, which shows an active matrix liquid crystal display panel having picture elements arranged in groups of picture elements and a lenticular screen having (cylindrical) lenticular elements, or lenticulars, as optical directory elements overlying the display panel. The light of each picture element is sent into different well-defined directions depending on the position of the picture element with respect to the lenses. In this way typically six independent views are created corresponding to six different viewing angles. A viewer receives different views in each eye and, when using the proper image content, observes a three-dimensional image.
Each lenticular in U.S. Pat. No. 6,064,424 is associated with a group of picture elements. The lenticulars are slanted with respect to the vertical column directions, which is favorable with regard to the perceived three-dimensional pixel structure.
For a viewer however due to the fact that different parts of the display reach the viewer's eye under different angles an intensity modulation on the display still occurs, referred to as “dark bands”. The bands “shift” over the display as the viewer moves parallel to the display and the pitch of the bands changes as the viewer moves towards the display or away from the display. Even with a small modulation depth (e.g. only 1%) the effect is very annoying.
The applicant filed an application disclosing an invention to overcome at least partly said intensity modulation on Apr. 29, 2005 at the European patent office with application number 05103555.8. Basically, that application discloses that the dark bands are prevented by certain combinations of the slant angle and the lens pitch. The provided solution is called “fractional views”. That invention is based on the understanding that the above mentioned modulation as a function of viewing angle, which is caused by the presence of non-emitting areas (black matrix) around the (LCD) picture elements, which are “imaged” into certain—hence darker—directions is overcome by choosing a design in which simultaneously both “full” (virtual) sub-pixels and “partial” (virtual) sub-pixels are imaged, leading to intensity modulations, which are mutually shifted in phase (e.g. 180° for k=2). As a result, the first harmonic of the total intensity cancels out and only a much less intense second harmonic (and third etc.) remains. The dark band effect is reduced accordingly.
However, if objects with a relatively large depth or disparity are rendered in a straightforward way, the display will suffer from so-called jagged edges. These repetitive patterns result into unnatural sharp features to e.g. objects far in the background, which are normally somewhat blurred.
It is an object of the invention to provide a method of the kind described in the opening paragraph whereby the occurrence of these so-called jagged edges is at least partly prevented.
This object of the invention is achieved in that the method comprises:
The inventors have observed that the artifacts occur if during the rendering, i.e. the computation of the display value a strict correspondence between the first intermediate value from the 3-D representation, the first one of the angular directions and the coordinates of the first one of the picture elements is maintained. In other words, the artefacts occur if the computation of the display value is solely based on the first intermediate value, which is the correct approach for most rendering methods. Basically, the method according to the invention is based on low-pass filtering in the 3-D representation. Because of the multiple intermediate values each based on respective angular directions but all related to the same coordinates of the first one of the picture elements the amount of filtering is dependent on the depth (disparity) of the object to be displayed. Objects which are to be displayed in the first plane (or relatively close to the first plane) are not or hardly blurred, while for other objects of the 3-D representation which are to be displayed further away from that first plane the amount of blur is higher.
Although low-pass filtering as such is a known technique, the method according to the invention clearly distinguishes from the approach a skilled person in the art would take. The skilled person would render multiple views, i.e. different images to be directed to the various mutually different angular directions, and would then low-pass these different views afterwards. That is a straightforward, simple and more computer friendly approach. However, the image quality, in particular the sharpness of the different views would be less high compared to the method according to the invention. The filtering would be depth independent in that case. That means that even objects, which are to be displayed in the first plane (or relatively close to the first plane) would be blurred.
In an embodiment of the method according to the invention, a first difference between the first one of the angular directions and the further angular direction is substantially equal to a second difference between the first one of the angular directions and a second one of the angular directions. Preferably, the second difference corresponds to the minimum of mutual differences of the set of mutual differences between the angular directions. In other words, preferably the further angular direction corresponds to a second one of the angular directions, whereby the second one of the angular directions from all angular directions in which the display apparatus is designed to direct the outputs, deviates minimal from the first one of the angular directions. If the first difference is smaller than the second difference good results are achieved too.
In an embodiment of the method according to the invention, for determining the first intermediate value the first one of the angular directions is applied. The fact that the first intermediate value is determined “on basis of” a first one of the angular directions does not mean that the exact first one of the angular directions is applied, i.e. the applied angular direction may deviate from the first one of the angular directions which is directly determined by the physical dimensions of the optical directory elements, e.g. lenses, and the position of the first one of the picture elements relative to the optical axis of the optical directory elements.
In an embodiment of the method according to the invention, the further angular direction corresponds to a second one of the angular directions, the first one of the angular directions determined by a first spatial position of the first one of the picture elements relative to its associated first one of the optical directory elements, the second one of the angular directions determined by a second spatial position of a second one of the picture elements relative to its associated second one of the optical directory elements. As said, the stereoscopic display apparatus is designed to direct the outputs of the picture elements in mutually different angular directions relative to the first plane. For example, there are fourteen different angular directions. The layout of the stereoscopic display apparatus, i.e. the alignment of the laterally separated picture elements and the optical directory means comprising the optical directory elements determines the fourteen different angular directions. A portion of the set of fourteen different angular directions is associated to a first one of the optical directory elements. A second portion of the set of fourteen different angular directions is associated to a second one of the optical directory elements and a third portion of the set of fourteen different angular directions is associated to a third one of the optical directory elements. Preferably, the different angular directions used to compute the display value correspond to the different portions of the set of fourteen different angular directions.
An embodiment of the method according to the invention, comprises
Preferably, the display value is based on more than two intermediate values, e.g. three. However with more than three intermediate values good results are achieved too. The conditions as specified above, e.g. related to the difference between angular directions and the portions of the set of angular directions also apply if the number of intermediate values is higher than two.
In an embodiment of the method according to the invention, combining comprises computing an average of the first intermediate value the second intermediate value and optionally the third intermediate value to compute the display value. Preferably, computing the average comprises computing a weighted average. The first intermediate value preferably has the highest weighting vector.
It is a further object of the invention to provide a stereoscopic display apparatus of the kind described in the opening paragraph whereby the occurrence of these so-called jagged edges is at least partly prevented.
This object of the invention is achieved in that the display apparatus further comprises:
It is a further object of the invention to provide a computer program product of the kind described in the opening paragraph whereby the occurrence of these so-called jagged edges is at least partly prevented.
This object of the invention is achieved in that the computer program product, after being loaded, provides said processing means with the capability to carry out:
Modifications of the method and variations thereof may correspond to modifications and variations thereof of the stereoscopic display apparatus and the computer program product, being described.
These and other aspects of the stereoscopic display apparatus, of the method and of the computer program product, according to the invention will become apparent from and will be elucidated with respect to the implementations and embodiments described hereinafter and with reference to the accompanying drawings, wherein:
The Figures are diagrammatic and not to scale. Same reference numerals are used to denote similar parts throughout the Figures.
The index of refraction of the display front panel 106 and the index of refraction of lenses is chosen n=1.5. Furthermore, the lens bodies in this example are (parts of) cylinders.
When moving in front of the display a modulation (dark bands) is clearly visible, although the modulation depth is only in the order of 1% (rms).The modulation is caused by the fact that different positions on the display correspond to different viewing angles. These in turn correspond to slightly different intensities due to different black matrix components in the light output, caused by e.g. a black matrix in certain (liquid crystal) displays. The bands move and change their pitch as the viewer moves in front of the display.
The portion of the set of angular directions comprising the angular directions corresponding to views 1,4,7,10,13, together called the first group, which are associated to a first one of the optical directory elements 601 together forms a first sub-cone. The portion of the set of angular directions comprising the angular directions corresponding to views 2,5,8,11,14, together called the second group, which are associated to a second one of the optical directory elements 602 together forms a second sub-cone. The portion of the set of angular directions comprising the angular directions corresponding to views 3,6,9,12 together called the third group, which are associated to a third one of the optical directory elements 603 together forms a third sub-cone. Note that the sub-cones belonging to the neighboring optical directory elements 601-603 are slightly rotated from one optical directory element to the other.
The jagged edge artifacts are shown in
In
However, the display value is also based on (in this case) two additional intermediate values, i.e. the second intermediate value 810 and the third intermediate value 812. The second intermediate value 810 and the third intermediate value 812 are fetched from the 3-D representation by applying a second fetch angle and a third fetch angle, respectively. Preferably, the second fetch angle is substantially equal to the second one of the angular directions 109, which corresponds to view 6. Preferably, the third fetch angle is substantially equal to the third one of the angular directions 110, which corresponds to view 4. Notice that views 4 and 6 are in number adjacent to view 5, meaning that the differences between horizontal distances, as described in connection with
For determining the second intermediate value 810 and the third intermediate value 812 the same starting point is applied as being applied for determining the first intermediate value 811.
After determining the first intermediate value 811, the second intermediate value 810 and the third intermediate value 812 these three values are combined into the display value. Preferably, combining means computing the average of the three intermediate values 810-812. Preferably, a weighted average is computed whereby the contribution of the first intermediate value 811 is higher than the contribution of the second intermediate value 810 and the third intermediate value 812.
The processing means comprises a number of determining means 153-155 for determining a respective number of intermediate values from the 3-D representation and a combining means 156 for combining the intermediate values 810-812 into display values. In
Preferably, the first fetch angle, the second fetch angle and the third fetch angle are based on the physical layout of the display device 100. The layout of the display device 100, in particular the position of the picture elements 102 relative to the associated optical directory elements 601-603 is such that the light being generated by the picture elements is primarily directed in predetermined angular directions. It is preferred that the first fetch angle, the second fetch angle and the third fetch angle are substantially equal to respective predetermined angular directions of the display device 100.
The coordinates of the picture elements are used as starting points for fetching the intermediate values from the 3-D representation as explained in connection with
The first determining means 153, the second determining means 154, the third determining means 155 and the combining means 156 may be implemented using one processor. Normally, these functions are performed under control of a software program product. During execution, normally the software program product is loaded into a memory, like a RAM, and executed from there. The program may be loaded from a background memory, like a ROM, hard disk, or magnetical and/or optical storage, or may be loaded via a network like Internet. Optionally an application specific integrated circuit provides the disclosed functionality.
The computer program product according to the invention can be loaded into a computing machine, the computing machine comprising processing means and a memory, in order to provide said processing means with the capability to carry out the processing of the method according to the invention. A single processing unit or a plurality of processing units can be controlled by the computer program product to achieve the results according to the invention.
The computer program product can be handled in a standard comprised or detachable storage, for example a flash memory or a compact disk or a hard disk. The computer program product can be embedded in a computing machine as embedded software or kept pre-loaded or loaded from one of the standard memory devices. The computer program product can be designed in any of the known codes such as machine language code or assembly language code and made to operate on any of the available platforms such as personal computers or servers.
The computer program product can be stored inside the apparatus or carried in a detachable storage medium such as an optical storage disc and transferred to the apparatus. The computer program product can be used in various forms of consumer apparatus for example, set top box, video receiver, video recorder/player, hand-held mobile communication or entertainment devices. The computer program product can be implemented on various platforms such as personal computers or signal processors.
In this specification the term 3-D representation is used. Typically the 3-D representation will be stored (digitally) with data elements according to a particular 3-D data format, which is based on a 3-D model. Below a not exhaustive list of types 3-D data formats is provided:
The method, the computer program product and the stereoscopic display apparatus according to the invention can be applied with and is arranged to apply with, respectively, a 3-D representation being described with any of the above listed 3-D data formats.
Although in the examples a liquid crystal display is shown, the invention can also be used in other kinds of displays such as plasma, LED-displays, etcetera.
Instead of lenticular elements other optical directory elements such as barriers may be chosen alternatively.
Although in the examples a so-called view mapping of the 4⅔ views is shown, the invention can also be used in other kinds of mappings.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be constructed as limiting the claim. The word ‘comprising’ does not exclude the presence of elements or steps not listed in a claim. The word “a” or “an” preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitable programmed computer. In the unit claims enumerating several means, several of these means can be embodied by one and the same item of hardware or software. The usage of the words first, second and third, etcetera do not indicate any ordering. These words are to be interpreted as names.
Number | Date | Country | Kind |
---|---|---|---|
05107636 | Aug 2005 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB2006/052840 | 8/17/2006 | WO | 00 | 2/15/2008 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2007/020600 | 2/22/2007 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
6064424 | Van Berkel et al. | May 2000 | A |
6069650 | Battersby | May 2000 | A |
6118584 | Van Berkel et al. | Sep 2000 | A |
6859240 | Brown et al. | Feb 2005 | B1 |
20030076423 | Dolgoff | Apr 2003 | A1 |
Number | Date | Country |
---|---|---|
0162014 | Aug 2001 | WO |
2004049262 | Jun 2004 | WO |
2006117707 | Nov 2006 | WO |
Number | Date | Country | |
---|---|---|---|
20080225114 A1 | Sep 2008 | US |