This invention relates to an autostereoscopic display device and a driving method for such a display device.
A known autostereoscopic display device comprises a two-dimensional liquid crystal display panel having a row and column array of display pixels (wherein a “pixel” typically comprises a set of “sub-pixels”, and a “sub-pixel” is the smallest individually addressable, single-color, picture element) acting as an image forming means to produce a display. An array of elongated lenses extending parallel to one another overlies the display pixel array and acts as a view forming means. These are known as “lenticular lenses”. Outputs from the display pixels are projected through these lenticular lenses, whose function is to modify the directions of the outputs.
The pixel comprises the smallest set of sub-pixels which can be addressed to produce all possible colors. For the purposes of this description, a “unit cell” is also defined. The unit cell is defined as the smallest set of sub-pixels which repeat to form the full sub-pixel pattern. The unit cell may be the same arrangement of sub-pixels as a pixel. However, the unit cell may include more sub-pixels than a pixel. This is the case if there are pixels with different orientations of sub-pixels, for example. The overall sub-pixel pattern then repeats with a larger basic unit (the unit cell) than a pixel.
The lenticular lenses are provided as a sheet of lens elements, each of which comprises an elongate partially-cylindrical (e.g. semi-cylindrical) lens element. The lenticular lenses extend in the column direction of the display panel, with each lenticular lens overlying a respective group of two or more adjacent columns of display sub-pixels.
Each lenticular lens can be associated with two columns of display sub-pixels to enable a user to observe a single stereoscopic image. Instead, each lenticular lens can be associated with a group of three or more adjacent display sub-pixels in the row direction. Corresponding columns of display sub-pixels in each group are arranged appropriately to provide a vertical slice from a respective two dimensional sub-image. As a user's head is moved from left to right a series of successive, different, stereoscopic views are observed creating, for example, a look-around impression.
The display panel 3 has an orthogonal array of rows and columns of display sub-pixels 5. For the sake of clarity, only a small number of display sub-pixels 5 are shown in the Figure. In practice, the display panel 3 might comprise about one thousand rows and several thousand columns of display sub-pixels 5. In a black and white display panel a sub-pixel in fact constitutes a full pixel. In a color display a sub-pixel is one color component of a full color pixel. The full color pixel, according to general terminology comprises all sub-pixels necessary for creating all colors of a smallest image part displayed. Thus, e.g. a full color pixel may have red (R) green (G) and blue (B) sub-pixels possibly augmented with a white sub-pixel or with one or more other elementary colored sub-pixels. The structure of the liquid crystal display panel 3 is entirely conventional. In particular, the panel 3 comprises a pair of spaced transparent glass substrates, between which an aligned twisted nematic or other liquid crystal material is provided. The substrates carry patterns of transparent indium tin oxide (ITO) electrodes on their facing surfaces. Polarizing layers are also provided on the outer surfaces of the substrates.
Each display sub-pixel 5 comprises opposing electrodes on the substrates, with the intervening liquid crystal material there between. The shape and layout of the display sub-pixels 5 are determined by the shape and layout of the electrodes. The display sub-pixels 5 are regularly spaced from one another by gaps.
Each display sub-pixel 5 is associated with a switching element, such as a thin film transistor (TFT) or thin film diode (TFD). The display pixels are operated to produce the display by providing addressing signals to the switching elements, and suitable addressing schemes will be known to those skilled in the art.
The display panel 3 is illuminated by a light source 7 comprising, in this case, a planar backlight extending over the area of the display pixel array. Light from the light source 7 is directed through the display panel 3, with the individual display sub-pixels 5 being driven to modulate the light and produce the display.
The display device 1 also comprises a lenticular sheet 9, arranged over the display side of the display panel 3, which performs a light directing function and thus a view forming function. The lenticular sheet 9 comprises a row of lenticular elements 11 extending parallel to one another, of which only one is shown with exaggerated dimensions for the sake of clarity.
The lenticular elements 11 are in the form of convex cylindrical lenses each having an elongate axis 12 extending perpendicular to the cylindrical curvature of the element, and each element acts as a light output directing means to provide different images, or views, from the display panel 3 to the eyes of a user positioned in front of the display device 1.
The display device has a controller 13 which controls the backlight and the display panel.
The autostereoscopic display device 1 shown in
The skilled person will appreciate that a light polarizing means must be used in conjunction with the above described array, since the liquid crystal material is birefringent, with the refractive index switching only applying to light of a particular polarization. The light polarizing means may be provided as part of the display panel or the view forming arrangement of the device.
In the designs above, the backlight generates a static output, and all view direction is carried out by the lenticular arrangement, which provides a spatial multiplexing approach. A similar approach is achieved using a parallax barrier.
The lenticular arrangement only provides an autostereoscopic effect with one particular orientation of the display. However, many hand held devices are rotatable between portrait and landscape viewing modes. Thus, a fixed lenticular arrangement does not allow an autostereoscopic viewing effect in different viewing modes. Future 3D displays, especially for tablets, mobile phones and other portable devices will thus have a possibility to observe 3D images from many directions and for different screen orientations. Modern LCD and OLED display panels with existing pixel designs are not suited for this application. This issue has been recognized, and there are various solutions.
A dynamic solution involves providing a switchable lens arrangement, which can be switched between different modes to activate the view forming effect in different orientations. There may essentially be two lenticular arrangements, with one acting in pass through mode and the other acting in lensing mode. The mode for each lenticular arrangement may be controlled by switching the lenticular arrangement itself (for example using an LC switchable lens array) or by controlling a polarization of the light incident on the lenticular arrangement.
A static solution involves designing a lens arrangement which functions in the different orientations. A simple example can combine a rectangular grid of square sub-pixels in the display with a rectangular grid of microlenses (where the lens grid directions are either slanted or non-slanted with respect to the pixel grid directions) to create multiple views in both display orientations. The sub-pixel shapes should be preferably close to a 1:1 aspect ratio, as this will allow avoiding a problem of different angular width for individual views in portrait/landscape orientations.
One possible disadvantage of this approach is a banding effect, in which the black matrix areas between the sub-pixels are projected to the viewer as a regular pattern. Partially it can be solved by slanting the lens array. Specifically, in order to reduce banding effect due to projection of periodic black pixel matrix a view forming arrangement need to be chosen with respect to the pixel addressing direction (rows/columns).
The invention is defined by the claims.
According to an example, there is provided an autostereoscopic display, comprising:
a pixelated display panel comprising an array of single color pixels or an array of sub-pixels of different colors with respective groups of sub-pixels together defining full color pixels; and
a view forming arrangement comprising an array of lens elements, positioned over the display panel, for directing the light from different pixels or sub-pixels to different spatial locations, thereby to enable different views of a three dimensional scene to be displayed in different spatial locations,
wherein the pixels of the display panel form a rectangular or parallelogram grid with a maximum internal angle deviation from 90 degrees of 20 degrees or less, and wherein the rectangular or parallelogram grid repeats with basic translation vectors x and y, and the length of the basic translation vectors x and y have an aspect ratio of the shorter to the longer between 0.66 and 1, and
wherein the view forming arrangement comprises a two dimensional array of microlenses which repeat in a regular grid with basic translation vectors p′ and q′;
wherein defining a dimensionless vector p as (px,py), which satisfies:
p′=p
x
x+p
y
y
q′=−p
y
x+p
x
y
and defining circular regions in the space of components py and px of vector p as:
for integer values n and m,
with rn,m=r0n−γ defining the radius of each circle and n,m defining the circle centers,
the basic translation vectors x, y, p′ and q′ are selected with values such that p falls in the the vector space which excludes the set P1,1 or P2,2 or P4,4 with r0=0.1 and γ=0.75.
In words, the main equation above reads as follows:
(Line 1) Pn,m is equal to the set of values of p such that the modulus (i.e. length) of the difference vector from a vector v to the vector p is less than rn,m for all values of vector v in the set n,m. This defines the circles centered on the set of values n,m.
(Line 2) n,m is the set of vector values i+j/n with i and j as vectors in the two dimensional vector space of integer values (i.e. positive and negative integers and zero) and for which the vector inner product function applied to the j vector gives the answer m. The vector inner product function is, for i=[i j]T then i,i=i2+j2.
The vector p defines the spatial relationship between the pixel (or sub-pixel) grid and the grid of lenses. Thus, it defines a mapping between the pixels (or sub-pixels) and the lenses. In particular, the components of the vector p are the terms of the matrix transformation from the pixel grid vector space (defined by x and y) and the lens grid vector space (defined by p′ and q′). Note that the term “pixel grid” is used to indicate the grid of pixels (if each pixel has only one addressable element), or the grid of sub-pixels (if each pixel has multiple independently addressable sub-pixels). The components of the vector p in turn define how different pixels (or sub-pixels) contribute to different lens phases and how the black mask area is imaged by the grid of lenses. Thus, the vector p can be considered to be a most fundamental way to define the relationship between the lenses and the pixels.
By “basic translation vector” is meant a vector translation from one point within a pixel or lens area to a corresponding point in an adjacent pixel or lens area. The lens and pixel areas are two dimensional, so there are two translation vectors—one for each grid direction. For a rectangular grid, the basic translation vectors are in the orthogonal row and column directions. For a skewed grid, the basic translation vectors are not orthogonal, but follow the row and column directions of the grid.
The circular regions define sets of possible values for the components of the vector p and thus define regions of related characteristics. By excluding the regions defined as P1,1 banding problems are prevented.
For example, the center of the P1,1 region includes the values of p which result from monochrome panels with integer relationship between the pixel grid and lens grid. Other routine panel designs, for example with an integer array of sub-pixels under each lens, as well as fractional designs, correspond to values of p which fall in the center of the P1,1, P2,2 or P4,4 regions.
In this way, the invention provides design parameters for display panel layouts that solves the banding problems mentioned above and enables rotatable multi-view autostereoscopic 3D displays with good performance.
The basic translation vectors x, y, p′ and q′ may have values such that p is not in the set P1,1 with r0=0.25 and γ=0.75.
The basic translation vectors x, y, p′ and q′ may have values such that p is not in the set P2,2 with r0=0.25 and γ=0.75.
The basic translation vectors x, y, p′ and q′ may have values such that p is not in the set P4,4 with r0=0.25 and γ=0.75.
The basic translation vectors x, y, p′ and q′ may have values such that p is not in the set P5,5 with r0=0.25 and γ=0.75.
The basic translation vectors x, y, p′ and q′ may have values such that p is not in the set P8,8 with r0=0.25 and γ=0.75.
These different regions represent progressively better banding performance, such that by excluding progressively more areas in the design space for the vector p, the remaining design options give progressively better banding performance.
The basic translation vectors x, y, p′ and q′ may have values such that p is not in the sets as defined above with r0=0.35. This defines a larger radius of each excluded zone, hence a smaller remaining design space.
There are also preferred regions in the vector space for the vector p. In one example, the basic translation vectors x, y, p′ and q′ have values such that p is in the set P9,18 with r0=0.35 and γ=0.75.
In another example, the basic translation vectors x, y, p′ and q′ have values such that p is in the set P14,26 with r0=0.35 and γ=0.75.
As mentioned above, the pixel grid is preferably near square. For example, the rectangle or parallelogram may have an aspect ratio of the length of the shorter side to the longer side between 0.83 and 1. The rectangle or parallelogram may have a maximum internal angle deviation from 90 degrees of 5 degrees or less.
The display device may be used in a portable device, wherein the portable device is configurable to operate in a portrait display mode and a landscape display mode. It may be a mobile telephone or tablet.
Embodiments of the invention will now be described, purely by way of example, with reference to the accompanying drawings, in which:
Note that
The invention provides an autostereoscopic display, comprising a pixelated display panel comprising an array of single color pixels or an array of sub-pixels of different colors and a view forming arrangement comprising an array of lens elements. The pixels form a square (or near square) grid, and the lenses also repeat in a square (or near square) grid. A vector p is defined which relates to a mapping between the pixel grid and the lens grid. Regions in the two dimension space for this vector p are identified which give good or poor banding performance, and the better banding performance regions are selected.
In the description below, display panel designs are discussed with pixels on a regular 4-fold symmetric essentially square grid, on top of which there is a light modulator that also has elements in a regular 4-fold symmetric grid. For the purposes of explanation, some definitions are needed. In particular, a coordinate system of the panel (i.e. the pixel grid) needs to be defined, and a coordinate system of the view forming arrangement needs to be defined in terms of geometric (physical) coordinates and logical coordinates that are relative to the coordinate system of the panel.
The sub-pixels are shown as squares. However, the actual sub-pixel shape may be different. For example the actual pixel aperture will typically be an irregular shape as it may for example depend on the size and position of pixel circuit elements, such as the switching transistor in the case of an active matrix display panel. It is the pixel grid shape that is important rather than the precise shape of individual pixels or sub-pixels.
Pixel pitch vectors x and y are also shown. These are translation vectors between adjacent pixel centers in the row direction and the column direction, respectively. The letters in the smallest unit cell 30 indicate the primary colors: R=red, G=green, B=blue, W=white.
A pixel grid is defined based on the two vectors x and y, hereafter referred to as pixel pitch vectors. The vectors form a lattice matrix X=[x y] with length units (e.g. meters). There are multiple possible definitions of a pixel including the smallest unit cell, however for this description, the pixel is approximately square. Therefore X should be chosen to form an approximately square region of sub-pixels. As shown in
The pixels do not need to be perfectly square. They may be approximately square, which is taken to mean that a rotation over any angle, a limited sheer or limited elongation is within scope. The aspect ratio is defined as:
and the angle of the grid is:
The sheer is then expressed as |θ−90°|. Hence for an approximately square grid it holds that a≈1 and |θ−90°|≈0°.
For example, a is preferably between 0.9 and 1.1 and θ is between 80 and 100 degrees (of course, if one pair of corner angles is at 80 degrees, then the other pair will be at 100 degrees).
To define the lens grid, lens pitch vectors can be defined.
Instead of physical lens pitch vectors in units of meters, logical and dimensionless lens pitch vectors can be defined as:
p=(px,py) and
q=(−py,px)
for chosen px and py.
The geometric (physical) pitch vectors p′ and q′ (e.g. in meters) are defined in terms of the logical lens pitch vectors as:
p′=Xp=p
x
x+p
y
y,
q′=Xq=p
y
x+P
x
y.
Deformations in the pixel grid should be reflected in equal deformations of the lens grid. Notice that p,q=0 but not necessarily p′,q′=0 as we do not require x,y=0. Similarly |p|=|q| but not necessarily |p′|=|q′|.
For the purposes of this description, regions are defined Pn,m for integer values n and m. These regions consist of multiple circles, themselves organized on a grid of circles.
Such a region is defined by:
The p-v term specifies the length of the vector from v top and thus the inequality defines a set of circles with a center defined by v. v is itself a set of vectors defined by the set of L terms. This has a discrete number of members as a result of the conditions placed on the integer values which make up the two dimensional vectors i and j.
Here rn,m=r0n−γ is the radius of each circle. This radius thus decreases with increasing n. n,m defines the set of centers, and i, i denotes the inner product, such that when i=[i j]T then i,i=i2+j2. We also define the shorthand Pn=Pn,n. Note that there are integers k for which there are no possible combinations of integers i and j for which j,j=k holds. As a consequence, the P3, P6 and P7 sets are empty.
As an example, the set P5 can be explored starting with 5,5.
With i∈2 we indicate all i=[i j]T where i and j are integers (negative, zero or positive). The set of solutions to j∈2j,j=5 is:
There is a graphical explanation of j and j/n as Gaussian integers and the reciprocal lattice thereof respectively shown in
Each point in
Any combination
from the set of solutions for j shown above is in 5,5. Two examples are
The region P5 then consists of circular regions with those centers and radius r5=r05−γ. Note that there are eight P5 circles around each P1 circle because there are eight solutions to j∈2j,j=5.
In order to minimize the problems of banding for rotatable displays with pixels on an approximately square grid a display design is presented in which an array of view forming arrangements (typically a micro-lens array) forms a square grid that can be described by the direction p in terms of pixel coordinates where p is chosen outside of regions Pn that give rise to banding.
To analyze the banding problem, two models have been used. The first model is based on an analysis of the spatial frequencies in both the pixel structure and the lens structure and the second one is based on ray tracing.
The first model uses moiré equations and a visibility function to estimate the amount of visible banding for a given pitch vector p.
This model results in a map such as
As a consequence of the PSF scaling more banding components are visible for smaller |p| (in the top left part of
The invention is based in part of the recognition that most of the structure in this banding map can be explained using the Pn areas where Pn with higher n correspond to smaller areas. Most of the areas with significant banding are explained by P1 . . . P8.
By fitting a radius r0=0.35 and γ=0.75 to this map, the image shown in
In
The invention is based on avoiding the zones that give rise to banding, namely avoiding certain ranges of values of the vector p=(px,py).
The first zones to avoid are the regions P1 (i.e. P1,1) which give rise to the greatest banding. In
The zones to exclude when designing the relationship between the pixel grid and the lens grid are:
1. p∉P1 with radius r0=0.25 and γ=0.75,
2. As directly above and also p∉P2,
3. As directly above and also p∉P4,
4. As directly above and also p∉P5,
5. As directly above and also p∉P8,
6 Any of the above but with radius r0=0.35.
Within the space that is left by excluding the regions, there are some regions that are of particular interest because banding is especially low for a wide range of parameters. These regions are:
1. p∈P9,18 with radius r0=0.35,
2. p∈P14,26 with radius r0=0.35.
Preferably, sub-pixels are on a square grid but small variations are possible.
The aspect ratio is preferably limited to 2/3≦a≦3/2, or more preferably to 5/6≦a≦6/5. The sheer of the grid from a square/rectangle to a rhombus/parallelogram is preferably to |θ−90°|≦20°, or even to |θ−90°|≦5°.
An alternative for moiré equations to illustrate the invention is to ray trace a model of a display with a lens that displays a fully white image.
A patch such as shown in
In this perceptual color space the L2 distance between two color values (denoted ΔE below) is indicative of the perceived difference between those colors.
The target is white corresponding to (L*, a*, b*)=(100, 0, 0).
In
In
Depending on the situation ΔE≈1 is just visible. The banding-free example in
Because the display uses a 2D microlens array, the lens phase itself is also 2D.
The plots can be summarized by taking the root-mean-square (RMS) value of ΔE over the entire phase space.
In the table below, this has been done for a list of points that correspond to regions that according to the banding model explained above should be excluded or included.
From this table it is clear that the two models are largely consistent in terms of banding prediction. The positive areas have low ΔERMS values, and the biggest negative areas (with lowest ordinals) have the highest ΔERMS values.
The first model above provides an overview of the banding effect, while the second model provides more details and visualization.
The invention is applicable to the field of autostereoscopic 3D displays, more specifically to full-parallax rotatable multi-view auto-stereoscopic displays.
The invention relates to the relationship between the pixel grid and the lens grid. It can be applied to any display technology.
Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.
Number | Date | Country | Kind |
---|---|---|---|
14200328.4 | Dec 2014 | EP | regional |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2015/080383 | 12/18/2015 | WO | 00 |