An embodiment described herein relates generally to a stereoscopic image display device, an image processing device, and an image processing method.
Stereoscopic image display devices enable viewers to view stereoscopic images with the unaided eye and without having to put on special glasses. In such a stereoscopic image display device, a plurality of images having mutually different viewpoints (a plurality of parallax images) is displayed, and the light beams coming out from the images are controlled using a light beam control element such as a parallax barrier or a lenticular lens. The controlled light beams are then guided to both eyes of a viewer, thereby enabling him or her to recognize stereoscopic images. Herein, the area within which the viewer is able to view stereoscopic images is called a visible area.
Conventionally, a technology is known in which the visible area is varied dynamically by varying the pitch of the apertures that are formed in the light beam control element with the aim of emitting the light beams coming out from the pixels toward a predetermined direction.
However, in the conventional technology, it is not possible to vary the distance between the light beams (i.e., the light beam interval) in each parallax image. For that reason, if a viewing distance, which indicates the distance between a stereoscopic image display device and a viewer, is large; then, at the position that is away from the stereoscopic image display device by a distance equal to the viewing distance, the light beam interval exceeds a value (such as the interocular distance) that enables the viewer to view stereoscopic images. Therefore, the stereoscopic images cannot be viewed.
According to an embodiment, a stereoscopic image display device includes a display, a determiner, a generator, and a display controller. The display is configured to display a stereoscopic image which includes a plurality of parallax images having mutually different parallaxes. The determiner is configured to determine the number of parallaxes in such a way that, the larger a viewing distance from the display to a viewer, the smaller becomes the interval between light beams which belong to each of the parallax images and which are emitted from the display. The generator is configured to generate the parallax images in number corresponding to the number of parallaxes. The display controller is configured to display the parallax images on the display.
An exemplary embodiment of a stereoscopic image display device, an image processing device, and an image processing method according to the invention is described below in details with reference to the accompanying drawings.
In a stereoscopic image display device 1 according to an embodiment, a plurality of parallax images having mutually different parallaxes are displayed so as to enable a viewer to view stereoscopic images. Herein, in the stereoscopic image display device 1, it is possible to implement a 3D display method such as the integral imaging method (II method) or the multi-view method. Examples of the stereoscopic image display device 1 include a TV, a PC, a smartphone, or a digital photo frame that enables a viewer to view a stereoscopic image with the unaided eye.
The display 20 is a device capable of displaying a stereoscopic image that includes a plurality of parallax images having mutually different parallaxes. As illustrated in
The parallax images are images constituting a stereoscopic image and are used in enabling a viewer to view the stereoscopic image. In a stereoscopic image, the pixels of each parallax image are assigned in such a way that, when a viewer views the display element 21 from his or her viewing position and through the light beam control element 22, a particular parallax image is seen to one eye of the viewer and another parallax image is seen to the other eye of the viewer. That is, the stereoscopic image is generated by rearranging the pixels of each parallax image. Meanwhile, in a parallax image, a single pixel includes a plurality of sub-pixels.
The display element 21 is a liquid crystal panel in which a plurality of sub-pixels having different colors (such as R, G, and B) is arranged in a matrix-like manner in a first direction (the row direction) and a second direction (the column direction). Alternatively, the display element 21 can be a flat-panel display such as an organic EL panel or a plasma panel. Moreover, the display element 21 illustrated in
The light beam control element 22 controls the direction of the light beam that is emitted from each sub-pixel of the display element 21. The light beam control element 22 has a plurality of linearly-extending optical apertures arranged in the first direction for the purpose of emitting light beams. In the example illustrated in
Firstly, prior to giving the specific details of the controller 10, the explanation is given about the condition that enables making changes in the light beam interval. Herein, the light beam interval is determined according to the optical apertures (in the example given in the embodiment, a lens (a cylindrical lens)) and the pixel pitch. As illustrated in
Herein, if the light beam control element 22 is placed in such a way that the extending direction of the lens is parallel to the column direction of the display element 21 (i.e., if the light beam control element 22 is placed perpendicular to the display element 21), then the light beam interval gets uniquely determined with respect to the pixel pitch. However, if the light beam control element 22 is placed at a tilt with respect to the display element 21, then the light beam interval may vary depending on the angle representing the relative tilt of the light beam control element 22 with respect to the display element 21 (in this example, the angle made by the second direction of the display element 21 with the extending direction of the lens).
Explained below with reference
In the example illustrated in part (a) of
In contrast, in the example illustrated in part (b) of
In the example illustrated in part (c) of
As illustrated in
Then, the number of light beams per line/per pixel can be acquired as px/pslant=a tan/3.
Herein, such a T for which pslant×T is an integer (or a value closer to an integer) is called a maximum cycle. Moreover, the number of light beams NL is the result of multiplying the minimum number of lines of pixels (hereinafter, called “the number of vertical lines”) y3d, which is required to display parallax images in number corresponding to the number of parallaxes that is set, by the number of pixels Xn in the width direction (the first direction) under the lens. Thus, the number of light beams NL can be expressed as Expression (2) given below.
N
L
=X
n
×y
3d (2)
Herein, the number of vertical lines y3d falls in the range of 1≦y3d≦T. In the example illustrated in part (a) of
In the example illustrated in part (b) of
In the example illustrated in part (c) of
Meanwhile, as illustrated in
W=(D×Xn×px)/g (3)
If the visible width W is divided by the number of light beams NL, then a light beam interval r at the viewing distance D is acquired. Herein, the light beam interval r at the viewing distance D can be expressed using Expression (4) given below,
R=W/N
L
=Dpx/gy
3d (4)
That is, larger the number of vertical lines y3d (larger the number of parallaxes that is set), smaller becomes the light beam interval r.
Given below are the specific details of the controller 10.
The first acquirer 11 acquires tilt information that indicates the relative tilt between the display element 21 and the light beam control element 22. In the embodiment, as the tilt information, the first acquirer 11 acquires the a tan mentioned above. However, that is not the only possible case. For example, a as the tilt information, the first acquirer 11 can acquire information related to the angle indicating the tilt of the light beam control element 22 (for example, the angle made between the second direction of the display element 21 and the extending direction of the lens) or can acquire information related to the dimensions of the pixels and the lens. In essence, as long as the first acquirer 11 acquires information that indicates the relative tilt between the display element 21 and the light beam control element 22, it serves the purpose. Meanwhile, the method of acquiring the tilt information can be arbitrary. For example, the first acquirer 11 can access an external device and acquire the tilt information from the external device. Alternatively, for example, the first acquirer 11 can access a memory in which the tilt information is stored, and read the tilt information from the memory.
The second acquirer 12 acquires the viewing distance D mentioned above. The method of acquiring the viewing distance D can be arbitrary. For example, an imaging device such as a camera can be attached to the display 20, and the second acquirer 12 can receive an image captured by the imaging device and calculate the viewing distance based on the image. For example, the face position of a viewer appearing in a captured image can be detected, and the viewing distance D can be calculated from the detected face position. Alternatively, for example, the second acquirer 12 can receive a specified input of the viewing distance D from a viewer or an operator, and accordingly acquire the viewing distance D. Sill alternatively, for example, the second acquirer 12 can access an external device and acquire the viewing distance D from the external device, or can access a memory in which the viewing distance D is stored and read the viewing distance from the memory.
The determiner 13 determines the number of parallaxes in such a way that, larger the value of the viewing distance D acquired by the second acquirer 12, smaller is the distance between the light beams of each parallax image that are emitted from the display 20 (i.e., smaller is the light beam interval). More particularly, the determiner 13 determines the number of parallaxes in such a way that, larger the value of the viewing distance D acquired by the second acquirer 12, larger becomes the number of parallaxes. The details of the determiner 13 are given later.
The generator 14 generates parallax images in number corresponding to the number of parallaxes determined by the determiner 13. More particularly, the generator 14 generates a required number of parallax images based on an input image that is input from the outside and based on the number of parallaxes that is determined by the determiner 13. For example, in the case of generating N (N≧2) number of parallax images; as illustrated in
As an example, explained below with reference to
Returning to the explanation with reference to
In Expression (6), koffset represents the positional shift between an image and the lens, and the unit thereof is pixels. In the example illustrated in
The parallax number v is a continuous value. However, since the parallax images are discreet in nature, the parallax number v cannot be assigned as it is to a parallax image. In that regard, linear interpolation or three-dimensional interpolation is performed. In this way, the display controller 15 displays the parallax images, which are generated by the generator 14, on the display 20.
Given below is the explanation of the details of the determiner 13. In the embodiment, the determiner 13 determines the number of parallaxes based on the tilt information, which is acquired by the first acquirer 11, and the viewing distance D, which is acquired by the second acquirer 12. Following are the specific details. Using the tilt information, which is acquired by the first acquirer 11, and the viewing distance D, which is acquired by the second acquirer 12; the determiner 13 calculates the light beam interval r at the position that is away from the display 20 by a distance equal to the viewing distance D. More particularly, from the tilt information (in this example, a tan) acquired by the first acquirer 11, the determiner 13 acquires the supposed number of vertical lines y3d. Then, using the number of vertical lines y3d and the viewing distance D acquired by the second acquirer 12, the determiner 13 acquires the light beam interval r=Dpx/gy3d (see Expression (4) given above) at the position that is away from the display 20 by a distance equal to the viewing distance D.
Herein, at the position of the viewing distance D, in order to ensure that a viewer is able to view stereoscopic images, the light beam interval r at the viewing distance D needs to be equal to or smaller than a reference value that is set to enable viewers to view stereoscopic images. As an example, in the embodiment, an interocular distance b representing the distance between the eyes of viewers is used as the reference value. In this example, the determiner 13 holds in advance the value of the interocular distance b, and determines the number of parallaxes in such a way that the light beam interval r at the viewing distance D is equal to or smaller than the interocular distance b. The condition for which the light beam interval r at the viewing distance D becomes equal to or smaller than the interocular distance b can be expressed using Expression (5) given below.
Dpx/gy
3d
≦b (5)
As described above, the number of vertical lines y3d falls in the range of 1≦y3d≦T. The determiner 13 determines the number of vertical lines y3d in such a way that, within the abovementioned range, y3d≧Dpx/gb that is a modification of Expression (5) given above is satisfied. If a plurality of numbers of vertical lines y3d satisfies the condition, then the determiner 13 selects the smallest number of vertical lines y3d. Then, the number of parallaxes (the number of light beams NL)=Xn×y3d can be determined using the selected number of vertical lines v3d.
Herein, the explanation is given for an example in which the tilt information a tan=6 (as illustrated in part (b) of
On the other hand, in this example, if the viewing distance D1 is equal to or larger than the predetermined value, then y3d≧D1px/gb is satisfied only when the number of vertical lines y3d is “2”. Hence, the determiner 13 selects the number of vertical lines y3d of “2” and determines the number of parallaxes. In this case, the number of parallaxes becomes 2×3=6. In this case, for example, as illustrated in
As described above, in the embodiment, the number of parallaxes is determined in such a way that, larger the viewing distance D, smaller becomes the light beam interval r. Hence, even if the viewing distance D is large, it becomes possible to prevent a situation in which the light beam interval r at the viewing distance D exceeds the value that enables viewers to view stereoscopic images. That is, according to the embodiment, a stereoscopic image display device can be provided that, even if the viewing distance is large, enables a viewer to view stereoscopic images.
In the embodiment described above, the light beam control element 22 is placed at a tilt with respect to the display element 21. However, that is not the only possible case. Alternatively, for example, the light beam control element 22 can be placed in such a way that the extending direction of the optical apertures thereof is parallel to the second direction (the column direction) illustrated in
Meanwhile, the controller 10 according to the embodiment described above has the hardware configuration that includes a CPU (Central Processing Unit), a ROM, a RAM, and a communication I/F device. Herein, the functions of each of the abovementioned constituent elements are implemented when the CPU loads programs, which are stored in the ROM, in the RAM and executes those programs. However, that is not the only possible case. Alternatively, at least some of the functions of the constituent elements can be implemented using individual circuits (hardware). For example, at least the determiner 13, the generator 14, and/or the display controller 15 may be configured from a semiconductor integrated circuit.
Meanwhile, the programs executed in the controller 10 according to the embodiment described above can be saved as downloadable files on a computer connected to the Internet or can be made available for distribution through a network such as the Internet. Alternatively, the programs executed in the controller 10 according to the embodiment described above can be stored in advance in a ROM or the like.
Alternatively, some or all of the functions of the abovementioned constituent elements can be realized by both software and hardware.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiment described herein may he embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiment described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
This application is a continuation of PCT international application Ser. No. PCT/JP2011/076288 filed on Nov. 15, 2011 which designates the United States; the entire contents of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2011/076288 | Nov 2011 | US |
Child | 14208726 | US |