The present disclosure relates to a display device.
Patent Literature (PTL) 1 discloses a head-mounted light-field display system having two light-field projectors, each including a solid-state light emission diode (LED) emitter array operatively coupled to a microlens array. The two light-field projectors correspond to respective human eyes. The solid-state LED emitter array and the microlens array are positioned such that light emitted from an LED of the solid-state LED emitter array reaches the eye through at most one microlens from the microlens array. The solid-state LED emitter array physically moves with respect to the microlens array to mechanically multiplex the solid-state LED emitters to achieve resolution via mechanically multiplexing.
PTL 1 is Japanese Translation of PCT International Application No. 2015-521298.
The present disclosure is accomplished in view of the abovementioned conventional circumstances, and an object thereof is to provide a display device that improves display reproducibility by reducing optical crosstalk to adjacent optical elements in an optical element array in which a plurality of optical elements is arrayed and by suppressing blurring or generation of a double image of a stereoscopic image to be reproduced.
The present disclosure provides a display device including: a display unit including a plurality of pixels that is arrayed; an optical element array arranged in parallel with a light exit surface of the display unit and including a plurality of optical elements that is arrayed; and a controller that controls a pixel among the plurality of pixels to be non-lighting, the pixel overlapping a boundary portion between adjacent optical elements among the plurality of optical elements in a facing direction in which the display unit and the optical element array face each other.
According to the present disclosure, it is possible to improve display reproducibility by reducing optical crosstalk to adjacent optical elements in an optical element array in which a plurality of optical elements is arrayed and by suppressing blurring or generation of a double image of a stereoscopic image to be reproduced.
In the light field projector based on the microlens array in PTL 1, the microlens array includes multiple microlenses which are arrayed. In the solid-state LED emitter array, when an original image is displayed, unnecessary light is generated because light of each pixel is not unidirectional. For example, when each pixel emits light by an LED corresponding to the entire region of the light receiving surface of each microlens, light emitted from the outermost LED goes beyond the boundary portion with the adjacent microlens and enters the adjacent microlens. In this case, since the LED that is the light emission source is reconstructed such that the light beam exits from each position in the depth direction of the stereoscopic image, the light beam leaks to the adjacent microlens as interference light of light beams that reconstruct the stereoscopic image. That is, an optical crosstalk occurs. This optical crosstalk causes blurring or a double image when a stereoscopic image of a reproduction target (for example, an object or a person to be displayed) is displayed, leading to deterioration in display reproducibility.
In view of this, the following exemplary embodiment will describe an example of a display device that improves display reproducibility by reducing optical crosstalk to adjacent optical elements in an optical element array in which a plurality of optical elements is arrayed and by suppressing blurring or generation of a double image of a stereoscopic image of a reproduction target.
The exemplary embodiment that specifically describes a display device according to the present disclosure will be described below in detail with reference to the drawings as appropriate. However, unnecessarily detailed description may be omitted. For example, detailed descriptions of already known matters and duplicated descriptions of substantially identical configurations may be omitted. This is to avoid the following description from being unnecessarily redundant and to help those skilled in the art to easily understand the following description. Note that the attached drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter set forth in the appended claims.
Display unit 13 includes, for example, a color liquid crystal display (LCD). Display unit 13 displays a three-dimensional image including stereoscopic image 19 (see
Note that display unit 13 is not limited to include the LCD described above, and may include, for example, a cathode ray tube, a light emission diode (LED) display, a plasma display, an organic electroluminescence (EL), an inorganic EL, a hologram printed matter, etc.
The optical element array is arranged in parallel with a light exit surface of display unit 13. A plurality of optical elements is arrayed in the optical element array. The optical element array is, for example, microlens array 23 in which microlenses 21 as a plurality of optical elements are arrayed. Each microlens 21 is formed in, for example, a square shape. Microlenses 21 each having square outline 25 are linearly arranged vertically and horizontally in a square array. The effective area of microlens array 23 is substantially the same as the area of display unit 13.
In display device 11, as illustrated in
Controller 15 includes a processor such as a central processing unit (CPU), a micro processing unit (MPU), a digital signal processor (DSP), or a field-programmable gate array (FPGA). Controller 15 functions as a controller that controls the operation of display device 11, and performs control processing for centrally controlling the operation of each component of display device 11, processing for exchanging data between the components of display device 11, processing for computing (calculating) data, and processing for storing data. Controller 15 operates according to a program stored in storage 17 such as a memory, thereby being capable of implementing the functions of directional image generator 33 and display controller 35. While operating, controller 15 may access storage unit 17 described above to temporarily store data generated or acquired by controller 15 in the memory (not illustrated).
Directional image generator 33 calculates and creates a directional image (that is, a three-dimensional image of a reproduction target that is to be reproduced by display unit 13) to be displayed on display unit 13 on the basis of information from a camera that has captured object 37 (see
Display controller 35 has a function of aligning microlens 21 and lighting pixel 39 on the basis of the directional image generated by directional image generator 33. That is, display controller 35 adjusts a display position (that is, adjusts the position of lighting pixel 39 and the position of non-lighting pixel 41) such that boundary portion 31 between microlenses 21 and lighting pixel 39 do not overlap each other along a facing direction in which they face each other (that is, a direction perpendicular to a display surface of display device 11 (planar view direction)) (the same applies hereinafter). In this alignment, for example, at least one of horizontal movement, vertical movement, adjustment of a display angle, or scaling of an image is performed. In order to prevent pixel 27 to be lighted from overlapping boundary portion 31 between adjacent microlenses 21, display controller 35 controls to be non-lighting pixel 27 corresponding to at least boundary portion 31 (in other words, pixel 27 overlapping boundary portion 31 along the facing direction). Here, the term “at least” includes meaning that a part of pixel 27 located closer to an optical axis with respect to boundary portion 31 in the optical element may be further controlled to be non-lighting. Note that this alignment function also produces a secondary effect of eliminating the need for alignment between the optical element and display unit 13.
Storage 17 includes, for example, a random access memory (RAM) and a read only memory (ROM), and temporarily stores a program (control data) necessary for the execution of the operation of display device 11 and data generated or acquired during operation. The RAM is, for example, a work memory used while display device 11 is in operation. The ROM stores and holds, for example, a program for controlling display device 11 in advance. For example, storage 17 stores not only the control data described above but also image data to be described later.
Next, first to seventh modifications of display device 11 according to the exemplary embodiment will be described.
Next, a function of display device 11 according to the exemplary embodiment will be described.
Display device 11 according to the exemplary embodiment includes: display unit 13 in which multiple pixels 27 are arrayed in a matrix; the optical element array which is arranged in parallel with the light exit surface of display unit 13 and in which the plurality of optical elements is arranged; and controller 15 that controls pixel 27 among the plurality of pixels 27 to be non-lighting, pixel 27 overlapping at least boundary portion 31 between adjacent optical elements among the plurality of optical elements so as to prevent pixel 27 to be lighted from overlapping boundary portion 31.
That is, in display device 11, display unit 13 and microlens array 23 are used to control the direction of light beams, by which the light beams are reconstructed. The position and direction of the light beams emitted from displayed object 37 are reproduced. At this time, the parallax, the focus adjustment, and the convergence match. As a result, the shape, brightness, color, and texture of object 37 according to the viewing angle are reproduced. Thus, natural display like real object 37 is possible.
The optical element array includes multiple optical elements which are arrayed. Examples of the optical element include a microlens and a pinhole. In display unit 13, when an original image is displayed, unnecessary light may be generated because light of each pixel 27 is not unidirectional. For example, when each pixel 27 emits light by light emitter 29 corresponding to the entire region of the light receiving surface of each microlens 21, the light emitted from outermost pixel 27 goes beyond boundary portion 31 with adjacent microlens 21 and enters adjacent microlens 21. In this case, since pixel 27 that is the light emission source is reconstructed such that the light beam exits from each position in the depth direction of stereoscopic image 19, the light beam leaks to adjacent microlens 21 as interference light of light beams that reconstruct stereoscopic image 19. That is, an optical crosstalk occurs. This optical crosstalk causes blurring of stereoscopic image 19 or generation of a double image of stereoscopic image 19 when stereoscopic image 19 is displayed.
Therefore, in display device 11, controller 15 has a function of aligning the optical element and lighting pixel 39. In this alignment, the display position of the image is adjusted such that boundary portion 31 between the optical elements and lighting pixel 39 do not overlap each other along the facing direction. In this alignment function, pixel 27 overlapping at least boundary portion 31 between the adjacent optical elements along the facing direction is controlled to be non-lighting by controller 15.
The left column of the table represents level 1 in which viewing range 55 is the maximum, that is, identical to the area inside outline 25 of microlens 21. The middle column of the table represents level 2 in which viewing range 55 is smaller than that in level 1. The right column of the table represents level 3 in which viewing range 55 is smaller than that in level 2.
When the pixels at the positions overlapping boundary portions 31 are controlled to be non-lighting by controller 15, the pixels inside and along the contour of the optical element form a non-lighting pixel group which is annular and controlled to be non-lighting. That is, a lighting pixel group is surrounded by the non-lighting pixel group. The lighting pixel group surrounded by the non-lighting pixel group forms viewing range 55. When there is no non-lighting pixel group, viewing range 55 corresponds to an area of one optical element.
In viewing range 55, lighting pixels 39 are separated from boundary portions 31 toward the optical axis due to the non-lighting pixel group being provided, whereby interference light that causes the optical crosstalk in which light beams leak to the adjacent optical element is suppressed. As a result, in display device 11, blurring of stereoscopic image 19 or generation of a double image of stereoscopic image 19 is suppressed, whereby the image quality (in other words, display reproducibility of stereoscopic image 19) is improved.
Therefore, according to display device 11 of the exemplary embodiment, it is possible to reduce blurring of stereoscopic image 19 or the generation of a double image of stereoscopic image 19 by suppressing the optical crosstalk to the adjacent optical element of the optical element array in which the plurality of optical elements is arrayed.
When the region of the non-lighting pixel group is small, the effect of suppressing the interference light is reduced, and blurring of stereoscopic image 19 or a double image of stereoscopic image 19 is likely to occur. On the other hand, when the region of the non-lighting pixel group is too large, an easily viewable and clear image can be obtained, but the viewing angle is narrowed, so that the stereoscopic effect is deteriorated. The non-lighting pixel group, that is, viewing range 55, has a trade-off relationship between the level of image quality and the size of viewing angle. Viewing range 55 can be appropriately set according to the use of display device 11 or the like.
Note that controller 15 may control the non-lighting of boundary portion 31 by the alignment function by directional image generator 33 in advance. In this case, display controller 35 executes fine adjustment for further controlling to be non-lighting a part of pixels 27 located closer to the optical axis with respect to boundary portion 31. By such controlling to be non-lighting, display controller 35 can perform fine adjustment for turning lighting pixel 39 that overlaps boundary portion 31 due to deviation from a design value into non-lighting pixel 41 at the time of bonding display unit 13 and the optical element array.
Furthermore, in display device 11, the arrangement direction of pixels 27 and the arrangement direction of microlenses 21, which are optical elements, are not parallel to each other.
In display device 11, the arrangement direction of pixels 27 and the arrangement direction of the optical elements are not parallel to each other. In display unit 13, a plurality of pixels 27 is arranged in a square array in a matrix (in a lattice).
On the other hand, in the optical element array, the plurality of optical elements is also arranged in a square array in a matrix, for example. In this case, pixels 27 arranged in a square array in display unit 13 and the optical elements arranged in a square array in the optical element array have two periodic intensity distributions. When these two periodic intensity distributions are overlapped, a coarse striped moire occurs at the intersection line of the periods.
Furthermore, in display unit 13, a black stripe (an example of a light shielding part) for increasing contrast may be provided along either the vertical direction or the horizontal direction for each of the plurality of pixels 27. In this case, the moire becomes more noticeable.
In view of this, in display device 11, the arrangement direction of pixels 27 and the arrangement direction of the optical elements are not parallel to each other, so that, even if two periodic intensity distributions are overlapped, the line of intersection of the periods is less likely to be generated. This non-parallel state can be obtained, for example, by rotating the optical element array at a predetermined angle around a rotation center perpendicular to the surface of display unit 13 with respect to display unit 13. Accordingly, moire is suppressed.
In addition, in display device 11, the optical element array is microlens array 23 in which microlenses 21 as a plurality of optical elements are arrayed.
In display device 11, a plurality of pixels 27 arranged vertically and horizontally with a period of RGB in the horizontal direction is arranged inside outline 25 of one microlens 21. The pixel corresponding to boundary portion 31 between adjacent microlenses 21 (in other words, pixel 27 that overlaps boundary portion 31 in a three-dimensional manner) is turned into non-lighting pixel 41 under the control of controller 15. Light beams emitted from lighting pixels 39 surrounded by outline 25, that is, from lighting pixels 39 in viewing range 55, are refracted by microlens 21. As a result, the direction of light beams is controlled by the positional relationship between each pixel 27 and microlens 21, and therefore, light beams emitted from object 37 are reconstructed.
Accordingly, by using microlens array 23 provided with the plurality of microlenses 21 as the optical element array, most of light beams entering microlens array 23 can be concentrated at one point, so that an amount of light can be increased.
In addition, in display devices 11F and 11G according to the sixth and seventh modifications, the optical element arrays are pinhole arrays 49 and 49G in which pinholes 47 and 47G, which are a plurality of optical elements, are arrayed.
In display devices 11F and 11G, a light flux having an extremely small diameter among light beams emitted from lighting pixels 39 surrounded by outlines 25F and 25G, that is, from lighting pixels 39 in viewing ranges 55, is emitted in one direction without being refracted by passing through pinholes 47 and 47G. That is, pinholes 47 and 47G have no focal point. The light beams emitted from lighting pixels 39 are inverted by 180° so as to correspond to the position of each light emitter 29 by passing through pinholes 47 and 47G. As a result, the direction of light beams is controlled by the positional relationship between respective pixels 27 and pinholes 47 and 47G, and therefore, light beams emitted from object 37 are reconstructed.
Accordingly, by using pinhole arrays 49 and 49G including the plurality of pinholes 47 and 47G as the optical element array, each light beam emitted from lighting pixel 39 is emitted in one direction unlike microlens array 23 that refracts the light beam to the focal point, so that it is possible to display stereoscopic image 19 without blur regardless of distance.
In addition, in display devices 11B and 11C according to the second and third modifications, the microlens serving as the optical element is cylindrical lens 43.
Cylindrical lens 43 can efficiently split, collect, and scatter light beams. By arranging cylindrical lenses 43 such that their generating lines coincide with the vertical direction, it is possible to display a plurality of parallax images with a relatively simple lens structure as compared with microlenses 21 arranged in a square array.
In addition, in display devices 11D, 11E, and 11G according to the fourth, fifth, and seventh modifications, the optical elements of the optical element array are arranged in a hexagonal array.
In this case, each optical element may have a polygonal shape (rectangular shape, hexagonal shape, etc.) or a circular shape. When each optical element has, for example, a hexagonal shape in the hexagonal array, boundary portions 31D and 31G between the adjacent optical elements on six sides share the respective sides of the hexagon, whereby the optical elements can be arrayed without any gap. As a result, the use efficiency of light emitted from each pixel 27 can be enhanced. In addition, the occurrence of moire can be easily suppressed as compared with the square array.
In addition, in display device 11, light emitter 29 is provided in display unit 13 so as to emit a light beam at an angle smaller than an emission angle of the light beam determined by the focal length of the optical element.
In display device 11, microlens 21, which is an optical element, is arranged at a distance substantially equal to the focal length of microlens 21 from light emitter 29. In this case, light emitter 29 is set to emit a light beam at an angle smaller than the original emission angle of the light beam from light emitter 29 emitted from microlens 21. More specifically, outside pixels 27 are turned into non-lighting pixels 41 with the optical axis of microlens 21 as the center. As a result, light emitter 29 emits a light beam at an angle smaller than the original emission angle of the light beam from light emitter 29. When microlens 21 is projected on display unit 13, outside pixels 27 are located inside and along outline 25 of microlens 21.
When pixel 27 overlaps outline 25 of microlens 21, this pixel 27 is also included in non-lighting pixel 41 at a position along and inside outline 25. That is, display device 11 may further control to be non-lighting a part of pixels 27 located closer to the optical axis with respect to boundary portion 31 between microlenses 21.
The lighting pixel group surrounded by the non-lighting pixel group forms viewing range 55 described above. In viewing range 55, lighting pixels 39 are separated from boundary portions 31 toward the optical axis due to the non-lighting pixel group being provided as described above, whereby interference light that causes the optical crosstalk in which light beams leak to the adjacent optical element is suppressed. As a result, in display device 11, blurring or the generation of a double image of stereoscopic image 19 are suppressed.
While various exemplary embodiments have been described above with reference to drawings, it is obvious that the present disclosure is not limited thereto. It is obvious to those skilled in the art that various modification examples, alteration examples, substitution examples, addition examples, deletion examples, and equivalent examples could be conceived of within the scope of claims, and thus it is obviously understood that those examples belong to the technical scope of the present disclosure. Further, the constituent elements in the various exemplary embodiments described above may be combined as needed without departing from the gist of the present invention.
The present disclosure is useful as a display device that improves display reproducibility by reducing optical crosstalk to adjacent optical elements in an optical element array in which a plurality of optical elements is arranged and by suppressing blurring or generation of a double image of a stereoscopic image to be reproduced.
Number | Date | Country | Kind |
---|---|---|---|
2019-103273 | May 2019 | JP | national |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2020/019157 | May 2020 | US |
Child | 17537138 | US |