Patent Application
20190035364
The present disclosure relates to a display apparatus, a method of driving the display apparatus, and an electronic apparatus.
There may be a case where it is desired to change a size of a display image on, for example, a display apparatus installed in a mobile electronic apparatus so as to easily view the display image. As an example of technologies for changing the size of the display image, there is a technology described in Patent Document 1.
According to the technology described in Patent Literature 1, an information communication terminal contains, within its casing, a part of a flexible display that has substantially rectangular sheet-like shape and is bendable and flexible. According to this technology, a size of a display surface is changed when necessary by exposing the part contained within the casing to the outside of the casing.
Patent Literature 1: Japanese Patent Application Laid-open No. 2010-178188
In a configuration employed in this related art described in Patent Document 1, a display unit is formed of the flexible display, and the size of the display unit (display screen) itself is mechanically changed. Thus, a mechanism for changing the size of the display surface is needed, resulting in structural complications.
In view of such circumstances, the present technology has been made to achieve an object to provide a display apparatus capable of changing a size of a display image without mechanically changing a display surface itself, a method of driving the display apparatus, and an electronic apparatus including the display apparatus.
In order to achieve this object, according to the present disclosure, there is provided a display apparatus including:
a display unit in which apertures are arranged in units of a plurality of adjacent pixels including a left-eye pixel and a right-eye pixel;
a signal processing unit that generates image information items with respect to the left-eye pixel and the right-eye pixel, respectively, such that an image is presented with an aspect ratio different from an aspect ratio of a display surface of the display unit; and
a display control unit that drives the left-eye pixel and the right-eye pixel on a basis of the image information items generated by the signal processing unit. Further, in order to achieve the above-mentioned object, according to the present disclosure, there is provided an electronic apparatus including the display apparatus having the above-described configuration.
In order to achieve the above-described object, according to the present disclosure, there is provided a method of driving a display apparatus, the display apparatus including a display unit in which apertures are arranged in units of a plurality of adjacent pixels including a left-eye pixel and a right-eye pixel, the method including:
generating image information items with respect to the left-eye pixel and the right-eye pixel, respectively, such that an image is presented with an aspect ratio different from an aspect ratio of a display surface of the display unit; and
driving the left-eye pixel and the right-eye pixel on a basis of the generated image information items.
In the display apparatus having the above-described configuration, the method of driving the same, and the electronic apparatus, the left-eye pixel displays a left-eye image, and the right-eye pixel display a right-eye image. Under this display state, the apertures arranged in the units of the plurality of adjacent pixels limit traveling directions of light beams emitted from the pixels so as to control a light beam that enters a left eye of the observer and a light beam that enters a right eye of the observer. With this, it is possible to separate an image that is visible only to the left eye, and an image that is visible only to the right eye from each other. In this way, when the observer views the display unit under a state in which a line of sight of the left eye and a line of sight of the right eye are parallel to each other, the observer can recognize, in his/her brain, the left-eye image and the right-eye image as two adjacent images, that is, as a display image larger than the display surface of the display unit (display image with the aspect ratio different from the aspect ratio of the display surface of the display unit).
According to the present disclosure, it is possible to change the size of the display image with a configuration simpler than the configuration in the case where the size of the display surface itself is mechanically changed. Note that, the advantages disclosed herein are not necessarily limited to those described hereinabove, and all of the advantages disclosed herein can be obtained. Further, the advantages disclosed herein are merely examples and not limited thereto, and other advantages may be additionally obtained.
Now, embodiments for carrying out the technology of the present disclosure (hereinafter, abbreviated as “embodiments”) are described in detail with reference to the drawings. The technology of the present disclosure is not limited to the embodiments, and various numerical values or the like of the embodiment are examples. In the following description, the same components or components having the same function are denoted by the same reference symbols, and redundant description thereof is omitted. Note that, the description is made in the following order.
Example 1 (Basic Configuration of Display Unit)
Example 2 (Modification Example of Example 1/Example in Which Separators Are Provided in Pixel Units in Diffusion Layer)
Example 3 (Modification Example of Example 2/Example in Which Surfaces of Parts on Pixel Side of Diffusion Layer Are Larger than Surfaces of Parts on Aperture Side of The Same)
Example 4 (Modification Example of Example 3/Example in Which Transparent Pad Is Provided over Layer of Apertures)
Example 5 (Modification Example of Example 1/Example in Which Diffraction Grating is Provided between Pixels And Diffusion Layer)
Example 6 (Method of Forming Separators in Display Unit According to Example 1)
Example 7 (Modification Example of Display Apparatus According to First Embodiment)
Example 8 (Modification Example of Example 1 to Example 5/Example of Using Liquid-Crystal Layer)
Example 9 (Modification Example of Example 1 to Example 5/Example of Using Electrochromic Element)
3-1. Embodiment A [Example in Which Virtual-Image Presentation Position with Respect to Observer Is More Distant than Display Unit Is Distant]
Example 10 (Example of Display Apparatus on Wristwatch-Type Terminal)
Example 11 (Modification Example of Example 10)
Example 12 (Example of Display Apparatus on Mobile Terminal)
Example 13 (Example of Display Apparatus on Camera Apparatus)
Example 14 (Example in Which Virtual Image Lenses Are Formed of Fixed Focus Lenses)
Example 15 (Modification Example of Example 14)
Example 16 (Example in Which Virtual Image Lenses Are Formed of Variable Focus Lenses)
Example 17 (Modification Example of Example 16)
3-2. Embodiment B [Example in Which Virtual-Image Presentation Position with Respect to Observer Is on Side Nearer than Display Unit is Near]
Example 18 (Example in Which Virtual Image Lenses Are Formed of Fixed Focus Lenses)
Example 19 (Example in Which Virtual Image Lenses Are Formed of Variable Focus Lenses)
Example 20 (Example of Using Virtual-Image Optical System According to Second Embodiment)
Example 21 (Example of Using Virtual-Image Optical System on Basis of Principle of Reconstruction of Parallax Rays)
<General Description of Display Apparatus, Method of Driving Display Apparatus, and Electronic Apparatus According to Present Disclosure>
In the display apparatus, the method of driving the display apparatus, and the electronic apparatus according to the present disclosure, a dimension of each of the apertures may be set equivalent to or smaller than a dimension of each of the pixels. Further, the display unit may include a spacer between the apertures and the pixels. Still further, the display unit may include a diffusion layer between the apertures and the pixels.
In the display apparatus, the method of driving the display apparatus, and the electronic apparatus according to the present disclosure, which have the above-described preferred configurations, the display unit may include separators provided in pixel units in the diffusion layer. It is preferred that the separators be made of a material that absorbs visible light. Further, it is preferred that an interface between the separators and the diffusion layer be formed of an interface that reflects visible light. The diffusion layer may be partitioned into separate parts by the separators, and surfaces on the pixel side of the separate parts of the diffusion layer may be larger than surfaces on the aperture side of the separate parts of the diffusion layer.
Further, in the display apparatus, the method of driving the display apparatus, and the electronic apparatus according to the present disclosure, which have the above-described preferred configurations, the display unit may include a transparent pad over a layer through which the apertures are provided. Further, the display unit may include a diffraction grating between the pixels and the diffusion layer. Alternatively, the display unit may include a liquid-crystal layer that adjusts an intensity of light to transmit through the apertures.
Still further, in the display apparatus, the method of driving the display apparatus, and the electronic apparatus according to the present disclosure, which have the above-described preferred configurations, the display unit may be capable of selectively forming the apertures with use of an element that is capable of controlling an intensity of light to transmit therethrough. With this, it is possible to present, when forming the apertures, an image with the aspect ratio different from the aspect ratio of the display surface of the display unit, and to present, when not forming the apertures, an image with an aspect ratio equal to the aspect ratio of the display surface of the display unit. As examples of the element capable of controlling the intensity of the light to transmit therethrough, there may be mentioned an electrochromic element and a liquid-crystal element.
Alternatively, in the display apparatus, the method of driving the display apparatus, and the electronic apparatus according to the present disclosure, which have the above-described preferred configurations, the display unit may include lenses arranged in the units of the plurality of adjacent pixels including the left-eye pixel and the right-eye pixel. In addition, the signal processing unit may generate image information items with respect to the left-eye pixel and the right-eye pixel, respectively, such that a virtual image is presented with the aspect ratio different from the aspect ratio of the display surface of the display unit.
Further, in the display apparatus, the method of driving the display apparatus, and the electronic apparatus according to the present disclosure, which have the above-described preferred configurations, there may be provided a detection unit that detects positional information and orientation information of eyes of an observer with respect to the display surface of the display unit. At this time, the signal processing unit may generate the image information items with respect to the left-eye pixel and the right-eye pixel, respectively, on the basis of a result of the detection by the detection unit.
Still further, in the display apparatus, the method of driving the display apparatus, and the electronic apparatus according to the present disclosure, which have the above-described preferred configurations, the detection unit may include an imaging unit that captures an observer. In addition, the signal processing unit may constitute the detection unit cooperatively with the imaging unit, and calculate the positional information and the orientation information of the eyes of the observer with respect to the display surface of the display unit on the basis of an image of the observer captured by the imaging unit.
Yet further, in the display apparatus, the method of driving the display apparatus, and the electronic apparatus according to the present disclosure, which have the above-described preferred configurations, the detection unit may include a distance measurement unit that measures a distance between the display surface of the display unit and the eyes of the observer. At this time, the signal processing unit may use the distance measured by the distance measurement unit in the calculation of the positional information of the eyes of the observer with respect to the display surface of the display unit.
Yet further, in the display apparatus, the method of driving the display apparatus, and the electronic apparatus according to the present disclosure, which have the above-described preferred configurations, the lenses arranged in the units of the plurality of adjacent pixels may be fixed focus lenses or variable focus lenses. When the lenses arranged in the units of the plurality of adjacent pixels are the variable focus lenses, the display control unit may control focal lengths of the variable focus lenses.
The imaging unit 20 and the distance measurement unit 30 are attached integrally with the display unit 10, and constitute a part of a detection unit that detects positional information and orientation information of eyes of an observer with respect to a display surface of the display unit 10. The imaging unit 20 is constituted by a camera capable of capturing a face of the observer who observes a display image on the display unit 10, and supplies information of taken images to the signal processing unit 40.
The distance measurement unit 30 measures a distance between the display surface of the display unit 10 and the eyes of the observer, and outputs a result of the measurement as information of the distance from the display surface of the display unit 10 to the eyes of the observer. As the distance measurement unit 30, there may be used a unit configured to measure the distance between the display surface of the display unit 10 and the eyes of the observer by a time-of-flight (TOF) method of using, for example, infrared rays. Alternatively, there may be used a unit having a configuration in which another camera is provided in addition to the camera constituting the imaging unit 20 so as to measure the distance between the display surface of the display unit 10 and the eyes of the observer by a triangulation method of using the images taken by the two cameras.
The signal processing unit 40 receives the information of the image taken by the imaging unit 20, and the information of the distance measured by the distance measurement unit 30. Then, on the basis of the information of the image taken by the imaging unit 20 and the information of the distance measured by the distance measurement unit 30, the signal processing unit 40 detects the positional information and the orientation information of the eyes of the observer with respect to the display surface of the display unit 10. The positional information of the eyes of the observer include the distance between the display surface of the display unit 10 and the eyes of the observer, and a distance between a left eye and a right eye (interocular). The orientation information of the eyes of the observer includes inclination of the eyes with respect to the display unit 10, that is, inclination of a line connecting the left eye and the right eye with respect to the display unit 10.
The signal processing unit 40 performs face detection on the observer on the basis of the image information supplied from the imaging unit 20, and then specifies positions of the left eye and the right eye (hereinafter, also referred to as “left and right eyes”) on the basis of the face detection, thereby obtaining coordinate information of the left and right eyes (left-eye position (XL, YL), right-eye position (XR, YR)) in the image. After obtaining the coordinate information of the left and right eyes, the signal processing unit 40 determines a positional relationship of the left and right eyes of the observer with respect to the display unit 10 by using the coordinate information of the left and right eyes and the distance information supplied from the distance measurement unit 30.
For example, in a plane orthogonal to an axis connecting the display unit 10 and the face of the observer to each other, a relative positional relationship between the display unit 10 and the face of the observer is assumed to be inclined with respect to the axis. In this case, as illustrated in
Further, as illustrated in
Subsequently, it is possible to obtain spatial relative coordinates of the display unit 10 and the face of the observer on the basis of the positional information and the orientation information of the left and right eyes 70L and 70R within the camera image acquired by the imaging unit 20, and on the basis of the information of the distance (positional information) measured by the distance measurement unit 30.
The above-described functions of the signal processing unit 40, such as the detection of the face of the observer, the detection of the left and right eyes, the determination of the positional relationship between the left and right eyes constitute, cooperatively with the functions of the imaging unit 20 and the distance measurement unit 30, the detection unit that detects the positional information and the orientation information of the eyes of the observer with respect to the display surface of the display unit 10. Note that, even without using the distance measurement unit 30, it is possible to detect the distance between the display surface of the display unit 10 and the eyes of the observer on the basis of, for example, the distance between the left and right eyes, which is obtained from the image information from the imaging unit 20. In addition, it is possible to detect the distance between the display surface of the display unit 10 and the eyes of the observer on the basis of a lens angle and the distance between the left and right eyes of the observer. Thus, the distance measurement unit 30 is not an indispensable component. Note that, the distance between the left and right eyes differs from observer to observer, and hence it is difficult to detect the distance with high accuracy on the basis of the distance between the left and right eyes. For this reason, by using the distance measurement unit 30, it is possible to increase accuracy in the distance detection.
The signal processing unit 40 also performs calculation of image information items with respect respectively to a left-eye pixel 13L and a right-eye pixel 13R on the basis of the positional information and the orientation information of the eyes of the observer, and on the basis of the image information to be displayed such that a display image is presented with an aspect ratio different from an aspect ratio of the display surface of the display unit 10. Then, the signal processing unit 40 supplies the calculated information to the display control unit 50.
The display control unit 50 drives the left-eye pixel 13L and the right-eye pixel 13R to be described below (refer to
Now, the specific examples of the display unit 10 in the display apparatus 1A according to the first embodiment are described.
On the display unit 10, a single pixel (pixel) 11 as a unit of forming a color image is formed, for example, of three sub-pixels. The single pixel 11 includes a plurality of pixels 11 arrayed in a two-dimensional matrix in a row direction and a column direction. For example, the single pixel 11 is formed of sub-pixels in three primary colors, that is, a sub-pixel 11R including an organic EL element that emits red (R) light, a sub-pixel 11G including an organic EL element that emits green (G) light, and a sub-pixel 11B including an organic EL element that emits blue (B) light.
Note that, formation of the single pixel 11 is not limited to a combination of the sub-pixels in the three primary colors of RGB, and it is possible to form a single pixel by adding another sub-pixel in another color or other sub-pixels in a plurality of colors to the sub-pixels in the three primary colors. More specifically, it is possible, for example, to form a single pixel by adding a sub-pixel that emits white (W) light so as to increase luminance, or to form a single pixel by adding at least one sub-pixel that emits complementary color light so as to expand a color reproduction range.
The display unit 10 has a configuration in which apertures 91 are arranged in an array in units of a plurality of adjacent pixels including the left-eye pixel and the right-eye pixel, or preferably, in units of even-number pixels.
The pixel configuration according to the former specific example has an advantage of being applicable to a case where the display unit 10 is rotated within a plane including its display surface. Specifically, in a case where the display unit 10 is rotated at 90 degrees, two left-right pixels in a pair in
A diffusion layer 14 for mixing the colors of the light beams that the sub-pixels 11R, 11G, and 11B respectively emit is laminated over the sub-pixels 11R, 11G, and 11B. A spacer 92, which is made of a transparent material, for securing an interval between the sub-pixels 11R, 11G, and 11B and the apertures 91 is laminated over the diffusion layer 14. Further, the apertures 91 are formed in the units of adjacent even-number pixels including the left-eye pixel 13L and the right-eye pixel 13R through a light blocking layer 93 laminated over the sub-pixels 11R, 11G, and 11B through intermediation of the diffusion layer 14 and the spacer 92. The apertures 91 limit traveling directions of the light beams emitted from the left-eye pixel 13L and the right-eye pixel 13R so as to control a light beam that enters the left eye of the observer and a light beam that enters the right eye of the observer. With this, it is possible to separate an image that is visible only to the left eye, and an image that is visible only to the right eye from each other.
In the display apparatus 1A according to the first embodiment, which includes the above-described display unit 10 according to Example 1, by the display drive by the display control unit 50, the left-eye pixel 13L displays the left-eye image, and the right-eye pixel 13R displays the right-eye image. At this time, the signal processing unit 40 that supplies the image information to the display control unit 50 generates the image information items respectively to the left-eye pixel 13L and the right-eye pixel 13R such that an image is presented with the aspect ratio different from the aspect ratio of the display surface of the display unit 10. The display image to be presented by the display apparatus 1A according to the first embodiment, which has the aspect ratio different from the aspect ratio of the display surface of the display unit 10, is an image different from a stereoscopic image (three-dimensional image) with an aspect ratio equal to the aspect ratio of the display surface of the display unit 10.
Herein, the case where “aspect ratios are equal to each other” encompasses not only a case where the aspect ratios are exactly equal to each other, but also a case where the aspect ratios are substantially equal to each other. Therefore, a case where the aspect ratio of the stereoscopic image differs from the aspect ratio of the display surface of the display unit 10 due to presence of various types of variations generated in design or in production is encompassed in the concept of the case where “aspect ratios are equal to each other.”
When the observer views the stereoscopic image, eye lenses of the observer are focused on a position on the display surface of the display unit 10. Specifically, as illustrated in
In contrast, in the display apparatus 1A according to the first embodiment, when the observer views the display image with the aspect ratio different from the aspect ratio of the display surface of the display unit 10, as illustrated in
Under a state in which the left-eye pixel 13L displays the left-eye image and the right-eye pixel 13R displays the right-eye image, the apertures 91 provided in the units of the plurality of pixels limit the traveling directions of the light beams emitted from the pixels 13L and 13R so as to control light beams from ones of the pixels 11, which enter the left eye 70L of the observer, and to control light beams from other ones of the pixels 11, which enter the right eye 70R of the observer. With this, a display image from the left-eye pixel 13L and a display image from the right-eye pixel 13R are separated into the image that is visible only to the left eye 70L, and the image that is visible only to the right eye 70R.
In this way, when the observer views the display unit 10 side in the manner that the line of sight of the left eye 70L and the line of sight of the right eye 70R are parallel to each other, the observer can recognize, in his/her brain, a display image larger than the display surface of the display unit 10, which is separated into the left-eye image and the right-eye image. In other words, in the display apparatus 1A according to the first embodiment, the display image from the left-eye pixel 13L and the display image from the right-eye pixel 13R can be separately displayed on two left and right screens by the function of the apertures 91, and hence can be presented to the observer as a display image that is enlarged in a left-right direction to be larger than (up to twice as large as) a physical screen size of the display unit 10. With this, larger amount of information can be presented to the observer.
Further, in the configuration of the display unit 10 according to Embodiment 1, the diffusion layer 14 is provided between the sub-pixels 11R, 11G, and 11B and the diffusion layer 14. This diffusion layer 14 has the function to mix the colors of the light beams that the sub-pixels 11R, 11G, and 11B respectively emit. By the function of the diffusion layer 14, the sub-pixels 11R, 11G, and 11B can be prevented from visually recognized by the observer. With this, a display image clearer than that in the case where the sub-pixels 11R, 11G, and 11B are visually recognized can be presented to the observer.
Example 2 is a modification example of Example 1.
When the separators 94 made of the material that absorbs the visible light are provided in the pixel units within the diffusion layer 14 in this way, the colors of the pixels 11 can be prevented from being mixed with each other. Further, when the interface between the separators 94 and the diffusion layer 14 is formed of the interface that reflects the visible light, an effect of preventing the colors of the pixels 11 from being mixed with each other can be further increased.
Example 3 is a modification example of Example 2.
Also in the display unit 10 according to Example 3, as in the display unit 10 according to Example 2, it is preferred that the separators 94 be made of the material that absorbs the visible light, and that the interface between the separators 94 and the diffusion layer 14 be formed of the interface that reflects the visible light. When the surfaces on the pixel 11 side of the separate parts of the diffusion layer 14 are formed to be larger than the surfaces on the aperture 91 side of the separate parts of the diffusion layer 14, the effect of preventing the colors of the pixels 11 from being mixed with each other can be further increased by the separators 94.
Example 4 is a modification example of Example 3.
When the transparent pad 95 is provided in this way over the layer through which the apertures 91 are provided, the display unit 10 according to Example 4 can be provided as a display unit having a touchscreen structure that allows input via a screen to be touched with a fingertip or a dedicated pen similar to display apparatuses of mobile terminals such as a smartphone. Note that, although, in the configuration of this example, the touchscreen structure is provided to the display unit 10 according to Example 3, it is similarly possible to provide the touchscreen structure to the display unit 10 according to Example 1 or to the display unit 10 according to Example 2. Further, when the touchscreen structure to be used is of an in-cell type, the transparent pad 95 may be a protective layer that does not have the touchscreen structure.
Example 5 is a modification example of Example 1.
The diffraction grating 96 has a function to scatter, by diffraction, the light beams in the respective colors, which are emitted from the sub-pixels 11R, 11G, and 11B. Thus, when the diffraction grating 96 is provided between the pixels 11 (sub-pixels 11R, 11G, and 11B) and the diffusion layer 14, by the function of the diffraction grating 96, uneven color mixture in the diffusion layer 14 can be reduced. Note that, although, in the configuration of this example, the diffraction grating 96 is provided with respect to the display unit 10 according to Example 1, it is similarly possible to provide the diffraction grating 96 to the display units 10 according to Examples 2 to Examples 4.
Example 6 relates to a method of forming the separators 94 in the display unit 10 according to Example 1.
In this example, intervals between the protruding portions 97A of the die 97 are each set, for example, to approximately 30 μm to 100 μm, and a thickness of each of the protruding portions 97A is set, for example, to 10 μm or less. With this, in the diffusion layer 14, recessed portions 14A each having a width of 10 μm or less for forming the separators 94 are formed at the intervals of approximately 30 μm to 100 μm (step in
After the application of the visible-light absorbing material, residual parts of the visible-light absorbing material on a top surface of the diffusion layer 14 are removed. Note that, when a width of each of the separators 94 is set, for example, to approximately 5 μm, and a thickness of the coating over the top surface of the diffusion layer 14 is set smaller than, for example, 1 μm at a density at which the visible light can be absorbed, the visible-light absorbing material need not necessarily be removed. Further, as in the case of Example 3, in order to secure gaps between the pixels 11 such that the mixture of the colors of adjacent pixels is reduced, the separators 94 may each be formed into the inverted trapezoidal shape smaller in dimension on the pixel 11 side than on the aperture 91 side.
Example 7 is a modification example of the display apparatus 1A according to the first embodiment.
Even without the function to detect the positional information and the orientation information of the eyes of the observer with respect to the display surface of the display unit 10, the display apparatuses capable of displaying images on an enlarged scale with the function of the apertures 91 are capable of presenting the images as the display image that is enlarged in the left-right direction to be larger than the physical screen size of the display unit 10. However, when the positional information and the orientation information of the eyes of the observer are detected, and the image calculation process in the signal processing unit 40 is executed on the basis of results of the detection, more preferred display image can be presented to the observer.
Example 8 is a modification example of Example 1 to Example 5.
Example 9 is a modification example of Example 1 to Example 5.
Whether or not to form the apertures 91 can be selected by, for example, instructions from the observer via the input unit 60 shown in
In this way, when necessary, the observer can switch the image display with the aspect ratio different from the aspect ratio of the display surface of the display unit 10, and the image display with the aspect ratio equal to the aspect ratio of the display surface to each other. Note that, when the apertures 91 are not formed, images are not displayed separately for the left and right eyes. Thus, the images are displayed in a normal display mode.
Further, when the apertures 91 are formed, the images are recognized as illustrated in the schematic view of
Also in the display apparatus 1A according to the first embodiment, which includes the display unit 10 according to Example 2, Example 3, Example 4, Example 5, Example 8, or Example 9 described hereinabove, it is possible to obtain the same functions and the same advantages as those of the display apparatus 1A according to the first embodiment, which includes the display unit 10 according to Example 1. In other words, the display image from the left-eye pixel 13L and the display image from the right-eye pixel 13R can be separately displayed on the two left and right screens by the function of the apertures 91, and hence can be presented to the observer as the display image that is enlarged in the left-right direction to be larger than (up to twice as large as) the physical screen size of the display unit 10.
Now, display pixels with respect to the left eye 70L and the right eye 70R of the observer are described with reference to
As an example of device specifications of the display unit 10, the number of the pixels is assumed to be 2160×3840, and each of the apertures 91 is arranged with respect to four pixels, with the number of the apertures being 540×960. The four pixels as a unit for the arrangement of the apertures 91 are formed of two vertically arranged pixels, that is, the right-eye pixels 13R, and two vertically arranged pixels, that is, the left-eye pixels 13L. In other words, in the pixel array in the display unit 10, the right-eye pixel 13R and the left-eye pixel 13L are provided alternately as the pixels in the horizontal direction (row direction).
In contrast, as for the left-eye screen 16L and the right-eye screen 16R, as illustrated in
Thus, when a dimension of each of the pixels of the left-eye screen 16L and the right-eye screen 16R, that is, when a dimension of each of the pixels that form the images is set to a dimension smaller than the resolution limit of the human eye, preferably, to half (one-half) or less, the gaps corresponding to one pixel between the pixel columns are not visually recognized. Note that, the resolution limit of the human eye is eyesight resolution. A visual angle of a human with an eyesight of 1.0 corresponds to an angle of one minute of arc. This means that an ability to check the visual angle of one minute of arc corresponds to the eyesight of 1.0.
By arraying the pixels of the left-eye screen 16L and the right-eye screen 16R, which display the images, at the intervals of one pixel in the direction corresponding to a direction of alignment of the left and right eyes 70L and 70R (horizontal direction/row direction), the number of pixels in the horizontal direction is half the number of the pixels of the display unit 10 with respect to each of the left and right eyes 70L and 70R. The number of pixels in the vertical direction is equal to the number of the pixels of the display unit 10. Note that, although, in the case exemplified here, the pixel array with the intervals of one pixel in the horizontal direction is employed in each of the left-eye screen 16L and the right-eye screen 16R that display the images, the pixel array is not limited to the pixel array at the intervals of one pixel. For example, it is possible to employ a pixel array at intervals of two pixels.
The resolution limit of the human eye with respect to the gaps corresponding to one pixel between the pixel columns of the left-eye screen 16L and the right-eye screen 16R, and the pixel dimension of each of the pixels of the left-eye screen 16L and the right-eye screen 16R are described in further detail with reference to
As an example, in a case where the eyesight is 1.0 and the viewing distance is 20 [cm], when the pixel dimension (dimension in the horizontal direction) is 29.1 [um] or less, that is, half an eyesight resolution of 58.2 [um] or less, the gaps corresponding to one pixel dimension between the pixel columns are unnoticeable. On mobile electronic apparatuses such as a mobile phone, the observer generally performs visual recognition (observation) of the display screen at a viewing distance of approximately 70 [cm] or less. Thus, in a case where the eyesight is 1.0 and the viewing distance is 70 [cm], when the pixel dimension is 101.8 [um] or less, that is, half an eyesight resolution of 203.6 [um] or less, the gaps corresponding to one pixel dimension between the pixel columns are unnoticeable.
The display apparatus 1A according to the first embodiment enables images to be presented separately to the left and right eyes 70L and 70R, that is, the images to be presented side by side in the left-right direction. With this, it is possible to obtain a laterally wide display area. For example, it is possible to present different images that are independent of and do not overlap with each other with respect to the whole display image to the left and right eyes 70L and 70R. In addition, as is clear from the illustrations in
The display apparatus 1B according to the second embodiment is a virtual-image display apparatus that enables an observer to view a virtual image with both the eyes on a screen of the single display unit 10. Note that, the display apparatus 1B according to the second embodiment does not exclude virtual image viewing with a single eye, and hence it is possible to view the virtual image with a single eye. In addition, the display apparatus 1B according to the second embodiment presents a virtual image with an aspect ratio different from the aspect ratio of the display surface of the display unit 10. The virtual image with the aspect ratio different from the aspect ratio of the display surface of the display unit 10 is an image different from a stereoscopic image (three-dimensional image) with the aspect ratio equal to the aspect ratio of the display surface of the display unit 10.
Herein, the case where “aspect ratios are equal to each other” encompasses not only the case where the aspect ratios are exactly equal to each other, but also the case where the aspect ratios are substantially equal to each other. Therefore, the case where the aspect ratio of the stereoscopic image differs from the aspect ratio of the display surface of the display unit 10 due to the presence of various types of variations generated in design or in production is encompassed in the concept of the case where “aspect ratios are equal to each other.” Further, when the observer views the stereoscopic image, the eye lenses of the observer are focused on a position on the display surface of the display unit 10. In contrast, when the observer views the virtual image, the eye lenses of the observer are focused on a position different from the position on the display surface of the display unit 10, that is, a position more distant than or less distant than the display surface is distant.
The virtual image lenses 12 include lens portions 121 made of a high-refractive-index material, and a low-refractive-index resin 122 covering the lens portions 121, and are formed in the units of adjacent even-number pixels including the left-eye pixel 13L and the right-eye pixel 13R each including the sub-pixels 11R, 11G, and 11B over which the diffusion layer 14, the spacer 92, and the apertures 91 are interposed. As each of the virtual image lenses 12, it is possible to use a fixed focus lens with a fixed focal length or a variable focus lens with a variable focal length. Alternatively, it is possible to use the fixed focus lens and the variable focus lens together. As the fixed focus lens, it is possible to use, for example, a gradient index lens (refer to Japanese Patent Application Laid-open No. 2015-225966). Moreover, as for the variable focus lens, a liquid-crystal lens and a liquid lens have been widely known.
The virtual image lenses 12 function to determine the virtual-image presentation position in accordance with its focal length. Thus, when the virtual image lenses 12 are each formed of the fixed focus lens, the virtual-image presentation position is fixed. When the virtual image lenses 12 are each formed of the variable focus lens, the virtual-image presentation position can be adjusted by changing the focal length of the variable focus lens under the drive control by the display control unit 50 to be described below.
In
The signal processing unit 40 also performs calculation of virtual-image information items (image information items) with respect respectively to the left-eye pixel 13L and the right-eye pixel 13R on the basis of the positional information and the orientation information of the eyes of the observer, the virtual-image distance information, and on the basis of the image information to be displayed such that a virtual image is presented at a position at the virtual distance with the aspect ratio different from the aspect ratio of the display surface of the display unit 10 Then, the signal processing unit 40 supplies the calculated information items to the display control unit 50. The display control unit 50 drives the left-eye pixel 13L and the right-eye pixel 13R on the basis of the virtual image information supplied from the signal processing unit 40. When the virtual image lenses 12 are each formed of the variable focus lens, the display control unit 50 controls the focal length of the variable focus lens in accordance with the instructions from the observer via the input unit 60.
Under the drive control by the display control unit 50, the virtual image is presented (displayed) at the position at the virtual image distance, that is, the virtual-image presentation position. In other words, when light of the images from the left-eye pixel 13L and the right-eye pixel 13R is focused on the retina of the observer by the virtual image lenses 12, the observer can recognize the images as a virtual image displayed at the presentation position (virtual-image distance position) that is determined in accordance with the focal length of the virtual image lenses 12.
Now, a flow of operations of the display apparatus 1B according to the second embodiment in the case where the virtual image lenses 12 are each formed of the fixed focus lens, and a flow of operations of the same in a case where the virtual image lenses 12 are each formed of the variable focus lens, are described.
As shown in the flowchart of
Then, on the basis of information of the image taken by the imaging unit 20 and information of the distance measured by the distance measurement unit 30, the signal processing unit 40 calculates the positional information and the orientation information of the eyes of the observer (Step S12). At this time, by using the virtual image distance determined in accordance with the focal length of a known fixed focus lens, the signal processing unit 40 calculates the virtual-image information items (image information items) with respect respectively to the left-eye pixel 13L and the right-eye pixel 13R on the basis of the positional information and the orientation information of the eyes of the observer, and on the basis of the image information to be displayed. Next, the display control unit 50 outputs the virtual-image information items obtained by the signal processing unit 40 to the left-eye pixel 13L and the right-eye pixel 13R (Step S13), and drives the left-eye pixel 13L and the right-eye pixel 13R. With this, a virtual image is presented at the presentation position at the virtual image distance (Step S14).
As shown in the flowchart of
Then, on the basis of the information of the image taken by the imaging unit 20 and the information of the distance measured by the distance measurement unit 30, the signal processing unit 40 calculates the positional information and the orientation information of the eyes of the observer (Step S22). Next, the signal processing unit 40 calculates virtual-image distance information on the basis of focal length information of the variable focus lens, which is designated by the observer via the input unit 60. In addition, by using the virtual-image distance information, the signal processing unit 40 calculates virtual-image information items with respect respectively to the left-eye pixel 13L and the right-eye pixel 13R on the basis of the positional information and the orientation information of the eyes of the observer, and on the basis of the image information to be displayed (Step S23). After that, the display control unit 50 outputs the virtual-image information items obtained by the signal processing unit 40 to the left-eye pixel 13L and the right-eye pixel 13R (Step S24), and drives the left-eye pixel 13L and the right-eye pixel 13R. With this, the virtual image is presented at the presentation position at the virtual image distance (Step S25).
As described above, the display apparatus 1B according to the second embodiment is a virtual-image display apparatus that enables the observer to view a virtual image with both the eyes on the single display unit 10, and that presents the virtual image with the aspect ratio different from the aspect ratio of the display surface of the display unit 10. Note that, presenting the virtual image with the aspect ratio different from the aspect ratio of the display surface of the display unit 10 means presenting (displaying) the virtual image not on the display surface of the display unit 10, but at the presentation position different from the position on the display surface of the display unit 10 in an observation direction (front-back direction of the display unit 10) for the observer.
Specifically, on the display apparatus 1B according to the second embodiment, the virtual-image presentation position with respect to the observer may be a position more distant from the observer than the display surface of the display unit 10 is distant, or a position less distant from the observer than the display surface of the display unit 10 is distant. The distance of the virtual image from the observer to the virtual-image presentation position, that is, the virtual image distance, is determined in accordance with the focal length of the virtual image lenses 12, and the distance from the observer to the display unit 10 (hereinafter, referred to as “viewing distance”).
Further, when the virtual image lenses 12 are each formed of the variable focus lens, the display apparatus 1B according to the second embodiment can be switched between virtual image display and real image display. In other words, when the virtual image lenses 12 are each formed of the variable focus lens, by providing a lens function to the variable focus lens, it is possible, as described above, to present a virtual image at the presentation position different from the position on the display surface of the display unit 10. Further, by omitting the lens function from the variable focus lens, it is possible to display a real image (two-dimensional image) on the display surface of the display unit 10. Whether or not to provide the lens function to the variable focus lens can be switched by collectively controlling focal lengths of all the microlenses forming the variable focus lenses under the control by the display control unit 50 on the basis of the instructions by the user via the input unit 60.
Further, on the display apparatus 1B according to the second embodiment, when the virtual image lenses 12 are each formed of the variable focus lens, it is also possible to individually control the focal lengths of the microlenses forming the variable focus lenses under the control by the display control unit 50. With this, the virtual image can be presented at distances different from position to position within the display screen, and depth perception can be partially produced with respect to the virtual image. In this way, the virtual image can be presented not as a two-dimensional image but as a three-dimensional image. This presentation differs from the case where the pupil of the observer is focused on the display unit 10 and a stereoscopic vision is produced by the left-right parallax. In other words, focusing in this presentation is performed not on the display unit 10 but on a three-dimensional position in a visible image.
Now, the display apparatus 1B according to the second embodiment is more specifically described. In the following description, a display apparatus according to the second embodiment, which presents a virtual image at a position more distant than the display surface of the display unit 10 is distant, is referred to as a display apparatus according to Embodiment A of the second embodiment. Another display apparatus according to the second embodiment, which presents a virtual image at a position less distant than the display surface of the display unit 10 is distant, is referred to as a display apparatus according to Embodiment B of the second embodiment.
(Display Apparatus According to Embodiment A of Second Embodiment)
The display apparatus according to Embodiment A of the second embodiment is a virtual-image display apparatus that presents a virtual image at a position more distant than the display surface of the display unit 10 is distant.
On the display apparatus according to Embodiment A of the second embodiment, the virtual image is presented by signal processes by the signal processing unit 40 in
More specifically, the signal processing unit 40 generates image information that causes a left side of the left-eye image and a right side of the right-eye image to be adjacent to each other. The display control unit 50 drives the left-eye pixel 13L and the right-eye pixel 13R on the basis of the image information generated by the signal processing unit 40, thereby presenting the virtual image 15 at the presentation position set as the position more distant than the display surface of the display unit 10 is distant. In other words, on the display apparatus according to Embodiment A of the second embodiment, the virtual image 15 is displayed on the left-eye screen 16L and the right-eye screen 16R being two screens adjacent to each other in the left-right direction.
It is possible to display an image of the same content on the two screens of the left-eye screen 16L and the right-eye screen 16R. Alternatively, it is possible to display images of different contents, for example, as illustrated in
Display pixels of the virtual image 15 with respect to the left eye 70L and the right eye 70R of the observer, the resolution limit of the human eye with respect to the gaps corresponding to one pixel between the pixel columns of the left-eye screen and the right-eye screen, and the pixel dimension are basically the same as those in the case of the display apparatus 1A according to the first embodiment described with reference to
As described above, the display apparatus according to Embodiment A of the second embodiment is a virtual-image display apparatus that includes a distant-display optical system that presents the virtual image 15 at a position more distant from the observer than the display surface of the display unit 10 is distant, in which the apertures 91 and the virtual image lenses 12 are arranged in an array in the units of adjacent even-number pixels including the left-eye pixel and the right-eye pixel. Further, the display apparatus enables the observer to view, with both the eyes with respect to the screen of the single display unit 10, the virtual image 15 at a position more distant than the display surface of the display unit 10 is distant. With this, a need for wearing an eyeglass-type display such as a head-mounted display on one's head is eliminated, thereby making it possible to reduce burden and labor on the observer (user).
Further, although it is difficult for observers who are far-sighted or weak-sighted from aging to view a screen on hand, the display apparatus according to Embodiment A of the second embodiment enables even such observers who are far-sighted or weak-sighted from aging to focus on the display screen of the virtual image by virtual image viewing, specifically, by shifting the focus position formed by the lenses of the eyeballs to a position more distant than the display surface of the display unit 10 is distant.
Further, the display apparatus according to Embodiment A of the second embodiment enables the virtual image to be presented separately to the left and right eyes 70L and 70R, that is, the virtual images to be presented side by side in the left-right direction. With this, it is possible to laterally widen a display area. For example, different images that are independent of and do not overlap with each other with respect to the whole display image can be presented as the virtual images to the left and right eyes 70L and 70R. In addition, as is clear from the illustrations in
Meanwhile, on a display apparatus, even when the pixel dimension (pixel pitch) is miniaturized to the level of human eyesight resolution or higher, due to the human eyesight resolution, this level of miniaturization does not come into action. Thus, it is impossible to obtain high-definition information. In contrast, on the display apparatus according to Embodiment A of the second embodiment, the pixels of the display unit 10, which are presented to the left and right eyes 70L and 70R, are used alternately in the horizontal direction of the pixel array for the right eye and the left eye. Thus, the pixels of the display unit 10, which are observed exclusively with the right eye, do not include pixels for the left eye when being displayed. However, when a gap corresponding to the non-displayed pixel is approximately at the level of eyesight resolution, it is impossible to discern the gap between adjacent ones of the display pixels. Thus, the pixel dimension may be reduced to approximately a level of half the eyesight resolution. As a result, it is possible to increase the number of pixels that can be displayed as a virtual image even when the screen size of the display unit 10 is unchanged.
Now, specific examples of a case where the display apparatus according to Embodiment A of the second embodiment is used as a display apparatus of an electronic apparatus, specifically, as a display apparatus of the mobile electronic apparatus are described. On the display apparatus according to Embodiment A of the second embodiment, when the presentation position of a virtual image with respect to the observer is more distant than the display unit 10 is distant, the virtual image is presented at the virtual-image presentation position such that the left side of the left-eye image and the right side of the right-eye image are adjacent to or overlap with each other. The information of the virtual image is generated by the signal processing unit 40. Note that, the “adjacent” herein encompasses the case where there is a gap between the left side of the left-eye image and the right side of the right-eye image.
Example 10 is an example in which the display apparatus according to Embodiment A of the second embodiment is used as a display apparatus of a wristwatch-type terminal being an example of the electronic apparatuses.
In
The left-eye pixel 13L and the right-eye pixel 13R of the display unit 10A of the wristwatch-type terminal 100 are driven by the signal processes by the signal processing unit 40 and under the display control by the display control unit 50. With this, the virtual image 15 is presented at the virtual-image presentation position that is determined in accordance with the focal length and the viewing distance of the virtual image lenses 12. More specifically, on the display apparatus according to Example 10, the virtual image 15 is presented on the two screens of the left-eye screen 16L and the right-eye screen 16R. The left-eye screen 16L and the right-eye screen 16R are configured such that the two screens are in contact with each other at this time so as to be continuous in the left-right direction.
It is possible to present a virtual image of the same content on the two screens of the left-eye screen 16L and the right-eye screen 16R. Alternatively, it is possible to present virtual images of different contents, for example, as illustrated in
Now, an example of device specifications of the display unit 10A of the wristwatch-type terminal 100 is described. The display unit 10A of the wristwatch-type terminal 100 is assumed to have a screen size of 2 [inch], with 4 [cm] in width and 3 [cm] in height, with the number of pixels being 1280 [pixel] in width and 960 [pixel] in height. Further, the pixel pitch (pixel dimension) is assumed to be 31 [um], with the pitch of each of the virtual image lenses 12 being 61 [um].
Under this device specification, it is assumed that, when the viewing distance being the distance from the observer to the display unit 10A is, for example, 20 [cm], the virtual image distance being the distance from the observer to the presentation position of the virtual image 15 is set, for example, to 60 [cm]. In this case, at the presentation position at the virtual image distance of 60 [cm], the virtual image 15 is displayed on the two screens of the left-eye screen 16L and the right-eye screen 16R each having a screen size of 6 [inch], with 12 [cm] in width and 9 [cm] in height, with the number of pixels being 640 [pixel] in width and 960 [pixel] in height.
In other words, on each of the two screens that display the virtual image 15, with respect respectively to the left and right eyes 70L and 70R, the number of pixels in the horizontal direction is half the number of pixels of the display unit 10A, and the number of pixels in the vertical direction is equal to the number of pixels of the display unit 10A. Further, a screen size of a whole screen of the two screens is 10.5 [inch], with 24 [cm] in width and 9 [cm] in height, with the number of pixels being 1280 [pixel] in width and 960 [pixel] in height. In other words, the whole screen of the two screens uses all the pixels of the display unit 10A. A display resolution of the virtual image corresponds to a resolution four times as high as a resolution of a video graphics array (VGA).
As described above, with the display apparatus according to Example 10, the virtual image 15 can be displayed at a presentation position more distant than the display unit 10A of the wristwatch-type terminal 100 is distant. Thus, it is possible to reduce eye strain that is caused by observing a screen on hand at a short distance. The screen size of the display unit 10A of the wristwatch-type terminal 100 is physically restricted to the size up to approximately two inches in consideration of wearability, and in accordance therewith, contents to be displayed thereon are also restricted. Even under such restrictions, with the display apparatus according to Example 1, it is possible to display, by virtual image display, the image (virtual image) having an enlarged screen size at a position more distant than the display unit 10A is distant, and hence to present a large amount of information.
With the display apparatus according to Example 10, by changing the viewing distance from the observer to the display unit 10A, it is possible to change the virtual image distance up to the presentation position at which the virtual image 15 is presented, and to change the screen size of the two screens of the left-eye screen 16L and the right-eye screen 16R. As illustrated in
Example 11 is a modification example of Example 10.
On the display apparatus according to Example 10, the left-eye screen 16L and the right-eye screen 16R are configured such that the two screens are in contact with each other so as to be continuous in the left-right direction. In contrast, as illustrated in
Now, another example of the device specifications of the display unit 10A of the wristwatch-type terminal 100 is described. The display unit 10A of the wristwatch-type terminal 100 is assumed to have the screen size of 2 [inch], with 4 [cm] in width and 3 [cm] in height, with the number of pixels being 1280 [pixel] in width and 960 [pixel] in height. Further, the pixel pitch (pixel dimension) is assumed to be 31 [um], with the pitch of each of the virtual image lenses 12 being 61 [um]. Under this device specification, when the viewing distance is, for example, 20 [cm], the virtual image distance is set, for example, to 60 [cm]. In this case, at the presentation position at the virtual image distance of 60 [cm], the virtual image 15 is displayed on the two screens each having the screen size of 6 [inch], with the number of pixels being 640 [pixel] in width and 960 [pixel] in height.
As described above, with the display apparatus according to Example 11, the virtual image can be presented on the two screens obtained by dividing the left-eye screen 16L and the right-eye screen 16R in the left-right direction. With this, although display of the same content on the two screens of the left-eye screen 16L and the right-eye screen 16R is not expected, information items of different (two types of) contents A and B can be simultaneously displayed thereon. Also in this case, all the pixels of the display unit 10A are used by the two screens.
On the display apparatus according to the modification example of Example 11, even when the viewing distance is unchanged, it is possible to change the sizes of the two screens divided in the left-right direction by changing the virtual image distance through changing of the focal length of the virtual image lenses 12. For example, as illustrated in
Further, by changing the viewing distance, it is possible to change the virtual image distance, and the screen size of the left-eye screen 16L and the right-eye screen 16R. For example, as illustrated in
Example 12 is an example in which the display apparatus according to Embodiment A of the second embodiment is used as a display apparatus of mobile terminals such as a feature phone and a smartphone, which are examples of the electronic apparatuses.
In
Now, an example of device specifications of the display unit 10B of the mobile terminal 200 is described. The display unit 10B of the mobile terminal 200 is assumed to have a vertically long screen, having a screen size of 5 [inch], with 6.2 [cm] in width and 11.1 [cm] in height, with the number of pixels being 2160 [pixel] in width and 3840 [pixel] in height. Further, the pixel pitch (pixel dimension) is assumed to be 29 [um], with the pitch of each of the virtual image lenses 12 being 59 [um].
Under this device specification, it is assumed that, when the viewing distance being the distance from the observer to the display unit 10B is, for example, 20 [cm], the virtual image distance being the distance from the observer to the virtual-image presentation position is set, for example, to 200 [cm]. In this case, at the presentation position at the virtual image distance of 200 [cm], the virtual image 15 is displayed on the two screens of the left-eye screen 16L and the right-eye screen 16R each having a screen size of 50 [inch], with 62 [cm] in width and 111 [cm] in height, with the number of pixels being 1080 [pixel] in width and 3840 [pixel] in height.
In other words, on each of the two screens that display the virtual image 15, with respect respectively to the left and right eyes 70L and 70R, the number of pixels in the horizontal direction is half the number of pixels of the display unit 10B, and the number of pixels in the vertical direction is equal to the number of pixels of the display unit 10B. Further, a screen size of a whole screen of the two screens is 64.5 [inch], with 121 [cm] in width and 111 [cm] in height, with the number of pixels being 2160 [pixel] in width and 3840 [pixel] in height. In other words, the whole screen of the two screens uses all the pixels of the display unit 10B. A display resolution of the virtual image corresponds to a resolution of 4K.
Further, with respect to the viewing distance of 20 [cm], the virtual image (two screens) is enlarged when the screen of the display unit 10B of the mobile terminal 200 is brought closer to the observer, and in contrast, the virtual image is downsized when the screen is separated away from the observer. Under the above-described device specification, when the viewing distance is reduced, for example, to 15 [cm], the virtual image 15 is displayed at a presentation position at a virtual image distance of 195 [cm] on two screens each having a screen size of 65 [inch], with 81 [cm] in width and 144 [cm] in height. A screen size of a whole screen of the two screens is 84 [inch], with 159 [cm] in width and 144 [cm] in height. In contrast, when the viewing distance is increased, for example, to 30 [cm], the virtual image 15 is displayed at a presentation position at a virtual image distance of 210 [cm] on two screens each having a screen size of 35 [inch], with 44 [cm] in width and 78 [cm] in height. A screen size of a whole screen of the two screens is 45 [inch], with 83 [cm] in width and 78 [cm] in height.
As described above, with the display apparatus according to Example 12, the virtual image 15 can be displayed at a presentation position more distant than the display unit 10B of the mobile terminal 200 is distant. Thus, it is possible to reduce eye strain on the observer. Specifically, by virtual image viewing, that is, by shifting the focus position formed by the lenses of the eyeballs to a position more distant than the display surface of the display unit 10B is distant, it is possible to reduce eye strain on the observer, which is caused by observation of a screen on hand at a short distance, such as the display unit 10B of the mobile terminal 200.
In particular, in the case of the mobile terminal 200 such as a feature phone and a smartphone, when the observer in motion views the screen of the display unit 10B, the observer's focus shifts to his/her hand, and hence it is difficult for the observer to grasp a surrounding situation. In contrast, with the display apparatus according to Example 12, even when viewing the screen of the display unit 10B, the observer focuses on a distant position, and hence it is easy for the observer to grasp the surrounding situation.
Further, the screen size of the display unit 10B of the mobile terminal 200 is physically restricted to the size up to approximately five inches in consideration of portability, and in accordance therewith, contents to be displayed thereon are also restricted. Even under such restrictions, with the display apparatus according to Example 12, it is possible to display, by virtual image display, the image (virtual image) having an enlarged screen size at a position more distant than the display unit 10B is distant. In particular, it is possible to display the virtual image with a large number of pixels that exceeds the eyesight limitation (1920×1080), and hence to significantly increase the amount of information to be presented.
On the mobile terminal 200, the display unit 10B is typically used as a vertically long screen. Thus, information extending in the horizontal direction is wrapped to the next line. A horizontally long photograph is restricted in horizontal width, and hence is displayed with unusable black portions on its upper and lower sides. As a result, the photograph is viewed on a small screen. In contrast, with the display apparatus according to Example 12, by virtual image display, it is possible to display the image (virtual image) in a horizontally wide screen size at a position more distant than the display unit 10B is distant. Thus, it is possible to significantly increase a degree of freedom in displaying the contents.
Example 13 is an example in which the display apparatus according to Embodiment A of the second embodiment is used as a display apparatus of camera apparatuses such as a still camera and a camcorder, which are examples of the electronic apparatuses.
In
Now, an example of device specifications of the display unit 10C of the camera apparatus 300 is described. The display unit 10C of the camera apparatus 300 is assumed to have a screen size of 3 [inch], with 6.1 [cm] in width and 4.6 [cm] in height, with the number of pixels being 2048 [pixel] in width and 1520 [pixel] in height. Further, the pixel pitch (pixel dimension) is assumed to be 30 [um], with the pitch of each of the virtual image lenses 12 being 60 [um].
Under this device specification, it is assumed that, when the viewing distance being the distance from the observer to the display unit 10C is, for example, 20 [cm], the virtual image distance being the distance from the observer to the virtual-image presentation position is set, for example, to 200 [cm]. In this case, at the presentation position at the virtual image distance of 200 [cm], the virtual image 15 is displayed on the two screens of the left-eye screen 16L and the right-eye screen 16R each having a screen size of 6 [inch], with 12 [cm] in width and 9 [cm] in height, with the number of pixels being 1024 [pixel] in width and 1520 [pixel] in height.
In other words, on each of the two screens that display the virtual image 15, with respect respectively to the left and right eyes 70L and 70R, the number of pixels in the horizontal direction is half the number of pixels of the display unit 10C, and the number of pixels in the vertical direction is equal to the number of pixels of the display unit 10C. Further, a screen size of a whole screen of the two screens is 51 [inch], with the number of pixels being 2480 [pixel] in width and 1520 [pixel] in height. In other words, the whole screen of the two screens uses all the pixels of the display unit 10C.
As described above, with the display apparatus according to Example 13, it is possible to present the virtual image on the left-eye screen 16L and the right-eye screen 16R as the two screens adjacent to each other in the left-right direction. With this, it is possible to simultaneously display information items of different (two types of) contents A and B on the two screens of the left-eye screen 16L and the right-eye screen 16R. It is preferred that the camera apparatus 300 such as a still camera and a camcorder display, for example, an image of a subject on the right-eye screen 16R, and display imaging conditions such as a shutter speed and a histogram on the left-eye screen 16L. By utilizing horizontally expanded two-screen display in this way, that is, by displaying the imaging conditions such as a shutter speed and a histogram in a vicinity of the image of the subject, a photographer can perform imaging under optimum conditions while checking the imaging conditions.
The camera apparatus 300 such as a still camera and a camcorder performs operation to determine composition of the subject in imaging. At this time, the eye focuses on a distant position when viewing the subject, and hence the screen of the display unit 10C of the camera apparatus 300 on a near side blurs. In contrast, when the composition is determined while the screen on the display unit 10C is viewed, the focus is on the display unit 10C, and hence the subject blurs. With the display apparatus according to Example 13, it is possible to focus on both the subject and the display unit 10C, and hence to easily determine the composition of the subject in imaging.
Further, with the display apparatus according to Example 13, the virtual image 15 can be displayed at a presentation position more distant than the display unit 10C of the camera apparatus 300 is distant. Thus, it is possible to reduce eye strain on the observer. Specifically, by virtual image viewing, that is, by shifting the focus position formed by the lenses of the eyeballs to a position more distant than the display surface of the display unit 10C is distant, it is possible to reduce eye strain on the observer, which is caused by observation of a screen on hand at a short distance, such as the display unit 10C of the camera apparatus 300.
Examples 10 to 13 described above are examples in which the left-eye screen 16L that presents the left-eye image (virtual image) and the right-eye screen 16R that presents the right-eye image (virtual image) are arranged as two adjacent (continuous) screens in the left-right direction, or two divided screens in the left-right direction. In other words, in Examples 10 to 13, the left-eye image and the right-eye image do not overlap with each other in the left-right direction. However, the display apparatus according to Embodiment A of the second embodiment is not limited to this configuration, and may cause the left-eye image and the right-eye image to overlap with each other in the left-right direction. Now, a specific example of the case where the left-eye image and the right-eye image overlap with each other in the left-right direction is described.
Example 14 is an example in which a distant-display optical system, which presents a virtual image at a position more distant than the display surface of the display unit 10 (refer to
First, the case of
When the panel size is 8 [cm], under the setting conditions that the viewing distance is 20 [cm] and the virtual image distance is 80 [cm], a virtual image having a virtual image size of 50.4 [cm] is presented at the presentation position at this virtual image distance under the state in which the part of the left side of the left-eye image and the part of the right side of the right-eye image overlap with each other. The virtual image size herein refers to the size of the virtual image 15 in the left-right direction (horizontal direction/lateral direction). At this time, the distance from the display unit 10 to the virtual-image presentation position (hereinafter, referred to as “panel-to-virtual-image distance”) is 60 [cm] (=virtual image distance of 80 [cm]−viewing distance of 20 [cm]).
Note that, in a region where the part of the left side of the left-eye image and the part of the right side of the right-eye image overlap with each other, it is preferred that either one of the left-eye image and the right-eye image be displayed, or the left-eye image and the right-eye image be displayed after being subjected to interpolation processes. With this, it is possible to suppress occurrence of such phenomena that double images are displayed in the region where the part of the left side of the left-eye image and the part of the right side of the right-eye image overlap with each other, and that luminance becomes higher than those in other regions. The same applies to Examples described below.
Next, the case of
With the above-described display apparatus according to Example 14, it is possible to change the virtual image size from that under the state of
Example 15 is a modification example of Example 14.
The state of
In contrast, under the state of
Specifically, under the state illustrated in
With the above-described display apparatus according to Example 15, even when the viewing distance is changed from that under the state of
Example 16 is an example in which the distant-display optical system, which presents a virtual image at a position more distant than the display surface of the display unit 10 (refer to
The state of
The state of
With the above-described display apparatus according to Example 16, it is possible to change the virtual image size from that under the state of
In addition, in the display apparatus according to Example 16, the distant-display optical system uses a variable focus, that is, the virtual image lenses 12 are each formed of a variable focus lens, and its focal length is adjustable. Thus, the virtual image distance determined in accordance with the focal length can be adjusted to be kept constant in accordance with the viewing distance. Thus, it is possible to display the virtual image with easy-to-view dimensions (size) while keeping constant (or under a state of keeping constant) the virtual image distance.
Example 17 is a modification example of Example 16, in which the distant-display optical system uses the variable focus and the virtual image size is fixed.
The state of
In contrast, under the state of
Specifically, under the state illustrated in
With the above-described display apparatus according to Example 17, even when the viewing distance is changed from that under the state of
(Display Apparatus According to Embodiment B of Second Embodiment)
A display apparatus according to Embodiment B of the second embodiment is a virtual-image display apparatus that presents a virtual image at a position less distant (nearer) than the display surface of the display unit 10 is distant, and that performs the presentation of the virtual image in a manner that a right side of a left-eye image and a left side of a right-eye image are adjacent to or overlap with each other at the virtual-image presentation position. On the display apparatus according to Embodiment B of the second embodiment, the virtual image is presented (displayed) by the signal processes by the signal processing unit 40 in
In other words, the display control unit 50 drives the left-eye pixel 13L and the right-eye pixel 13R of the display unit 10 on the basis of the image information generated by the signal processing unit 40, thereby presenting, in accordance with the focal length and the viewing distance of the virtual image lenses 12, a virtual image at a presentation position set as a position less distant than the display surface of the display unit 10 is distant. More specifically, the signal processing unit 40 generates image information that causes the left side of the left-eye image and the right side of the right-eye image to overlap with each other. The display control unit 50 drives the left-eye pixel 13L and the right-eye pixel 13R on the basis of the image information generated by the signal processing unit 40, thereby presenting the virtual image 15 at the presentation position set as the position less distant than the display surface of the display unit 10 is distant.
The display apparatus according to Embodiment B of the second embodiment includes a vicinity-display optical system that presents the virtual image 15 at a position less distant from the observer than the display surface of the display unit 10 is distant, in which the virtual image lenses 12 are arranged in the array in the units of adjacent even-number pixels including the left-eye pixel and the right-eye pixel. Further, the display apparatus enables the observer to view, with both the eyes with respect to the screen of the single display unit 10, the virtual image 15 at a position less distant (nearer) than the display surface of the display unit 10 is distant. Thus, the display apparatus according to Embodiment B of the second embodiment is useful as a virtual-image display apparatus particularly for a near-sighted observer under a naked-eye state. In other words, by virtual image viewing, that is, by shifting the presentation position to a position nearer than the display surface of the display unit 10 is near in accordance with the focus position formed by the lenses of the eyeballs, it is possible to view the display screen of the virtual image even with naked eyes of a near-sighted person who needs eyesight correction with eye glasses or contact lenses.
Also with regard to the display apparatus according to Embodiment B of the second embodiment, there is a case where the virtual image lens 12 are each formed of a fixed focus lens, and a case where the virtual image lenses 12 are each formed of a variable focus lens. Now, the case where the virtual image lenses 12 are each formed of a fixed focus lens is specifically described as Example 18, and the case where the virtual image lenses 12 are each formed of a variable focus lens is specifically described as Example 19.
Example 18 is an example in which the vicinity-display optical system, which presents a virtual image at a position less distant than the display surface of the display unit 10 (refer to
In
The size of the display surface of the display unit 10 in the horizontal direction (row direction), that is, the panel size, is assumed, for example, to be 10 [cm], and the distance between the left eye 70L and the right eye 70R of the observer (interocular) is assumed, for example, to be 65 [mm]. Further, the light beam relating to the left eye 70L of the observer is indicated by the one-dot chain lines, the light beam relating to the right eye 70R is indicated by the broken lines, and the virtual image 15 is indicated by two-dot chain lines. The same applies to Example 19 described below.
In the case illustrated in
With the above-described display apparatus according to Example 18, it is possible to perform short-distance presentation of the virtual image 15 with respect to a near-sighted observer under a naked-eye state by changing the presentation position (virtual image distance) of the virtual image 15 through changing of the viewing distance without adjusting the image information for driving the display unit 10. In this case, the observer needs to change the virtual image distance in accordance with his/her own eyesight.
Note that, in the case illustrated in
Meanwhile, in the case illustrated in
Example 19 is an example in which the vicinity-display optical system, which presents a virtual image at a position less distant than the display surface of the display unit 10 (refer to
On the display apparatus according to Example 19, the viewing distance being the distance from the observer to the display surface of the display unit 10 is fixed. The viewing distance is fixed, for example, to 20 [cm]. In addition, in
With the above-described display apparatus according to Example 19, it is possible to perform short-distance presentation of the virtual image 15 with respect to a near-sighted observer under a naked-eye state by changing the virtual image distance through changing of the focal length of the variable focus lens in accordance with the eyesight of the observer under the state in which the viewing distance is fixed.
<Display Apparatus According to Third Embodiment>
The technology according to the present disclosure is applicable also to what is called an electronic mirror that uses a display to which a function of a mirror is provided. The electronic mirror refers to an electronically formed mirror that includes a camera arranged in a vicinity of the display, which captures the face of an observer (user), and that performs left-right inversion (mirror-image inversion) on the taken image, and displays the image on the display as a real image. In this way, the function of the mirror provided to the display is exerted. When this electronic mirror, to which the technology according to the present disclosure is applied, is related to the system configuration of the display apparatus according to the second embodiment of the present disclosure, which is shown in
The display apparatus according to the third embodiment is featured not only in merely presenting, as a real image, a left-right inverted image of the image taken by the imaging unit 20 on the display surface of the display unit 10, but also in presenting, as a virtual image, the image at a presentation position less distant from the observer than the display unit 10 is distant. In other words, the display apparatus according to the third embodiment is similar to the display apparatus according to Embodiment B of the second embodiment in presenting a virtual image at a presentation position less distant from the observer than the display unit 10 is distant.
With the display apparatus according to the third embodiment, it is possible to present a virtual image at a position less distant from the observer than the display unit 10 is distant. Thus, it is possible to provide an electronic mirror that enables even a near-sighted observer under a naked-eye state to check his/her own face without coming closer to the display surface of the display unit 10. The electronic mirror to which the display apparatus according to the third embodiment is applied is used as a naked-eye viewable mirror that enables a person with weak eyesight to view, as in looking in a mirror and even without wearing eye glasses or contact lenses, his/her own face by display of the virtual image at the presentation position nearer than the display unit 10 is near.
Further, the display apparatus according to the third embodiment enables even a person who has eyesight too weak to check his/her own face reflected on a mirror with naked eyes to apply skin treatment or makeup, or to wear contact lenses without wearing eye glasses or contact lenses. In other words, by virtual image viewing, that is, by shifting the presentation position to a position nearer than the display surface of the display unit 10 is near in accordance with a focus position formed by the lenses of the eyeballs, it is possible to view the display screen of the virtual image even with naked eyes of a near-sighted person who needs eyesight correction with eye glasses or contact lenses.
The display apparatus according to the third embodiment can use either one of the fixed focus lens and the variable focus lens as each of the virtual image lenses 12. Note that, when the variable focus lens is used as each of the virtual image lenses 12, it is possible to switch the virtual image display and the real image display to each other. In other words, when the virtual image lenses 12 are each formed of the variable focus lens, by providing a lens function to the variable focus lens, it is possible to present the left-right inverted image of the image taken by the imaging unit 20 as a virtual image at a position less distant than the display unit 10 is distant. Further, by omitting the lens function from the variable focus lens, it is possible to display, on the display surface of the display unit 10, the left-right inverted image of the image taken by the imaging unit 20 as a real image (two-dimensional image). With this, the display surface of the display unit 10 functions as an ordinary mirror.
Now, a focus distance in looking in the mirror is described with reference to
For example, in order that a near-sighted observer, who cannot check (cannot view) his/her own face until coming close to a position at the viewing distance of 10 [cm], checks his/her own face, this observer needs to come close to the mirror at 5 [cm] from the display surface of the display unit 10 having the mirror function, that is, from a mirror surface. This is because, when the observer comes close to the position at 5 [cm] from the mirror surface, a light beam moves back and force 10 [cm] with respect to the mirror surface, that is, the viewing distance measures 10 [cm].
In contrast, when the virtual image is presented at the presentation position of 10 [cm] from the observer on the side nearer than the display unit 10 is near, the observer can check (view), without coming close to the display surface of the display unit 10, his/her own face at the distance of 10 [cm] from the face on the side nearer than the display unit 10 is near. In other words, when the virtual image is presented at the distance of 10 [cm] from the observer, even the near-sighted person, who cannot check his/her own face until coming close to the position at the viewing distance of 10 [cm], can check his/her own face with naked eyes.
As described above, in the case of an ordinary mirror, there is a need to make the distance between the face and the mirror close to one half of the focus distance in viewing with naked eyes. For example, a person who cannot view a thing until coming close to 10 [cm] on hand needs to bring a mirror close to a position of 5 [cm], resulting in interference of makeup tools such as mascara with the mirror. At the same time, the mirror that has come too close narrows the viewable range. With the display apparatus according to the third embodiment, it is possible to present a virtual image at any position nearer than the display surface of the display unit 10 is near, and hence to set the virtual-image presentation position at 10 [cm] from the eye. With this, the position of the display surface of the display unit 10 having the function of a real mirror is sufficiently spaced apart from the face. Thus, it is possible to avoid problems such as the interference of makeup tools with the mirror.
In the configuration of this embodiment, as in the case of Embodiment B of the second embodiment, for near-sighted eyes, a virtual image is presented at a position less distant from the observer than the display unit 10 is distant. Alternatively, for far-sighted eyes (or weak-sighted eyes from aging), it is possible to present the virtual image at a position more distant from the observer than the display unit 10 is distant (modification example of the third embodiment). Further, it is also possible to enable switching near-sighted use and far-sighted use to each other from observer to observer, specifically, to present the virtual image at a position less distant than the display unit 10 is distant in the case of the near-sighted use, and to present the virtual image at a position more distant than the display unit 10 is distant in the case of the far-sighted use. In this case, a variable focus lens is used as each of the virtual image lenses 12, and presentation positions of the virtual image are set as appropriate by changing the focal length of the variable focus lens in accordance with the switching of the near-sighted use and the far-sighted use to each other.
Further, in the third embodiment or in the modification example thereof, it is preferred that the viewing distance be calculated on the basis of the distance between the left and right eyes 70L and 70R in the camera image taken by the imaging unit 20 in
Now, specific examples of the display apparatus according to the third embodiment, which is configured to present a virtual image at a position less distant from the observer side than the display unit 10 is distant, are described.
In
The display unit 10 to be used in Example 20 is, for example, a display having a screen size (whole screen size) of 20 [inch], with 30 [cm] in height and 40 [cm] in width, with the number of pixels being 3000 in height, 4000 [pixel] in width, and 100 [um] in pixel pitch. The distance between the observer and the display unit 10, that is, the viewing distance is set to 30 [cm]. With this, a virtual image is presented at a presentation position at a virtual image distance of 15 [cm], that is, half the viewing distance of 30 [cm]. In addition, the virtual image size is 10 [inch], with 15 [cm] in height and 20 [cm] in width. The screen size of the virtual image at this time corresponds to a projection range for one eye.
With the above-described display apparatus according to Example 20, by using the technology according to the second embodiment of the present disclosure, that is, the technology of virtual image display that enables an observer to view the virtual image with both the eyes on the screen of the single display unit 10, it is possible to present, to the observer, the virtual image at a position nearer than the display unit 10 having the function of a mirror is near. With this, it is possible for a person who needs eyesight correction to check his/her own face even without wearing eye glasses or contact lenses. Thus, it is possible to apply skin treatment with naked eyes, for example, after wake-up or before going to bed.
In Example 20, the function of an electronic mirror is exerted by using the technology of virtual image display that enables the observer to view the virtual image with both the eyes on the screen of the single display unit 10 with use of the virtual-image optical system according to the second embodiment. In contrast, Example 21 is featured in using a virtual-image optical system configured on the basis of what is called reconstruction of parallax rays so as exert the function of the electronic mirror.
As illustrated, for example, in
The plurality of display elements 17 each have a display region 17A having, for example, a rectangular shape, and are each configured to be capable of displaying an independent image. In other words, the plurality of display elements 17 are each formed of a plurality of pixels, and hence are each capable of displaying on its own an image recognizable by a person. In an example in
As illustrated, for example, in
Note that, the surfaces on which the display elements 17 and the lenses 18A are arranged need not necessarily be flat surfaces, and may be gently curved surfaces. Further, the display element 17 and the lenses 18A are arranged at fixed pitch intervals such that a person can recognize an image as a whole (in other words, such that image is not displayed with local defects). A coverslip 19 is arranged on a front surface of the lens array unit 18. The display unit 10, the lens array unit 18, and the coverslip 19 are integrated with each other.
Light of the image displayed by each of the plurality of display elements 17 of the display unit 10 is converted into substantially parallel light beams by the lens 18A, and these light beams enter the left eye 70L and the right eye 70R of the observer (user) through the cover slip 19.
As illustrated in
The display surface of the display unit 10 is arranged in a vicinity of a focal point (focal length) obtained when the substantially parallel light beams enter the lenses 18A−1 and 18A−2. In other words, the light of the image, which is emitted from the display element 17−1, is emitted as substantially parallel light beams from the lens 18A−1. Similarly, the light of the image, which is emitted from the display element 17−2, is emitted as substantially parallel light beams from the lens 18A−2.
A light beam emitted from a point PL1 on a slightly right side with respect to substantially a center of the display element 17−1 is assumed to be converted into the substantially parallel light beams by the lens 18A−1, and these light beams are assumed to be focused, for example, on the point 81−13 on the retina 80. A light beam emitted from a point PC1 on a slightly left side with respect to the point PL1 in
Similarly, a light beam emitted from a point PL2 (corresponding to the point PL1 of the display element 17−1) on a slightly right side with respect to substantially a center of the display element 17−2 located on a right side with respect to the display element 17−1 in
In this way, the light beams emitted from the points PL1 and PL2 as corresponding pixels are focused on the same point on the retina 80. Similarly, the light beams emitted from the points PC1 and PC2 as corresponding pixels are focused on the same point on the retina 80.
Now, the above is described in further detail with reference to
Note that, illustration of optical path refraction that occurs in practice at surfaces of the lenses is simplified in
Among light beams of the real image 91−11 in the display region 17A−11, a light beam L1−11 emitted from a pixel located on the left side in
Among light beams of the real image 91−12 in the display region 17A−12 located at substantially a center of
In contrast, among light beams emitted from the real image 91−13 of the display region 17A−13 located on a rightmost side in
In this way, the light beams, which are emitted to be a dominant component from the pixels located leftward among the pixels of the real image 91−11 displayed by the display region 17A−11 are focused on the point 81−12 within the view range on the retina 80. Further, the light beams, which are emitted to be a dominant component from the pixels located at substantially the center among the pixels of the real image 91−12 of the display region 17A−12 located at the center are focused on the point 81−11 within the view range on the retina 80. In addition, the light beams, which are emitted to be a dominant component from the rightward pixels among the pixels of the real image 91−13 of the display region 17A−13 located rightmost are focused on the point 81−13 within the view range on the retina 80.
An image on the point 81−12 is recognized as a virtual image 92−11 by a light beam L1−11A that is virtually obtained by tracing back the light beam L1−11 from the lens 18A−1. An image on the point 81−11 is recognized as a virtual image 92−12 by a light beam L2−12A that is virtually obtained by tracing back the light beam L2−12 from the lens 18A−2. An image on the point 81−13 is recognized as a virtual image 92−13 by a light beam L3−13A that is virtually obtained by tracing back the light beam L3−13 from the lens 18A−3.
In practice, similar phenomena occur in all other pixels, and hence the observer (user) visually recognizes the whole of a plurality of real images displayed in the display regions 17A each including the real images 91−11 to 91−13 as a combined one virtual image through the eye 70. In other words, the virtual-image optical system is configured such that the light emitted from the display unit 10 is focused on the retina 80 on the basis of the principle of the reconstruction of parallax rays.
Pixels in a display region 17A-22A located at substantially a center in
Pixels in a display region 17A−23A located on a rightmost side in
In this way, the same images 111−21 to 111−23 displayed on the display regions 17A−21A to 17A−23A are combined on the eye 70, and visually recognized by the observer (user) as a single image 112. In other words, an image including a left-side part of the image 111−21 (letter S) as a main component, an image including a central part of the image 111−22 (letter S) as a main component, and an image (virtual image) including a right-side part of an image 111−23 (letter S) as a main component are combined into the single image 112 (letter S). The above is performed not only in the left-right direction but also in the up-down direction.
The display apparatus according to Example 21 is a virtual-image display apparatus that presents, by using the virtual-image optical system configured on the basis of the principle of the above-described reconstruction of parallax rays, a virtual image at a position nearer than the display unit 10 having the function of a mirror is near. Further, also in the display apparatus according to Example 21, the same functions and the same advantages as those of the display apparatus according to Example 20 can be obtained. Specifically, it is possible to present the virtual image at a position nearer than the display unit 10 having the function of a mirror is near. With this, it is possible for a person who needs eyesight correction to check his/her own face even without wearing eye glasses or contact lenses. Thus, it is possible to apply skin treatment with naked eyes, for example, after wake-up or before going to bed.
<Aspect Ratio of Virtual Image>
As described above, either one of the display apparatus according to the second embodiment and the display apparatus according to the third embodiment is a virtual-image display apparatus that enables the observer to view a virtual image with both the eyes on the screen of the single display unit 10. Further, the virtual-image display apparatus differs from a stereoscopic-image display apparatus that displays a stereoscopic image (three-dimensional image) on the display surface of the display unit 10 with an aspect ratio equal to the aspect ratio of this display surface in presenting a virtual image at the presentation position different from the position on the display surface of the display unit 10 with an aspect ratio different from the aspect ratio of the display surface. The aspect ratio refers to a ratio (width/height) of the lengths (numbers of pixels) in the vertical direction and the horizontal direction of the display surface of the display unit 10 (screen), and of the virtual image.
Now, aspect-ratio change amounts Δaspect at the time of the presentation of the virtual image in the display apparatus according to the second embodiment and the display apparatus according to the third embodiment are described. The aspect-ratio change amounts Δaspect herein are quotients obtained by dividing the aspect ratio of a virtual image at the time of the virtual image display by the aspect ratio of the display surface of the display unit 10. The aspect ratio herein is described by way of an example of the display apparatus according to Embodiment A of the second embodiment.
As illustrated in
In this case, the horizontal length H′ of the virtual image 15 is determined to be (Ex/2+H/2)×LV/LD−EX/2, and the vertical length V′ of the virtual image 15 is determined to be V′=V/2×LV/LD. Further, the aspect-ratio change amounts Δaspect at the time when the virtual image 15 is displayed are obtained by dividing the aspect ratio of the virtual image 15 by the aspect ratio of the display surface of the display unit 10, that is, obtained by (H′/V′)/(H/V). Therefore, the following equation is established.
Δaspect=1+{EX(LV−LD)/LV×H) (1)
The display apparatus according to the second embodiment and the display apparatus according to the third embodiment are featured in that the aspect-ratio change amounts Δaspect at the time when the virtual image 15 is displayed satisfy the relationship expressed by Equation (1) described above. In other words, as the horizontal width H of the display surface of the display unit 10 becomes smaller, the aspect ratio of the virtual image 15 becomes higher than the aspect ratio of the display surface. Then, when the row direction corresponds to the lateral direction, the virtual image 15 is displayed in a laterally expanded manner, that is, horizontally elongated manner. Further, the horizontal width of the virtual image 15 with respect to the horizontal width of the display surface of the display unit 10 is one or more and two or less. Note that, when the virtual image 15 is displayed on two separate screens, the horizontal width of the virtual image as a whole is more than two, but a horizontal width of the two screens is two.
When a value of Formula (1) described above is more than one, the presentation position of the virtual image 15 with respect to the observer is a position more distant than the display unit 10 is distant (LV>LD), in other words, the virtual image 15 is presented (displayed) at a position deeper than the display unit 10 is deep. In other words, the case where the value of Formula (1) exceeds one corresponds to the case of the display apparatus according to the first embodiment. Further, when the value of Formula (1) is less than one, the presentation position at which the virtual image 15 is presented (displayed) with respect to the observer is a position nearer than the display unit 10 is near (LV<LD). In other words, the case where the value of Formula (1) is less than one corresponds to the cases of the display apparatus according to Embodiment B of the second embodiment and the display apparatus according to the third embodiment.
Further, a change in aspect-ratio change amount Δaspect at the time when the viewing distance LD is changed, for example, from 10 [cm] to 60 [cm] in a case where the virtual image distance LV is, for example, as long as approximately 200 [cm], and that in a case where the virtual image distance LV is, for example, as short as approximately 60 [cm] differ approximately twice from each other. In other words, when the virtual image distance LV is short, it is possible to greatly convert the wide display by changing the viewing distance LD. For example, on a wristwatch-type display apparatus having a small screen size, it is possible to acquire information without bringing the apparatus close to one's face at the time of needing only a small amount of information, such as checking of the time. In addition, at the time of checking, for example, a map containing much information, by bringing the apparatus close to one's face, it is possible to view the map in a display range expanded wide.
The technical scope of the present disclosure is not limited to the scope of Examples described hereinabove. Specifically, various changes or improvements may be made in Examples described hereinabove without departing from the gist of the technology of the present disclosure, and embodiments with such changes or improvements are also encompassed within the technical scope of the present disclosure.
For example, the virtual image lenses 12 that determine the virtual-image presentation position are not limited to the microlenses used in Examples in the second embodiment and the third embodiment described hereinabove, which are arranged in the array in the units of the plurality of adjacent pixels including the left-eye pixel and the right-eye pixel. Alternatively, it is also possible to use, as the virtual image lenses 12, cylindrical lenses arranged in a stripe pattern in the units of the plurality of adjacent pixels including the left-eye pixel and the right-eye pixel.
Further, the left-eye pixel and the right-eye pixel in the cases exemplified in Examples in the second embodiment and the third embodiment described hereinabove, each of which are formed in the units of a single pixel being a unit at the time forming a color image, may be formed in units of the sub-pixels. In this case, the “pixel” in claims is replaced with “sub-pixel.”
In addition, also in the configurations of the display apparatus according to the second embodiment and the display apparatus according to the third embodiment, as in the configuration of the display apparatus according to the first embodiment, the image display with the aspect ratio different from the aspect ratio of the display surface of the display unit 10, and the image display with the aspect ratio equal to the aspect ratio of the display surface may be switched to each other.
Note that, the apertures 91 and the virtual image lenses 12 need not necessarily be arranged in the units of the plurality of adjacent pixels including the left-eye pixel and the right-eye pixel as in the configurations of Examples in the first embodiment to the third embodiment described hereinabove. Alternatively, the apertures 91 and the virtual image lenses 12 may be arranged in units of a single pixel.
Note that, the present disclosure may also provide the following configurations.
[1] A display apparatus, including:
a display unit in which apertures are arranged in units of a plurality of adjacent pixels including a left-eye pixel and a right-eye pixel;
a signal processing unit that generates image information items with respect to the left-eye pixel and the right-eye pixel, respectively, such that an image is presented with an aspect ratio different from an aspect ratio of a display surface of the display unit; and
a display control unit that drives the left-eye pixel and the right-eye pixel on a basis of the image information items generated by the signal processing unit.
[2] The display apparatus according to Item [1], in which
the display unit includes a diffusion layer between the apertures and the pixels.
[5] The display apparatus according to Item [4], in which
the display unit includes separators provided in pixel units in the diffusion layer.
[6] The display apparatus according to Item [5], in which
the separators are made of a material that absorbs visible light.
[7] The display apparatus according to Item [5] or [6], in which
the diffusion layer is partitioned into separate parts by the separators, and pixel-side surfaces thereof are larger than aperture-side surfaces thereof.
[9] The display apparatus according to any of Items [1] to [8], in which
the display unit includes a transparent pad on a layer in which the apertures are provided.
[10] The display apparatus according to any of Items [4] to [9], in which,
the display unit includes a diffraction grating between the pixels and the diffusion layer.
[11] The display apparatus according to any of Items [1] to [10], in which
the display unit includes a liquid-crystal layer that adjusts an intensity of light to be transmitted through the apertures.
[12] The display apparatus according to any of Items [1] to [11], in which
the display unit is capable of selectively forming the apertures with use of an element that is capable of controlling an intensity of light to be transmitted therethrough, and
the display unit
a detection unit that detects positional information and orientation information of eyes of an observer with respect to the display surface of the display unit, in which
the signal processing unit generates the image information items with respect to the left-eye pixel and the right-eye pixel, respectively, on the basis of a result of the detection by the detection unit.
[14] The display apparatus according to Item [13], in which
the detection unit includes an imaging unit that captures an observer, and
the signal processing unit
the detection unit includes a distance measurement unit that measures a distance between the display surface of the display unit and the eyes of the observer, and
the signal processing unit uses a result of the measurement by the distance measurement unit in the calculation of the positional information of the eyes of the observer with respect to the display surface of the display unit.
[16] The display apparatus according to any of Items [1] to [12], in which
the display unit includes lenses arranged in the units of the plurality of adjacent pixels including the left-eye pixel and the right-eye pixel, and
the signal processing unit generates image information items with respect to the left-eye pixel and the right-eye pixel, respectively, such that a virtual image is presented with the aspect ratio different from the aspect ratio of the display surface of the display unit.
[17] The display apparatus according to Item [16], further including
a detection unit that detects positional information and orientation information of eyes of an observer with respect to the display surface of the display unit, in which
the signal processing unit generates the image information items with respect to the left-eye pixel and the right-eye pixel, respectively, on a basis of a result of the detection by the detection unit.
[18] The display apparatus according to Item [17], in which
the detection unit includes an imaging unit that captures an observer, and
the signal processing unit
the detection unit includes a distance measurement unit that measures a distance between the display surface of the display unit and the eyes of the observer, and
the signal processing unit uses a result of the measurement by the distance measurement unit in the calculation of the positional information of the eyes of the observer with respect to the display surface of the display unit.
[20] The display apparatus according to Item [16], in which
the lenses arranged in the units of the plurality of pixels are fixed focus lenses with a fixed focal length.
[21] The display apparatus according to Item [16], in which
the lenses arranged in the units of the plurality of pixels are variable focus lenses with variable focal lengths, and
the display control unit controls the variable focal lengths of the variable focus lenses.
[22] A method of driving a display apparatus, the display apparatus including a display unit in which apertures are arranged in units of a plurality of adjacent pixels including a left-eye pixel and a right-eye pixel, the method including:
generating image information items with respect to the left-eye pixel and the right-eye pixel, respectively, such that an image is presented with an aspect ratio different from an aspect ratio of a display surface of the display unit; and
driving the left-eye pixel and the right-eye pixel on a basis of the generated image information items.
[23] An electronic apparatus, including
a display apparatus including
the variable focus lenses are formed of microlenses arranged in an array.
[A02] The display apparatus according to Item [A01], in which
the display control unit switches virtual image display and real image display to each other by collectively controlling the focal lengths of the microlenses in the display unit.
[A03] The display apparatus according to Item [A01], in which
the display control unit presents a virtual image at distances different from position to position within a display screen by individually controlling the focal lengths of the microlenses in the display unit.
[A04] The display apparatus according to any of Items [16] to [21] or [A01] to [A04], in which,
when a virtual-image presentation position with respect to the observer is more distant than the display unit is distant, the signal processing unit generates virtual-image information such that a left side of a left-eye image and a right side of a right-eye image are adjacent to or overlap with each other at the virtual-image presentation position.
[A05] The display apparatus according to Item [A04], in which,
when the virtual-image presentation position with respect to the observer is more distant than the display unit is distant, an aspect-ratio change amount of the virtual image with respect to the display surface of the display unit is more than one.
[A06] The display apparatus according to any of Items [16] to [21] or [A01] to [A03], in which,
when a virtual-image presentation position with respect to the observer is less distant than the display unit is distant, the signal processing unit generates virtual-image information such that a right side of a left-eye image and a left side of a right-eye image are adjacent to or overlap with each other at the virtual-image presentation position.
[A07] The display apparatus according to Item [A06], in which,
when the virtual-image presentation position with respect to the observer is less distant than the display unit is distant, an aspect-ratio change amount of the virtual image with respect to the display surface of the display unit is less than one.
[A08] The display apparatus according to any of Items [16] to [21] or [A01] to [A03], in which
the left-eye pixel and the right-eye pixel are provided left-right alternately in a pixel array in the display unit, and
the signal processing unit generates virtual-image information such that images that are independent of and different from each other are presented as a left-eye image and a right-eye image at a virtual-image presentation position.
[A09] The display apparatus according to Item [A08], in which
the signal processing unit generates virtual-image information items such that, with respect to each of the left eye and the right eye, the number of pixels of the virtual image in a horizontal direction is half the number of pixels of the display unit, and that the number of pixels in a vertical direction is equal to the number of pixels of the display unit.
[A10] The display apparatus according to any of Items [16] to [21] or [A01] to [A09], in which
a pixel pitch of the display unit is smaller than eyesight resolution.
[A11] The display apparatus according to Item [A10], in which
the pixel pitch of the display unit is half or less of the eyesight resolution.
[A12] The display apparatus according to Item [A11], in which
the pixel pitch of the display unit is 101.8 [um] or less.
[A13] The display apparatus according to Item [A04], in which
a size of the virtual image that is formed when the left-eye image and the right-eye image overlap with each other changes in accordance with a viewing distance from the observer to the display unit.
[A14] The display apparatus according to Item [A04], in which
a size of the virtual image that is formed when the left-eye image and the right-eye image overlap with each other is unchanged regardless of a viewing distance from the observer to the display unit.
[A15] The display apparatus according to Item [A14], in which
a predetermined range from one end of an effective pixel region on the display unit is used as an image display region for the left-eye image, and
a predetermined range from another end of the effective pixel region on the display unit is used as an image display region for the right-eye image.
[A16] The display apparatus according to Item [16], in which
the number of pixels of the virtual image in a horizontal direction is half the number of pixels of the display unit in the horizontal direction, and
the number of pixels in a vertical direction is equal to the number of pixels in a vertical direction of the display unit.
[A17] The display apparatus according to Item [A16], in which
the virtual image is formed in a pattern of intervals of one pixel in the horizontal direction.
[B01] A display apparatus, including:
a display unit in which apertures and lenses are arranged in units of a plurality of pixels;
a detection unit that detects a left eye and a right eye of an observer;
an imaging unit that captures the observer;
a signal processing unit that
a display control unit
when the observer is near-sighted, the virtual image is presented at a position less distant from the observer than the display unit is distant.
[B03] The display apparatus according to Item [B01], in which
when the observer is far-sighted, the virtual image is presented at a position more distant from the observer than the display unit is distant.
[B04] The display apparatus according to any of Items [B01] to [B03], in which
the display unit of the virtual-image optical system includes a lens array unit in which the lenses are arranged in units of a plurality of adjacent pixels including a left-eye pixel and a right-eye pixel,
the signal processing unit generates virtual-image information items with respect to the left-eye pixel and the right-eye pixel, respectively, such that the virtual image is presented with the aspect ratio different from the aspect ratio of the display surface of the display unit on the basis of the result of the detection by the detection unit, and
a drive control unit drives the left-eye pixel and the right-eye pixel on the basis of the virtual-image information items generated by the signal processing unit.
[B05] The display apparatus according to any of Items [B01] to [B03], in which
the virtual-image optical system includes a lens array unit in which the lenses that emit light beams respectively from the plurality of pixels as substantially parallel light beams are each arranged correspondingly and in proximity to corresponding one of display regions each including ones of the plurality of pixels of the display unit, the lenses each emitting light beams of images from the ones of the plurality of pixels in the corresponding one of the display regions,
the lenses of the lens array unit each emit, as the substantially parallel light beams in a direction corresponding to a position within the corresponding one of the display regions, the light beams of the images from the ones of the plurality of pixels in the corresponding one of the display regions such that the light beams are focused on a retina of the observer, and visually recognized as one virtual image by the observer.
[B06] The display apparatus according to any of Items [B01] to [B05], in which
the signal processing unit calculates a viewing distance from the observer to the display unit on the basis of a distance between a left eye and a right eye of the observer in an image taken by the imaging unit, and calculates a virtual image distance to a virtual-image presentation position suited to an eyesight of the observer on the basis of the calculated viewing distance.
[B07] The display apparatus according to Item [B06], in which
the display control unit adjusts the virtual-image presentation position in accordance with the virtual image distance calculated by the signal processing unit.
[B08] The display apparatus according to Item [B06], in which
the signal processing unit presents the calculated virtual image distance to the observer, and
the observer adjusts, in accordance with the presented virtual image distance, the virtual-image presentation position via the display control unit.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2016-035266 | Feb 2016 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2017/001704 | 1/19/2017 | WO | 00 |
