Patent Application
20170046880
The present disclosure relates to a display device and more particularly to a display device for a vehicles.
A head-up display (HUD) is known as a display device for a vehicle (e.g., refer to PTL 1). An exemplary head-up display displays an object that indicates a state of the vehicle and an object for navigating the vehicle. The object that indicates a state of the vehicle may be an object that represents information on a vehicle speed, for example. The object for navigating the vehicle may be an arrow, for example.
The present disclosure provides a display device that is capable of displaying a three-dimensional (3D) image in accordance with a user's situation.
A display device according to an aspect of the present disclosure includes a detector, a projection unit, and a controller. The detector detects positions of eyes of a user. The projection unit projects a two-dimensional (2D) image and a 3D image that is stereoscopically visible with naked eyes of a user. The controller switches an image projected by the projection unit between the 2D image and the 3D image, based on a detection result from the detector.
A display device of the present disclosure is capable of displaying a 3D image in accordance with a user's situation.
A technique for displaying a 3D image is known in the technical field of display devices. Display devices for vehicles, such as head-up displays, need to display a 3D image in accordance with a user's situation, so as not to inhibit his/her driving operation.
Some exemplary embodiments will be given below in detail with reference to the accompanying drawings.
The exemplary embodiments that will be described below are comprehensive, specific examples. Numeric values, shapes, materials, constituent elements, their layouts and connections, process steps, and order of the process steps in the exemplary embodiments are examples and not intended to limit the present disclosure, accordingly.
First, a description will be given of a configuration of a display device according to a first exemplary embodiment.
As illustrated in
Detector 11 detects positions of both the eyes of user 20. More specifically, detector 11 includes, for example at least an image pickup unit that captures an image of the face of user 20 and a processing unit that detects positions of both the eyes of user 20 by using the captured image. In other words, detector 11 captures an image of the front face of user 20 and detects eye positions of user 20 by using the captured image. It should be noted that any given method, such as existing facial recognition technology, may be used to detect eye positions. Detector 11 may detect eye positions about 30 times to 60 times per second, for example. The image pickup unit may be an image pickup device.
Projection unit 12 is an image projection device that projects a 2D image and a 3D image that is stereoscopically visible with naked eyes of user 20. In the first exemplary embodiment, projection unit 12 may be a tablet-shaped image projection device and mounted on the dashboard of the vehicle, for example, as illustrated in
Projection unit 12 projects light onto windshield 15, creating an image at position 30 by using the light reflected by windshield 15. The image created in this manner is a virtual image. When projection unit 12 projects a 2D image, the 2D image is displayed at position 30. The 2D image may be rays forming the 2D image.
Meanwhile, when projection unit 12 projects a 3D image, the 3D image is also displayed at position 30. The 3D image may be rays forming the 3D image. When projection unit 12 projects a 3D image, an image viewed by the left eye of user 20 and an image viewed by the right eye of user 20 are mutually different images between which parallax is present. Herein, an image viewed by the left eye refers to a left-eye image; an image viewed by the right eye refers to a right-eye image. Therefore, when projection unit 12 projects a 3D image, objects contained in the 3D image are visually perceived at near position 30a, far position 30b, and the like in accordance with the parallaxes of the objects.
Projection unit 12 may project an image by means of, for example a liquid crystal on silicon (LCOS) system using a reflective liquid crystal display and a light emitting diode (LED), a digital light processing (DLP (registered trademark)) using a micro mirror array and an LED, or a laser scanning system using a micro electro mechanical systems (MEMS) mirror and a semiconductor laser. The laser scanning system may be a raster scanning system, for example. Note that, a 3D image projected by projection unit 12 is an image that is stereoscopically visible with naked eyes of a user, details of which will be described later.
Acquiring unit 14 obtains vehicle-related information from the vehicle. This vehicle-related information may be information on a vehicle speed, for example. Acquiring unit 14 may obtain the information from devices other than display device 10; examples of those devices include a smartphone and a car navigation system installed inside the vehicle. In addition, acquiring unit 14 may obtain the information via any given communication network, such as a wired or wireless communication network. A communication network may be a communication interface.
Controller 13 switches an image projected by projection unit 12 between a 2D image and a 3D image, based on a detection result from detector 11. Details of the method in which controller 13 switches the images will be described later. As an example, controller 13 causes projection unit 12 to project an image containing an arrow for navigation or an image containing a speed meter, based on the information obtained by acquiring unit 14.
A concrete example of controller 13 is a processor. Controller 13 may be implemented in either hardware only or a combination of hardware and software. As an example, controller 13 may be implemented using a microcontroller.
Next, a description will be given of a method for projecting a 3D image that is stereoscopically visible with naked eyes of user 20. Projection unit 12 projects a 3D image by means of a parallax barrier system, for example.
In the parallax barrier system, as illustrated in
There is provided parallax barrier 50 in front of video element 40. The expression “in front of video element 40” refers to “between video element 40 and user 20”. When left-eye pixel arrays 40L output left-eye images, the left-eye images pass through slits 50a formed in parallax barrier 50 and enter left eye 20L of user 20. Likewise, when right-eye pixel arrays 40R output right-eye images, the right-eye images pass through slits 50a and enter right eye 20R of user 20. In this case, parallax barrier 50 hinders the left-eye images output from left-eye pixel array 40L from entering right eye 20R of user 20. Likewise, parallax barrier 50 hinders the right-eye images output from right-eye pixel array 40R from entering left eye 20L of user 20.
With the configuration described above, projection unit 12 projects a 3D image that is stereoscopically visible with naked eyes of user 20. When projection unit 12 displays a 2D image, corresponding left-eye pixel arrays 40L and right-eye pixel arrays 40R each may output the same image.
Projection unit 12 may project a 3D image by means of a lenticular system.
Switching between 3D Image and 2D Image
In relation to the projecting of a 3D image in the above manner, positions of both the eyes of user 20 on the driver's seat are estimated in advance. Further, an optical system of projection unit 12 is designed such that the left-eye images and the right-eye images enter both the eyes that are expected to be positioned at the estimated positions. If both of the eyes of user 20 are not positioned within a predetermined range, user 20 may fail to stereoscopically view the 3D image appropriately.
If both of the eyes of user 20 are positioned within predetermined range 60, the left-eye images enter left eye 20L and the right-eye images enter right eye 20R. Herein, predetermined range 60 may be a rectangular area defined by the broken line in
If at least one of the eyes of user 20 is positioned outside predetermined range 60, user 20 may fail to stereoscopically view the 3D image appropriately.
If changing his/her attitude during a driving operation, for example, user 20 may fail to stereoscopically view a 3D image appropriately which display device 10 or some other display device for a vehicle displays. In this case, user 20 might have trouble with his/her driving operation, which is in a dangerous situation.
To avoid such dangerous situations, controller 13 in display device 10 switches between a 2D image and a 3D image.
The detection error described above means that detector 11 has failed to detect at least one of positions of both the eyes of user 20. The detection error arises when a hand of user 20 covers an eye of user 20 (
If the detection result from detector 11 is a detection error (Yes in S12), controller 13 causes projection unit 12 to project a 2D image (S16). If the detection result from detector 11 is not a detection error (No in S12), controller 13 determines whether at least one the eyes of user 20 is positioned outside predetermined range 60 (S13).
Examples of a case where at least one of the eyes of user 20 is positioned outside predetermined range 60 include a case where the head of user 20 is shifted in a lateral direction (horizontal direction) (
If detector 11 detects that at least one of eyes of user 20 is positioned outside predetermined range 60 (Yes in S13), controller 13 causes projection unit 12 to project a 2D image (S16). If detector 11 detects that both of the eyes of user 20 are not positioned outside predetermined range 60, that is, are positioned within predetermined range 60 (No in S13), controller 13 determines whether a detected difference in height between the positions of the eyes of user 20 is equal to or more than a preset value (S14). Herein, the preset value is referred to as a first preset value.
A case where a difference in height between the positions of the eyes is equal to or more than the preset value may be a case where user 20 inclines his/her head, increasing height difference L1 between the positions of the eyes, for example, as illustrated in
If detector 11 detects that height difference L1 between the positions of the eyes of user 20 is equal to or more than the preset value (Yes in S14), controller 13 causes projection unit 12 to project a 2D image (S16). If detector 11 detects that height difference L1 between the positions of the both the eyes of user 20 is neither equal to nor more than the preset value, that is, is less than the preset value (No in S14), controller 13 causes projection unit 12 to project a 3D image (S16).
As described above, controller 13 switches an image projected by projection unit 12 between a 2D image and a 3D image, based on a detection result from detector 11. In this way, display device 10 can display a 3D image in accordance with a situation of user 20.
In the flowchart of
In the foregoing first exemplary embodiment, if detector 11 detects that at least one of the eyes of user 20 is positioned outside predetermined range 60, controller 13 causes projection unit 12 to project a 2D image. Alternatively, if detector 11 detects that at least one of the eyes of user 20 is positioned outside predetermined range 60 and a distance between both the eyes of user 20 in a horizontal direction is less than a preset value, controller 13 may cause projection unit 12 to project a 3D image. Herein, the preset value is referred to as a second preset value.
A case where a distance between the positions of the eyes in a horizontal direction is less than the preset value may a case where user 20 turns his/her head away, decreasing distance L2 between the positions of the eyes in a horizontal direction, for example, as illustrated in
When driving a vehicle, user 20 sometimes turns his/her head away in order to check his/her surroundings. In this case, the positions of both the eyes of user 20 usually return to within predetermined range 60 immediately.
A case where user 20 turns his/her head away may be a case where user 20 does not face forward, or toward windshield 15. In this case, even when projection unit 12 projects a 3D image, user 20 does not view this 3D image and thus less likely to stereoscopically view the 3D image appropriately. For this reason, if at least one of the eyes of user 20 is positioned outside predetermined range 60, projection unit 12 may still project a 3D image preferentially.
In the foregoing first exemplary embodiment, controller 13 frequently switches between a 3D image and a 2D image to be projected. This frequent switching may inhibit user 20 from driving the vehicle. So, to decrease the switching frequency, controller 13 may make a determination whether to switch images at predetermined regular intervals, each of which is longer than a period over which detector 11 detects positions of both the eyes.
As illustrated in
If the detection result from detector 11 is a detection error (Yes in S23), controller 13 determines whether a predetermined period has elapsed since an occurrence of the first detection error (an occurrence of the first detection error after the last detection success) (S24). If the detection result is not a detection error in step S23 (No in S23), detector 11 detects positions of both the eyes of user 20 (S22).
If controller 13 determines that the predetermined period has elapsed since an occurrence of the first detection error in step S24 (Yes in S24), controller 13 causes projection unit 12 to project a 2D image (S25). If controller 13 determines that the predetermined period has elapsed since an occurrence of the first detection error in step S24 (No in S24), detector 11 detects positions of both the eyes of user 20 (S22).
As described above, if detection errors continue to occur over a predetermined period, namely, if detector 11 has not successfully detected positions of both the eyes of user 20 over the predetermined period since a failure to detect at least one of positions of the eyes, controller 13 may cause projection unit 12 to project a 2D image. The above configuration suppresses controller 13 from frequently switching between a 3D image and a 2D image to be projected. Therefore, with this configuration, display device 10 can display a 3D image in accordance with a situation of user 20.
In the flowchart illustrated in
In the foregoing first exemplary embodiment, projection unit 12 projects a 2D image when the detection result is a detection error. Alternatively, when the detection result is a detection error, projection unit 12 may project a 3D image.
As described above, a detection error may be caused due to an appearance of a whiteout in an image captured by detector 11 or an occurrence of any disadvantage in detector 11. In short, when a detection error is caused, both the eyes of user 20 are not always positioned at positions unsuitable for a 3D image. The above configuration enables controller 13 to switch between a 2D image and a 3D image at a lower frequency when display device 10 projects a 3D image as a basic operation.
Alternatively, if the detection result is a detection error, controller 13 may maintain an image that is currently being projected. More specifically, if the detection result is a detection error while projection unit 12 is projecting a 2D image, controller 13 may continue to project the 2D image. If the detection result is a detection error while projection unit 12 is projecting a 3D image, controller 13 may continue to project the 3D image. This configuration enables controller 13 to switch between a 2D image and a 3D image at a lower frequency.
The first exemplary embodiment has been described as an example of the present disclosure. However, it can be appreciated that the present disclosure is not limited to the first exemplary embodiment and also applicable to exemplary embodiments that undergo modifications, substitutions, additions, and omissions as appropriate. Furthermore, it can also be appreciated that it is possible to conceive novel exemplary embodiments by combining some constituent elements described in the first exemplary embodiment.
In the foregoing exemplary embodiment, display device 10 projects an image onto windshield 15. Alternatively, for example, display device 10 may project an image onto a combiner.
Display device 10a illustrated in
Alternatively, a display device according to the foregoing exemplary embodiment may project an image onto a translucent display medium other than windshield 15 and combiner 70. Moreover, a display device according to the foregoing exemplary embodiment may be applied to movable bodies other than vehicles, including airplanes.
The exemplary embodiment has been described using the example in which a tablet-shaped image projection device is used as a display device according to the foregoing exemplary embodiment. Alternatively, a configuration in which an optical system including a mirror and a lens is disposed between an image projection device, such as a liquid crystal panel, and a windshield may be employed.
The exemplary embodiment has been described using the example in which detector 11 detects positions of both eyes. Alternatively, a detector may detect a position or orientation of a user's head. Furthermore, detector 11 may detect a user's attitude by using a pressure sensor or the like disposed in a seat on which the user sits. These examples are effective in reducing a cost and size of detector 11.
The constituent elements in the foregoing exemplary embodiment may be implemented in dedicated hardware or by execution of a software program suitable for the constituent elements. Alternatively, the constituent elements may be implemented by reading and executing of a software program stored in a hard disk, semiconductor memory, or other recording medium with a unit for executing a program, such as a CPU or a processor.
A display device (display method) according to one or more aspects has been described based on the exemplary embodiment; however, it can be appreciated that the present disclosure is not limited to this exemplary embodiment. Various modifications of this exemplary embodiment that those skilled in the art can conceive of and some embodiments contemplated based on a combination of constituent elements in different exemplary embodiments may also be contained in the scope of one or more aspects, provided that these modifications and embodiments fall within the spirit of the present disclosure.
In the foregoing exemplary embodiment, for example, a process that would be performed by a specific processing unit may be performed by another processing unit. A plurality of processes may be performed in a different order. Alternatively, a plurality of processes may be performed in parallel.
As described above, a display device according to an aspect of the present disclosure includes: a detector that detects positions of eyes of a user; a projection unit that projects a 2D image and a 3D image that is stereoscopically visible with naked eyes of the user; and a controller that switches an image projected by the projection unit between the 2D image and the 3D image, based on a detection result from the detector.
When the detector fails to detect at least one of the positions of the eyes, the controller may cause the projection unit to project the 2D image.
When the detector detects that at least one of the eyes is positioned outside a predetermined range, the controller may cause the projection unit to project the 2D image.
When the detector detects that a difference in height between the positions of the eyes is equal to or more than a preset value, the controller may cause the projection unit to project the 2D image.
When at least one of the eyes is positioned outside the predetermined range and the detector detects that a distance between the positions of the eyes in a horizontal direction is less than a preset value, the controller may cause the projection unit to project the 3D image.
When the detector has not successfully detected the positions of the eyes over a predetermined period since the failure to detect at least one of the positions of the eyes, the controller may cause the projection unit to project the 2D image.
When the projection unit projects the 3D image, the controller may determine whether to switch a projected image from the 3D image to the 2D image, based on the detection result from the detector.
The projection unit may project an image onto a translucent display medium and allows the user to view the image reflected on the display medium.
The display device may be a head-up display for a vehicle, and the projection unit may project the image onto a windshield or a combiner.
An overall aspect or specific aspects of the above display device may be implemented using a system, a device, an integrated circuit (IC), a computer program, or a recording medium. Alternatively, the overall aspect or specific aspects may be implemented using an arbitrary combination of a system, a device, an integrated circuit (IC), a computer program, and a recording medium.
The present disclosure can be effectively used as a head-up display for a vehicle.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2014-098767 | May 2014 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2015/002338 | 5/8/2015 | WO | 00 |
