Patent Grant
10754154
The present disclosure generally relates to a display device and a moving body having the display device and, more particularly, to a display device for projecting a virtual image on a target space and a moving body having the display device.
Conventionally, there has been known, as a vehicle display device, a head-up display device that superimposes and displays an information image from an image forming unit (image display) into a visual field of a driver (see, for example, PTL 1).
A display device disclosed in PTL 1 is configured to cause light generated by a display surface of an image forming unit to enter a windshield (window member) through a projection lens and guide the light from the display surface to a driver by causing the windshield to reflect the light. The display device disclosed in PTL 1 includes means for detecting a vibration state of a vehicle and a driving device that drives a projection lens, and changes a superimposition position of an image (virtual image) within a visual field of a driver by displacing the projection lens in accordance with a direction of vibration displacement. PTL 1 discloses a technique of reducing vibrations of a virtual image due to vibrations of a vehicle equipped with a display device.
PTL 1: Unexamined Japanese Patent Publication No. 1-293239
The present disclosure provides a display device that can adjust a display position of a virtual image in accordance with various vibrations exerted on the display device and a moving body having the display device.
A display device according to a first aspect includes an image forming unit, a projection unit, a main body unit, and a position correcting unit. The image forming unit includes a display surface and forms an image on the display surface. The projection unit projects a virtual image corresponding to an image on a target space by using output light from the image forming unit. The main body unit is equipped with an image forming unit and a projection unit. The position correcting unit changes a display position of a virtual image relative to the main body unit on the basis of an orientation signal representing an orientation of the main body unit. The position correcting unit includes a plurality of correcting units that change a display position of a virtual image by using different means. The position correcting unit is configured to select at least one correcting unit from the plurality of correcting units in accordance with a frequency component of an orientation signal and causes the selected correcting unit to change a display position of a virtual image.
In a display device according to a second aspect, the plurality of correcting units in the first aspect include an image correcting unit configured to change a display position of a virtual image by changing a position of an image on a display surface.
In a display device according to a third aspect, the position correcting unit in the second aspect is configured to select at least the image correcting unit with respect to a frequency component of the orientation signal which is more than or equal to a predetermined lower limit frequency.
In a display device according to a fourth aspect, the projection unit in any one of the first to third aspects includes an optical element configured to project a virtual image on the target space by reflecting or transmitting output light from the image forming unit. The plurality of correcting units include an element correcting unit configured to change a display position of a virtual image by changing a direction or position of an optical element.
In a display device according to a fifth aspect, the position correcting unit in the fourth aspect is configured to select at least an element correcting unit with respect to a frequency component of an orientation signal which is less than or equal to a predetermined upper limit frequency.
In a display device according to a sixth aspect, the plurality of correcting units in any one of the first to fifth aspects each include a display surface correcting unit configured to change the display position of the virtual image by changing a position of a display surface.
In a display device according to a seventh aspect, the position correcting unit in the sixth aspect is configured to select at least the display surface correcting unit with respect to a frequency component of an orientation signal which is less than or equal to a predetermined upper limit frequency.
In a display device according to an eighth aspect, the plurality of correcting units in any one of the first to seventh aspects each include a first correcting unit and a second correcting unit. The position correcting unit further includes a first filter and a second filter. An orientation signal is input to the first correcting unit via the first filter. An orientation signal is input to the second correcting unit via the second filter.
A moving body according to a ninth aspect includes a display device according to any one of claims 1 to 8 and a reflecting member configured to reflect light from a projection unit.
The present disclosure has an advantage of being capable of adjusting a display position of a virtual image in accordance with various vibrations exerted on a display device.
Prior to describing an exemplary embodiment according to the present disclosure, disadvantages of the conventional technique will briefly be described. The display device disclosed in PTL 1 adjusts a display position of a virtual image within a visual field of a driver by using a single means (for example, driving the projection lens) regardless of frequency components of vibrations exerted on the display device (vibrations of a vehicle). Accordingly, for example, when various vibrations are exerted on the display device due to road surface conditions, acceleration and deceleration of the vehicle, and the like, vibrations of a virtual image may not be reduced only by adjusting a display position of the virtual image depending on a type of vibrations. When, for example, a means for adjusting a display position of a virtual image corresponds to vibrations having a relatively small amplitude and a relatively high frequency, vibrations of a virtual image which have a relatively large amplitude and a relatively low frequency sometimes cannot be reduced.
(1) Outline
Display device 10 according to the first exemplary embodiment is, for example, a head-up display (HUD) used for automobile 100 as a moving body, as shown in
As shown in
As shown in
Display device 10 makes user 200 visually recognize, through windshield 101, virtual images 300 projected on target space 400 set in front of (outside) automobile 100. In this case, “virtual image” indicates an image formed by divergent rays of light, which are formed when light emitting from display device 10 is diverged by a reflecting object such as windshield 101, so as to appear as if an actual object were present. This allows user 200 driving automobile 100 to see virtual images 300 projected by display device 10 so as be superimposed on a real space spreading in front of automobile 100, as shown in
In display device 10 according to the first exemplary embodiment, virtual images 300 formed in target space 400 include two types of virtual images such as at least first virtual image 301 and second virtual image 302. In this case, the “first virtual image” is, for example, navigation information indicating a traveling direction of automobile 100, and can present, for example, an arrow indicating a right turn or left turn on road surface 600. First virtual image 301 of this type is an image displayed by using an augmented reality (AR) technique, and is superimposed and displayed at a specific position in an actual scenery (road surface 600, buildings, neighboring vehicles, pedestrians, and the like) viewed by user 200. Second virtual image 302 is, for example, vehicle speed information, and can, for example, present a current running speed (vehicle speed) of automobile 100. In a case of
Display device 10 forms virtual images 300, formed in target space 400, on virtual plane 501 intersecting with optical axis 500 of display device 10. In the first exemplary embodiment, optical axis 500 extends along road surface 600 in front of automobile 100 in target space 400 in front of automobile 100. Virtual plane 501 on which virtual images 300 are formed is almost vertical to road surface 600. For example, when road surface 600 is a horizontal plane, virtual image 300 are displayed along a vertical plane.
In this case, display device 10 according to the first exemplary embodiment includes image forming unit 2, projection unit 3, and main body unit 1. Image forming unit 2 includes display surface 20 and forms image 700 on display surface 20 (see
Display device 10 according to the first exemplary embodiment further includes position correcting unit 4 for correcting a display position of each virtual image 300. Position correcting unit 4 changes the display position of virtual image 300 relative to main body unit 1 on the basis of orientation signal Si1 representing an orientation of main body unit 1. In this case, position correcting unit 4 includes a plurality (two in the case of
This adjusts the display position of each virtual image 300 in accordance with an orientation of main body unit 1. Accordingly, even when, for example, automobile 100 is set in the front inclined orientation or rear inclined orientation, display device 10 can superimpose and display first virtual image 301 at a specific position where the image should be superimposed in an actual scenery when viewed from user 200. Display device 10 according to the first exemplary embodiment selectively uses the plurality of correcting units (41, 42) that change the display position of virtual image 300 by using different means in accordance with a frequency component of orientation signal Si1. Even if, therefore, various vibrations are exerted on main body unit 1 of display device 10 due to a condition of road surface 600, acceleration and deceleration of automobile 100, and the like, it is possible to change the display position of virtual image 300 by using a correcting unit (41, 42) suitable for a type (frequency component) of vibrations. Accordingly, display device 10 has an advantage of being capable of adjusting the display position of virtual image 300 in accordance with various vibrations exerted on display device 10.
(2) Configuration
Display device 10 according to the first exemplary embodiment includes main body unit 1, image forming unit 2, projection unit 3, and position correcting unit 4, as shown in
Main body unit 1 is formed from, for example, one housing. Accommodating image forming unit 2 and projection unit 3 in main body unit 1 will mount image forming unit 2 and projection unit 3 on main body unit 1. In the first exemplary embodiment, constituent elements (position correcting unit 4, display controller 51, mirror driving unit 52, and module driving unit 53) other than image forming unit 2 and projection unit 3 are also mounted (accommodated) in main body unit 1. Main body unit 1 is fixed in dashboard 102 of automobile 100. Note, however, that constituent elements (position correcting unit 4, display controller 51, mirror driving unit 52, and module driving unit 53) other than image forming unit 2 and projection unit 3 may not be mounted in main body unit 1. In addition, main body unit 1 may be constituted by a plurality of housings or need not be a housing. For example, main body unit 1 may be a frame or plate member.
Image forming unit 2 includes display surface 20 and forms image 700 on display surface 20 (see
While image forming unit 2 displays an image on liquid crystal panel 21, when light source device 22 emits light, the light output forward from light source device 22 is transmitted through liquid crystal panel 21 and output forward from the front surface (display surface 20) of liquid crystal panel 21. In this case, light output forward from display surface 20 is light reflecting an image displayed on liquid crystal panel 21. When display surface 20 is viewed from front, it looks as if image 700 were displayed on display surface 20, and hence image 700 is formed on display surface 20.
In this case, a longitudinal direction of display surface 20 coincides with a longitudinal direction of image 700, and a transverse direction of display surface 20 coincides with a transverse direction of image 700. The longitudinal direction of projected image 700 coincides with a longitudinal direction of each virtual image 300 (see
Projection unit 3 projects virtual images 300 corresponding to image 700 on target space 400 by using output light from image forming unit 2. According to the first exemplary embodiment, as described above, display device 10 is a head-up display configured to project an image on windshield 101 (see
In the first exemplary embodiment, for example, projection unit 3 includes first mirror 31 and second mirror 32, as shown in
That is, first mirror 31 is disposed on an opposite side to light source device 22 when viewed from liquid crystal panel 21, that is, in front of liquid crystal panel 21, so as to make output light from image forming unit 2 enter first mirror 31. First mirror 31 reflects output light from image forming unit 2 toward second mirror 32. Second mirror 32 is disposed at a position where output light from image forming unit 2 which is reflected by first mirror 31 enters second mirror 32. Second mirror 32 reflects output light from image forming unit 2, which is reflected by first mirror 31, toward a target object (windshield 101). In the first exemplary embodiment, first mirror 31 is a convex mirror, and second mirror 32 is a concave mirror.
As described above, projection unit 3 projects image 700 (see
Display controller 51 controls image forming unit 2 (liquid crystal panel 21 and light source device 22). Display controller 51 is formed from, for example, a microcomputer including a central processing unit (CPU) and a memory as main components. In other words, display controller 51 is implemented by a computer including a CPU and a memory. The CPU executes a program stored in the memory to cause the computer to function as display controller 51. Although the program is recorded in advance in a memory of display controller 51 in this case, the program may be provided via an electric communication line such as the Internet or provided by being recorded on a recording medium such as a memory card.
Display controller 51 forms arbitrary image 700 on display surface 20 by controlling image forming unit 2. That is, display controller 51 can cause liquid crystal panel 21 to display (draw) an arbitrary video content by performing software processing, thereby forming arbitrary image 700 on display surface 20. When, for example, virtual images 300 (first virtual image 301 and second virtual image 302) like those shown in
Mirror driving unit 52 moves an optical element included in projection unit 3. That is, mirror driving unit 52 changes a direction or position of the optical element. In the first exemplary embodiment, a target to be driven by mirror driving unit 52 is second mirror 32. Mirror driving unit 52 changes the direction of second mirror 32 by rotating second mirror 32. Accordingly, a direction of light reflected by second mirror 32 changes in accordance with a rotation angle (deflection angle) of second mirror 32, and a display position of each virtual image 300 relative to main body unit 1 changes. In this case, mirror driving unit 52 changes the display position of virtual image 300 projected on target space 400 in a longitudinal direction by rotating at least second mirror 32, in a direction of arrow A1 in
Module driving unit 53 moves image forming unit 2. That is, module driving unit 53 physically changes a position or direction of display surface 20. In the first exemplary embodiment, targets to be driven by module driving unit 53 are liquid crystal panel 21 and light source device 22. Module driving unit 53 changes the position of display surface 20 by rectilinearly moving image forming unit 2. Accordingly, the position of image 700 relative to main body unit 1 changes in accordance with a movement amount of display surface 20, and the display position of each virtual image 300 relative to main body unit 1 changes. In this case, module driving unit 53 changes the display position of virtual image 300 projected on target space 400 in the longitudinal direction by at least rectilinearly moving image forming unit 2 in a direction of arrow A2 in
Position correcting unit 4 includes a plurality of correcting units (first correcting unit 41 and second correcting unit 42), orientation detector 43, high-pass filter 44 (written as “HPF” in
Position correcting unit 4 is formed from, for example, a microcomputer including a CPU and a memory as main components. In this case, high-pass filter 44 and low-pass filter 45 are formed from digital filters. However, high-pass filter 44 and low-pass filter 45 are formed from analog filters. At least some functions (for example, first correcting unit 41 and second correcting unit 42) of position correcting unit 4 may share single microcomputer with display controller 51.
Orientation detector 43 detects the orientation of main body unit 1 by acquiring orientation information representing an orientation of automobile 100 (automobile body) from an electronic control unit (ECU) mounted in automobile 100. That is, because main body unit 1 is fixed to dashboard 102, the orientation of main body unit 1 coordinates with the orientation of automobile 100 (automobile body), and it is possible to detect the orientation of main body unit 1 from orientation information of automobile 100. Orientation detector 43 outputs orientation signal Si1 representing the orientation of main body unit 1 upon detecting the orientation of main body unit 1. Orientation signal Si1 is a signal whose instantaneous value represents at least a tilt amount (for example, an angle) of automobile 100 relative to a horizontal plane in a pitching direction. In this case, “pitching” indicates rotation about an axis extending through automobile 100 in a horizontal direction centered on a center of gravity of automobile 100, that is, rotation leading to the front inclined orientation or rear inclined orientation.
When, for example, automobile 100 is set in the rear inclined orientation at the time of acceleration of automobile 100 to tilt by 5° (elevation angle of 5°) with respect to a horizontal plane, the instantaneous value of orientation signal Si1 becomes a value corresponding to “5”. In contrast, when automobile 100 is set in the front inclined orientation at the time of deceleration of automobile 100 to tilt by 5° (depression angle of 5°) with respect to a horizontal plane, the instantaneous value of orientation signal Si1 becomes a value corresponding to “−5”. The orientation of automobile 100 with no tilt in the pitching direction relative to a horizontal plane will be referred to as a “reference orientation”. At this time, the instantaneous value of orientation signal Si1 becomes a value corresponding to “0”. Accordingly, while vibrations are exerted on automobile 100 in the pitching direction, an amplitude of orientation signal Si1 corresponds to an amplitude of vibrations of automobile 100, and a frequency of orientation signal Si1 corresponds to a frequency (number) of vibrations of automobile 100.
High-pass filter 44 is configured to receive orientation signal Si1 from orientation detector 43 and passes only a high-frequency component of orientation signal Si1. In this case, the “high-frequency component” is a frequency component more than or equal to a predetermined lower limit frequency (cutoff frequency) of high-pass filter 44. That is, a frequency component (high-frequency component) more than or equal to the lower limit frequency of orientation signal Si1 passes through high-pass filter 44, and a frequency component less than the lower limit frequency is reduced by high-pass filter 44.
Low-pass filter 45 is configured to receive orientation signal Si1 from orientation detector 43 and passes only a low-frequency component of orientation signal Si1. In this case, the “low-frequency component” is a frequency component less than or equal to a predetermined upper limit frequency (cutoff frequency) of low-pass filter 45. That is, a frequency component (low-frequency component) less than or equal to the upper limit frequency of orientation signal Si1 passes through low-pass filter 45, and a frequency component exceeding the upper limit frequency is reduced by low-pass filter 45.
In this case, position correcting unit 4 is configured such that orientation signal Si1 is input to first correcting unit 41 via high-pass filter 44 as a first filter, and orientation signal Si1 is input to second correcting unit 42 via low-pass filter 45 as a second filter. That is, first correcting unit 41 is connected to an output of high-pass filter 44, and second correcting unit 42 is connected to an output of low-pass filter 45.
With this configuration, position correcting unit 4 selects at least one correcting unit from a plurality of correcting units (first correcting unit 41 and second correcting unit 42) in accordance with a frequency component of orientation signal Si1, and the selected correcting unit changes the display position of each virtual image 300. Position correcting unit 4 selects at least first correcting unit 41 (image correcting unit) with respect to a frequency component of orientation signal Si1 which is more than or equal to a predetermined lower limit frequency. In addition, position correcting unit 4 selects at least second correcting unit 42 (an element correcting unit or display surface correcting unit) with respect to a frequency component of orientation signal Si1 which is less than or equal to a predetermined upper limit frequency.
In the first exemplary embodiment, for example, a cutoff frequency (lower limit frequency) of high-pass filter 44 is almost equal to a cutoff frequency (upper limit frequency) of low-pass filter 45. However, this is not exhaustive, and the cutoff frequency (lower limit frequency) of high-pass filter 44 may be different from the cutoff frequency (upper limit frequency) of low-pass filter 45.
A plurality of correcting units (first correcting unit 41 and second correcting unit 42) change the display position of each virtual image 300 by using different means. That is, although first correcting unit 41 and second correcting unit 42 each have a function for changing the display position of virtual image 300, first correcting unit 41 and second correcting unit 42 use different means (methods) for changing the display position of virtual image 300.
In the first exemplary embodiment, first correcting unit 41 controls display controller 51. That is, first correcting unit 41 functions as an image correcting unit that changes the display position of each virtual image 300 by changing the position of image 700 on display surface 20. More specifically, first correcting unit 41 controls display controller 51 in accordance with an output from high-pass filter 44, that is, a high-frequency component of orientation signal Si1. In this case, first correcting unit 41 controls display controller 51 with respect to at least first virtual image 301 to change the position of image 700 on display surface 20 so as to absorb (reduce) a change in the position of virtual image 300 in target space 400 due to a change in the orientation of main body unit 1. This makes it possible to cope with vibrations, of vibrations of automobile 100, which have a high-frequency component, by adjusting the display position of virtual image 300 relative to main body unit 1 by using first correcting unit 41.
Second correcting unit 42 controls mirror driving unit 52 and module driving unit 53. That is, second correcting unit 42 functions as an element correcting unit that changes the display position of each virtual image 300 by causing mirror driving unit 52 to control to change a direction or position of an optical element (second mirror 32). In addition, second correcting unit 42 functions as a display surface correcting unit that changes the display position of virtual image 300 by changing the position of display surface 20 by controlling module driving unit 53. More specifically, second correcting unit 42 controls at least one of mirror driving unit 52 and module driving unit 53 in accordance with an output from low-pass filter 45, that is, a low-frequency component of orientation signal Si1. In this case, second correcting unit 42 changes a direction of second mirror 32 by controlling mirror driving unit 52 so as to absorb (reduce) a change in the position of virtual image 300 in target space 400 due to a change in the orientation of main body unit 1 with respect to both first virtual image 301 and second virtual image 302. Alternatively, second correcting unit 42 changes the position of display surface 20 by controlling module driving unit 53 so as to absorb (reduce) a change in the position of virtual image 300 in target space 400 due to a change in the orientation of main body unit 1 with respect to both first virtual image 301 and second virtual image 302. Accordingly, it is possible to cope with vibrations, of vibrations of automobile 100, which have a low-frequency component, by adjusting the display position of virtual image 300 relative to main body unit 1 by using second correcting unit 42.
(3) Operation
An operation of display device 10 described above will be described next.
(3.1) Basic Operation of Position Correcting Unit
A basic operation of position correcting unit 4 will be described first with reference to
As shown in
As shown in
In this case, position correcting unit 4 causes first correcting unit 41 to change the display position of virtual image 300 by changing the position of image 700 on display surface 20. Details of correction by first correcting unit 41 will be described in “(3.2) Operation of first correcting unit”. Accordingly, as shown in
As shown in
In this case, position correcting unit 4 causes first correcting unit 41 to change the display position of virtual image 300 by changing the position of image 700 on display surface 20. As a result, as shown in
As described above, for example, with respect to vibrations having a high-frequency component of automobile 100, position correcting unit 4 causes first correcting unit 41 to reduce a change in the position of virtual image 300 in target space 400 due to a change in the orientation of main body unit 1 by changing the position of image 700 on display surface 20. In the first exemplary embodiment, first correcting unit 41 changes the display position of only first virtual image 301 of first virtual image 301 and second virtual image 302 relative to main body unit 1, and hence the position of second virtual image 302 changes in target space 400 as the orientation of main body unit 1 changes.
In this case, it is assumed that vibrations having a relatively small amplitude and a relatively high frequency are exerted on automobile 100. However, other types of vibrations may be exerted on automobile 100. For example, when vibrations having a relatively large amplitude and a relatively low frequency are exerted on automobile 100, position correcting unit 4 causes second correcting unit 42 to change the display position of virtual image 300. In addition, when vibrations including both a high-frequency component and a low-frequency component are exerted on automobile 100, position correcting unit 4 causes both first correcting unit 41 and second correcting unit 42 as a combination to change the display position of virtual image 300.
(3.2) Operation of First Correcting Unit
An operation of first correcting unit 41 will be described next with reference to
As shown in
First correcting unit 41 can move the display position of first virtual image 301(X) in a direction opposite to that in the case shown in
As described above, first correcting unit 41 causes display controller 51 to change the position of image 700 on display surface 20, and hence can respond to a change in the orientation of main body unit 1 at a relatively high speed, and can adjust the display position of virtual image 300 so as to follow up vibrations having a high-frequency component. That is, first correcting unit 41 can adjust the display position of virtual image 300 so as to reduce an influence of vibrations having a relatively small amplitude and a relatively high frequency.
First correcting unit 41 changes the display position of virtual image 300 relative to main body unit 1 by changing the position of image 700 on display surface 20. Accordingly, as described above, first correcting unit 41 can change the display position of only first virtual image 301 of first virtual image 301 and second virtual image 302, relative to main body unit 1. First correcting unit 41 may change the display position of at least one of first virtual image 301 and second virtual image 302 relative to main body unit 1. For example, first correcting unit 41 may change the display positions of both first virtual image 301 and second virtual image 302 relative to main body unit 1. In this case, it is possible to reduce changes in the positions of first virtual image 301 and second virtual image 302 in target space 400 due to a change in the orientation of main body unit 1.
(3.3) Operation of Second Correcting Unit
An operation of second correcting unit 42 will be described next with reference to
A case in which second correcting unit 42 controls mirror driving unit 52 to change a direction of second mirror 32 will be described first with reference to
Second correcting unit 42 can move the display position of first virtual image 301(X) in a direction opposite to that in the case of
A case in which second correcting unit 42 changes the position of display surface 20 by controlling module driving unit 53 will be described next with reference to
Second correcting unit 42 can move the display position of first virtual image 301(X) in a direction opposite to that in the case of
As described above, second correcting unit 42 physically moves an optical element or display surface 20, and hence can change a projection range of output light from image forming unit 2 in target space 400 in accordance with a change in the orientation of main body unit 1. That is, second correcting unit 42 can change the display position of virtual image 300 together with display area 401 (see
Second correcting unit 42 changes the display position of virtual image 300 relative to main body unit 1 by changing a direction or position of an optical element (second mirror 32) or changing the position of display surface 20. Accordingly, second correcting unit 42 changes the display positions of both first virtual image 301 and second virtual image 302 relative to main body unit 1. That is, second correcting unit 42 moves virtual image 300 in target space 400 together with display area 401 (see
The first exemplary embodiment is merely one of various exemplary embodiments of the present disclosure. The first exemplary embodiment can be variously modified in accordance with a design, for example, as long as the object of the present disclosure can be achieved. Furthermore, the aspect according to the first exemplary embodiment is not limited to be embodied by a display device alone. The aspect according to the first exemplary embodiment may be embodied by a system, a method for controlling a display device, a computer program, or a recording medium storing a program, for example. The modifications described below can be applied while being combined as appropriate.
Orientation detector 43 is not limited to a configuration for acquiring orientation information from an electronic control unit (ECU) of automobile 100 or the like, and may have a configuration including sensors such as an acceleration sensor and a gyro sensor and configured to detect the orientation of main body unit 1 on the basis of outputs from the sensors.
Position correcting unit 4 may include a plurality of correcting units (first correcting unit 41 and second correcting unit 42) that change the display position of virtual image 300 by respectively using different means, and may include three or more correcting units.
The filters included in position correcting unit 4 are not limited to high-pass filter 44 and low-pass filter 45. For example, position correcting unit 4 may include a bandpass filter and a clipping filter for limiting an amplitude.
It is not essential for display device 10 to project two types of virtual images 300 including first virtual image 301 and second virtual image 302 into target space 400. Display device 10 may project one type of virtual image 300 on target space 400. In addition, it is not essential for display device 10 to make virtual images 300 include an image displayed by using an augmented reality technique, such as first virtual image 301.
Details of correction by position correcting unit 4 may differ depending on a content of virtual image 300 (for example, first virtual image 301 or second virtual image 302). For example, orientation signal Si1 for execution of correction may have different frequency components between first virtual image 301 and second virtual image 302. For example, position correcting unit 4 executes display position adjustment for both first virtual image 301 and second virtual image 302 with respect to a high-frequency component, and executes display position adjustment for only first virtual image 301 with respect to a low-frequency component.
Display surface 20 may tilt relative to optical axis 500. In this case, display device 10 can project not only virtual image 300 perpendicular to road surface 600 but also virtual image 300 displayed along road surface 600. That is, display device 10 can display virtual image 300 visually recognized with a depth along road surface 600.
Position correcting unit 4 may change the display position of virtual image 300 relative to main body unit 1 in accordance with not only a change in the orientation of automobile 100 in the pitching direction but also, for example, a change in the orientation of automobile 100 in a rolling direction or yawing direction. In this case, “rolling” means rotation of automobile 100 about an axis extending through automobile 100 in a front-back direction centered on the center of gravity of automobile 100, that is, a tilt of automobile 100 in a transverse direction. In this case, “yawing” means rotation of automobile 100 about an axis extending through automobile 100 in an up-down direction centered on the center of gravity of automobile 100.
Projection unit 3 may include at least an optical element, and need not necessarily include two mirrors including first mirror 31 and second mirror 32. That is, projection unit 3 may include only one mirror or three or more mirrors. In addition, projection unit 3 may include, for example, an optical component other than a mirror, such as a lens. In this case, second correcting unit 42 (element correcting unit) may change the display position of virtual image 300 by changing a direction or position of a lens (optical element) that transmits light emitting from image forming unit 2. Projection unit 3 may or may not include a relay optical system for forming an intermediate image.
Display device 10 is not limited to the configuration for projecting virtual image 300 on target space 400 set in front of automobile 100 in a traveling direction, and may, for example, project virtual image 300 on a lateral, rear, or upper side of automobile 100 in the traveling direction.
Display device 10 is not limited to a head-up display used for automobile 100 and can be applied to moving bodies other than automobile 100, such as a motorcycle, train, aircraft, construction machine, and vessel. In addition, display device 10 may be used for, for example, amusement facilities as well as a moving body, and may be used as a wearable terminal such as a head-mounted display (HMD), medical equipment, and stationary device. Display device 10 may also be incorporated as, for example, an electronic viewfinder in equipment such as a digital camera.
Display device 10A according to the second exemplary embodiment differs in a configuration of image forming unit 2A from display device 10 according to the first exemplary embodiment, as shown in
That is, in the second exemplary embodiment, image forming unit 2A includes diffuse transmission screen 23 and irradiation unit 24 that irradiates screen 23 with light from a back of screen 23. Irradiation unit 24 is a scanning type irradiation unit, which irradiates screen 23 with light. With this configuration, image 700 is drawn on display surface 20A formed from a front surface or back surface (the front surface in this case) of screen 23 by light from irradiation unit 24, and virtual image 300 (see
Irradiation unit 24 includes light source 241 that outputs laser light, scanning unit 242 that scans light from light source 241, and lens 243. Light source 241 is formed from a laser module that outputs laser light. Scanning unit 242 irradiates screen 23 with light scanning display surface 20A by scanning light from light source 241. In this case, scanning unit 242 performs a raster scan operation of two-dimensionally scanning light in a longitudinal direction and a transverse direction of display surface 20A. That is, scanning unit 242 forms a two-dimensional image by scanning a bright spot formed on display surface 20A. Scanning unit 242 includes, for example, a micro scanning mirror using a micros-electron mechanical systems (MEMS) technique. That is, scanning unit 242 includes an optical element (mirror portion) that reflects laser light, and reflects light from light source 241 in a direction corresponding to a rotation angle (deflection angle) of the optical element by rotating the optical element. This causes scanning unit 242 to scan light from light source 241. Scanning unit 242 executes a raster scan operation of two-dimensionally scanning light by rotating the optical element about two orthogonal axes.
In display device 10A according to the second exemplary embodiment, first correcting unit 41 (see
An operation of display device 10A according to the second exemplary embodiment will be described next.
As shown in
First correcting unit 41 can move the display position of first virtual image 301(X) in a direction opposite to that in the case of
As described above, first correcting unit 41 changes the position of image 700 on display surface 20A by using scanning unit 242, and hence can respond to a change in orientation of main body unit 1 at relatively high speed and adjust the display position of virtual image 300 so as to follow up vibrations having a high-frequency component. That is, first correcting unit 41 can adjust the display position of virtual image 300 so as to reduce an influence of vibrations having a relatively small amplitude and a relatively high frequency.
First correcting unit 41 changes the display position of virtual image 300 relative to main body unit 1 by changing the position of image 700 on display surface 20A. Accordingly, first correcting unit 41 can change the display position of only first virtual image 301 of first virtual image 301 and second virtual image 302 relative to main body unit 1. First correcting unit 41 may change the display position of at least one of first virtual image 301 and second virtual image 302 relative to main body unit 1. For example, first correcting unit 41 may change the display positions of both first virtual image 301 and second virtual image 302 relative to main body unit 1. In this case, it is possible to reduce changes in the positions of first virtual image 301 and second virtual image 302 in target space 400 due to a change in the orientation of main body unit 1.
In the second exemplary embodiment, image forming unit 2A may be configured to project image 700 on diffuse transmission screen 23 from back of screen 23 by using a projector. In this case, first correcting unit 41 can change the position of image 700 on display surface 20A by controlling the projector.
The configuration of display device 10A according to the second exemplary embodiment (including the modification) can be combined with the configuration of the first exemplary embodiment (including the modification) as needed.
The drawings illustrated in each exemplary embodiment described above are merely conceptual diagrams for explaining an example of display device 10 (or 10A), and are different in shapes, sizes, positional relationships, and the like of the respective members from actual display device 10 (or 10A) as appropriate.
(Overview)
As has been described above, display device (10, 10A) according to the first aspect includes image forming unit (2, 2A), projection unit (3), main body unit (1), and position correcting unit (4). Image forming unit (2, 2A) includes display surface (20, 20A) and forms image (700) on display surface (20, 20A). Projection unit (3) projects virtual image (300) corresponding to image (700) on target space (400) by using output light from image forming unit (2, 2A). Main body unit (1) incorporates image forming unit (2, 2A) and projection unit (3). Position correcting unit (4) changes the display position of virtual image (300) relative to main body unit (1) on the basis of orientation signal (Si1) representing the orientation of main body unit (1). Position correcting unit (4) includes a plurality of correcting units (41, 42) that change the display position of virtual image (300) by using different means. Position correcting unit (4) is configured to select at least one correcting unit from the plurality of correcting units (41, 42) in accordance with a frequency component of orientation signal (Si1) and cause the selected correcting unit to change the display position of virtual image (300).
According to this configuration, the display position of virtual image (300) relative to main body unit (1) is adjusted in accordance with the orientation of main body unit (1). Accordingly, even when the orientation of main body unit (1) changes, display device (10, 10A) can, for example, superimpose and display virtual image (300) at a specific position where the virtual image should be superimposed on an actual scenery viewed from user (200). In addition, display device (10, 10A) selectively uses a plurality of correcting units (41, 42) that change the display position of virtual image (300) by using different means in accordance with a frequency component of orientation signal (Si1). Therefore, for example, even when various vibrations are exerted on main body unit (1), it is possible to change the display position of virtual image (300) by using correcting unit (41, 42) suitable for a type of vibrations (frequency component). As a result, display device (10, 10A) has an advantage of being capable of adjusting the display position of virtual image (300) in accordance with various vibrations exerted on display device (10, 10A).
In display device (10, 10A) according to the second aspect, the plurality of correcting units (41, 42) according to the first exemplary embodiment include an image correcting unit (for example, first correcting unit 41) that changes the display position of virtual image (300) by changing the position of image (700) on display surface (20, 20A). According to this configuration, the image correcting unit changes the position of image (700) on display surface (20, 20A) and hence can respond to a change in the orientation of main body unit (1) at relatively high speed.
In display device (10, 10A) according to the third aspect, position correcting unit (4) according to the second aspect is configured to select at least an image correcting unit with respect to a frequency component of orientation signal (Si1) which is more than to equal to a predetermined lower limit frequency. According to this configuration, position correcting unit (4) can change the display position of virtual image (300) by using an image correcting unit with respect to vibrations having a high-frequency component, thereby improving responsiveness with respect to a change in the display position of virtual image (300) due to vibrations having a high-frequency component.
In display device (10, 10A) according to the fourth aspect, projection unit (3) according to any one of the first to third aspects includes an optical element (for example, second mirror 32) that projects virtual image (300) on target space (400) by reflecting or transmitting output light from image forming unit (2, 2A). A plurality of correcting units (41, 42) each include an element correcting unit (for example, second correcting unit 42) that changes the display position of virtual image (300) by changing a position or direction of an optical element. This configuration enables the image correcting unit to reduce a chance of hiding part of virtual image (300) even with a relatively large change in the orientation of main body unit (1) because the image correcting unit changes a projection range of output light from image forming unit (2, 2A) on target space (400).
In display device (10, 10A) according to the fifth aspect, position correcting unit (4) according to the fourth aspect is configured to select at least an element correcting unit with respect to a frequency component of orientation signal (Si1) which is less than or equal to a predetermined upper limit frequency. According to this configuration, position correcting unit (4) can cause the element correcting unit to change the display position of virtual image (300) with respect to vibrations having a low-frequency component, thereby improving responsiveness to a change in the display position of virtual image (300) with respect to vibrations having a relatively large amplitude and a relatively low frequency.
In display device (10, 10A) according to the sixth aspect, the plurality of correcting units (41, 42) according to any one of the first to fifth aspects each include a display surface correcting unit (for example, second correcting unit 42) that changes the display position of virtual image (300) by changing a position of display surface (20, 20A). This configuration enables the display surface correcting unit to reduce a chance of hiding part of virtual image (300) even with a relatively large change in the orientation of main body unit (1) because the display surface correcting unit changes a projection range of output light from image forming unit (2, 2A) on target space (400).
In display device (10, 10A) according to the seventh aspect, position correcting unit (4) according to the sixth aspect is configured to select at least a display surface correcting unit with respect to a frequency component of orientation signal (Si1) which is less than or equal to a predetermined upper limit frequency. This configuration enables position correcting unit (4) to change the display position of virtual image (300) by using the display surface correcting unit with respect to vibrations having a low-frequency component, thereby improving responsiveness to a change in the display position of virtual image (300) with respect to vibrations having a relatively large amplitude and a relatively low frequency.
In display device (10, 10A) according to the eighth aspect, the plurality of correcting units (41, 42) according to any one of the first to seventh aspects include first correcting unit (41) and second correcting unit (42). Position correcting unit (4) further includes a first filter (for example, high-pass filter 44) and a second filter (for example, low-pass filter 45). Orientation signal (Si1) is input to first correcting unit (41) via the first filter. Orientation signal (Si1) is input to second correcting unit (42) via the second filter. This configuration enables position correcting unit (4) to passively select at least one correcting unit from the plurality of correcting units (41, 42) in accordance with a frequency component of orientation signal (Si1) via the first filter and the second filter. This can simplify the configuration of position correcting unit (4).
A moving body (for example, automobile 100) according to the ninth aspect includes display device (10, 10A) according to any one of the first to eighth aspects and a reflecting member (for example, windshield 101) that reflects light from projection unit (3).
This configuration adjusts the display position of virtual image (300) relative to main body unit (1) in accordance with an orientation of the moving body. Accordingly, even when the orientation of the moving body changes, display device (10, 10A) can, for example, superimpose and display virtual image (300) at a specific position where the image should be superimposed on an actual scenery viewed from user (200). In addition, display device (10, 10A) selectively uses a plurality of correcting units (41, 42) that change the display position of virtual image (300) by using different means in accordance with a frequency component of orientation signal (Si1). Therefore, even when, for example, various vibrations are exerted on the moving body, it is possible to change the display position of virtual image (300) by using correcting unit (41, 42) suitable for a type (frequency component) of vibrations. As a result, display device (10, 10A) has an advantage of being capable of adjusting the display position of virtual image (300) in accordance with various vibrations exerted on display device (10, 10A).
The configurations according to the second to eighth aspects are not essential configurations for display device (10, 10A) and can be omitted as appropriate.
The present disclosure is effective as a display device that projects virtual images on a target space and a moving body or the like having the display device.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2017-072709 | Mar 2017 | JP | national |
This application is a continuation of the PCT International Application No. PCT/JP2018/001864 filed on Jan. 23, 2018, which claims the benefit of foreign priority of Japanese patent application No. 2017-072709 filed on Mar. 31, 2017, the contents all of which are incorporated herein by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 20100066832 | Nagahara et al. | Mar 2010 | A1 |
| 20100157430 | Hotta et al. | Jun 2010 | A1 |
| 20120050138 | Sato et al. | Mar 2012 | A1 |
| 20160288645 | Popham | Oct 2016 | A1 |
| 20170254659 | Fukumoto | Sep 2017 | A1 |
| 20190139286 | Shimoda | May 2019 | A1 |
| Number | Date | Country |
|---|---|---|
| 1-293239 | Nov 1989 | JP |
| 2006-142897 | Jun 2006 | JP |
| 2010-070066 | Apr 2010 | JP |
| 2010-256878 | Nov 2010 | JP |
| 2017-003946 | Jan 2017 | JP |
| 2017-013590 | Jan 2017 | JP |
| 2009095246 | Aug 2009 | WO |
| 2018042898 | Mar 2018 | WO |
| Entry |
|---|
| International Search Report of PCT application No. PCT/JP2018/001864 dated Apr. 24, 2018. |
| German Office Action dated May 11, 2020 for the related German Patent Application No. 112018001655.2. |
| Number | Date | Country | |
|---|---|---|---|
| 20200012103 A1 | Jan 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2018/001864 | Jan 2018 | US |
| Child | 16576908 | US |
