This patent application is based on and claims priority pursuant to 35 U.S.C. § 119(a) to Japanese Patent Application Nos. 2018-200777 and 2019-133724, filed on Oct. 25, 2018, and Jul. 19, 2019, respectively, in the Japan Patent Office, the entire disclosures of which are hereby incorporated by reference herein.
Embodiments of the present disclosure relate to a display device, a display system, and a mobile object.
A display device, such as a head-up display (HUD), is used as an application for allowing a driver (an observer) to visually recognize various kinds of information (vehicle information, warning information, navigation information, and the like) in a mobile object, such as a vehicle, with limited movement of the driver's (observer's) eyes.
For example, a display device is known in the art that carries out two-dimensional scan with image light emitted from a light source in a main scanning direction and a sub-scanning direction by optical scanning means to form an intermediate image on a light divergence member, and projects the intermediate image onto a member that receives the projection, such as a windshield of a vehicle, in an enlarged scale. By doing so, the display device displays a virtual image to be superimposed on the observer's sight.
Further, a display device is known in the art that includes a light source, which generates a coherent light flux, and an optical plate, which includes a plurality of microlenses arranged at a pitch greater than a diameter of the light flux, and controls an angle of divergence of the light flux.
Embodiments of the present disclosure described herein provide a display device, a display system, and a mobile object. The display device includes a light source configured to emit light, a light deflector configured to deflect the light incident on the light deflector in a main scanning direction and a sub-scanning direction, a divergence optical system configured to diverge the light deflected by the light deflector to form a virtual image to be visually recognized by an observer, and a dioptric system disposed on an optical path between the light deflector and the divergence optical system to refract the light deflected by the light deflector to be made incident on the divergence optical system. In the display device, the dioptric system has a refractive power different in the main scanning direction than in the sub-scanning direction. The display system includes the display device, an imaging optical system configured to form the virtual image with the light diverged by the divergence optical system, and a reflector configured to reflect light emitted from the imaging optical system. The mobile object includes the display system, and the reflector is a windshield configured to reflect the light diverged by the divergence optical system.
A more complete appreciation of embodiments and the many attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings.
The accompanying drawings are intended to depict embodiments of the present disclosure and should not be interpreted to limit the scope thereof. The accompanying drawings are not to be considered as drawn to scale unless explicitly noted.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present disclosure. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “includes” and/or “including”, when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
In describing example embodiments shown in the drawings, specific terminology is employed for the sake of clarity. However, the present disclosure is not intended to be limited to the specific terminology so selected and it is to be understood that each specific element includes all technical equivalents that have the same structure, operate in a similar manner, and achieve a similar result.
The display system 1 allows the observer 3 (a driver) to visually recognize navigation information that is necessary for driving the vehicle (information such as a vehicle speed, route information, a distance to the destination, the name of current location, existence and position of an object (target) ahead of the vehicle, a sign for the speed limit or the like, and traffic congestion information), via a windshield 50, for example. In this case, the windshield 50 serves as a transmissive and reflective member that transmits a part of light incident on the windshield 50 and reflects at least a part of the remainder. A distance between a viewpoint position of the observer 3 and the windshield 50 is several tens of centimeters to one meter or so.
The display system 1 includes a display device 10, a free-form surface mirror 30, and the windshield 50. The display device 10 is, for example, a head-up display device (HUD device) mounted in a car, which is an example of the mobile object. The display device 10 is arranged at an arbitrary position according to the interior design of the car. The display device 10 may be disposed, for example, below a dashboard of the car, or may be embedded in the dashboard.
The display device 10 includes a light-source device 11, a light deflector 13, and a screen 15. The light-source device 11 is a device that radiates a laser beam emitted from a light source to the outside of the device. The light-source device 11 may radiate a laser beam obtained by combining laser beams of three colors, R, G, and B, for example. The laser beam emitted from the light-source device 11 is guided to a reflection surface of the light deflector 13. The light-source device 11 includes a semiconductor light-emitting element such as a laser diode (LD) as the light source. The light source is not limited to the above, and may include a semiconductor light-emitting element such as a light-emitting diode (LED).
The light deflector 13 is a device which changes a direction of travel of the laser beam using Micro Electro Mechanical Systems (MEMS) or the like. The light deflector 13 is configured by using scanning means, such as a single minute MEMS mirror that swings about two axes orthogonal to each other, or a mirror system formed of two MEMS mirrors that swing or rotate about a single axis. The screen 15 is scanned with the laser beam emitted from the light deflector 13. The light deflector 13 may be configured by using a polygon mirror or the like, not limited to the MEMS mirror.
The screen 15 is a divergence member having the function of diverging the laser beam at a predetermined divergence angle. The screen 15 includes a transmissive optical element having a light diffusion effect, such as a microlens array (MLA) or a diffusion plate, as a form of an exit pupil expander (EPE), for example. Alternatively, the screen 15 may include a reflective optical element having a light diffusing effect such as a micromirror array. As the laser beam emitted from the light deflector 13 is applied onto the screen 15 to scan the screen 15, an intermediate image 40, which is a two-dimensional image, is formed on the screen 15.
A projection method of the display device 10 includes a “panel method” and a “laser scanning method”. The “panel method” forms the intermediate image 40 by an imaging device such as a liquid crystal panel, a digital mirror device (DMD) panel, or a fluorescent display tube (VFD). The “laser scanning method” forms the intermediate image 40 by a scan performed by the scanning means with the laser beam emitted from the light-source device 11.
The display device 10 according to the first embodiment employs the latter method, namely, the “laser scanning method”. Since the “laser scanning method” can assign light emission or light extinction to each pixel, generally, a high-contrast image can be formed. Alternatively, the display device 10 may employ the “panel method” as the projection method.
The virtual image 45, which is projected onto the free-form surface mirror 30 and the windshield 50 by the laser beam (light flux) emitted from the screen 15, is enlarged relative to the intermediate image 40 and displayed. The free-form surface mirror 30 is designed and arranged so as to offset a tilt, distortion, misalignment, and the like of an image caused by the curved shape of the windshield 50. The free-form surface mirror 30 may be installed in such a way that the free-form surface mirror 30 can be rotated about a predetermined rotation axis. The free-form surface mirror 30 can thereby adjust a reflection direction of the laser beam (light flux) emitted from the screen 15, and change the display position of the virtual image 45.
The free-form surface mirror 30 is designed by using ready-made optical design simulation software so that free-form surface mirror 30 has fixed condensing power, in order to bring an imaging position of the virtual image 45 to a desired position. In the display system 1, the condensing power of the free-form surface mirror 30 is set such that the virtual image 45 is displayed at a position (or, a depth position) of, for example, 1 m or more and 30 m or less (preferably, 10 m or less) away from the viewpoint position of the observer 3. The free-form surface mirror 30 may be a concave mirror or a curved mirror. The free-form surface mirror 30 is an example of an imaging optical system.
The windshield 50 is a transmissive and reflective member having the function of transmitting a part of a laser beam (light flux) and reflecting at least a part of the remainder (namely, a partial reflection function). The windshield 50 serves as a semi-transmissive mirror allowing the observer 3 to visually recognize the scenery ahead and the virtual image 45. The virtual image 45 includes image information for allowing the observer 3 to visually recognize the vehicle information (speed, travel distance, and the like), navigation information (route guidance, transportation information, and the like), and warning information (such as collision warning), for example. The transmissive and reflective member may be a front windshield provided separately from the windshield 50. The windshield 50 is an example of a reflective member.
The virtual image 45 may be displayed so as to overlap the scenery ahead of the windshield 50. Also, the windshield 50 is not flat, but is curved. Therefore, the imaging position of the virtual image 45 is determined by the curved surfaces of the free-form surface mirror 30 and the windshield 50. The windshield 50 may use a semi-transmissive mirror (a combiner) as an individual transmissive and reflective member having the partial reflection function.
With such a configuration, a laser beam (light flux) emitted from the screen 15 is projected toward the free-form surface mirror 30, and is reflected by the windshield 50. The observer 3 can visually recognize the virtual image 45, which is the enlarged image of the intermediate image 40 formed on the screen 15, by way of the light reflected from the windshield 50.
The display device 10 includes a control device 17 for controlling the operation of the display device 10. The control device 17 is a controller for a circuit board, an IC chip, and the like mounted inside the display device 10. The control device 17 includes a field-programmable gate array (EPGA) 1001, a central processing unit (CPU) 1002, a read-only memory (ROM) 1003, a random access memory (RAM) 1004, an interface (I/F) 1005, a bus line 1006, an LD driver 1008, a MEMS controller 1010, and a motor driver 1012.
The FPGA 1001 is an integrated circuit for which a change of settings by a designer of the display device 10 is possible. Each of the LD driver 1008, the MEMS controller 1010, and the motor driver 1012 generates a drive signal in response to a control signal from the FPGA 1001. The CPU 1002 is an integrated circuit which performs processing to control the entire display device 10. The ROM 1003 is a storage device which stores programs for controlling the CPU 1002. The RAM 1004 is a storage device which serves as a work area of the CPU 1002. The I/F 1005 is an interface for communicating with external devices. The I/F 1005 is coupled to, for example, a controller area network (CAN) of a car.
An LD1007 is, for example, a semiconductor light-emitting element which constitutes a part of the light-source device 11. The LD driver 1008 is a circuit which generates a drive signal to drive the LD 1007. A MEMS 1009 is a device which constitutes a part of the light deflector 13, and shifts the position of a scan mirror. The MEMS controller 1010 is a circuit which generates a drive signal to drive the MEMS 1009. A motor 1011 is an electric motor which rotates a rotation axis of the free-form surface mirror 30. The motor driver 1012 is a circuit which generates a drive signal to drive the motor 1011.
The vehicle information receiver 171 includes the function of receiving information of the car (information such as speed and travel distance) from the CAN or the like. The vehicle information receiver 171 is realized by the processing of the I/F 1005 and the CPU 1002 illustrated in
The external information receiver 172 includes the function of receiving information outside the car (such as position information provided by a GPS, and route information or transportation information provided by a navigation system) from an external network. The external information receiver 172 is realized by the processing of the I/F 1005 and the CPU 1002 illustrated in
The image generator 173 includes the function of generating image information for displaying the intermediate image 40 and the virtual image 45, on the basis of the information input by the vehicle information receiver 171 and the external information receiver 172. The image generator 173 is realized by the processing of the CPU 1002 illustrated in
The image display unit 174 includes the function of forming the intermediate image 40 on the screen 15, on the basis of the display information generated by the image generator 173, and projecting the laser beam (light flux) forming the intermediate image 40 toward the windshield 50, thereby displaying the virtual image 45. The image display unit 174 is realized by the processing of the CPU 1002, the FPGA 1001, the LD driver 1008, the MEMS controller 1010, and the motor driver 1012 illustrated in
The image display unit 174 includes a control unit 175, an intermediate image forming unit 176, and a projection unit 177. The control unit 175 generates a control signal for controlling the operation of the light-source device 11 and the light deflector 13, in order to form the intermediate image 40. Also, the control unit 175 generates a control signal for controlling the operation of the free-form surface mirror 30, in order to display the virtual image 45 at a predetermined position.
The intermediate image forming unit 176 forms the intermediate image 40 on the screen 15, on the basis of the control signal generated by the control unit 175. The projection unit 177 projects the laser beam forming the intermediate image 40 onto the transmissive and reflective member (windshield 50 or the like), in order to form the virtual image 45 to be visually recognized by the observer 3.
The light source elements 111R, 111G, and 111B of three colors (R, G, B) are, for example, laser diodes (LDs) each having one or more luminous points. The light source elements 111R, 111G, and 111B radiate laser beams (light fluxes) having wavelengths of λR, λG, and λB different from each other (for example, λR being 640 nm, λG being 530 nm, and λB being 445 nm).
Each of the radiated laser beams (light fluxes) is coupled by the coupling lenses 112R, 112G, and 112B. The coupled lasers (light fluxes) are shaped by the apertures 113R, 113G, and 113B, respectively. The apertures 113R, 113G, and 113B have shapes (for example, circular, elliptical, rectangular or square shapes) according to predetermined conditions such as the angle of divergence of the laser beam (light flux).
The laser beams (light fluxes) shaped by the apertures 113R, 113G, and 113B are combined by the three composite elements 114, 115, and 116. Each of the composite elements 114, 115, 116 is a plate-shaped or prism-shaped dichroic mirror, and reflects or transmits the laser beam (light flux) according to the wavelength, and combines the reflected or transmitted laser beams into a single light flux. The combined light flux passes through the lens 117, and is guided to the light deflector 13.
The mirror 130 includes a reflection surface which reflects the laser beam emitted from the light-source device 11 to the screen 15. In the light deflector 13, a pair of meandering beam portions 132 is formed with the mirror 130 interposed therebetween. The meandering beam portion 132 includes a plurality of loop-back portions. The loop-back portions are formed of first beam portions 132a and second beam portions 132b that are alternately arranged. The meandering beam portion 132 is supported by the frame member 134. The piezoelectric member 136 is disposed to couple the first beam portion 132a and the second beam portion 132b that are adjacent to each other. The piezoelectric member 136 applies different voltages to the first beam portion 132a and the second beam portion 132b to generate a warp in each of the beam portions 132a and 132b.
As a result, the adjacent beam portions 132a and 132b bend in different directions. As the warp accumulates, the mirror 130 rotates in a vertical direction about a horizontal axis. Owing to such a configuration, the light deflector 13 can perform optical scanning in the vertical direction at a low voltage. Optical scanning in a horizontal direction about a vertical axis is performed by resonance using a torsion bar or the like coupled to the mirror 130.
The shape of each one of the microlenses 150 is not limited to hexagonal, but may be, for example, rectangular or triangular. In addition, although the figure illustrates the structure in which a plurality of microlenses 150 are regularly arranged as an example, the arrangement of the microlenses 150 is not limited to the above. That is, the microlenses 150 may be arranged such that the centers of the microlenses 150 are offset from each other, for example, so that irregular arrangement is formed. If such eccentric arrangement is to be adopted, the shapes of the microlenses 150 are different from each other.
In consideration of the above, in order to reduce the speckle, the pitch 155 of the microlenses 150 is designed to be larger than a diameter 156 of the incident light. Referring to
The scan range is the entire range subjected to scanning by the light deflector 13. The scan light scans the scan range of the screen 15 in a vibrating manner (that is to say, performs reciprocating scanning) in a main scanning direction (X-axis direction) at a high frequency of 20,000 to 40,000 Hz or so. In contrast, the scan light scans the same in one way in a sub-scanning direction (Y-axis direction) at a low frequency of several tens of hertz (Hz) or so. In other words, the light deflector 13 performs a raster scan on the screen 15. In this case, as the display device 10 performs light emission control of each of the light source elements in accordance with the scanning position (the position of the scan light), rendering per pixel or display of a virtual image can be carried out.
Time taken to render one screen, more specifically, a scanning time for one frame (one period of two-dimensional scanning), is several tens of milliseconds (msec) since a sub-scan rate is several tens of Hz as described above. For example, in a case where a main scan rate is 20000 Hz and the sub-scan rate is 50 Hz, the scanning time for one frame is 20 msec.
The scan range is assumed as a range in which the image area 61 and a part of the frame area 62 (that is to say, a portion near the outer edge of the image area 61) of the screen 15 are combined. In
As described above, the screen 15 includes a transmissive optical element having a light diffusion effect such as a microlens array. The image area 61 is not necessarily rectangular or planar, but may be polygonal or curved. Further, the screen 15 may be a flat plate or a curved plate having no light diffusion effect. Furthermore, the image area 61 may be formed of a reflective element having a light diffusing effect such as a micromirror array, according to the layout of the device.
The screen 15 is provided with a synchronous detection system 60 including a light receiving element in a peripheral area of the image area 61 (that is to say, a part of the frame area 62) of the scan range. In
Next, optical design of the display system 1 according to the first embodiment is described. The relationship between an angle of divergence and the intensity of the divergent light generated on the screen 15 is described referring to
Further, as illustrated in
The present embodiment proposes optimal optical design for the display device 10, in order to allow the observer 3 to visually recognize the virtual image 45 having a good brightness distribution while suppressing reduction in the brightness at the edge of the virtual image 45 to be visually recognized by the observer 3.
The observer 3 (for example, the driver who drives the car) visually recognizes the virtual image 45 from the eye-box (an area near the eyes of the observer 3) along the optical path of light reflected by the windshield 50. The eye-box is intended as a range in which the observer 3 can visually recognize the virtual image 45 without adjusting the viewpoint position. Specifically, the eye-box is equivalent to or subordinate to an eye range of drivers for automobiles (JIS D0021). The eye-box is set on the basis of the eyellipse, which is a spatial area where the eye point of a driver seated on a seat can exist, as an area in which the driver can visually recognize the virtual image 45.
In the display system 1, an optical path length from the light deflector 13 to the image center of the intermediate image 40 formed on the screen 15 is defined as Ta, an optical length to the central position of an area at which the light flux diverged from the intermediate image 40 passes through the free-form surface mirror 30 is defined as Tb, and an optical path length between the center of the free-form surface mirror 30 and the center of the virtual image 45 is defined as Tc.
The light flux emitted from the light-source device 11 enters the light deflector 13, and is radiated onto the screen 15 for two-dimensional scan. The intermediate image 40 illustrated in
The surface shape of the free-form surface mirror 30 is designed to reduce optical strain that occurs in the windshield 50 illustrated in
In the explanation of
Further, in the explanation of
As has been described referring to
When a width of the eye-box in the main scanning direction is greater than a width of the eye-box in the sub-scanning direction, the brightness of the virtual image 45 as seen from the eye-box edge in the main scanning direction is less than the brightness of the virtual image 45 as seen from the eye-box edge in the sub-scanning direction. In particular, brightness reduction at the image edge of the virtual image 45 in the main scanning direction is greater than the brightness reduction at the image edge of the virtual image 45 in the sub-scanning direction.
It holds true that when the width of the virtual image 45 is constant and the width of the eye-box is increased, the width of the virtual image 45 per unit length of the eye-box is reduced. Therefore, the above can be rephrased as the width of the eye-box being constant and the width of virtual image 45 being reduced (that is to say, an angle between the line Lo+ and the line Lo− being reduced) virtually.
In other words, when the width of the eye-box in the main scanning direction is greater than the width of the same in the sub-scanning direction, angular differences Δθx+ and Δθx− in the main scanning direction are greater than angular differences Δθy+ and Δθy− in the sub-scanning direction, respectively. For example, when Ta is equal to 100, Tb is equal to 300, Tc is equal to 3100, Td, which corresponds to a distance from the eye-box to the virtual image 45 (or, a virtual image distance), is equal to 3600, Ex, which corresponds to a width of the eye-box in the main scanning direction, is equal to 130, and Ey, which corresponds to a width of the eye-box in the sub-scanning direction, is 40, while Δθx+ is 11.2°, Δθy+ is 4.10. As a result, the brightness reduction is greater in the image edge of the virtual image 45 in the main scanning direction than the image edge in the sub-scanning direction.
In the present embodiment, as an example in which the refractive powers to be exhibited are different in the main scanning direction and the sub-scanning direction, a case where the refractive power is exhibited in the main scanning direction, but no refractive power is exhibited in the sub-scanning direction is described. As illustrated in
As an example, a case where the optical path length between the light deflector 13 and the dioptric system 80 is To, and the dioptric system 80 is a cylindrical mirror which is curved by a curvature radius Rx in
In contrast, since the dioptric system 80 has no refractive power in the sub-scanning direction, as illustrated in
As described above, the dioptric system 80 has the refractive power of reducing an angle between the deflected light corresponding to the image edge, which is the deflected light corresponding to the image edge of the virtual image, of beams of the deflected light being incident on the screen 15, and the deflected light corresponding to the image edge, which is generated from the deflected light being incident on and diverged by the screen 15 as the divergent light to reach the observer's viewpoint. Since the refractive power in the main scanning direction is greater than the refractive power in the sub-scanning direction, by providing the dioptric system 80 between the light deflector 13 and the screen 15, the angles as discussed above in the main scanning and the sub scanning can be approximated to each other. Consequently, brightness deviation in the plane of the virtual image 45 can be decreased.
In the above, the case where the refractive power is positive has been described. However, depending on the layout of the display system 1, and the property of each optical system, the angular difference between the incident angle of light entering a divergence optical system and the emission angle of the emission light may be reduced when a negative refractive power is applied. That is, the angular difference may be reduced when a light ray, which corresponds to the image edge, made incident on the divergence optical system, is refracted in a direction opposite to the image center. In such a case, by carrying out comparison of the magnitude of the refractive power in the negative direction, the refractive power in the main scanning direction may be increased as compared to the refractive power in the sub-scanning direction.
In the above, “So” represents a distance between a laser emission point of the light source element 111 and a lens 112 disposed between the light source element 111 and the light deflector 13, f1 represents a focal length of the lens 112, f2 represents a focal length of the dioptric system 80, and d represents a distance between the lens 112 and the dioptric system 80.
The beam diameter is intended as the diameter of a peripheral portion at which the intensity is decreased to intensity corresponding to 13.5% of the intensity at the central axis. Further, as regards the focal point, a point on the screen 15 is assumed as 0. As illustrated in the graph of
In other words, according to the first formula, the focal length, spacing, and the like of the dioptric system 80, which is a cylinder mirror by way of example, may be set such that the relationship in the second formula is satisfied. Thereby, it is possible to reduce the size of the display device while suppressing brightness reduction and speckle noise degradation.
−20≤Δf≤20 Second Formula
Numerous additional modifications and variations are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the disclosure of the present disclosure may be practiced otherwise than as specifically described herein. For example, elements and/or features of different illustrative embodiments may be combined with each other and/or substituted for each other within the scope of this disclosure and appended claims.
Number | Date | Country | Kind |
---|---|---|---|
2018-200777 | Oct 2018 | JP | national |
2019-133724 | Jul 2019 | JP | national |