Patent Application
20220413287
The present disclosure relates to a head-up display system and a movable body.
A known technique is described in, for example, Patent Literature 1.
A head-up display system according to one embodiment of the present disclosure includes a projection module including a display panel to project an image displayed on the display panel, a reflective optical element that reflects at least a part of the image, an optical member located between the projection module and the reflective optical element and having light-shielding capability, and a controller that controls the light-shielding capability of the optical member.
A movable body according to one embodiment of the present disclosure includes a head-up display system. The head-up display system includes a projection module including a display panel to project an image displayed on the display panel, a reflective optical element that reflects at least a part of the image, an optical member located between the projection module and the reflective optical element and having light-shielding capability, and a controller that controls the light-shielding capability of the optical member.
The objects, features, and advantages of the present disclosure will become more apparent from the following detailed description and the drawings.
As a head-up display (HUD) system with the structure that forms the basis of a HUD system according to one or more embodiments of the present disclosure, a known HUD system causes images having parallax between them to reach the left and right eyes of a user and projects a virtual image in the field of view of the user to be viewed as a three-dimensional (3D) image with depth.
The HUD system is, for example, mountable on a movable body for navigation. The HUD system for such use is to be protected against heat.
In response to the above issue, one or more aspects of the present disclosure are directed to a HUD system and a movable body that are protected against heat.
An embodiment of the present disclosure will now be described with reference to the drawings. The drawings used herein are schematic and are not drawn to scale relative to the actual size of each component.
As shown in
The head-up display system 1 is hereafter also referred to as a HUD system 1. The HUD system 1 may be mounted on a movable body 20. The HUD system 1 mounted on the movable body 20 displays an image for a user 30 aboard the movable body 20. An image projected by the first projection module 2 is referred to as a first image. An image projected by the second projection module 3 is referred to as a second image.
The movable body according to one or more embodiments of the present disclosure includes a vehicle, a vessel, or an aircraft. The vehicle according to one or more embodiments of the present disclosure includes, but is not limited to, an automobile or an industrial vehicle, and may also include a railroad vehicle, a community vehicle, or a fixed-wing aircraft traveling on a runway. The automobile includes, but is not limited to, a passenger vehicle, a truck, a bus, a motorcycle, or a trolley bus, and may also include another vehicle traveling on a road. The industrial vehicle includes an agricultural vehicle or a construction vehicle. The industrial vehicle includes, but is not limited to, a forklift or a golf cart. The agricultural vehicle includes, but is not limited to, a tractor, a cultivator, a transplanter, a binder, a combine, or a lawn mower. The construction vehicle includes, but is not limited to, a bulldozer, a scraper, a power shovel, a crane vehicle, a dump truck, or a road roller. The vehicle includes a man-powered vehicle. The classification of the vehicle is not limited to the above examples. For example, the automobile may include an industrial vehicle traveling on a road, and one type of vehicle may fall within a plurality of classes. The vessel according to one or more embodiments of the present disclosure includes a jet ski, a boat, or a tanker. The aircraft according to one or more embodiments of the present disclosure includes a fixed-wing aircraft or a rotary-wing aircraft.
The first projection module 2 includes the first display panel 6. The first display panel 6 projects an image displayed on the first display panel 6. The first display panel 6 may include a flat display panel selected from a liquid crystal display (LCD), an organic electroluminescent (EL) display, an inorganic EL display, a plasma display panel (PDP), a field-emission display (FED), an electrophoresis display, and a twisting-ball display.
In the present embodiment, the first display panel 6 emits image light linearly toward the reflective optical element 4 as shown in
The first projection module 2 may further include a stage 7 on which the first display panel 6 is mountable. The stage 7 can move or orient the first display panel 6 with respect to the reflective optical element 4. This causes the first projection module 2 to change the position at which the first image is projected on the reflective optical element 4. The first display panel 6 may be located on the surface of a dashboard in the movable body 20.
The second projection module 3 includes a display device 8 and an optical system 9. The display device 8 includes an illuminator 10 and the second display panel 11. The second projection module 3 projects an image displayed on the second display panel 11.
The display device 8 emits image light from the second image displayed on the second display panel 11. For the second projection module 3 that can project a parallax image viewable as a 3D image to the user 30, the display device 8 may further include a parallax optical element 12. For the second projection module 3 that projects an image viewable as a two-dimensional (2D) image alone to the user 30, the parallax optical element 12 may be eliminated. The structure including the second projection module 3 that can display a parallax image will be described in detail later.
The optical system 9 causes image light from the second image emitted by the display device 8 to travel toward the reflective optical element 4. The optical system 9 may have a predetermined positive refractive index. The optical system 9 with a predetermined positive refractive index causes the second image on the second display panel 11 to be projected as an enlarged virtual image at a position farther than the reflective optical element 4 in the field of view of the user 30. The optical system 9 may include a mirror. The mirror included in the optical system 9 may be a concave mirror.
The illuminator 10 illuminates the second display panel 11 with planar illumination light. The illuminator 10 may include a light source, a light guide plate, a diffuser plate, and a diffuser sheet. The illuminator 10 spreads illumination light emitted from its light source uniformly to illuminate the surface of the second display panel 11. The illuminator 10 can emit illumination light to be substantially uniform through, for example, the light guide plate, the diffuser plate, and the diffuser sheet. The illuminator 10 may emit the uniform light toward the second display panel 11.
The second display panel 11 may be, for example, a transmissive liquid crystal display panel. The second display panel 11 is not limited to a transmissive liquid crystal panel but may be a self-luminous display panel. The self-luminous display panel may be, for example, an organic EL display or an inorganic EL display. For the second display panel 11 being a self-luminous display panel, the display device 8 may not include the illuminator 10.
The second projection module 3 may further change at least either the position or the orientation of at least one component included in the optical system 9. The second projection module 3 may include a drive 17 for changing the position or the orientation of at least one component included in the optical system 9. The drive 17 may include, for example, a stepper motor. For example, the drive 17 can change the tilt of the mirror included in the optical system 9. The controller 5 may control the drive 17. The drive 17 drives the second projection module 3 to change the position at which the second image is projected on the reflective optical element 4.
The reflective optical element 4 reflects at least a part of an image. In the present embodiment, images that are reflected by the reflective optical element 4 include the first image and the second image. The reflective optical element 4 may reflect either multiple images or one of the first image and the second image depending on the structure of the projection module.
The reflective optical element 4 reflects, toward a viewing zone 32 of the user 30, image light from the first image emitted from the first projection module 2 and image light from the second image emitted from the second projection module 3. The HUD system 1 mounted on the movable body 20 being a vehicle may use a windshield of the vehicle as the reflective optical element 4.
With the first projection module 2 and the second projection module 3 in operation, the reflective optical element 4 can cause a first image 51 and a second image 52 to appear in the field of view of the user 30 as shown in
The first projection module 2 may change the position at which the first image is displayed on the first display panel 6, and the second projection module 3 may change the position at which the second image is displayed on the second display panel 11. Changing the position at which the first image is displayed on the first display panel 6 changes the display position of the first image 51 in the first image display area 53. Changing the position at which the second image is displayed on the second display panel 11 changes the display position of the second image 52 in the second image display area 54.
As shown in
The reflective optical element 4 may include a second reflective area 4b that reflects a part of incident light and substantially blocks another part of the incident light. This allows the first image and the second image projected onto the second reflective area 4b to appear clearly in the field of view of the user 30 without being superimposed on the background opposite to the user 30 from the reflective optical element 4. For example, the first projection module 2 may project a part of the first image 51 onto the second reflective area 4b. This allows the first image 51 to show information independent of information about the background.
In the HUD system 1 mounted on the movable body 20 being a vehicle, the windshield may include a lower black portion as the second reflective area 4b. The lower black portion of the windshield may be referred to as a black ceramic portion. The second reflective area 4b in the movable body 20 may be usable for displaying information from measuring instruments such as a speedometer, a tachometer, or a direction indicator, which may be located on a known instrument panel. The first reflective area 4a may be the area of the windshield excluding the lower black portion.
The first projection module 2 including the stage 7 can change the position at which the first image 51 is projected between when the first projection module 2 is in a first projection pose to project the first image 51 onto the first reflective area 4a and when the first projection module 2 is in a second projection pose to project at least a part of the first image 51 onto the second reflective area 4b. The position or the orientation of the first display panel 6 varies between the first projection pose and the second projection pose.
The HUD system 1 according to the present embodiment includes, between the projection module and the reflective optical element 4, the optical member 71 with light-shielding capability. The optical member 71 has its light transmittance varying in accordance with a control signal from the controller 5. The optical member 71 may include, for example, polymer-dispersed liquid crystals (PDLCs).
The controller 5 can control the light transmittance of the optical member 71. The optical member 71 may switch between the light-shielding state and the transparent state. The controller 5 may control the optical member 71 to be in the light-shielding state when, for example, the HUD system 1 receives no power. More specifically, the controller 5 may control the light-shielding capability of the optical member 71 depending on whether the projection module is in operation on power being supplied or is in non-operation without power being supplied. The controller 5 may cause the optical member 71 to be in the transparent state in response to the projection module being in operation. In this state, the projection module projects an image without being obstructed by the optical member 71. The controller 5 may cause the optical member 71 to be in the light-shielding state in response to the projection module being in non-operation. The HUD system 1 not in use can reduce entry of external light into the first projection module 2 and the second projection module 3 and thus damage to optical elements including the first display panel 6 and the second display panel 11. The optical member 71 may partially include glass to serve as a cover to protect the first projection module 2 and the second projection module 3.
The HUD system 1 may include an input unit 15 that obtains external information. For the HUD system 1 mounted on the movable body 20, the input unit 15 can obtain information from an electronic control unit (ECU) 21 in the movable body 20. The ECU 21 is a computer that electronically controls various devices mounted on the movable body 20. The ECU 21 may control, for example, an engine, a navigation system, or an inter-vehicle distance measuring device. The controller 5 may obtain, from the ECU 21 through the input unit 15, information indicating whether an ignition switch of the movable body 20 on which the HUD system 1 is mounted is on or off. The controller 5 may cause the optical member 71 to be in the transparent state in response to the ignition switch being on. In this state, the projection module in the HUD system 1 in operation while the movable body 20 is travelling projects an image without being obstructed by the optical member 71. The controller 5 may cause the optical member 71 to be in the light-shielding state in response to the ignition switch being off. The HUD system 1 not in operation while the movable body 20 is parked is thus protected against damage caused by external light and heat of the light.
As shown in
The controller 5 may obtain, from the ECU 21 through the input unit 15, information indicating whether the ignition switch of the movable body 20 is on or off. In response to the ignition switch being on, the controller 5 may activate the cooler 72. Although the optical member 71 does not block external light while the movable body 20 is travelling, the HUD system 1 can activate the cooler 72 to avoid damage caused by heat.
The HUD system 1 may further include a temperature sensor for measuring the temperature inside the HUD system 1. The controller 5 may control the operational state of the cooler 72 based on the temperature measured with the temperature sensor. For example, the controller 5 may operate the cooler 72 in response to the temperature measured with the temperature sensor exceeding a threshold (e.g., 50° C.).
The controller 5 is connected to each of the components of the HUD system 1 to control these components. The controller 5 may be, for example, a processor. The controller 5 may include one or more processors. The processors may include a general-purpose processor that reads a specific program to perform a specific function, and a processor dedicated to specific processing. The dedicated processor may include an application-specific integrated circuit (ASIC). The processor may include a programmable logic device (PLD). The PLD may include a field-programmable gate array (FPGA). The controller 5 may be either a system on a chip (SoC) or be a system in a package (SiP) in which one or more processors cooperate with other components.
The controller 5 includes a memory. The memory includes any storage device such as a random-access memory (RAM) or a read-only memory (ROM). The memory may store any programs and information for various processes. For example, the memory may store, as the first image and the second image, display items to be displayed. Examples of the display items include text, graphics, and animations combining text and graphics.
In the HUD system 1 shown in
As described above, the second display panel 11 can display a parallax image to allow a user to view a 3D image. As shown in
Each divisional area corresponds to a subpixel. Thus, the active area A includes multiple subpixels arranged in a lattice in u-direction and v-direction. Each subpixel has one of the colors red (R), green (G), and blue (B). One pixel may be a set of three subpixels with R, G, and B. One pixel may include four or any other number of subpixels, instead of three subpixels. One pixel may include subpixels with a combination of colors different from R, G, and B. A pixel may be referred to as a picture element. For example, multiple subpixels included in one pixel may be arranged in the horizontal direction. Multiple subpixels having the same color may be arranged, for example, in the vertical direction.
The multiple subpixels arranged in the active area A form subpixel groups Pg under control by the controller 5. Multiple subpixel groups Pg are arranged repeatedly in u-direction. Each subpixel group Pg may be aligned with or shifted from the corresponding subpixel group Pg in v-direction. For example, the subpixel groups Pg are repeatedly arranged in v-direction at positions shifted by one subpixel in u-direction from the corresponding subpixel group Pg in adjacent rows. The subpixel groups Pg each include multiple subpixels in predetermined rows and columns. More specifically, the multiple subpixel groups Pg each include (2×n×b) subpixels P1 to PN (N=2×n×b), which are consecutively arranged in b rows in v-direction and in (2×n) columns in u-direction. In the example shown in
Each subpixel group Pg is the smallest unit controllable by the controller 5 to display an image. The subpixels included in each subpixel group Pg are identified using identification reference signs P1 to PN (N=2×n×b). The subpixels P1 to PN (N=2×n×b) included in each subpixel group Pg with the same identification reference signs are controlled by the controller 5 at the same time. Being controlled at the same time includes being controlled simultaneously and substantially simultaneously. Being controlled at the same time includes being controlled based on the same single clock and in the same frame. For example, the controller 5 can switch the image to be displayed by the subpixels P1 from the left eye image to the right eye image at the same time in all the subpixel groups Pg.
As shown in
The parallax optical element 12 can define the traveling direction of image light emitted from the multiple subpixels. The parallax optical element 12 can substantially define the viewing zone 32 for a parallax image. The viewing zone 32 is the range of space from which the left eye 311 and the right eye 31r of the user 30 can view the parallax image as a 3D image. In one example, the parallax optical element 12 is a liquid crystal shutter as shown in
The parallax optical element 12 includes multiple transmissive portions 12a and multiple light-reducing portions 12b as controlled by the controller 5. For the parallax optical element 12 being a liquid crystal shutter, the transmissive portions 12a include pixels P with a higher light transmittance, and the light-reducing portions 12b include pixels P with a lower light transmittance. The light-reducing portions 12b are strip areas extending in a predetermined direction in the plane of the parallax optical element 12. The light-reducing portions 12b define transmissive portions 12a between adjacent light-reducing portions 12b. The transmissive portions 12a and the light-reducing portions 12b extend in a predetermined direction along the active area A. The transmissive portions 12a and the light-reducing portions 12b are arranged alternately in a direction orthogonal to the predetermined direction. The transmissive portions 12a have a higher light transmittance than the light-reducing portions 12b. The transmissive portions 12a may have a light transmittance 10 or more times, or 100 or more times, or 1000 or more times the light transmittance of the light-reducing portions 12b. The light-reducing portions 11b have a lower light transmittance than the transmissive portions 12a. The light-reducing portions 12b may block image light.
The direction in which the transmissive portions 12a and the light-reducing portions 12b extend may correspond to the direction in which the subpixel groups Pg in the second display panel 11 are arranged. The parallax optical element 12 is controlled to simultaneously cause subpixels in the subpixel groups Pg identified with the same identification reference signs P1 to P12 to be light-transmissive or light-reducing as viewed with the left eye 311 and the right eye 31r of the user 30.
Image light from the second image emitted from the active area A on the second display panel 11 partially transmits through the transmissive portions 12a and reaches the reflective optical element 4 through the optical system 9. The image light reaching the reflective optical element 4 is reflected by the reflective optical element 4 and reaches the left eye 311 and the right eye 31r of the user 30. This allows the left eye 311 and the right eye 31r of the user 30 to view, as a virtual image of an image appearing on the active area A, a second virtual image V2 frontward from the reflective optical element 4. Being frontward herein refers to z-direction. As shown in
The user 30 thus views the image appearing as the second virtual image V2 through the third virtual image V3. In reality, the user 30 does not view the third virtual image V3, or a virtual image of the parallax optical element 12. However, the third virtual image V3 is hereafter referred to as appearing at the position at which the virtual image of the parallax optical element 12 is formed and as defining the traveling direction of image light from the second virtual image V2. Areas in the second virtual image V2 viewable by the user 30 with image light reaching the position of the left eye 311 of the user 30 are hereafter referred to as left viewable areas VaL. Areas in the second virtual image V2 viewable by the user 30 with image light reaching the position of the right eye 31r of the user 30 are referred to as right viewable areas VaR.
As shown in
E:Vd=(n×VHp):Vg (1)
Vd:VBp=(Vdv+Vg):(2×n×VHp) (2)
The virtual image barrier pitch VBp is the interval in x-direction at which the light-reducing portions 12b projected as the third virtual image V3 are arranged in a direction corresponding to u-direction. The virtual image gap Vg is the distance between the third virtual image V3 and the second virtual image V2. The optimum viewing distance Vd is the distance between the position of the left eye 311 or the right eye 31r of the user 30 and the third virtual image V3, or a virtual image of the parallax optical element 12. An interocular distance E is the distance between the left eye 311 and the right eye 31r. The interocular distance E may be, for example, 61.1 to 64.4 mm, as calculated through studies conducted by the National Institute of Advanced Industrial Science and Technology. VHp is the horizontal length of each subpixel of the virtual image. VHp is the length of each subpixel of the second virtual image V2 in a direction corresponding to x-direction.
As described above, the left viewable areas VaL in
With the parallax optical element 12 having an aperture ratio of 50%, the left viewable areas VaL may match the right light-reducing areas VbR, and the right viewable areas VaR may match the left light-reducing areas VbL. With the parallax optical element 12 having an aperture ratio of less than 50%, the left viewable areas VaL may be included in the right light-reducing areas VbR, and the right viewable areas VaR may be included in the left light-reducing areas VbL. Thus, the right viewable areas VaR are not easily viewable with the left eye 311, and the left viewable areas VaL are not easily viewable with the right eye 31r.
In the example shown in
A change in the positions of the eyes 31 of the user 30 changes the parts of the subpixels P1 to P12 used to display the virtual image viewable with the left eye 311 and the right eye 31r of the user 30. The HUD system 1 may further include a detector 13 for detecting the positions of the left eye 311 and the right eye 31r of the user 30. The detector 13 outputs the detected positions of the left eye 311 and the right eye 31r of the user 30 to the controller 5. The detector 13 may include an imaging device or a sensor. For the HUD system 1 mounted on the movable body 20 being a vehicle, the detector 13 may be installed in any of various places such as on a rearview mirror, an instrument panel, a steering wheel, or a dashboard.
For the detector 13 including an imaging device, the imaging device captures a subject and generates an image of the subject. The imaging device includes an image sensor. The image sensor may include, for example, a charge-coupled device (CCD) image sensor or a complementary metal-oxide-semiconductor (CMOS) image sensor. The imaging device is arranged to have the face of the user 30 being at the position of the subject. For example, the detector 13 may define a predetermined position as the origin and detect the direction and amount of displacements of the eyes 31 from the origin. The detector 13 may detect, with two or more imaging devices, the position of at least one of the left eye 311 and the right eye 31r as the coordinates in a 3D space.
The detector 13 may include no imaging device and may be connected to an external imaging device. The detector 13 may include an input terminal for receiving signals from the external imaging device. The external imaging device may be directly connected to the input terminal. The external imaging device may be connected to the input terminal indirectly through a shared network.
For the detector 13 including a sensor, the sensor may be an ultrasonic sensor or an optical sensor.
The controller 5 may obtain positional information about the left eye 311 and the right eye 31r of the user 30 from the detector 13 through an obtainer 14. The obtainer 14 can obtain positional information about the left eye 311 and the right eye 31r of the user 30 detected by the detector 13. The detector 13 and the obtainer 14 are connected to each other through wired or wireless communication or both. For the movable body 20 being a vehicle, the detector 13 and the obtainer 14 may be connected to each other with a vehicle network such as a controller area network (CAN). The obtainer 14 may include a connector for wired communication, such as an electrical connector or an optical connector. The obtainer 14 may include an antenna for wireless communication.
The controller 5 controls, based on the position of the left eye 311 of the user 30, the parallax optical element 12 to allow the subpixels P1 to P6 displaying the left eye image to be viewed by the left eye 311. The controller 5 controls, based on the position of the right eye 31r of the user 30, the parallax optical element 12 to allow the subpixels P7 to P12 displaying the right eye image to be viewed by the right eye 31r.
For example, the left eye 311 and the right eye 31r of the user 30 observing the second virtual image V2 as shown in
In the example shown in
The HUD system 1 according to one or more embodiments of the present disclosure with the above structure is protected against heat of external light. In other words, the HUD system 1 and the movable body 20 according to one or more embodiments of the present disclosure are protected against heat.
The above embodiments are described as typical examples. Various modifications and substitutions to the embodiments are apparent to those skilled in the art without departing from the spirit and scope of the present disclosure. Thus, the above embodiments should not be construed to be restrictive, but may be variously modified or altered within the scope of the present disclosure. For example, multiple structural blocks described in the above embodiments or examples may be combined into a structural block, or each structural block may be divided. The embodiments of the present disclosure can also be implemented as a method or a program implementable by a processor included in the device, or as a storage medium storing the program. These method, program, and storage medium also fall within the scope of the present disclosure.
In one or more embodiments of the present disclosure, the second projection module 3 includes a liquid crystal shutter as a parallax optical element. The parallax optical element is not limited to a liquid crystal shutter but may be another optical element that can substantially define the viewing zone for the parallax image. For example, the parallax optical element may be a parallax barrier plate with slits that are arranged parallel to one another. The slits allow transmission of the right eye image in the parallax image along the optical path toward the right eye and the left eye image toward the left eye. For the parallax optical element being the parallax barrier with fixed openings as described above, the controller 5 may switch, based on the movement of the head of the user 30, between subpixels displaying the left eye image and subpixels displaying the right eye image on the second display panel 11. In this manner, the controller 5 can continue displaying a 3D image for the user 30 independently of any displacements of the eyes of the user 30.
The parallax optical element may include multiple lenticular lenses arranged parallel to one another into a flat surface. The lenticular lenses can deflect the left eye image and the right eye image in the parallax image alternately displayed on the second display panel respectively to the optical path toward the right eye and the optical path toward the left eye.
The second projection module 3 may be switchable between a first state for displaying a 3D image and a second state for displaying a 2D image. In the first state, the controller 5 displays a parallax image on the second display panel 11 and displays, on the parallax optical element 12, the transmissive portions 12a and the light-reducing portions 12b for defining the traveling direction of image light. In the second state, the controller 5 displays a 2D image representing a 2D image on the second display panel 11 and causes the parallax optical element 12 to be entirely in a light transmission state to transmit image light uniformly. The controller 5 performs control to synchronize the switching of the states of the second display panel 11 and the parallax optical element 12. This allows the second projection module 3 to select either a 2D image or a 3D image as appropriate and display the image for the user 30.
The present disclosure may be implemented in the following forms.
A head-up display system according to one embodiment of the present disclosure includes a projection module including a display panel to project an image displayed on the display panel, a reflective optical element that reflects at least a part of the image, an optical member located between the projection module and the reflective optical element and having light-shielding capability, and a controller that controls the light-shielding capability of the optical member.
A movable body according to one embodiment of the present disclosure includes a head-up display system. The head-up display system includes a projection module including a display panel to project an image displayed on the display panel, a reflective optical element that reflects at least a part of the image, an optical member located between the projection module and the reflective optical element and having light-shielding capability, and a controller that controls the light-shielding capability of the optical member.
The head-up display system and the movable body according to one embodiment of the present disclosure are protected against heat.
Although embodiments of the present disclosure have been described in detail, the present disclosure is not limited to the embodiments described above, and may be changed or modified in various manners without departing from the spirit and scope of the present disclosure. The components described in the above embodiments may be entirely or partially combined as appropriate unless any contradiction arises.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2019-214688 | Nov 2019 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2020/042856 | 11/17/2020 | WO |
