The present invention relates to a head-up display apparatus, for example, a technique effectively applicable to a head-up display apparatus using AR (Augmented Reality).
Patent Document 1 discloses a head-up display apparatus capable of effectively preventing intrusion of external light such as sunlight. The head-up display apparatus includes a shutter unit having a plurality of shutters, and changes a size of a transparent window portion formed in the shutter unit according to a size of a display image displayed by a display unit, thereby preventing the intrusion of external light and thus damage to the display unit.
For example, a head-up display (Head Up Display, hereinafter may be referred to as “HUD”) may be mounted on a vehicle represented by an automobile. The HUD projects, onto a windshield (front glass) and the like, various pieces of information such as: driving information such as a vehicle speed and an engine speed; and navigation information, and displays the information. By using the HUD, a driver can obtain the information necessary for driving without moving his/her visual line to a dashboard panel, a so-called instrument panel which is built in a dashboard. This makes it possible to contribute to safe driving.
Meanwhile, more recently, it is desired in the HUD to use the AR that adds various pieces of information to an existing object on a landscape and displays the information. In particular, the HUD using the AR (called AR-HUD) requires a wide display region. In order to widen the display region, it is necessary to widen an opening provided on a light path projected to the windshield from a display panel. Widening the opening makes it easier for sunlight to enter the display panel and, as a result, the display panel becomes easy to be damaged.
Thus, like Patent Document 1, a method of changing the size of the transparent window portion can be considered. However, even if the size of the transmissive window portion is changed according to the size of the display image, sufficient protection cannot always be achieved because a condensing point(s) of the sunlight may still occur on the display panel. For achieving the sufficient protection, it is desirable to completely block an incident light path of the sunlight. However, in this case, the projected optical path from the display panel is also blocked at the same time, and a time zone during which the HUD cannot be used occurs. However, even in this case, if the time zone during which the HUD cannot be used is shortened as much as possible, convenience of the user can be ensured to some extent.
The present invention has been made in view of the above, and one of purposes thereof is to provide a head-up display apparatus capable of preventing damage due to sunlight and ensuring user convenience.
The above and other objects and novel features of the present invention will become apparent from the description and accompanying drawings herein.
A brief description of typical inventions disclosed in the present application is as follows.
A representative head-up apparatus projecting an image onto a display region of a windshield and allowing a driver of a vehicle to visually recognize a landscape on which the image is superimposed has a light source, a display panel, a reflection mirror, a solar radiation sensor, a blocking mechanism, and a protection processor. The display panel creates an image to be projected onto the display region by modulating the light from the light source. The reflection mirror reflects the image created by the display panel to project it onto the display region. The solar radiation sensor detects a sunlight intensity when a position of sun exists within a predetermined detection range. The blocking mechanism forms a projected light path of the image between the display region and the display panel when tuned OFF, and blocks the projected light path of the image and an incident light path of the sunlight which is a direction opposite to the projected light path when turned ON. The protection processor controls ON/OFF of the blocking mechanism based on an estimated temperature of the display panel, the estimated temperature being estimated by using the sunlight intensity from the solar radiation sensor, luminance of the light source, and an ambient temperature.
If an effect(s) obtained by the representative inventions disclosed in the present application is explained, the head-up display apparatus can prevent damage due to sunlight and ensure user convenience.
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Incidentally, in all the drawings for explaining the embodiments, in principle, the same members are denoted by the same reference numerals, and a repetitive description thereof will be omitted.
<<Outline of HUD Apparatus>>
The vehicle information 4 includes, for example, speed information and gear information of the vehicle 2, steering angle information, lamp lighting information, external light information, distance information, infrared information, engine ON/OFF information, camera image information inside and outside the vehicle, acceleration gyro information, GPS (Global Positioning System) information, navigation information, vehicle-to-vehicle communication information, road-to-vehicle communication information, and the like. The GPS information also includes information on current time. Based on such vehicle information 4, the HUD apparatus 1 uses the image display unit 12 to project a projected image onto a display region 5 of the windshield 3. Consequently, the HUD apparatus 1 makes a driver of the vehicle 2 visually recognize a landscape(s) on which the projected image is superimposed.
Consequently, the driver 6 visually recognizes the projected image, which has been projected on the display region 5, as a virtual image ahead of the transparent windshield 3 in a form of being superimposed on landscapes (roads, buildings, people, etc.) outside the vehicle. The projected image (virtual image) includes various things such as a road sign, a current speed of an own vehicle, and various pieces of information (AR information) added to an object(s) in the landscape. Incidentally, in
Further, a condenser lens 63 is installed between the display panel 64 and the reflection mirror M2. Consequently, sunlight from the sun 60 may be condensed on the display panel 64 via the reflection mirrors M1, M2 and the condenser lens 63. Thus, a drive mechanism 62 for changing an installation angle of the reflection mirror M1 is attached to the reflection mirror M1. The drive mechanism 62 includes a stepping motor and the like. The reflection mirror M1 to which the drive mechanism 62 is attached constitutes a blocking mechanism 67.
The blocking mechanism 67 forms a projected optical path of an image between the display region 5 and the display panel 64 when it is turned off, and blocks the projected optical path of the image and an incident optical path of the sunlight which is a direction opposite thereto when it is turned on. Specifically, as shown in
Incidentally, the blocking mechanism 67 is not necessarily limited to such a configuration, has only to be capable of blocking the incident optical path of the sunlight, and may be, for example, a method of changing the installation angle of the reflection mirror M2, or a method of separately inserting a slide-type shielding plate or the like on the incident optical path of the sunlight. However, as described above, the drive mechanism 62 in the blocking mechanism 67 of
Further, in
In
In detail, the solar radiation sensor 66 detects the sunlight intensity when a position (azimuth direction and elevation angle) of the sun 60 is present within a sunlight detection range 70, as shown in
A range of the incident angle at which the possibility of the damage can be ignored, in other words, a range of the incident angle at which the possibility of the damage cannot be ignored, can be determined in advance based on optical conditions of the optical system including the reflection mirrors M1, M2 and the condenser lens 63 (for example, installation positions, installation angles, sizes, and the like). Thus, the solar radiation sensor 66 detects the sunlight intensity within the sunlight detection range 70 by regarding, as the sunlight detection range 70, a range of the incident angle (position of the sun 60) that cannot ignore the possibility of the damage to the display panel 64.
As a specific configuration of the solar radiation sensor 66, for example, by appropriately installing an opening, a shielding plate, or the like around a light receiving element such as a photodiode, given is such a method as to physically limit the incident angle of the sunlight incident on the light receiving element. Alternatively, by using a known solar radiation sensor capable of detecting both the position of the sun 60 and the sunlight intensity (for example, a sensor that detects the position by a light intensity balance of four light receiving elements), may be a method of performing a signal processing in combination with position information and sunlight intensity information that have been detected.
<<Configuration of Control System of HUD Apparatus>>
The controller 10 mainly controls display of the projected image (virtual image) in the HUD apparatus 1, controls an audio output, and the like. The controller 10 is configured by, for example, a wiring board and the like, and the wiring board is mounted in, for example, the housing 61 of
The vehicle information acquisitor 15 is, for example, a CAN (Controller Area Network) interface, a LIN (Local Interconnect Network) interface, or the like, and acquires the vehicle information 4 based on a communication protocol such as CAN or LIN. As shown in
For example, a vehicle speed sensor 41 detects a speed of the vehicle 2 in
An illuminance sensor 45 and a chromaticity sensor 46 detect external light, and generate external light information as a detection result. A distance measuring sensor 47 detects a distance between the vehicle 2 and an external object, and generates distance measuring information as a detection result. An infrared sensor 48 detects presence/absence of an object and a distance of an object that lie at a short distance of the vehicle 2, and generates infrared information as a detection result. An engine start sensor 49 detects ON/OFF of an engine, and generates ON/OFF information as a detection result.
An acceleration sensor 50 and a gyro sensor 51 detect acceleration and angular velocity of the vehicle 2, respectively, and generate acceleration gyro information representing a posture and a behavior of the vehicle 2 as a detection result. A temperature sensor 52 detects temperatures inside and outside the vehicle, and generates temperature information as a detection result. For example, the temperature sensor 52 can detect an ambient temperature Ta of the HUD apparatus 1. However, as described in
A road-to-vehicle communication wireless transceiver 53 generates road-to-vehicle communication information by road-to-vehicle communication between the vehicle 2 and a road, a sign, a signal, or the like. A vehicle-to-vehicle communication wireless transceiver 54 generates vehicle-to-vehicle communication information by vehicle-to-vehicle communication between the vehicle 2 and another vehicle in the vicinity thereof. An in-vehicle camera 55 and a vehicle-outside camera 56 generate camera image information inside the vehicle and camera image information outside the vehicle by photographing an inside and outside of the vehicle, respectively. Specifically, the in-vehicle camera 55 is, for example, a DMS (Driver Monitoring System) camera or the like that captures a posture, an eye position, a movement, and the like of the driver 6 in
Meanwhile, the vehicle-outside camera 56 captures, for example, surrounding conditions such as a front and a back of the vehicle 2. In this case, analyzing the captured image makes it possible to grasp: presence or absence of obstacles such as other vehicles and people existing in the vicinity thereof; road surface conditions such as buildings and terrains, rain and snow, freezing, and unevenness; road signs; and the like. Further, the vehicle-outside camera 56 also includes, for example, a drive recorder that records a traveling situation as an image.
A GPS receiver 57 generates GPS information obtained by receiving a GPS signal. For example, the GPS receiver 57 makes it possible to acquire the current time. A VICS (Vehicle Information and Communication System, registered trademark) receiver 58 generates VICS information obtained by receiving a VICS signal. The GPS receiver 57 and the VICS receiver 58 may be provided as parts of a navigation system. Incidentally, various information acquisition devices shown in
In
The audio data generator 27 generates audio data based on the vehicle information 4 and the like if necessary. The audio data is generated, for example, in a case of performing voice guidance of a navigation system, issuing a warning to the driver 6 by the AR function, or the like. An audio driver 19 drives the speaker 11 based on the audio data, and causes the speaker 11 to output voice.
The image data generator 28 generates image data for determining a display content of the projected image projected on the display region 5 of
The display driver 20 drives each display element (pixel) included in the display panel 64 in the image display 35 based on the corrected image data from the distortion corrector 29. Consequently, the image display 35 creates (displays) an image to be projected onto the display region 5 based on the corrected image data. The light source adjuster 30 controls brightness of the light source 65 in the image display 35. When a position of the display region 5 in the windshield 3 needs to be adjusted, the mirror adjuster 31 changes the installation angle of the reflection mirror M1 in the image display unit 12 via the drive mechanism 62. Further, as described in
The protection processor 75 includes a timer 76 and, although details thereof are described later, performs various protective operations based on the estimated temperature of the display panel 64 in the image display 35, the estimated temperature being estimated by mainly using: the sunlight intensity from the solar radiation sensor 66; the ambient temperature Ta from the temperature sensor 52 and the like in
The volatile memory 18 mainly holds the acquired vehicle information 4 and various pieces of data used in a processing process of each part in the MCU 16 as appropriate. The communicator 21 communicates with an outside of the HUD apparatus 1 based on a communication protocol such as CAN or LIN. The communicator 21 may be integrated with the vehicle information acquisitor 15. Incidentally, each part in the controller (ECU) 10 of
<<Schematic Operation of Protection Processor>>
Meanwhile, when the sunlight is incident (when the sunlight intensity by the solar radiation sensor 66 is non-zero), the temperature of the display panel 64 rises according to the sunlight intensity. The protection processor 75 is shifted from the normal mode MN to the protective mode MP at a time point (protection-on time tON′) when the temperature of the display panel 64 reaches a protection start temperature (95° C. in this example). In the protective mode MP, the blocking mechanism 67 is turned on (that is, the installation angle of the reflection mirror M1 is in a changed state), and the driving of the light source 65 is stopped.
Here, in each operational mode, it may be difficult to actually measure the temperature of the display panel 64 by the temperature sensor or the like because the display panel 64 has a property in which it is difficult to mount a component(s) thereon. Thus, the protection processor 75 controls the operational modes including turning on and off the blocking mechanism 67 based on the estimated temperature of the display panel 64 that is estimated by using the sunlight intensity from the solar radiation sensor 66, the luminance of the light source 65, and the ambient temperature Ta.
As shown in
This makes it possible to calculate in advance a required time until the temperature of the display panel 64 reaches a protection start temperature (for example, 95° C.) from the saturation temperature Tsat on the premise of a constant sunlight intensity. Then, based on the constant sunlight intensity and the required time, an on-intensity Ion and a continuous detection time TON in
Meanwhile, the protection processor 75 is shifted from the protective mode MP to the degenerate mode MD when the sunlight intensity is in a state of the off-intensity Ioff or less predetermined by the sunlight intensity and the state continues for an interval of a predetermined continuous undetected time TOFF. In the degenerate mode MD, the blocking mechanism 67 is turned off (that is, the installation angle of the reflection mirror M1 is in the initial state), and the light source 65 is driven in a state where the maximum luminance Lmax is limited to a value lower than that in the normal mode MN.
For example, the maximum luminance Lmax in the degenerate mode MD is limited to 70% or the like of the maximum luminance (Lmax (Ta)) in the normal mode MN. At this time, the protection processor 75 determines, for example, the maximum luminance (Lmax (Ta)) in the normal mode MN according to the ambient temperature Ta. Specifically, for example in
By providing such a degenerate mode MD, the temperature of the display panel 64 can gradually come closer toward the saturation temperature Tsat as shown in
Therefore, when the overshoot occurs, a period in which the temperature of the display panel 64 cannot be estimated with high accuracy leads to occurring consequently. Specifically, there may be periods when the actual temperature is slightly higher than the estimated temperature. Then, in a process of performing control based on the estimated temperature, there is the possibility that the temperature of the display panel 64 exceeds an upper limit temperature in specifications. For example, if the protective mode MP occurs with high frequency to some degree, errors may accumulate and it may be difficult to control the temperature of the display panel 64. Thus, in order to eliminate an error factor that may occur in the control based on the estimated temperature without causing such an overshoot, it becomes beneficial to provide the degenerate mode MD that limits the maximum luminance Lmax.
Incidentally, in a case of an LED light source, the luminance of the light source 65 is controlled by a PWM duty ratio (=LED on-time/PWM cycle). In this case, the protection processor 75 of
That is, in
Further, in this example, the estimated temperature of the display panel 64 has been used in the form of being indirectly reflected by: the on-intensity Ion and the continuous detected time TON in being shifted to the protective mode MP; set luminance in the degenerate mode MD; and the like. However, in some cases, the protection processor 75 may control the operative mode by directly using the calculated estimated temperature while sequentially calculating the estimated temperature of the display panel 64 by the calculation as described in
<<Detailed Operation of Protection Processor>>
First, outlines of these flows will be described. As described in
Here, in the degenerate mode MD, since the maximum luminance Lmax of the light source 65 is limited, it is necessary to return to the normal mode MN under some conditions. Thus, when the protection processor 75 detects that power of the vehicle 2 is turned on again (for example, an ignition switch is turned on from off) in a period after an operation in the degenerate mode MD continues for a predetermined standby time, it is shifted from the degenerate mode MD to the normal mode MN. The standby time is, for example, 3 hours or more, typically 6 hours or the like. Further, it can be determined whether the standby time has been continued, for example, by acquiring the current time from the GPS receiver 57 or the like of
This standby time (6 hours) is predetermined based on, for example, a sunlight detection range 70 of
Further, if luminance suddenly changes after 6 hours have passed in a process of the driver continuing driving, the driver's consciousness is directed to it and the safety may be impaired. Thus, it becomes a condition that the power of the vehicle 2 is turned on again. Meanwhile, used may be such a method that the maximum luminance Lmax in the degenerate mode MD is gradually increased toward the maximum luminance Lmax (Ta) in the normal mode MN with time. However, in this case, a complicated processing may be required to estimate the temperature of the display panel 64. Therefore, from such a viewpoint, it is beneficial to keep the maximum luminance Lmax in the degenerate mode MD at XX % (for example, 70%) of the maximum luminance Lmax (Ta) in the normal mode MN.
Also, as an exceptional case, the driver may turn off the power of the vehicle 2 during a period of the protective mode MP. For example, if the power of the vehicle 2 is turned off immediately after the shift to the protective mode MP and the power of the vehicle 2 is turned on again immediately after that, activating it from the initial state (that is, the normal mode MN) may be unable to achieve the protection of the display panel 64. Thus, the protection processor 75 includes a timer 76 as shown in
The timer 76 counts the same time as the off-time TOFF (for example, 5 minutes) from a time point of being shifted to the protective mode MP (protection on-time tON′ in
Further, even if the power of the vehicle 2 is turned off immediately after the shift to the protective mode MP and a time when the power of the vehicle 2 is turned on thereafter is a time after the counting operation of the timer (after-protection timer TW) has expired, the protection processor does not need to maintain the protective mode MP. In this case, in
Next, details of these processing contents will be described. In
In the protection necessity determination of
After step S203, the protection processor 75 determines whether the on-timer (TON) has expired (step S204). When the on-timer (TON) is counting, the protection processor 75 ends the processing. Meanwhile, when the on-timer (TON) has expired, the protection processor 75 is shifted to the protective mode MP (step S205). Then, the protection processor 75 records, as the protection-on time tON′, the current time acquired from the GPS receiver 57 or the like of
Thereafter, the protection processor 75 notifies the user (driver) of the protective mode MP (step S208). That is, in the protective mode MP, since the projected image is not displayed in the display region 5, the driver's consciousness is directed to it and the safety may be impaired. Thus, for example, a warning as shown in
In an example of
In the return possibility determination of
In the return possibility determination [1] of
When the sunlight intensity is the Off-intensity Ioff or less in step S403, the protection processor 75 activates an off-timer (TOFF) for counting the off-time TOFF (step S404). The off-timer (TOFF) is one of the timers 76 in
After step S404, the protection processor 75 determines whether the off-timer (TOFF) has expired (step S405). When the off-timer (TOFF) is counting, the protection processor 75 ends the processing. Meanwhile, when the off-timer (TOFF) has expired, the protection processor 75 is shifted to the degenerate mode MD (step S406). Thereafter, as described in
In the degeneracy release determination of
Next, the protection processor 75 determines whether the power-on operation time tPON of the vehicle 2 has elapsed the standby time (for example, 6 hours) from the protection-on time tON′ recorded in step S206 of
In the return possibility determination [2] of
Subsequently, when the after-protection timer TW expires in step S603, the protection processor 75 activates the HUD apparatus in a state set in the degenerate mode MD (that is, displays the projected image on the display region 5) in step S604. Thereafter, as described in
Meanwhile, when the after-protection timer TW is not counting in step S602 (that is, when the timer has expired), a processing as shown in
When the sunlight intensity is the off-intensity Ioff or less in step S702, the protection processor 75 performs the same processings as those of steps S502 to S504 of
Then, when the standby time has elapsed in step S704, the protection processor 75 activates the HUD apparatus in a state set in the normal mode MN in step S705 (that is, displays the projected image on the display region 5). Meanwhile, if the standby time has not elapsed in step S704, the protection processor 75 activates the HUD apparatus in a state set in the degenerate mode MD (step S706). Thereafter, as described in
<<Main Effects of Embodiments>>
As described above, using the HUD apparatus of the embodiment typically makes it possible to prevent the damage due to the sunlight and to secure the user convenience. That is, while the display panel 64 is protected, the time zone during which the HUD cannot be used is shortened as much as possible, in other words, the time zone during which the HUD can be used (the time zone in which the projected image on the display region 5 is displayed) can be extended.
Specifically, by the sunlight intensity within the sunlight detection range 70 being detected by the solar radiation sensor 66, the time zone in which the HUD can be used can be extended without being unnecessarily shifted to the protective mode MP. Further, even when the mode is shifted to the protective mode MP and when the sunlight intensity is low, the time zone in which the HUD can be used can be extended by canceling the protective mode MP after the off-time TOFF. Furthermore, when the protective mode MP is canceled (released), the display panel 64 can be reliably protected by shifting to the degenerate mode MD instead of the normal mode MN.
In the foregoing, the invention made by the inventors of the present invention has been specifically described based on the embodiments. However, it is needless to say that the present invention is not limited to the foregoing embodiments and various modifications and alterations can be made within the scope of the present invention. For examples, the above-mentioned embodiments have been described in detail so as to make the present invention easily understood, and the present invention is not always limited to the embodiment having all of the described constituent elements. Also, a part of the configuration of one embodiment may be replaced with the configuration of another embodiment, and the configuration of one embodiment may be added to the configuration of another embodiment. Furthermore, another configuration may be added to a part of the configuration of each embodiment. Moreover, another configuration may be added to a part of the configuration of each embodiment, and a part of the configuration of each embodiment may be eliminated or replaced with another configuration.
Number | Date | Country | Kind |
---|---|---|---|
2020-032959 | Feb 2020 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2021/002891 | 1/27/2021 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2021/171885 | 9/2/2021 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20150098029 | Sato | Apr 2015 | A1 |
20160161742 | Yonemoto | Jun 2016 | A1 |
20170075118 | Wall | Mar 2017 | A1 |
Number | Date | Country |
---|---|---|
2015-31793 | Feb 2015 | JP |
2015-152746 | Aug 2015 | JP |
2019-89436 | Jun 2019 | JP |
10-2010-0033770 | Mar 2010 | KR |
Entry |
---|
International Search Report of PCT/JP2021/002891 dated Mar. 30, 2021. |
Number | Date | Country | |
---|---|---|---|
20230103912 A1 | Apr 2023 | US |