Patent Application
20120268582
The invention relates to a vehicle having a device for generating a head-up display, i.e., a device for the projection of information into the driver's field of view via the windshield.
Head-up displays are used for the projection of information into the driver's eye. In some cases, such projections enable the driver to refrain from looking at the instruments (speedometer, navigation display), whereby an additional time-consuming and strenuous accommodation of the eye (dynamic adaptation of the eye's refractive power) is made unnecessary. In most cases, the projection beam path of the head-up display into the driver's eye is to be adapted to the driver's height and position or to the size and the position of the defined eye region (eye box).
DE 10 2004 031 311 A1, which is incorporated by reference, shows a generic optical device for the representation of information on a projection surface with an image sensor matrix on which the pupil of a user can be imaged.
An essential concept of an aspect of the invention is statically or dynamically introducing an additional camera comprising a focusing element and an image sensor into the beam path of a head-up display. The focusing element may be, e.g., a lens or an objective. Preferably, a CMOS or CCD chip is used as an image sensor.
The camera may be introduced into the optical system of the head-up display via a beam splitter or by means of a mechanically introduced camera, the latter being located on, e.g., a chopper wheel. Coupling a hinged mirror in (cf. reflex camera) is also possible. The camera could also be statically located in the beam path if a certain region of the projection of the head-up display does not have to be used. The camera may correspond to a cellphone camera.
An essential advantage of the invention consists in the fact that outstanding new camera functions can be realized by using the optical elements of the head-up display without much additional construction work. In the following, said functions will be described in greater detail.
A camera-based rain sensor can be realized by introducing the camera into the beam path. According to aspects of the invention, the focusing element of the camera is arranged in such a manner that a region of the outside of the windshield is imaged on the image sensor in a focused manner. The imaged region on the outside of the windshield corresponds to the region through which the virtual beam path of the head-up display passes.
The optical system of the head-up display is particularly used to obtain a relatively large sensor area on the windshield for rain detection. An evaluation of the camera images allows a reliable detection of rain or dirt particles on the windshield.
Prior-art rain sensors are arranged in the upper region of the windshield and hence observe a windshield part that does not correspond to the part of the windshield through which the driver of a motor vehicle looks. The sensor is not able to detect any local water (e.g., splashed water from a puddle etc.) and dirt accumulation present in the driver's field of view if they are not present in the field of view of the sensor as well. The sensor area of prior-art rain sensors is relatively small (about 2.5 cm2), which restricts reliable and fast rain detection. These rain sensors are visible from outside through a recess in the blackened part and partially spoil the design of the vehicle. Prior-art rain sensors, as stand-alone sensors, require space in a cramped zone of the vehicle, additional communications lines and supply lines as well as an eyehole in the blackened part of the windshield (footprint). Prior-art rain sensors in standard cars are sometimes interference-prone and annoy the driver of the motor vehicle by wrong or missing wiping.
The inventive way of rain sensing using the optical elements of a head-up display has great advantages over conventional optoelectronic or camera-based rain sensors. The sensor area is in the driver's field of view, wherein the sensor is not noticed by the driver. Rain and dirt are directly detected in the region that is most important to the driver. In comparison with prior-art rain sensor systems, the sensor area is relatively large so that faster and reliable detection is possible. For projection, the head-up display covers a windshield area of about 300 cm2, whereas the currently used sensor area is about 2.5 cm2.
The design of the solution presented herein is clearly advantageous since no sensor is visible from outside. The electronic components of the camera may be integrated into the electronic components of the head-up display, which saves costs and space. A camera-based rain sensor having a large field of view on the windshield can solve the problems of the prior-art rain sensors (e.g., drizzle) by means of an appropriately higher pixel resolution and also enables many other functions (e.g., detection of dry dirt).
A further advantage is the possibility of assessing the result of the wiping operation of the windshield cleaning system.
The camera-based rain sensor in the head-up display looks upwards so that it is largely protected from interferences caused by other road users.
In a preferred further development of an aspect of the invention, rain and dirt detection on the windshield is combined with a simultaneous observation of the driver's eye region by means of a camera. For this purpose, a bifocal focusing device is provided that operates according to, e.g., the principle of the refractive effect of a partially introduced plane-parallel plate in the convergent beam path, whereby two object planes can be achieved: one part of the footprint area on the windshield may be used to detect reflections of light in the raindrops in a first object plane and to drive the windshield wiper. The second object plane is the driver's eye region. In a first partial region, the image sensor delivers focused images of the outside of the windshield. In a second partial region, the image sensor delivers focused images of the driver's eye region. In the latter case, the windshield functions as a mirror. The beam path of the head-up display is used in an inverse direction. The second partial region of the image sensor receives light radiation from the eye box (eye region) of the driver. The arrangement of the focusing element allows the recognition and identification of the eyes and the surrounding areas of the face of the driver from the camera images. Driver identification may be advantageous in many ways (e.g., release of ignition, anti-theft device, child-proof lock, personalization of safety and comfort functions).
The driver identification system may be additionally supported by a modulated light source (e.g., voltage modulation of passenger compartment illumination). Thus, the driver can be quickly and reliably recognized before he or she starts the vehicle.
The observation of the driver's eye region may also be used for fatigue detection. In combination with a lane detection function, fatigue (as a reason for deviating from the traffic lane) can be detected more reliably and a dangerous situation can be defused by warning the driver appropriately (vibration, acoustic signals, light-induced pulse of passenger compartment illumination etc.).
The head-up display is capable of projecting light patterns onto the windshield. In a preferred embodiment, these light patterns may be used for rain detection, for example. Moreover, the air space above the windshield is advantageously illuminated by the head-up display. If additional illumination is required, it could be designed as IR illumination. If necessary, the head-up display may illuminate, in a clocked manner, the windshield part for improved rain or dirt detection. Generally, a part of the projected light of the head-up display is upwardly decoupled from the windshield. In order to prevent the driver from being disturbed by said windshield illumination, additional coupling-in of IR light may also be performed.
For example, rain detection may be illuminated by means of a cyclic light signal in the invisible spectral range (e.g., infrared) of the head-up display, said light signal covering the whole area. It is also possible to illuminate the area of the face (eye box) by means of infrared light (e.g., as a superimposed surface projection of an additional IR light source by the head-up display). In this manner, the driver's eyes can be cyclically observed while the vehicle is in motion.
In a preferred embodiment, a polarizing filter is at least partially arranged in the beam path between the optical or mechanical element and the image sensor.
For optimizing the observation of the eyes, a polarizing filter may be preferably provided in order to prevent light from shining from the surroundings (from above through the windshield) into the camera system. Said polarizing filter absorbs the light radiation that is not reflected via the windshield from the passenger compartment of the vehicle.
If the outside of the windshield is illuminated for rain detection, only a very small part of the light radiation is reflected from the inclined windshield into the eye region if no preferred polarizing direction of illumination is used. The reflected part is even smaller if that polarizing direction which is deliberately avoided by the light source of the head-up display is used in a calculated manner for illumination. In this manner, a maximum part of light passes the windshield, and light that is totally reflected or scattered back by raindrops or dirt is used for rain and dirt detection.
If the outside of the windshield and the eye region are simultaneously observed by means of a camera, the two regions are preferably illuminated by means of a polarizing filter with two partial regions with opposite polarizing directions, and the two regions are imaged onto the image sensor by means of a further polarizing filter with two partial regions with opposite polarizing directions.
So we propose a camera whose depth-of-field zone includes both the object plane “windshield” and the object plane “eye box”, wherein a partial polarizing filter coating between the objective and the sensitive image sensor surface is designed in such a manner that the polarizing filter effects for the defined image regions (eye box and windshield region for rain detection) are opposite to each other. By specifically illuminating the rain sensors with oppositely polarized light, making a distinction between the at least two different object planes can thus be supported in order to develop a reliable algorithm for object recognition. The polarizing filter/s may also be introduced dynamically since both object recognition processes do not have to be designed as fast processes.
The windshield area provided for rain detection may also be illuminated with visible light that is not or preferably oppositely polarized relative to the light radiation of the eye box.
The required camera may be used to determine the light in the surroundings and may deliver important sensor information for the head-up display, the air conditioning system, and the vehicle lighting system.
The sensor may also have further functions. For example, it may function as a communication interface between man and vehicle. Possible applications may include, e.g., opening the vehicle by, e.g., placing a card with an imprinted code on the windshield footprint of the head-up display or by having a fingerprint evaluated by the camera. Said opening function is enabled by the camera being focused on the outside of the windshield.
In an advantageous realization, the vehicle has at least one of the following assistance functions on the basis of an evaluation of the data from the image sensor: driver recognition, fatigue detection, rain/dirt detection.
Exemplary embodiments and drawings will be described in the following.
The invention is best understood from the following detailed description when read in connection with the accompanying drawing. Included in the drawing is the following figure:
The region (5) between the light source (4) and the deflection mirror (2) shown in
In
The image data of the camera (6, 8) can be used for the detection of the presence of raindrops (7) or dirt particles on the windshield (3) and for the generation of a signal for activating the windshield wipers or a windshield washing program.
Advantageously, the rain sensor is not visible from outside although the region of the windshield in which rain or dirt particles is/are detected is directly located in the driver's field of view.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2009 054 194.2 | Nov 2009 | DE | national |
This application is the U.S. National Phase Application of PCT/DE2010/001219, filed Oct. 16, 2010, which claims priority to German Patent Application No. 10 2009 054 194.2, filed Nov. 24, 2009, the contents of such applications being incorporated by reference herein.
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/DE10/01219 | 10/16/2010 | WO | 00 | 7/2/2012 |
