Patent Application
20070278406
The present invention relates to a night-vision system for motor vehicles, which includes a camera having an image sensor surface that is sensitive to radiation and which is configured to detect electromagnetic radiation from the near-infrared range.
Systems for night-vision assistance are becoming more common in motor vehicles. Night-vision systems serve the purpose of improving the driver's vision at night, beyond the range of a dimmed headlight, through the use of cameras and displays or windshield projections. The oncoming traffic must not be blinded by glare as would be the case with a conventional high beam, which also includes light in the visible range.
Night-vision assistance is achieved by utilization and detection of wavelength ranges that are not visible to the human eye. These are made accessible to the driver via cameras, using displays or windshield projections (for instance, by head-up displays).
Conventional halogen headlights (high beam and low beam) include both spectral components in the visible range (VIS, 380 nm-780 nm, cf. DIN 5030 part 2) and also in the near-infrared (NIR IR-A, 780 nm-1400 nm). Current NIR high beam headlights use conventional halogen bulbs and block the visible range with the aid of optical filters. In the future, NIR high beam headlights based on lasers or LED's may become available as well. Video cameras on the basis of CCD or CMOS technology have a spectral sensitivity that ranges from approximately 380 nm to roughly 1100 nm. That is to say, only the range between 780 nm and 1100 nm of the NIR-IR-A range is utilized. It is denoted by NIR range in the following.
Various known night-vision systems utilize the non-visible near-infrared range (NIR range) having wavelengths of 780 to approximately 1100 nm. In these NIR-based, so-called active systems (in contrast to systems that are based on heat radiation of the far-infrared) the region illuminated by NIR high beam headlights of the motor vehicle is recorded as near-infrared image using a video camera, and is visualized to the driver by means of a display (conventional or head-up display) in order to provide night-vision assistance to the driver.
In pure NIR systems (without VIS range utilization), the image from the NIR region of 780 nm to approximately 1100 nm is merely recorded by the camera and made visible to the driver on a display or head-up display. Such a system is described in an article by Kunihiko Toyofuku et al.: “The Night View System using Near-Infrared Light” in SAE 2003-01-0018, p. 33-p. 38. There, a block filter in the optical path in front of the image sensor (imager) completely suppresses the recording of the visible range (VIS range), i.e., the wavelengths between 380 and 780 However, in doing so, possible improvements in the image quality of the image regions relevant for night-vision assistance are prevented by radiation from the visible (VIS) range, and safety-relevant information about preceding vehicles, such as LED-based brake lights, which is available only in the visible range, is withheld from the driver.
In addition, mixed NIR-VIS systems are known. Here, radiation both from the NIR and the VIS range is recorded and the image visualized on a display. The camera utilized for this purpose is sensitive in a wavelength range of approximately λ_low to λ_high, λ_low lying in the visible range between 380 nm and 780 nm, and λ_high lying between 780 nm and 1100 nm in the NIR range.
One particular problem in pure NIR systems and in the combined NIR-VIS systems is the uneven illumination of the region detected via the camera. For better vision at night, it is mainly the visualization of the visual field beyond the low beam range that is of interest. The low beam range (denoted as close range in the following) is already sufficiently illuminated by the low beam and thus of secondary importance, but it is displayed (at least partially) nevertheless so as to facilitate driver orientation when viewing the night vision image. The camera image for this range is brightly illuminated because the conventional low beam and the NIR high beam supplement each other. In addition, close regions are more highly illuminated as a matter of principle and imaged more brightly than more distant zones.
Part of the limited brightness dynamics of the camera and the displays is thus “given away” because of the bright close range, so that dark regions, beyond the close range, for example (denoted as far range in the following), are no longer able to be resolved as well.
Furthermore, the driver's attention becomes increasingly drawn to the bright close range, thereby making it more difficult to perceive critical details in the far range.
Dimming of areas that are brighter than desired, computer-implemented by software algorithms in the processing of the image (in pure display systems also known as image processing), requires complicated computer work and additional memory capacity, which increases the cost of the correspondingly equipped night-vision control device. In basic night-vision systems, which do not include an image-processing computer, such software-based postworking of the camera image is not possible.
Overmodulations of the imager due to limited brightness dynamics are also no longer able to be corrected by software-based postprocessing. In addition, a wavelength-dependent attenuation of the close range via software algorithms is not possible in gray-value cameras, and only with great effort in the case of color cameras.
The present invention make it possible to attenuate the recorded radiation on predefined partial regions of the image-sensor surface of the camera of the night-vision system that would otherwise be regularly exposed to undesired high radiation intensity, such attenuation being implementable without the aid of image-processing software algorithms. Since according to the present invention the attenuation of the radiation in predefined partial regions is effected by an optical filter element appropriately disposed in the optical path of the night-vision system, the radiation is reduced in the desired image regions, for example the image of the excessively bright close range, in particular, even prior to being recorded. For the purpose of the present invention, the optical path denotes the path from the illuminated object to the imager. For the present invention, suitable positions of the filter element are positions in the section immediately in front of and/or within the camera.
This arrangement dispenses with costly software algorithms for image postworking in order to dim image areas that would normally have an undesired excessive brightness. In an uncomplicated manner, the driver's gaze is focused more on the image sections that are of interest for night vision assistance. Overmodulation of partial regions of the image-sensor surface is avoided, and the available brightness dynamics of the camera and display with respect to the image regions relevant for night-vision assistance are utilized in an optimal manner.
An advantageous example embodiment of the system according to the present invention includes a camera, which is sensitive in a wavelength range of 380 to 1100 nm. The radiation is recorded both from the VIS and NIR range, which improves the quality of the night-vision assistance (LED brake lights and tail-gate lights, for example, are visible as well).
Another advantageous example embodiment of the night-vision system according to the present invention is the filter-related attenuation of the radiation of at least the area of the image-sensor surface on which the close range is imaged from the driver's perspective.
This is the area immediately in front of the motor vehicle, which is already adequately viewable with the aid of the low beam from the driver's perspective. According to the present invention, the high brightness, caused particularly by a combination of low beam and NIR high beam, is thereby attenuated in this region of low interest in the context of night-vision assistance, which improves the night vision beyond the low-beam range. The driver's attention is not distracted by high brightness in the close range. Moreover, the dynamic range of the camera is utilized to better effect, so that dark image regions (especially in the far range) are able to be resolved more highly.
An advantageous further aspect of the present invention is a wavelength-dependent filter characteristic of the optical filter, which has a transmittance function that is individually adapted to the particular use of the system. For instance, the wavelength characteristic of the image sensor in the camera and/or the headlight may be taken into account by an inverse wavelength characteristic of the optical filter, thereby achieving a homogenous spectral sensitivity of the overall system across a large range of wavelengths.
Due to the selection of different spectral ranges of low beam and NIR high beam, the attenuation of the low beam is able to be simplified considerably. If the spectrums of NIR high beam and conventional low beam are selected such that they do not overlap (by blocking the NIR portion with the aid of an optical filter in the low-beam headlight, for instance), complete suppression of the low-beam light component in the NV image is possible (spectral separation).
Especially advantageous is a blocking of all spectral components beyond approximately 600 nm in the low-beam spectrum because this allows the night-vision camera to be configured in such a way (transmittance range of 600 to 1100 nm) that LED tail lights or brake lights having a wavelength of 625 nm, for instance, are still able to be detected despite suppression of the low beam. When configuring the wavelength-dependent filter characteristic, the spectral reflection behavior of the street (from asphalt, for example) may be taken into account as well.
The exchangeability of the optical filter constitutes an additional improvement. It allows a simple adaptation to different vehicle types or vehicle variants. Retrofitted systems may thus be adapted to different types of vehicles in a simple manner as well.
Especially suitable for effective attenuation of radiation from a specific object range, such as the close range, is the positioning of the filter immediately in front of the image-sensor surface. An optical filter in the form of a coating on the image-sensor surface is an advantageous variant in this context because it requires no affixation device for the filter. As an alternative, the filter may be applied as coating on a glass cover for the image sensor (glass lid), which protects the actual image sensor and its bond wires from damage. Alternatively, the lid itself may be embodied as optical filter. An integration of the filter into the lens may be advantageous as well. In particular, the coating of the last lens facing the imager suggests itself in this context.
In the figures, identical or functionally equivalent components are denoted by matching reference numerals.
Upon activation of the night-vision system by an operating unit 13, control unit 3 turns on NIR high-beam headlights 5. These headlights 5 illuminate a spatial range in the NIR wavelength range (780 to approximately 1100 nm) in front of the vehicle that is similar to that of conventional high beam headlights. The illumination range amounts to approximately 250 meters.
A camera 7, which is sensitive also to the NIR range and includes a CCD or CMOS image sensor (with linear or non-linear intensity characteristic in each case) and has a depth of focus from approximately 2 m to infinite, records, among others, the NIR radiation reflected by objects located in the NIR high-beam range. According to the present invention, camera 7 is equipped with an optical filter element 9, which is positioned in the optical path of night-vision system 1 and attenuates the radiation on a predefined partial region of image-sensor surface 11 in camera 7. The image-sensor surface is a CCD or CMOS chip, for example.
The image data recorded by camera 7 are transmitted to an imaging unit 15 by control unit 3. In imaging unit 15, the image of the camera is visualized on a display 17 for the driver. Display 17 is a so-called head-up display, for instance, by which the visualized image of the camera is reflected to a lower portion of the windshield in a manner that allows it to be clearly visible to the driver.
It is advantageous to have filter element 9 as close as possible to image-sensor surface 11 in order to obtain the sharpest possible boundary between the close range image and the far range image with the smallest possible overlap, so that the fewest number of rays of image points from the far range is projected in a filtered manner, and the highest number of rays from close range 20 is filtered by filter 9.
The radiation from close range 20 recorded by camera 7 is projected onto an upper region of image-sensor surface 11, the so-called close range image region 24, via camera lens 22, which is shown as a lens overall. According to the present invention, filter element 9 is positioned directly in front of this close range image region 24.
Filter element 9 may be made of the material/the layers of a conventional interference filter or adsorption filter. This filter 9 attenuates the radiation from close range 20 according to its wavelength characteristic. The unfiltered radiation coming from the far range impinges upon the remaining portion of image sensor surface 11. For instance, a filter whose attenuation of the radiation has the inverse, locus-dependent characteristic of the imaging of the motor vehicle's low beam light is mounted in front of image sensor surface 11. However, other filter elements that cover a range going beyond the pure close range are conceivable as well. They have a locus-dependent filter characteristic, for instance, which orients itself on the overall intensity of the radiation recorded by camera 7 and thus not only corrects halation of the close range, but additionally also compensates for inhomogeneities in the far range by an inverse characteristic. A homogenous intensity of the entire visual range of the camera is able to be achieved in this way, so that vignetting, for example, is compensated. Filter 9, i.e., the filter coating, may then influence the entire imager surface or else only portions thereof.
Filter 9 may also have a wavelength-dependent transmittance characteristic. Furthermore, a combination of locus-dependent and wavelength-dependent characteristic is possible.
Transmission rate T is a function over wavelength A. The attenuation for the visible range (380-780 nm) is very high at approximately 90%. In contrast, the suppression of radiation in the NIR range (780-1100 nm) amounts only to 4%. A combination of the locus-dependent characteristic with a wavelength-dependent transmittance characteristic is advantageous also for achieving a likewise high attenuation of the NIR radiation from the close range and an equally satisfactory transmittance of VIS and NIR radiation for the remaining image-sensor surface area.
With regard to the local filter characteristic,
Since filter 9 (not shown in
The filter is configured not to provide attenuation for dark regions, and filter 9 is to provide strong attenuation for bright areas. The brightness stages lying in-between should be imaged continuously, if possible, in an inverse manner as well.
The locally varying attenuation and the stepless variation, if possible, of the transmittance capacity of filter 9 is able to be realized in different ways.
For one, it may be achieved by a locally varying application of a different number of attenuation layers having the same transmissivity.
One attenuation layer has a transmissivity of 95%, for example. If five layers, for instance, are then applied on top of one another, one obtains an overall transmittance of 95% to the power of 5=77%. The different number of layers at different locations may be realized by masks or multiple coatings, for example.
For another, it may be achieved by a locally varying application of different layers having different transmissivity. In this manner, layers having transmissivities of 95%, 90%, 85% . . . , for example, are applied one after another using a plurality of masks that do not overlap. The two methods may also be combined.
Although the present invention was described above in terms of exemplary embodiments, it is not limited to these embodiments, but rather may be modified in numerous ways.
For instance, the optical filter may already be affixed in the optical path of the night-vision system in front of the camera. A partially filtering coating of the windshield, for instance, is conceivable.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2004 001 556.2 | Jan 2004 | DE | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/EP04/53035 | 11/22/2004 | WO | 5/17/2007 |
