The invention relates to a sensor arrangement for a motor vehicle for detecting an environment having at least two camera systems.
A sensor system of this type can be used, for example, for assisting the driver, thus for supporting an operator of a vehicle. It supplies information on the environment and can be used in the domain of lane tracking, for a warning in the case of a lane deviation, or in the domain of automatic vehicle guidance.
In the case of such sensor systems, it is known to use so-called CCD cameras (CCD=charged coupled device). However, it should be taken into account that the functionality of driving assistance systems is limited when the sensor is already subjected to limitations when detecting the environment. In the case of CCD cameras, it is known that, especially in darkness and in the event of blinding due to an external light source, these cameras have a limited functionality. In this case, with respect to a blinding light in darkness, a superproportional limitation should be taken into account, specifically when the CCD camera is adjusted to the environmentally caused illumination level. In the event another vehicle driving with switched-on lights is encountered, the image information is even largely destroyed by the oncoming blinding light sources.
The use of infrared cameras in such sensor arrangements is also known (see. e.g. technical journal: CAR AND DRIVER, October 1998). Infrared cameras obtain a heat image of the driving environment. In the heat image, all contours and objects are based on thermal contrasts. However, the information which is important for the driving task or for the reaction of a driver assistance system cannot always be obtained from the heat image.
European patent document EP 0 454 516 A1 describes an obstacle detection system having two video cameras, which generate images in the visible and in the infrared range. For generating images in the infrared range, CCD technology is used, for example. By means of a similar video camera, which can detect the entire spectrum, a differential signal is generated. This differential signal or differential image relates to the visual range, which is covered by the cameras and is based on the contrast of an object in this visual range. Japanese patent document JP-10 255019 also describes a system with a CCD camera, which generates a visible image from the area in front of a vehicle. Furthermore, an infrared image is generated by an additional infrared camera. Based on the temperature information, a threshold for illuminated parts is generated, and an improved vehicle detection can take place on the basis of this threshold.
It is an object of the present invention to further develop a sensor arrangement of the above-mentioned type such that the environment can be detected essentially without any limitation of the functionality.
This object is achieved by a sensor arrangement for a motor vehicle for detecting the environment using at least two camera systems. Each camera system operates in a different spectral region. Each camera system is adjusted to obtain images in different distance ranges.
An essential idea of the invention is to use at least two camera systems with respectively different spectral operating regions.
In this case, the different camera systems are adjusted to different distance ranges. For example, an infrared camera takes over the environmental detection in the remote range because it is suitable for day and night use and is free from the effects of blinding. Freedom from blinding means, in this context, that the individual pixels are not overmodulated by the headlights of oncoming vehicles. The image information is therefore retained although the environment is completely dark. The close range is detected by the CCD camera. In particular, the CCD camera is adjusted such that it operates in a range which is illuminated by the front headlights when the vehicle headlights are switched on. Because of the higher illumination level, this measure reduces the susceptibility of the CCD camera to blinding effects.
According to a preferred embodiment, the sensor arrangement comprises a CCD-camera (charged coupled device) and a camera which operates in the infrared range. The infrared camera represents, for example, a meaningful supplementation of the sensor system (CCD), which is visual here, beyond its detection limits in the extended area in front of the driving environment.
When using camera systems adjusted to different distance ranges and with connected imaging scales, the driving environment, as a whole, can be detected better in both the close and remote ranges.
Another advantage of using two camera systems with different spectral operating regions consists of determining the atmospheric absorbance in the two spectral regions via differential contrast evaluation, a comparison of differences in contrast between objects and their environments. Because atmospheric absorbances have different effects on images formed by different camera systems adjusted to different distance ranges, by comparing differences in contrast observed by the different camera systems (which are indicative of the atmospheric absorbances), conclusions can be drawn with respect to the extent of fog or haze. Furthermore, in conjunction with a visual range model stored in a vehicle, a driver's visual range can be determined from the detected absorbances. This information, in turn, can be made available to the driver, or control parameters can be adjusted in the vehicle as a function of the determined driver's visual range.
These and other advantageous embodiments are defined in the subclaims.
The single FIGURE will be explained in detail in the following and with reference to the single drawing. The FIGURE of the single drawing is a schematic top view of a vehicle with a sensor system according to the invention arranged on the front of the vehicle.
A vehicle 10 has two headlights 12, which illuminate a certain light range L during operation.
Between the two front headlights 12, two cameras are arranged, specifically in this case, an infrared camera 16 and a CCD camera (CCD=charged coupled device) 14. Both cameras 16 and 14 are aligned in the driving direction. The CCD camera is constructed and adjusted such that it essentially detects the range A, which is illuminated when the front headlights are switched on and therefore corresponds to the range L.
In contrast, the infrared camera 16 detects the environment particularly in the remote range B.
Both cameras 16, 14 are connected with a control and analyzing device 18. The control and analyzing device 18 emits a signal to a display 20, which is arranged in the interior of the vehicle within the driver's viewing range. The display 20 informs the driver of the environmental situation in the detected ranges.
In addition, but not shown in the FIGURE, the control and analyzing device 18 can supply its information also to other units in the vehicle, for example, to systems concerned with automatic vehicle guidance.
On the one hand, the control and analyzing device 18 forwards the information transmitted by the cameras 16 and 14 directly to the driver. It also carries out a differential contrast evaluation. As a result, the atmospheric absorbance can be determined in the two spectral regions. If a visual range model is also stored in the control and analyzing device 18, by way of the detected absorbances and by means of a differential contrast evaluation, a conclusion can also be drawn with respect to the driver's visual range.
This visual range and/or these detected absorbances can then be utilized for adapting control parameters or for recommending a vehicle speed to the driver.
However, for determining the atmospheric absorbance in the visible spectral region, another system, such as a light detection and ranging (LIDAR) system may also be used.
A memory device 22 can be provided in which a visual range model is stored. A device 24 is provided by which a conclusion can be drawn with respect to the visual range from information of the analyzing device 18.
Number | Date | Country | Kind |
---|---|---|---|
199 45 588 | Sep 1999 | DE | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCTEP00/09183 | 9/20/2000 | WO | 00 | 3/8/2002 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO0121438 | 3/29/2001 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5001558 | Burley et al. | Mar 1991 | A |
5051906 | Evans, Jr. et al. | Sep 1991 | A |
5686889 | Hillis | Nov 1997 | A |
5742335 | Cannon | Apr 1998 | A |
5952957 | Szu | Sep 1999 | A |
6028672 | Geng | Feb 2000 | A |
6341016 | Malione | Jan 2002 | B1 |
6344893 | Mendlovic et al. | Feb 2002 | B1 |
6483429 | Yasui et al. | Nov 2002 | B1 |
6753766 | Patchell | Jun 2004 | B2 |
20040051634 | Schofield et al. | Mar 2004 | A1 |
Number | Date | Country |
---|---|---|
0 454 516 | Oct 1991 | EP |
736414 | Oct 1996 | EP |
2 687 000 | Aug 1993 | FR |
4-164281 | Jun 1992 | JP |
4-164282 | Jun 1992 | JP |
9-96528 | Apr 1997 | JP |
9259390 | Oct 1997 | JP |
10-162287 | Jun 1998 | JP |
10-255019 | Sep 1998 | JP |
2000-184368 | Jun 2000 | JP |
2002-255629 | Aug 2002 | JP |