Patent Application
20100131155
1. Field of the Invention
The present invention relates to a method and an apparatus for sensing an obstacle in a region surrounding a motor vehicle, and to a motor vehicle.
2. Description of Related Art
An analysis in terms of obstacles, in particular for the surrounding region in front of the vehicle, is required for so-called driver assistance systems for motor vehicles. With the aid of this analysis a general determination is made of the presence or range of obstacles, for example of a preceding further motor vehicle, and control is applied correspondingly to the driver assistance system.
Driver assistance systems can be categorized generally as so-called convenience systems and safety systems. A convenience system assists the person steering the motor vehicle while driving, and is intended thereby to make driving more convenient for that person. A safety system, on the other hand, is intended to avoid a potential accident between the motor vehicle and an obstacle, or at least decrease the effects of the accident.
One convenience system, for example, is an automatic distance and speed control system, referred to also as an adaptive cruise control (ACC). The automatic speed control system automatically adjusts the motor vehicle's speed on the basis of obstacles detected in front of the motor vehicle, such as preceding further vehicles.
Safety systems are also known as “predictive safety systems” (PSS). One example of a safety system is a system that automatically initiates emergency braking of the motor vehicle upon detection of a potential collision by the motor vehicle with an obstacle.
Published German patent document DE 10 2004 007 553 discloses a sensing apparatus for a motor vehicle for sensing an obstacle in a region surrounding the motor vehicle. On the basis of signals generated a surroundings sensor mounted on the motor vehicle, a computer of the motor vehicle generates a probability distribution for the presence of the obstacle in the surrounding region. The surrounding region is in this context divided into multiple fields, and for each of the fields the computer calculates a probability value as an indicator of the presence of the obstacle in the respective field.
According to the invention, a method for sensing an obstacle in a region surrounding a motor vehicle encompasses the following method steps:
As already stated in the introduction, motor vehicles can be equipped with driver assistance systems that assist the person steering the motor vehicle while driving. Driver assistance systems can be divided into convenience systems and safety systems.
Convenience systems are provided in order to assist the person steering the motor vehicle while driving, thereby making the motor vehicle easier to control. Examples of convenience systems are an automatic distance and speed control system, in particular an adaptive distance and speed control system for upgraded highways and expressways, or a stop-and-go-capable distance and speed control system for city traffic, or a lane-keeping system.
Safety systems, on the other hand, are provided in order to intervene automatically in an emergency situation. One example of a safety system is an automatic emergency braking system that automatically initiates emergency braking of the motor vehicle in order to prevent a potential collision of the motor vehicle with an obstacle, or at least to decrease the negative effect of the collision for occupants of the motor vehicle.
The two types of driver assistance system have in common the fact that they require information regarding the presence of an obstacle in the region surrounding the motor vehicle. An obstacle is, in particular, a motor vehicle preceding the motor vehicle, so that the region surrounding the motor vehicle is, in particular, a surrounding region directly in front of the motor vehicle.
In order to determine whether an obstacle is present in the region surrounding the motor vehicle, in particular whether an obstacle such as a further motor vehicle driving in front of the motor vehicle is present in front of the motor vehicle, according to the present invention an image of the surrounding region is generated using the at least one image-producing sensor. Suitable image-producing sensors are, for example, radar sensors, optical cameras, or ultrasonic sensors that are disposed, for example, in the front region of the motor vehicle.
In addition, according to the present invention the surrounding region is subdivided into a plurality of fields or cells, and the image of the surrounding region, or the image data set associated with the image, is analyzed in terms of the presence of an obstacle. It is generally not possible to ascertain with 100% probability whether an obstacle is present in the relevant field, for example because of measurement inaccuracies of the image-producing sensor, noise in an electronic processing system downstream from the sensor, contamination, or poor visibility. On the basis of the analysis a probability is therefore determined for each field as an indicator of the presence of the obstacle, as known in principle, for example, from published German patent document DE 10 2004 007 553 mentioned in the introduction.
Safety systems are intended to be activated only in emergency situations. It is therefore important for the safety system that it reliably initiate only when an accident is imminent, i.e. for example only when a collision of the motor vehicle with the obstacle is unavoidable. It is therefore necessary that improper initiation of the safety system be precluded to the greatest extent possible. The safety system must therefore not initiate when no obstacle is present. For the convenience system, on the other hand, the requirements for reliable recognition of an obstacle are generally less strict.
According to the present invention, the surrounding region is therefore classified differently by means of the two threshold values, by the fact that the individual probabilities of the fields are compared with the first and with the second threshold value. Only if the probability of the relevant field is greater than the corresponding threshold value is the field classified as containing an obstacle. Because, according to the present invention, the second threshold value is greater than the first threshold value, the reliability of the decision that the relevant field contains an obstacle is then greater for the second classification (which is based on the larger, i.e. the second, threshold value) than for the first classification. Because, according to the present invention, the second classification is delivered to the safety system of the motor vehicle, prerequisites exist for avoiding to the greatest extent possible improper initiation of the safety system, i.e. prerequisites exist for avoiding the inference that an obstacle is present even though none is in fact present.
The first classification of the surrounding region is based on the smaller, i.e. the first, threshold value. The first classification is intended for the convenience system of the motor vehicle, for which the requirement of avoiding inadvertent recognition of an obstacle is less stringent than for the safety system.
It is therefore possible on the basis of the method according to the present invention, proceeding from an analysis of the surrounding region or of the image of the surrounding region, to obtain information both for the safety system and for the convenience system. It is accordingly possible to use the same image, or the same image data set associated with the image, for both the convenience system and the safety system, thereby reducing, for example, the outlay for analysis of the surrounding region even though different requirements exist regarding obstacle detection reliability.
According to an embodiment of the method according to the present invention, the first threshold value is the same first threshold value for all fields, or different first threshold values are associated with different fields. The second threshold value can be the same second threshold value for all fields, or different second threshold values can be associated with different fields. The distance of the obstacle from the motor vehicle can, for example, be important for the reliability of the decision regarding the presence of an obstacle in a field. It is then a good choice to provide different first or second threshold values for different fields. At least one of the threshold values can also be variable as a function of the speed of the motor vehicle, the visibility conditions, etc.
According to a variant of the method according to the present invention, for each field a further probability is determined as an indicator of the non-presence of an obstacle in the relevant field, and the first and/or second classification is determined additionally on the basis of the further probabilities. In addition to the probabilities as an indicator of the presence of the obstacle in the relevant field, the probabilities of the contrary hypothesis can thus additionally be calculated, i.e. the probabilities that no obstacle is present in the relevant field and that therefore, for example, the road in front of the first vehicle is travelable. It would be possible in this manner to distinguish among object, open space, and ignorance.
According to a further aspect of the invention, an apparatus for sensing an obstacle in a region surrounding a motor vehicle is embodied in such a way that it
The method according to the present invention for sensing an obstacle in a region surrounding a motor vehicle can be carried out by way of the apparatus according to the present invention. Because the apparatus according to the present invention determines the presence of the obstacle, based on the image of the region surrounding the motor vehicle or based on the image data associated with the image, for both the safety system and the convenience system, the apparatus according to the present invention, which for example is a computer, can be embodied in relatively simple and therefore economical fashion without, in particular, reducing the relatively stringent requirements for the safety system regarding obstacle recognition reliability.
The first threshold value can be the same first threshold value for all fields, or different first threshold values can be associated with different fields. The second threshold value can be the same second threshold value for all fields, or different second threshold values can be associated with different fields.
According to a further aspect of the invention, a motor vehicle has:
The convenience system is, for example, a distance and speed control system, in particular an adaptive distance and speed control system for upgraded highways and expressways, or a stop-and-go-capable distance and speed control system for city traffic, or a lane-keeping system. The safety system is, for example, an automatic emergency braking system that automatically initiates emergency braking of the motor vehicle according to the present invention or, for example, a warning system such as a lane departure warning system.
In addition to the probabilities as an indicator of the presence of the obstacle in the relevant field, the probabilities of the contrary hypothesis can additionally be calculated, i.e. the probabilities that no obstacle is present in the relevant field and that therefore, for example, the road in front of the first vehicle is travelable. It would be possible in this manner to distinguish among object, open space, and ignorance.
Mounted on the front side of motor vehicle 1 is an image-producing sensor 3 that creates images 21, depicted in
Image-producing sensor 3 is, for example, an optical camera, a radar sensor, or an ultrasonic sensor, and is connected via an electrical lead 6 to a computer 7 mounted in motor vehicle 1. A computer program runs on computer 7 and generates, from the signals generated by image-producing sensor 3, image 21 of surrounding region 4 or an image data set associated with image 21. Alternatively, image 21 or the image data set of image 21 can already be generated by sensor 3 (step S1 of the flow chart of
In the case of the present exemplifying embodiment, image-producing sensor 3 and computer 7 are embodied in such a way that images 21 of surrounding region 4 are produced continuously, e.g. at a time interval of 40 ms.
The computer program running on computer 7 is embodied in such a way that it analyzes image 21, or the image data set associated with image 21, in terms of the presence of an obstacle (step S2 of the flow chart). An obstacle is, in particular, motor vehicle 2 driving in front of motor vehicle 1. In the case of the present exemplifying embodiment, this is brought about by the fact that image recognition algorithms generally known to one skilled in the art, which automatically recognize obstacles (such as, for example, motor vehicle 2) imaged in image 21, run on computer 7.
In the case of the present exemplifying embodiment, the computer program running on computer 7 is furthermore embodied in such a way that on the basis of the analysis of image 21 it determines, for each field 5a through 5h of surrounding region 4, a probability for the presence of an obstacle (step S3 of the flow chart). The determination of such probabilities is known in principle to one skilled in the art, for example, from published German patent document DE 10 2004 007 553 mentioned in the introduction, and will therefore not be explained further.
As already explained, surrounding region 4 encompasses eight rows each having twenty fields, i.e., rows 5a through 5h.
As is evident from
The computer program running on computer 7 then, for each of fields 5a to 5h, compares the individual probability values with a first threshold value 23 and with a second threshold value 24. In the case of the present exemplifying embodiment, first threshold value 23 has a value of 0.65 and second threshold value has a value of 0.9. The comparison with first threshold value 23 is illustrated in
Based on the comparison with first threshold value 23, the computer program running on computer 7 creates a first classification 26 depicted in
Based on the comparison with second threshold value 24, the computer program running on computer 7 creates a second classification 27 depicted in
In the present exemplifying embodiment, the two classifications 26, 27 are created for each continuously generated image 21.
Motor vehicle 1 further encompasses a convenience system 8 and a safety system 9. In the case of the present exemplifying embodiment, convenience system 8 is an adaptive distance and speed control system and is connected via an electrical lead 10 to computer 7. Safety system 9 is connected via an electrical lead 11 to computer 7.
Computer 7 is embodied in such a way that it transmits first classification 26, or continuously transmits first classifications 26, via electrical lead 10 to convenience system 8 (step S6 of the flow chart). Based on first classification 26 or on the continuously delivered first classifications 26, the adaptive distance and speed control system automatically controls the speed of motor vehicle 1 in generally known fashion.
In the case of the present exemplifying embodiment, safety system 9 is an automatic emergency braking system that, as applicable, initiates emergency braking of motor vehicle 1 in generally known fashion. Second classification 27 of surrounding region 4 is transmitted, or second classifications 26 of surrounding region 4 are continuously transmitted, from computer 7 to safety system 9 via electrical lead 11 (step S7 of the flow chart).
In the exemplifying embodiment described, the same first and the same second threshold value 23, 24 are associated with each of fields 5a to 5h. It is also possible, however, for different first and/or second threshold values to be associated with different fields 5a to 5h. The first and/or second threshold values can be speed-dependent.
The adaptive distance and speed control system that is described is also merely one example of a convenience system 8. A convenience system can also be, for example, a lane-keeping system. The emergency braking system is intended as merely an example of a safety system 9. In addition, more than one image-producing sensor 3 can also be used to generate image 21 of surrounding region 4.
In addition to the probabilities as an indicator of the presence of the obstacle in the relevant field, it is additionally possible also to calculate the probabilities of the contrary hypothesis, i.e. the probabilities that no obstacle is present in the relevant field and that therefore, for example, the road in front of the first vehicle is travelable. It would be possible in this manner to distinguish among object, open space, and ignorance.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2006 058 308.6 | Dec 2006 | DE | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/EP2007/060907 | 10/12/2007 | WO | 00 | 2/8/2010 |
