This application claims priority to German Patent Application No. 10 2012 023 867.3, filed Dec. 6, 2012, which is incorporated herein by reference in its entirety.
The technical field relates to a traffic light detection system for a motor vehicle comprising an optical sensor for recording image data of an environment lying ahead of the motor vehicle as well as an evaluation device for detecting a traffic light mapped in the image data. Furthermore the technical field relates to a motor vehicle with such a traffic light detection system and a method for traffic light detection.
Generic traffic light detection systems are known in the art and are utilized, in particular, for driver assistance systems. For example the DE 102 27 221 A1 discloses a monitoring system with at least one camera that records image data of the space outside. These image data are analyzed for a traffic light or traffic sign assistance system, using contour and/or color analysis. Further the DE 10 2006 023 544 A1 has revealed a method for operating a motor vehicle with at least one at least partially automated support function for the driver. Environment data are recorded with a camera and analyzed. As a result of the analysis road markings, traffic lights, pedestrian crossings or vehicle parked on the edge of the road are recorded.
The (traffic) light detection known from the art is based on detecting certain properties of traffic lights in the image data. In particular the image data are searched for edges and circles in order to detect traffic lights. The problem is that edges and circles are found not only at traffic lights but also on many other objects in an urban environment. Known traffic light detection systems therefore suffer from the problem that they frequently detect traffic lights where there are none. These cases are described as false-positive (FP).
It is at least one object to provide a traffic light detection system that reduces false-positive detections of traffic lights and which thus increases the reliability of modern systems. In addition, other objects, desirable features and characteristics will become apparent from the subsequent summary and detailed description, and the appended claims, taken in conjunction with the accompanying drawings and this background.
A traffic light detection system is provided for a motor vehicle comprising an optical sensor for recording image data of an environment lying ahead of the motor vehicle, and an evaluation device for detecting a traffic light mapped in the image data. The traffic light detection system is characterized in that the evaluation device is configured and arranged to detect a stop line in the image data, which is arranged on a carriageway ahead of the motor in a predefined area ahead of the traffic light associated with the carriageway, transversely to the longitudinal direction of the carriageway, in that it comprises a verification device which does not verify a traffic light detected in the image data and associated with the carriageway until such a stop line is detected in the image data, and comprises an output interface, via which the information is provided following successful verification of a traffic light that the traffic light has been verified as such.
At least one inventive aim is to distinctly reduce the number of false-positive detections of traffic lights by additionally searching in the image data for clues to be found typically in the vicinity of traffic lights (mainly a stop line which extends across the carriageway in front of the traffic light), and not verifying a traffic light detected in the image data as a traffic light, until the clues have been detected/are found to be present. Such a stop line on the carriageway to be easily identified in the image data is typically arranged in front of traffic lights on the carriageway.
It is not until such a stop line is detected on a carriageway associated with the detected traffic light that according to the invention the traffic light is verified as a traffic light. As to whether a carriageway with such a stop line is associated with a traffic light detected in the image data is revealed by an evaluation of the layout geometry of a detected traffic light and the carriageway with the stop line with reference to one's own motor vehicle.
An embodiment of the traffic light detection system is characterized in that the information provided via the output interface comprises the following signals: a first signal that is emitted in case a traffic light is detected in the image data, a second signal which is emitted in case of a traffic light is verified as such (by way of image data), and a third signal that is emitted in case a verification of a traffic light is not possible. By emitting these signals it is possible, for example for a driver assistance system connected with the traffic light detection system, to perform, in dependence of the three cases, a reliability evaluation of the result generated by the traffic light detection system, i.e., a traffic light detected in the image data. Thus emission of the second signal, where a traffic light was detected in the image data and has been verified, supplies the information “traffic light was detected” with maximum reliability.
If “only” the first signal is emitted, the reliability of traffic light detection is equal to the methods currently known and used for traffic light detection. If the third signal is emitted, this may mean for example, depending on the respective underlying definition, that for technical reasons no traffic light can be detected (e.g., due to a faulty optical sensor etc.), or for example that a traffic light was detected, albeit, in the image data, a preceding vehicle was also detected in the image data which may hide the stop line on the carriageway. These and other additional output possibilities easily accessible to the expert are used, in particular, to activate downstream assistance systems in the motor vehicle.
The area lying in longitudinal direction of the carriageway ahead of the traffic light preferably comprises an extension of approximately 2 m to approximately 50 m, in particular approximately 3 m, approximately 4 m, approximately 5 m, approximately 6 m, approximately 7 m, approximately 8 m, approximately 9 m, approximately 10 m, approximately 20 m, approximately 30 m or approximately 40 m in carriageway longitudinal direction and an extension transversely to the carriageway longitudinal direction, which at least comprises the width of the lane. These details refer, of course, to dimensions in reality. The evaluation device would therefore preferably search only in that area of the image data for stop lines, which reflect that area in reality.
An embodiment of the traffic light detection system is characterized in that the evaluation device is configured and adapted to determine, in the image data, a preceding vehicle or a stationary vehicle on the carriageway. In this variant therefore a vehicle driving ahead in the same driving lane is determined by analyzing existing image data.
Alternatively or additionally a sensor unit connected with the verification device for determining a preceding vehicle or a stationary vehicle ahead of the motor vehicle may be present, which to this end scans an environment lying ahead of the motor vehicle. In this variant a preceding vehicle is determined with an additional sensor unit scanning the environment lying ahead of the vehicle. Such a sensor unit preferably comprises an ultrasound, radar and/or LIDAR sensor and/or a camera.
An embodiment of the traffic light detection system is characterized in that the verification device is configured and adapted such that if a traffic light associated with the carriageway and a preceding vehicle or a stationary vehicle ahead of the traffic light and ahead of the motor vehicle have been detected, the third signal is emitted. In this case, as already described above, an information is ultimately provided through emitting the third signal, which permits evaluation of the analysis result, which could influence a downstream driver assistance system.
A method-related embodiment is met by a method for traffic light detection, where in a first step using an optical sensor image data of an environment lying ahead of the motor vehicle is recorded and where in a second step a mapped traffic light is identified in the image data using an evaluation device.
According to an embodiment the second step comprises the following steps. In a first step a stop line is identified in the image data, which is arranged on a carriageway lying ahead of the motor vehicle, within a predefined area ahead of a traffic light associated with the carriageway, transversely to the carriageway longitudinal direction. In a further step a traffic light associated with the carriageway and detected in the image data is not verified until such a stop line has been detected in the image data. In a further step, following a successful verification of a traffic light, the information is provided that the traffic light as such has been verified.
An embodiment of the method is characterized in that the following signals are emitted via an output interface connected with the evaluation device: a first signal in the case a traffic light has been detected in the image data, a second signal in the case such a traffic light has been verified by way of the image data, and/or a third signal in the case a verification of a traffic light is not possible.
An embodiment of the method is characterized in that the evaluation device is configured and adapted to identify a preceding vehicle or a stationary vehicle on the carriageway in the image data. Alternatively or additionally a sensor unit connected with the verification device for determining a preceding vehicle or a stationary vehicle ahead of the motor vehicle may be present which to this end scans an environment lying ahead of the motor vehicle. Another embodiment of the method is characterized in that, provided a traffic light associated with the carriageway and a preceding vehicle or a stationary vehicle ahead of the traffic light have been detected in the image data, the third signal is emitted.
The embodiments provide analogously transcribing the above statements in relation to the traffic light detection system and its further developments.
Finally, a motor vehicle is equipped with an above-described traffic light detection system according to an embodiment.
The present invention will hereinafter be described in conjunction with the following drawing figures, wherein like numerals denote like elements, and:
The following detailed description is merely exemplary in nature and is not intended to limit application and uses. Furthermore, there is no intention to be bound by any theory presented in the preceding background or summary or the following detailed description.
While at least one exemplary embodiment has been presented in the foregoing summary and detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration in any way. Rather, the foregoing summary ad detailed description will provide those skilled in the art with a convenient road map for implementing an exemplary embodiment, it being understood that various changes may be made in the function and arrangement of elements described in an exemplary embodiment without departing from the scope as set forth in the appended claims and their legal equivalents.
Number | Date | Country | Kind |
---|---|---|---|
10 2012 023 867.3 | Dec 2012 | DE | national |