The invention relates to a driver assistance system and a method using position points for representing features in an environment of a vehicle.
Nearly all currently available driver assistance systems based on data provided by environment monitoring sensors use an object abstract environment model. Typically an object list of surrounding objects is provided. Such an approach does not cover areas where no objects are present and which define a potential maneuvering space. In the field of research, approaches are known which use sensors providing space occupancy information about a defined area surrounding the vehicle and entering said information on a space occupancy map. Such a representation permits indirect estimations of the available maneuvering space. A disadvantage of this method, however, is that the space occupancy map (occupancy grid) contains large amounts of data which are currently too large to be usable in a commercial application, since the bandwidths provided by typical CAN connections for the communication between control devices are not sufficient for real-time transmission.
It is an object of one or more embodiments of the present invention to provide a method and a driver assistance system for representing a maneuvering space in a vehicle environment using a reduced amount of data.
The above object can be accomplished with a method and a driver assistance system according to at least one embodiment of the invention as disclosed herein.
A key component of at least one embodiment of the present invention is the representation of a succession of boundaries of a driving path or traffic lane currently being driven, by position points that each have a predefined set of attributes. The succession of boundaries results e.g. from the positions of traffic lane markings, roadwork or construction site fences, roadside structures, guardrails, parked vehicles at the roadside, etc.
Preferably, the distance, in particular a longitudinal spacing distance, and the number of position points can be predefined adaptively depending on at least one of the following parameters:
i) speed of the ego-vehicle (i.e. the subject vehicle itself); for example, a large longitudinal distance between the position points will be selected for representing traffic lane markings in particular in motorway scenarios in which the subject vehicle is driving at a relatively high speed; a correspondingly smaller distance between the position points is preferentially selected for modeling the maneuvering space boundaries during parking maneuvers when the subject vehicle is driving at a relatively low speed. Namely, in such an embodiment, a large distance is chosen when driving at high speed and, correspondingly, a small distance when driving at low speed;
ii) complexity of the scenario; e.g. a small distance between the position points is required in a driving situation in the city with many surrounding objects and traffic signs;
iii) curve of the traffic lane; a small distance between the position points is required on winding road sections;
iv) width of the traffic lane; in particular, if the traffic lane becomes wider, a larger distance between the position points can be selected.
In a preferred embodiment of the present invention, an attribute of the position points indicates a lateral width. The lateral width is a measurement of an area that is usable as a maneuvering space by the subject vehicle and located on the other side of the position point, i.e. outside the driving path or traffic lane delimited by the position points. The lateral width is e.g. large if another driving path or traffic lane where the subject vehicle can be freely driven is present on the other side of traversable traffic lane markings. The lateral width will be set e.g. to a small value or to zero if a non-traversable roadside structure, e.g. a slope, directly starts on the other side of traversable traffic lane markings. Preferably, the lateral width directly indicates the width of a maneuvering space opposite a position point.
The lateral width of position points representing non-traversable traffic lane boundaries such as guardrails or roadwork or construction site fences preferably equals zero.
In a further embodiment of the present invention, the lateral width of position points representing traversable traffic lane markings is larger than zero.
In another preferred embodiment of the invention, the lateral width of position points representing traversable traffic lane markings equals zero if a lane change of the subject vehicle or ego-vehicle to the adjacent lane, wherein the adjacent lane is also delimited by the position points, would at this position lead to a risk of collisions with oncoming or overtaking vehicles.
In an advantageous embodiment of the invention there is a further attribute of the position points. The further attribute indicates a measure of a narrowing of the area inside the driving path or traffic lane delimited by the position points that is usable as maneuvering space. In other words, this attribute indicates whether the whole area delimited by the position points can be used as maneuvering space or whether there are obstacles which must be bypassed.
In particular, the further attribute is assigned a predefined standard value if no obstacle is present in the traffic lane. In a further advantageous embodiment of the invention, the further attribute assumes a value deviating from the predefined standard value in the case of position points delimiting a road section where an obstacle is present. In an advantageous embodiment, the further attribute indicates which area and/or how much space is actually available as maneuvering space.
A further embodiment is directed to a method for a driver assistance system which determines for a vehicle a future trajectory based on data provided by a sensor system for detecting the environment. For this purpose, surrounding objects and their positions are detected using the sensor data, and the vehicle surroundings of the subject vehicle or ego-vehicle are represented via position points that bound an available driving path according to a method as described above. This representation of the surroundings is transmitted via a vehicle bus to a control device. The control device is designed and configured in such a way that a future trajectory of the ego-vehicle is determined dependent on the position points.
An additional embodiment is directed to a driver assistance system with a sensor system for detecting the environment, and a data evaluation unit configured to execute, and operating by a method as described above. For this purpose, the data evaluation unit is connected via a vehicle bus system to a control device which controls a driver assistance function.
In the following, the invention will be described in greater detail in connection with embodiments thereof, and with reference to the accompanying drawings, wherein:
The starting point for an understanding of an embodiment of the invention is the driving path or traffic lane 1 currently being driven on by the subject vehicle or ego-vehicle 2 as illustrated in
The width of the traffic lane 1 that is usable as maneuvering space can also be restricted by moving objects, for example other vehicles, on the other side of the boundary line. In a preferred embodiment of the present invention, this restriction is described by the attribute of lateral width. Even if the line is physically traversable at the moment of observation, a traffic lane boundary is marked as “non-traversable”, in particular using position points 8, if a crossing of the boundary is unsafe due to an oncoming traffic situation or due to another vehicle 9 approaching and overtaking from behind, as illustrated in
Stationary objects occupying the traffic lane currently being driven can be modeled by using a further attribute representing the remaining maneuvering space between the two boundary lines. This attribute assumes a predefined standard value if no obstacle is present on the traffic lane. In a preferred embodiment of the invention, the further attribute otherwise assumes the remaining free space as a physical distance value. This scenario is illustrated exemplarily in
Advantages of the invention presented here are the complete description of the open space ahead within the current traffic lane and the representation of the lateral traversability as a basis for determining the trajectory for leaving the traffic lane currently being driven, if necessary. The particular advantage of representing the situation using a list of boundary points is the fact that arbitrary traffic lane courses can be described, and the effort involved is also smaller than required by an analytical representation. It is possible to represent arbitrary courses of the current traffic lane; the abstract point information greatly reduces the required amounts of data compared to a dense open space representation, permitting the use of production-ready means of communication such as CAN. In particular, the representation of the boundaries of the current path is sensor-independent, meaning that whenever new features become detectable by new sensors, it is no problem to account for said features in the representation; one example of this would be curbs.
Number | Date | Country | Kind |
---|---|---|---|
10 2012 103 669 | Apr 2012 | DE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/DE2013/100121 | 4/4/2013 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2013/159768 | 10/31/2013 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5991427 | Kakinami et al. | Nov 1999 | A |
6014601 | Gustafson | Jan 2000 | A |
6269308 | Kodaka et al. | Jul 2001 | B1 |
6433679 | Schmid | Aug 2002 | B1 |
6466516 | O'Brien, Jr. et al. | Oct 2002 | B1 |
6498972 | Rao et al. | Dec 2002 | B1 |
7138909 | Winner | Nov 2006 | B2 |
7340380 | Klotz et al. | Mar 2008 | B2 |
7382236 | Maass et al. | Jun 2008 | B2 |
7486803 | Camus | Feb 2009 | B2 |
7495550 | Huang et al. | Feb 2009 | B2 |
7680749 | Golding et al. | Mar 2010 | B1 |
7792641 | Liu et al. | Sep 2010 | B2 |
8072370 | Woodington et al. | Dec 2011 | B2 |
8410920 | Ito | Apr 2013 | B2 |
8812193 | Lueke et al. | Aug 2014 | B2 |
8842884 | Klein et al. | Sep 2014 | B2 |
8880272 | Ferguson | Nov 2014 | B1 |
20010016798 | Kodaka et al. | Aug 2001 | A1 |
20020031242 | Yasui et al. | Mar 2002 | A1 |
20030072471 | Otsuka et al. | Apr 2003 | A1 |
20030174054 | Shimomura | Sep 2003 | A1 |
20040143381 | Regensburger et al. | Jul 2004 | A1 |
20050125121 | Isaji et al. | Jun 2005 | A1 |
20050259158 | Jacob et al. | Nov 2005 | A1 |
20070158593 | Partin et al. | Jul 2007 | A1 |
20070219720 | Trepagnier | Sep 2007 | A1 |
20070233386 | Saito | Oct 2007 | A1 |
20070276600 | King et al. | Nov 2007 | A1 |
20080027607 | Ertl et al. | Jan 2008 | A1 |
20080042812 | Dunsmoir et al. | Feb 2008 | A1 |
20080195292 | Naab et al. | Aug 2008 | A1 |
20080204212 | Jordan et al. | Aug 2008 | A1 |
20090037055 | Danner et al. | Feb 2009 | A1 |
20090088966 | Yokoyama et al. | Apr 2009 | A1 |
20090195414 | Riegel et al. | Aug 2009 | A1 |
20100013917 | Hanna et al. | Jan 2010 | A1 |
20100097200 | Hilsebecher et al. | Apr 2010 | A1 |
20100253598 | Szczerba | Oct 2010 | A1 |
20100256852 | Mudalige | Oct 2010 | A1 |
20100289632 | Seder et al. | Nov 2010 | A1 |
20100329513 | Klefenz | Dec 2010 | A1 |
20110121993 | Davis et al. | May 2011 | A1 |
20110190972 | Timmons et al. | Aug 2011 | A1 |
20110199200 | Lueke et al. | Aug 2011 | A1 |
20110313665 | Lueke et al. | Dec 2011 | A1 |
20120139775 | Popovic | Jun 2012 | A1 |
20120290184 | Suzuki | Nov 2012 | A1 |
20120303258 | Pampus et al. | Nov 2012 | A1 |
20120323479 | Nagata | Dec 2012 | A1 |
20130173232 | Meis | Jul 2013 | A1 |
20130184976 | Akiyama et al. | Jul 2013 | A1 |
20130197804 | Lueke et al. | Aug 2013 | A1 |
20130218448 | Suzuki | Aug 2013 | A1 |
20140032047 | Voelz et al. | Jan 2014 | A1 |
20140160250 | Pomerantz et al. | Jun 2014 | A1 |
20140249722 | Hegemann et al. | Sep 2014 | A1 |
20150022392 | Hegemann | Jan 2015 | A1 |
20150105937 | Waldbauer et al. | Apr 2015 | A1 |
20150146008 | Conner et al. | May 2015 | A1 |
20150149076 | Strauss et al. | May 2015 | A1 |
Number | Date | Country |
---|---|---|
197 38 764 | Mar 1999 | DE |
103 55 807 | Jul 2004 | DE |
102004018681 | Nov 2005 | DE |
102005002719 | Aug 2006 | DE |
102006020631 | Nov 2007 | DE |
102006040333 | Mar 2008 | DE |
102006056835 | Jun 2008 | DE |
102007013023 | Sep 2008 | DE |
102007016868 | Oct 2008 | DE |
102009007412 | Aug 2010 | DE |
102009045286 | Apr 2011 | DE |
102010006828 | Aug 2011 | DE |
102010042440 | Apr 2012 | DE |
0 640 903 | Mar 1995 | EP |
1 346 877 | Sep 2003 | EP |
1 552 975 | Jul 2005 | EP |
2012211 | Jan 2009 | EP |
2 541 524 | Jan 2013 | EP |
2005-182753 | Jul 2005 | JP |
2007-331652 | Dec 2007 | JP |
2008-143263 | Jun 2008 | JP |
2009-023399 | Feb 2009 | JP |
2010-524102 | Jul 2010 | JP |
2012-003419 | Jan 2012 | JP |
2012-079118 | Apr 2012 | JP |
2013-533990 | Aug 2013 | JP |
WO 04094186 | Nov 2004 | WO |
WO 2008122498 | Oct 2008 | WO |
WO 2011101988 | Aug 2011 | WO |
WO 2011141018 | Nov 2011 | WO |
Entry |
---|
U.S. Dept. of Transportation Federal Highway Adminstration, “Manual on Uniform Traffic Control Devices (MUTCD): Chapter 3A. General”, Aug. 3, 2004, <http://mutcd.fhwa.dot.gov/HTM/2003r1/part3/part3a.htm>. |
U.S. Dept. of Transportation Federal Highway Adminstration, “Manual on Uniform Traffic Control Devices (MUTCD): Chapter 3B. General”, Feb. 11, 2010, <http://mutcd.fhwa.dot.gov/htm/2009/part3/part3b.htm>. |
Math Open Reference. “Point”. Oct. 30, 2006. <http://www.mathopenref.com/point.html>. |
Encyclopedia of Mathematics. “Line (Curve)”. Feb. 7, 2011. <https://www.encyclopediaofmath.org/index.php?title=Line—(curve)&oldid=15722>. |
Xia Huang et al., “Lane Following System for a Mobile Robot Using Information from Vision and Odometry”, IEEE CCECE 2011, 24th Canadian Conference, May 2011, Niagara Falls, Canada, pp. 1009 to 1013. |
C. Blaschke, J. Schmitt, B. Färber; “Überholmanöver-Prädiktion über CAN-BUS-Daten”; (“Overtaking Maneuver Prediction via CAN-Bus Data”); Automobiltechnische Zeitschrift (ATZ), vol. 110, No. 11/2008, pp. 1022-1029. |
M. Kretschmer, L. König, J. Neubeck, J. Wiedemann; “Erkennung und Prädiktion des Fahrverhaltens während eines Überholvorgangs”; (“Detection and Prediction of the Driver's Behavior during an Overtaking Maneuver”); 2. Tagung Aktive Sicherheit durch Fahrerassistenz, Garching, Germany, 2006, with English abstract, pp. 1 to 17, FKFS-IVK. |
C. Wojek, B. Schiele; “A Dynamic Conditional Random Field Model for Joint Labeling of Object and Scene Classes”; European Conference on Computer Vision (ECCV), Marseille, France, 2008, ECCV 2008, Part IV, LNCS 5305, pp. 733-747. |
International Search Report of the International Searching Authority for International Application PCT/DE2013/100121, dated Oct. 21, 2013, 2 pages, European Patent Office, HV Rijswijk, Netherlands. |
English Translation of PCT International Preliminary Report on Patentability of the International Searching Authority for International Application PCT/DE2013/100121, dated Dec. 4, 2014, 5 pages, International Bureau of WIPO, Geneva, Switzerland. |
German Search Report for German Application No. 10 2012 103 669.1, dated Dec. 21, 2012, 5 pages, Muenchen, Germany, with English translation, 5 pages. |
Radu Danescu et al., “Modeling and Tracking the Driving Environment With a Particle-Based Occupancy Grid”, IEEE Transactions on Intelligent Transportation Systems, Dec. 1, 2011, IEEE, Piscataway, NJ, USA, vol. 12, No. 4, XP011379328, pp. 1331 to 1342. |
Christof Schroeter et al., “A Sensor-Independent Approach to RBPF SLAM—Map Match SLAM Applied to Visual Mapping”, Intelligent Robots and Systems, Sep. 22, 2008, IEEE, Piscataway, NJ, USA, XP032335734, pp. 2078 to 2083. |
Radu Danescu et al., “Particle Grid Tracking System Stereovision Based Obstacle Perception in Driving Environments”, IEEE Intelligent Transportation Systems Magazine, Apr. 1, 2012, IEEE, USA, vol. 4. No. 1, XP011393203, pp. 6 to 20. |
Cyrill Stachniss et al., “Exploration with Active Loop-Closing for, FastSLAM”, Intelligent Robots and Systems, Sep. 28, 2004, IEEE, Piscataway, NJ, USA, vol. 2, XP010765873, pp. 1505 to 1510. |
European Office Action in European Patent Application No. 13 719 008.8, dated Oct. 2, 2017, 6 pages, with partial English translation, 2 pages. |
Number | Date | Country | |
---|---|---|---|
20150105937 A1 | Apr 2015 | US |