This application is the National Stage of International Application No. PCT/CN2019/108403, filed on Sep. 27, 2019, which claims priority to Chinese Patent Application No. 201811154050.X, filed on Sep. 30, 2018, which are incorporated herein by reference in their entireties.
The present invention relates to the field of intelligent transportation, in particular to a lane line fitting method and system.
At present, vehicles with an Autonomous Driving System (ADS) are gradually brought to the market, which greatly promotes the development of intelligent transportation. The ADS senses a surrounding environment in real time by using an environment sensing system installed on a vehicle, and determines a drivable area of the vehicle through data returned by a sensor. Environment sensing contents can be divided into two main parts, namely, road information and target information, respectively. Lane line information in the road information can provide driving path information for the vehicle, which is convenient for the realization of functions such as lane changing and lane maintaining for lateral control. In addition, the lane line information can also provide a reference for screening a target in a road in the environment sensing system.
Therefore, it can be known that lane line detection is crucial to ADS, and in order to ensure driving safety of an autonomous driving vehicle, the prior art requires that an environment sensing system acquires the lane line information around the vehicle as much as possible while sensing the surrounding environment. However, when the road is changed such as bifurcated or joins, the lane lines directly output by the sensor may be multiple and relatively complex, and cannot be directly used for decision-making and control of a vehicle behavior.
In view of this, the present invention aims to provide a lane line fitting method to solve the technical problem that extracted lane lines are multiple and relatively complex in the prior art.
To achieve the above object, a technical solution of the present invention is implemented as follows:
A lane line fitting method comprises:
Furthermore, the method may further comprise: acquiring a decision-making lane changing signal and/or navigation information for the current position of the vehicle, wherein the decision-making lane changing signal indicates the lane changing direction side of the vehicle, and the navigation information is used for indicating the road width unchanged side.
Furthermore, the method may further comprise: setting the priority of determining the lane line offset reference based on the lane changing direction side, the road width unchanged side, the lane continuous side and the reference side of the driving coordinate system.
Furthermore, the method may further comprise: determining an actual road working condition of the vehicle according to the map information, and selecting, according to the actual road working condition, one or more of the lane changing direction side, the road width unchanged side, the lane continuous side and the reference side of the driving coordinate system to determine the lane line offset reference. Wherein, the actual road working condition and the selected lane line offset reference comprise any one of the following: in the case that the actual road working condition is a separated roadbed, a conventional ramp, a conventional main road, ramp bifurcation or departure from a high-speed lane, the lane changing direction side and/or the reference side of the driving, coordinate system are/is selected to determine the lane line offset reference; in the case that the actual road working condition is main road narrowing, the road width unchanged side is selected to determine the lane line offset reference; and in the case that the actual road working condition is ramp merging or ramp-main road joining, the lane continuous side and/or the reference side of the driving coordinate system are/is selected to determine the lane line offset reference.
Furthermore, the method may further comprise: completely or partially deleting, by combining the map information, a lane line that is outside the road boundary of the current road or affected by a road obstacle from the plurality of lane lines.
Compared with the prior an, the lane line fitting method according to the present invention has the following advantages: the lane line fitting method according to the embodiments of the present invention can accurately and quickly determine a lane line offset reference used for lane line fitting, and outputs an effective lane line based on the lane line offset reference, facilitates lane maintaining and other controls, solves the problem that extracted lane lines are numerous and relatively complex in the prior art, can be adapted to different road scenes, and has high processing efficiency of lane line algorithm.
Another object of the present invention is to provide a lane line fitting system to solve the technical problem that extracted lane lines are multiple and relatively complex in the prior art.
To achieve the above object, a technical solution of the present invention is implemented as follows:
A lane line fitting system comprises:
Furthermore, the information acquisition unit may be further used for acquiring a decision-making lane changing signal and/or navigation information for the current position of the vehicle, wherein the decision-making lane changing signal indicates the lane changing direction side of the vehicle, and the navigation information is used for indicating the road width unchanged side.
Furthermore, the system may further comprise: a priority setting unit, used for setting the priority of determining the lane line offset reference based on the lane changing direction side, the road width unchanged side, the lane continuous side and the reference side of the driving coordinate system. Wherein the reference determination unit is further electrically connected to the priority setting unit, and used for determining the lane line offset reference based on the priority, set by the priority setting unit, of determining the lane line offset reference based on the lane changing direction side, the road width unchanged side, the lane continuous side and the reference side of the driving coordinate system.
Furthermore, the system may further comprise: a road working condition determination unit, used for determining an actual road working condition of the vehicle according to the map information, wherein the reference determination unit is also electrically connected to the road working condition determination unit, and used for selecting, according to the actual road working condition, one or more of the lane changing direction side, the road width unchanged side, the lane continuous side and the reference side of the driving coordinate system to determine the lane line offset reference. Wherein, the actual road working condition and the selected lane line offset reference comprise any one of the following: in the case that the actual road working condition is a separated roadbed, a conventional ramp, a conventional main road, ramp bifurcation or departure from a high-speed lane, the lane changing direction side and or the reference side of the driving coordinate system are/is selected to determine the lane line offset reference; in the case that the actual road working condition is main road narrowing, the road width unchanged side is selected to determine the lane line offset reference; and in the case that the actual road working condition is ramp merging or ramp-main road joining, the lane continuous side and/or the reference side of the driving coordinate system are/is selected to determine the lane line offset reference.
Furthermore, the system may further comprise: a lane line screening, unit, electrically connected to the lane line fitting unit, and used for completely or partially deleting, by combining the map information, a lane line that is outside the road boundary of the current road or affected by a road obstacle from the plurality of lane lines.
The lane line fitting system and the aforementioned lane line fitting method have the same advantages over the prior art, and details are not described here.
Another object of the present invention is to provide a machine-readable storage medium, wherein an instruction is stored on the machine-readable storage medium, and the instruction is used for causing a controller to execute the above-mentioned lane line fitting method.
Other features and advantages of the present invention will be described in detail in the specific embodiments below.
The drawings, which form a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and the description thereof are used to explain the present invention, and do not constitute an improper limitation on the present invention. In the drawings:
It should be noted that, in the case of no conflict, the embodiments of the present invention and features in the embodiments can be combined with each other.
In the embodiments of the present invention, “electrical connection” is used to describe the signal connection between two components, such as a control signal and a feedback signal, and an electrical power connection between two components. In addition, the “connection” involved in the embodiments of the present invention can be a wired connection or a wireless connection, and the “electrical connection” involved can be a direct electrical connection between two components or an indirect electrical connection through another component.
The present invention will be described in detail below with reference to the drawings and embodiments.
Step S110, acquiring map information for a current position of a vehicle.
The map information comprises the number of lanes, a road width and line point information of lane lines on two sides of the vehicle. In a more preferred embodiment, the map information can further comprise a road type, road feature points, a lane width, and the like. The road feature points are points that can represent a specific position of a road in a road scene, such as the start point and end point of a certain road section.
The map information is preferably high-precision map information. Those skilled in the art know that the high-precision map information can show the above-mentioned road type, number of lanes, road width, road feature points, and line points of the lane lines on two sides of the vehicle, lane width and other information. The high-precision imp divides the road into a set of map points section by section, and the map output will divide the road from the position where the road changes, and will also give the relevant map information of the current road and the next road section.
Step S120, determining, from among the lane lines on two sides of the vehicle, a lane line on one side to be a lane line offset reference used for lane line fitting.
Specifically, in Step S120, it is determined, from among the lane lines on two sides of the vehicle, that a lane line on one side, consistent with the direction indicated by at least one of the following, is a lane line offset reference used for lane line fitting:
1) A lane changing direction side, indicating the side to which the vehicle is expected to perform lane changing in the current road.
The lane line fitting method according to the present invention can further comprise: acquiring a decision-making lane changing signal for the current position of the vehicle, wherein the decision-making lane changing signal indicates the lane changing direction side of the vehicle.
The decision-making lane changing signal can be given by a decision-making system of the autonomous driving vehicle, wherein the decision-making system determines whether to perform lane changing of the vehicle according to current vehicle data, road data, target data and the like, and gives a corresponding decision-making lane changing signal, such as lane maintaining (not changing a lane), leftwards lane changing with lane changing uncompleted, rightwards lane changing with lane changing uncompleted, and having a lane changing signal with lane changing completed.
2) A reference side of a driving coordinate system.
The driving coordinate system takes a road boundary line on one side of the road on which the vehicle is located as a reference, and takes a road guide line direction and a direction following a left-hand rule with the road guide line direction as two axes.
Based on the established driving coordinate system, the direction information (whether the driving coordinate system is established on the left side or the right side of the road) on the reference side of the driving coordinate system can be obtained, and then according to the position points, output by the high-precision map, of the lane lines on two sides of the vehicle, the side consistent with the reference side of the driving coordinate system in direction is determined as a lane line, offset reference.
In addition, the reference side of the driving coordinate system can be switched, and the switching rifle is, for example, taking a preset default road boundary line as the reference line; switching to a road boundary line on the navigation direction side indicated by the navigation direction information; maintaining the current reference line unchanged if the road on which the vehicle is currently located is a ramp, and switching to the default road boundary line if the road on which the vehicle is currently located is a main road.
3) A road width unchanged side, indicating the side where the road width does not change in the road ahead of the vehicle.
The lane line fitting method according to the present invention can further comprise: acquiring navigation information for the current position of the vehicle, wherein the navigation information is used for indicating the road width unchanged side. Specifically, the navigation information is obtained by, for example, a vehicle-mounted navigation system having a GPS positioning function, and can indicate a change (narrowing on the left side, widening on the left side, narrowing on the right side, and widening on the right side, etc.) in width of the road ahead in real time, and then according to the position points, output by the high-precision map, of the lane lines on two sides of the vehicle, determine the side consistent with the road width unchanged side as the lane line offset reference.
4) A lane continuous side, indicating the side where the lane continuity does not change in the current road.
For example, in the case of a freeway with no change in the road width but a change in the number of lanes, there is certainly a case where the lane is continuous on one side and discontinuous on the other side, and thus the lane line offset reference can be determined according to the lane continuous side.
Step S130, offsetting based on the lane line offset reference to generate a plurality of lane lines of the vehicle.
Preferably, step S130 can comprise the following steps: calculating a heading angle of each line point on the lane line offset reference; and offsetting for the preset lane width to the left and/or right based on a coordinate, heading angle and preset lane width corresponding to each line point on the lane line offset reference to generate a plurality of lane lines of the vehicle. The calculation equation is explained as follows:
Original points: (x(1),x(2),x(3), . . . ,x(n);y(1),y(2),y(3), . . . ,y(n)).
Calculate heading angle information:
yaw(1)=a tan 2((y(1)),x(1)))*180/pi
yaw(2)==: a tan 2((y(2)−y(1)),(x(2)−x(1)))*180/pi;
yaw(3)=a tan 2((y(3)−y(2)),(x(3)−x(2)))*180/pi;
yaw(n)=a tan 2((y(n)−y(n−1)),(x(n)−x(n−1)))*180/pi;
The offset equation for points on the lane line (offset to the right) is as follows:
X(i)=x(i)+LaneWidth_m*sin(yaw(i));
Y(i)=y(i)−LaneWidth_m*cos(yaw(i));
LaneWidth_m represents the lane width (generally, the default lane width is 3.75 m).
It should be noted that the lane lines on two sides of the vehicle in the embodiment of the present invention refer to the left lane line and the right lane line adjacent to the vehicle, and do not comprise the left-left lane line (that is, lane line further to the lea), the right-right lane line (that is, lane line further to the right), etc. The plurality of lane lines mentioned here comprise lane lines on two sides of the vehicle, as well as a left-left lane line and a right-right lane line that are lanes to the left or right of the lane lines on two sides of the vehicle, etc.
Step S140, performing curve fitting on a set of line points on the plurality of generated lane lines to obtain a corresponding lane line equation.
Preferably, the error of the fitted lane line is large due to the error caused by its own fitting using the fitted lane line equation, and the lane line information of the original high-precision map is also given in the form of continuous points. Therefore, the operation in the form of points is maintained during the intelligent lane line offset to ensure equidistant offset, and the fitting, operation is not performed three times until the final lane line information is given and given in the form of cubic equation parameters.
The following will give a comprehensive description by exemplifying the lane line fitting method of the embodiment of the present invention. In this example, the map information is exemplified by a high-precision map. For ease of description, four examples of lane line fitting based on the lane changing direction side, the driving coordinate system, the road width unchanged side and the lane continuous side are respectively described below.
I. Lane Line Fitting Based on a Lane Changing Direction Side.
II. Lane Line Fitting Based on a Reference Side of a Driving Coordinate System.
III. Lane Line Fitting Based on a Road Width Unchanged Side.
IV. Lane Line Fitting Based on a Lane Continuous Side.
Here, some conditions may apply to more than one of the above lane line fitting schemes based on the lane changing direction side, the reference side of the driving coordinate system, the road width unchanged side and the lane continuous side. To avoid repetitive execution of lane line fitting, in a preferred embodiment, the lane line fitting method according to the embodiment of the present invention can further comprise: setting the priority of determining the lane line offset reference based on the lane changing direction side, the road width unchanged side, the lane continuous side and the reference side of the driving coordinate system.
Step S701, judging whether there is a decision-making lane changing signal, if so, performing the lane line fitting with the lane changing direction side as the reference, otherwise performing step S702.
Step S702, judging whether road narrowing or widening occurs, if so, performing the lane line fitting with the road width unchanged side as the reference, otherwise performing step S703.
When the lane line fitting is performed with the road width unchanged side as the reference, it is necessary to combine actual road working conditions, such as whether the road is widening or narrowing, whether the road widening end point is passed, or whether the left side or right side is widening or narrowing, etc., to determine the lane line offset reference, and then fit the lane line. For example, when the road is narrowing, if the left side is narrowing, the lane line on the right side is used as the lane line offset reference for offsetting other lane lines; and if the right side is narrowing, the lane line on the left side is used as the lane line offset reference for offsetting other lane lines. It can also be judged whether the road width at the next 100 m is less than the set threshold value, and if so, a state signal can be given to the decision-making system of the autonomous driving vehicle at the same time. For another example, when the road is widening, it is judged whether the road widening end point is passed; if so, the left side is widening and the lane line on the right side is used as the lane line offset reference for offsetting other lane lines; if the right side is widening, the lane line on the left side is used as the lane line offset reference for offsetting other lane lines; if the road widening end point is not passed, if the left side is widening, the lane line on the right side is used as the lane line offset reference for offsetting for the original road width to obtain other lane lines; if the right side is widening, the lane line on the left side is used as the lane line offset reference for offsetting for the original road width to obtain other lane lines.
Step S703, judging whether the number of lanes of the current road and the next road section has changed, if so, performing the lane line fitting with the lane continuous side as the reference, otherwise performing step S704.
When performing the lane line fitting with the lane continuous side as the reference, if the number of lanes on two sides is continuous, step S704 is directly executed.
Step S704: performing the lane line fitting with the reference side of the driving coordinate system as the reference.
Further, the above four lane line fitting schemes based on the lane changing direction side, the reference side of the driving coordinate system, the road width unchanged side and the lane continuous side are applicable to a variety of road working conditions. In a preferred embodiment, the lane line fitting method further comprises: determining an actual road working condition of the vehicle according to the map information, and selecting, according to the actual road working condition, one or more of the lane changing direction side, the road width unchanged side, the lane continuous side and the reference side of the driving coordinate system to determine the lane line offset reference.
For example, the actual road working condition and the selected lane line offset reference can comprise any one of the following:
1) In the case that the actual road working condition is a separated roadbed, a conventional ramp, a conventional main road, ramp bifurcation or departure from a high-speed lane, the lane changing direction side and/or the reference side of the driving coordinate system are/is selected to determine the lane line offset reference.
2) in the case that the actual road working condition is main road narrowing, the road width unchanged side is selected to determine the lane line offset reference.
3) In the case that the actual road working condition is ramp merging or ramp-main road joining, the lane continuous side and/or the reference side of the driving coordinate system are/is selected to determine the lane line offset reference.
Further, the above example of lane line fitting is output by fitting four lane lines of L1, L2, R1 and R2, but some lane lines, such as L2 or R2, may already be outside the road boundary, and such fitting is not valid. Therefore, the lane line fitting method in the embodiment of the present invention can further comprise: completely or partially deleting, by combining the map information, a lane line that is outside the road boundary of the current road or affected by a road obstacle from the plurality of lane lines,
In summary, the lane line fitting method according to the embodiments of the present invention can accurately and quickly determine a lane line offset reference used for lane line fitting, and outputs an effective lane line based on the lane line offset reference, facilitates lane maintaining and other controls, solves the problem that extracted lane lines are numerous and relatively complex in the prior art, can be adapted to different road scenes, and has high processing efficiency of lane line algorithm.
In a preferred embodiment, the information acquisition unit 1 is further used for acquiring a decision-making lane changing signal and/or navigation information for the current position of the vehicle, wherein the decision-making lane changing signal indicates the lane changing direction side of the vehicle, and the navigation information is used for indicating the road width unchanged side.
In a preferred embodiment, the lane line fitting system further comprises: a priority setting unit 4, used for setting the priority of determining the lane line offset reference based on the lane changing direction side, the road width unchanged side, the lane continuous side and the reference side of the driving coordinate system. In addition, the reference determination unit 2 is limber electrically connected to the priority setting unit 4, and used for determining the lane line offset reference based on the priority, set by the priority setting unit, of determining the lane line offset reference based on the lane changing direction side, the road width unchanged side, the lane continuous side and the reference side of the driving coordinate system.
In a more preferred embodiment, the lane line fitting system further comprises: a road working condition determination unit 5, used for determining an actual road working condition of the vehicle according to the map information.
In addition, the reference determination unit 2 is also electrically connected to the road working, condition determination unit 5, and used for selecting, according to the actual road working condition, one or more of the lane changing direction side, the road width unchanged side, the lane continuous side and the reference side of the driving coordinate system to determine the lane line offset reference.
The actual road working condition and the selected lane line offset reference can comprise any one of the following: in the case that the actual road working condition is a separated roadbed, a conventional ramp, a conventional main road, or ramp bifurcation, the lane changing direction side and/or the reference side of the driving coordinate system are/is selected to determine the lane line offset reference; in the case that the actual road working condition is main road narrowing or departure from a high-speed lane, the road width unchanged side is selected to determine the lane line offset reference; and in the case that the actual road working condition is ramp merging or ramp-main road joining, the lane continuous side and/or the reference side of the driving coordinate system areas selected to determine the lane line offset reference.
In a more preferred embodiment, the lane line fitting system further comprises: a lane line screening unit 6, electrically connected to the lane line fitting unit 3, and used for completely or partially deleting, by combining the map information, a lane line that is outside the road boundary of the current road or affected by a road obstacle from the plurality of lane lines.
It should be noted that other implementation details and effects of the lane line fitting system in the embodiments of the present invention can refer to the above-mentioned embodiments of the lane line fitting method, which will not be repeated here.
The above descriptions are only the preferred embodiments of the present invention and are not intended to limit the present invention. Any modification, equivalent replacement, improvement, etc., made within the spirit and principle of the present invention, such as adaptively changing the order of execution of steps and adjusting the connection relationship between functional modules, shall be comprised in the protection scope of the present invention.
A person skilled in the art can understand that all or part of the steps in the method of the foregoing embodiments can be implemented by a program instructing related hardware. The program is stored in a storage medium, and comprises several instructions for causing a single chip computer, a chip, or a processor to execute all or part of the steps of the method described in each embodiment of the present application. In addition, the aforementioned storage medium comprises various kinds of mediums that may store program codes, such as a U disk, a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
In addition, any combination of the various embodiments of the present invention can be made therebetween, which, as long as not violating the idea of the embodiments of the present invention, shall likewise be considered as contents disclosed in the embodiments of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
201811154050.X | Sep 2018 | CN | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2019/108403 | 9/27/2019 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2020/063817 | 4/2/2020 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
8311283 | Wu et al. | Nov 2012 | B2 |
20010037165 | Shirai et al. | Nov 2001 | A1 |
20070168113 | Litkouhi | Jul 2007 | A1 |
20100238283 | Ho | Sep 2010 | A1 |
20100268452 | Kindo | Oct 2010 | A1 |
20100332127 | Imai | Dec 2010 | A1 |
20110010021 | Kobayashi | Jan 2011 | A1 |
20110109745 | Nakatani et al. | May 2011 | A1 |
20140200801 | Tsuruta et al. | Jul 2014 | A1 |
20150145664 | You et al. | May 2015 | A1 |
20180111613 | Oh | Apr 2018 | A1 |
20180165525 | Hamada | Jun 2018 | A1 |
20180190122 | Guarneri et al. | Jul 2018 | A1 |
20190113925 | Sim | Apr 2019 | A1 |
Number | Date | Country |
---|---|---|
102529975 | Jul 2012 | CN |
102667888 | Sep 2012 | CN |
103465909 | Dec 2013 | CN |
103832433 | Jun 2014 | CN |
104670229 | Jun 2015 | CN |
105260699 | Jan 2016 | CN |
105300401 | Feb 2016 | CN |
105528588 | Apr 2016 | CN |
105588576 | May 2016 | CN |
106096525 | Nov 2016 | CN |
106525056 | Mar 2017 | CN |
107392103 | Nov 2017 | CN |
2001283391 | Oct 2001 | JP |
2009214786 | Sep 2009 | JP |
2009237901 | Oct 2009 | JP |
2010218528 | Sep 2010 | JP |
2014136480 | Jul 2014 | JP |
201701046 | Jan 2017 | JP |
2017033080 | Feb 2017 | JP |
101502511 | Mar 2015 | KR |
2010004689 | Jan 2010 | WO |
Entry |
---|
Search Report from European Application No. 19866854.3 dated Oct. 14, 2021 (4 pages). |
Huval et al. “An Empirical Evaluation of Deep Learning on Highway Driving”, C0RR (ARXIV), vol. 1504.01716v3, Apr. 7, 2015, pp. 1-7. |
English Translation of International Search Report from PCT/CN2019/108403 dated Jan. 2, 2020 (3 pages). |
Luo, Qiang. Science-Engineering (B), China Doctoral Dissertations Full-Text Database. Departure and Lane-Changing Model for Highway Driving Safety Warning, No. No. 12, Dec. 15, 2014, and its English abstract. |
Number | Date | Country | |
---|---|---|---|
20210389153 A1 | Dec 2021 | US |