Patent Application
20100148948
The present invention generally relates to navigation of a vehicle and, more particularly relates to detection and warning of departure of the vehicle from a lane of a roadway.
Wheeled automotive vehicles frequently travel within defined lanes of a roadway, generally based on steering by an operator (driver) of the vehicle. Some vehicles are equipped with lane departure warning (LDW) systems that are designed to provide a warning indication if the vehicle departs from an identified lane of the roadway. In response to the warning, the driver of the vehicle may steer the vehicle back into the appropriate lane. Currently proposed lane departure warning systems typically include optical systems having one or more cameras configured to capture images of the roadway and to process the images to identify lane markings, such as painted lines, on the roadway. Conventional optical lane departure warning systems generally suffer during low light conditions and when lane markings are not clearly visible.
It is therefore desirable to provide for a lane departure warning system for a vehicle that does not suffer drawbacks of low light conditions and poor performance when lane markings are not clearly visible. It is further desirable to provide for a lane departure warning system for a vehicle that is easy to implement and cost affordable.
According to one aspect of the present invention, a vehicle lane departure warning system is provided. The system includes a position sensor for sensing position of a vehicle and memory storing learned vehicle path data. The system further includes a controller for processing the sensed position and determining a stored learned vehicle path as that the vehicle is traveling on. The controller comprises logic for comparing the sensed position to the stored learned vehicle path and determining if the vehicle is sufficiently departing from the stored learned path. The system further includes an output for providing a warning signal indicative of the vehicle departing from the stored learned path. According to another aspect of the present invention, the stored learned path is updated as the vehicle repeatedly travels the path.
According to a further aspect of the present invention, a method of storing learned vehicle path data in memory and warning of departure of the vehicle from a learned path is provided. The method includes the steps of sensing position of a vehicle, processing the sensed position, and determining a learned vehicle path that the vehicle is travelling on. The method also includes the step of updating the stored learned vehicle path as the vehicle repeatedly travels the path. The method further includes the steps of comparing the sensed position to the stored learned current vehicle path, determining that the vehicle is sufficiently departing from the stored learned vehicle path of the road way, and providing a warning signal indication output if the vehicle is determined to be departing from the stored learned vehicle path.
These and other features, advantages and objects of the present invention will be further understood and appreciated by those skilled in the art by reference to the following specification, claims and appended drawings.
The present invention will now be described, by way of example, with reference to the accompanying drawings, in which:
Referring now to
The lane departure warning system 12 is provided on the vehicle 10 to monitor the position of the vehicle 10, to generate and update learned travel paths or lanes, to detect departure of the vehicle 10 from a learned travel path lane, and to provide an output, such as a warning to the operator of the vehicle when the vehicle 10 departs from a learned travel path lane on the roadway. The lane departure warning system 12 may also upload learned travel path data to a central database, such as OnStar®, to make learned travel path data available to other vehicles.
The lane departure warning system 12 is shown including a lane departure warning (LDW) controller 14 having various inputs 20-28 and 80 and providing a warning output 30. The controller 14 has control circuitry shown in the form of a microprocessor 16 and memory 18. It should be appreciated that the controller 14 may employ other analog and/or digital control circuitry including an application specific integrated circuit (ASIC) or other known circuitry for processing the input data, updating learned travel paths, executing one or more lane departure warning routines, outputting a lane departure warning, and uploading data to one or more central databases.
Memory 18 may include any known storage medium, such as random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory and other memory devices. Stored within memory 18 is a learned path database 32 and logic including a lane departure warning routine 50, according to one embodiment. The learned path database 32 may contain one or more vehicle paths that have been learned and stored in memory. The learned vehicle paths may include a confidence level indicating the number of times that each vehicle path has been traveled, such that a higher confidence level is indicative of a frequently traveled path and may be considered a lane. Also shown stored within memory 18 is a lane departure warning routine 100 that processes images captured by a camera and a lane marking assist routine 150, which may be implemented, according to a second disclosed embodiment.
The lane departure warning routine 50 is executed by the microprocessor 16 to process the various inputs to determine whether the vehicle 10 is within or outside of a learned lane of the roadway, and to provide a warning output when the vehicle deviates from the learned lane. Included as inputs to the lane departure warning controller 14 is a vehicle speed signal 20 providing an indication of the speed of the vehicle. Vehicle speed may be sensed by a vehicle speed sensor or may be determined from GPS data. If the vehicle speed is too low (e.g., less than 15 mph) or too high (e.g., greater than 75 mph), the position data is not recorded and the lane departure warning system 12 may be turned off or otherwise ignored such that travel path data is not recorded and updated and a lane departure warning is disregarded. Also input to the controller 14 is a vehicle turn signal indication 22 which provides an indication that the operator of the vehicle intends to turn the vehicle 10 by steering. If the vehicle turn signal indication 22 is on, indicating that the vehicle 10 is expected to turn, the position data acquired within a time period of about ±5 seconds of the turn signal being on is not recorded and the lane departure warning routine may be turned off or ignored such that travel data is not recorded and updated and a lane departure warning is disregarded.
Also input to the controller 14 is a vehicle yaw signal which indicates the yaw of the vehicle 10 as sensed by a yaw sensor, according to one embodiment. It should be appreciated that vehicle yaw may otherwise be determined by employing two or more GPS receivers. If the vehicle yaw exceeds a threshold yaw (e.g., 0.35 radians/second) position data is not recorded, travel path data is not updated, and the lane departure warning routine 50 may be turned off or ignored such that data is not recorded or updated and a lane departure warning is disregarded. Further input to the controller 14 is a brake signal 28 indicative of whether the vehicle brakes are applied. If the vehicle brakes are applied, the position data is ignored such that the data is not recorded and updated and the lane departure warning system may be turned off or ignored such that the data is not recorded or updated and a lane departure warning is disregarded. Accordingly, the input signals 20, 22, 24 and 28 may be compared to on/off or threshold values and used to determine whether or not to allow the lane departure warning system 12 to be employed to update learned paths and generate lane departure warnings.
Additionally, an optical imager, such as a camera 80 may be included in the lane departure warning system 12, according to one embodiment. The camera 80 may be located on the front of the vehicle 10, according to one embodiment, and may acquire images of the roadway generally in front of the vehicle 10. The images acquired by the camera 80 may be processed to locate lane markings on the roadway, such as painted lines or other lane indicators, using known video image processing techniques, such as image recognition. It should be appreciated that one or a plurality of cameras may be employed located at various locations on board the vehicle 10.
Global positioning system (GPS) receiver 26 provides position data input to the lane departure warning controller 14. GPS position data includes the longitude and latitude position coordinates generated by the GPS receiver 26. It should be appreciated that any of a number of commercially available GPS receivers may be employed to provide the sensed position of the vehicle 10. Current GPS receivers offer a very high accuracy. Some current GPS receivers provide accurate position information to within ±12 meters, while other GPS receivers may provide reliable and better accuracy. With the added assistance of GPS repeaters, the accuracy of the acquired GPS data may be as accurate as ±2 cm. While a single GPS receiver is shown, it should be appreciated that a plurality of GPS receivers, such as first and second GPS receivers, may be employed. By employing two GPS receivers on board the vehicle 10 mounted at a known distance apart from each other, enhanced position accuracy may be achieved in addition to determining vehicle yaw. While a GPS receiver 26 is disclosed herein, it should be appreciated that any known position sensing sensor may be employed to sense position of the vehicle 10 for use in the lane departure warning system 12 of the present invention.
The lane departure warning controller 14 provides an output signal shown as a warning output 30. The warning output 30 is indicative of an identified departure of the vehicle 10 from a learned lane on the roadway. It should be appreciated that any of a number of output signals may be employed as the warning output 30 including visible displayed warnings and audible signal alerts. Additionally, it should be appreciated that the warning output 30 may be made available to any of a number of other systems or devices on board the vehicle 10, such as for example, an active steering system to allow the vehicle 10 to automatically steer the vehicle 10 back into the lane, or to turn on the vehicle headlights or pretension the seatbelts, as well as perform other actions.
The lane departure warning controller 14 further outputs data off board the vehicle 10. This is achieved by uploading data to a central data base at block 90 via a transceiver 88. The central database may include a service provider, such as OnStar®. The central database may be included in a service made available to other vehicles, such that learned vehicle path data may be usable by a plurality of vehicles traveling on the roadway. The data upload may be implemented by the transceiver 88 communicating via satellite communication, cell phone communication, or other wireless communications.
Referring to
If all of the qualifiers including the vehicle speed is between the minimum and maximum speed thresholds, the turn signal is off, the sensed yaw is less than the maximum threshold yaw, and the vehicle brake is off, then routine 50 proceeds to decision step 60. In decision step 60, routine 50 determines whether the GPS data matches a known path within limits defined by ±learn limits. The known path may be based on calculated GPS coordinates of the current vehicle position. The learn limits may be a set distance off of a known path, such as five feet, according to one example. It should be appreciated that the position data generated by the GPS receiver is recorded periodically in memory every i seconds. The rate at which the acquired position data is recorded may be speed dependent, such that the data recording rate increases with increased speed of the vehicle. The captured position data is then processed to create a lane area for target information. If the acquired GPS data does not represent a known path stored in memory, then routine 50 proceeds to step 61 to record X number of GPS data points and to calculate a spline based on the recorded GPS data points. The X number of GPS data points may be twenty data points, according to one example. Routine 50 then proceeds to step 62 to identify a new path of the vehicle and sets the path counter for the new path equal to one, and further calculates control limits defining the limits of the new path. Following step 62, routine 50 returns to step 54. If the sensed GPS data represents a known path stored in memory, then routine 50 proceeds to step 64 to increment the path learned counter. The path learned counter thereby keeps a count value as to the number of times that a particular path is identified as being traveled based on the acquired GPS data.
Next, routine 50 proceeds to decision step 66 to determine if the path counter value is greater than a threshold M and if the acquired GPS data is outside of the control limits. The control limits may be a calculated standard deviation limits as follows. Using the distance of the actual points from the calculated spline, you determine a value Δ(i). Then you can calculate a range, R(i)=A (i)−Δ(i−1). This gives a measure of variation from point to point. You take that average value of R(i) for a certain number of points. The value of stdev=Average®/d2. If we use ten points to get the average R then d2=3.076. Once you get a significant number of points near the area of interests, the value for stdev can be calculated as the direct statistical parameter. The value 2 can be changed to make tighter or looser limits. A pretty typical starting point is around 2.6. The path learn counter contains a count value indicative of the number of times a vehicle has traveled over a path at or near the current GPS position coordinates. If the path counter value exceeds the threshold count M, then the confidence of the learned path is determined to be high and the vehicle is considered to have regularly traveled the path and it is assumed that the path defines a lane of the roadway. Provided that the path counter value exceeds the path count threshold M and the GPS data is outside of the control limits, then the routine 50 determines that the vehicle has departed from a lane and proceeds to step 68 to output a lane departure warning output. The warning output may include a visual and/or audible output to alert the driver of the vehicle about the departure of the vehicle from a lane. Following issuance of the warning output, routine 50 returns to step 54.
If the path counter is not greater than the counter threshold M or if the GPS data is determined to be within the control limits, then routine 50 proceeds to step 70 to update the path spline and to recalculate the control limits using the recent sensed GPS data, before returning to step 54. Thus, routine 50 uses the sensed GPS data to update the learned path.
Referring to
Referring to
The lane departure warning system 12 may operate to execute a lane departure warning routine with camera image 100 and lane marking assist routine 150, according to a second embodiment. The lane departure warning routine 100 is shown in
If the lane markings are determined to be sufficiently clear, routine 100 proceeds to decision step 110 to determine whether the vehicle is in a recognized stored lane while the turn signal is off. If the vehicle is determined not to be in a recognized stored lane of the roadway while the turn signal is off, routine 100 proceeds to step 112 to go to the warning system algorithm to provide a lane departure warning to the vehicle operator. If the vehicle is determined to be within a recognized stored lane while the turn signal is off, routine 100 then proceeds to determine if the path of the vehicle is a known path in step 116. If the path of the vehicle is not a known path, routine 100 proceeds to step 118 to record the sensed position data for the new vehicle path, and then proceeds to step 120 to calculate a path spline for the new vehicle path and to calculate standard deviation control limits for the new path. The new path data is stored in memory. The standard deviation control limits may be ±5 feet, according to one embodiment, such that the width of a conventional road lane is provided.
If the determined current vehicle path is a known path, as determined by step 116, routine 100 proceeds to step 122 to update the spline path for the known path and to calculate a standard deviation to set control limits for the known path, thereby providing a position update to the known path. The updated spline path and standard deviation data is stored in memory. Following either steps 120 or 122, routine 100 proceeds to step 124 to determine if the current position points are outside of the control limits. If the position points are outside of the control limits, routine 100 proceeds to step 126 to revise and recalculate the path spline and standard deviation control limits, which are stored in memory. If the points are not outside of the control limits, then routine 100 returns to step 106.
The lane marking assist routine 150 is shown in
Accordingly, it should be appreciated that the lane departure warning system 12 and method of the present invention advantageously detects the departure of a vehicle 10 from a lane or roadway in a manner that is easy to implement and cost affordable. The system 12 advantageously does not require a camera; however, it should be appreciated that the lane departure system 12 and method may be employed in connection with or in combination with a camera or other optical system. It should further be appreciated that the sensed path data may further be uploaded to a central database and made available for use by the vehicle 10 and other vehicles. It should further be appreciated that the lane departure system 12 advantageously learns changes in the lanes of the roadway over time.
It will be understood by those who practice the invention and those skilled in the art, that various modifications and improvements may be made to the invention without departing from the spirit of the disclosed concept. The scope of protection afforded is to be determined by the claims and by the breadth of interpretation allowed by law.
