The present invention relates generally to a driving assistance system for a vehicle and, more particularly, to a driving assistance system that utilizes one or more cameras at a vehicle.
Use of imaging sensors in vehicle imaging systems is common and known. Examples of such known systems are described in U.S. Pat. Nos. 5,949,331; 5,670,935 and/or 5,550,677, which are hereby incorporated herein by reference in their entireties.
The present invention provides a driving assistance system for a vehicle that utilizes one or more sensors such as imaging sensors or cameras (preferably one or more CMOS cameras) and/or such as non-imaging sensors or radar sensors or lidar sensors or the like to capture data representative of objects and scenes exterior of the vehicle, and provides control of the vehicle to maneuver the vehicle to accelerate to a speed of a determined rearward approaching vehicle and/or to change lanes to avoid the path of travel of the determined rearward approaching vehicle, in order to mitigate or avoid collision with the determined rearward approaching vehicle.
These and other objects, advantages, purposes and features of the present invention will become apparent upon review of the following specification in conjunction with the drawings.
A vehicle vision system and/or driver assist system and/or object detection system and/or alert system operates to capture images exterior of the vehicle and may process the captured image data to display images and to detect objects at or near the vehicle and in the predicted path of the vehicle, such as to assist a driver of the vehicle in maneuvering the vehicle in a rearward direction. The vision system includes an image processor or image processing system that is operable to receive image data from one or more cameras and provide an output to a display device for displaying images representative of the captured image data. Optionally, the vision system may provide display, such as a rearview display or a top down or bird's eye or surround view display or the like.
Referring now to the drawings and the illustrative embodiments depicted therein, a vehicle 10 includes an imaging system or vision system 12 that includes at least one exterior viewing imaging sensor or camera, such as a rearward viewing imaging sensor or camera 14a (and the system may optionally include multiple exterior viewing imaging sensors or cameras, such as a forward viewing camera 14b at the front (or at the windshield) of the vehicle, and a sideward/rearward viewing camera 14c, 14d at respective sides of the vehicle), which captures images exterior of the vehicle, with the camera having a lens for focusing images at or onto an imaging array or imaging plane or imager of the camera (
When a vehicle is traveling along a highway situation with several lanes, the subject vehicle (ego vehicle) may drive on a first lane or other lane and may be about to enter a lane next left to it, such as shown in
The system according the present invention may optionally display to or otherwise warn (such as via an audible alert or haptic alert or the like) the driver of the ego vehicle about the rear end collision hazard, such as by utilizing aspects of the systems described in U.S. Pat. No. 9,146,898, which is hereby incorporated herein by reference in its entirety. It may indicate acceleration/deceleration and path scenarios over an HMI to a driver of the vehicle, such as by utilizing aspects of the systems described in U.S. Pat. No. 9,327,693, which is hereby incorporated herein by reference in its entirety). This may be done when the driver is driving the vehicle. Optionally, the system may accelerate the vehicle on its own (without driver initiation) in an appropriate manner, when the free space in front allows it, which may be determined by the environmental sensor processing system. This may be done when the vehicle is driving in a driver assisting mode, such as in a cruise control with lane and lane change assistance (driver is steering, system intervenes moderately, SAE Level 2), or this may also be done when driving in a highway pilot mode or autonomous or semi-autonomous mode (without driver intervention, optionally driver supervised, SAE Level 3 and higher).
As shown in
The system according the invention may handle other types of scenarios, such as when the ego vehicle is on the far left or a middle lane with another lane right to it (on a right hand traffic highway), such as shown in
As shown in
The decision whether the ego vehicle stays in the lane or changes to a lane left of it (or right of it) may be done by a decision logic, look up table, algorithm, bot or trained artificial intelligence (Al) algorithm, or optimal control (OC) algorithm, which may take the following parameters or optimization objectives into account:
Optionally, the system may determine alternative paths with consecutive deceleration/acceleration maneuvers for avoiding a rear end hazard. In the above referenced U.S. Pat. No. 9,146,898, the vision processing system of the rearward directed side cameras produce a determination of distance and speed of vehicles approaching from the rear in a consecutive or adjacent lane. Such systems may add to the determination of free avoidance paths which include lane changes. Also described in U.S. Pat. No. 9,146,898 is the ability of the system to determine the lane of vehicles approaching from the rear, when the road is curvy and the foot point of the subject vehicle from the rear is occluded due to the topography of the rear road. Optionally, the path planning may be done by using influence mapping as shown in the systems described in U.S. Publication No. US-2014-0067206, which is hereby incorporated herein by reference in its entirety.
The system thus may determine a rearward approaching vehicle rearward of the equipped vehicle and traveling at a speed greater than the equipped vehicle. The system or control also determines the speed of the equipped vehicle, and may determine the speed of the determined rearward approaching vehicle (such as by determining an approach rate of the rearward approaching vehicle or based on a communication from the rearward approaching vehicle, such as a vehicle-to-vehicle or v2v communication, or the like). At least in part responsive to determination of the rearward approaching vehicle, the control or system controls the equipped vehicle to accelerate the equipped vehicle to at least the determined speed of the determined rearward approaching vehicle.
The control may control the equipped vehicle to accelerate to generally match the determined speed of the determined rearward approaching vehicle and may control the equipped vehicle to maneuver the equipped vehicle into an adjacent lane responsive at least in part to (i) determination that another vehicle (or object) is ahead of the equipped vehicle in the same lane and traveling at a slower speed than the equipped vehicle (or is not moving in the same lane) and (ii) determination that the determined rearward approaching vehicle is in the adjacent lane. Thus, the equipped vehicle may be automatically maneuvered such as shown in
Optionally, the control may control the equipped vehicle to accelerate to the speed of the determined rearward approaching vehicle responsive at least in part to determination that the determined rearward approaching vehicle is in the same lane as the equipped vehicle. The control may control the equipped vehicle to accelerate to the speed of the determined rearward approaching vehicle responsive at least in part to determination that there are no other vehicles present ahead of the equipped vehicle in the same lane as the equipped vehicle. The control may control the equipped vehicle to maneuver the equipped vehicle into an adjacent lane when said control determines an opening at the adjacent lane, so as to allow the rearward approaching vehicle to pass the equipped vehicle in the lane initially occupied by the equipped vehicle. For example, if the equipped vehicle is traveling in the left lane of a highway, the control may maneuver the equipped vehicle to the slower right lane to allow the rearward approaching vehicle to pass in the faster left lane (such as shown in
Optionally, the control may control the equipped vehicle to accelerate to the speed of the determined rearward approaching vehicle and to maneuver into an adjacent lane responsive at least in part to determination that the determined rearward approaching vehicle is in that adjacent lane. For example, the control may determine that there is a gap ahead of the rearward approaching vehicle and may accelerate to the approaching vehicle's speed and maneuver the equipped vehicle into the gap, thus avoiding causing the approaching vehicle to have to slow down.
As another aspect of the present invention, the system's adaptive cruise control (ACC) may have a desired speed and a desired top speed, where optionally both may be set by driver input, and optionally both may be limited by the current speed limit for the current lane and optionally limited by speed limits for the specific ego vehicle (for example a general speed limit for trucks is, for example, set to 100 km/h for trucks above 7.5 t) or the ego vehicle's condition. Such a condition may be that the ego vehicle is pulling a trailer. For car-trailer trains, specific speed limitations apply depending on the trailer type (e.g., a trailer with or without its own braking system, a trailer with or without suspension and the total weight of trailer exceeding or not exceeding a certain ratio to the total weight of the pulling vehicle), such as by utilizing aspects of the systems described in U.S. Pat. No. 9,558,409, which is hereby incorporated herein by reference in its entirety.
In some countries additional speed limitations may arise depending from the driver's license type for driving a trailer train (license class), also an aspect of the systems described in U.S. Pat. No. 9,558,409. Specially trained drivers may be allowed to drive faster than untrained. The system according the invention may have access to the driver's driving license type information by user entry or provided via remote data communication.
The system includes an image processor operable to process image data captured by the camera or cameras (and/or other sensors), such as for detecting objects or other vehicles or pedestrians or the like in the field of view of one or more of the cameras. For example, the image processor may comprise an image processing chip selected from the EYEQ family of image processing chips available from Mobileye Vision Technologies Ltd. of Jerusalem, Israel, and may include object detection software (such as the types described in U.S. Pat. Nos. 7,855,755; 7,720,580 and/or 7,038,577, which are hereby incorporated herein by reference in their entireties), and may analyze image data to detect vehicles and/or other objects. Responsive to such image processing, and when an object or other vehicle is detected, the system may generate an alert to the driver of the vehicle and/or may generate an overlay at the displayed image to highlight or enhance display of the detected object or vehicle, in order to enhance the driver's awareness of the detected object or vehicle or hazardous condition during a driving maneuver of the equipped vehicle.
The vehicle may include any type of sensor or sensors, such as imaging sensors or radar sensors or lidar sensors or ladar sensors or ultrasonic sensors or the like. The imaging sensor or camera may capture image data for image processing and may comprise any suitable camera or sensing device, such as, for example, a two dimensional array of a plurality of photosensor elements arranged in at least 640 columns and 480 rows (at least a 640×480 imaging array, such as a megapixel imaging array or the like), with a respective lens focusing images onto respective portions of the array. The photosensor array may comprise a plurality of photosensor elements arranged in a photosensor array having rows and columns. Preferably, the imaging array has at least 300,000 photosensor elements or pixels, more preferably at least 500,000 photosensor elements or pixels and more preferably at least 1 million photosensor elements or pixels. The imaging array may capture color image data, such as via spectral filtering at the array, such as via an RGB (red, green and blue) filter or via a red/red complement filter or such as via an RCC (red, clear, clear) filter or the like. The logic and control circuit of the imaging sensor may function in any known manner, and the image processing and algorithmic processing may comprise any suitable means for processing the images and/or image data.
For example, the vision system and/or processing and/or camera and/or circuitry may utilize aspects described in U.S. Pat. Nos. 9,233,641; 9,146,898; 9,174,574; 9,090,234; 9,077,098; 8,818,042; 8,886,401; 9,077,962; 9,068,390; 9,140,789; 9,092,986; 9,205,776; 8,917,169; 8,694,224; 7,005,974; 5,760,962; 5,877,897; 5,796,094; 5,949,331; 6,222,447; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978; 7,859,565; 5,550,677; 5,670,935; 6,636,258; 7,145,519; 7,161,616; 7,230,640; 7,248,283; 7,295,229; 7,301,466; 7,592,928; 7,881,496; 7,720,580; 7,038,577; 6,882,287; 5,929,786 and/or 5,786,772, and/or U.S. Publication Nos. US-2014-0340510; US-2014-0313339; US-2014-0347486; US-2014-0320658; US-2014-0336876; US-2014-0307095; US-2014-0327774; US-2014-0327772; US-2014-0320636; US-2014-0293057; US-2014-0309884; US-2014-0226012; US-2014-0293042; US-2014-0218535; US-2014-0218535; US-2014-0247354; US-2014-0247355; US-2014-0247352; US-2014-0232869; US-2014-0211009; US-2014-0160276; US-2014-0168437; US-2014-0168415; US-2014-0160291; US-2014-0152825; US-2014-0139676; US-2014-0138140; US-2014-0104426; US-2014-0098229; US-2014-0085472; US-2014-0067206; US-2014-0049646; US-2014-0052340; US-2014-0025240; US-2014-0028852; US-2014-005907; US-2013-0314503; US-2013-0298866; US-2013-0222593; US-2013-0300869; US-2013-0278769; US-2013-0258077; US-2013-0258077; US-2013-0242099; US-2013-0215271; US-2013-0141578 and/or US-2013-0002873, which are all hereby incorporated herein by reference in their entireties. The system may communicate with other communication systems via any suitable means, such as by utilizing aspects of the systems described in International Publication Nos. WO 2010/144900; WO 2013/043661 and/or WO 2013/081985, and/or U.S. Pat. No. 9,126,525, which are hereby incorporated herein by reference in their entireties.
The system may also communicate with other systems, such as via a vehicle-to-vehicle communication system or a vehicle-to-infrastructure communication system or the like. Such car2car or vehicle to vehicle (V2V) and vehicle-to-infrastructure (car2X or V2X or V2I or 4G or 5G) technology provides for communication between vehicles and/or infrastructure based on information provided by one or more vehicles and/or information provided by a remote server or the like. Such vehicle communication systems may utilize aspects of the systems described in U.S. Pat. Nos. 6,690,268; 6,693,517 and/or 7,580,795, and/or U.S. Publication Nos. US-2014-0375476; US-2014-0218529; US-2013-0222592; US-2012-0218412; US-2012-0062743; US-2015-0251599; US-2015-0158499; US-2015-0124096; US-2015-0352953; US-2016-0036917 and/or US-2016-0210853, which are hereby incorporated herein by reference in their entireties.
The system may utilize aspects of the trailering or trailer angle detection systems or trailer hitch assist systems described in U.S. Pat. Nos. 9.085,261 and/or 6,690,268, and/or U.S. Publication Nos. US-2017-0254873; US-2017-0217372; US-2017-0050672; US-2015-0217693; US-2014-0160276; US-2014-0085472 and/or US-2015-0002670, and/or U.S. patent application Ser. No. 15/928,128, filed Mar. 22, 2018, now U.S. Pat. No. 10,552,976, Ser. No. 15/928,126, filed Mar. 22, 2018, and published on Sep. 27, 2018 as U.S. Publication No. US-2018-0276838, Ser. No. 15/910,100, filed Mar. 2, 2018, now U.S. Pat. No. 10,706,291, Ser. No. 15/885,855, filed Feb. 1, 2018, and published on Aug. 2, 2018 as U.S. Publication No. US-2018-0215382, and/or Ser. No. 15/878,512, filed Jan. 24, 2018, and published on Jul. 26, 2018 as U.S. Publication No. US-2018-0211528, and/or U.S. provisional application Ser. No. 62/533,694, filed Jul. 18, 2017, which are hereby incorporated herein by reference in their entireties.
The system may utilize sensors, such as radar or lidar sensors or the like. The sensing system may utilize aspects of the systems described in U.S. Pat. Nos. 9,753,121; 9,689,967; 9,599,702; 9,575,160; 9,146,898; 9,036,026; 8,027,029; 8,013,780; 6,825,455; 7,053,357; 7,408,627; 7,405,812; 7,379,163; 7,379,100; 7,375,803; 7,352,454; 7,340,077; 7,321,111; 7,310,431; 7,283,213; 7,212,663; 7,203,356; 7,176,438; 7,157,685; 6,919,549; 6,906,793; 6,876,775; 6,710,770; 6,690,354; 6,678,039; 6,674,895 and/or 6,587,186, and/or International Publication Nos. WO 2018/007995 and/or WO 2011/090484, and/or U.S. Publication Nos. US-2018-0045812; US-2018-0015875; US-2017-0356994; US-2017-0315231; US-2017-0276788; US-2017-0254873; US-2017-0222311 and/or US-2010-0245066 and/or U.S. patent application Ser. No. 15/897,268, filed Feb. 15, 2018, now U.S. Pat. No. 10,782,388, which are hereby incorporated herein by reference in their entireties.
Optionally, the vision system may include a display for displaying images captured by one or more of the imaging sensors for viewing by the driver of the vehicle while the driver is normally operating the vehicle. Optionally, for example, the vision system may include a video display device, such as by utilizing aspects of the video display systems described in U.S. Pat. Nos. 5,530,240; 6,329,925; 7,855,755; 7,626,749; 7,581,859; 7,446,650; 7,338,177; 7,274,501; 7,255,451; 7,195,381; 7,184,190; 5,668,663; 5,724,187; 6,690,268; 7,370,983; 7,329,013; 7,308,341; 7,289,037; 7,249,860; 7,004,593; 4,546,551; 5,699,044; 4,953,305; 5,576,687; 5,632,092; 5,708,410; 5,737,226; 5,802,727; 5,878,370; 6,087,953; 6,173,501; 6,222,460; 6,513,252 and/or 6,642,851, and/or U.S. Publication Nos. US-2014-0022390; US-2012-0162427; US-2006-0050018 and/or US-2006-0061008, which are all hereby incorporated herein by reference in their entireties.
Changes and modifications in the specifically described embodiments can be carried out without departing from the principles of the invention, which is intended to be limited only by the scope of the appended claims, as interpreted according to the principles of patent law including the doctrine of equivalents.
The present application is a continuation of U.S. patent application Ser. No. 18/361,969, filed Jul. 31, 2023, now U.S. Pat. No. 11,981,329, which is a continuation of U.S. patent application Ser. No. 18/046,983, filed Oct. 17, 2022, now U.S. Pat. No. 11,713,038, which is a continuation of U.S. patent application Ser. No. 17/247,688, filed Dec. 21, 2020, now U.S. Pat. No. 11,472,403, which is a continuation of U.S. patent application Ser. No. 16/014,562, filed Jun. 21, 2018, now U.S. Pat. No. 10,870,426, which claims the filing benefits of U.S. provisional application Ser. No. 62/523,407, filed Jun. 22, 2017, which is hereby incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
62523407 | Jun 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 18361969 | Jul 2023 | US |
Child | 18661791 | US | |
Parent | 18046983 | Oct 2022 | US |
Child | 18361969 | US | |
Parent | 17247688 | Dec 2020 | US |
Child | 18046983 | US | |
Parent | 16014562 | Jun 2018 | US |
Child | 17247688 | US |