The present disclosure generally relates to assisted parking and, more specifically, curb detection for vehicle parking.
Semi-autonomous vehicles are equipped with systems, such as an assisted parking module, that assist with certain driving tasks when activated by a driver. The assisted parking module assists the driver in sensing a potential parking space, planning a path into the parking space, and exercising lateral, longitudinal and transmission gear control to maneuver the vehicle into the parking space. An accurate estimation of the current vehicle position and heading angle is important for path planning, and lateral and longitudinal control tasks. Traditionally, this is done using odometry and/or a yaw rate sensor. Odometry determines the distance traveled based on the speed of the wheels and the circumference of the wheels.
On narrow streets, parking a vehicle on the street often involves parking so that a portion of the vehicle is on the street and a portion of the vehicle in on the curb. However, curbs can make odometry inaccurate. Thus, curbs cause difficulty for path planning, and lateral and longitudinal control tasks.
The appended claims define this application. The present disclosure summarizes aspects of the embodiments and should not be used to limit the claims. Other implementations are contemplated in accordance with the techniques described herein, as will be apparent to one having ordinary skill in the art upon examination of the following drawings and detailed description, and these implementations are intended to be within the scope of this application.
Exemplary embodiments provide systems and methods for curb detection for parking. An example vehicle parking assist system includes a processor and memory. An example program stored in the memory is configured to move a vehicle using a set of maneuvers to park the vehicle in a parking space based on an estimated location of a curb. The example program is also configured to compare a first yaw rate to a reference yaw rate to detect when the vehicle contacts the curb. Additionally, the example program is configured to move the vehicle using an adjusted set of maneuvers based on an actual location of the curb.
An example method to assist parking a vehicle includes moving a vehicle using a set of maneuvers to park the vehicle in a parking space based on an estimated location of a curb. The example method also includes comparing a first yaw rate to a reference yaw rate to detect when the vehicle contacts the curb. The example method also includes moving the vehicle using an adjusted set of maneuvers based on an actual location of the curb.
A computer readable medium comprising instructions that, when executed, cause a vehicle to move using a set of maneuvers to park the vehicle in a parking space. The set of maneuvers are based on an estimated location of a curb. Additionally, the instructions, when executed, cause the vehicle to compare a first yaw rate to a reference yaw rate to detect when the vehicle contacts the curb. The instructions, when executed, also cause the vehicle to move using an adjusted set of maneuvers, the adjusted set of maneuvers based on detecting an actual location of the curb.
For a better understanding of the invention, reference may be made to embodiments shown in the following drawings. The components in the drawings are not necessarily to scale and related elements may be omitted, or in some instances proportions may have been exaggerated, so as to emphasize and clearly illustrate the novel features described herein. In addition, system components can be variously arranged, as known in the art. Further, in the drawings, like reference numerals designate corresponding parts throughout the several views.
While the invention may be embodied in various forms, there are shown in the drawings, and will hereinafter be described, some exemplary and non-limiting embodiments, with the understanding that the present disclosure is to be considered an exemplification of the invention and is not intended to limit the invention to the specific embodiments illustrated.
Vehicles (such as, cars, trucks, vans, sport utility vehicles, etc.) are being manufactured with parking assist features that aid the driver with locating a potential parking spot with distance sensors (such as, ultra sonic sensors, RADAR, LiDAR, etc.) and/or visual sensors (such as, cameras, infrared sensors, etc.). Parking spaces involving curbs (such as, parking spaces that straddle the curb, parking spaces that have the vehicle park very close to the curb, parking spaces on the sidewalk, etc.) interfere with path planning, and lateral and longitudinal control tasks unless the existence of the curb is detected and compensated for. For example, if the system does not account for the climbing of a curb when planning the vehicle's path, the path could cause damage to the vehicle by allowing the vehicle's wheels to slide/slip off of the curb, or by contacting the curb at an improper angle. As another example, when the vehicle wheel climbs a curb, the distance traveled is not properly calculated via odometry. This leads to errors in the estimated vehicle position and heading angle. This can result in an unacceptable final position of the vehicle, or even unacceptable movement of the vehicle with regards to surrounding objects. Depending on the curb profile, height, material, and/or color, etc., detecting the curb with visual sensors can be difficult.
The vehicle 102 includes a parking assist system 110, steering control system 112, a throttle control system 114, a brake control system 116, and a curb detector 118. The parking assist system 110 detects the parking space 104 and plans a path to maneuver the vehicle 102 into the parking space 104. In the illustrated example, the parking assist system 110 is communicatively coupled to ultrasonic sensors 120, RADAR sensors 122, and/or LiDAR sensor 124. The ultrasonic sensors 120, the RADAR sensors 122, and/or the LiDAR sensor 124 detect the location and dimensions of objects (such as, other vehicles, trees, garbage cans, etc.) to define the parking space 104. The parking assist system 110 is communicatively coupled to the steering control system 112, the throttle control system 114, and the brake control system 116 to maneuver the vehicle 102 into the parking space 104.
The curb detector 118 is communicatively coupled to a yaw rate sensor 126 that measures the yaw rate of vehicle 102, a front right (FR) wheel speed sensor 128a that measures the speed of a front right wheel 130a, a front left (FL) wheel speed sensor 128b that measures the speed of a front left wheel 130b, a rear right (RR) wheel speed sensor 128c that measures the speed of a rear right wheel 130c, and a rear left (RL) wheel speed sensor 128d that measures the speed of a rear left wheel 130d. As discussed in more detail below, based on the measurements of the yaw rate sensor 126 and the wheel speed sensors 128a, 128b, 128c, and 128d, the curb detector 118 (a) detects when one of the wheels 130a, 130b, 130c, and 130d contacts the curb 100 and (b) identifies which one of the one of the wheels 130a, 130b, 130c, and 130d contacted the curb 100.
The parking assist system 110 tracks the position of the vehicle 102 based on the measurements from the wheel speed sensors 128a, 128b, 128c, and 128d and the yaw rate sensor 126. The parking assist system 110 is communicatively coupled to the curb detector 118. When one of the wheels 130a, 130b, 130c, and 130d contacts the curb 100, the curb detector 118 informs the parking assist system 110. The parking assist system 110 then recalculates the position of the vehicle 102 and/or replans the path of the vehicle 102 to enter the parking space 104. In some parking maneuvers, the vehicle 102 may contact the curb 100 more than once. For example, initially, the rear right wheel 130c may contact and/or climb the curb 100, followed by the front right wheel 130a contacting and/or climbing the curb 100. In such an example, the parking assist system 110 may replan the path of the vehicle 102 after each wheel 130a, 130b, 130c, and 130d contacts the curb 100. In some examples, the parking assist system 110 may replan the path based on the probable position at which the other wheel(s) 130a, 130b, 130c, and 130d will contact the curb 100.
The sensors 204 may be arranged in and around the vehicle 102 in any suitable fashion. In the illustrated example, the sensors 204 include the ultrasonic sensors 120, the RADAR sensors 122, the LiDAR sensor 124, the yaw rate sensor 126, the FR wheel speed sensor 128a, the FL wheel speed sensor 128b, the RR wheel speed sensor 128c, and the RL wheel speed sensor 128d. In some examples, two to six ultrasonic sensors 120 are mounted to a front bumper and/or a rear bumper of the vehicle 102 to detect objects within a set range (such as, 1-meter (3.28 feet) range setting, a 3-meter (9.83 feet) range setting, etc.) along a front arc and/or a rear arc of the vehicle 102. The ultrasonic sensors 120 use high frequency sound waves. In some examples, RADAR sensors 122 are mounted to a front bumper and/or a rear bumper of the vehicle 102 to detect objects within a set range (such as, a 30-meter (98.3 feet) range setting, etc.) using electromagnetic waves. In some examples, a LiDAR sensor 124 is mounted to the roof of the vehicle to objects within a set range (such as, a 70-meter range setting, etc.) using infrared or ultraviolet light. The vehicle 102 may have any combination of the ultrasonic sensors 120, the RADAR sensors 122, and the LiDAR sensor 124 to detect the parking space 104 of
The yaw rate sensor 126 is installed midway between a front axle and a rear axle of the vehicle 102. The yaw rate sensor 126 measures the angular velocity of the vehicle 102 around its vertical axis. The parking assist system 110 uses the measurements from the yaw rate sensor 126 to determine the orientation of the vehicle 102 while turning. The wheel speed sensors 128a, 128b, 128c and 128d are mounted on the wheel assembly of each of the wheels 130a, 130b, 130c, and 130d respectively. The wheel speed sensors 128a, 128b, 128c and 128d measure the rotational speed of the wheels 130a, 130b, 130c, and 130d. Using the yaw rate sensor 126 and the wheel speed sensors 128a, 128b, 128c and 128d, the parking assist system 110 monitors the position of the vehicle 102. Additionally, using the yaw rate sensor 126 and the wheel speed sensors 128a, 128b, 128c and 128d, the curb detector 118 detects when one of the wheels 130a, 130b, 130c, and 130d contacts and/or climbs the curb 100.
The ECUs 206 monitor and control the systems of the vehicle 102. The ECUs 206 communicate and exchange information via the CAN bus 202. Additionally, the ECUs 206 may communicate properties (such as, status of the ECU 206, sensor readings, control state, error and diagnostic codes, etc.) to and/or receive requests from other ECUs 206. For example, the parking assist system 110 may specify, via a message on the CAN bus 202, a throttle position for the throttle control system 114 to implement. Some vehicles 102 may have seventy or more ECUs 206 located in various locations around the vehicle 102 communicatively coupled by the CAN bus 202. The ECUs 206 (such as the steering control system 112, etc.) are discrete sets of electronics that include their own circuit(s) (such as integrated circuits, microprocessors, memory, storage, etc.) and firmware, sensors, actuators, and/or mounting hardware. In the illustrated example, the ECUs 206 include the parking assist system 110, the steering control system 112, the throttle control system 114, and the brake control system 116. The vehicle 102 may have different ECUs 206 than those listed. The steering control system 112 autonomously steers the vehicle 102 into the parking space 104 in conjunction the parking assist system 110. The throttle control system 114 and the brake control system 116 control the speed of the vehicle 102.
In the illustrated example of
The memory 210 and the storage 212 are a computer readable medium on which one or more sets of instructions for operating the methods of the present disclosure can be embedded. The instructions may embody one or more of the methods or logic as described herein. In a particular embodiment, the instructions may reside completely, or at least partially, within any one or more of the memory 210, the computer readable medium, and/or within the controller 208 during execution of the instructions.
The terms “non-transitory computer-readable medium” and “computer-readable medium” should be understood to include a single medium or multiple media, such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. The terms “non-transitory computer-readable medium” and “computer-readable medium” also include any tangible medium that is capable of storing, encoding or carrying a set of instructions for execution by a processor or that cause a system to perform any one or more of the methods or operations disclosed herein. As used herein, the term “computer readable medium” is expressly defined to include any type of computer readable storage device and/or storage disk and to exclude propagating signals.
The yaw calculator 304 compares the yaw rate of the vehicle 102 as measured by the yaw rate sensor 126 and yaw rate experienced by the wheels 130a, 130b, 130c, and 103d. As the vehicle 102 turns, the inside wheels (such as, the front right wheel 130a and the rear right wheel 130c) travel at a lower speed than the outside wheels (such as, the front left wheel 130b and the rear left wheel 130d). This difference in speed, as measured by the wheel speed sensors 128a, 128b, 128c, and 128d, is used to calculate the rate of change in the heading angle of the vehicle 102. When one of the wheels 130a, 130b, 130c, and 103d contacts and/or climbs the curb 100, the speed of that one of the wheels 130a, 130b, 130c, and 103d changes. This affects the rate of change as calculated using the speed measurements from the wheel speed sensors 128a, 128b, 128c, and 128d.
To calculate the rate of change, the yaw calculator 304 calculates a rear wheel speed differential (ΨRW), and a front wheel speed differential (ΨFW). The rear wheel speed differential (ΨRW) is calculated in accordance with Equation (1) below.
In Equation (1) above, VRL is the wheel speed (in radians per second) of the rear left wheel 130d as measured by the RL wheel speed sensor 128d, VRR is the wheel speed (in radians per second) of the rear right wheel 130c as measured by the RR wheel speed sensor 128c, Rw is radius of the wheels 130c and 130d (in meters), and twR is the track width of the rear axle of the vehicle. The front wheel speed differential (ΨFW) is calculated in accordance with Equation (2) below
In Equation (2) above, VFL is the wheel speed (in radians per second) of the front left wheel 130b as measured by the FL wheel speed sensor 128b, VFR is the wheel speed (in radians per second) of the front right wheel 130a as measured by the FR wheel speed sensor 128a, Rw is radius of the wheels 130a and 130b (in meters), twF is the track width of the front axle of the vehicle, and δ is the road wheel steering angle. The road wheel steering angle (δ) is the angle of the wheels (e.g., the front right wheel 130a and the front left wheel 130b) when the vehicle 102 is turning. In some examples, the road wheel steering angle (δ) is measured by the steering control system 112.
Returning to
ΔΨRW=ΨREF−ΨRW Equation (3)
ΔΨFW=ΨREF−ΨFW Equation (4)
In some examples, the vehicle 102 does not include the yaw rate sensor 126. In some such examples, the yaw calculator 304 compares the rear wheel speed differential (ΨRW) to the front wheel speed differential (ΨFW) to calculate a rear wheel yaw rate difference (ΔΨRW) and a front wheel yaw rate difference (ΔΨFW) The rear wheel yaw rate difference (ΔΨRW) is calculated in accordance with Equation (5) below. The front wheel yaw rate difference (ΔΨFW) is calculated in accordance with Equation (6) below.
ΔΨRW=ΨFW−ΨRW Equation (5)
ΔΨFW=ΨRW−ΨFW Equation (6)
If the wheels 130a, 130b, 130c, and 130d are moving as expected (e.g., not contacting and/or climbing the curb 100), the rear wheel yaw rate difference (ΔΨRW) and the front wheel yaw rate difference (ΔΨFW) are small. In such a scenario, measurement noise and/or tire imperfections may contribute to the rear wheel yaw rate difference (ΔΨRW) and/or the front wheel yaw rate difference (ΔΨFW) being a non-zero value. When one of the wheels 130a, 130b, 130c and 130d climbs over the curb 100, its corresponding wheel speed will increase in order to travel in the vertical direction. This increase in wheel speed will cause difference in the corresponding yaw rate calculation.
Returning to
In Equation (7) and Equation (8) above, VS is the speed of the vehicle 102.
Returning to
The parking assist system 110 communicates (e.g., via the CAN bus 214) to the curb detector 118 to start detecting the curb 100 (block 708). An example method to detect the curb 100 is disclosed in connection with
The parking assist system 110 determines whether one of the wheels 130a, 130b, 130c, 130d has contacted and/or climbed the curb 100 (block 712). The parking assist system 110 determines whether one of the wheels 130a, 130b, 130c, 130d has contacted and/or climbed the curb 100 based on message received from the curb detector 118. The message includes which set of wheels (such as the front wheels 130a and 130b or the rear wheels 130c and 130d). In some examples, the message also includes which one of the wheels 130a, 130b, 130c, 130d contacted and/or climbed the curb 100. Alternately, in some examples, the parking assist system 110 infers which one of the wheels 130a, 130b, 130c, 130d contacted and/or climbed the curb 100 based on which set of wheels contacted and/or climbed the curb 100 and which direction the vehicle 102 is moving.
If the parking assist system 110 determines that one of the wheels 130a, 130b, 130c, 130d has contacted and/or climbed the curb 100, the parking assist system 110 redetermines the current position of the vehicle 102 (block 714). In some examples, the parking assist system 110 also recalculates the path (e.g. adjusts the set of maneuvers) based on location of the curb 100. If the parking assist system 110 does not that detect that one of the wheels 130a, 130b, 130c, 130d has contacted and/or climbed the curb 100, the parking assist system 110 determines whether the vehicle 102 is in the parking space 104 (block 716). If the parking assist system 110 determines the vehicle 102 is in the parking space 104, the parking assist system 110 causes the transmission of the vehicle 102 to be shifted into park (block 718). The parking assist system 110 may also alert the occupants of the vehicle 102. Otherwise, if the parking assist system 110 determines the vehicle 102 is not in the parking space 104, the parking assist system 110 continues to moved the vehicle 102 along the path calculated at block 706 or recalculated at block 714 (block 710).
The curb detector 118 calculates the rear wheel yaw rate difference (ΔΨRW) and the front wheel yaw rate difference (ΔΨFW) or the normalized rear wheel yaw rate difference (ΨnRW) and the normalized front wheel yaw rate difference (ΨnFW) (block 808). In some examples, the rear wheel yaw rate difference (ΔΨRW) and the front wheel yaw rate difference (ΔΨFW) are calculated in accordance with Equation (3) and Equation (4) above. Alternatively, in some examples, the rear wheel yaw rate difference (ΔΨRW) and the front wheel yaw rate difference (ΔΨFW) are calculated in accordance with Equation (5) and Equation (6) above. In some examples, the curb detector 118 additionally calculates the normalized rear wheel yaw rate difference (ΨnRW) and the normalized front wheel yaw rate difference (ΨnFW) in accordance with Equation (7) and Equation (8) respectively above.
The curb detector 118 compares the rear wheel yaw rate difference (ΔΨRW or ΨnRW) and the front wheel yaw rate difference (ΔΨFW or ΨnFW) to the yaw rate threshold (block 810). If either the rear wheel yaw rate difference (ΔΨRW or ΨnRW) or the front wheel yaw rate difference (ΔΨFW or ΨnFW) satisfy the yaw rate threshold 600, the curb detector 118 indicates to the parking assist system 110 which one of the wheels 130a, 130b, 130c, and 130d contacted and/or climbed the curb 100 (block 812). Otherwise, if neither the rear wheel yaw rate difference (ΔΨRW or ΨnRW) nor the front wheel yaw rate difference (ΔΨFW or ΨnFW) satisfy the yaw rate threshold 600, the curb detector 118 continues to monitor the wheel speed sensors 128a, 128b, 128c, and 128d (block 802).
The flowcharts of
In this application, the use of the disjunctive is intended to include the conjunctive. The use of definite or indefinite articles is not intended to indicate cardinality. In particular, a reference to “the” object or “a” and “an” object is intended to denote also one of a possible plurality of such objects. Further, the conjunction “or” may be used to convey features that are simultaneously present instead of mutually exclusive alternatives. In other words, the conjunction “or” should be understood to include “and/or”. The terms “includes,” “including,” and “include” are inclusive and have the same scope as “comprises,” “comprising,” and “comprise” respectively.
The above-described embodiments, and particularly any “preferred” embodiments, are possible examples of implementations and merely set forth for a clear understanding of the principles of the invention. Many variations and modifications may be made to the above-described embodiment(s) without substantially departing from the spirit and principles of the techniques described herein. All modifications are intended to be included herein within the scope of this disclosure and protected by the following claims.
Number | Name | Date | Kind |
---|---|---|---|
5261503 | Yasui | Nov 1993 | A |
6105703 | Kuroda | Aug 2000 | A |
6289281 | Shinmura | Sep 2001 | B1 |
6438463 | Tobaru et al. | Aug 2002 | B1 |
6904350 | Lu et al. | Jun 2005 | B2 |
7653471 | Mattson et al. | Jan 2010 | B2 |
8081539 | Faber | Dec 2011 | B2 |
8364365 | Brewer et al. | Jan 2013 | B2 |
20070282499 | Maeda | Dec 2007 | A1 |
20080291276 | Randler | Nov 2008 | A1 |
20110148663 | Barth | Jun 2011 | A1 |
20140371972 | Jecker et al. | Dec 2014 | A1 |
20160078763 | Kiyokawa | Mar 2016 | A1 |
20160229394 | Fujii | Aug 2016 | A1 |
20170008515 | Seo | Jan 2017 | A1 |
Number | Date | Country |
---|---|---|
2098844 | Sep 2009 | EP |
1386805 | Jun 2011 | EP |
2689990 | Jan 2014 | EP |
2486814 | Jun 2012 | GB |
2514473 | Nov 2014 | GB |
EP 2148220 | Jan 2010 | IT |
EP-2148220 | Jan 2010 | IT |
EP 1129917 | Sep 2001 | JP |
EP-1129917 | Sep 2001 | JP |
Entry |
---|
Christoph Mertz et al., Collision Warning and Sensor Data Processing in Urban Areas, Proceedings of the 5th International Conference on ITS Telecommunications, Jun. 2005, pp. 73-78. |
Christopher R. Carlson et al., Error Sources when Land Vehicle Dead Reckoning with Differential Wheelspeeds, Stanford University, Submitted Feb. 2003, Revised Sep. 2003, 28 pages. |
Search Report dated Aug. 23, 2017 for GB Patent Application No. GB 1704037.9 (4 Pages). |
Number | Date | Country | |
---|---|---|---|
20170261994 A1 | Sep 2017 | US |