The present invention relates to a parking assisting apparatus and method for assisting parallel type parking or tandem type parking of a vehicle in a parking space next to a parked vehicle.
JP2003-270344 A discloses a parking assisting apparatus for assisting parallel type parking comprising distance measuring means for detecting distance information between an own vehicle and a target object to be detected, parking space detecting means for detecting a parking space in which the own vehicle can be parked, target object side detecting means for detecting a side of the target object which would become substantially parallel to the side of the own vehicle if the own vehicle were parked in the parking space, and parking direction determining means for determining a target parking direction in which the own vehicle should be oriented when the own vehicle is parked in the parking space.
However, in fact, since the side of the parked vehicle which exists next to the parking space for parallel type parking is typically substantially perpendicular to a traveling direction of the own vehicle, it is difficult to detect the side of the parked vehicle with a distance-measuring sensor when the own vehicle passes in front of the parked vehicle. Thus, according to the configuration disclosed in JP2003-270344 A, because the side of the parked vehicle cannot be detected with a distance-measuring sensor or it cannot be detected with high accuracy even if it can be detected, there is a problem that it is not possible to precisely estimate the direction of the parking space next to the parked vehicle.
Therefore, an object of the present invention is to provide a parking assisting apparatus which can determine the angle of an own vehicle to be changed at the time of parking in a parking space by precisely estimating the direction of the parking space next to a parked vehicle.
In order to achieve the aforementioned objects, according to the first aspect of the present invention, a parking assisting apparatus for assisting tandem type parking of a vehicle in parking space next to a parked vehicle is provided which comprises;
distance data acquiring means for acquiring distance data representing respective distances between an own vehicle and a plurality of points on a side of the parked vehicle when the own vehicle passes on the side of the parked vehicle, said parked vehicle existing on a proximal side of the parking space in a traveling direction of the own vehicle; and
inclination angle calculating means for calculating an inclination angle which is an angle of the traveling direction of the own vehicle with respect to the side of the parked vehicle, based on the distance data acquired by the distance data acquiring means;
wherein said apparatus is configured to determine an angle of the own vehicle to be changed at the time of parking in the parking space in a tandem type parking manner, based on the inclination angle calculated by the inclination angle calculating means.
According to the second aspect of the present invention, a parking assisting apparatus for assisting parallel type parking of a vehicle in a parking space next to a parked vehicle is provided which comprises;
distance data acquiring means for acquiring distance data representing respective distances between an own vehicle and a plurality of points on a front surface of the parked vehicle when the own vehicle passes in front of the parked vehicle, said parked vehicle existing on a proximal side of the parking space in a traveling direction of the own vehicle; and
inclination angle calculating means for calculating an inclination angle which is an angle of the traveling direction of the own vehicle with respect to the front surface of the parked vehicle, based on the distance data acquired by the distance data acquiring means;
wherein said apparatus is configured to determine an angle of the own vehicle to be changed at the time of parking in the parking space in a parallel type parking manner, based on the inclination angle calculated by the inclination angle calculating means.
According to the third aspect of the present invention, in the first or the second aspect of the present invention,
if a parking section line or road partition line adjacent to the parking space is recognized by image recognition processing, the inclination angle calculating means calculates the angle of the traveling direction of the own vehicle with respect to the recognized parking section line or road partition line.
According to the fourth aspect of the present invention, a parking assisting apparatus for assisting tandem type parking of a vehicle in a parking space next to a parked vehicle is provided which is configured to calculate an angle of a traveling direction of an own vehicle with respect to a side of the parked vehicle, based on distance data which is representing respective distances between the own vehicle and a plurality of points on the side of the parked vehicle and is acquired when the own vehicle passes on the side of the parked vehicle which exists on a proximal side of the parking space in a traveling direction of the own vehicle, and said apparatus is configured to determine an angle of the own vehicle to be changed at the time of parking in the parking space in a tandem type parking manner, based on the calculated angle.
According to the fifth aspect of the present invention, a parking assisting apparatus for assisting parallel type parking of a vehicle in a parking space next to a parked vehicle is provided which is configured to calculate an angle of a traveling direction of an own vehicle with respect to a front surface of the parked vehicle, based on distance data which is representing respective distances between the own vehicle and a plurality of points on the front surface of the parked vehicle and is acquired when the own vehicle passes in front of the parked vehicle which exists on a proximal side of the parking space in a traveling direction of the own vehicle, and said apparatus is configured to determine an angle of the own vehicle to be changed at the time of parking in the parking space in a parallel type parking manner, based on the calculated angle.
According to the present invention, a parking assisting apparatus is provided which can determine the angle of the own vehicle to be changed at the time of parking in the parking space by precisely estimating the direction of the parking space next to the parked vehicle.
These and other objects, features, and advantages of the present invention will become more apparent from the following detailed description of preferred embodiments given with reference to the accompanying drawings, in which:
In the following, the best mode for carrying out the present invention will be described in detail by referring to the accompanying drawings.
To the parking assisting ECU 12A are connected a steering angle sensor 16 for detecting the steering angle of the steering wheel (not shown), and a vehicle speed sensor 18 for detecting the speed of the vehicle, via appropriate buses such as a CAN (Controller Area Network) or a high-speed communication bus. The vehicle speed sensor 18 may be wheel speed sensors provided on individual wheels, each of which generates pulse signals according to the rotating speed of the corresponding wheel.
The parking assisting ECU 12A is connected to a distance-measuring sensor 70 which measures the distance with respect to a parked vehicle using sound waves (for example, sonic waves), radio waves (for example, millimeter waves), light waves (for example, lasers), etc. The distance-measuring sensor 70 may be any means which can detect a distance such as a stereo vision camera, other than laser radar, millimeter wave radar, and sonic wave sonar, for example. The distance-measuring sensor 70 is provided on either side of the front body of the vehicle.
The distance-measuring sensor 70 detects the distance with respect to the parked vehicle located on the side of the own vehicle by emitting sound waves or the like in a predetermined area, and then receiving the reflected waves, as shown in
The parking assisting ECU 12A is also connected to a reverse shift switch 50 and a parking switch 52. The reverse shift switch 50 outputs an ON signal when a shift lever is shifted to the reverse position and otherwise outputs an OFF signal. The parking switch 52 is provided in the cabin of the vehicle so as to allow a user in the cabin to operate it. The parking switch 52 outputs an OFF signal in its normal state and outputs an ON signal when operated by the user.
The parking assisting ECU 12A determines whether the user needs assistance in parking the vehicle based on the output signal of the parking switch 52. It is noted that the parking switch 52 may include a switch for specifying parallel type parking or tandem type parking. In this case, the parking assisting ECU 12A operates in a parking mode (i.e., parallel type parking mode or tandem type parking mode) according to the specified parking mode.
Referring to
In step 110, the parking assisting ECU 12A calculates the inclination angle θ0 with respect to the detected parked vehicle. The inclination angle θ0 is an angle between a traveling direction of the own vehicle when the own vehicle passes on the side of the parked vehicle and the side of the parked vehicle (or fore-and-aft direction of the parked vehicle), in the case of the tandem type parking, as shown in
The inclination angle θ0 is derived from the detection results (i.e., row of points representing distance with respect to the side of the parked vehicle) of the distance-measuring sensor 70, utilizing a fact that the side of the parked vehicle can be approximated by a line or second-order curve with small curvature. If the liner approximation is applied to the side of the parked vehicle, the inclination angle θ0 may be derived from the direction of the approximated line, and if the second-order curve approximation is applied to the side of the parked vehicle, the inclination angle θ0 may be derived from the direction perpendicular to the center axis of the approximated second-order curve. It is noted that in an alternative embodiment the approximation of functions other than the second-order curve approximation can be applied as long as the principal axis is determined and another approximation way using a pattern can be applied.
In subsequent step 120, the parking assisting ECU 12A determines whether a front end of the side of the parked vehicle is detected, based on the detection results of the distance-measuring sensor 70. For example, the parking assisting ECU 12A determines that the front end of the side of the parked vehicle is detected, if the row of points whose length is longer than a predetermined length (>2.0 m) is detected and then no row of points can be detected for a length longer than or equal to 50 cm. In the example shown in
In step 130, the parking assisting ECU 12A determines whether a parking space for tandem type parking is detected, based on the detection results of the distance-measuring sensor 70. For example, the parking assisting ECU 12A determines that the parking space for tandem type parking is detected if the row of points whose length is 2.0 m is detected and then no row of points can be detected for a length longer than or equal to 6 m. In the illustrated example in
In step 140, the parking assisting ECU 12A calculates an angle of the vehicle to be changed in performing tandem type parking in the parking space detected in step 130, based on the inclination angle θ0 calculated in step 110, and determines the calculated angle as a target angle θ. The target angle θ is calculated as follows, for example.
θ=θ0+α
Here, α is a amount of change in orientation of the own vehicle after the reference position, and is referred as to a deflection angle α. The deflection angle α is calculated based on respective outputs of the steering angle sensor 16 and vehicle speed sensor (see
In fact, the parking assisting ECU 12A of the present embodiment calculates minute deflection angle αi at every predetermined distance (0.5 m, in this example) based on the following formula (2) which is transformed formula (1) and calculates the deflection angle α by summing the calculated respective minute deflection angles α1˜k.
At this time, the predetermined distance (0.5 m, in this example) is monitored by integrating in time the output signals of the vehicle speed sensor (i.e., wheel speed pulses). Further, road curvature γ is determined based on the steering angle Ha obtained from the steering angle sensor 16, using the relationship γ==Ha/L·η (where L is the length of the wheelbase, and η is an overall gear ratio of the vehicle, that is to say, the ratio of the steering angle Ha to the steering angle of the wheel), for example. It is noted that the minute deflection angle αi may be calculated, for instance, by multiplying the road curvature γ obtained every 0.01 m of minute travel distance by that minute travel distance 0.01 m, and integrating these multiplied values obtained every 0.05 m of travel distance. It is noted that the relationship between the road curvature γ and the steering angle Ha may be stored in the ROM of the parking assisting ECU 12A in the form of a map generated based on correlation data obtained in advance on a vehicle type basis.
In this manner, when the parking space for tandem type parking is detected, the parking assisting ECU 12A calculates the angle (i.e., the target angle θ) of the vehicle to be changed in performing tandem type parking in the parking space. Then, when the parking assisting ECU 12A has calculated the target angle θ, the parking assisting ECU 12A performs parking assist control according to various situations based on the calculated target angle θ. The parking assist control may include not only assistance after the parking start position (for example, assistance in setting a target parking position, vehicle control such as steering control when the vehicle rolls backward for the parking space, etc.), but also assistance before the parking start position (for example, information output to the driver such as guidance message for guiding the vehicle to an appropriate parking start position, steering assistance for making the orientation of the vehicle appropriate at the parking start position, etc). In the case of the configuration in which only the assistance after the parking start position is performed, the target angle θ may be calculated when the vehicle arrives at the parking start position (when the reverse shift switch 50 is turned on). In the case of the configuration in which assistance before the parking start position is performed, the parking assisting ECU 12A may calculate the target angle θ periodically before the vehicle arrives at the parking start position, and perform steering assistance or the like for making the target angle θ fall within an appropriate range.
Referring to
In step 210, the parking assisting ECU 12A calculates the inclination angle θ0 with respect to the detected parked vehicle. The inclination angle θ0 is an angle between a traveling direction of the own vehicle when the own vehicle passes in front of the parked vehicle and the front surface of the parked vehicle (or lateral axis of the parked vehicle), in the case of the parallel type parking, as shown in
In subsequent step 220, the parking assisting ECU 12A determines whether a left end of the front surface (i.e., a distal end in the traveling direction) of the parked vehicle is detected, based on the detection results of the distance-measuring sensor 70. For example, the parking assisting ECU 12A determines that the left end of the front surface of the parked vehicle is detected if the row of points whose length is 1 m is detected and then no row of points can be detected for a length longer than or equal to 50 cm. In the example shown in
In step 230, the parking assisting ECU 12A determines whether a parking space for parallel type parking is detected, based on the detection results of the distance-measuring sensor 70. For example, the parking assisting ECU 12A determines that the parking space is detected if the row of points whose length is 1.0 m is detected and then no row of points can be detected for a length longer than or equal to 2 m. In the illustrated example in
In step 240, the parking assisting ECU 12A calculates an angle of the vehicle to be changed in performing parallel type parking in the parking space detected in step 230, based on the inclination angle θ0 calculated in step 210, and determines the calculated angle as a target angle θ. The target angle θ is calculated as follows, for example.
θ=90−(θ0+α)
Here, α is the deflection angle α explained above (see
In this manner, when the parking space for parallel type parking is detected, the parking assisting ECU 12A calculates the target angle θ of the vehicle to be changed in performing parallel type parking in the parking space. Then, when the parking assisting ECU 12A has calculated the target angle θ, the parking assisting ECU 12A performs parking assist control according to various situations based on calculated target angle θ. The parking assist control may include not only assistance after the parking start position, but also assistance before the parking start position. In the case of the configuration in which only the assistance after the parking start position is performed, the target angle θ may be calculated when the vehicle arrives at the parking start position (when the reverse shift switch 50 is turned on). In the case of the configuration in which assistance before the parking start position is performed, the parking assisting ECU 12A may calculate the target angle θ periodically before the vehicle arrives at the parking start position, and perform steering assistance or the like for making the target angle θ fall within an appropriate range.
Next, the parking assist which may be performed when the vehicle rolls backward from the parking start position to the parking space is explained with reference to
When the reverse shift switch 50 is turned on in the parking start position, the parking assisting ECU 12A displays the image (real image) captured by the back monitoring camera 20, which images a scene behind the vehicle with a predetermined viewing angle, on the display 22 provided in the cabin. Then, a target parking frame 80 is superposed on the captured image on the display 22, as shown in
The initial position of the target parking frame 80 displayed on the display 22 is determined based on the positional relationship between the parking space and the parking start position. On the other hand, the initial direction of the target parking frame 80 displayed on the display 2 is determined based on the target angle θ calculated as mentioned above. In this case, the initial direction of the target parking frame 80 is determined to be substantially parallel to the side of the parked vehicle. The initial position and direction of the target parking frame 80 (corresponds to the target parking position and the target parking direction, respectively) may be confirmed by the user as they are, when the user operates a confirmation switch, for example. Or, the position and direction of the target parking frame 80 may be adjusted with touch switches, etc., for moving the target parking frame in lateral and longitudinal directions and in directions of rotation, as shown in
When the position and direction of the target parking frame are confirmed, the parking assisting ECU 12A determines the target parking position and the target parking direction based on the position and direction of the confirmed target parking frame 80, and determines a target track based on the determined target parking position and target parking direction. When the vehicle starts to roll backward, the parking assisting ECU 12A estimates the position of the vehicle during the parking assist control using the travel distance of the vehicle derived from the output signals of the vehicle speed sensor 18 and the steering position derived from the output signals of the steering angle sensor 16. Then, the parking assisting ECU 12A calculates a target steering angle as a function of the amount of departure of the estimated vehicle position from the target track. The parking assisting ECU 12A transmits the calculated target steering angle to the steering system ECU 30. The steering system ECU 30 controls the motor 32 so as to implement the target steering angle. The motor 32 may be disposed in a steering column for rotating a steering shaft by its rotating angle. The parking assisting ECU 12A requests the driver to stop the vehicle (or controls the vehicle to stop automatically using the automatic braking system) when the vehicle finally arrives at the target parking position in the target parking direction within the parking space, and then terminates the parking assist control.
According to the first embodiment described above, the following effect among others can be obtained.
As mentioned above, since the inclination angle θ0 with respect to the parked vehicle on the proximal side of the parking space is calculated and the target angle θ is calculated by taking the calculated inclination angle θ0 into consideration, it becomes possible to calculate the target angle θ with high accuracy even if the own vehicle doesn't pass in parallel with the side or front surface of the parked vehicle as shown in
The second embodiment differs from the above first embodiment mainly in that the inclination angle θ0 used to calculate the target angle θ is calculated using image recognition results of a parking section line or road partition line in addition to the detection results (i.e., row of points representing distance with respect to the side of the parked vehicle) of the distance-measuring sensor 70. In the following, arrangements unique to the second embodiment are described intensively, but other configurations may be the same as those in the above first embodiment. Further, elements which may be the same as the corresponding elements are given the same reference numerals and their explanations are omitted.
The image recognition device 26 recognizes white lines painted around the parking space by performing image processing of the captured image of the back monitoring camera 20. The white line may be a line A of the parking section line located at the inlet side as shown in
Here, an example of the process for recognizing the parking section line is described. In this example, feature points are extracted in the ROI in the captured image. The feature points are extracted as points at which the rate of change of luminance exceeds a predetermined value. In other word, edges (i.e., outlines) which are defined by a steep change in brightness are extracted. Then coordinates of the respective pixels are converted from the local coordinate system of the camera to the real coordinate system by distortion correction. Then, liner approximation is applied to the edges (i.e., grouping of the feature points) to derive the outlines of the feature points. Then the outline of the feature points which has an angle (i.e., an inclination angle) smaller than or equal to a predetermined angle (an acute angle) with respect to the fore-and-aft direction of the vehicle is detected as a parking section line (which is typically a white line).
When the image recognition device 26 can recognize such a white line, the image recognition device 26 supplies the parking assisting apparatus 10B with information representative of the direction of the recognized white line (or an angle of the own vehicle with respect to the recognized white line).
In step 112, the parking assisting apparatus 10B determines whether the white line around the parking space is successfully recognized by image recognition, based on the image recognition results obtained from the image recognition device 26. Here, the case where the parking section line in the image is not successfully recognized may be the case where the parking section line cannot be recognized due to influence of insufficient light at night, underground parking area, etc. (i.e., influence on extraction of the edges), the positional relationship between the actual parking section line and the coverage of the back monitoring camera 20, snow cover, etc., or the fact that the parking section line doesn't exist in the first place. In step 112, if the image recognition of the white line is successfully performed, the process routine goes to step 114, while if the image recognition of the white line is not successfully performed, the process routine goes to step 116.
In step 114, the parking assisting apparatus 10B calculates the inclination angle θ0 based on the detection results of the distance-measuring sensor 70, as is the case with the above first embodiment.
In step 116, the parking assisting apparatus 10B calculates the inclination angle θ0 based on the image recognition results of the white line obtained from the image recognition device 26. In this case, the inclination angle θ0 may be calculated as an angle between the direction of the white line in the captured image and the fore-and-aft direction of the own vehicle.
The inclination angle θ0 calculated in this way is utilized effectively in determining the target angle θ, as is the case with the above first embodiment.
According to the second embodiment described above, the following effect, among others, can be obtained.
According to the second embodiment, it is possible to determine the target angle θ adapted to the parking section line, even in a situation where the parked vehicle is parked in a biased manner within the parking section line, for example, because the inclination angle θ0 based on the detection results of the white line of the image recognition device 26 is utilized with a higher priority than the inclination angle θ0 based on the detection results of the distance-measuring sensor 70.
The present invention is disclosed with reference to the preferred embodiments. However, it should be understood that the present invention is not limited to the above-described embodiments, and variations and modifications may be made without departing from the scope of the present invention.
For example, although in the above-described embodiments various applications are initiated when the parking switch 52 is turned on, the present invention is not limited to this configuration. For example, they may be initiated if the vehicle speed is lower than a predetermined speed and it is determined that the vehicle position is located in the parking area based on the map data of a navigation device, even in the condition where the parking switch 52 is not turned on. In this case, such a configuration where there is no parking switch 52 can be contemplated.
Further, although in the above-described embodiments the distance-measuring sensor 70 which is suited to detect the side of the parked vehicle is used, it is also possible to detect the side of the parked vehicle (and thus the inclination angle θ0) based on image recognition using a camera.
Further, although in the above-described embodiments the target angle θ is merely used to determine the initial display direction of the target parking frame 80 and the final target parking direction is determined based on the direction of the target parking frame 80 after its orientation adjusting operation, the present invention is not limited to such a configuration. For example, the final target parking direction may be determined directly based on the target angle θ if there is no function of adjusting the orientation of the target parking frame 80.
The present application is based on Japanese Priority Application No. 2007-036917, filed on Feb. 16, 2007, the entire contents of which are hereby incorporated by reference.
Number | Date | Country | Kind |
---|---|---|---|
2007-036917 | Feb 2007 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2008/052343 | 2/13/2008 | WO | 00 | 4/8/2009 |