The present disclosure relates to a control device for controlling a safety device in a vehicle.
Conventionally, a device is known that detects an object around an own vehicle and predicts a collision between the detected object and the own vehicle. This device detects objects around the own vehicle based on ultrasonic waves transmitted and received by a radar sensor mounted to the front end of the own vehicle.
In the accompanying drawings:
For the above known device, as disclosed in, for example, Japanese Laid-Open Patent Publication No. 2004-230947, it is possible to detect objects around the own vehicle based on images captured by an imaging device mounted to the own vehicle, instead of the radar sensor. In a configuration where moving objects are detected using images captured by the imaging device, a determination as to whether there is a moving object around the own vehicle may not be correctly made despite the presence of the same object having been detected, except in cases where the same object around the own vehicle has been already known to be a moving object. For each object around the own vehicle, certain information (or reliable information) indicating that it is certain that the object around the own vehicle is a moving object or uncertain information (or unreliable information) indicating that it is not certain whether the object is a moving object may be determined.
In this configuration, if a safety device is actuated regardless of whether the object around the own vehicle is detected as certain information or as uncertain information, there is a concern that the safety device may not be properly actuated.
In view of the foregoing, it is desired to have a control device capable of properly actuating the safety device according to moving-object detection information.
One aspect of the present disclosure provides a control device to be applied to a vehicle equipped with an imaging device that captures images of surroundings of the vehicle, and a safety device that avoids a collision between the vehicle and an object or reduces collision damages. The control device is configured to, based on moving-object detection information around the vehicle detected from the images captured by the imaging device, actuate the safety device for the moving object. The moving-object detection information detected from the captured images includes, for each object present around the vehicle, certain information indicating that it is certain that the object is a moving object or uncertain information indicating that it is not certain whether the object is a moving object. The control device includes: a control unit configured to, in response to any of the certain information and the uncertain information being acquired as the moving-object detection information, actuate the safety device based on a position of the object subjected to detection with the certain information or the uncertain information; and an actuation region setting unit configured to change an actuation region where the safety device is to be actuated, according to whether the moving-object detection information is the certain information or the uncertain information, and when the moving-object detection information is the uncertain information, narrow the actuation region as compared to when the moving-object detection information is the certain information.
In a configuration where moving objects are detected using images captured by the imaging device, whether a moving object is present around the own vehicle may not be correctly determined despite the presence of this object having been detected, except in cases where the object around the own vehicle has already been determined to be a moving object. For each object around the own vehicle, certain information indicating that it is certain that the object around the own vehicle is a moving object or uncertain information that it is not certain whether the object is a moving object may be determined. If the safety device is actuated regardless of whether the object around the own vehicle is detected with certain or uncertain information, there is a concern that the safety device may not be properly actuated.
In this regard, when either certain information or uncertain information is acquired as the moving-object detection information, the safety device is actuated based on the position of the object subjected to detection with the certain or uncertain information. Prior to actuating the safety device, the actuation region where the safety device is to be actuated is changed according to whether the moving-object detection information is certain information or uncertain information. This allows the safety device to be properly actuated depending on whether a moving object is detected around the own vehicle as the certain information or as the uncertain information.
An embodiment in which a control device according to the present disclosure is applied to a driving assistance system 100 mounted to an own vehicle will now be described with reference to the accompanying drawings.
As illustrated in
Each camera 11 is, for example, a monocular camera. The cameras 11 are respectively attached to the front end, the rear end, and left and right sides of the own vehicle, and capture images of surroundings of the own vehicle. Each camera 11 transmits image information of the captured images to the image processing ECU 21. In the present embodiment, the camera 11 corresponds to an “imaging device.”
Each sonar device 12 is, for example, an ultrasonic sensor that uses ultrasonic waves as transmission waves, or a radar device that uses high-frequency signals in the millimeter wave band as transmission waves. The sonar devices 12 are respectively mounted to the front end, the rear end, and left and right sides of the own vehicle, and measure a distance to each object around the own vehicle. Specifically, each sonar device 12 transmits a probe wave every predefined cycle and receives its reflected waves using a plurality of antennas. A distance to each object is measured by detecting a plurality of detection points on the object based on the time of transmission of the probe wave and times of reception of its reflected waves. In addition, an azimuth of the object is calculated based on a phase difference of the reflected waves received by the plurality of antennas. Upon the distance and the azimuth of the object being successfully calculated, the position of the object relative to the own vehicle can be determined.
Each sonar device 12 calculates a movement speed of each object based on a change in frequency of the reflected wave reflected by the object due to the Doppler effect. This allows whether the object around the own vehicle is a stationary object to be detected. Specifically, an object is detected as a stationary object when the sum of the movement speed of the object and the travel speed of the own vehicle is zero. Each sonar device 12 transmits stationary-object detection information directed to stationary objects around the own vehicle to the vehicle ECU 22. The stationary-object detection information includes information about the position of each detected stationary object relative to the own vehicle. In the present embodiment, each sonar device 12 corresponds to a “ranging device.”
Each of the ECUs 21 and 22 is a control unit that includes a well-known microcomputer formed of a central processing unit (CPU), a read-only memory (ROM), a random-access memory (RAM), a flash memory, and other components. The ECUs 21 and 22 acquire various signals and perform various control based on the acquired information.
Specifically, the image processing ECU 21 detects moving objects around the own vehicle based on the images captured by the cameras 11. Specifically, the image processing ECU 21 calculates a movement speed of each object in the captured images from the cameras 11. The image processing ECU 21 calculates an optical flow of each object based on the image information transmitted from the cameras 11 every predefined cycle and calculates the movement speed of the object based on the calculated optical flow. The optical flow is a motion vector representing of movement of a plurality of boundary points that are detected as points forming a boundary line across which the luminance changes in the captured image. The moving objects present around the own vehicle are thereby detected. The image processing ECU 21 transmits moving-object detection information directed to moving objects around the own vehicle to the vehicle ECU 22. The moving-object detection information includes information about the position of each detected moving object relative to the own vehicle.
The vehicle ECU 22 actuates the safety devices 30 based on the moving-object detection information directed to moving objects around the own vehicle transmitted from the image processing ECU 21. The safety devices 30 are configured to avoid a collision between the own vehicle and each object or reduce collision damages, and include a braking device 31, a seat belt device 3, and a warning device 33. In the present embodiment, the vehicle ECU 22 corresponds to a “control device.”
The braking device 31 decelerates the own vehicle based on a collision avoidance signal output from the vehicle ECU 22. Based on the collision avoidance signal output from the vehicle ECU 22, the seatbelt device 32 winds up the seatbelt to tighten the seatbelt. The warning device 33 is configured to notify the driver or the like of a collision being likely to occur based on the collision avoidance signal output from the vehicle ECU 22. The warning device 33 may include an auditory warning device, such as a speaker or a buzzer, or a visual warning device, such as a display, which are installed in the cabin of the own vehicle.
The vehicle ECU 22 is connected to a yaw rate sensor 13, a steering angle sensor 14, and a vehicle speed sensor 15. The yaw rate sensor 13 is installed, for example, at the center of the own vehicle, and outputs a yaw rate signal corresponding to a rate of change in amount of steering of the own vehicle to the vehicle ECU 22. The steering angle sensor 14 is attached to, for example, the steering column of the own vehicle, and outputs a steering angle signal corresponding to a change in steering angle of the steering wheel caused by the driver's operation. The steering angle sensor 14 outputs the steering angle signal to the vehicle ECU 22. The speed sensor 15 is attached to, for example, a wheel of the own vehicle and detects a direction of rotation of the wheel and outputs a vehicle speed signal corresponding to a wheel speed to the vehicle ECU 22.
In the own vehicle of the present embodiment, moving objects around the own vehicle are detected based on the images captured by the cameras 11, and stationary objects around the own vehicle are detected based on measurements made by the sonar devices 12. The vehicle ECU 22 actuates the safety devices 30 in collision avoidance processes, that is, a first actuation process to be performed on moving objects and a second actuation process to be performed on stationary objects. In the first actuation process, the vehicle ECU 22 actuates the safety devices 30 to avoid a collision with each moving object or mitigate damages upon impact with the moving object, taking into account not only the position of the moving object relative to the own vehicle, but also a movement path and a movement speed of the moving object. In the second actuation process, the vehicle ECU 22 actuates the safety devices 30 to avoid a collision with each stationary object or mitigate damages upon impact with the stationary object, based on a distance from the own vehicle to the stationary object.
In a configuration where moving objects are detected using images captured by the cameras 11, it is not possible to properly detect a moving object in some positional relationships between the moving object and a stationary object, which thus makes it impossible to correctly perform the first actuation process to be performed on moving objects. For example, in cases where there is another object near a wall as a stationary object, and the stationary object (i.e., the wall) and the other object are present in the same captured image, whether the other object is a moving object or a stationary object may be mistakenly detected. In other cases where a moving object is present on the far side of a wall as a stationary object, the moving object may be detected as a moving object for which the own vehicle is to be controlled despite the own vehicle not having to be controlled for the moving object on the far side of the wall.
In the present embodiment, a determination as to whether there is a moving object around the own vehicle is made based on the moving-object detection information, and a determination as to whether there is a stationary object around the own vehicle is made based on the stationary-object detection information. In addition, at least either neighborhood-of-stationary-object regions A1 that are regions including the stationary object and its surroundings, or far-side regions A2 that are regions on the far side of the stationary object with respect to the own vehicle are set as a mask region. In response to the there being a moving object in the mask region, performance of the first actuation process on the moving object is restricted.
In a configuration where moving objects are detected using images captured by the cameras 11, a determination as to whether there is a moving object around the own vehicle may not be correctly made despite the presence of the same object having been detected, except in cases where the same object around the own vehicle has been already determined to be a moving object. For each object around the own vehicle, the image processing ECU 21 determines certain information indicating that it is certain that the object around the own vehicle is a moving object or uncertain information indicating that it is not certain whether the object is a moving object, and transmits the certain information or the uncertain information to the vehicle ECU 22. Such certain information and uncertain information is information indicating the presence of a moving object, where the certain information is high probability information indicating with a high probability that a moving object is present, and the uncertain information is low probability information indicating with a low probability that a moving object is present than the high probability information. If the safety devices 30 are actuated regardless of whether the object around the own vehicle is detected with certain information or uncertain information, there is a concern that the safety devices 30 may not be properly actuated.
In the present embodiment, when actuating the safety devices 30, an actuation region where the safety devices 30 are actuated is changed according to whether the moving-object detection information is certain information or uncertain information. When the moving-object detection information is uncertain information, the actuation region is narrowed as compared to when the moving-object detection information is certain information.
In
At step S12, the vehicle ECU 22 determines whether the moving-object detection information includes information indicating the presence a moving object. More specifically, the vehicle ECU 22 determines whether the moving-object detection information transmitted from the image processing ECU 21 is any of certain information and uncertain information. If the moving-object detection information is any of certain information and uncertain information, the vehicle ECU 22 determines that a moving object is present. If the answer is NO at step S12, the vehicle ECU 22 terminates the collision avoidance process. If the answer is YES at step S12, the vehicle ECU 22 proceeds to step S13. At step S13, the vehicle ECU 22 determines whether the moving-object detection information is uncertain information among certain information and uncertain information. In the present embodiment, the process step S12 corresponds to the moving-object determination unit 201 in
If the moving-object detection information is certain information and the answer at step S13 is therefore NO, then the vehicle ECU 22 proceeds to step S22. At step S22, the vehicle ECU 22 performs the collision avoidance process (the first actuation process) directed to moving objects. In this case, since an object detected around the own vehicle is recognized as a moving object, the vehicle ECU 22 performs collision avoidance control to actuate the safety devices 30 based on the position and the like of the moving object included in the moving-object detection information.
If the moving-object detection information is uncertain information and the answer at step S13 is therefore YES, then the vehicle ECU 22 proceeds to step S14, where the vehicle ECU 22 determines whether a stationary object is present around the own vehicle. The presence or absence of a stationary object is determined using the stationary-object detection information acquired based on measurements made by the sonar devices 12. Specifically, the vehicle ECU 22 determines whether the stationary-object detection information includes information that indicates the presence of a stationary object. In the present embodiment, the process step S14 corresponds to the stationary-object determination unit 202 in
If a stationary object is present around the own vehicle and the answer at step S14 is therefore YES, then the vehicle ECU 22 proceeds to step S15. At step S15, the vehicle ECU 22 sets neighborhood-of-stationary-object regions A1 that include the stationary object and its surroundings and far-side regions A2 that are regions on the far side of the stationary object with respect to the own vehicle, as a mask region. In the present embodiment, the process step S15 corresponds to the mask region setting unit 203 in
The neighborhood-of-stationary-object regions A1 and the far-side regions A2 may be set as follows, respectively. As illustrated in
The detection point P may not be at the center of the neighborhood-of-stationary-object region A1. Alternatively, the detection point P may be biased toward the own vehicle in the neighborhood-of-stationary-object region A1. That is, the size of a portion of the neighborhood-of-stationary-object region A1 on the far side of the detection point P and the size of a remaining portion of the neighborhood-of-stationary-object region A1 on the near side of the detection point P as viewed from the own vehicle CA may be different. For example, the portion of the neighborhood-of-stationary-object region A1 on the far side of the detection point P may be broader than the remaining portion of the neighborhood-of-stationary-object region A1 on the near side of the detection point P. Given the stationary-object detection information indicating that there are a plurality of detection points P on an outer surface of the stationary object, a neighborhood-of-stationary-object region A1 is set for each of the plurality of detection points P. A merged region of all of the neighborhood-of-stationary-object regions A1 is set as a mask region. Alternatively, each neighborhood-of-stationary-object region A1 may be a circular region with a predefined radius centered at the detection point P.
As illustrated in FIG. 3B, each far-side region A2 is set as a region that spans a predefined angle θ (or a predefined width) to the left and right relative to a straight line connecting the sonar device 12 installed at the front end of the own vehicle and the detection point P, and that extends a predefined distance from the detection point P in a direction away from the own vehicle CA. Given the stationary-object detection information indicating that there are a plurality of detection points P, a far-side region A2 is set for each of the plurality of detection points P. A merged region of all of the far-side regions A2 is set as a mask region.
At step S15, both the merged region of neighborhood-of-stationary-object regions A1 and the merged region of far-side region neighborhood-of-stationary-object regions are set as mask regions. Alternatively, either the merged region of neighborhood-of-stationary-object regions A1 or the merged region of far-side regions A2 may be set as a mask region.
Then, at step S16, the vehicle ECU 22 determines whether an object subjected to detection with the uncertain information (hereinafter referred to as a subjected-to-detection object X) is in the mask region. If the subjected-to-detection object X is in the mask region and the answer at step S16 is therefore YES, then the vehicle ECU 22 proceeds to step S17. At step S17, the vehicle ECU 22 considers the subjected-to-detection object X to be a stationary object. At step S18, the vehicle ECU 22 performs the collision avoidance process (the second actuation process) directed to stationary objects, and terminates the collision avoidance process. In this case, the vehicle ECU 22 considers the position of the object X included in the moving-object detection information to be a stationary object position, and based on the stationary object position, the vehicle ECU 22 performs collision avoidance control to actuate the safety devices 30. At step S18, based on the determination that the subjected-to-detection object X is in the mask region, the vehicle ECU 22 restricts the first actuation process directed to moving objects from being performed. In the present embodiment, the process step S18 corresponds to the actuation restriction unit 204 in
If the subjected-to-detection object X is not in the mask region and the answer at step S16 is therefore NO, then the vehicle ECU 22 proceeds to step S21. At steps S21 and S22, the vehicle ECU 22 performs the collision avoidance process (the first actuation process) directed to moving objects. In this case, in the collision avoidance process (first actuation process) directed to moving objects, the actuation region where the safety devices 30 are to be actuated is set narrower than in the normal collision avoidance process. Then, at step S22, the vehicle ECU 22 performs the collision avoidance process (first actuation process) directed to moving objects, and terminates the collision avoidance process. In the present embodiment, the process step S21 corresponds to the actuation region setting unit 205 in
Changing the actuation region for the safety devices 30 will now be described with reference to
More specifically, the actuation region A10 is defined as a region with a predefined margin on each of the left and right sides of the width of the own vehicle CA. The width of the actuation region A10 is D11. On the condition that a moving object is present in the actuation region A10, the vehicle ECU 22 performs the first actuation process on the moving object. For example, if the answer at step S13 is NO and thus the vehicle ECU 22 proceeds to step S22, that is, if the moving-object detection information is certain information, the vehicle ECU 22 performs the first actuation process based on the presence or absence of a moving object in the actuation region A10 having the width of D11.
However, at step S21, the moving-object detection information is uncertain information, and then the width of the actuation region A10 is changed from D11 to D12 (D12<D11). That is, when the moving-object detection information is uncertain information, the actuation region A10 is changed to a narrower region than when the moving-object detection information is certain information. Upon preceding from step S21 to step S22, the first actuation process is performed at step S22 based on the presence or absence of a moving object in the actuation region A10 having the width of D12.
If at step S14 it is determined that there is no stationary object around the own vehicle and the answer is therefore NO, then the vehicle ECU 22 proceeds to step S19. In this case, the vehicle ECU 22 recognizes that the moving-object detection information is uncertain information and that there is no stationary object among objects detected as uncertain information, and at steps S19 and S20, the vehicle ECU 22 re-determines whether the object is a moving object.
In detail, at step S19, the vehicle ECU 22 acquires a position history of the subjected-to-detection object X (the object subjected to detection with the uncertain information). At subsequent step S20, based on the position history of the object X, the vehicle ECU 22 determines whether the object X is actually a moving object. At step S19, for the subjected-to-detection object X, the vehicle ECU 22 acquires position information from measurements made by the sonar devices 12 every predefined time interval. In addition, at step S20, the vehicle ECU 22 uses a plurality of pieces of position information acquired during a predefined period of time from the current time to a previous time thereto, or a past several pieces of position information from the current time. Then, on the condition that the amount of movement of the subjected-to-detection object X is equal to or greater than a predefined value and the direction of position change in each cycle calculated from the position history is stable, the vehicle ECU 22 determines that the subjected-to-detection object X is a moving object.
More specifically, as illustrated in
If at step S20 it is determined that the object X is a moving object, the vehicle ECU 22 proceeds to step S21. Then, at steps S21 and S22, the vehicle ECU 22 performs the collision avoidance process (the first actuation process) directed to moving objects as described above. In this case, at step S21, the vehicle ECU 22 sets the actuation region where the safety devices 30 are to be actuated to a narrower region than normal, and then at step S22, performs the collision avoidance process (the first actuation process) directed to moving objects.
If at step S20 it is not determined that the object X is a moving object, the vehicle ECU 22 terminates the collision avoidance process. In this case, it remains uncertain whether the subjected-to-detection object X is actually a moving object. Thus, performance of the first actuation process directed to moving objects is withheld.
The present embodiment described in detail above can provide the following advantages.
(A1) In the present embodiment, when any of certain information and uncertain information is acquired as the moving-object detection information, the safety devices 30 are actuated based on the position of the object subjected to detection with the certain information or the uncertain information. When actuating the safety devices 30, the actuation region where the safety devices 30 are to be actuated is changed according to whether the moving-object detection information is certain information or uncertain information. This allows the safety devices 30 to be properly actuated depending on whether a moving object is detected around the own vehicle as the certain information or as the uncertain information.
(A2) Specifically, when the moving-object detection information is uncertain information, the determination region is narrowed by narrowing the actuation region in the forward direction of travel of the own vehicle, in the lateral direction of the own vehicle. Therefore, the safety devices 30 can be properly actuated in the forward direction of travel of the own vehicle, whether the moving-object detection information is certain information or uncertain information.
(A3) In the present embodiment, even if the moving-object detection information is uncertain as to whether the object is a moving object around the own vehicle, the object is determined to be a moving object based on the time-series position history of the object. This also allows the safety devices 30 to be actuated properly.
(A4) When the presence or absence of a moving object is uncertain and the moving-object detection information is thus uncertain information, and further when it is determined that there is a stationary object, such as a wall, around the object detected as a moving object, an object near the stationary object may be mistakenly detected as a moving object.
In this regard, in the present embodiment, when it is determined that a stationary object is present around the own vehicle, at least either neighborhood-of-stationary-object regions A1 that are regions including the stationary object and its surroundings, or far-side regions A2 that are regions on the far side of the stationary object with respect to the own vehicle, are set as a mask region. When the moving-object detection information is uncertain and the object subjected to detection with the uncertain information is present in the mask region, actuation of the safety devices 30 directed to the moving object is restricted. With this configuration, even if another stationary object present around the wall as a stationary object is mistakenly determined to be a moving object, the inconvenience of the safety devices 30 being unnecessarily actuated due to a false determination that the other stationary object is a moving object can be suppressed.
The above embodiments may be modified and implemented as follows.
(B1) Each camera 11 is not limited to a monocular camera. Alternatively, each camera 11 may be a stereo camera.
(B2) In the above embodiment, when the moving-object detection information is uncertain information, the determination region in the forward direction of travel of the own vehicle is narrowed in the lateral (widthwise) direction of the own vehicle. Alternatively, for example, when the moving-object detection information is uncertain information, instead of or in addition to the determination region in the forward direction of travel of the own vehicle, determination regions on both left and right sides of the own vehicle may be narrowed in the longitudinal direction of the own vehicle.
(B3) The size of each mask region may variably be set. For example, in a configuration where devices that measure a distance to each object based on reflected waves from the object are used as the sonar devices 12, the reflection intensity of the reflected waves from the stationary object may be different depending on a form, such as the size or the like, of the stationary object. Therefore, the size of the mask region may be set based on the reflection intensity of the reflected waves. Specifically, at step S15 of
Variably setting the size of the mask region based on the reflection intensity of the reflected waves allows an appropriate mask region to be set according to the form of the stationary object.
(B4) In the above embodiment, an example has been illustrated in which the vehicle ECU 22 corresponds to the control device, but the present disclosure is not limited thereto. Alternatively, the image processing ECU 21 and the vehicle ECU 22 may be combined to correspond to the control device. That is, the control device may generate moving-object detection information related to a moving object around the own vehicle based on the captured images from the imaging devices.
Although the present disclosure has been described in accordance with the above described embodiments, it is not limited to such embodiments, but also encompasses various variations and variations within equal scope. In addition, various combinations and forms, as well as other combinations and forms, including only one element, more or less, thereof, are also within the scope and idea of the present disclosure.
Number | Date | Country | Kind |
---|---|---|---|
2019-187640 | Oct 2019 | JP | national |
This application is a continuation application of International Application No. PCT/JP2020/038047 filed Oct. 7, 2020 which designated the U.S. and claims priority to Japanese Patent Application No. 2019-187640 filed with the Japan Patent Office on Oct. 11, 2019, the contents of each of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2020/038047 | Oct 2020 | US |
Child | 17658225 | US |