This application claims priority to Japanese Patent Application No. 2024-004453 filed on Jan. 16, 2024, incorporated herein by reference in its entirety.
The disclosure relates to a collision avoidance assistance device for a vehicle, a collision avoidance assistance method, and a storage medium, for performing a collision avoidance assistance operations for reducing a likelihood of a host vehicle colliding with a target.
A conventional device shoots images of the face of a driver, using a driver monitor camera to acquire image data. When detecting that the driver is in an inattentive state (e.g., a distracted driving state) based on the image data, the conventional device generates an alarm (e.g., see Japanese Unexamined Patent Application Publication No. 2008-204107 (JP 2008-204107 A)).
However, a certain amount of time is required to detect that the driver is in an inattentive state using the driver monitor camera. Accordingly, timing of executing the collision avoidance assistance operations, including the alarm, may be delayed.
The disclosure has been made to solve this issue. That is to say, an object of the disclosure is to provide a collision avoidance assistance device for a vehicle, a collision avoidance assistance method, and a storage medium, capable of quickly starting an operation (first operation) for avoidance of collision between a host vehicle and a target when it is presumed that attention of a driver to driving is reduced.
One aspect of a collision avoidance assistance device for a vehicle according to the disclosure includes a controller (10) configured to start a first operation (S235) for avoidance of collision between a host vehicle and a target, when a first condition, that is satisfied when a likelihood that the host vehicle will collide with the target is high, is satisfied (Yes in S230). For example, the first condition is a condition that is satisfied when a collision likelihood index value (TTC) indicating a likelihood of collision between the host vehicle and the target reaches a predetermined threshold (TTCth). Further, the first operation may be an alarm operation for issuing an alarm to a driver, or may be an automatic braking operation.
Further, the controller is configured to, when a particular state is occurring (S330), change the first condition to a first early-satisfied condition (Yes in S215, S250) that is a “condition that is satisfied earlier than when the particular state is not occurring (S390)”. The particular state includes at least one state of a state in which a user of the host vehicle is presumed to be performing an operation on in-vehicle equipment installed in the host vehicle (S320), a state in which the user is performing a call using the in-vehicle equipment and a mobile device that is communicably connected to the in-vehicle equipment (S340), and a state in which the mobile device communicably connected to the in-vehicle equipment is receiving an incoming signal (S350).
When the particular state that is described above is occurring, generally, the attention of the driver, who is the user of the host vehicle, to driving, is reduced. Further, whether the particular state is occurring can be immediately detected based on signals from the in-vehicle equipment. Thus, according to the above aspect, when the attention of the driver to driving is reduced, the first operation for collision avoidance can be promptly started.
In addition, when the first operation is an operation that issues an alarm (alarm operation), the first condition is preferably changed to the first early-satisfied condition, only when the target is either a two-wheeled vehicle or a pedestrian. This is because two-wheeled vehicles and pedestrians are targets that are relatively difficult for drivers, whose attention to driving is reduced, to notice. This enables the driver to recognize, at an early stage, two-wheeled vehicles or pedestrians regarding which there is a high likelihood that the driver will overlook.
Further, there are cases in which the device is configured such that automatic braking is executed at a timing later than the alarm operation that is the first operation. In this case, the automatic braking is preferably executed earlier when the particular state is occurring, regardless of the type of target, than when the particular state is not occurring (see S605 to S615 in
In the above description, names and/or signs used in the embodiment are added in parentheses to the configurations of the disclosure corresponding to the embodiment to be described later, to facilitate understanding of the disclosure. However, the components of the disclosure are not limited to the embodiment defined by the names and/or the signs. The disclosure also encompasses a collision avoidance assistance method for a vehicle, and a storage medium.
Features, advantages, and technical and industrial significance of exemplary embodiments of the disclosure will be described below with reference to the accompanying drawings, in which like signs denote like elements, and wherein:
A “collision avoidance assistance device DS for a vehicle (hereinafter referred to as “device DS”)” according to an embodiment of the disclosure includes components illustrated in
In the present specification, “ECU” refers to an electronic control unit (control unit) equipped with a microcomputer including a central processing unit (CPU) (processor), read-only memory (ROM), random-access memory (RAM), non-volatile memory to which data can be written, an interface, and so forth. The ECU is also referred to as a controller or a computer. A plurality of ECUs, which is illustrated in
A driver assistance ECU 10 uses the components illustrated in
A camera device 20 includes a camera 21 and an image ECU 22. The camera 21 shoots an image of a scene ahead of the host vehicle HV every time a predetermined amount of time elapses, to acquire image data. The image ECU 22 generates camera information based on the image data every time a predetermined amount of time elapses, and transmits the camera information to the driver assistance ECU 10. The camera information includes the image data itself, and camera target information such as “position relative to the host vehicle HV, relative longitudinal speed, relative lateral speed, and type” of the target that is shot. The types of targets include other vehicles, two-wheeled vehicles (including motorcycles, bicycles, electric kick scooters, and so forth), and pedestrians.
The radar device 30 is a well-known device that acquires information regarding a target that is present ahead of the host vehicle HV by using millimeter wave band radio waves, and includes a radar transceiver 31 and a radar ECU 32. The radar transceiver 31 transmits millimeter waves within a predetermined detection range every time a predetermined amount of time elapses, and receives the millimeter waves reflected by the target. The radar transceiver 31 transmits information regarding the transmitted and received millimeter waves to the radar ECU 32. The radar ECU 32 acquires radar information including “distance to the target, direction of the target, relative speed of the target, and so forth” based on the information from the radar transceiver 31, and transmits the radar information to the driver assistance ECU 10. Note that the driver assistance ECU 10 generates fusion target information that ultimately identifies the “position, relative speed, type, and so forth” of the target by integrating (fusing) the camera information and the radar information.
A powertrain ECU 40 controls a drive device including a power source of the host vehicle HV (omitted from illustration) by driving a powertrain actuator 41, thereby generating driving force.
A brake ECU 50 controls a braking device (omitted from illustration) of the host vehicle HV by driving a brake actuator 51, thereby applying braking force to the host vehicle HV. When the brake ECU 50 receives an instruction from the driver assistance ECU 10, the brake ECU 50 drives the brake actuator 51 to execute automatic braking in which the braking force is automatically applied to the host vehicle HV.
The steering ECU 60 controls a steering device (omitted from illustration) of the host vehicle HV by driving a steering motor 61, thereby changing a steering angle of the host vehicle HV.
A notification ECU (alarm ECU) 70 is connected to an alarm display device 71 arranged in a position visible from a driver's seat, and an alarm sound generating device 72 that generates an alarm sound, and controls these in accordance with instructions from the driver assistance ECU 10.
A navigation ECU 80 is connected to a Global Positioning System (GPS) receiver 81, a map database 82 that stores map information, and a display (touchscreen) 83 that displays touch buttons, and together with these, makes up an in-vehicle navigation system. The navigation ECU 80 acquires a current position of the host vehicle HV based on GPS signals received by the GPS receiver 81. The navigation ECU 80 provides route guidance to a destination that is input using the display 83, based on the current position of the host vehicle HV that is acquired, and the map information stored in the map database 82.
An audio device 85 includes a “radio receiver, an amplifier, a control circuit, and a speaker”, none of which are illustrated. The control circuit is equipped with Bluetooth functionality. The audio device 85 is arranged to display operating buttons on the display 83 by way of the navigation ECU 80. The audio device 85 outputs various sounds from a speaker in accordance with operations on the operating buttons displayed on the display 83.
A communication device 90 wirelessly communicates with external devices that are outside of the host vehicle HV (e.g., roadside devices, information management centers, and so forth) and can acquire various types of information from the external devices. Further, the communication device 90 has Bluetooth functionality. A user of the vehicle can set a mobile device including a mobile phone CP and the communication device 90 to a mutually communicable state by Bluetooth-connecting the mobile phone CP to the communication device 90, and thus can make hands-free calls. The communication device 90 causes the display 83 to display operating buttons by way of the navigation ECU 80. The user can operate the operating buttons displayed on the display 83 to perform operations including making telephone (mobile phone CP) calls. Further, when the mobile phone CP Bluetooth-connected to the communication device 90 is in a state of receiving an incoming call signal (incoming call state), the communication device 90 can display a screen indicating this on the display 83 by way of the navigation ECU 80.
The driver assistance ECU 10 inputs detection values (output values) of the following “sensors and switches”.
When the driver operates an operating switch of in-vehicle equipment (hereinafter referred to as “first case”), the attention that the driver pays to driving will often become reduced. The operating switches for the in-vehicle equipment include various touch-operable operating buttons displayed on the display 83, the operating switch 94 for the air conditioner, the hazard indicator switch 95, and the like. Further, when the driver is making a hands-free call using the mobile phone CP of the driver him/herself, and the communication device 90 (hereinafter referred to as “second case”), the attention that the driver pays to driving will often become reduced. In addition, when an incoming call is being received by the mobile phone CP that is communicably connected to the communication device 90 (hereinafter referred to as “third case”), a message thereof is displayed on the display 83, and accordingly the attention that the driver pays to driving will often become reduced. Accordingly, in such cases, the device DS advances a timing of starting collision avoidance assistance operations, including issuing an alarm, as compared to a timing in a case otherwise. This enables the driver to notice the presence of an obstruction early on when his or her attention to driving is reduced, and to take appropriate measures against the obstruction.
A CPU of the driver assistance ECU 10 (hereinafter simply referred to as “CPU”) executes routines shown in flowcharts of
At a predetermined timing, the CPU starts processing from S200 in
When the value of the assistance flag XW is “0”, the CPU advances from S205 to S210. In S210, the CPU determines whether an obstruction (target) is present in a region through which the host vehicle HV will travel within a certain period of time (host vehicle travel region), based on the fusion target information (i.e., camera information and radar information). When no target (obstruction) is present in the host vehicle travel region, the CPU advances directly from S210 to S295 and ends this routine for the time being.
On the other hand, when an obstruction is present in the host vehicle travel region, the CPU advances from S210 to S215, and determines whether the value of the reduced-attention flag Xd is “1”. The reduced-attention flag Xd is set to “1” when it is presumed that the attentiveness to driving of the driver is decreasing (see
When the value of the reduced-attention flag Xd is not “1” (i.e., when “0”), the CPU makes a determination of “No” in S215 and advances to S220, and sets a collision determination threshold time TTCth to a basic threshold time TTCthB (see block B in
In S225, the CPU calculates a Time To Collision TTC by dividing a distance between the obstruction and the host vehicle HV by the relative speed of the obstruction. That is to say, the CPU calculates the time required for the host vehicle to collide with the obstruction as the Time To Collision TTC. The Time To Collision TTC is a value that decreases as the likelihood of the host vehicle HV colliding with the obstruction increases, and is one of collision likelihood index values that indicate the likelihood of a collision between the host vehicle HV and an obstruction.
Next, the CPU advances to S230, and determines whether the Time To Collision TTC is no more than a collision determination threshold time TTCth (in this case, basic threshold time TTCthB). That is to say, in S230, the CPU determines whether a collision avoidance assistance starting condition (alarm generation condition), which is satisfied when prediction is made that the host vehicle will collide with a target, is satisfied. For convenience, the collision avoidance assistance starting condition is also referred to as “first condition”.
When the Time To Collision TTC is not no more than the collision determination threshold time TTCth, the CPU advances directly from S230 to S295 and ends this routine for the time being. Conversely, when the Time To Collision TTC is no more than the collision determination threshold time TTCth, the CPU advances from S230 to S235.
The CPU starts an alarm generating operation (first operation) as a collision avoidance assistance operation. More specifically, the CPU transmits an instruction signal to the alarm ECU 70, to cause the alarm display device 71 to display an alarm (attention) mark and also cause the alarm sound generating device 72 to generate an alarm sound. Next, the CPU advances to S240, and sets the value of the assistance flag XW to “1”. Thereafter, the CPU advances to S295.
On the other hand, when the CPU advances to S215, and the value of the reduced-attention flag Xd is “1”, the CPU makes a determination of “Yes” in S215, and advances to S245. In S245, the CPU determines whether the type of obstruction is a “two-wheeled vehicle or a pedestrian”. When the type of obstruction is neither of “two-wheeled vehicle and pedestrian”, the CPU advances from S245 to the above-described S220.
On the other hand, when the type of obstruction is either of “two-wheeled vehicle and pedestrian”, the CPU advances from S245 to S250. In S250, the CPU sets the collision determination threshold time TTCth to “value obtained by adding positive threshold correction value dTTCth (sec S440 in
As a result, when the Time To Collision TTC is no more than the collision determination threshold time TTCth (in this case, TTCthB+threshold correction value dTTCth), determination is made that the collision avoidance assistance starting condition (alarm generation condition, first condition) is satisfied. In S235, a collision avoidance assistance operation (alarm generation operation, first operation) is started. That is to say, when the value of the reduced-attention flag Xd is “1”, the collision avoidance assistance operation is executed at an earlier timing than when the value of the reduced-attention flag Xd is not “1”.
As can be understood from the above, when the value of the reduced-attention flag Xd is “1” and also the obstruction is a two-wheeled vehicle or a pedestrian, the condition is changed to the first early-satisfied condition. The first early-satisfied condition is a condition in which the first condition is satisfied at an earlier timing than when the value of the reduced-attention flag Xd is “0”. Accordingly, when the attention to driving of the driver is reduced, the driver can be made aware of an obstruction at an earlier stage. Also, when a configuration is made such that the processing of S245 is not to be executed, and the value of the reduced-attention flag Xd is “1”, the condition is changed to the first early-satisfied condition in which the first condition is satisfied at an earlier timing than when the value of the reduced-attention flag Xd is “0”.
Now, upon the CPU advancing to S205 when the value of the assistance flag XW is set to “1”, the CPU advances from S205 to S255. At S255, the CPU determines whether a target (obstruction) is present in the host vehicle travel region. When a target (obstruction) is present in the host vehicle travel region, the CPU advances directly from S255 to S295. Accordingly, in this case, display of the alarm mark and generation of the alarm sound continue.
On the other hand, when the target (obstruction) is no longer present in the host vehicle travel region, the CPU advances from S255 to S260, and sets the value of the assistance flag XW to “0”. Next, the CPU advances from S260 to S265, and stops the alarm generation operation serving as the collision avoidance assistance operation. Thereafter, the CPU advances directly from S265 to S295 and ends this routine for the time being.
At a predetermined timing, the CPU starts processing from S300 in
When the value of the reduced-attention flag Xd is “0”, the CPU advances from S310 to S320, and determines whether the current point in time is immediately following an operation performed on in-vehicle equipment. Operations on in-vehicle equipment include operation of the operating switch 94 for the air conditioner, operation of the hazard indicator switch 95, touch operations of various operating buttons displayed on the touchscreen display 83, and so forth.
When the current point in time is immediately following an operation performed on in-vehicle equipment, the CPU advances from S320 to S330, and sets the value of the reduced-attention flag Xd to “1”. Thereafter, the CPU advances to S395. When the current point in time is not immediately following an operation performed on in-vehicle equipment, the CPU advances from S320 to S340.
In S340, the CPU determines whether a user of the host vehicle, including the driver, is making a hands-free call using the “mobile phone CP that is Bluetooth-connected to the communication device 90” and the “communication device 90”. When a hands-free call is being made, the CPU advances from S340 to S330, sets the value of the reduced-attention flag Xd to “1”, and then advances to S395. When a hands-free call is not being performed, the CPU advances from S340 to S350.
In S350, the CPU determines whether the mobile phone CP that is Bluetooth-connected to the communication device 90 is receiving an incoming call signal (i.e., an incoming call is being received). When an incoming call is being received, the CPU advances from S350 to S330, sets the value of the reduced-attention flag Xd to “1”, and then advances to S395. When no incoming call is being received, the CPU advances from S350 to S395.
On the other hand, when the CPU advances to S310, and the value of the reduced-attention flag Xd is “1”, the CPU advances from S310 to S360, and determines whether a certain threshold time has elapsed since the point in time the in-vehicle equipment was operated last. When the certain threshold time has not elapsed since the point in time at which the in-vehicle equipment was operated last, the CPU advances directly from S360 to S395. Accordingly, the value of the reduced-attention flag Xd is maintained at “1”.
On the other hand, when the certain threshold time has elapsed since the point in time at which the in-vehicle equipment was operated last, the CPU advances from S360 to S370. In S370, the CPU determines whether the state at the current point in time is a state in which a hands-free call using the mobile phone CP and the communication device 90 is not being performed. When the state at the current point in time is a state in which a hands-free call is being made (i.e., a call is in progress), the CPU advances directly from S370 to S395. Accordingly, the value of the reduced-attention flag Xd is maintained at “1”.
On the other hand, when the state at the current point in time is a state in which a hands-free call is not being performed, the CPU advances from S370 to S380. In S380, the CPU determines whether the state at the current point in time is a state in which the “mobile phone CP Bluetooth-connected to the communication device 90” is not receiving an incoming call signal. When the state at the current point in time is a state in which a call is being received by the “mobile phone CP that is Bluetooth-connected to the communication device 90”, the CPU advances directly from S380 to S395. Accordingly, the value of the reduced-attention flag Xd is maintained at “1”.
On the other hand, when the state at the current point in time is not a state in which “the mobile phone CP Bluetooth-connected to the communication device 90” is receiving a call, the CPU advances from S380 to S390. In S390, the CPU sets the value of the reduced-attention flag Xd to “0”. Thereafter, the CPU advances to S395.
At a predetermined timing, the CPU starts processing from S400 in
Now, when a predetermined operation is performed on the touchscreen display 83, the navigation ECU 80 displays a selection screen 500 illustrated in
More specifically, upon the driver performing a touch operation on one of the buttons 511 to 515, the CPU makes a determination of “Yes” in S410, and advances to S420. In S420, the CPU references a lookup table LT that is stored in ROM in advance, and sets the basic threshold time TTCthB to a value corresponding to the button on which the touch operation was made.
That is to say, when the button 511 labeled “Very early” is operated by touching, the CPU sets the basic threshold time TTCthB to a time T1. When the button 512 labeled “Early” is operated by touching, the CPU sets the basic threshold time TTCthB to a time T2. When the button 513 labeled “Normal” is operated by touching, the CPU sets the basic threshold time TTCthB to a time T3. When the button 514 labeled “Late” is operated by touching, the CPU sets the basic threshold time TTCthB to a time T4. When the button 515 labeled “Very late” is operated by touching, the CPU sets the basic threshold time TTCthB to a time T5. A relation of the following Expression (1) is satisfied among time T1 to time T5.
T1>T2>T3>T4>T5 . . . (1)
Next, the CPU advances to S430, and acquires a value (Tl-TTCthB) obtained by subtracting the basic threshold time TTCthB from the time T1, as a correction margin TS.
Next, the CPU advances to S440, and sets a threshold correction value dTTCth to a value (a TS) obtained by multiplying the correction margin TS by a coefficient a. The coefficient a is a value greater than “0” and smaller than “1”. Thereafter, the CPU advances to S495 and ends this routine for the time being. Note that the basic threshold time TTCthB, the correction margin TS, and the threshold correction value dTTCth are stored in non-volatile memory of the driver assistance ECU 10.
When the CPU advances to S410, and that point in time is not a point in time immediately following a touch operation being performed on any one of the buttons 511 to 515, the CPU advances directly from S410 to S495 and ends this routine for the time being.
As described above, the device DS starts the collision avoidance assistance operation (first operation) earlier when the attention of the driver to driving is reduced, whereby the likelihood of a collision between the host vehicle HV and an obstruction can be reduced. In particular, when the obstruction is either a two-wheeled vehicle or a pedestrian, the alarm operation serving as a collision avoidance assistance operation is started earlier, enabling the driver to recognize these obstructions early on and begin appropriate driving with respect thereto.
Note that the disclosure is not limited to the above embodiment, and various modifications can be adopted within the scope of the disclosure. For example, the processing of S245 in
Further, the CPU according to the modification of the driver assistance ECU 10 may execute a routine shown in
That is to say, when the CPU determines in S210 of
In S620, the CPU determines whether the type of obstruction is a “two-wheeled vehicle or a pedestrian”. When the type of obstruction is either one of “two-wheeled vehicle and pedestrian”, the CPU advances from S620 to S625 and sets an alarm threshold time TTCWth to a “sum of the basic threshold time TTCthB, a positive certain time TW, and the above-described threshold correction value dTTCth”. Thereafter, the CPU advances to S635. On the other hand, when the type of obstruction is neither of “two-wheeled vehicle and pedestrian”, the CPU advances from S620 to S630, and sets the alarm threshold time TTCWth to a “sum of the basic threshold time TTCthB and the certain time TW”. Thereafter, the CPU advances to S635.
The CPU calculates the Time To Collision TTC in S635, and determines in S640 whether the Time To Collision TTC is no more than the alarm threshold time TTCWth. When the Time To Collision TTC is no more than the alarm threshold time TTCWth, the CPU executes the above-described alarm operation in S645. Thereafter, the CPU advances to S650. When the Time To Collision TTC is not no more than the alarm threshold time TTCWth, the CPU advances directly from S640 to S650.
In S650, the CPU determines whether the Time To Collision TTC is no more than the automatic braking threshold time TTCBth. When the Time To Collision TTC is no more than the automatic braking threshold time TTCBth, an automatic braking starting condition serving as a collision avoidance assistance starting condition is satisfied. For convenience, the automatic braking starting condition is also referred to as “second condition”. As can be understood from the above, when the reduced-attention flag Xd is “1”, the second condition is changed to a second early-satisfied condition which is satisfied earlier than when the reduced-attention flag Xd is “0” (see S610, S615 and S650).
When the Time To Collision TTC is no more than the automatic braking threshold time TTCBth, in S655 the CPU starts the automatic braking that is described above. Thereafter, the CPU sets the value of the assistance flag XW to “1” in S660, advances to S695, and ends this routine for the time being. When the Time To Collision TTC is not no more than the automatic braking threshold time TTCBth, the CPU advances directly from S650 to S695 and ends this routine for the time being.
Thus, when the reduced-attention flag Xd is set to “1”, the CPU according to the modification changes the automatic braking starting condition to a condition that is satisfied earlier than when the reduced-attention flag Xd is not set to “1”, regardless of the type of obstruction. In a case in which the reduced-attention flag Xd is “1”, the CPU changes the alarm generation condition to a condition that is satisfied earlier than when the reduced-attention flag Xd is not “1”, only when the obstruction is either a two-wheeled vehicle or a pedestrian.
In addition, the CPU according to the above embodiment and modification may execute just any one or two of steps out of “S320, S340, and S350” between S310 and S330 in
Also, the CPU may set the collision determination threshold time TTCth in S255 to a “value obtained by adding the correction margin TS to the basic threshold time TTCthB”. When making a determination of “No” in S245, the CPU may set the collision determination threshold time TTCth to a “value obtained by adding the threshold correction value dTTCth to the basic threshold time TTCthB”, and then advance to S225. Further, the collision likelihood index value may be an inverse of the Time To Collision TTC, in which case the first condition is satisfied when the collision likelihood index value reaches a first threshold, and the second condition is satisfied when the collision likelihood index value reaches a second threshold that is greater than the first threshold. In addition, the disclosure is applicable to a host vehicle HV in a state in which a driving mode has transitioned from automated driving to driving by a driver in an automated driving vehicle.
Number | Date | Country | Kind |
---|---|---|---|
2024-004453 | Jan 2024 | JP | national |