Patent Application
20250196849
The present invention relates to a driving assistance device, a driving assistance method, and a program.
In recent years, an invention of a vehicle control device that performs automatic deceleration control and automatic steering control has been disclosed (for example, refer to Patent Document 1).
In a vehicle capable of performing automatic steering control in addition to automatic deceleration control, the probability of quickly responding to sudden changes in the surrounding environment of the vehicle is high, and a degree of control margin is relatively high. On the other hand, when there is no avoidance space to the sides of a target object, automatic steering control becomes difficult, and the degree of control margin is the same as for a vehicle that only performs automatic deceleration control. In conventional technologies, there are cases where it is not possible to perform operations according to such differences in the environment.
The present invention has been made in consideration of such circumstances, and one of the objects is to provide a driving assistance device, a driving assistance method, and a program that can perform an appropriate preliminary operation according to a surrounding situation of a target object.
The driving assistance device, the driving assistance method, and the program according to the present invention have adopted the following configuration.
(1): A driving assistance device according to one aspect of the present invention includes a braking controller configured to refer to an output of a detection device that detects presence of objects in front of a vehicle, and instruct a braking device of the vehicle to stop the vehicle when a degree of proximity between a target object among the objects and the vehicle satisfies a first condition, and a steering avoidance controller configured to instruct a steering device of the vehicle to avoid contact with the target object by steering, in which the braking controller includes a first preliminary operation controller that performs a first preliminary operation when the degree of proximity satisfies a second condition, and further includes a second preliminary operation controller that performs a second preliminary operation when the degree of proximity satisfies a third condition and it is determined that there is no space in which the vehicle is able to proceed after avoidance by the steering is performed in any of tracks to sides of the target object at a time point when the third condition is satisfied, the first condition is a condition that is satisfied when the degree of proximity is higher than the second condition, the second condition is a condition that is satisfied when the degree of proximity is higher than the third condition, and the second preliminary operation is an operation, which is started at an earlier timing than the first preliminary operation.
(2): In the aspect of (1) described above, the second preliminary operation may be an operation performed in more stages than the first preliminary operation.
(3): In the aspect of (1) or (2) described above, at least one of the first preliminary operation and the second preliminary operation may be an operation of instructing the braking device to output a braking force smaller than a braking force that the braking controller instructs the braking device to output.
(4): In the aspect of (3) described above, both the first preliminary operation and the second preliminary operation may be operations of instructing the braking device to output a braking force smaller than a braking force that the braking controller instructs the braking device to output, and a braking force that may be initially output in the second preliminary operation is smaller than a braking force that is initially output in the first preliminary operation.
(5): In the aspect of (1) or (2) described above, at least one of the first preliminary operation and the second preliminary operation may be an operation of instructing an output device to perform a display, a voice output, or a vibration output for calling attention.
(6): A driving assistance method according to another aspect of the present invention includes, by a driving assistance device, referring to an output of a detection device that detects presence of objects in front of a vehicle, and performing one or both of instructing a braking device of the vehicle to stop the vehicle when a degree of proximity between a target object among the objects and the vehicle satisfies a first condition and instructing a steering device of the vehicle to avoid contact with the target object by steering, performing a first preliminary operation when the degree of proximity between the target object and the vehicle satisfies a second condition, and performing a second preliminary operation when the degree of proximity between the target object and the vehicle satisfies a third condition and it is determined that there is no space in which the vehicle is able to proceed after avoidance by the steering is performed in any of tracks to sides of the target object at a time point when the third condition is satisfied, in which the first condition is a condition that is satisfied when the degree of proximity is higher than the second condition, the second condition is a condition that is satisfied when the degree of proximity is higher than the third condition, and the second preliminary operation is an operation that is started at an earlier timing than the first preliminary operation.
(7): A program according to still another aspect of the present invention causes a computer to execute referring to an output of a detection device that detects presence of objects in front of a vehicle, and performing one or both of instructing a braking device of the vehicle to stop the vehicle when a degree of proximity between a target object among the objects and the vehicle satisfies a first condition and instructing a steering device of the vehicle to avoid contact with the target object by steering, performing a first preliminary operation when the degree of proximity between the target object and the vehicle satisfies a second condition, and performing a second preliminary operation when the degree of proximity between the target object and the vehicle satisfies a third condition and it is determined that there is no space in which the vehicle is able to proceed after avoidance by the steering is performed in any of tracks to sides of the target object at a time point when the third condition is satisfied, in which the first condition is a condition that is satisfied when the degree of proximity is higher than the second condition, the second condition is a condition that is satisfied when the degree of proximity is higher than the third condition, and the second preliminary operation is an operation that is started at an earlier timing than the first preliminary operation.
According to the aspects of (1) to (7) described above, it is possible to perform an appropriate preliminary operation according to a surrounding situation of a target object.
Hereinafter, an embodiment of a driving assistance device, a driving assistance method, and a program of the present invention will be described with reference to the drawings.
The vehicle M is equipped with, for example, a camera 10, a radar device 12, a light detection and ranging (LIDAR) 14, an object recognition device 16, a human machine interface (HMI) 30, a vehicle sensor 40, a driving operator 80, a driving assistance device 100, a traveling drive force output device 200, a brake device 210, and a steering device 220. These devices and apparatuses are connected to each other by a multiplex communication line such as a controller area network (CAN) communication line, a serial communication line, a wireless communication network, or the like. The configuration shown in
The camera 10 is a digital camera that uses a solid-state image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The camera 10 is attached to an arbitrary place in a vehicle in which the vehicle system 1 is mounted (hereinafter, referred to as the vehicle M). When an image of the front is captured, the camera 10 is attached to an upper part of the front windshield, a back surface of the windshield rear-view mirror, and the like. The camera 10 periodically and repeatedly captures, for example, a periphery of the vehicle M. The camera 10 may be a stereo camera.
The radar device 12 radiates radio waves such as millimeter waves to the periphery of the vehicle M, and also detects at least a position (a distance and an orientation) of an object by detecting radio waves (reflected waves) reflected by the object. The radar device 12 is attached to an arbitrary place on the vehicle M. The radar device 12 may detect the position and speed of an object in a frequency modulated continuous wave (FM-CW) method.
The LIDAR 14 irradiates the periphery of the vehicle M with light (or electromagnetic waves with wavelengths close to that of light) and measures scattered light. The LIDAR 14 detects a distance to a target based on a time from light emission to light reception. The irradiated light is, for example, a pulsed laser beam. The LIDAR 14 is attached to an arbitrary place on the vehicle M.
The object recognition device 16 performs sensor fusion processing on a result of detection by some or all of the camera 10, the radar device 12, and the LIDAR 14, and recognizes the position, type, speed, and the like of an object. The object recognition device 16 outputs a result of recognition to the driving assistance device 100. The object recognition device 16 may output the results of detection by the camera 10, the radar device 12, and the LIDAR 14 to the driving assistance device 100 as they are. The object recognition device 16 may be omitted from the vehicle system 1. Some or all of the camera 10, the radar device 12, the LIDAR 14, and the object recognition device 16 are examples of a “detection device.”
The HMI 30 presents various types of information to an occupant of the vehicle M and receives an input operation by the occupant. The HMI 30 includes various display devices, speakers, buzzers, vibration generation devices (vibrators), touch panels, switches, keys, and the like.
The vehicle sensor 40 includes a vehicle speed sensor that detects a speed of the vehicle M, an acceleration sensor that detects acceleration, a yaw rate sensor that detects an angular speed around a vertical axis, an azimuth sensor that detects a direction of the vehicle M, and the like.
The navigation device 50 includes, for example, a global navigation satellite system (GNSS) receiver, a guidance controller, and a storage that has stored map information. The GNSS receiver identifies the position of the vehicle M on the basis of a signal received from a GNSS satellite. The position of the vehicle M may be identified or complemented by an inertial navigation system (INS) using an output of the vehicle sensor 40. The guidance controller determines, for example, a route from the position of the vehicle M (or an arbitrary position to be input) identified by the GNSS receiver to a destination to be input by the occupant with reference to the map information, and causes the HMI 30 to output guidance information so that the vehicle M travels along the route. The map information is, for example, information in which a road shape is expressed by a link indicating a road and nodes connected by a link. The map information may include a road curvature, point of interest (POI) information, and the like. The navigation device 50 may transmit a current position of the vehicle M and a destination to a navigation server via the communication device and acquire a route from the navigation server.
The driving operator 80 includes, for example, an accelerator pedal, a brake pedal, a steering wheel, a shift lever, and other operators. The driving operator 80 has a sensor that detects the amount of operation or a presence or absence of an operation attached thereto, and a result of the detection is output to some or all of the traveling drive force output device 200, the brake device 210, and the steering device 220.
The traveling drive force output device 200 outputs a traveling drive force (torque) for the vehicle to travel to drive wheels. The traveling drive force output device 200 includes, for example, a combination of an internal combustion engine, an electric motor, and a transmission, and an electronic controller (ECU) that controls these. The ECU controls the constituents described above according to information input from the driving assistance device 100 or information input from the driving operator 80.
The brake device 210 includes, for example, a brake caliper, a cylinder that transmits hydraulic pressure to the brake caliper, an electric motor that generates hydraulic pressure in the cylinder, and an ECU. The ECU controls the electric motor according to the information input from the driving assistance device 100 or the information input from the driving operator 80, so that a brake torque corresponding to a braking operation is output to each wheel. The brake device 210 may be provided with a backup mechanism that transmits hydraulic pressure generated by operating the brake pedal included in the driving operator 80 to the cylinder via a master cylinder. The brake device 210 is not limited to the constituent described above, and may be an electronically controlled hydraulic brake device that controls an actuator according to the information input from the driving assistance device 100 to transmit the hydraulic pressure of the master cylinder to the cylinder.
The steering device 220 includes, for example, a steering ECU and an electric motor. The electric motor applies force to, for example, a rack and pinion mechanism to change a direction of a steering wheel. The steering ECU drives the electric motor according to the information input from the driving assistance device 100 or the information input from the driving operator 80 to change the direction of the steering wheel.
The driving assistance device 100 includes, for example, a braking controller 110, a steering avoidance controller 120, and a second preliminary operation controller 130. The braking controller 110 includes a first preliminary operation controller 112, and the second preliminary operation controller 130 includes a steering avoidance feasibility determiner 132. These functional units are realized by, for example, a hardware processor such as a central processing unit (CPU) executing a program (software). In addition, some or all of these components may be realized by hardware (a circuit unit; including circuitry) such as large scale integration (LSI), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a graphics processing unit (GPU), or may be realized by software and hardware in cooperation. A program may be stored in advance in a storage device (a storage device having a non-transitory storage medium) such as an HDD or flash memory of the driving assistance device 100, or may be stored in a detachable storage medium such as a DVD or a CD-ROM and installed in the HDD or flash memory of the driving assistance device 100 by the storage medium (non-transitory storage medium) being attached to a drive device.
Instructions from the driving assistance device 100 to the traveling drive force output device 200, the brake device 210, and the steering device 220 are set in the traveling drive force output device 200, the brake device 210, and the steering device 220 so that they are executed with priority over a result of detection from the driving operator 80. With regard to braking, when a braking force based on an operation amount of the brake pedal is greater than an instruction from the driving assistance device 100, the latter may be set to be executed with priority. In addition, communication priority in an in-vehicle LAN may be used as a mechanism for executing instructions from the driving assistance device 100 with priority.
The braking controller 110 refers to the output of the detection device (mentioned above) that detects the presence of objects in front of the vehicle M, and when a degree of proximity between the target object TO among the objects and the vehicle M satisfies a first condition, instructs the brake device 210 and/or the traveling drive force output device 200 to decelerate and stop the vehicle M. The target object TO is an object that is on the same track as the vehicle M and is in a direction of travel of the vehicle M, and is an object with which the vehicle M needs to avoid contact, excluding objects that can be passed over such as manholes. The braking controller 110 extracts such an object and sets it as the target object TO. In the example of
The “degree of proximity” is expressed by various index values that indicate the degree of proximity between objects. For example, the “degree of proximity” is time to collision (TTC), which is an index value calculated by dividing the distance by a relative speed (a direction of approaching each other is set to be positive). When the relative speed is negative (a direction of moving away from each other), the TTC is provisionally set to infinity. The TTC is an index value that indicates a higher “degree of proximity” as its value becomes smaller. Then, satisfying the “first condition” means, for example, that the TTC is less than a first threshold value Th1. The first threshold value Th1 is, for example, a value of one and several tenths of a [sec]. Instead of TTC, an index value having a similar property, such as headway time, a distance, or other index value, may be used as the “degree of proximity.” In addition, TTC adjusted by taking into account acceleration and jerk may be used as the “degree of proximity.” In the following description, the “degree of proximity” will be described as TTC.
When the TTC is less than the first threshold value Th1, the braking controller 110 instructs the brake device 210 and/or the traveling drive force output device 200 to output a braking force that decelerates the vehicle M at a first deceleration B1, for example. The first deceleration B1 is, for example, a deceleration of several tenths of a [G](close to one). As a result, the braking controller 110 quickly decelerates and stops the vehicle M to avoid contact with the target object TO. The ECUs of the brake device 210 and the traveling drive force output device 200 have a function of calculating a brake output, an amount of regenerative control, an amount of engine brake, and the like based on the instructed deceleration, and the ECU determines the respective control amounts on the basis of the instructed deceleration and the speed of the vehicle M. This is a known technology, and a detailed description will be omitted.
An operation of the first preliminary operation controller 112 will be described below, and the steering avoidance controller 120 will be described first.
Steering avoidance is performed when there is a sudden change in an environment surrounding the vehicle, such as when the target object TO decelerates unexpectedly, or when an object other than the recognized target object TO interrupts between the vehicle M and the target object TO and is set as a new target vehicle TO. In such a situation, the deceleration calculated in advance to stop the vehicle in front of the target vehicle TO may not make it possible to respond, but a probability of being able to respond to sudden changes in the environment surrounding the vehicle can be increased by having the steering avoidance function.
Processing of the first preliminary operation controller 112 and the second preliminary operation controller 130 will be described below.
When the degree of proximity between the target object TO and the vehicle M satisfies the second condition (for example, when the TTC is less than a second threshold value Th2), the first preliminary operation controller 112 performs a first preliminary operation to inform the driver of the vehicle M of the presence of the target object TO. The first preliminary operation is, for example, an operation of instructing the brake device 210 and/or the traveling drive force output device 200 to output a braking force that decelerates the vehicle M at a second deceleration B2 during a period from when the TTC becomes less than the second threshold value Th2 to when it becomes less than the first threshold value Th1. The second deceleration B2 is a deceleration smaller (closer to zero) than the first deceleration B1. The second threshold value Th2 is a value greater than the first threshold value Th1. Therefore, the first condition is a condition that is satisfied when the degree of proximity is higher than the second condition.
The second preliminary operation controller 130 performs a second preliminary operation to inform the driver of the vehicle M of the presence of the target object TO when the degree of proximity between the target object TO and the vehicle M satisfies a third condition (for example, the TTC is less than a third threshold value Th3) and when it is determined that there is no space in which the vehicle can proceed on any of the tracks to the sides of the target object TO after avoidance by steering is performed at a time point when the third condition is satisfied. The determination on space in which the vehicle can proceed is performed by the steering avoidance feasibility determiner 132. The third threshold value Th3 is a value greater than the second threshold value Th2. Therefore, the second condition is a condition that is satisfied when the degree of proximity is higher than the third condition.
For example, at the time point when the TTC becomes less than the third threshold value Th3, the steering avoidance feasibility determiner 132 determines whether an object is present in the lateral area extending from slightly in front of the target vehicle TO to the rear on both sides of the target vehicle TO, such as areas A1L and A1R shown in
The second preliminary operation is, for example, an operation of instructing the brake device 210 and/or the traveling drive force output device 200 to first output a braking force that decelerates the vehicle M at a third deceleration B3 and then instructing the brake device 210 and/or the traveling drive force output device 200 to output a braking force that decelerates the vehicle M at a fourth deceleration B4 during a period from when the TTC becomes less than the third threshold value Th3 to when it becomes less than the first threshold value Th1. The third deceleration B3 is, for example, a deceleration smaller (closer to zero) than the second deceleration B2, and the fourth deceleration B4 is a deceleration larger than or approximately the same as the second deceleration and smaller than the first deceleration B1. A timing for switching from the third deceleration B3 to the fourth deceleration B4 may be set arbitrarily.
In this manner, the second preliminary operation is started at an earlier timing than the first preliminary operation, and is performed in multiple stages. As described above, in a situation where steering avoidance is possible, a probability of being able to respond quickly to a sudden change in the surrounding environment of the vehicle is high, and a degree of control margin is relatively high. On the other hand, when there is no avoidance space to the sides of the target object, even if the steering avoidance function is provided, because it is difficult to execute it, the degree of control margin is the same as for a vehicle that can only perform automatic stopping. In other words, in a situation where steering avoidance is difficult, it is preferable to call the attention of the driver of the vehicle M earlier and more effectively than in a situation where steering avoidance is possible. According to the present embodiment, the second preliminary operation is started at an earlier timing than the first preliminary operation and is performed in multiple stages, so that an appropriate preliminary operation can be performed according to the surrounding situation of the target object.
First, the braking controller 110 identifies a target object TO (step S1). Next, the second preliminary operation controller 130 determines whether TTC between the vehicle M and the target object TO is less than the third threshold value Th3 (step S2). When the TTC between the vehicle M and the target object TO is equal to or greater than the third threshold value Th3, the processing returns to step S1.
When it is determined that the TTC between the vehicle M and the target object TO is less than the third threshold value Th3, the steering avoidance feasibility determiner 132 of the second preliminary operation controller 130 determines whether there is a space in which the vehicle M can proceed on the tracks to the sides of the target object TO (step S3).
When it is determined that there is no space in which the vehicle M can proceed on the tracks to the sides of the target object TO, the second preliminary operation controller 130 executes the second preliminary operation (step S4). Next, the second preliminary operation controller 130 determines whether the TTC between the vehicle M and the target object TO has increased to be equal to or greater than the third threshold value Th3 (step S5). When it is determined that the TTC between the vehicle M and the target object TO has increased to be equal to or greater than the third threshold value Th3, the processing returns to step S1.
When it is not determined that the TTC between the vehicle M and the target object TO has increased to be equal to or greater than the third threshold value Th3, the braking controller 110 determines whether the TTC between the vehicle M and the target object TO is less than the first threshold value Th1 (step S6). When it is determined that the TTC between the vehicle M and the target object TO is equal to or greater than the first threshold value Th1, the processing returns to step S3. When a positive determination is obtained in step S3, the second preliminary operation is stopped, and subsequent processing from step S8 is executed. When it is determined that the TTC between the vehicle M and the target object TO is less than the first threshold value Th1, the braking controller 110 outputs a braking force that decelerates the vehicle M at the first deceleration B1 to the brake device 210 and/or the traveling drive force output device 200, thereby decelerating and stopping the vehicle M (step S7). At this time, as described above, steering avoidance may be performed instead of (or in addition to) decelerating and stopping the vehicle M.
When a positive determination is obtained in step S3, that is, when the TTC between the vehicle M and the target object TO is less than the third threshold value Th3 and there is space in which the vehicle M can proceed on the tracks to the sides of the target object TO, the first preliminary operation controller 112 of the braking controller 110 determines whether the TTC between the vehicle M and the target object TO is less than the second threshold value Th2 (step S8). When it is determined that the TTC between the vehicle M and the target object TO is equal to or greater than the second threshold value Th2, the processing returns to step S1.
When it is determined that the TTC between the vehicle M and the target object TO is less than the second threshold value Th2, the first preliminary operation controller 112 executes the first preliminary operation (step S9). Next, the first preliminary operation controller 112 determines whether the TTC between the vehicle M and the target object TO has increased to be equal to or greater than the second threshold value Th2 (step S10). When it is determined that the TTC between the vehicle M and the target object TO has increased to be equal to or greater than the second threshold value Th2, the processing returns to step S1.
When it is not determined that the TTC between the vehicle M and the target object TO has increased to be equal to or greater than the second threshold value Th2, the braking controller 110 determines whether the TTC between the vehicle M and the target object TO is less than the first threshold value Th1 (step S11). When it is determined that the TTC between the vehicle M and the target object TO is equal to or greater than the first threshold value Th1, the processing returns to step S3. When a negative determination is obtained in step S3, the first preliminary operation is stopped, and the subsequent processing from step S4 is executed. When it is determined that the TTC between the vehicle M and the target object TO is less than the first threshold value Th1, the braking controller 110 outputs the first deceleration B1 to the brake device 210 and/or the traveling drive force output device 200 to decelerate and stop the vehicle M (step S7).
According to the embodiment described above, when the degree of proximity between the target object TO and the vehicle M satisfies the third condition, and when it is determined at the time point when the third condition is satisfied that there is no space in which the vehicle can proceed after avoidance by the steering is performed on any of the tracks to the sides of the target object TO, it is possible to perform an appropriate preliminary operation according to a surrounding situation of the target object TO by performing the second preliminary operation, which is started at an earlier timing than the first preliminary operation.
In the embodiment described above, in either the first preliminary operation or the second preliminary operation, instead of outputting a braking force, a display, an audio output, a vibration output, or the like for calling attention may be performed. In this case, examples in which the second preliminary operation is performed in multiple stages include, instead of outputting a braking force in stages while changing a deceleration rate as described above, making an attention level (contrast, brightness, color, or the like) of a first display screen different from that of second and subsequent display screens, making content or a volume of a first audio output different from that of second and subsequent audio outputs, making second and subsequent vibration outputs larger than the first vibration output, and the like.
In the embodiment described above, when a branch road to a destination set in the navigation device 50 is on either a left or right side of a lane in which the vehicle M is traveling, a lane change may be forcibly performed during a preliminary operation. This will result in moving the vehicle M toward the destination, and guiding the vehicle M to a state where there is no object that is a target object near the vehicle M.
The embodiment described above can be expressed as follows.
A driving assistance device includes a storage medium configured to store computer-readable instructions, and a processor connected to the storage medium, in which the processor executing the computer-readable instructions to refer to an output of a detection device that detects presence of objects in front of a vehicle, and performing one or both of instructing a braking device of the vehicle to stop the vehicle when an index value obtained by dividing a distance between a target object among the objects and the vehicle by a relative speed is less than a first threshold value, and instructing a steering device of the vehicle to avoid contact with the target object by steering, perform a first preliminary operation when the index value is less than a second threshold value, and perform a second preliminary operation when the index value is less than a third threshold value, and it is determined that there is no space in which the vehicle can proceed after avoidance by the steering is performed in any of tracks to sides of the target object at a time point when the index value is less than the third threshold value, the first threshold value is smaller than the second threshold value, the second threshold value is smaller than the third threshold value, and both the first preliminary operation and the second preliminary operation are operations of instructing the braking device to output a braking force smaller than a braking force that the braking controller instructs the braking device to output, and the second preliminary operation is an operation of instructing the braking device to output the braking force at an earlier timing than the first preliminary operation.
The above describes a form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within a range not departing from the gist of the present invention.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2022/012569 | 3/18/2022 | WO |
