The present invention relates to a driving assist device for a vehicle.
An automobile industry has recently developed various technologies and equipments to improve the safety of vehicles in order to achieve a safe automobile society.
Japanese Patent Laid-Open Publication No. 2000-251111, for example, discloses a technology of a monitoring control of an object in front of driver's eyes which uses marking. Japanese Patent Laid-Open Publication No. 2002-074594, meanwhile, discloses another technology for a proper indication of a pedestrian in danger of hitting or the like.
The technologies of the above-described publications could not properly make a driver recognize an object (a pedestrian, etc.) in danger of hitting or the like in case the driver's eyes were not directed to the object.
Accordingly, an object of the present invention is to provide a driving assist device for a vehicle which can properly make the driver recognize any object in danger even in case the driver's eyes are not directed to such object.
According to the present invention, there is provided a driving assist device for a vehicle, comprising an object detection device to detect an object to be recognized around the vehicle, an eyes-direction specification device to specify a direction of driver's eyes, and a mark indication device to indicate a mark with a specified shape on a windshield when the object is detected by the object detection device, wherein the mark indication device is configured to indicate the specified-shape mark at a specified portion of the windshield that is located in the direction of the driver's eyes specified by the eyes-direction specification device and then to indicate the specified-shape mark in such a manner that the mark overlaps with the object.
According to the driving assist device for a vehicle of the present invention, when the object (such as a pedestrian or another vehicle in danger of hitting) is detected, the specified-shape mark is indicated at the specified portion of the windshield that is located in the direction of the driver's eyes. Then, the specified-shape mark is changed in indication position in such a manner that the mark finally overlaps with the object. Accordingly, the driver can be made properly recognize the object even in case the driver's eyes are not directed to such object.
According to an embodiment of the present invention, the mark indication device is configured to indicate the specified-shape mark repeatedly in such a manner that the mark indicated repeatedly moves from a position of the driver's-eyes direction specified by the eyes-direction specification device to a position of the object indicated. Thereby, the driver can be made recognize the object surely.
According to another embodiment of the present invention, the mark indication device is configured to continue the repeated indication of the specified-shape mark until a vehicle driver gazes at the object. Thereby, the driver can be made recognize the object surely.
According to another embodiment of the present invention, the mark indication device is configured to change shape of the specified-shape mark to be indicated in accordance with a kind of the object. Thereby, the driver can recognize the kind of the object promptly.
According to another embodiment of the present invention, the mark indication device is configured to change at least one of shape, color and moving speed of the specified-mark to be indicated in accordance with a degree of danger of the object. Thereby, the driver can recognize the kind of the object promptly.
According to another embodiment of the present invention, the object detected by the object detection device is at least one of a pedestrian, another vehicle, a traffic signal, an intersection, and a cross walk. Thereby, any object in danger can be picked up properly.
According to another embodiment of the present invention, in case a plurality of objects are detected by said object detection device, the mark indication device is configured to indicate the specified-shape mark for a plurality of objects in order of priority of indication of objects. Thereby, the driver can be made recognize the particular object having the higher priority promptly.
Other features, aspects, and advantages of the present invention will become apparent from the following description which refers to the accompanying drawings.
Hereinafter, preferred embodiments of the present invention will be described referring to the accompanying drawings.
A system constitution of a driving assist device for a vehicle according to a first embodiment of the present invention is shown in
The camera for object detection 10, which is disposed at a roof front-end portion inside the vehicle or a door mirror, picks up a surrounding image of the vehicle. This camera may be comprised of a single camera or a stereo camera. Any surrounding object of the vehicle can be detected based on the image picked tip by the camera for object detection 10. The object may be detected further based on information from a radar (not illustrated) which is disposed near a front grille of a vehicle front portion. The camera for eyes detection 20, which is disposed at an instrument panel or on a dash board inside the vehicle, picks up an image of a driver's eye in a visible area or an infrared area. A direction of driver's eyes can be detected (specified) by the image picked up by the camera for eyes detection 20. The ECU 30 is comprised of a computer which performs various processing (object picking-up processing 31, eyes-guidance start determination processing 32, guidance-mark indication processing 33, etc.). The windshield display 40 indicates various kind of information, such as images, on a windshield of the vehicle.
Hereinafter, the operation of the above-described driving assist device for a vehicle will be described referring to a flowchart shown in
In step ST100, an initialization processing (for resetting all flags) is executed. Then, respective input processing of sensors (the camera for object detection 10, etc.) is executed in step ST200.
Subsequently, an object picking-up processing is executed in step ST300. A specific processing flow of this object picking-up processing ST300 is shown in
In step ST301, the ECU 30 detects an object from the image picked up by the camera for object detection 10. In the present embodiment, the object detected is set to be a pedestrian, another vehicle, a traffic signal, an intersection, and a cross walk, each shape data of which has been memorized in the ECU 30. Any other object may be set if need be. The ECU 30 detects the object and the kind of the object from the image picked up by using a patter matching processing between the image picked up by the camera for object detection 10 and the above-described memorized shape data. Further, the ECU 30 calculates the distance from the vehicle to the detected object, moving direction and speed of the detected object and the like, based on the image from the camera for object detection 10 and information from the radar.
Next, the ECU 30 determines in step ST302 whether or not there exists any object detected in the step ST301 which is located within a specified distance from the vehicle. When there exists no such object (NO in the determination step ST302), the control sequence proceeds to step ST305, where all flags are reset.
Meanwhile, when there exists such object (YES in the step ST302), the control sequence proceeds to step ST303, where the ECU 30 determines whether or not there exists any new object among the objects which have been detected to be located within the specified distance in the step ST302.
When there exists such new object (YES in the determination step ST303), the control sequence proceeds to step ST304, where the ECU 30 puts a priority to the object based on a priority (degree of danger) determination table shown in
Thus, the object picking-up processing ST300 is executed. Subsequently, an eyes-guidance start determination processing is executed in step ST400 shown in
First, the ECU 30 determines in step ST401 whether or not there exists any object for the eyes-guidance start determination processing. When there exists no such object (NO in the determination step ST401), the control sequence proceeds to step ST406, where an eyes-guidance indication flag is set to 0, thereby ending eyes-guidance processing.
Meanwhile, when there exists such object (YES in the step ST401), the control sequence proceeds to step ST402, where the ECU 30 selects a specified object having the highest priority from the objects detected in the step ST302 and calculates the direction of location of this object when seen from the vehicle.
Then, the ECU 30 in step ST403 detects the eyes-direction of the driver in the vehicle. The eyes-direction may be detected directly by the eyes detection sensor (camera for eyes detection 20), or predicted by detecting the direction of a driver's head with a camera located in the vehicle (not illustrated).
In step ST404, the ECU 30 determines whether or not the direction of the object detected in the step ST402 and the eyes-direction calculated in the step ST403 are located within a specified range so that they can be considered to be an identical direction. For example, an angle α between the eyes-direction (vector) and the object direction (vector) is smaller than a specified angle β, it is determined that “they are the identical direction.” To the contrary, the angle α is greater than the specified angle β, it is determined that “they are not the identical direction.”
When it is determined in the step ST404 that “they are the identical direction (YES in the determination step ST404),” the control sequence proceeds to step ST406, where the ECU 30 sets the eyes guidance indication flag to 0, thereby ending the eyes-guidance processing.
Meanwhile, when it is determined in the step ST404 that “they are not the identical direction (NO in the step ST404),” the control sequence proceeds to step ST405, where the ECU 30 sets the eyes guidance indication flag to 1, thereby starting the eyes-guidance processing.
Thus, the eyes-guidance start determination processing ST400 is executed. Subsequently, a guidance-mark indication processing is executed in step ST500 shown in
The ECU 30 determines in step ST501 whether there exists any object for the guidance-mark indication processing or not.
When there exists no such object (NO in the determination step ST501), the control sequence proceeds to step ST511, where the ECU 30 sets the guidance mark to non-indication, thereby ending the eyes-guidance processing. Meanwhile, when there exists such object (YES in the step ST501), the control sequence proceeds to step ST502, where the ECU 30 checks the eyes-guidance indication flag. When the eyes-guidance indication flag is 1, it proceeds to step ST503. When the eyes-guidance indication flag is 0, it proceeds to step ST510.
When the eyes-guidance indication flag is 1, the ECU 30 in the step ST503 obtains an eye-point position (A0) of the driver in the indication area on the windshield by the windshield display 40 based on the eyes direction calculated in the step ST403. Also, the ECU 30 obtains the position (A1) of the object having the highest priority in the indication area on the windshield by the windshield display 40 based on the direction of the object having the highest priority calculated in the step ST402. And, the ECU 30 calculates a line (L) that interconnects the eye-point position (A0) and the object's position (A1) with the shortest distance as shown in
Then, the ECU 30 divides the above-described line (L) by a specified distance (ΔL) in step ST504. The value of ΔL depends on the degree of danger (priority) of the object so that the higher the degree of danger (priority) is, the greater the value of ΔL.
Next, the ECU 30 sets A to A0, N to 0, respectively (ST505), and conducts a calculation of A=A0+N×ΔL (ST506).
The ECU 30 in step ST507 commands the windshield display 40 to indicate the guidance mark at the position A which was obtained in the step ST506 for a specified time. In response to this, the windshield display 40 indicates the guidance mark at a position corresponding to the above-described position A in the indication area on the windshield for a specified time. Accordingly, at first the guidance mark is indicated for the specified time at the driver's eye-point position (A0). Herein, the specified time may be set to 1-2 seconds, for example. Also, as shown in
Next, the ECU 30 lets N to be increment (ST508), then determines whether A1>A0+N×ΔL is met or not (ST509). This determination is the one as to whether the next-time indication position of the guidance mark A (=A0+N×ΔL) has reached to the indication position A1 of the object or not.
When it is determined that A1>A0+N×ΔL is not met (NO in the step ST509), the processing of the steps ST506-ST508 are executed again. In this case, N has been increment, so the guidance mark is indicated at a position (A) which is closer to the object by ΔL than the previous indicated position (see
Through repeated processing of the steps ST506-ST509, the guidance mark originally indicated at the driver's eye-point position (A0) on the windshield is changed in indication position gradually by the specified distance (ΔL) toward the object's position (A1) (see
Meanwhile it is determined that A1>A0+N×ΔL is met (YES in the step ST509), the control sequence proceeds to step ST510, where the ECU 30 commands the windshield display 40 to indicate the guidance mark at the object's position (A1). In response to this, the windshield display 40 indicates the guidance mark at a position corresponding to the object's position (A1) in the indication area on the windshield (see
According to the above-described guidance-mark indication processing ST500, the guidance mark is indicated at the driver's eye-point position (A0) on the windshield first, then the indication position of the guidance mark is changed by the specified distance (ΔL) toward the object's position (A1), and finally the guidance mark is indicated at the object's position (A1) so as to overlap with it (see
According to the present embodiment, when the object (pedestrian, another vehicle in danger of hitting or the like) is detected, the guidance mark is indicated at the specified portion of the windshield that is located in the direction of the driver's eyes. Then, the guidance mark is changed in indication position in such a manner that the guidance mark overlaps with the object finally. Accordingly, the driver can be made properly recognize the object even in case the driver's eyes are not directed to such object.
Further, according to the present embodiment, the sensor input processing ST200, the object picking-up processing ST300, the eyes-guidance start determination processing ST400, and the guidance-mark indication processing ST500 are repeated as shown in
The above-described first embodiment shows the example in which only one object having the highest priority is selected from the objects detected, and the indication of the guidance mark is conducted for this object. However, a plurality of objects may be selected and the indication of the guidance mark may be conducted for the objects in order of priority (degree of danger). Hereinafter, this example in which two objected are selected will be described.
The whole processing is substantially the same as the one of the first embodiment shown in
The concrete processing flow of the eyes-guidance start determination processing ST400 of the present embodiment is shown in
First, the ECU 30 determines in step ST411 whether or not there exists any object for the eyes-guidance start determination processing. When there exists no such object (NO in the determination step ST411), the control sequence proceeds to step ST416, where an eyes-guidance indication flag is set to 0, thereby ending eyes-guidance processing.
Meanwhile, when there exists such object (YES in the step ST411), the control sequence proceeds to step ST412, where the ECU 30 selects an object having the highest priority and another object having the second highest priority from the objects detected in the step ST302 and calculates respective directions of location of these two objects when seen from the vehicle.
Then, the ECU 30 in step ST413 detects the eyes-direction of the driver of the vehicle. The eyes-direction may be detected directly by the eyes detection sensor (camera for eyes detection 20), or predicted by detecting the direction of the driver's head with the camera located in the vehicle compartment (not illustrated).
In step ST414, the ECU 30 determines whether or not the driver's eyes direction has become identical to the directions of these two objects at least one time.
When it is determined in the step ST414 that “it has become identical” (YES in the determination step ST414),” the control sequence proceeds to step ST416, where the ECU 30 sets the eyes guidance indication flag to 0, thereby ending the eyes-guidance processing.
Meanwhile, when it is determined in the step ST404 that “it has not become identical” (NO in the step ST414), the control sequence proceeds to step ST415, where the ECU 30 sets the eyes guidance indication flag to 1, thereby starting the eyes-guidance processing.
Thus, the eyes-guidance start determination processing ST400 is executed. Subsequently, the guidance-mark indication processing is executed in step ST500 shown in
First, the ECU 30 determines in step ST521 whether there exists any object for the guidance-mark indication processing or not.
When there exists no such object (NO in the step ST521), the control sequence proceeds to step ST531, where the ECU 30 sets the guidance mark to non-indication. Meanwhile, when there exists such object (YES in the step ST521), it proceeds to step ST522, where the ECU 30 checks the eyes-guidance indication flag. When this flag is 1, it proceeds to step ST523. When this flag is 0, it proceeds to step ST530.
When the eyes-guidance indication flag is 1, the ECU 30 in the step ST523 obtains the eye-point position (A0) of the driver in the indication area on the windshield by the windshield display 40 based on the eyes direction calculated in the step ST413. Also, the ECU 30 obtains respective positions (A1, A2) of the two objects in the indication area on the windshield by the windshield display 40 based on the directions of the two objects calculated in the step ST412. Herein, the two objects are set to a pedestrian and another vehicle, the pedestrian having the highest priority. The position of the pedestrian is set to A1, and the position of the vehicle is set to A2. And, the ECU 30 calculates a line (L) that interconnects the eye-point position (A0), the object's position (A1), and the object's position (A2) in order of priority with the shortest distance, as shown in
Then, the ECU 30 divides the above-described line (L) by a specified distance (ΔL) in step ST524. The value of ΔL depends on the degree of danger (priority) of the object so that the higher the degree of danger (priority) is, the greater the value of ΔL.
Next, the ECU 30 sets A to A0, N to 0, respectively (ST525), and conducts a calculation of A=A0+N×ΔL (ST526).
The ECU 30 in step ST527 commands the windshield display 40 to indicate the guidance mark at the position A obtained in the step ST506 for a specified time. In response to this, the windshield display 40 indicates the guidance mark at a position corresponding to the above-described position A in the indication area on the windshield for a specified time. Accordingly, at first the guidance mark is indicated for the specified time at the driver's eye-point position (A0). Herein, the specified time may be set to 1-2 seconds, for example. Also, as shown in
Next, the ECU 30 lets N to be increment (ST528), then determines whether A2>A0+N×ΔL is met or not (ST529). This determination is the one as to whether the next-time indication position of the guidance mark A (=A0+N×ΔL) has reached to the indication position (A2) of the object or not.
When it is determined that A2>A0+N×ΔL is not met (NO in the step ST529), the processing of the steps ST526-ST528 are executed again. In this case, N has been increment, so the guidance mark is indicated at a position (A) which is closer to the object by ΔL than the previous indicated position (see
Through repeated processing of the steps ST526-ST529, the guidance mark originally indicated at the driver's eye-point position (A0) on the windshield is changed in indication position gradually by the specified distance (ΔL) toward the object's position (A1), and then it is changed in indication position gradually by the specified distance (ΔL) from the object's position (A1) toward the object's position (A1) (see
Meanwhile it is determined that A2>A0+N×ΔL is met (YES in the step ST529), the control sequence proceeds to step ST530, where the ECU 30 commands the windshield display 40 to indicate the guidance mark at the object's position (A2). In response to this, the windshield display 40 indicates the guidance mark at a position corresponding to the object's position (A2) in the indication area on the windshield (see
According to the above-described guidance-mark indication processing ST500, the guidance mark is indicated at the driver's eye-point position (A0) on the windshield first, then the indication position of the guidance mark is changed by the specified distance (ΔL) toward the object's position (A1), subsequently the indication position of the guidance mark is changed by the specified distance (ΔL) from the object's position (A1) toward the object's position (A2), and finally the guidance mark is indicated at the object's position (A2) (see
Further, according to the present embodiment, the sensor input processing ST200, the object picking-up processing ST300, the eyes-guidance start determination processing ST400, and the guidance-mark indication processing ST500 are repeated as shown in
The present invention should not be limited to the above-described embodiments, and any other modifications and improvements may be applied within the scope of a sprit of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
2007-219473 | Aug 2007 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
5457439 | Kuhn | Oct 1995 | A |
7734419 | Kondoh | Jun 2010 | B2 |
20040193331 | Kashiwada et al. | Sep 2004 | A1 |
20060164219 | Knoll | Jul 2006 | A1 |
20070076526 | Aikyo et al. | Apr 2007 | A1 |
20070106475 | Kondoh | May 2007 | A1 |
20070210906 | Knoll et al. | Sep 2007 | A1 |
20080122939 | Hirai | May 2008 | A1 |
20090303078 | Mochizuki et al. | Dec 2009 | A1 |
Number | Date | Country |
---|---|---|
10253510 | May 2004 | DE |
102006012773 | Nov 2006 | DE |
102005042912 | Mar 2007 | DE |
1783531 | May 2007 | EP |
2002-074594 | Mar 2002 | JP |
2002074594 | Mar 2002 | JP |
2005-0251111 | Sep 2005 | JP |
Number | Date | Country | |
---|---|---|---|
20090058678 A1 | Mar 2009 | US |