This application is a National Stage of International Application No. PCT/JP2010/072973 filed Dec. 21, 2010, claiming priority based on Japanese Patent Application No. 2010-009246 filed Jan. 19, 2010, the contents of all of which are incorporated herein by reference in their entirety.
The present invention relates to a vehicle periphery monitoring device for highlight-displaying an obstacle on a monitor device mounted in the interior of a vehicle for calling the driver's attention.
A conventional example of this type of device is disclosed in Patent Document 1. This device is designed to extract an obstacle present around a vehicle based on a signal obtained from a photographing device for photographing the surroundings of the vehicle and to display the obstacle on a display device. The way of displaying the obstacle is changed depending on a degree of risk determined by an attribute or a moving direction of the obstacle to allow the driver to recognize a positional relationship between their vehicle and the obstacle or a degree of the risk.
A vehicle peripheral information monitoring device disclosed in Patent Document 2 is designed to display an obstacle detected by vehicle peripheral object detection means on a predetermined schematic pictorial display along with risk-degree information. In this vehicle peripheral information monitoring device, a perspective display level of a basic picture showing the situation around the vehicle representing a background in displaying the obstacle is determined thereby to allow the driver to easily grasp the situation around the vehicle.
Patent Document 1: Japanese Unexamined Patent Application Publication No. 2009-40108
Patent Document 2: Japanese Unexamined Patent Application Publication No. 7-223488
Both of Patent Document 1 and Patent Document 2 employ a system for displaying the obstacle affixed with the information relating to the degree of risk. Thus, if plural obstacles are present in a target area, excessive information is displayed on a monitoring screen at once, which may make it difficult for the driver to quickly grasp the situation around the vehicle. Further, since the degree of risk is determined also taking into consideration factors other than the distance between the vehicle and the obstacle such as the attribute or moving direction of the obstacle, the driver may have difficulty in having a sense of distance to the obstacle displayed on the monitoring screen. In addition, it would be difficult for the driver to intuitively determine whether or not the obstacle can be avoided by a steering operation simply by superimposing the obstacle on the surrounding image.
If the driver pays close attention to the monitoring screen excessively in order to obtain a variety of information, they may be distracted from their driving or lose their concentration on their driving, which may enhance the risk of inducing accidents. Therefore, it is not preferable to display excessive information on the monitoring screen. On the other hand, it is necessary to allow the driver to positively have the sense of distance between their vehicle and the obstacle in order to avoid contact between the vehicle and the obstacle. The present invention has been made having regard to the above disadvantages, and its object is to provide the vehicle periphery monitoring device in which information displayed on the monitor device is not excessive to allow the driver to intuitively have the sense of distance between their vehicle and the obstacle.
A first characteristic feature of a vehicle periphery monitoring device according to the present invention lies in comprising an image acquisition unit for obtaining a surrounding image of a vehicle captured by a photographing device mounted on the vehicle, an obstacle detection unit for detecting an obstacle present around the vehicle and its position, a traveling state detection unit for detecting a traveling state of the vehicle, a predicted path line generation unit for generating a predicted path line based on the traveling state of the vehicle detected at the traveling state detection unit, a highlighted display determination unit for determining highlighted display of a partial area including the obstacle of a predicted path area when the obstacle is present within the predicted path area defined by the predicted path line, and a display control unit for superimposing the predicted path line and the highlighted display on the surrounding image and displaying the superimposed image on a monitor device mounted in the interior of the vehicle.
With the first characteristic feature, the area that is highlight displayed to include the obstacle is part of the predicted path area defined by the predicted path line, which allows the driver to easily and intuitively have the sense of distance between their vehicle and the obstacle by referring to the predicted path line. Further, the obstacle per se is not highlight displayed individually, but the area including the obstacle is highlight displayed, which can avoid troublesomeness associated with the highlighted display for each obstacle when a number of obstacles are present. Further, when the obstacle is small and difficult to visually confirm on the monitoring screen, the area including the obstacle is highlight displayed and thus the driver may easily recognize the presence of the obstacle.
A second characteristic feature of the present invention lies in that the highlighted display is provided for each of a plurality of partial areas divided from the predicted path area at least in a perspective direction in advance.
With the second characteristic feature, the highlighted display is provided for each of the partial areas divided in the perspective direction, which allows the driver to easily have the sense of distance between their vehicle and the highlight displayed area. Therefore, the driver may easily grasp the distance to the obstacle and easily perform an operation to avoid the obstacle.
A third characteristic feature of the present invention lies in that the display control unit is configured to provide a side surface portion in a side of the predicted path line near the photographing device in display.
With the third characteristic feature, since the predicted path line is expressed in three dimensions, the driver may easily have the sense of distance between their vehicle and the obstacle by referring to the predicted path line.
A fourth characteristic feature of the present invention lies in that the display control unit is configured to provide a shaded portion in the side of the predicted path line near the photographing device in display.
With the fourth characteristic feature, since the predicted path line is expressed in three dimensions, the driver may easily have the sense of distance between their vehicle and the obstacle by referring to the predicted path line.
A fifth characteristic feature of the present invention lies in that the highlighted display is provided by coloring in the partial area.
When the highlighted display is provided by coloring in the partial area as in the fifth characteristic feature, the driver may easily recognize the highlighted display, which can reduce the risk of missing the obstacle.
A sixth characteristic feature of the present invention lies in that the colored-in partial area is semitransparent.
When the colored-in partial area is semitransparent as in the sixth characteristic feature, the surrounding image representing the background of the highlighted display may also be seen through. Thus, it is possible to recognize the obstacle that is actually present on the display device in addition to the highlighted display. As a result, the driver may easily grasp the positional relationship between their vehicle and the obstacle and easily perform the operation for avoiding the obstacle.
A seventh characteristic feature of the present invention lies in that a color used in coloring in the partial area is changed depending on a distance between the vehicle and the obstacle.
With the seventh characteristic feature, the driver may easily intuitively have the sense of distance between their vehicle an the obstacle if red bearing a cautionary implication is used for the partial area positioned closer to the vehicle, while green or blue is used for the partial area positioned further from the vehicle, for example.
A eighth characteristic feature of the present invention lies in that the predicted path line is linked to steering of a steering wheel.
With the eighth characteristic feature, the predicted path area defined by the predicted path line is also linked to the steering of the steering wheel. Thus, even when another obstacle is included in the predicted path area by steering the steering wheel, the partial area including the obstacle is highlight displayed to allow the driver to easily recognize the presence of the new obstacle. Further, the predicted path area is moved in response to the steering of the steering wheel, which facilitates the operation for avoiding the obstacle.
A ninth characteristic feature of the present invention lies in that the device is configured to highlight-display the obstacle relatively approaching the predicted path area.
With the ninth characteristic feature, the driver may easily recognize the presence of the obstacle when the obstacle is relatively approaching the predicted path area in response to the operation of the vehicle or the movement of the obstacle, as a result of which the obstacle may easily be avoided.
An embodiment of a vehicle periphery monitoring device according to the present invention will be described hereinafter in reference to
An acceleration pedal 26 for controlling running speed and a brake pedal 27 for applying a braking force to the front wheels 28f and rear wheels 28r through a brake unit 31 are juxtaposed with each other in the vicinity of the driver's seat. A monitor 20 (display device) is mounted on a portion above a console provided adjacent to the driver's seat. If the vehicle 30 is provided with a parking assist system or a car navigation system, the monitor 20 may be used as the display device for those systems as well.
An operational system for the steering wheel 24 includes a steering sensor 14 for measuring a steering direction and an operational amount of the steering wheel 24. An operational system for a shift lever 25 includes a shift position sensor 15 for detecting a shift position. Further, an acceleration sensor 16 is provided in an operational system for the acceleration pedal 26 and a brake sensor 17 is provided in an operational system for the brake pedal 27, respectively, for measuring an operational amount of the pedal. Moreover, a wheel speed sensor 18 is provided in the vicinity of each of the rear wheels 28r for measuring a rotational amount of the rear wheels 28r. It should be noted that the arrangements of those sensors are not limited to the above arrangements, but may be any other arrangements as long as substantially the same measurements are obtained.
A camera 12 (photographing device) is provided in a central part of a rear portion of the vehicle 30 for capturing a surrounding image rearwardly of the vehicle 30. The surrounding image captured by the camera 12 is displayed on the monitor 20. A sonar 13 is provided in each of lateral opposite ends of the rear portion of the vehicle 30 for detecting an obstacle that is present rearwardly of the vehicle and measuring a distance between the vehicle and the obstacle. Further, the vehicle 30 is equipped with an ECU (electronic control unit) 10 acting as a core of the vehicle periphery monitoring device of the present invention.
A traveling state detection unit 6 is a functional unit for detecting a traveling state such as a speed or traveling direction of the vehicle 30, and includes the steering sensor 14, shift position sensor 15, acceleration sensor 16, brake sensor 17 and wheel speed sensor 18. The arrangement of the traveling state detection unit 6 is not limited to the above arrangement, but may have part of the above sensors or may have any other sensor.
The image acquisition unit 1 is a functional unit for obtaining the surrounding image of the vehicle 30 captured by the camera 12. The obstacle detection unit 2 is a functional unit for detecting an obstacle present around the vehicle 30 and its position based on the surrounding image obtained at the image acquisition unit 1 and a signal from the sonar 13. It should be noted that it is not necessarily required to use both of the surrounding image obtained at the image acquisition unit 1 and the signal from the sonar 13, but only one of them may be used in detecting the obstacle and its position at the obstacle detection unit 2.
The predicted path line generation unit 4 is a functional unit for generating a locus (referred to as “predicted path line” hereinafter) of the vehicle 30 predictable from the traveling state detected at the traveling state detection unit 6. The highlighted display determination unit 3 is a functional unit for highlight-displaying part of a predicted path area including the obstacle defined by the predicted path line generated at the predicted path line generation unit 4 when the position of the obstacle detected at the obstacle detection unit 2 is included in the predicted path area. The predicted path line, predicted path area and highlighted display will be described later.
The display control unit 5 is a functional unit for superimposing the surrounding image of the vehicle 30 obtained at the image acquisition unit 1, the predicted path line generated at the predicted path line generation unit 4 and the highlighted display determined at the highlighted display determination unit 3 and for displaying the superimposed image on the monitor 20 mounted in the interior of the vehicle.
The predicted path line 40 consists of a right and left pair of predicted locus lines 41 each showing a predicted locus of the vehicle 30 and distance mark lines 42, 43 and 44. In the current embodiment, the distance mark lines 42, 43 and 44 indicate positions of 0.5 m, 1.0 m and 2.2 m from a rear end of the vehicle 30, respectively. The predicted path line 40 is depicted in yellow basically, while the distance mark line 42 and part of the predicted locus line 41 positioned nearer to the vehicle 30 than the mark line 42 are displayed in red in order to call the driver's attention. It should be noted that the color of the predicted path line 40 and the number or positions of the distant mark lines are not limited to the above example. Further, the predicted path line 40 may be shown in dotted line, dashed line or chain line, instead of solid line.
The predicted locus line 41 consists of a main line portion 41a, a side surface portion 41b and a shaded portion 41c. The side surface portion 41b and shaded portion 41c are provided inwardly of the main line portion 41a in a width direction of the vehicle. Similarly, each of the distance mark lines 42, 43 and 44 consists of a main line portion 42a, 43a or 44a, a side surface portion 42b, 43b or 44b and a shaded portion 42c, 43c or 44c provided adjacent to the vehicle 30. The predicted path line 40 is displayed in three dimensions by providing the side surface portions 41b, 42b, 43b and 44b and the shaded portions 41c, 42c, 43c and 44c in this way, which allows the driver to easily and intuitively have a sense of distance to the obstacle.
The predicted path line 40 varies in response to the traveling state detected at the traveling state detection unit 6. For example, when the steering wheel 24 is steered, the predicted path line 40 is correspondingly moved sideways on the monitor 20. An area contoured by the right and left locus lines 41 and the distant mark line 44 positioned farthest from the vehicle 30 of the predicted path line 40 is defined as the predicted path area 50. When the obstacle is present in the predicted path area 50, part of the area including the obstacle is highlight displayed. In the current embodiment, it is determined whether or not the predicted path area 50 divided into three partial areas 51, 52 or 53 by the distance mark lines 42 and 43 in a perspective direction is highlight displayed in each partial area.
Since each of the partial areas 51, 52 and 53 to be highlight displayed is part of the predicted path area 50 defined by the predicted path line 40, the driver may easily and intuitively have the sense of distance between their vehicle and the obstacle when referring to the predicted path line 40. Further, the predicted path line 40 displayed on the monitor 20 is linked to steering of the steering wheel 24, as a result of which the driver may easily determine whether or not the obstacle can be avoided by steering the steering wheel 24.
When a relatively small obstacle such as an obstacle 62 shown in
When the highlighted display is provided by coloring in the partial area in which the obstacle is present as in the current embodiment, a range to be highlight displayed becomes broader than the case for highlight-displaying the obstacle per se. As a result, the driver may easily recognize the presence of the obstacle on the monitor 20. Further, when the partial area 51 positioned nearest to the vehicle 30 is colored in red bearing a cautionary implication, the partial area 53 positioned farthest from the vehicle 30 is colored in green bearing a less cautionary implication, and the intermediate partial area 52 is colored in yellow as the above, the driver can intuitively have the sense of distance between their vehicle and the obstacle more easily. Further, since the surrounding image obtained at the image acquisition unit 1 is also displayed on the monitor 20, such a surrounding image is visible as a background of the colored area if the colored-in area is semitransparent. Consequently, the driver can recognize any obstacle present reflected in the surrounding image and easily perform an operation to avoid the obstacle.
With the vehicle 30 having the parking assist system, the predicted path line 40 may also act as a guide line displayed for parking assist. Using the predicted path line 40 versatilely in this manner enables the driver to become familiar with the predicted path line 40 and easily have the sense of distance in the highlight-displayed area in reference to the predicted path line 40.
Modified embodiments of the vehicle periphery monitoring device according to the present invention will be described hereinafter in reference to
Provided the predicted path line 40 is also included in the predicted path area 50, it is possible to highlight-display a sectional area 56 of the predicted path line 40 as shown in
Alternatively, in coloring in the target area in each of the above embodiments, the contour of the obstacle may be detected through image processing, for example, so as not to color in the inside of the contour. It is also possible to frame the obstacle as shown in
As other modifications, the predicted path area 50 may be divided in the lateral direction (width direction of the vehicle), or the predicted path line 40 may not necessarily be linked to the steering of the steering wheel 24, but may be fixed in position at a certain point. It is also possible to provide the vehicle periphery monitoring device for allowing the driver to intuitively have the sense of distance between the vehicle 30 and the obstacle that is present forwardly of the vehicle 30 with the camera 12 and sonar 13 being mounted on the front side of the vehicle 30. Further, it is possible to provide the vehicle periphery monitoring device for allowing the driver to intuitively have the sense of distance between the vehicle 30 and the obstacle that is present on a lateral side of the vehicle 30 with the camera 12 and sonar 13 being mounted on at least one of the lateral sides of the vehicle 30.
When the obstacle is included in the predicted path area 50, it is also possible to give a warning beep through a speaker provided in the interior of the vehicle or generate vibration on the steering wheel 24, in addition to the visual highlighted display. In that case, it is preferable that the warning beep or the vibration on the steering wheel 24 is varied in stages to allow the driver to intuitively have the sense of distance to the obstacle.
The present invention is applicable to a vehicle periphery monitoring device for highlight-displaying an obstacle on a monitor device mounted in the interior of a vehicle to call the driver's attention.
Number | Date | Country | Kind |
---|---|---|---|
2010-009246 | Jan 2010 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2010/072973 | 12/21/2010 | WO | 00 | 6/14/2012 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2011/089812 | 7/28/2011 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20080231702 | Matsumoto et al. | Sep 2008 | A1 |
20110181724 | Kadowaki et al. | Jul 2011 | A1 |
Number | Date | Country |
---|---|---|
7-223488 | Aug 1995 | JP |
10-117340 | May 1998 | JP |
2000-177513 | Jun 2000 | JP |
2000177513 | Jun 2000 | JP |
2002-29346 | Jan 2002 | JP |
2004-203068 | Jul 2004 | JP |
2004203068 | Jul 2004 | JP |
2009-40108 | Feb 2009 | JP |
2009-265803 | Nov 2009 | JP |
2009-292457 | Dec 2009 | JP |
2009292457 | Dec 2009 | JP |
Entry |
---|
EPO translation to JP 2000-177513A. |
EPO translation to JP 2009-292457A. |
EPO translation to JP 2004-203068A. |
International Search Report for PCT/JP2010/072973 dated Apr. 5, 2011. |
English Translation of International Preliminary Report on Patentability for PCT/JP2010/072973 dated Aug. 16, 2012. |
Number | Date | Country | |
---|---|---|---|
20120296523 A1 | Nov 2012 | US |