The present application claims priority from Japanese Patent Application No. 2017-046049 filed on Mar. 10, 2017, the entire contents of which are hereby incorporated by reference.
The technology relates to an image display device that displays an image on a road surface.
A device has been known that depicts figures or other geometrical shapes on a road surface, by a light-distribution control of headlights or other lights of a vehicle.
For example, Japanese Unexamined Patent Application Publication (JP-A) No. 2009-149152 describes a light drive unit that controls a light-distribution control unit of lights, to indicate a direction of a person who is estimated to be in danger, and a distance to the person, by a low-luminance region. The low-luminance region is a part whose luminance is lowered, out of a region of the road surface illuminated with light.
Regarding an image display device that displays an image on a road surface, there is a request for ability to notify a pedestrian of a safety level of a vehicle.
It is desirable to provide an image display device that makes it possible to notify a pedestrian of a safety level of a vehicle.
An aspect of the technology provides an image display device including an illuminator and a detector. The illuminator is configured to send out light on a road surface frontward of a vehicle, to display an image on the road surface. The detector is configured to detect a pedestrian frontward of the vehicle. The illuminator is configured to cause a notification image to be on chronologically-changeable display on the road surface. The notification image notifies information to the pedestrian detected by the detector.
An aspect of the technology provides an image display device including an illuminator, a detector, and circuitry. The illuminator is configured to send out light on a road surface frontward of a vehicle, to display an image on the road surface. The detector is configured to detect a pedestrian frontward of the vehicle. The circuitry is configured to control the illuminator to cause a notification image to be on chronologically-changeable display on the road surface. The notification image notifies information to the pedestrian detected by the detector.
Some implementations of the technology are described below as mere examples with reference to the accompanying drawings.
In the following, some implementations of the technology are described in detail with reference to the drawings. The implementations described below each illustrate one example of the technology, and are not intended to limit the contents of the technology. All of the configurations and the operation described in each implementation are not necessarily essential for configurations and operation of the technology. It is to be noted that like constituent elements are denoted by the same reference characters, and description thereof is omitted to avoid redundancy.
The image display device 10 may be a device that is mounted on the vehicle 1, and displays an image on a road surface R around the vehicle 1. The image display device 10 may be a device that displays the image on the road surface R, and thereby notifies information to a surrounding entity around the vehicle 1. The term “surrounding entity” means a surrounding vehicle different from the vehicle 1, or a pedestrian. The term “pedestrian” means a person who passes along a sidewalk, and a person who passes along or crosses a driveway, inclusive of a person who rides a bicycle. The image to be displayed on the road surface R by the image display device 10 to notify the information to the surrounding entity around the vehicle 1 is also called a “notification image”. Moreover, processing to be performed by the image display device 10 to display the notification image G on the road surface R is also called “image display processing”.
In particular, as illustrated in
The image display device 10 may include an illuminator 20, a detector 30, and a controller 50.
The illuminator 20 may be a device that sends out light on the road surface R frontward of the vehicle 1. The image to be displayed on the road surface R by the image display device 10 may be depicted by the light sent out by the illuminator 20. In other words, the illuminator 20 may be able to send out the light on the road surface R frontward of the vehicle 1, to display the image on the road surface R. The illuminator 20 may include various light sources such as a lamp, a light emitting diode (LED), a digital micro mirror device, and a projector. The illuminator 20 may include headlights of the vehicle 1. In one preferred but non-limiting example, the illuminator 20 may include light-distribution-variable headlights such as adaptive driving beam (ADB).
The detector 30 may be a sensor that detects surroundings of the vehicle 1. The detector 30 may include one or more cameras. The detector 30 may include a combination of a camera and, for example, radar. The term “surroundings of the vehicle 1” means road environment of a road on which the vehicle 1 is located. Non-limiting examples of the road environment to be detected by the detector 30 may include roads, pedestrians, vehicles, road markings, road signs, traffic lights, intersections, railway crossings, footbridges, street lamps, buildings, and equipment.
In particular, the detector 30 may be able to detect the pedestrian W frontward of the vehicle 1. In one specific but non-limiting example, the detector 30 may detect, in real time, a pedestrian position of the pedestrian W who crosses the driveway on which the vehicle 1 travels, and a pedestrian direction of the pedestrian W. The detector 30 may supply the controller 50 with information regarding the pedestrian position detected, and with information regarding the pedestrian direction detected. It is to be noted that the pedestrian direction means a direction of movement of the pedestrian W in a case where the pedestrian W is moving. In a case where the pedestrian W is standing still, the pedestrian direction means a direction to which the face of the pedestrian W is turned.
The controller 50 may be a control unit that controls image display on the road surface R by the image display device 10. The controller 50 may be a control unit that controls the illuminator 20 on the basis of the information outputted from the detector 30. The controller 50 may include an electronic control unit (ECU) that synthetically controls constituent elements included in the image display device 10.
The controller 50 may include a calculation unit 51, an evaluation unit 52, and a display control unit 55.
The calculation unit 51 may have a function of calculating a distance from the pedestrian W detected by the detector 30 to the vehicle 1. In one specific but non-limiting example, the calculation unit 51 may calculate a distance from the pedestrian position detected by the detector 30 to a position of the vehicle 1. The calculation unit 51 may supply a calculation result to the evaluation unit 52.
The evaluation unit 52 may have a function of evaluating a safety level of the vehicle 1 with respect to the pedestrian W. In one specific but non-limiting example, the evaluation unit 52 may evaluate the safety level of the vehicle 1 with respect to the pedestrian W, on the basis of the distance from the pedestrian W to the vehicle 1 calculated by the calculation unit 51, and on the basis of a speed of the vehicle 1. The safety level of the vehicle 1 with respect to the pedestrian W may be an index that indicates what degree of safety the vehicle 1 has with respect to the pedestrian W. The speed of the vehicle 1 may be measured by a measurer 5. The measurer 5 may be provided in advance in the vehicle 1, and measure a traveling speed of the vehicle 1. Alternatively, the speed of the vehicle 1 may be measured by analyzing images acquired by the detector 30.
In particular, the evaluation unit 52 may evaluate, as the safety level as mentioned above, arrival time it takes for the vehicle 1 to arrive at the pedestrian position detected by the detector 30. The evaluation unit 52 may be able to estimate the arrival time by dividing the distance from the pedestrian W to the vehicle 1 calculated by the calculation unit 51, by the speed of the vehicle 1 measured. The evaluation unit 52 may supply the display control unit 55 with information regarding the arrival time estimated. Notifying the pedestrian W of the arrival time makes it possible for the pedestrian W to quantitatively recognize the safety level of the vehicle 1 with respect to the pedestrian W. Accordingly, the evaluation of the arrival time as the safety level as mentioned above is effective, in terms of protection of safety of the pedestrian W.
Furthermore, the evaluation unit 52 may evaluate the safety level of the vehicle 1 with respect to the pedestrian W, not only from a viewpoint of the arrival time but also from another viewpoint. In one specific but non-limiting example, the evaluation unit 52 may evaluate the safety level, by focusing not only on the arrival time but also on a state of the pedestrian position and the pedestrian direction.
For example, as illustrated in
Moreover, the evaluation unit 52 may evaluate the safety level highly, in a case where the pedestrian direction detected by the detector 30 is a receding direction from the vehicle 1. The evaluation unit 52 may evaluate the safety level lowly, in a case where the pedestrian direction detected by the detector 30 is an approaching direction with respect to the vehicle 1. Furthermore, the evaluation unit 52 may evaluate the safety level highly, in a case where the pedestrian direction detected by the detector 30 is a receding direction from the driveway on which the vehicle 1 travels. The evaluation unit 52 may evaluate the safety level lowly, in a case where the pedestrian direction detected by the detector 30 is an approaching direction with respect to the driveway.
The display control unit 55 may have a function of performing a display control of the notification image G on the road surface R. The display control unit 55 may control the illuminator 20 to cause the notification image G to be on chronologically-changeable display on the road surface R in accordance with a change in the safety level. The notification image G may be notified to the pedestrian W. In one specific but non-limiting example, the display control unit 55 may set, as the notification image G, a count-down image of the arrival time acquired by the evaluation unit 52. The display control unit 55 may control the illuminator 20 to cause the count-down image of the arrival time set as the notification image G to be displayed in a region of the road surface R near the pedestrian W. At this occasion, the display control unit 55 may control the illuminator 20 to cause the notification image G to be on movable display on the road surface R following a change in the pedestrian position and a change in the pedestrian direction detected by the detector 30.
Moreover, the display control unit 55 may control the illuminator 20 to cause the notification image G to be displayed in a display mode corresponding to the safety level evaluated by the evaluation unit 52. In one specific but non-limiting example, in a case with the relatively low safety level, the display control unit 55 may set the display mode of the notification image G, to cause more highlighted display of the notification image G than in a case with the relatively high safety level, in order to attract the pedestrian's attention more easily. In more details, the display control unit 55 may set the display mode of the notification image G, to cause at least one of the following to be carried out in accordance with reduction in the arrival time: enlargement of the notification image G; an increase in luminance of the notification image G; and a color change in the notification image G. It is to be noted that the display mode as to the color change in the notification image G may be a display mode with a color change to a more conspicuous color in accordance with the reduction in the arrival time, e.g., a color change from a white color or a cold color to a warm color.
The image display processing illustrated in
In step S401, the controller 50 may determine whether or not the pedestrian W has been detected by the detector 30. In one specific but non-limiting example, the controller 50 may determine whether or not an image of the pedestrian W is included in the images acquired by the detector 30, to determine whether or not the pedestrian W has been detected by the detector 30. In a case where the pedestrian W has not been detected by the detector 30, the controller 50 may end the processing. In a case where the pedestrian W has been detected by the detector 30, the flow may proceed to step S402.
In step S402, the controller 50 may acquire the speed of the vehicle 1 measured.
In step S403, the controller 50 may acquire the pedestrian position and the pedestrian direction of the pedestrian W detected by the detector 30.
In step S404, the controller 50 may determine whether or not the pedestrian position falls outside the driveway, and whether or not the pedestrian direction is the receding direction from the vehicle 1 or the driveway. In a case where the pedestrian position does not fall outside the driveway, or in a case where the pedestrian direction is not the receding direction from the vehicle 1 or the driveway, the flow may proceed to step S406. In a case where the pedestrian position falls outside the driveway, and the pedestrian direction is the receding direction from the vehicle 1 or the driveway, the flow may proceed to step S405.
In step S405, the controller 50 may control the illuminator 20 to cause the notification image G to be non-displayed, and end the processing. In the case where the pedestrian position falls outside the driveway, and the pedestrian direction is the receding direction from the vehicle 1 or the driveway, it is assumed that the pedestrian W has no intention of crossing the driveway. In this case, displaying the notification image G on the road surface R may cause erroneous information to be notified to, for example, surrounding vehicles or surrounding pedestrians. Accordingly, the controller 50 may control the illuminator 20 to cause the notification image G to be non-displayed on the road surface R, in the case where the pedestrian position falls outside the driveway, and the pedestrian direction is the receding direction from the vehicle 1 or the driveway.
In step S406, the controller 50 may calculate the distance from the pedestrian position detected by the detector 30 to the vehicle 1.
In step S407, the controller 50 may estimate the arrival time it takes for the vehicle 1 to arrive at the pedestrian position, on the basis of the distance from the pedestrian position detected by the detector 30 to the vehicle 1, and on the basis of the speed of the vehicle 1.
In step S408, the controller 50 may evaluate the safety level of the vehicle 1 with respect to the pedestrian W, on the basis of the arrival time estimated, and on the basis of the pedestrian position and the pedestrian direction detected by the detector 30. For example, the controller 50 may evaluate the safety level of the vehicle 1 with respect to the pedestrian W, according to the evaluation items summarized in
In step S409, the controller 50 may set the count-down image of the arrival time, as the notification image G.
In step S410, the controller 50 may set the display mode of the notification image G thus set, in accordance with the safety level evaluated.
In step S411, the controller 50 may set a display region of the notification image G, to cause the notification image G to be on the movable display following the change in the pedestrian position and the change in the pedestrian direction detected by the detector 30. When the pedestrian position detected by the detector 30 changes, the region of the road surface R spaced away from the pedestrian position by a predetermined distance may also change following the change in the pedestrian position. When the pedestrian direction detected by the detector 30 changes, the region of the road surface R located ahead in the pedestrian direction may also change following the change in the pedestrian direction. The controller 50 may set, as the display region of the notification image G, the region of the road surface R that is spaced away from the pedestrian position detected by the detector 30 by the predetermined distance and is located ahead in the pedestrian direction detected by the detector 30. Thus, the notification image G may be on the movable display following the change in the pedestrian position and the change in the pedestrian direction detected by the detector 30.
In step S412, the controller 50 may control the illuminator 20, to cause the notification image G to be displayed on the road surface R, as the set image, in the set display mode, and in the set display region. Thereafter, the controller 50 may end the processing.
[3. Notification Image to be displayed by Image Display Processing]
In
Before the notification image G is displayed, as illustrated in
Thereafter, as the vehicle 1 travels, the distance from the pedestrian position to the vehicle 1 becomes shorter. In accordance therewith, the image display device 10 may display, as illustrated in
Thereafter, when the pedestrian direction changes to the receding direction from the driveway, the image display device 10 may control the illuminator 20 to cause the notification image G to be non-displayed, as illustrated in
Thereafter, when the pedestrian position changes to a position close to the driveway, and the pedestrian direction changes to the approaching direction with respect to the vehicle 1, the image display device 10 may display, as illustrated in
Thereafter, when the pedestrian W crosses, causing the change in the pedestrian position to inside the driveway, and causing the change in the pedestrian direction to the approaching direction with respect to a centerline of the driveway, the image display device 10 may display, as illustrated in
As described, in the image display device 10 according to this implementation, the notification image G to be notified to the pedestrian W may be on the chronologically-changeable display on the road surface R in accordance with the change in the safety level of the vehicle 1 with respect to the pedestrian W. Accordingly, in the image display device 10 according to this implementation, it is possible for the pedestrian W to recognize what degree of allowance for safety they have at this moment in time. Hence, in the image display device 10 according to this implementation, it is possible to notify the pedestrian W of the safety level of the vehicle 1, leading to suppression of occurrence of a traffic accident such as collision of the pedestrian W with the vehicle 1.
Meanwhile, for example, the technique as described in JP-A 2009-149152 makes it possible for a driver of a vehicle to know predetermined information without a considerable movement of a line of sight. However, a pedestrian is not able to quantitatively recognize the safety level of the vehicle with respect to the pedestrian. Therefore, the technique as described in JP-A 2009-149152 causes the pedestrian difficulty in determining, in real time, what degree of allowance for safety they have. In contrast, in the image display device 10 according to this implementation, it is possible to notify the pedestrian W of the safety level of the vehicle 1. This makes it possible for the pedestrian W to determine safety in real time, resulting in the suppression of the occurrence of the traffic accident such as the collision of the pedestrian W with the vehicle 1.
Moreover, in the image display device 10 according to this implementation, the arrival time it takes for the vehicle 1 to arrive at the pedestrian position detected by the detector 30 may be evaluated as the safety level. The count-down image of the arrival time may be displayed as the notification image G. Accordingly, in the image display device 10 according to this implementation, it is possible for the pedestrian W to quantitatively recognize, in real time, a chronological change in the safety level. Hence, in the image display device 10 according to this implementation, it is possible to notify the pedestrian W of the safety level more accurately, leading to further suppression of the occurrence of the traffic accident.
Furthermore, in the image display device 10 according to this implementation, the safety level may be evaluated on the basis of the pedestrian position and the pedestrian direction detected by the detector 30. Even in the case with the change in the pedestrian position and the change in the pedestrian direction, the image display device 10 may be able to cause the count-down image of the arrival time to be on the movable display following the change in the pedestrian position and the change in the pedestrian direction. Therefore, in the image display device 10 according to this implementation, it is possible for the pedestrian W to immediately visually recognize the count-down image of the arrival time, and to immediately recognize the safety level. Hence, in the image display device 10 according to this implementation, it is possible to promptly notify the pedestrian W of the safety level, leading to the further suppression of the occurrence of the traffic accident.
In addition, in the image display device 10 according to this implementation, it is possible to display the notification image G, with the display mode, e.g., the size, the luminance, and the color, of the notification image G being changed in accordance with the safety level. Hence, in the image display device 10 according to this implementation, it is possible to easily attract the attention of the pedestrian W in accordance with the safety level, leading to the further suppression of the occurrence of the traffic accident.
Moreover, in the image display device 10 according to this implementation, the notification image G may be non-displayed, in the case where the pedestrian position falls outside the driveway, and the pedestrian direction is the receding direction from the vehicle 1 or the driveway. In other words, in the image display device 10 according to this implementation, it is possible to cause the notification image G to be non-displayed, in the case where it is assumed that the pedestrian W has no intention of crossing the driveway. Therefore, in the image display device 10 according to this implementation, it is possible to suppress the erroneous information from being notified to, for example, the surrounding vehicles or the surrounding pedestrians. Hence, in the image display device 10 according to this implementation, it is possible to accurately notify a target of notification of the notification image G, leading to the further suppression of the occurrence of the traffic accident.
In one implementation of the technology, the image display device 10 may serve as an “image display device”. In one implementation of the technology, the vehicle 1 may serve as a “vehicle”. In one implementation of the technology, the road surface R may serve as a “road surface”. In one implementation of the technology, the pedestrian W may serve as a “pedestrian”. In one implementation of the technology, the illuminator 20 may serve as an “illuminator”. In one implementation of the technology, the detector 30 may serve as a “detector”. In one implementation of the technology, the evaluation unit 52 may serve as an “evaluation unit”. In one implementation of the technology, the display control unit 55 may serve as a “display control unit”. In one implementation of the technology, the evaluation unit 52 and the display control unit 55 may serve as “circuitry”.
In one implementation described above, the evaluation unit 52 and the display control unit 55 illustrated in
It should be appreciated that the forgoing implementations including modification examples may be applied to one another by persons skilled in the art.
The foregoing description is intended to be merely illustrative rather than limiting. It should therefore be appreciated that variations may be made in the implementations of the disclosure by persons skilled in the art without departing from the scope as defined by the appended claims.
The terms used throughout the specification and the appended claims are to be construed as “open-ended” terms. For example, the term “include” and its grammatical variants are intended to be non-limiting, such that recitation of items in a list is not to the exclusion of other like items that can be substituted or added to the listed items. The term “have” and its grammatical variants are intended to be non-limiting, such that recitation of items in a list is not to the exclusion of other like items that can be substituted or added to the listed items.
Number | Date | Country | Kind |
---|---|---|---|
2017-046049 | Mar 2017 | JP | national |