The present invention relates to an image projection apparatus.
An image projection apparatus represented by a projector has already been used in a wide field as an apparatus for enlarging and projecting a desired image, and furthermore has been widely used also as a display device for a personal computer or a mobile phone in recent years.
For such an image projection apparatus, the following have already been known particularly as conventional techniques relating to use in a vehicle.
2010-26759
That is, the aforementioned Patent Document 1 discloses a projection-type display apparatus using a headlight of a vehicle as an outside light source by arranging an LCD projector superior in portability without containing a light source ahead of the headlight serving as the outside light source. To solve its problem, Patent Document 2 also shows an embodiment for realizing: a first state of previously incorporating a projector at the front of a headlight and into a vehicle; and a second state of directly irradiating a light flux from the headlight onto the outside of the vehicle by moving the projector or the headlight, and for further displaying an image onto a road.
Furthermore, in Patent Document 3, known as a vehicle driving support apparatus is an apparatus in which to effectively alert an occupant of an own vehicle at a time of determination of lane departure, information for alerting the occupant by irradiation means (laser) attached to a headlight portion at the front of a vehicle is displayed on a road ahead of the vehicle.
According to Patent Document 4, it has already been known that a projector serving as projection means is attached to a head portion of a vehicle and projects a path guidance image to be guided to a branch direction onto a road surface ahead of the vehicle with setting of a projection angle based on path information searched for by a navigation system. In addition, according to Patent Document 5, already known has been a vehicle driving support apparatus which enables a traveling destination of an own vehicle to be recognized and thus enables appropriate driving by projecting a drawing pattern including a target mark and a tracking line onto a road surface ahead of the vehicle based on a traveling state of the own vehicle.
However, the aforementioned conventional techniques do not necessarily effectively display necessary information based on a traveling state or the like of the own vehicle.
Therefore, the present invention has been achieved in view of the problems in the aforementioned conventional technique, and is directed to providing an image projection apparatus capable of: projecting information onto a road surface, a wall surface, an own vehicle, or the like (hereinafter referred to as a road surface or the like); and displaying the projected information based on information about a vehicle such as a traveling state of the own vehicle (a moving body represented by an automobile or the like), for example.
To solve the aforementioned problems, a configuration described in claims is, for example, adopted. The present application includes a plurality of means for solving the aforementioned problems. However, if one example of them is given, it is an image projection apparatus that projects an image and has: an acquisition unit that acquires information about a vehicle; and an image projection unit that projects the image based on the information acquired by the acquisition unit.
According to the present invention, provided can be an image projection apparatus capable of projecting, based on information about a vehicle, the information onto a road surface or the like and displaying the projected information.
For an embodiment of the present invention, its detailed contents will be described below with reference to the accompanying drawings.
<Arrangement of Image Projection Apparatus>
First,
Then,
Incidentally, while the examples in which one or a plurality of (a pair of) image projection apparatuses are loaded into each of the front and the rear of the own vehicle have been described above, the present invention is not limited to these. For example, the image projection apparatus may be loaded into locations (e.g., a side mirror portion, a top of the roof, and a side surface and a bottom surface of the vehicle body, etc.) other than the front and the rear of the own vehicle. The image projection apparatus may be integrally incorporated into each of the headlights or the tail lamps. That is, in the present invention, a desired image may be able to be projected onto the road surface or the like by the image projection apparatus. Incidentally, if the image projection apparatus is incorporated into each of the headlights and the tail lamps, a light source of the headlight or the tail lamp can be also used as a light source for projection.
<Configuration of Light Distribution Control ECU>
Then,
Note that examples of the information from the aforementioned various types of information acquisition units include: a speed signal representing a traveling speed of an own vehicle; a signal representing a state (ON/OFF) of an engine; gear information representing a position of a gear; a hazard signal for informing a surrounding driver of the presence of a danger; a steering-wheel steering angle signal representing a steering angle of a steering wheel; a turn-signal signal representing the presence or absence of turn signals (or also referred to as “blinkers”) or indicating which of the right and left turn signals is lighting up/flashing; and further lamp lighting information representing a lighting/flashing state of each of the aforementioned various types of lamps.
Further examples of the information from the aforementioned various types of information acquisition units include: information (an illuminance signal and a chromaticity signal, etc.) from an outside light sensor which detects light outside a vehicle; image information from a camera attached to the vehicle; a signal from a distance sensor which detects a distance between an own vehicle and a vehicle or another object traveling around, e.g., ahead of the own vehicle; further a signal from an infrared sensor which detects an external condition of the vehicle at night; and the like.
Furthermore, examples of the information from the aforementioned communication unit include: a GPS (Global Positioning System) signal for determining a position of the own vehicle; so-called navigation information serving as information from a navigation device which performs route guidance or the like; information about vehicle-to-vehicle communication performed between a vehicle and another vehicle and road-to-vehicle communication performed between a road and a vehicle; and the like.
A control signal from the aforementioned light distribution control ECU 40 and a signal (an image signal to be projected onto the road surface or the like) from a projection signal output unit 110 are inputted to a projector 100 constituting the aforementioned image projection apparatus via a control unit 120. Thus, an image is projected onto the road surface or the like as described below.
In addition, respective signals from a headlight sensor 66 and a high/low sensor 67 are further inputted to the aforementioned light distribution control ECU 40.
<Image Projection Apparatus>
Then, an example of a further detailed configuration of the image projection apparatus 500 including the projector 100, the projection signal output unit 110, and the control unit 120 illustrated in
A projection optical system 501 is an optical system which projects an image onto a road surface or the like, and includes a lens and/or a mirror. A display element 502 is an element which modulates transmitted light or reflected light to generate an image, and its examples include a transmissive liquid crystal panel, a reflective liquid crystal panel, and a DMD (Digital Micromirror Device: registered trademark) panel, etc. A display element driving unit 503 feeds a driving signal to the display element 502, and generates an image in the display element 502. A light source 505 generates light for image projection, and its examples include a high-pressure mercury lamp, a xenon lamp, an LED light source, and a laser light source, etc. A power source 506 supplies power to the light source 505. Further, the power source 506 supplies power required for each of other units. The illumination optical system 504 collects light generated by the light source 505, makes the light more uniform, and irradiates it to the display element 502. A cooling unit 515 cools each of parts which becomes a high-temperature state such as the light source 505, the power source 506, or the display element 502 as the need arises using an air cooling system or a liquid cooling system. An operation input unit 507 is a light receiving unit in an operation button or a remote control, and inputs an operation signal from a user.
An image signal input unit 531 is connected to an external image output device, and inputs image data. A voice signal input unit 533 is connected to an external voice output device, and inputs voice data. A voice output unit 540 can perform a voice output based on the voice data inputted to the voice signal input unit 533. The voice output unit 540 may output an operation sound or error warning sound built therein. A communication unit 532 is connected to an external information processing apparatus, for example, and inputs and outputs various types of control signals thereto and therefrom.
A nonvolatile memory 508 stores various types of data used in a projector function. The data stored in the nonvolatile memory 508 include image data and image data previously prepared to be projected onto a road. A memory 509 stores image data to be projected, respective control parameters for the units in the apparatus, and the like. A control unit 510 controls an operation of each of the units to be connected thereto.
An image adjustment unit 560 performs an image processing to the image data inputted to the image signal input unit 531 and the image data and the image data stored in the nonvolatile memory 508. Examples of the image processing include: a scaling processing for enlarging, reducing, and deforming, for example, an image; a brightness adjustment processing for changing luminance; a contrast adjustment processing for changing a contrast curve of the image; and a retinex processing for decomposing the image into light components and changing weighting for each of the components.
A storage unit 570 records a video, an image, a voice, various types of data, and the like. For examples, a video, an image, a voice, various types of data, and the like may be previously recorded at a time of product delivery, or a video, an image, a voice, various types of data, and the like acquired from an external apparatus, an external server, and the like via the communication unit 532 may be recorded. The video, the image, the various types of data, and the like recorded in the storage unit 570 may be respectively outputted as projected images via the display element 502 and the projection optical system 501. The voice recorded in the storage unit 570 may be outputted as a voice from the voice output unit 540.
As described above, various functions can be put on the image projection apparatus 500. However, the image projection apparatus 500 need not necessarily have all the aforementioned components. The image projection apparatus 500 may have any configuration if it has a function of projecting an image.
Thus, in the aforementioned image projection apparatus 500, a length of a long side in a range of a projected image is 10061−542=9519≈9520 mm relative to a projection distance of 700 mm. Therefore, a projection ratio is 700/9520≈0.07, and a significantly wider angle than ever before is realized.
Incidentally, while the one image projection apparatus 500 and the projection optical system therein have been described above, one or a plurality of (a pair of) projectors may be loaded into a vehicle (or integrally incorporated into each of headlights and tail lamps) to project a desired image onto a road surface or the like as described above. At that time, when a plurality of (a pair of) image projection apparatuses are used as particularly illustrated in
While a configuration in which a transmission-type liquid crystal image display element is used as the image projection apparatus projecting the image onto the road surface or the like has been described above, the present invention is not limited to this. Other examples of the image projection apparatus can include various types of image projection apparatuses such as: a reflection-type image projection apparatus including a micromirror such as a DLP (Digital Light Processing) apparatus; and an image projection apparatus capable of projecting image light from a planar light emitting diode capable of light modulation via a projection optical system. That is, in the present invention, the image projection apparatus may be able to project the desired image onto the road surface or the like.
<Image Projected onto Road Surface or the Like>
The image projection apparatus whose details have been described above is then loaded into the front and/or the rear of the vehicle body as described above as an example. Thus, a specific example of various types of images projected onto the road surface or the like by a relationship with vehicle information will be described in detail below with reference to
According to the image projected onto the road surface or the like, by setting a display method (in this case, the flashing or the flashing period) based on not only the traveling direction of the own vehicle but also driving information (in this case, a vehicle speed and the steering-wheel steering angle) on the own vehicle for a driver of another vehicle or a pedestrian existing around the own vehicle, a presentation (warning) is made more surely to the surrounding driver or pedestrian, and high safety can be ensured. At this time, if the pair of image projection apparatuses is incorporated as illustrated in the examples of
Furthermore, as also illustrated in
Furthermore, in the aforementioned drawings, their display contents are replaced with the aforementioned arrow, for example, a mark 230 for announcing a danger (see
According to such an image projected onto a road surface or the like, a presentation (warning) is made more surely to a surrounding driver or pedestrian particularly in putting the own vehicle into a garage, and high safety can be ensured.
Then,
In the aforementioned examples, a color or a shape of the mark (the arrow 200) can also be changed depending on the distance therefrom to the intersection. For example, as illustrated in
According to the image projected onto the road surface or the like, higher safety can be ensured because the traveling direction of the own vehicle is easier to recognize by the surrounding driver or pedestrian, and the path which the own vehicle is to enter at the intersection is also easier to recognize by the driver of the own vehicle.
Particularly if a plurality of vehicles travel side by side on a relatively wide road, a mark (linear arrow) 210 may be displayed so as to extend also onto a road surface of an adjacent lane as also illustrated in
An image projected onto a road surface or the like using an image signal, which is captured by the camera 61 illustrated also in
As also illustrated in
Such display of the image 300 can contribute to safe driving particularly at the time of a lane change because a driver who is driving can surely recognize (see) the another vehicle 10′ traveling therebehind, which is usually difficult to see.
As also illustrated in
Furthermore, as also illustrated in
As illustrated in
In addition, at times of traveling in a tunnel, along an expressway, along a general road, and the like, the display content can also be changed. For example, as also illustrated in
Furthermore, as illustrated in
Particularly at the time of traveling in a tunnel, the display content can also be made different from those at the time of traveling along an expressway and a general road. As illustrated in
Note that, in this case, the color of the linear arrow 210 serving as the display content may be appropriately set by the aforementioned light distribution control ECU 40 using respective signals from the aforementioned illuminance sensor 57 and chromaticity sensor 58. If the driver does not turn on the light in the traveling in the tunnel, mode switching (specifically, switching on the light) can also be performed by detecting a natural-light change or illumination light in the tunnel. Further, if a signal from the vehicle speed sensor 54 is also used in traveling in a tunnel on an expressway, an average traveling speed in a predetermined time period is detected, and an optimum display content can also be projected for driving information about the vehicle while also considering the average traveling speed. More specifically, it is recognized from the average traveling speed in the predetermined time period that the vehicle is traveling along the expressway. A display method at the time of traveling in the tunnel may be similar to a display state in the evening/at night, for example. Even in traveling along the expressway, its mode returns to a general road mode at a time of a traffic jam. Therefore, it is conceivable to be interlocked with the navigation device or provided with a step of confirming whether the vehicle has left the expressway.
Note that various examples of the present invention have been described above, but the present invention is not limited to the embodiments described above and includes various modification examples. For examples, the embodiments above have been described in detail so as to make the present invention easily understood, and the present invention is not always limited to the embodiment having all of the described constituent elements. Also, a part of the configuration of one embodiment may be replaced with the configuration of another embodiment, and the configuration of one embodiment may be added to the configuration of another embodiment. Furthermore, another configuration may be added to a part of the configuration of each embodiment, and a part of the configuration of each embodiment may be eliminated or replaced with another configuration.
Some or all of the aforementioned respective components, functions, processing units, processing means, and the like may be realized through hardware by a design using an integrated circuit, for example. The aforementioned respective components, functions, and the like may be implemented by software by processors interpreting and executing programs for implementing their respective functions. Information such as programs, tables, and files, etc. for implementing the respective functions can be placed on a recording device such as a memory, a hard disk, and an SSD (Solid State Drive) and a recording medium such as an IC card, an SD card, and a DVD.
In addition, contents of the present invention including the various examples described above will be summarized below.
(1) If the blinker is lighted/flashed in a right turn/left turn, a flashing period is made variable depending on a speed/steering angle.
(2) If the steering wheel is operated in a right turn/left turn, a display content/display position is made variable depending on the steering angle (e.g., is an oblique mark when the blinker is started and is changed to an L-shaped mark when the steering angle becomes large).
(3) If the steering wheel is operated when the vehicle is put into a garage or is parked, a display/arrow of a traveling range is changed depending on a steering angle/gear.
(4) If the blinker is lighted/flashed in a right turn/left turn, a projected image is interlocked (synchronized or alternated) with lighting/flashing of the turn signal.
(5) If the blinker is lighted/flashed in a right turn/left turn, the lighting/flashing of the blinker is made the same in color as the lighting/flashing of the turn signal.
(6) If the blinker is lighted/flashed in a right turn/left turn, a display position of a mark is changed at a right turn/left turn.
(7) If the steering wheel is operated in a right turn/left turn, the presence or absence of lighting/flashing the blinker is detected, and a display representing a right turn/left turn is performed when the blinker is lighted/flashed (e.g., interlocking with the blinker and/or the steering wheel).
(8) If the blinker is lighted/flashed in a right turn/left turn, a display distance of a mark is interlocked with a GPS or a navigation system and changed depending on a distance therefrom to an intersection (e.g., the mark is displayed far from the own vehicle when the distance therefrom to the intersection is long, and the display is brought close to the own vehicle as it approaches to the intersection).
(9) If the blinker is lighted/flashed in a right turn/left turn, a color and a shape of a mark are changed depending on a distance therefrom to the intersection (e.g., the color is changed to blue→yellow→red, or its size is gradually increased).
(10) If the blinker is lighted/flashed in a right turn/left turn, a right-turn/left-turn arrow (e.g., the letter L) is large-displayed/flashed.
(11) If the blinker is lighted/flashed in a lane change, an arrow is not the letter L which brings an image of a right turn/left turn, and a linear arrow is obliquely displayed.
(12) If the blinker is lighted/flashed in a lane change, marks are displayed on diagonally right and left front sides to be seen by a following vehicle(s).
(13) If the blinker is lighted/flashed in a lane change, not an arrow but a track of a vehicle is displayed to clarify a place which the own vehicle enters.
(14) If the blinker is lighted/flashed in a lane change, a camera image of a lane to be changed is projected (e.g., an image etc. of a side surface serving as a driver's blind spot).
(15) If the blinker is lighted/flashed in a lane change, a time period of lighting/flashing the blinker is shorter than that at the time of a right turn/left turn. Therefore, since projection display is not performed in time, or a projection time period may be too short, there is a need to simplify a processing method until the projection display and to reduce a time difference, or to continue the projection display in a predetermined time period or more.
(16) Projection display is performed only when the blinker is lighted/flashed after a predetermined time period, for example, if it is assumed that an operation for indicating the blinker has been erroneously performed.
(17) If the steering wheel is operated in garaging or parking the vehicle, an average traveling speed in any time period is detected, and L-shaped expression of a right turn/left turn is not displayed in response to a detection result (i.e., separation from a case where the vehicle decelerates in a right turn/left turn).
(18) If the steering wheel is operated in garaging or parking the vehicle, an alert is displayed (e.g., on any one or all of the front, rear, right, and left sides of the vehicle).
(19) If the steering wheel is operated in garaging or parking the vehicle, attention attraction is interlocked with a hazard and displayed.
(20) If the steering wheel is operation in garaging or parking the vehicle, attention attraction is displayed to a surrounding pedestrian or the like (mainly in backing etc.).
(21) If the steering wheel is operated in garaging or parking the vehicle, a parking area is lighted/flashed by red or the like (a parking mode).
(22) A display content is changed at each time of traveling in a tunnel, along an expressway, and along a general road. A projection distance of a mark is changed depending on the respective speeds.
(23) A display content is changed at each time of traveling in a tunnel, along an expressway, and along a general road. A driver's view angle changes depending on a traveling speed. Therefore, the display content is displayed at a wide angle in a low speed, and is displayed at a narrow angle in a high speed.
(24) A display content is changed at each time of traveling in a tunnel, along an expressway, and along a general road. The display content is changed in synchronization with lighting of a small light in the tunnel (color replacement). If a driver does not turn on the light, the driver recognizes that the vehicle is traveling in the tunnel by detecting a natural-light change or in-tunnel illumination. The driver recognizes that the vehicle is traveling along the expressway from an average traveling speed during a predetermined time period. A display method at the time of traveling in the tunnel may be similar to that in a display state in the evening/at night, for example. Its mode returns to a general road mode at the time of a traffic jam even in traveling along the expressway. Therefore, the vehicle is interlocked with a navigation device or provided with a step of confirming whether the vehicle has left the expressway.
(25) In traveling in a tunnel, a color, which is difficult to see by in-tunnel illumination, is consciously heavily irradiated. Alternatively, a color, which is easy to see, is irradiated.
In association with the foregoing item (5):
(26) OFF timing of a light source is changed between a display mode from an image source input and a display mode at a traveling time or the like (e.g., ON/OFF of the image projection apparatus is (are) changed depending on a driving situation in the display mode at the traveling time or the like, and the image projection apparatus is always turned ON in the display mode from the image source input). In the display mode from the image source input, a headlight is turned OFF, and the image projection apparatus is turned ON. In the display mode at the traveling time or the like, both of the headlight and the image projection apparatus are also turned ON.
(27) A light source in the image projection apparatus is turned ON when needed, and is turned OFF otherwise.
(28) Even at a time of engine OFF, the light source can be turned ON. Alternatively, at the time of engine OFF, the image projection apparatus is not started.
(29) At the time of the engine OFF, functions are restricted (e.g., security and a warning are turned ON, and others (e.g., display from the image source input) are not so).
(30) At the time of the engine OFF, power from the light source is brought into an energy saving mode.
<Projected Image and Behavior of Vehicle>
Furthermore, when a vehicle and a projected image have independently moved, an attention of a person who is seeing the projected image (other person such a pedestrian and a driver of the other party) is distracted. Thus, the projected image becomes difficult to visually recognize.
More specifically, for example, when the own vehicle has once stopped for a red traffic signal in an attempt to turn right or turn left at an intersection, an image including, for example, an arrow etc. and representing a direction in which the own vehicle travels is projected onto a road surface ahead of the own vehicle (at the intersection). At this time, an arrow or the like serving as an image representing a direction in which the own vehicle travels is effectively displayed for the purpose of attracting attention of another person who is seeing the projected image (other person such as a pedestrian and a driver of the other party).
However, in this case, the projected image also simultaneously moves as the vehicle starts moving. That is, when both of the vehicle and the projected image have moved, the other person who is seeing the projected image is rather confused so that an intended purpose may be unable to be achieved. Therefore, in the other example, stillness movement of a projection position onto the road surface of the projected image are appropriately switched to match a behavior or the own vehicle.
A more specific example is illustrated in
In this example, in details of the light distribution control ECU 40 and the peripheral elements illustrated in
That is, particularly after the own vehicle 10 stops at the intersection or the like and its traveling direction is displayed by the arrow 200 or the like, a display position of the arrow 200 is not interlocked with movement of the vehicle 10, a position of the own vehicle 10 is grasped by a vehicle speed pulse, a steering angle of a steering wheel, and the like so that the display position does not vary as much as possible, and a display position of an image cannot be interlocked with the movement of the own vehicle but fixed by correction required for remaining at an initial display position (that is, the display position of the image onto a road can be fixed/moved). Note that examples of a trigger for the fixing include a case where the own vehicle 10 is changed from a stopping state to a traveling state, a case where the steering wheel starts to be turned (a predetermined steering angle is detected), or their combination. If correction required for the image generated on the display element 502 is not made, the display position of the image is interlocked with the movement of the vehicle. Thus, the light distribution control ECU 40 grasps the behavior of the own vehicle 10 in response to the respective signals from various types of sensors, and simultaneously determines fixing/movement of the display position of the image onto the road.
As described above, stillness/movement of the image projected onto the road surface are changed to match the behavior of the own vehicle. More specifically, attention of another person (a pedestrian, or a driver of the other party, etc.) is attracted by moving a projected image (a moving image representing the arrow 200) at an own-vehicle stopping time. On the other hand, if the own vehicle is moving (traveling), distraction of the attention is avoided by making the projected image stand still (making also the projection position onto the road surface fixed) and by shifting the attention to the own vehicle, and so safety can be improved.
In the examples described in detail above, the display of a moving direction of the own vehicle particularly in attempting to turn right or turn left the own vehicle at the intersection has been described in detail, but the display can also be similarly implemented even in other cases. As its example, the present invention is also similarly applied to the display performed even when the steering wheel is operated in garaging the vehicle as illustrated in
Thus, similarly to the aforementioned examples, when the arrow 200 is displayed as a moving image, the attention can be attracted more surely to the surrounding driver or pedestrian, and higher safety can be ensured by avoiding confusion between the own vehicle and the image displayed when the vehicle has actually moved back.
Furthermore, as also illustrated in
10 . . . own vehicle (passenger vehicle); 10′ . . . another vehicle; 11 . . . headlight; 12 . . . window; 13, 13′ . . . tail lamp; 40 . . . light distribution control ECU; 51 . . . direction indicator sensor; 52 . . . steering-wheel steering angle sensor; 53 . . . shift position sensor; 54 . . . vehicle speed sensor; 55 . . . accelerator operation sensor; 56 . . . brake operation sensor; 57 . . . illuminance sensor; 58 . . . chromaticity sensor; 59 . . . engine start sensor; 60 . . . hazard lamp sensor; 61 . . . camera; 62 . . . image processing unit; 63 . . . GPS receiving unit; 64 . . . map information output unit; 66 . . . headlight sensor; 67 . . . high/low sensor; 100 . . . projector; 110 . . . projection signal output unit; 120 . . . control unit; 500 . . . image projection apparatus; 501 . . . projection optical system; 502 . . . display element; 503 . . . display element driving unit; 504 . . . illumination optical system; 505 . . . light source; 531 . . . image signal input unit; 533 . . . voice signal input unit; and 532 . . . communication unit.
Number | Date | Country | Kind |
---|---|---|---|
2015-003961 | Jan 2015 | JP | national |
2015-155164 | Aug 2015 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2015/084820 | 12/11/2015 | WO | 00 |