The present application claims priority from Japanese Patent Application No. 2023-021178 filed on Feb. 14, 2023, the entire contents of which are hereby incorporated by reference.
The disclosure relates to a vehicle with a road surface rendering function.
Japanese Unexamined Patent Application Publication (JP-A) Nos. 2016-055691, 2020-111284, 2015-164828, and 2016-215877 disclose that various patterns are rendered on a road surface where a vehicle is traveling by projecting light from the vehicle.
By rendering those patterns on the road surface, the vehicle can provide, for example, a driver who drives the vehicle with information on traveling of the vehicle via the road surface.
An aspect of the disclosure provides a vehicle with a road surface rendering function. The vehicle includes a projection member, a controller, and a detection device. The projection member is configured to perform light projection for road surface rendering at least toward a road surface ahead of the vehicle. The controller is configured to control the light projection for the road surface rendering by the projection member. The detection device is configured to perform detection of the road surface where the projection member projects the light for the road surface rendering. The controller is configured to determine, based on the detection of the road surface by the detection device, whether a first road surface area in the road surface for the road surface rendering rises relative to a second road surface area where the vehicle is traveling. The controller is configured to suppress the light projection for the road surface rendering by the projection member based on determining that the first road surface area rises relative to the second road surface area.
An aspect of the disclosure provides a vehicle with a road surface rendering function. The vehicle includes a projection member, a detection device, and circuitry. The projection member includes a light source and is configured to perform light projection for road surface rendering at least toward a road surface ahead of the vehicle. The detection device includes a camera and is configured to perform detection of the road surface where the projection member projects the light for the road surface rendering. The circuitry is configured to control the light projection for the road surface rendering by the projection member. The circuitry is configured to determine, based on the detection of the road surface by the detection device, whether a first road surface area in the road surface for the road surface rendering rises relative to a second road surface area where the vehicle is traveling. The circuitry is configured to suppress the light projection for the road surface rendering by the projection member based on determining that the first road surface area for the road surface rendering rises relative to the second road surface area.
The accompanying drawings are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments and, together with the specification, serve to describe the principles of the disclosure.
It is not always appropriate to simply render a road surface rendered image on a road surface by projecting light from a vehicle.
Road surfaces have various reflection characteristics. The traveling vehicle may approach, for example, an uphill. When light for road surface rendering is projected to a rising part of the road surface relative to the vehicle, light that is more intense than expected may be reflected toward a driver of the vehicle
It is desirable to improve the road surface rendering from the vehicle.
In the following, an embodiment of the disclosure is described in detail with reference to the accompanying drawings. Note that the following description is directed to an illustrative example of the disclosure and not to be construed as limiting to the disclosure. Factors including, without limitation, numerical values, shapes, materials, components, positions of the components, and how the components are coupled to each other are illustrative only and not to be construed as limiting to the disclosure. Further, elements in the following example embodiment which are not recited in a most-generic independent claim of the disclosure are optional and may be provided on an as-needed basis. The drawings are schematic and are not intended to be drawn to scale. Throughout the present specification and the drawings, elements having substantially the same function and configuration are denoted with the same numerals to avoid any redundant description.
In such a traveling environment, a driver of the vehicle 1 drives the vehicle 1 so as to prevent lane departure on the road while paying attention to, for example, a forward side in a traveling direction of the vehicle 1. In a dark traveling environment, the vehicle 1 may turn ON headlamps. In
Research and development have been promoted on drawing a picture by radiating visible light onto a road surface from the vehicle 1.
For example,
On the right side of
By rendering the pattern of the road surface rendered image 11 or the like on the road surface, the vehicle 1 can provide, for example, its driver with information on traveling of the vehicle 1 via the road surface.
It is not always appropriate to simply rendered the road surface rendered image 11 on the road surface by projecting light from the vehicle 1.
Road surfaces have various reflection characteristics. The traveling vehicle 1 may approach, for example, an uphill. When light for road surface rendering is projected to a rising part of the road surface relative to the vehicle, light that is more intense than expected may be reflected toward the driver of the vehicle.
The vehicle 1 renders the road surface rendered image 11 by projecting light onto the road surface while traveling along a flat road surface area 91. The vehicle 1 renders the road surface rendered image 11 basically at a predetermined separation distance D1 from the vehicle 1.
In
In this case, the distance from the vehicle 1 to the road surface area 92 where the road surface rendered image 11 is rendered decreases. Since the road surface area 92 rises relative to the flat road surface area 91, the light for the road surface rendered image 11 gathers into a small spot. For those reasons, the reflection light intensity of the road surface rendered image 11 in
The vehicle 1 renders the road surface rendered image 11 by projecting light onto the road surface while traveling along a downhill road surface area 93. The vehicle 1 renders the road surface rendered image 11 basically at the predetermined separation distance D1 from the vehicle 1.
In
In this case, the distance from the vehicle 1 to the road surface area 94 where the road surface rendered image 11 is rendered decreases. Since the road surface area 94 rises relative to the downhill road surface area 93, the light for the road surface rendered image 11 gathers into a small spot. For those reasons, the reflection light intensity of the road surface rendered image 11 in
It is desirable to improve the road surface rendering from the vehicle.
The control system 20 of the vehicle 1 of
For example, the vehicle network 26 may be a wired communication network conforming to a controller area network (CAN) or a local interconnect network (LIN) for the vehicle 1. The vehicle network 26 may be a communication network such as a LAN or a combination of those networks. The vehicle network 26 may partly include a wireless communication network. The various devices coupled to the vehicle network 26 can exchange information via the vehicle network 26.
A right headlamp module 31 and a left headlamp module 32 provided at a front end 50 of the vehicle 1 are coupled to the headlamp control device 22. The right headlamp module 31 and the left headlamp module 32 are headlamp members that project light forward from the vehicle 1.
The right headlamp module 31 and the left headlamp module 32 of this embodiment include projection modules 53 for road surface rendering as described later. In one embodiment, the projection module 53 of the right headlamp module 31 and the projection module 53 of the left headlamp module 32 may serve as a projection member configured to project light for road surface rendering from the traveling vehicle 1 to render the road surface rendered image 11 on a road surface around the traveling vehicle 1. That is, the projection member may include a light source.
The headlamp control device 22 controls a lighting status of the right headlamp module 31 and a lighting status of the left headlamp module 32 based on information acquired via the vehicle network 26 about an operation on a lamp operation lever (not illustrated) and a detection value from an automatic light intensity sensor (not illustrated). With the lamp operation lever, an operation state such as “low beam”, “high beam”, or “OFF” can be set in general.
The headlamp control device 22 may output information on the lighting statuses of the right headlamp module 31 and the left headlamp module 32 to other control devices via the vehicle network 26.
Various operation members to be operated by an occupant such as the driver are coupled to the operation control device 23.
The operation control device 23 may output information on the operation states of the various operation members such as the wiper operation lever 33 to other control devices via the vehicle network 26.
Various detection members that detect the traveling condition and the traveling environment of the vehicle 1 are coupled to the detection control device 24.
The detection control device 24 may output, for example, detection information from the lidar 34 to other control devices via the vehicle network 26.
The lidar 34 is oriented forward at the front of the vehicle 1, and scans a forward area around the vehicle 1 with laser light.
The detection control device 24 may generate space information on the forward area around the vehicle 1 based on scanning information from the lidar 34. The space information based on the scanning information from the lidar 34 may include information on the shape of a road surface in the forward area around the vehicle 1. For example, when the vehicle 1 is traveling in the situation of
As illustrated in
The image captured by the external camera 35 may include, as its detection image, the road surface rendered image 11 rendered by projecting light onto a road surface.
In one embodiment, the external camera 35, the lidar 34, or the like provided to the vehicle 1 may serve as a detection device configured to detect a road surface where the road surface rendered image 11 is projected. That is, the detection device may include a sensor.
The external camera 35 captures an image of a road surface where the projection modules 53 and 53 project light for the road surface rendering. In one embodiment, the lidar 34 may serve as a wave scanning member to detect the shape of the road surface by outputting laser light (wave) toward the road surface where the projection modules 53 and 53 project light for the road surface rendering.
The acceleration sensor 36 detects an acceleration of the traveling vehicle 1. The acceleration sensor 36 may detect three-axis accelerations.
Based on the three-axis accelerations from the acceleration sensor 36, the detection control device 24 may generate information such as roll, pitch, and yaw angular velocities and the moving speed and direction of the vehicle 1.
A communication device 37 is coupled to the communication control device 25. The communication device 37 exchanges information with a server device via a base station (not illustrated) or the like. Examples of the base station include a 5G base station and a base station for advanced driver assistance systems (ADAS) or intelligent transport systems (ITS). Some 5G base stations may have functions of a server device. The communication device 37 may directly communicate with other vehicles 1 or the like by vehicle-to-X (V2X) communication.
The communication control device 25 may transmit information acquired via the vehicle network 26 from the communication device 37 to a base station or a server device, or may output, to the vehicle network 26, information received by the communication device 37 from a base station or a server device.
The rendering control device 21 includes a memory 41, a timer 42, a communication port 43, an input/output port 45, a CPU 44, and an internal bus 46 to which those components are coupled. The control devices provided in the control system 20 basically have structures similar to that of the rendering control device 21.
The right headlamp module 31 and the left headlamp module 32 are coupled to the input/output port 45.
The communication port 43 is coupled to the vehicle network 26. The communication port 43 acquires information from the vehicle network 26, and outputs, to the vehicle network 26, information to be output by the rendering control device 21.
The timer 42 measures a period or time.
For example, the memory 41 may include a semiconductor memory, a hard disk drive (HDD), and a random access memory (RAM). The HDD is a non-volatile memory. The RAM is a volatile memory. The memory 41 records programs to be executed by the CPU 44 and various types of information to be used during execution of the programs as data. For example, the memory 41 records data on the projection patterns 60 illustrated in
The CPU 44 reads and executes the programs recorded in the memory 41. Therefore, the CPU 44 serves as a controller of the rendering control device 21. In one embodiment, the CPU 44 may serve as a controller configured to control light projection for the road surface rendering by the projection modules 53 and 53.
The CPU 44 controls the operation of the rendering control device 21. The CPU 44 outputs signals to the right headlamp module 31 and the left headlamp module 32 via the communication port 43. In this way, the CPU 44 controls the projection modules 53 provided in the right headlamp module 31 and the left headlamp module 32 for the road surface rendering. The right headlamp module 31 and the left headlamp module 32 are lit in a projection pattern for the road surface rendering. For example, as illustrated in
In this way, the CPU 44 can control the light projection for the road surface rendering by the projection modules 53 and 53 based on the detection (captured image) by the external camera 35.
The left headlamp module 32 is provided at the left end in the front end 50 of the vehicle 1. The left headlamp module 32 includes low-beam LEDs 51, high-beam LEDs 52, and the MEMS projection module 53.
For example, the projection module 53 may be a digital micromirror device (DMD).
In one embodiment, the MEMS projection module 53 may serve as the projection member, and projects light by reflecting light from a three-color light source by MEMS elements. The reflection state of each MEMS element may be controlled based on an image signal.
The right headlamp module 31 or the left headlamp module 32 may use a device that can render an image on a road surface, except for the MEMS projection module 53.
The MEMS projection module 53 may project light inside and outside the radiation range of the low-beam LEDs 51 and the high-beam LEDs 52 as a whole. A part of the no-crossing rendering pattern for a pedestrian in
In
In
The CPU 44 controls the MEMS projection module 53 of the right headlamp module 31 and the MEMS projection module 53 of the left headlamp module 32 based on the projection pattern to render the road surface rendered image 11 corresponding to the projection pattern on the road surface. In one embodiment, the MEMS projection module 53 of the right headlamp module 31 and the MEMS projection module 53 of the left headlamp module 32 may serve as the projection member configured to project the light for the road surface rendering at least toward a road surface ahead of the vehicle 1 based on the projection pattern.
The image 70 of
Therefore, the captured image 70 of
The image 70 captured by the external camera 35 may be an image showing the forward road surface in the traveling direction of the vehicle 1 from substantially the same height position as that of the line of sight of the driver of the vehicle 1.
The image 70 of
Therefore, the captured image 70 of
The image 70 captured by the external camera 35 may be an image showing the forward road surface in the traveling direction of the vehicle 1 from substantially the same height position as that of the line of sight of the driver of the vehicle 1.
The detection image 76 corresponding to the road surface rendered image 11 of
In the detection image 76 corresponding to the road surface rendered image 11 of
The CPU 44 of the rendering control device 21 repeats the road surface rendering control of
In one embodiment, if the headlamp control device 22 has a rendering control function in the control system 20, a CPU of the headlamp control device 22 may serve as the controller to repeat the road surface rendering control of
In Step ST1, the CPU 44 that controls light projection for road surface rendering determines whether the road surface rendering is requested. The request for the road surface rendering may be generated by various control devices of the control system 20. For example, when lighting the headlamps, the headlamp control device 22 may generate information for requesting the road surface rendering and output the information to the rendering control device 21 via the vehicle network 26. When the road surface rendering is requested, the CPU 44 advances the process to Step ST2. When the road surface rendering is not requested, the CPU 44 terminates this control.
In Step ST2, the CPU 44 selects a projection pattern to be used for the road surface rendering from among the projection patterns 60 recorded in the memory 41. The CPU 44 may select multiple projection patterns.
In Step ST3, the CPU 44 starts to project light for the road surface rendering. The CPU 44 controls the projection module 53 of the right headlamp module 31 and the projection module 53 of the left headlamp module 32 to irradiate a road surface with light in the projection pattern selected in Step ST2. Thus, a road surface rendered image 11 corresponding to the projection pattern is rendered on the road surface.
In Step ST4, the CPU 44 acquires the latest captured image 70 from the external camera 35. The CPU 44 may acquire space information based on scanning information from the lidar 34.
In Step ST5, the CPU 44 analyzes, for example, the captured image 70 acquired in Step ST4, and determines whether the road surface area where the road surface rendered image 11 is rendered rises relative to the road surface area where the vehicle is traveling.
In
In
The CPU 44 analyzes, for example, the captured image 70 acquired in Step ST4, and determines whether the road surface area rises.
For example, when the capturing position of the detection image 76 corresponding to the road surface rendered image 11 in the image 70 captured by the external camera 35 is lower than the capturing position in the previous captured image 70 by a threshold or more, the CPU 44 may determine that the road surface area for the road surface rendering rises relative to the road surface area where the vehicle 1 is traveling. The CPU 44 may otherwise determine that the road surface area for the road surface rendering does not rise relative to the road surface area where the vehicle 1 is traveling.
As indicated by the broken line from the external camera 35 to the road surface rendered image 11 in
At this time, the CPU 44 may superimpose the captured images 70 before and after comparison, and determine whether the capturing position at the upper end of the detection image 76 in the captured image 70 after comparison descends by a predetermined threshold number of pixels or more.
When the vehicle travels along a rough road surface, the body moves up and down compared with a case where the vehicle travels along a flat road surface.
The behavior of the body of the vehicle changes by traveling control.
The threshold is used for reducing the occurrence of a case where the variation in the capturing position of the detection image 76 due to such normal effects is determined as road surface rising.
When the road surface area for the road surface rendering rises, for example, greatly relative to the road surface area where the vehicle 1 is traveling though the threshold is used, determination can be made that the road surface rises. When the road surface area for the road surface rendering rises greatly relative to the road surface area where the vehicle 1 is traveling and the light of the road surface rendered image 11 toward the driver of the vehicle 1 is intense, determination can be made that the road surface rises.
In Step ST6, the CPU 44 determines whether determination has been made in Step ST5 that the road surface area for the road surface rendering rises relative to the road surface area where the vehicle 1 is traveling. When determination is made that there is a rise, the CPU 44 advances the process to Step ST7. When determination is not made that there is a rise, the CPU 44 advances the process to Step ST10.
In Step ST7, the CPU 44 stops projecting the light for the road surface rendering. The CPU 44 controls the projection module 53 of the right headlamp module 31 and the projection module 53 of the left headlamp module 32 to stop projecting the light toward the road surface.
In Step ST8, the CPU 44 makes determination on the timing to resume the light projection. The CPU 44 determines whether the vehicle 1 has passed through the road surface area determined as rising.
At this time, the CPU 44 may acquire a new image 70 captured by the external camera 35, and determine whether the vehicle 1 has passed through the road surface area determined as rising based on the captured image 70.
The CPU 44 may cause the timer 42 to measure a period that has elapsed after the stop of the light projection, and make determination on the timing to resume the light projection based on whether the period measured by the timer 42 has exceeded a threshold.
The CPU 44 may calculate the threshold of the period measured by the timer 42 based on a current vehicle speed and the separation distance D1.
When determination is not made that the vehicle 1 has passed through the road surface area determined as rising, the CPU 44 repeats this step. In this period, the light projection for the road surface rendering remains stopped.
When determination is made that the vehicle 1 has passed through the road surface area determined as rising, the CPU 44 advances the process to Step ST9.
In Step ST9, the CPU 44 resumes the light projection for the road surface rendering by the projection modules 53 after the vehicle 1 has passed through the road surface area determined as rising.
After the CPU 44 has determined that the road surface area for the road surface rendering rises relative to the road surface area where the vehicle 1 is traveling and has stopped the light projection for the road surface rendering by the projection modules 53, the CPU 44 can continue to stop the light projection for the road surface rendering by the projection modules 53 until the vehicle 1 passes through the road surface area determined as rising. Then, the CPU 44 can resume the light projection for the road surface rendering by the projection modules 53.
In Step ST10, the CPU 44 determines whether to terminate the rendering. The CPU 44 may determine to terminate the road surface rendering, for example, when the road surface rendering is not requested. In this case, the CPU 44 advances the process to Step ST11.
For example, when the road surface rendering is still requested, the CPU 44 determines not to terminate the road surface rendering, and returns the process to Step ST4. In this case, the CPU 44 repeats the process from Step ST4 to Step ST10 to continue the control for the road surface rendering.
In Step ST11, the CPU 44 stops projecting the light for the road surface rendering. The CPU 44 controls the projection module 53 of the right headlamp module 31 and the projection module 53 of the left headlamp module 32 to stop projecting the light toward the road surface. Then, the CPU 44 terminates this control.
In this way, the CPU 44 can determine whether the road surface area for the road surface rendering rises relative to the road surface area where the vehicle 1 is traveling based on the detection of the road surface by the external camera 35. When the road surface area for the road surface rendering rises relative to the road surface area where the vehicle 1 is traveling, the CPU 44 can perform control to suppress the light projection for the road surface rendering by the projection modules 53.
As described above, the vehicle 1 according to this embodiment includes the external camera 35 configured to detect the road surface where the projection modules 53 project the light for the road surface rendering. The CPU 44 configured to control the light projection for the road surface rendering by the projection modules 53 determines whether the road surface area for the road surface rendering rises relative to the road surface area where the vehicle 1 is traveling based on the detection of the road surface by the external camera 35. When the road surface area for the road surface rendering rises relative to the road surface area where the vehicle 1 is traveling, the CPU 44 suppresses the light projection for the road surface rendering by the projection modules 53.
When the road surface area for the road surface rendering rises relative to the road surface area where the vehicle 1 is traveling and intense light may be reflected toward the driver of the vehicle 1, the light projection for the road surface rendering by the projection modules 53 can be suppressed.
In this embodiment, when the traveling vehicle 1 approaches, for example, an uphill as illustrated in
The embodiment described above is an exemplary embodiment of the disclosure but is not limitative, and various modifications or alterations may be made without departing from the scope disclosed herein.
In the embodiments described above, the projection module 53 is provided in the vehicle 1 while being integrated with the headlamp LEDs 51 and 52 in the right headlamp module 31 or the left headlamp module 32.
For example, the projection module 53 may be provided in the vehicle 1 separately from the right headlamp module 31 or the left headlamp module 32.
The vehicle 1 may include one, three, or more projection modules 53. The one projection module 53 or the third projection module 53 may be provided at the center of the front part of the vehicle in a width direction.
The vehicle according to the embodiment of the disclosure includes the detection device configured to detect the road surface where the projection member projects the light for the road surface rendering. The controller configured to control the light projection for the road surface rendering by the projection member determines whether the road surface area for the road surface rendering rises relative to the vehicle based on the detection of the road surface by the detection device. When the road surface area for the road surface rendering rises relative to the road surface area where the vehicle is traveling, the controller suppresses the light projection for the road surface rendering by the projection member.
When the road surface area for the road surface rendering rises relative to the road surface area where the vehicle is traveling, the light projection for the road surface rendering by the projection member can be suppressed.
In the embodiment of the disclosure, when the traveling vehicle approaches, for example, an uphill, it is possible to reduce the occurrence of a case where light that is more intense than expected is reflected toward the driver of the vehicle due to the light projection for the road surface rendering. In the embodiment of the disclosure, the road surface rendering from the vehicle can be improved.
The rendering control device 21 illustrated in
Number | Date | Country | Kind |
---|---|---|---|
2023-021178 | Feb 2023 | JP | national |