Patent Grant
7815313
The present invention relates to a drive sense adjusting apparatus and a drive sense adjusting method, which are for adjusting a drive sense of a driver by presenting a visual stimulus into a vision of the driver.
Heretofore, as disclosed in Japanese Patent Laid-Open Publication No. H11-149272, there has been known a speed sense correcting device for controlling a speed sense of a driver by presenting, as a visual stimulus to the driver, a pattern (reverse-running pattern) moving so as to recede from a vision of the driver. According to such a speed sense correcting device, an incorrect speed sense formed in the driver's brain after high-speed running can be corrected in a short time, and a safe drive can be ensured in a drive that follows.
However, the speed sense correcting device described above is configured in order to correct a contradiction in the speed sense of the driver, and accordingly, cannot stabilize a drive sense of the driver more by adjusting the drive sense concerned of the driver. Moreover, the speed sense correcting device described above is one that controls the speed sense of the driver, and accordingly, cannot control drive senses of the driver other than the speed sense, which are such as a heading perception and equilibrium sense of the driver.
The present invention has been made in order to solve the above-described problems. It is an object of the present invention to provide a drive sense adjusting apparatus and a drive sense adjusting method, which are capable of adjusting a drive sense of a driver and stabilizing the drive sense of the driver more by presenting a visual stimulus into a vision of the driver.
In order to achieve the above-described object, a drive sense adjusting apparatus and a drive sense adjusting method according to the present invention display a visual stimulus, and control the visual stimulus so as to allow a driver to perceive the visual stimulus approaching the driver or receding therefrom in response to at least one of a driving environment, a vehicle condition, and a driver condition.
Moreover, a drive sense adjusting apparatus according to the present invention is provided in a vehicle, and includes: a visual stimulus presentation unit for presenting a visual stimulus to a display screen, the visual stimulus presentation unit being provided in a vision of a driver; and an imaging unit for imaging a video outside of the vehicle, the imaging unit being disposed on a vertical plane including a straight line connecting an eyeball position of the driver and a center portion of the display screen to each other or at a position where the straight line and an optical axis substantially coincide with each other, wherein the visual stimulus presentation unit presents the video outside of the vehicle as the visual stimulus onto a display screen, the video being imaged by the imaging unit.
Furthermore, a drive sense adjusting apparatus according to the present invention is provided in a vehicle, and includes: a visual stimulus presentation unit for presenting a visual stimulus to a display screen, the visual stimulus presentation unit being provided in a vision of a driver; and a visual stimulus creation unit for creating the visual stimulus presented by the visual stimulus presentation unit, wherein the visual stimulus creation unit creates a visual stimulus equivalent to a road optical flow accompanied with a vehicle motion corresponding to a sight direction of the driver to the visual stimulus presentation unit.
According to the drive sense adjusting apparatus and the drive sense adjusting method in accordance with the present invention, visually induced vection can be produced for the driver by the visual stimulus. Accordingly, the drive sense of the driver is adjusted, thus making it possible to stabilize the drive sense of the driver more.
Moreover, according to the drive sense adjusting apparatus in accordance with the present invention, a direction perpendicular to the screen of the visual stimulus presentation unit and a direction of a displayed image are substantially the same. Accordingly, when the driver visually recognizes the display screen, the image outside of the video, which is displayed on the display screen, and an environment outside of the vehicle, are easily associated with each other, thus making it possible to stabilize the drive sense of the driver.
Furthermore, according to the drive sense adjusting apparatus in accordance with the present invention, the visual stimulus equivalent to the road optical flow accompanied with the vehicle motion is presented into a peripheral vision of the driver, which is obstructed by functional components of the vehicle in a usual vehicle structure. Accordingly, an area of the entire road optical flow perceived by the driver is increased, thus facilitating for the driver to perceive the heading direction.
The inventors of the present application have repeatedly performed an energetic research aiming at visually induced vection. As a result, the inventors have found that, even if physical quantities such as pitching, rolling and yawing are not varied in a vehicle motion, a drive sense of a driver can be adjusted by presenting certain visual information thereto. Note that the above-described visually induced vection means a motion sense caused by visual information though oneself stands still. For example, the vection is a sense felt as if a standing railcar on which oneself is on board were moving when oneself views another railcar starting to move from a window of the standing railcar. Description will be made below in detail of a configuration and operation of a drive sense adjusting apparatus serving as embodiments of the present invention created based on the above-described finding with reference to the drawings. Note that, though the drive sense adjusting apparatus mainly controls a heading perception of the driver in the embodiments to be described below, it is a matter of course that the present invention is not limited to the control for the heading perception, and for example, can also be applied to processing for controlling an equilibrium sense of the driver.
As shown in
The driving environment detection unit 4 detects a scene image, a light quantity and a rainfall quantity outside of the vehicle as information indicating the driving environment outside of the vehicle. Moreover, the vehicle status detection unit 5 detects pitching, rolling, yawing, an acceleration G, a vehicle speed, a rolling angle, a steering angle and a steering angle speed as information indicating the state quantity of the vehicle 1. Furthermore, the driver status detection unit 6 detects an image of the driver and a physiological state of the driver, such as muscle potentials, brain waves, a heartbeat and a pulse, as information indicating the drive state of the driver.
The control unit 7 produces a visual stimulus in response to detection results of the driving environment detection unit 4, the vehicle status detection unit 5 and the driver status detection unit 6, displays the produced visual stimulus on the film 3 by controlling the projector 2, thereby presenting the visual stimulus to the driver. Note that, though the control unit 7 presents the visual stimulus onto the film 3 provided on the inner surface of the windscreen glass in this embodiment, the control unit 7 may present the visual stimulus by providing the film 3 on surfaces of other regions such as an upper face portion of the instrument panel, a front pillar portion, a headlining portion and a sun visor portion.
Then, the drive sense adjusting apparatus having such a configuration as described above executes the visual stimulus presentation processing to be described below, thereby adjusting and stabilizing the drive sense of the driver. Description will be made below in detail of the operation of the drive sense adjusting apparatus in the case of executing the visual stimulus presentation processing with reference to
In the case of performing the visual stimulus presentation processing, as shown in
With such a configuration, motions of the light spots Pn approaching the driver or receding therefrom, which are as shown in
Note that, though the inventors of the present application have confirmed that it is possible to control the heading perception of the driver even when a size of the light spots Pn is sufficiently small, a shape of the light spots Pn maybe a bar shape and a rectangular shape depending on an external environment such as a road environment. Moreover, the size of the light spots Pn may be arbitrary as long as the light spots Pn do not adversely affect a front view of the driver. Moreover, though the speeds Vn are given to the respective light spots Pn in this embodiment, the speeds of the respective light spots Pn may be varied depending on positions thereof within the vision of the driver, or uniform speeds may be given to the respective light spots Pn in matching with the vehicle speed of the vehicle 1.
Moreover, though the control unit 7 produces the visual stimulus by assuming the virtual spots In infinitely far forward the driver in this embodiment, a motion of a light spot as shown in
With such a configuration as described above, viewed from the driver, the visual stimulus approaching the driver is perceived like spring out of the virtual spot I, and on the contrary, the visual stimulus receding therefrom is perceived like vanishing to the virtual spot I. In particular, when the spot P is located at an eyeball position E of the driver or in the vicinity of the eyeball position E, it becomes further easy for the driver to perceive such a sense, and accordingly, it becomes possible to precisely control the heading perception of the driver by means of the motion of the visual stimulus.
Note that, as an example of changing the density distribution of the light spots correspondingly to the distances X, Y and Z, there is a case of lowering the density of the light spots on a center portion of an XY plane, for example as shown in
As apparent from the above description, in the drive sense adjusting apparatus serving as the first embodiment of the present invention, the control unit 7 presents the visual stimulus onto the film 3 adhered on the inner surface of the windscreen glass 8 of the vehicle 1, and controls the visual stimulus approaching the driver or receding therefrom to be perceived by the driver in response to the detection results of the driving environment detection unit 4, the vehicle status detection unit 5 and the driver status detection unit 6, thereby producing the visually induced vection in the driver by means of the visual stimulus. Accordingly, the drive sense of the driver can be adjusted in response to the vehicle state quantity, the driving environment and the driver state.
Moreover, in the drive sense adjusting apparatus serving as the first embodiment of the present invention, the control unit 7 controls the visual stimulus approaching the driver or receding therefrom from at least one virtual spot In to be perceived by the driver, and guides awareness of the driver to the direction of the virtual spot In. Accordingly, the heading perception of the driver can be adjusted in response to various situations.
A drive sense adjusting apparatus serving as a second embodiment of the present invention has the same configuration as that of the drive sense adjusting apparatus serving as the first embodiment. The control unit 7: (1) based on the eyeball position E of the driver and the steering angle, estimates a focus of expansion F caused by which the vehicle 1 moves forward or back; and (2) arranges plural virtual spots I in a near-field region FR of the focus of expansion F.
Specifically, as shown in
Here, the control unit 7 estimates the eyeball position E of the driver based on a seated position (a height of a seat cushion, a sliding quantity of a seat, and a seatback angle) of the driver and standard dimensions of a human body. Note that, in the case of estimating the eyeball position E more precisely, it is recommended to image a face of the driver by a stereo camera, and to estimate the eyeball position E by pattern matching processing.
Moreover, in general, the focus of expansion F is one that indicates the motion direction of the vehicle with respect to the global coordinate system. Accordingly, in the vehicle in which the heading direction is changed constantly by causes such as road unevenness, it is difficult to exactly specify the position of the focus of expansion F. Therefore, the control unit 7 arranges the plural virtual spots I in the near-field region FR of the focus of expansion F, and presents, as the visual stimulus to the driver, the light spots each of which irregularly repeats occurrence and vanishment or moves in each virtual spot I. With such a configuration as described above, in comparison with the case where the visual stimulus is generated from a fixed virtual spot I, the heading perception of the driver can be stably maintained.
Note that, though it is difficult to define a discrimination of the heading perception because a definition of the vicinity thereof differs depending on a road situation and a driving scene, it is said that, as shown in
Moreover, when the vehicle steadily turns, the control unit 7 makes the following definitions as shown in
Note that the directions θR and θL of the focus of expansion F are represented by the following Formulae 1 and 2. Moreover, the offset amount D of the driver's seat center P1 with respect the vehicle center P0 is regarded as positive in the case where the driver's seat center P1 is offset in the right direction with respect to the vehicle center P0. Moreover, parameters such as the turning radius R, the distance WL and the distance WR may be defined based on actual distances with reference to information from a car navigation system on, for example, a highway, or may be estimated based on a detection result of a sight direction of the driver. Moreover, the turning radius R may be estimated based on the vehicle speed and the steering angle.
θR=cos−1{(R−WR)/(R−D)} [Formula 1]
θL=cos−1{(R−WL)/(R+D)} [Formula 2]
Moreover, in this embodiment, when the vehicle is going straight ahead, the visual stimulus is presented to the driver like spring out of the focus of expansion F generated as the vehicle travels ahead, as shown by dotted lines in
As apparent from the above description, according to the drive sense adjusting apparatus serving as the second embodiment of the present invention, the control unit 7 arranges the plural virtual spots I in the near-field region FR of the focus of expansion F, and presents, as the visual stimulus to the driver, the light spots each of which irregularly repeats occurrence and vanishment or moves in each virtual spot I. Accordingly, in comparison with the case where the visual stimulus is generated from the fixed virtual spot I, the heading perception of the driver can be stably maintained.
Here, in this embodiment, as shown in
With such a configuration as described above, in response to the variation of the acceleration vector applied to the driver or the vehicle 1 at the time of turning, posture guidance for a head posture inclined by the driver can be easily performed. Specifically, at the time of turning, the driver inclines the head, and an inclination of the outside viewed from the head is then increased in a reverse direction. In this case, the visual stimulus presented into the vision of the driver is rotationally displaced in the same direction as the inclination direction of the head, and thus it is made possible to compensate a motion of a visual element, such as a window frame, displaced in the reverse direction within the vision of the driver, which is one of causes to damage the equilibrium sense. Accordingly, the inclination displacement of the head at the time of turning can be stably guided, and the equilibrium sense of the driver can be stably maintained.
Moreover, in this embodiment, in response to the steering angle θ, the control unit 7 may also move the focus of expansion F in the left or right direction and the lower direction. Specifically, when the steering angle is varied by the angle θ in the left direction, as shown in
At this time, if no visual stimulus is presented, and the driver undesirably maintains a higher viewpoint position than a viewpoint lowered accompanied with a proper change of the driving posture owing to some influence of a vibration disturbance and the like, then a lower acceleration applied to the head is reduced momentarily, and there occurs a momentary feeling of wrongness in equilibrium sense, which is just like a discomfort at a moment when an elevator starts to descend. Hence, the focus of expansion F is moved in the left or right direction and the lower direction in response to the steering angle θ, thus making it possible to stably guide the height variation of the head position, and to stably maintain the equilibrium sense of the driver.
Moreover, when the focus of expansion F is moved in the left or right direction and the lower direction in response to the steering angle θ, the control unit 7 may vary a moving quantity of the focus of expansion F between a left turning and a right turning. Specifically, in the case of a vehicle in which the driver's seat is on the right side, when angles made of the moving direction of the focus of expansion F and the horizontal direction in the left turning and the right turning are defined as θl and θr, respectively, as shown in
Moreover, in the case of moving the focus of expansion F in the left or right direction and the lower direction in response to the steering angle θ, as shown in
Note that a lateral acceleration gr applied to the driver at the time of turning is represented as the following Formula 3 based on the turning radius R (refer to
Gr=V^2/R [Formula 3]
R=L/β [Formula 4]
Gr=βV^2/L [Formula 5]
φ1=atan(Gr/Go) [Formula 6]
Hence, the angle φ1 is represented as the following Formula 7 based on the steering angle β (=steering angle θ/steering gear ratio n) of the front wheels of the vehicle concerned, the wheel base L thereof, the vehicle speed V and the gravitational acceleration g0 by assigning the Formula 5 to the Formula 6. Then, an angular position variation φ of the visual stimulus is represented as the following Formula 8 when a proportionality constant is α. Accordingly, the angular position variation φ of the visual stimulus may also be calculated by using the Formula 6 and the Formula 7. Note that, if the proportionality constant α is 1, the visual stimulus is varied in angle like a pendulum in a similar way to the angle variation of the vector of the acceleration applied to the driver. Moreover, if the proportionality constant α is within a range of 0<α<1, the angle variation becomes smaller than the angle variation of the vector of the acceleration applied to the driver. It is experimentally understood that, in general, the inclination range of the head of the driver owing to the turning is incorporated in the above-described range.
φ1=atan {(β·V^2)/(L·G)} [Formula 7]
φ=αφ1 [Formula 8]
A drive sense adjusting apparatus serving as a third embodiment of the present invention has the same configuration as that of the drive sense adjusting apparatus serving as the first embodiment. The control unit 7: (1) as shown in
With such a configuration as described above, the control unit 7 will present the visual stimulus only to a part of the region within the vision, and accordingly, the driver can be prevented from feeling trouble by the presentation of the visual stimulus, and in addition, a presented region effective in adjusting the heading perception can be set in response to the situation. Moreover, even if the film 3 is provided on a region having a curvature, such as the windscreen glass, the upper surface of the instrument panel and the front pillar portion, a visual stimulus free from distortion can be presented to the driver.
A drive sense adjusting apparatus serving as a fourth embodiment of the present invention has the same configuration as that of the drive sense adjusting apparatus serving as the third embodiment. When the horizontal direction and the vertical direction on the vertical plane VP with a point O thereon taken as a center is an X direction and a Y direction, respectively, the control unit 7 changes a transmittance of the visual stimulus in response to distances in the X direction and the Y direction. Specifically, as shown in
With such a configuration as described above, the situation of the vehicle in the heading direction can be grasped through the portion where the transmittance of the visual stimulus is high, and accordingly, the visual stimulus presented to the driver can be prevented from inhibiting the driver's grasp of the situation in the heading direction. Note that the control unit 7 may change the region where the transmittance of the visual stimulus is to be changed in response to the driving scene. Alternatively, the control unit 7 may enhance transmittances of the vicinity of the focus of expansion F caused by the traveling of the vehicle and of the vicinities of the left and right pillars from which other objects such as a pedestrian may run into the vehicle. Moreover, in a similar way, the control unit 7 may change the transmittance of the visual stimulus in response to a depth direction Z.
A drive sense adjusting apparatus serving as a fifth embodiment of the present invention has the same configuration as that of the drive sense adjusting apparatus serving as the third embodiment. As shown in
A drive sense adjusting apparatus serving as a sixth embodiment of the present invention has the same configuration as that of the drive sense adjusting apparatus serving as the third embodiment. The control unit 7 radially divides a display range of the visual stimulus. Specifically, in a state where the vehicle is going straight ahead on a road leading far away, such as a highway, as shown in
θR1=tan−1{(WL+D)/h} [Formula 9]
θL1=tan−1{(WR−D)/h} [Formula 10]
Furthermore, assuming structure heights on the left and right sides as SL and SR, respectively, the control unit 7 calculates angles θL2 and θR2 of left and right divided lines between the road surface portion and the structure based on the following formulae 11 and 12, and divides the virtual plane VP by the calculated angles θL1 and θR1 (refer to
θL2=tan−1{(WL+D)/(h−SL)}[Formula 12]
θR2=tan−1{(WL−D)/(h−SR)}[Formula 11]
Then, as shown in
Moreover, as described above, the respective divided regions differ depending on the running condition, and with regard to the left and right divided regions, the left and right structure heights SL and SR are increased by buildings and the like when the vehicle runs at an urban area, and accordingly, the display range is enlarged. Moreover, in a country regulating that the vehicle runs on the left side, a pavement is on the left side, and an oncoming car runs on the right side, and accordingly, a right-side flow is increased. Hence, in such a case, it is desirable to allocate a visual stimulus obtained by a self-motion to the right side so that left and right flows can be made even.
As apparent from the above description, according to the drive sense adjusting apparatus serving as the sixth embodiment of the present invention, when the control unit 7 radially divides the virtual plane with the vehicle heading direction taken as the center, and projects the visual stimulus onto the virtual plane VP, the control unit 7 controls the visual stimulus in response to the running direction to be projected on at least one regions radially divided. Accordingly, a visual stimulus more in touch with an actual instance can be presented in response to the outside scene and the drive condition.
A drive sense adjusting apparatus serving as a seventh embodiment of the present invention has the same configuration as those of the drive sense adjusting apparatuses serving as the first to sixth embodiments. The control unit 7 controls the visual stimulus so that a contrast of an element of the visual stimulus gets weaker as the element approaches the virtual spot (a center position of the virtual plane in this case). With such a configuration as described above, the driver perceives the virtual spot like being located far away by means of the aerial perspective as one of depth perception phenomena, and accordingly, a natural visual stimulus approximate to the actual scene is presented, thus making it possible to prevent the driver from feeling trouble over the visual stimulus. Moreover, according to the aerial perspective, as the element of the visual stimulus approaches the virtual spot, a bluing effect of the color thereof is increased, brightness thereof is lowered, and a density thereof is enhanced, thus also making it possible to obtain a similar effect. Furthermore, the control unit 7 may vary the contrast in response to the depth direction Z by a similar method.
A drive sense adjusting apparatus serving as an eighth embodiment of the present invention includes a sensor for detecting light quantities outside the vehicle and inside the cabin in addition to the configurations of the drive sense adjusting apparatuses serving as the first to seventh embodiments. The control unit 7 varies at least one of the brightness, contrast, color, density and opacity of the visual stimulus in response to the light quantities outside the vehicle and inside the cabin. In general, the external light is always varied at the time of driving the vehicle, and accordingly, the case is conceived, where the driver cannot recognize the visual stimulus. Hence, with such a configuration as described above, it is made possible for the driver to recognize the visual stimulus in any running scene.
A drive sense adjusting apparatus serving as a ninth embodiment of the present invention has the same configuration as those of the drive sense adjusting apparatuses serving as the first to eighth embodiments. The vehicle status detection unit 5 detects the lateral acceleration of the vehicle. Then, when the variation of the lateral acceleration during a time Δt is a predetermined value or more, the control unit 7 determines that there is a lurch in the heading direction of the vehicle, estimates the heading direction of the vehicle based on the steering angle during the time Δt, and presents the visual stimulus from the virtual spot fixed to the global coordinate system. Note that the control unit 7 may also determine the lurch of the vehicle based on the pitching, the rolling, the yawing, the acceleration G, the vehicle speed, the roll angle, the steering angle, the steering angle speed and the like. Then, with such a configuration as described above, the lurch of the vehicle can be corrected by the visual stimulus, and accordingly, the unstableness felt by the driver owing to the lurch can be reduced.
A drive sense adjusting apparatus serving as a tenth embodiment of the present invention has the same configuration as those of the drive sense adjusting apparatuses serving as the first to ninth embodiments. The driving environment detection unit 4 detects whether or not a wiper arm is operated. Then, when the wiper arm is operated, the control unit 7 determines that the heading direction of the vehicle is obscure, and presents the visual stimulus. Note that the control unit 7 may also determine that the heading direction of the driver is obscure in the case of having detected that it is raining by means of a raindrop sensor and in response to nature environments such as fogging, snowing and a sandstorm. Moreover, the control unit 7 may also make the above-described determination by measuring a motion of an external structure based on an image imaged by an external camera provided on the vehicle. Then, with such a configuration as described above, even if the heading direction of the vehicle is obscure for the driver, the driver can grasp the heading direction of the vehicle by means of the visual stimulus.
A drive sense adjusting apparatus serving as an eleventh embodiment of the present invention has the same configuration as those of the drive sense adjusting apparatuses serving as the first to tenth embodiments. The driver status detection unit 6 detects the number of winks of the driver and the motion of the eyeball thereof. Then, when the number of winks reaches a fixed value or more, the control unit 7 determines that an arousal state of the driver is low, and presents the visual stimulus so that the driver cannot lose sight of the heading direction. Moreover, based on the motion of the eyeball, the control unit 7 determines that the driver is looking aside while driving when a moving quantity of the sight with respect to the heading direction is large, and a pause thereof is 0.2 [second] or more. Then, the control unit 7 presents the visual stimulus. With such a configuration as described above, even if the awareness of the driver is low, the driver can be allowed to grasp the heading direction more, and to increase the awareness to the heading direction.
As a method of adjusting the drive sense of the driver, thereby stabilizing the drive sense of the driver, conceived is a method of disposing a window (frame) penetrating the vehicle body within the peripheral vision of the driver in the cabin, and presenting visually perceived information of the environment outside the vehicle, particularly, of the road optical flow through the window. However, it is not a realistic method to actually dispose the window as described above because such disposition affects the functional components of the vehicle. Note that, in order to solve such a problem, conceived is a method of imaging and presenting a video of the environment outside the vehicle, which is obstructed by the vehicle body and becomes a blindside from the driver, and correcting distortion of the imaged video outside the vehicle, thereby presenting a video outside the vehicle free from a feeling of wrongness to the vision of the driver.
However, in the case of simply presenting the video of the environment outside the vehicle, it is difficult for the driver to associate the video outside the vehicle and the scene outside the vehicle with each other owing to influences from a direction of an imaging device, transformation of the video outside the vehicle, an angle of view of the imaging device, the rolling (pitching) of the vehicle body and the like. Moreover, even if the video free from the feeling of wrongness is to be displayed for the vision of the driver by image processing, it takes time to perform the image processing, and accordingly, a shift occurs between a vehicle behavior by the drive operation and the video, and the video thus obtained cannot be effectively utilized as the visually perceived information of the road optical flow.
In this connection, with a configuration to be described below, a drive sense adjusting apparatus serving as a twelfth embodiment of the present invention facilitates the driver to associate the video outside the vehicle and the scene outside the vehicle with each other, thereby stabilizing the drive sense of the driver. Description will be made below of the drive sense adjusting apparatus serving as the twelfth embodiment of the present invention with reference to the drawings.
As shown in
Moreover, the imaging device 11 is disposed at a position on a vertical plane including the straight line 13 or where an optical axis 14 thereof substantially coincides with a position of the straight line 13. With such a configuration as described above, a direction perpendicular to the screen of the visual stimulus display device 12 and a direction of the video outside the image can be made to substantially coincide with each other. Accordingly, when the driver visually recognizes the display screen, the video outside the vehicle on the display screen and the environment outside the vehicle are easily associated with each other, thus making it possible to stabilize the drive sense of the driver.
Note that, as shown in
Hence, at an upper end portion of the visual stimulus display device 12 or an end portion of the visual stimulus display device 12, which is near the central vision when the driver gazes the heading direction, a function such as zooming of the imaging device 11 is used, image processing such as coordinate conversion is performed, and the disposition of the imaging device 11 or the visual stimulus display device 12 is adjusted on the vertical plane including the straight line 13 connecting the eyeball position E of the driver and the screen center of the visual stimulus display device 12 to each other or on an approximate straight line thereof. In such a way, as shown in
Moreover, at the upper end portion of the visual stimulus display device 12 or the end portion of the visual stimulus display device 12, which is near the central vision when the driver gazes the heading direction, the function such as zooming of the imaging device 12 is used, image processing such as cut-out of the image is performed, a wide lens is used, and the disposition of the imaging device 11 or the visual stimulus display device 12 is adjusted on the vertical plane including the straight line 13 connecting the eyeball position E of the driver and the screen center of the visual stimulus display device 12 to each other or on the approximate straight line thereof. In such a way, as shown in
With such a configuration as described above, even if the entire video outside the vehicle does not completely coincide with the environment outside the vehicle, the driver visually recognizes the video outside the vehicle by the single-eye gaze or the both-eye periphery viewing, thus making it possible to perceive the motion direction continuing with the road optical flow viewed through the front window freely from the feeling of wrongness. Moreover, the heading perception of the self motion straight ahead is facilitated based on the motion direction of the entire optical flow in which an area is increased. Note that investigation was performed for precisions of self-vehicle positions in a lane (lane keeping) when the driver is instructed to keep a center of the lane to actually drive the vehicle on a straight road both in a case of presenting the visual stimulus to the driver and a case of not presenting the same. As a result, as shown in
Note that, though not shown in the drawing, in the case of running on a curved road in the above-described experiment, it was found that the head posture of the driver during the turning is stabilized by presenting the visual stimulus. Moreover, the above-described experiment was performed by adjusting the displayed image in such a manner that a micro color camera (f=7.5 mm) as the imaging device 11 was attached onto a left side of a front bumper of the vehicle, a liquid crystal monitor (10.5 inches) as the visual stimulus display device 12 was disposed in the vicinity of a dashboard at the center of the vehicle width, and the eyeball position E of the driver, a center of the monitor and an optical axis of the camera were disposed so as to be located on an approximate straight line.
Moreover, as shown in
Accordingly, the function such as zooming of the imaging device 11 is used, the image processing such as the coordinate conversion is performed, the wide lens is used, and the disposition of the imaging device 11 or the visual stimulus display device 12 is adjusted on the vertical plane including the straight line 13 connecting the eyeball position E of the driver and the screen center of the visual stimulus display device 12 to each other or on the approximate straight line thereof. In such a way, it is desirable to correct the road range 17 imaged by the imaging device 11 so that a horizontal angle of view at a vertical center of the road range 17 can be made to substantially coincide with a right end point 22a of a vertical center of a left-eye vision 22 and a left end point 23a of a vertical center of a right-eye vision 23. With such a configuration as described above, in the case of such both-eye gaze, the position, depth perception, depth direction, speed and the like of the environment outside the vehicle can be associated with those of the displayed image outside the vehicle at a center thereof.
Moreover, as shown in
Note that, though the image displayed when the driver is gazing the visual stimulus display device 12 is the displayed screen on the navigation system in the example shown in
Moreover, as shown in
Moreover, as shown in
Moreover, as shown in
As shown in
As shown in
With such a configuration as described above, the road optical flow accompanied with the heading of the vehicle, which is viewed through the front window by the driver, and a flow of a component in the vehicle heading direction of the road optical flow presented by the visual stimulus presentation unit 43 become the same. Accordingly, it is made possible for the driver to perceive the motion direction continuously with the road optical flow viewed through the front window freely from the feeling of wrongness, and the heading perception of the self motion straight ahead is facilitated based on the motion direction of the entire optical flow in which the area is increased.
Note that a moving distance of each visual stimulus per unit time, that is, a moving speed thereof is made proportional to the vehicle speed detected by the vehicle state detection unit 41. Specifically, when the vehicle speed is 30 km per hour, the visual stimulus creation unit 42 creates a visual stimulus P having moved by 40 pixels in the left direction and 30 pixels in the lower direction on the screen at each refresh timing of the visual stimulus presentation unit 43. When the vehicle speed is 60 km per hour, the visual stimulus creation unit 42 creates a visual stimulus P having moved by 80 pixels in the left direction and 60 pixels in the lower direction on the screen.
Moreover, the shape of the visual stimulus P may be an arbitrary shape such as a circle, a rectangle, a star shape and a line shape as long as a motion thereof can be perceived within the region of the peripheral vision (refer to
Moreover, when the viewpoint position of the driver largely moves owing to a change of the driver, and the like, the virtual line VL defined in the visual stimulus presentation unit 43 and the virtual line VL defined from the virtual spot I ahead of the vehicle sometimes shift from each other. In such a case, for example as shown in
As apparent from the above description, according to the drive sense adjusting apparatus serving as the thirteenth embodiment of the present invention, the optical flow having the same component in the vehicle heading direction, which is the same as that of the optical flow of the road viewed by the driver through the front glass, is displayed on the visual stimulus presentation unit 43, and the visual stimulus corresponding to the road optical flow accompanied with the vehicle motion is presented into the peripheral vision of the driver, which is obstructed by the functional components of the vehicle in the usual vehicle structure. Accordingly, the area of the entire optical flow is increased, thus facilitating for the driver to perceive the heading direction.
As shown in
As shown in
Next, as shown in
Here, a moving distance of each information line IL per unit time, that is, a moving speed thereof is made proportional to the vehicle speed detected by the vehicle state detection unit 41. Specifically, when the vehicle speed is 30 km per hour, the visual stimulus creation unit 42 creates an information line IL having moved by 30 pixels in the lower direction on the screen at each refresh timing of the visual stimulus presentation unit 43. When the vehicle speed is 60 km per hour, the visual stimulus creation unit 42 creates an information line IL having moved by 60 pixels in the lower direction on the screen. Moreover, when the information line IL reaches the lower end of the screen of the visual stimulus presentation unit 43, the visual stimulus presentation unit 43 displays the information line IL repeatedly while moving the information line IL from the upper end of the screen. In addition, the virtual lines VL1 and VL2 and the display lines DL are not displayed actually.
Note that, as shown in
Moreover, in general, it is known that, in the case of viewing such a comparatively broad plane as corresponding to a floor or the ground, a perception of a plane expanding in the depth direction is affected by a size variation and a density variation, which is thus affected not by a shape of an object but largely by the perspective method (for example, refer to THE VISION SOCIETY OF JAPAN, Ed., Visual Information Processing Handbook (in Japanese), Asakura Shoten). Accordingly, as shown in
Note that, in the case of displaying the information lines IL while making a movement thereof, the moving distance thereof is increased as the Y coordinate is increased. Moreover, in addition to display intervals of the information lines IL, a thickness of each information line IL is thickened, thus making it possible to express the information lines IL while emphasizing the perspective. Furthermore, the above-described masking areas R1 and R2 are set, thus making it possible to display the information lines IL while further emphasizing the perspective by the lengths and intervals thereof.
Moreover, owing to an influence of the vehicle behavior such as the rolling, the virtual lines VL defined in the visual stimulus presentation unit 43 and the virtual lines VL defined from the virtual spot I ahead of the vehicle sometimes shift from each other. In such a case, the inclination angle of the vehicle with respect to the road, such as the roll rate and the yaw rate, is detected in the vehicle state detection unit 41, and based on a detection result, a position of the virtual spot I is moved in the crosswise direction or the vertical direction with respect to the vehicle heading direction as shown in
Note that, since the virtual spot I and the virtual lines VL are not actually displayed on the visual stimulus presentation unit 43, one that is actually affected by the influence of the vehicle behavior on the display is only the information lines IL. Accordingly, the information lines IL may also be created so that a gradient of the information lines can be spatially perpendicular to the vehicle heading direction. Specifically, if the influence is of a roll rate on the right side in the vehicle heading direction, it is satisfactory if the right side of each information line IL be inclined upward, or the left side thereof be inclined downward, or in both ways in response to the roll angle of the vehicle. Moreover, the information lines IL may also be inclined by moving the virtual spot I to the left side.
Moreover, also in the case where the viewpoint position of the driver is varied owing to the change of the driver, and the like, as described above, the virtual lines VL defined in the visual stimulus presentation unit 43 and the virtual lines VL defined from the virtual spot I ahead of the vehicle sometimes shift from each other. Accordingly, it is recommended that the virtual spot I be able to be moved in the vertical direction or the crosswise direction by an operation of the driver, such as turning of a switch. Furthermore, in the embodiment described above, a device (for example, refer to Japanese Patent No. 3465566) for detecting the eye position of the driver based on image data including the face of the driver may be provided, and the virtual spot I may be defined by using a detection result of the device concerned.
As apparent from the above description, according to the drive sense adjusting apparatus serving as the fourteenth embodiment of the present invention, among the road optical flow accompanied with the heading of the vehicle, a moving component thereof in the lateral direction with respect to the vehicle heading direction is displayed, and accordingly, thus making it possible to facilitate the heading perception by means of the minimum display information. Moreover, even if the eyeball position E of the driver is moved in the lateral direction, the driver can perceive the motion direction continuously with the road optical flow viewed through the front window freely from the feeling of wrongness.
Moreover, according to the drive sense adjusting apparatus serving as the fourteenth embodiment of the present invention, to the display information, imparted can be a depth sense continuous with a depth sense of the road viewed through the front window by the driver, and accordingly the heading perception can be facilitated by means of more natural display information. Moreover, the movement of the virtual spot I makes the change of the gradient of the information lines IL. Accordingly, the gradient shift of the virtual lines IL from the road optical flow viewed through the front window, which is caused by the influence of the vehicle behavior such as the rolling, can be solved, and the heading perception can be facilitated by means of the natural display information irrespective of the vehicle behavior.
Furthermore, according to the drive sense adjusting apparatus serving as the fourteenth embodiment of the present invention, it is possible to solve such inconsistency between the virtual lines VL defined in the visual stimulus presentation unit 43 and the virtual lines VL defined from the virtual spot I ahead of the vehicle, which may be caused when the sight position largely moves owing to the change of the driver, and the like. Accordingly, the heading perception can be facilitated by means of the natural display information irrespective of the variation of the viewpoint position of the driver.
As shown in
In the drive sense adjusting apparatus serving as the fifteenth embodiment of the present invention, the visual stimulus creation unit 42 creates, as the visual stimulus, two types of information lines IL1 and IL2 moving continuously while maintaining a parallel relationship to the display line DL, and as shown in
At this time, in the case of applying the geometric perspective to the information lines IL1 and IL2, the display moving distances thereof differ between the upper end of the screen and the lower end of the screen. Accordingly, it is needless to say that the above-described values are mean values of the moving quantities of the respective information lines. Moreover, between the display lines IL1 and IL2, the display brightness, or the chroma or lightness of a display is different. Accordingly, the driver can perceive that the information lines IL1 and IL2 concerning two different speed components are displayed to be moved. Meanwhile, it is conceived that the display lines IL1 and IL2 are superimposed on each other because the display moving speeds of the display lines IL1 and IL2 differ from each other. In this case, desirably, the display brightness, the chroma or lightness of the display color, or a combination of both in the superimposed information lines IL1 and IL2 take the respective intermediate values thereof. In such a way, the respective information lines IL1 and IL2 can be perceived while maintaining continuity of the flows thereof.
As apparent from the above description, according to the drive sense adjusting apparatus serving as the fifteenth embodiment of the present invention, the flows perceived while maintaining the continuity at the two types of speeds are displayed, thus making it possible to present a speed difference component that is faster or slower than a target speed or equal thereto, that is, a relative speed. Moreover, a magnitude of the speed difference is expressed by a cycle change of the display brightness. Accordingly, the magnitude of the speed difference can be presented as information perceivable within a peripheral vision region that is excellent in acquisition for temporal information concerning a lightness variation and perception of an object (for example, refer to Tadahiko Fukuda, Functional Difference Between Central Vision and Peripheral Vision in Driving Perception (in Japanese), Journal of the Institute of Television Engineers of Japan, vol. 32, No. 6, pp. 492 to 498).
As above, description has been made of the embodiments to which the invention created by the inventors of the present invention is applied. However, the present invention is not limited to the descriptions and the drawings, which form a part of the disclosure of the present invention according to these embodiments. Specifically, all of other embodiments, examples, operational techniques and the like, which are made by those skilled in the art based on these embodiments, are naturally incorporated in the scope of the present invention. The above is additionally described at the end of this specification.
The entire content of Japanese Patent Application No. TOKUGAN 2004-225820 with a filing date of Aug. 2, 2004, and Japanese Patent Application No. TOKUGAN 2005-145404 with a filing date of May 18, 2005, is hereby incorporated by reference.
| Number | Date | Country | Kind |
|---|---|---|---|
| P2004-225820 | Aug 2004 | JP | national |
| P2005-145404 | May 2005 | JP | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 4962998 | Iino | Oct 1990 | A |
| 5028912 | Iino | Jul 1991 | A |
| 5051735 | Furukawa | Sep 1991 | A |
| 5410346 | Saneyoshi et al. | Apr 1995 | A |
| 5506595 | Fukano et al. | Apr 1996 | A |
| 6727807 | Trajkovic et al. | Apr 2004 | B2 |
| 6774772 | Hahn | Aug 2004 | B2 |
| 6789901 | Kormos | Sep 2004 | B1 |
| 6947064 | Hahn et al. | Sep 2005 | B1 |
| 7382288 | Wilson et al. | Jun 2008 | B1 |
| 7519471 | Shibata et al. | Apr 2009 | B2 |
| 20020011925 | Hahn | Jan 2002 | A1 |
| 20040016870 | Pawlicki et al. | Jan 2004 | A1 |
| 20050134479 | Isaji et al. | Jun 2005 | A1 |
| 20050219057 | Ihara et al. | Oct 2005 | A1 |
| 20080158096 | Breed | Jul 2008 | A1 |
| Number | Date | Country |
|---|---|---|
| 11-149272 | Jun 1999 | JP |
| Number | Date | Country | |
|---|---|---|---|
| 20060022808 A1 | Feb 2006 | US |
