This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2010-127753, filed on Jun. 3, 2010; the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to a display apparatus and a display method.
As a display apparatus mounted on a vehicle, a head-up display (HUD) is widely used. The HUD presents a CG image to eye (one eye or both eyes) of an observer (driver). In this case, the CG image is a target representing an advance direction (moving direction) of the vehicle, or a location to indicate to the observer.
For example, above-mentioned technique is disclosed in JP-A 2009-244355. As to this display apparatus, the CG image had better be a target for the observer to easily view. Briefly, the display apparatus for displaying such CG image is desired.
In general, according to one embodiment, a display apparatus mounted on a vehicle includes a generation unit and a presentation unit. The generation unit is configured to generate a CG image in a CG space having a coordinate system corresponding to a scene viewed from a view point of an observer. The CG image represents a target to be perceived by the observer. The presentation unit is configured to present the CG image to at least one eye of the observer. The generation unit generates a plurality of CG images of the target advancing to a specific coordinate in the CG space and going back from the specific coordinate based on a velocity of the vehicle. The target is perceived by the observer so that the target is advancing from the vehicle to a specific location corresponding to the specific coordinate in the scene and stops at the specific location for a specific time.
Hereinafter, embodiments of the present invention will be explained by referring to the drawings. The present invention is not limited to the following embodiments.
In
At a timing when the vehicle 20 approaches a temporary destination along a route to a final destination, the display apparatus 1 starts to display the CG image of the target 10. The temporary destination is a place to guide or urge the observer 100 to pay attention along the route to the final destination, for example, an intersection to turn to the right or left.
The display apparatus 1 makes the observer 100 perceive, in a front scene viewed by the observer 100, that the target 10 is moving toward the temporary destination and, after reaching the temporary destination, the target 10 stops at the temporary destination for a specific time. As a result, the display apparatus 1 can present the CG image of the target for the observer to easily view.
The display apparatus 1 includes a generation unit 11, a storage unit 12, and a presentation unit 13. The generation unit 11 includes a route determination unit 111, a specific location determination unit 112, a location decision unit 113, and a CG image generation unit 114. The generation unit 11 and the storage unit 12 may be realized as a CPU (Central Processing Unit) and a memory used by the CPU.
When the route determination unit 111 receives information of the final destination (desired by the observer 100) of the vehicle 20, the route determination unit 111 determines a route for the vehicle 20 to trace before arriving at the final destination. Map information includes a route map. For example, the map information is stored in the storage unit 12.
The specific location determination unit 112 determines one or a plurality of temporary destinations along the route (determined by the route determination unit 111). The temporal destinations are stored in the storage unit 12.
The location decision unit 113 decides whether the vehicle 20 is near any of temporary destinations by using vehicle information. The vehicle information includes the present location and a velocity of the vehicle 20. The vehicle information is acquired from a location measurement means (not shown in
When the vehicle 20 is near the temporary destination, the CG image generation unit 114 generates a plurality of CG images of the target 10. Each CG image is generated in order for the observer 100 to perceive the target 10 moving from a start position (a location initially indicated by the target on the route) to the temporary destination and stopping at the temporary destination for a specific time. The CG image generation unit 114 outputs each CG image of the target 10 to the presentation unit 13. Its detail processing is explained afterwards.
The presentation unit 13 presents a light flux 5 (including CG image of the target 10) to the observer 100. Briefly, the presentation unit 13 irradiates the light flux 5 toward a front glass 21. A combiner may be installed onto the front glass 21. The front glass 21 reflects the light flux 5 toward eyes 101 of the observer 100.
The presentation unit 13 includes a light source 131, a limiter unit 132, a diffusion unit 133, an image forming unit 134, a first lens 135, an aperture unit 136, a second lens 137, and a reflection plate 138.
Assume that a focal distance of the first lens 135 and the second lens 136 is f1 and f2 respectively. The aperture unit 136 is installed at a position having a distance f1 from the first lens 135 and a distance f2 from the second lens 137.
As to the light flux 5 irradiated from the light source 131, the advance direction is limited by the limiter unit 132. Under this condition, the light flux 131 is incident onto the image forming unit 134 having the diffusion unit 133. By the diffusion unit 133, the light flux 5 is diffused and uniformly incident onto the image forming unit 134. By partially transmitting or shutting the light flux 5, the image forming unit 134 forms a light flux 5 having shape of the target 10.
The light flux 5 from the image forming unit 134 is passed through the first lens 135, the aperture unit 136 and the second lens 137. The light flux 5 of which divergence angle (angle spread by the light flux 5) is controlled is incident onto the reflection plate 138. The reflection plate 138 reflects the light flux 5 toward the front glass 21.
The image forming unit 134 is located at a side of the light source 131 from the aperture unit 136. Accordingly, in comparison with a case that the aperture unit 136 is located at a side of the light source 131 from the image forming unit 134, a transmittance of the light flux 5 passed through the image forming unit 134 rises. As a result, a power consumption of the light source 131 can be suppressed.
As the light source 131, a light emitting diode, a high pressure mercury lamp, a halogen lamp or a laser, are used. As the limiter unit 132, a taper light gas is used. As the diffusion unit 133, a diffusion filter or a diffusion plate is used. As the image forming, unit 134, a liquid crystal display or a digital mirror device is used.
By referring to
After the final destination is determined (For example, the observer 100 indicates a final destination by an input device), the route determination unit 111 determines a route to be traced by the vehicle 20. The route represents a path from the present position to the final destination.
Along the route to the final destination, the specific location determination unit 112 determines one or a plurality of temporary destinations (S202). For example, the specific location determination unit 112 determines a position Pp=(Xpn,Ypn) (n=1,2,3, . . . ) of a cross point to turn to the right or the left along the route, as the temporary destination. A location of the temporary destination is stored in the storage unit 12.
While the vehicle 20 is running, the location decision unit 113 decides whether the vehicle 20 is near the temporary destination (S203). For example, it is decided whether a distance from the present location Pc of the vehicle 20 to the temporary destination Pp is within a specific value. The present location Pc may be a pointed end of the vehicle 20 or a position of the observer 100 who gets in the vehicle 20.
First, by using the location measurement means, the location decision unit 113 calculates the present location Pc=(Xc,Yc) of the vehicle 20. Next, the location decision unit 113 calculates a distance D from the present location Pc to the temporary destination. Last, the location decision unit 113 decides whether the distance D is within a specific value.
For example, the location decision unit 113 decides whether the distance D is within 100 m. If the distance D is not within the specific value (NO at S203), this decision processing is repeated until the distance D is within the specific value.
If the distance D is within the specific value (YES at S203), the CG image generation unit 114 generates a CG image of the target 10 for the observer 100 to perceive the target 10 advancing (moving forward) from the start position P0 to the temporary destination Pp and stopping at the temporary destination Pp (S204). The start position P0 is a location initially indicated by the target 10.
The start position may be preset, when the distance D is within the specific value, as a position P0=(x0,y0) moved a specific distance from the present location Pc0 of the vehicle 20 to the temporary destination Pp. For example, when a distance to the temporary destination Pp is within 100 m, a position moved 20 m from the present location Pc0 of the vehicle 20 to the temporary destination Pp may be set as the start position P0. Generation of the CG image is executed until the vehicle 20 arrives at the temporary destination Pp from the start position P0.
When the vehicle 20 arrives at the temporary destination Pp, the location decision unit 113 decides whether a next temporary destination exists along the route to the final destination (S205). If the next temporary destination does not exist along the route (NO at S205), the display apparatus 1 completes the processing.
If the next temporary destination exists along the route (YES at S205), processing is forwarded to S203. In this case, above-mentioned processing is executed for the next temporary destination. Thus far, processing to display the target by the display apparatus 1 was explained.
The CG image generation unit 114 generates CG image of the target 10 in CG space defined by CG coordinate system (x′,y′) based on the vehicle 20. A view point in the CG coordinate system had better be previously matched with an actual view point of the observer 100. For example, an origin of the CG coordinate system may be matched with the actual view point of the observer 100.
By this processing, the CG image generation unit 114 makes the observer 100 perceive the target 10 overlapped with a front scene of the front glass 21. Furthermore, by using a camera or a sensor (not shown in FIG.), the CG image generation unit 114 may measure a view point of the observer 100 at a specific interval and adjust the view point in the CG coordinate system.
Processing to generate CG image is explained in detail.
The CG image generation unit 114 generates a plurality of CG images in order for the observer 100 to perceive the target 10 advancing from the start position P0 to the temporary destination Pp. Whenever each CG image of the target 10 is generated, the presentation unit 13 presents the CG image to the observer 100 (S2041).
From a coordinate g0′ (corresponding to the start position Po) in the CG space, the CG image generation unit 114 starts to generate the CG image of the target 10. For example, by an equation (1), the CG image generation unit 114 may determine a coordinate g0′=(x0′,y0′) of the target 10 in the CG coordinate system (x′,y′) using the present location Pc0 (of the vehicle 20) and the start position P0.
q
0
′=P
0
−Pc
0=(x0−Xc,y0−Yc) (1)
The CG image generation unit 114 generates CG image of the target 10 at a coordinate g0′=(x0′,y0′) in the CG coordinate system. If the target 10 is an arrow, the CG image may be generated so that a pointed end of the arrow is located at the coordinate q0′=(x0′,y0′).
Based on a velocity of the vehicle 20 when the presentation unit 13 presents one CG image of the target 10, the CG image generation unit 114 may determine a coordinate qk′=(xk′,y′) (k=1,2, . . . ) to display a next CG image in the CG coordinate system by an equation (2) and generate the CG image of the target 10 in order. As to the equation (2), a coordinate of the present position of the vehicle 20 is subtracted from the start position P0, and the coordinate qk′ in the CG coordinate system is calculated using velocities of the vehicle 20 and the target 10.
Briefly, at an interval Δt (For example, 1/30 second), CG image of k-th target 10 to be displayed at the coordinate qk′ is generated in order. Δt represents a time to present one CG image by the presentation unit 13.
In the equation (2), Vck represents a velocity (vector) of the vehicle 20 when CG image of k-th target 10 is presented. The CG image generation unit acquires Vck from the velocity measurement means 25. Vk represents a velocity (vector) of k-th target 10. By using Vk, a position of (k+1)-th target 10 on the route is determined. Vc0 represents a velocity (vector) of the vehicle 20 when CG image of the target 10 at the start position P0 is presented. V0 represents a velocity (vector) of the target 10 at the start position P0. Moreover, a size (|vk|) of vk maybe a constant value (For example, (|v0|)). However, its size had better be larger than a size of velocity of the vehicle 20.
Furthermore, in order for the target 10 not to be overtaken by the vehicle 20, |vk| maybe changed based on the size |Vck| of Vck. For example, |vk| may be changed based on |Vck| so that |vk| is always larger than |Vck|.
In the equation (2), “k=0” represents the target 10 indicating the start position P0. Furthermore, as shown in an equation (3), a direction of k-th target 10 had better be a direction from a unit vector of velocity Vck of the vehicle 20 to a unit vector of velocity vk of k-th target 10.
By this processing, based on the present location and the velocity of the vehicle 20, the CG image generation unit 114 can correct a direction indicated by the target 10.
After the CG image of the target 10 arriving at the temporary destination is generated, the CG image generation unit 114 generates a CG image of the target 10 for the observer 100 to perceive the target 10 stopping at the temporary destination for a specific time. The presentation unit 13 dynamically presents the CG image of the target 10 to the observer 100 (S2042).
Briefly, the CG image generation unit 114 may decide whether CG image of the target 10 arriving at the temporary destination is generated by using an equation (4). The equation (4) represents that a location (generated in order from the present location Pc0 of the vehicle at a timing when the start position is determined) of the target 10 along the route is the temporary destination Pp.
In the equation (4), δ represents a threshold which an error occurred by packaging is taken into consideration. For example, δ may be set as 0.1.
While the vehicle 20 is approaching the temporary destination Pp, the CG image generation unit 114 generates CG image of the target 10 so that the target 10 is approaching a view point of the observer 100 in the CG coordinate system.
Briefly, the CG image generation unit 114 generates CG image so that the target 10 is going back based on a velocity of the vehicle 20 in CG space. For example, based on a velocity of the vehicle 20 at a timing when the presentation unit 13 presents CG image of a target 10, the CG image generation unit 114 may calculate a coordinate Qs′=(xs′,ys′) (s=1,2, . . . ) of the target 10 in the CG coordinate system, by an equation (5).
In the equation (5), Vcs represents a velocity (vector) of the vehicle 20 at a timing when CG image of s-th target 10 is presented. Furthermore, as shown in an equation (6), a direction ds′ of s-th target 10 had better be a direction from a unit vector of velocity Vcs of the vehicle 20 to a unit vector of velocity Vs of s-th target 10.
By this processing, the CG image generation unit 114 can correct a direction indicated by the target 10, based on a location and a velocity of the vehicle 20.
As shown in
By using the location measurement means, the CG image generation unit 114 decides whether the vehicle 20 arrives at the temporary destination Pp (S2043). If it is decided that the vehicle 20 does not arrive at the temporary destination (NO at S2043), processing is forwarded to S2042.
If it is decided that the vehicle arrives at the temporary destination (YES at S2042), the CG image generation unit 114 completes generation of CG image of the target 10. The presentation unit 13 completes presentation of CG image of the target 10 (S2044). As mentioned-above, detail processing of S204 is explained.
As to the display apparatus 1 of the first embodiment, CG image of the target for the observer to easily view can be presented. Moreover, in the first embodiment, the generation unit 11 executes all processing using two-dimensional coordinate (x,y) However, execution of processing is not limited to this method. For example, by executing processing using three-dimensional coordinate (x,y,z), the generation unit 11 can determine coordinates to generate the target 10, based on ups and downs of the route.
Furthermore, the CG image generation unit 114 may change a time Tm required for the target 10 to move from the start position P0 to the temporary destination Pp, and a time Ts while the target 10 stops at the temporary destination Pp, based on a velocity of the vehicle 20.
Furthermore, in the first embodiment, a method for indicating a temporary destination to the observer is explained. As to a method for indicating a final destination to the observer, the same processing can be applied.
In the first embodiment, the display apparatus 1 mounted onto a vehicle (car) is explained as an example. However, examples are not limited to this one. For example, the display apparatus 1 can be used for a general vehicle such as a ship, a helicopter, or a airplane.
Furthermore, in the first embodiment, by reflecting a light flux 5 on a front glass 21 of the vehicle 20, the presentation unit 13 presents the light flux 5 to eyes 101 of the observer 100. However, presentation processing of the light flux 5 is not limited to this method. For example, the image forming unit 134 is equipped on the front glass 21. In this case, the light flux 5 from the image forming unit 134 is directly presented to eyes 101 of the observer 100.
(Modification)
In a modification of the first embodiment, the CG image generation unit 114 generates CG image of the target 10 at a fixed velocity u (vector). This modification is applied to a case that the vehicle 20 is running at a fixed velocity Uc. In this case, the CG image generation unit 114 need not determine coordinates of the target 10 in CG space by the equation (2). Accordingly, processing cost can be suppressed. Hereinafter, the modification is explained in detail.
If it is decided that the vehicle 20 is near the temporary destination Pp (YES at S203), the CG image generation unit 114 generates CG image in CG space by advancing the target 10 at a fixed velocity in order.
In this case, based on a velocity u (fixed value) of the target 10, a distance D between the present location Pc0 of the vehicle 20 and the temporary destination Pp, a velocity tic (fixed value) of the vehicle 20 and a presentation time Δt of one image, the CG image generation unit 114 generates CG image for the observer 100 to perceive the target 10 advancing to the temporary destination Pp.
For example, assume that “u=80 (m/s) D=100 (m), Uc=60 (m/s) and Δt= 1/30 (s) ” By generating CG images of 150 slices in order, the CG image generation unit 114 makes the observer 100 perceive the target 10 advancing to the temporary destination Pp.
After that, in order for the observer 100 to perceive the target 10 stopping at the temporary destination Pp, the CG image generation unit 114 executes the same processing as the first embodiment.
As to the modification, processing cost of the CG image generation unit 114 can be suppressed.
As to the second embodiment, processing of the CG image generation unit 114 is different from that of the first embodiment.
If it is decided that the vehicle 20 is near the temporary destination Pp (YES at S203), the CG image generation unit 114 generates CG image for the observer 100 to perceive the target 30 stopping at the temporary destination Pp. The presentation unit 13 presents the CG image (S8041).
For example, by the equation (5), the CG image generation unit 114 determines a coordinate Qs′ of a target 10 in CG coordinate system, and locates another target 30 at the coordinate Qs′.
By using the location measurement means, the CG image generation unit 114 decides whether the vehicle 20 arrives at the temporary destination Pp (S8042). If it is decided that the vehicle 20 does not arrive at the temporary destination Pp (NO at S8042), processing is forwarded to S8041.
If it is decided that the vehicle 20 arrives at the temporary destination P, (YES at S8042), the CG image generation unit 114 completes generation of CG image of the target 30. The presentation unit 13 completes presentation of CG image of the target 30 (S8043).
The CG image generation unit 114 executes processing of
Moreover, if the target 30 has a bar shape, the CG image generation unit 114 may generate the target 30 of which lower part than a specific height is semi-transparent. By this processing, even if the vehicle 20 is vibrated by ups and downs of a surface where the vehicle 20 is running, the observer 100 can correctly recognize the temporary destination Pp.
As mentioned-above, in the second embodiment, the display apparatus to present CG image of the target for the observer to easily view can be provided.
While certain embodiments have been described, these embodiments have been presented by way of examples only, and are not intended to limit the scope of the inventions. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
P2010-127753 | Jun 2010 | JP | national |