This is a U.S. national stage of application No. PCT/DE2003/002271, filed on Jul. 7, 2003. Priority is claimed on the following application(s): Country: Germany, Application No.: 102 36 221.1, Filed: Aug. 7, 2002.
1. Field of the Invention
The invention relates to a method and a device in which navigational information for a vehicle is superimposed on an image of the vehicle environment, this graphic representation of the navigational information being transformed by a perspective transformation.
2. Description of Prior Art
Such a method or such a device is known from European patent application EP 0 406 946 A1.
In addition, there are navigation systems today which display to the driver the recommended route at a junction by means of pictograms and emit acoustic information, e.g. “Take the second turning on the right” or “Drive straight on at the roundabout”. Some systems also additionally show the recommended route on a map.
A vehicle is deemed below to refer not just to land vehicles but also to watercraft and airplanes.
SUMMARY OF THE INVENTION
An object of the invention is to indicate a method and a device for displaying navigational information for a vehicle such that the route through road traffic to a defined destination is displayed to a vehicle driver in an intuitive and easily comprehensible manner.
According to the invention, this object is met by a method for displaying navigational information for a first vehicle to a driver of the first vehicle, including the steps of displaying navigational information for the first vehicle in the form of a virtual pilot vehicle superimposed on an image of the vehicle environment of the first vehicle, determining a position, an orientation and a size of the displayed virtual pilot vehicle based on a current speed of the first vehicle, reference points for a recommended route, a position and orientation of the vehicle, a position and orientation of a camera for recording the first vehicle environment and an eye position and a line of sight of the driver, and using the virtual pilot vehicle to display a route or action recommendation indicating to “keep minimum distance from the vehicle ahead in accordance with the current driving speed” by positioning the virtual pilot vehicle on the image of the vehicle environment such that it appears to be proceeding in front of the driver at precisely the minimum distance currently required. Driving too close to a second vehicle in front of the first vehicle is shown by the second vehicle being located in the image between the driver and the virtual pilot vehicle.
The further claims relate to preferred embodiments of the method according to the invention.
The invention will be described below with reference to embodiments represented in the drawings, in which:
a is another view of a virtual pilot vehicle image displaying navigational information;
b is another view of a virtual pilot vehicle image displaying navigational information;
a is a schematic diagram of a route showing a position of the virtual pilot vehicle;
b is another schematic diagram of a route showing a position of the virtual pilot vehicle;
a is a display in which a virtual pilot vehicle image is shown in the vehicle environment as viewed by a driver;
b is a display of the virtual pilot vehicle image of
c is a windshield display of a virtual pilot vehicle image; and
d is a windshield display of the virtual pilot vehicle image of
According to the invention, navigational information for a vehicle is displayed intuitively and in an easily comprehensible manner in the form of a virtual pilot vehicle superimposed upon an image of the vehicle environment. The display mode and/or the position and/or the orientation and/or size of the virtual pilot vehicle are determined, for example, in accordance with the route information, speed, reference points for a recommended route and the position and orientation of the vehicle or of the camera for recording the vehicle environment.
In a preferred embodiment of the invention, the navigational information is represented with the aid of a virtual pilot in the form of a stylized vehicle which appears to be proceeding in front of the driver on the recommended route. Through its virtual driving maneuvers, the virtual pilot vehicle draws the attention of the driver to imminent real driving maneuvers.
Through its actions, the virtual pilot vehicle can display to the driver intuitively and in an easily comprehensible manner route recommendations or other action recommendations. Examples of such recommendations may comprise the following:
1. a recommendation to “turn right” or “turn left”, as shown in
2. a recommendation to “turn left onto a certain road” or to “turn right onto a certain road” as shown in
3. a recommendation to “drive carefully because of a safety hazard” approaching the driver, for example a traffic jam, roadworks, person driving on the wrong side of the road or similar, as shown in
4. a recommendation to “reduce speed” as shown in
5. a recommendation to “keep the minimum distance from the vehicle ahead in accordance with the current speed” is displayed by a virtual pilot vehicle being positioned on the road such that it appears to be proceeding in front of the driver at precisely the minimum distance currently required. If a real vehicle is now located between the driver and the virtual vehicle, then the driver has driven up too close to the real vehicle in front.
Here, the virtual pilot vehicle is embedded in a video image of the real scene ahead of the vehicle of the driver and is shown on a display or projected in front of the driver onto the windshield of his/her vehicle.
Since the virtual pilot vehicle behaves in principle like a real vehicle guiding the driver, the recommendations and instructions which the virtual pilot displays visually are intuitively comprehensible to the driver.
The pilot vehicle appears to be proceeding at a certain distance, the pilot distance d, ahead of the actual vehicle. This distance is advantageously dependent on the current speed of the vehicle and possibly on the maximum speed permissible or recommended at the current point.
This pilot distance is determined for example as follows:
Let the driving speed v and any applicable maximum speed v0 be given.
The unknown is the virtual pilot distance d.
If no maximum speed applies or if v<v0, then
If v>v0, it is recommended that the driver reduce speed. This is signaled by a shortening of the distance, i.e.
Here, the variable c can be chosen as fixed, e.g. c=2, or interpreted as a function of the type of road, e.g. c=2 in urban traffic, c=5 on country roads, c=6 on motorways.
Furthermore, in a preferred embodiment of the invention, the pilot position in global coordinates is determined as follows:
Let the vehicle position {right arrow over (P)} in global coordinates, e.g. measured via GPS, the information about the route recommended by the navigational system in the form of n reference points {right arrow over (R)}i and the distance by which the pilot proceeds ahead of the vehicle on the recommended route d be given.
The unknown is the pilot position {right arrow over (L)} in global coordinates and the pilot orientation {right arrow over (O)} in global coordinates, where {right arrow over (O)} forms the unit vector in the line of sight of the virtual pilot vehicle.
In order to determine the pilot position on the route, the position of the vehicle on the route must first be determined. To this end, the measured position {right arrow over (P)} of the vehicle is projected onto the route, as shown in
One way of doing this is to find the point {right arrow over (P)}0=(1−t0){right arrow over (R)}i
The pilot orientation is now given by
Through a perspective transformation, a 2-dimensional representation of the pilot is determined from the pilot position and the pilot orientation for superimposing on the video image or for projecting onto the windshield:
Case 1: Superimposing on a Video Image
Let the pilot position {right arrow over (L)}, the pilot orientation {right arrow over (O)}, the parameters of the real camera and a 3-dimensional description of the pilot model be given.
The unknown is the 2-dimensional representation of the pilot.
The position of the pilot model can be calculated in global coordinates from {right arrow over (L)} and {right arrow over (O)}. The projection images are computed from the parameters of a camera for recording the vehicle environment, and the model description of the pilot vehicle is projected onto the display plane.
The system is in this case equipped with a camera which records what happens in front of the vehicle. The virtual pilot vehicle is embedded into the individual video images in accordance with the route computed for the journey. The augmented reality image thus obtained is shown on a display within visual range of the driver (
In addition, for example, the recommended route for the journey is displayed. The further path of the virtual pilot vehicle is also visually displayed by the route for the journey
Case 2: Projection onto the Windshield
Let the pilot position {right arrow over (L)}, the pilot orientation {right arrow over (O)}, the position and line of sight of the driver determined via sensors and a 3-dimensional description of the pilot model be given. The unknown is the 2-dimensional representation of the pilot. The position of the pilot model in global coordinates can be calculated from {right arrow over (L)} and {right arrow over (O)}. The projection images are computed from the parameters of the eye position and line of sight, and the model description of the pilot vehicle is projected onto the display plane.
In this case, the eye position of the driver is determined, for example, first via a tracking system. Via a projection apparatus, the virtual vehicle is projected onto the appropriate point on the windshield in accordance with the route computed for the journey. (
The recommended route for the journey, for example, is additionally projected onto the windshield.
Number | Date | Country | Kind |
---|---|---|---|
102 36 221 | Aug 2002 | DE | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/DE03/02271 | 7/7/2003 | WO | 00 | 2/7/2005 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2004/018970 | 3/4/2004 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5388990 | Beckman | Feb 1995 | A |
5444624 | Wilkinson et al. | Aug 1995 | A |
5734357 | Matsumoto | Mar 1998 | A |
6088527 | Rybczynski | Jul 2000 | A |
6411896 | Shuman et al. | Jun 2002 | B1 |
6464130 | Itoh et al. | Oct 2002 | B1 |
6735517 | Engelsberg et al. | May 2004 | B2 |
20020055808 | Matsumoto | May 2002 | A1 |
20050060066 | Buehler et al. | Mar 2005 | A1 |
Number | Date | Country |
---|---|---|
198 13 300 | Oct 1999 | DE |
100 37 573 | Feb 2002 | DE |
0 406 946 | Jan 1991 | EP |
0 406 946 | Jul 2001 | EP |
09113301 | May 1997 | JP |
2000275057 | Oct 2000 | JP |
2001141495 | May 2001 | JP |
Number | Date | Country | |
---|---|---|---|
20060155467 A1 | Jul 2006 | US |