Patent Grant
8477108
The present invention relates to a method for displaying information in a motor vehicle, in which a plurality of objects are represented graphically with the aid of a display mounted in the motor vehicle. The present invention further relates to a display device for a motor vehicle having a display for the graphic representation of information which is mounted in the motor vehicle, a user-interface device by which graphics data are able to be generated for objects displayable on the display, and an input device coupled to the user-interface device.
In a motor vehicle, there are various information and communication areas to which indicating instruments are assigned. They are used to provide information to the driver and passengers. Moreover, they are able to assist the driver in navigation or communication with the outside world. In particular, the display is able to visually represent vehicle data related to traffic or operation. What is termed the instrument cluster is disposed in the vicinity of the primary field of view of the driver. Usually it is located in the cockpit behind the steering wheel and is visible through an opening in the steering wheel. It is used especially to display the speed, the fuel-tank capacity, the radiator temperature and other motor-vehicle information specific to operation. In addition, radio and audio functions may be displayed. Finally, menus for telephone, navigation, telematic services and multimedia applications may be displayed. Usually liquid-crystal displays in various forms are used as display.
For example, German Published Patent Application No. 100 01 988 describes an instrument cluster for the display of operation-related and/or traffic-related data. To permit better comprehension of the diverse offering of information, German Published Patent Application No. 103 03 792 describes a perspective representation of three-dimensional elements.
As a further display device, a vehicle frequently possesses a multifunction display in the center console or above the center console. Such a multifunction operating element is described, for example, in German Published Patent Application No. 199 41 955.
In order to present the various operating and display possibilities in clearly arranged fashion, hierarchical menu structures are frequently used. A menu shows various menu items and, if applicable, graphics or icons assigned to the menu items. Upon selection of a menu item, a submenu having further submenu items opens. This structure may be continued over several hierarchical levels. In addition, instead of being assigned a submenu, a menu item may be assigned a specific display image which represents the information assigned to the menu item.
If such menu structures are used in a motor vehicle, the problem arises that navigation within these menu structures and the absorption of the information indicated by the display claim the attention of the driver in such a way that he is no longer able to safely drive the motor vehicle at the same time. Thus, if the driver wants to operate vehicle devices whose information is shown via the display device, he should do so prior to starting a trip or should interrupt his driving in order to operate them. However, such drawbacks for the user operation are undesirable. In many cases, the result is that the driver operates the devices in the vehicle while driving, although this leads to a distraction which can represent a safety risk.
It is therefore desirable that the information in the motor vehicle be displayed in such a way that it may be comprehended quickly and intuitively by the driver, so that the acquisition of the displayed information does not cause the driver to be distracted while driving. Furthermore, the operation should be executable so intuitively, easily and quickly that the driver is able to operate the devices of the vehicle, whose information is displayed by the display device, while driving, as well, even if possibly complex hierarchical structures are displayable by the display device. The display of information and the operator control associated with a display of information in the motor vehicle thus contribute to safety when driving the motor vehicle.
In a method and a display device of the type indicated at the outset, the displayed information is able to be comprehended as quickly and intuitively as possible, and a rapid, intuitive and simple operator control of vehicle devices whose information is displayed is provided.
The method of example embodiments of the present invention is characterized in that a user-interface device generates graphics data which control the display such that the objects are shown disposed on a virtual, perspectively displayed ring, and that in response to an input with the aid of an input device, an arithmetic logic unit of the user-interface device alters the graphics data such that the objects on the virtual ring rotate like a carousel. In particular, the virtual ring is displayed in a perspectively three-dimensional manner in an inclined view from above, so that not only the objects on the front portion of the virtual ring are visible, but also objects on the back side of the virtual ring.
Under the term “rotate” within the present context should be understood that the virtual ring is rotated. Since the three-dimensional virtual ring on the display is represented in a two-dimensional, perspective view, the objects are actually shifted with respect to their position on the display.
The depiction of the objects on a virtual ring has the advantage that, even if a multitude of objects are displayed graphically, the viewer finds his way very easily and quickly, and therefore the safety of the vehicle is not impaired, even if the driver absorbs the information displayed by the display while he is driving and, if necessary, operates the vehicle devices assigned to the objects.
A line may be input on the display with the aid of the input device. The angle by which the objects are rotated is then calculated as follows:
where
αRotation is the total angle of rotation in degrees,
S is the length of the line defined using the input device and
B is the width of the display.
Of the line defined by the input device, preferably only the length of the horizontal component aligned parallel to the width of the display is used for parameter S. Thus, of the line on the display input via the input device, only a projection in the horizontal is utilized for calculating the total angle of rotation.
In the method, the manner in which the objects on the virtual ring are rotated like a carousel is of special importance. Namely, how well and how quickly the observer is able to comprehend the objects displayed on the virtual ring, even when they are rotated like a carousel, is dependent on the representation of this rotation. In this context, many animation techniques which are used outside of the motor vehicle for the variable graphic display of objects are unsuitable for use in the motor vehicle, since in the motor vehicle, the observer only looks at the display for brief moments. Therefore, the time characteristic of the change in a position of a graphically displayed object is also of special significance for safety in driving the vehicle.
In the method, when calculating the graphics data for successive intermediate images for the representation of the rotation, the successive angles of rotation α are calculated by the following computational steps:
where
t is a system time at which the generated graphics data are shown on the display, with
t=0 at the beginning of the rotation,
d is the duration of the total rotation,
b is the initial angle of an object on the virtual ring,
αRotation is the total angle of rotation and
steps (i) and (ii) are repeated until t is greater than d.
Furthermore, the duration of the total rotation, i.e., the time from the initial angle of an object to the final angle, which is defined by the user via the input device, is particularly significant for the ascertainability of the displayed information. In the method, the duration of the total rotation is in a range from 2 seconds to 3 seconds, preferably in a range from 2.4 seconds to 2.6 seconds. The duration of 2.5 seconds for the total rotation is especially preferred.
The speed of the motor vehicle may be measured, and the duration of the total rotation may be ascertained as a function of the speed of the motor vehicle. By preference, the higher the speed of the motor vehicle, the longer the duration of the rotation. Namely, at higher speeds, the driver can only direct his eye toward the display for shorter periods. Moreover, the spacing of the time intervals in which the driver directs his eye toward the display is greater, since at higher speeds, the driver must focus greater attention on the driving process. The coupling of the rotational duration of the two-dimensional object to the speed of the motor vehicle therefore ensures that at higher speeds, the driver retains his orientation in the information display, and in this manner, is able to comprehend the information contents easily, quickly and intuitively.
An object may be activated with the aid of the input device, the other objects being pushed graphically into the background after the activation. In particular, each object shown on the display may be activated by the input device. It is therefore not necessary to use the input device to first rotate this object to the front in order to activate it. After an object is activated, preferably the virtual ring, i.e., the objects which are displayed on this ring, is hidden, and only the activated object is displayed. In the hiding of the virtual ring or the objects displayed on it, and the sole display of the activated object, for example, the activated object is enlarged while displacing the other objects of the ring until only the activated object is displayed.
Furthermore, in a display state in which only the activated object is displayed, as a result of an input for the carousel-like rotation of the objects, the last activated object merges into the carousel-like display within the further objects, the objects on the virtual ring rotate in carousel fashion by one position, the virtual ring is again hidden, and finally only the next object is displayed. Because of this change of display in the rendering of the objects, the viewer is able to orient himself more easily within the structure of the displayed objects, even if in each instance he looks at the changing display for only brief time periods, as is often the case in a motor vehicle when the driver absorbs the presentation of information.
After a carousel-like shift of the objects on the virtual ring, the object displayed in the foreground may be activated automatically after a time interval has elapsed. The user therefore only has to rotate the object to be activated into the foreground. The further operating step of activation may be omitted, so that after the object has been rotated, the user may turn his eye away from the display and does not have to further manipulate the input device. This is particularly advantageous for use in a motor vehicle, since the distraction of a driver who is looking at the display and operating the input device is reduced to a minimum.
In particular, the object is a graphic window in which information and/or control elements of the user-interface device are displayed.
The input may be accomplished by touching the display. The input may be accomplished by a gesture of a body part of a user, which is performed in front of the display. The gesture is detected and evaluated by the input device or another downstream device. For example, the gesture of the body part of the user may be detected by a capacitive coupling between the body part and a receiving device. Moreover, the gesture of the body part of the user may be detected by an emission of infrared radiation and reflection of this infrared radiation by the body part of the user.
Preferably, information of driver-assistance systems is displayed by at least a portion of the objects. This information also includes warning signs, which should be understood as quickly as possible by the driver. In this context, it is possible, for example, for objects which include warning signs to be rotated to the front on the virtual ring, and then shown enlarged on the display.
The display device according to example embodiments of the present invention is characterized in that the user-interface device is able to generate graphics data which control the display such that a plurality of objects are shown disposed on a virtual, perspectively displayed ring, and that the user-interface device includes an arithmetic logic unit by which, as a function of an input with the aid of the input device, the graphics data are able to be altered such that the objects on the virtual ring rotate like a carousel.
For the operative control by a user, a line on the display is determinable with the aid of the input device. As explained above, from the length of this line, the arithmetic logic unit is able to calculate the angle by which the objects should be rotated. As explained above, the graphics data for successive intermediate images for successive angles of rotation α to represent the rotation are calculable by the arithmetic logic unit, as well. In this context, the duration of the total rotation lies in a range from 2 seconds to 3 seconds, particularly from 2.4 seconds to 2.6 seconds, and especially preferred, at 2.5 seconds.
The display device may include an interface for the reception of data concerning the speed of the motor vehicle. In this case, the duration of the total rotation is ascertainable by the arithmetic logic unit as a function of these speed data.
The input device may be a touch-sensitive surface of a display. The input device is preferably a device for sensing and evaluating a gesture of a body part of a user, which is performed in front of the display. To this end, in particular, the input device may include a receiving device to which a signal is transmittable capacitively from the body part of the user when the body part is near the receiving device. The position of the body part may be detected with the aid of this capacitive coupling. A gesture by the user may be inferred from the change in this position over time.
Furthermore, the input device may include an infrared-light source or a receiver for reflected infrared light for detecting the gesture of the body part of the user. The position of the body part and its change over time is sensed and interpreted as gesture in this case, as well.
In addition, a proximity sensor may be provided by which the operating intention of a user is detected based on the approach of a body part of the user.
The user-interface device may be coupled to at least one driver-assistance system. In this case, the graphics data are able to be generated by the user-interface device so that information from this driver-assistance system is displayable by at least a portion of the objects.
Further features and aspects of example embodiments of the present invention are explained in more detail below with reference to the appended Figures.
The display device includes a display 1 for the graphical representation of information. Display 1 may be a matrix display, e.g., an LCD (liquid crystal display), especially a color display using TFT (thin-film transistor) technology. Furthermore, the display may be what is referred to as a twisted nematic-liquid crystal display (TN-LCD), a super twisted nematic (STN) display, a double-layer STN, an FLC (ferroelectric liquid crystal) display or an SSFLC (surface stabilized ferroelectric liquid crystal). Assigned to display 7 is a back-lighting (not shown) which may be provided by one or more light-emitting diodes. Display 1 is freely programmable, that is, any desired graphics data may be generated, which are represented on display 1.
In particular, display 1 is mounted in an area of the vehicle that is clearly visible for at least the driver. If the operator control of the devices of the vehicle is directly coupled to the placement of the display, so that, for example, the user must bring his hand or his finger at least into the vicinity of display 1 in order to make inputs, then display 1 is positioned in such a way that the driver of the vehicle may easily reach it with his hand or his finger. For instance, display 1 may be accommodated in the center console of the vehicle.
Display 1 is connected to a user-interface device 2, by which graphics data are able to be generated for graphical objects displayable on display 1. User-interface device 2 is also connected to an input device 4, via which the user is able to control devices of the vehicle whose information is displayed on display 1.
For example, input device 4 may be a device for detecting and evaluating a gesture of a body part of a user. For instance, the hand of the user may perform the gesture in front of display 1. In so doing, the three-dimensional position of the hand is detected in a specific location area in front of display 1 without it being necessary to touch display 1. The permitted location area is a function of the placement of display 1 in the motor vehicle. The area should be selected such that the stay of the hand of a user in this location area may be associated unequivocally with an operative control of input device 4. For instance, the boundary of the location area may lie 40 cm to 10 cm in front of display 1. If the hand of the user is brought up closer than this threshold value to display 1, this is detected by input device 4 or a separate proximity sensor, and the approach is interpreted as an operating intention. For instance, this may lead to the objects displayed by display 1 being shown differently. Input device 4 detects the position and the movement of the hand of the user in the location area. In so doing, various gestures performed by the hand are recognized and interpreted as inputs.
For example, input device 4 may include infrared-light sources and infrared-light receivers, which detect the infrared light reflected by the hand. Details of such an input device are described in German Published Patent Application No. 100 58 244, which is hereby incorporated in its entirety by reference thereto. Further input devices which may be used in conjunction with the display device are described in German Published Patent Application No. 103 05 341 and German Published Patent Application No. 10 2004 048 956.
Furthermore, the position of the hand and its change over time may also be detected by an optical system. In this system, for example, a light-emitting diode emits square-wave, amplitude-modulated light. This light is reflected by the object to be detected, i.e., the hand, and after the reflection, arrives at a photodiode. A further light-emitting diode likewise emits square-wave, amplitude-modulated light to the photodiode, this light, however, being phase-shifted by 180°. At the photodiode, the two light signals superimpose and cancel each other out if they have exactly the same amplitude. If the signals do not cancel each other out at the photodiode, the light emission of the second diode is regulated via a control loop in such a way that the total received signal again adds up to zero. If the position of the object changes, the light component which arrives at the photodiode from the first light-emitting diode via the reflection at the object also changes. This brings about a correction of the intensity of the second light-emitting diode through the control loop. The control signal is therefore a measure for the reflection of the light, which is emitted by the first diode, at the object. In this manner, a signal which is characteristic for the position of the object may be derived from the control signal.
In addition, the input device may be a touch-sensitive foil, which is provided on display 1. The position at which display 1 disposed behind the foil is touched may be detected by the foil. For example, the foil may take the form of a resistive touch foil, capacitive touch foil or piezoelectric foil. In addition, the foil may be constructed such that a flow of heat which goes out from the finger of a user, for instance, is measured. Various inputs may be obtained from the evolution of the touching of the foil over time. For example, in the simplest case, the touching of the foil at a specific position may be assigned to one graphical object displayed on display 1. Sliding movements of the finger over the foil may be interpreted, as well. In this manner, the user is able in particular to define a line on display 1 by touching the foil at one point, sliding on the foil toward another point, and taking the finger off the foil at this other point.
Finally, a remote operator-control element may be used as input device. In particular, the remote operator control element is a mechanical control element. For instance, a rotary switch may be provided by which objects shown on the display are controllable and are selectable by pressing the rotary switch. Furthermore, an angle of rotation may also be input directly by way of the rotary switch, as explained later. In addition, separate pressure switches may be disposed around the rotary switch, the arrangement of display fields on the display, which are assigned to the pressure switches, corresponding at least schematically to the arrangement of the pressure switches. The information system may include a multifunction operating device, for example, as described in European Published Patent Application No. 1 212 208.
User-interface device 2 is further coupled to a system clock 8 and to a vehicle bus 7. User-interface device 2 is connected to driver-assistance systems of the vehicle via vehicle bus 7. User-interface device 2 receives data from these driver-assistance systems via vehicle bus 7, and prepares these data so that they are displayed graphically to the driver or the vehicle occupants via display 1. To this end, user-interface device 2 generates graphics data for objects displayable on display 1, which, inter alia, graphically represent the information of the driver-assistance systems. User-interface device 2 is further connected via vehicle bus 7 to various information devices and communication devices, as well as entertainment devices of the vehicle. The varied information from these vehicle devices is processed in user-interface device 2 and converted into graphics data for a graphical representation. For animations of the graphical representation on the display, the user-interface device includes an arithmetic logic unit 3 which refers to system clock 8 in the generating of intermediate images.
In the following, the information readout on display 1 in the vehicle is explained in detail:
The graphics data, which user-interface device 2 generates for display 1, have a hierarchical structure. The starting point for this hierarchical structure is the view of display 1 shown in
In the view shown in
Below perspectively displayed, virtual ring 5 are command buttons for controlling the graphics data generated by user-interface device 2 for display 1. Using a first command button 9, in any display state, the user is able to return to the initial state in which objects 6 are shown disposed on virtual, perspectively displayed ring 5. Using command buttons 10 and 11, objects 6 on virtual ring 5 may be rotated by one position like a carousel clockwise or counterclockwise, as explained later in detail. Functions within an object 6 may be actuated by command buttons 12 and 13, and using command button 14, for example, the user is able to get directly to the settings menu for the graphics.
Starting from the view of display 1 shown in
For example,
On the other hand, if command button 10 or 11 is actuated, object 6 for the climate control is likewise reduced, and the further objects 6 of virtual ring 5 are shown displayed again as in
When working with the method described above for displaying the quantity of information organized into a hierarchical structure, the transition between two static representations on display 1 is of particular importance. Namely, since the display device is accommodated in a motor vehicle, it is especially important that, in particular, the driver of the motor vehicle is able to quickly, easily and intuitively comprehend the information shown on display 1, even if he only directs his eye to display 1 for brief periods. In this context, it is particularly important that at any time, the viewer is able to orient himself well within the hierarchical structure. Abrupt changes of display images are disadvantageous for this. In particular, fluid transitions between two static representations, during which intermediate images are displayed that clarify the transition between the two static representations, facilitate the orientation in the structure as well as the comprehensibility of the information content.
Moreover, it is especially important how the intermediate images visually display the transition between two static representations. In this context, a linear transition from one static representation to the next static representation is not suitable for the practical application in a motor vehicle. Rather, intermediate images are advantageous which illustrate a movement of objects 6 that is at least partially decelerated. The parameters for the selection of the deceleration and the duration of the transition must also be adapted to the application in the vehicle, so that for the most part, conventional animations familiar from the computer field are not usable.
In the following, it is described in detail how, with the aid of input device 4, the user is able to rotate objects 6, disposed on virtual ring 5, like a carousel on this virtual ring 5.
The starting point for the rotation is the arrangement of objects 6 on virtual ring 5 shown in
the total angle of rotation αRotation being indicated in degrees, S being the length of the line or the horizontal component thereof defined by the input device, and B being the width of the display. In this context, angle of rotation α relates to virtual ring 5. Actually, objects 6 in the perspective representation on display 1 are only shifted in the plane of display 1. Angle of rotation α is therefore transformed accordingly in the generation of the graphics data by user-interface device 2.
If input device 4 is a remote operator-control element having a rotary transducer, the total angle of rotation may also be input via the angle of rotation of the rotary transducer.
After total angle of rotation αRotation has been input by the user with the aid of input device 4, an arithmetic logic unit 3 of user-interface device 2 generates an animation which includes the graphics data for successive intermediate images that represent successive angles of rotation α for objects 6. The transition from the initial state having an initial angle of the objects to a final state in which the objects have been rotated by the entire angle αRotation takes place through a decelerated movement, which is calculated by the following computational steps:
In this context, t is the system time, which is retrieved from system clock 8 by arithmetic logic unit 3. At the beginning of the rotation, the system time is equal to zero. In the final state of the rotation, system time t corresponds to duration d of the total rotation. Steps (i) and (ii) are repeated until system time t is greater than duration d of the total rotation.
The selection of the duration of the total rotation is particularly significant for the practical application of the above-described method in a vehicle. Duration d of the total rotation is in a range from 2 seconds to 3 seconds, particularly in a range from 2.4 seconds to 2.6 seconds. Duration d of 2.5 seconds for the total rotation is especially preferred.
In addition, in the case of the present exemplary embodiment, total angle of rotation αRotation is adapted to an angle of rotation which corresponds to a carousel-like rotation of objects 6 on virtual ring 5 in which in the final state, an object 6 appears in the foreground, as shown in
If an object is rotated into the foreground by the user with the aid of input device 4, this object 6 is automatically activated after an interval of time has elapsed. Thus, this object 6 is enlarged after the time interval has elapsed, at the same time virtual ring 5 together with the other objects 6 disappearing until only activated object 6 is displayed.
According to a further refinement of the exemplary embodiment, the data of the speedometer of the motor vehicle are transferred into user-interface device 2, and therefore arithmetic logic unit 3, via vehicle bus 7. These data are used by arithmetic logic unit 3 to ascertain the duration of the rotation. In this context, the higher the speed of the motor vehicle, the longer the duration of the total rotation.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2007 039 442 | Aug 2007 | DE | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/EP2008/058842 | 7/8/2008 | WO | 00 | 5/16/2011 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2009/024400 | 2/26/2009 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5689284 | Herget | Nov 1997 | A |
| 5751275 | Bullister | May 1998 | A |
| 6052110 | Sciammarella et al. | Apr 2000 | A |
| 6430501 | Slominski | Aug 2002 | B1 |
| 6448987 | Easty et al. | Sep 2002 | B1 |
| 6452570 | Kuenzner | Sep 2002 | B1 |
| 6538635 | Ringot | Mar 2003 | B1 |
| 6642936 | Engholm et al. | Nov 2003 | B1 |
| 6769320 | Bollgohn et al. | Aug 2004 | B1 |
| 6898523 | Cochlovius et al. | May 2005 | B2 |
| 6956540 | Yoshihara et al. | Oct 2005 | B1 |
| 7111788 | Reponen | Sep 2006 | B2 |
| 7730425 | de los Reyes et al. | Jun 2010 | B2 |
| 7966577 | Chaudhri et al. | Jun 2011 | B2 |
| 8028250 | Vronay et al. | Sep 2011 | B2 |
| 20020041260 | Grassmann | Apr 2002 | A1 |
| 20030164818 | Miller-Smith | Sep 2003 | A1 |
| 20070157126 | Tschirhart et al. | Jul 2007 | A1 |
| 20080161997 | Wengelnik et al. | Jul 2008 | A1 |
| Number | Date | Country |
|---|---|---|
| 44 46 431 | Jun 1996 | DE |
| 198 37 510 | Feb 2000 | DE |
| 100 01 988 | Jul 2001 | DE |
| 199 41 955 | Aug 2001 | DE |
| 100 39 432 | Dec 2001 | DE |
| 100 58 244 | May 2002 | DE |
| 101 17 030 | Oct 2002 | DE |
| 101 18 765 | May 2003 | DE |
| 101 55 549 | May 2003 | DE |
| 103 03 792 | Aug 2004 | DE |
| 103 05 341 | Aug 2004 | DE |
| 600 18 874 | Jul 2005 | DE |
| 601 06 175 | Nov 2005 | DE |
| 10 2004 029 203 | Dec 2005 | DE |
| 10 2004 048 956 | Apr 2006 | DE |
| 10 2005 035 111 | Sep 2006 | DE |
| 10 2005 017 313 | Oct 2006 | DE |
| 10 2006 002 679 | Aug 2007 | DE |
| 0 547 993 | Jun 1993 | EP |
| 1 052 566 | Nov 2000 | EP |
| 1 207 072 | May 2002 | EP |
| 1 212 208 | Jun 2002 | EP |
| 1 560 102 | Aug 2005 | EP |
| 2 434 068 | Jul 2007 | GB |
| 2006-260265 | Sep 2006 | JP |
| WO 0004440 | Jan 2000 | WO |
| WO 0239712 | May 2002 | WO |
| WO 2005091122 | Sep 2005 | WO |
| WO 2006108617 | Oct 2006 | WO |
| Entry |
|---|
| International Search Report and Written Opinion, PCT Application No. PCT/EP2008/058842. |
| Almy, et al., “User interface for zooming of graphic displays,” Research Disclosure, Mason Publications, Hampshire, GB, vol. 312, No. 46, Apr. 1, 1990. |
| International Preliminary Report on Patentability, PCT application No. PCT/EP2008/058842. |
| Number | Date | Country | |
|---|---|---|---|
| 20110205162 A1 | Aug 2011 | US |
