Patent Grant
9283829
This patent application is a U.S. National Phase of International Patent Application No. PCT/EP2011/000963, filed 28 Feb. 2011, which claims priority to German Patent Application No. 10 2010 011 039.6, filed 11 Mar. 2010, the disclosures of which are incorporated herein by reference in their entirety.
Disclosed embodiments relate to a method for operating a user interface, in which at least one two-dimensional, graphical object may be presented on a display panel in a first presentation, which shows a first side of the object, and in a second presentation, which shows the second side of the object.
Graphical user interfaces are known particularly for computers and for operator control systems of electronic devices, in which they allow the user to interact with the machine by means of graphical symbols, also called objects. In this context, these objects can be controlled in a wide variety of ways. By way of example, they can be selected or moved by means of manual operator control elements, such as keys, rotary pressure controls or a mouse, using a touch-sensitive display panel or using gestures which are sensed in front of or on the display panel and are converted into control signals.
Today, mass-produced vehicles have functional devices, such as an air conditioning system, which is operated by means of mechanical keys and rotary controls. On account of a large diversity of variants owing to country-specific requirements and equipment variants, high levels of complexity arise in the planning and production of the operator control modules in this context. In addition, the increasing diversity of functions results in excess loading with switches, which means that these are no longer comprehensible to the user, make access to functions which are considered essential more difficult and hence increase the risk of distraction from the road traffic.
On account of this increase in electronic devices and the diversity of functions thereof in vehicles, it is now standard practice to also equip vehicles with an operator control system which has a graphical user interface in order to be able to control the various operator control systems of the vehicle, for example air conditioning system, radio, CD player, communication device or navigation system, by using a few, user-programmable operator control elements.
DE 10 2008 034 507 A1 describes a method for displaying information in a motor vehicle, in which a displayed two-dimensional graphical object may be rotated from the front to the back. In this case, the presentation may be chosen such that the display panel may be used as well as possible and the presented information can be grasped quickly and intuitively by the driver of the vehicle. This is achieved by virtue of perspective rotation of the graphical object, which in this case is always completely visible within the context of the perspective view. The front may be used to present display information and elementary setting options for functional devices in the vehicle, while the back can be used to make detail settings.
In addition, the documents U.S. Pat. No. 7,315,312 BS, U.S. Pat. No. 7,171,630 B2, U.S. Pat. No. 7,081,882 B2, JP 2000163193 A, EP 1 672 474 A2 and DE 43 01 766 C2 describe methods for graphical presentation of page turning for book pages, with particular discussion of the aspect of the realistic three-dimensional effect being provided.
Disclosed embodiments enable the presentation of different information on different sides of a displayed graphical object. The presentation of the graphical object may be altered such that the graphical object may be rotated from the first side to the second side in a perspective presentation on a display panel when a first or a second control signal has been triggered. Disclosed embodiments also relate to an associated apparatus for providing such a user interface.
Disclosed embodiments also provide a method for such presentation that may be particularly suitable for a display panel in a vehicle. However, it can also be used in conjunction with other display panels, particularly when such a display panel may be used by a plurality of users simultaneously.
Disclosed embodiments are explained herein in more detail with reference to the Figures, wherein:
a-2d show a presentation of a graphical object according to a disclosed embodiment of the method when a first control signal has been triggered;
a-3d shows the presentation of a graphical object according to the disclosed embodiment of the method shown in
a shows the first side of a graphical object in the form of a user menu for an air conditioning system according to a disclosed embodiment of a method; and
b shows a second side of the graphical object from
In accordance with disclosed embodiments, a method and an apparatus provide a graphical user interface of the type mentioned above, which can be quickly customized to suit varied user requirements, particularly when a plurality of users make settings using the user interface in alternate succession.
A disclosed embodiment provides a method wherein a rotation from the first side to the second side may be followed by different information being presented on the second side on the basis of whether the first or the second control signal has been triggered. The information presented on the first side may be typically a subset of a piece of overall information. The features of the control signal allow a different subset of the overall information to be specifically displayed on the second side in comparison with the information on the first side, this subset being determined by the control signal. This enables the presented information to be customized flexibly to suit different user requirements, particularly when a plurality of users use a user interface in succession.
The basic idea of the disclosed embodiments involves the concept of two-side logic. In this case, there exists, for a first side, a second side which can be used to display various pieces of information based on a particular criterion, in this case, based on a control signal. In general, the first side can also be synonymously called the front and the second side the back, with a plurality of different backs existing for a front.
Advantageously, the object may be rotated from the first to the second side such that the axis of rotation or the center of rotation, which may be associated with the rotation, is dependent on the control signal. This provides the option of providing the user with a visual indication—during the actual rotation—of which control signal has been triggered and which information will appear on the second side. In this case, the user can also intuitively recognize whether the correct control signal has been triggered, or whether a mistrigger has possibly occurred.
In one implementation of the method according to the disclosed embodiments, more than two different control signals may be recognized and more than two backs with a different information content may be provided. It is, thus, possible for four different backs to be provided, for example, which may be presented around the center of the object via different instances of the corners or edges as a result of rotations by the object, if the latter is rectangular.
The rotation can be executed in an animated form, for example in a rotary movement, which may be first of all accelerated from the initial state and then decelerated again to the final state. Advantageous rotation algorithms are described in DE 10 2008 034 507 A1, already cited at the outset.
Within the context of the disclosed embodiments, a control signal may be a physical signal which is triggered by an operating event and which is sensed by a means for sensing control signals, and which is used for controlling at least one method step or operation on physical resources provided for this purpose. The first and second control signals may, therefore, also be made up of a plurality of control signals. It is also possible to use individual features of a control signal to control a single method step. By way of example, it would thus be possible for one feature of the control signal to determine the information content that is to be displayed on the second side and for another feature to define the axis of rotation.
Besides operator control elements, the means for sensing control signals may also comprise means for user recognition. In one implementation of the method according to disclosed embodiments, the user who has triggered the control signal by virtue of an operating event may be sensed and the control signal may be associated with the first or second control signal on the basis of the sensed user. This enables the information presented on the second side to be customized on a user-specific basis.
User recognition can be effected in a wide variety of ways. Firstly, a user or a user group can be identified by virtue of the operation of an operator control element, which is associated with said user or user group. In this case, the operator control element may be in the exclusive range of these users, for example. Alternatively or in addition, user identification can be supported by a camera system.
Furthermore, the location, angle or direction at which or from which an operating element enters a detection range formed around an operator control element can be determined and associated with a user. In particular, it may be possible to distinguish between the driver and the front-seat passenger in a vehicle depending on the location of the operating element in the left-hand or right-hand half of the detection range. The respective user could also use an operating element, which he uses to render himself recognizable to the system, for example a radio signal pin which emits an identification code that can be associated with the user and which can be sensed by the system.
User recognition could also be effected by means of sensor sensing, for example by means of an electrode arrangement in the seat of the user. By way of example, this electrode arrangement can be used to couple an identification code capacitively into the body of the driver or front-seat passenger. The identification code may be in this case able to identify the seat position and the user himself. The identification code may be transmitted by means of the body of the user and may be output capacitively at the fingertip, so that it can be transmitted to a reception device in the system, for example. For further details of this signal transmission, reference is made to DE 10 2004 048 956 A1 and the further literature cited therein, which are hereby incorporated into the present application by reference. In particular, the circuit devices used in DE 10 2004 048 956 A1 can be used.
In one advantageous implementation of a method provided in accordance with disclosed embodiments, at least two delimited areas may be defined on the display panel. Operation of an operator control element associated with the first area prompts the first control signal to be triggered and operation of an operator control element associated with the second area prompts the second control signal to be triggered. Typically, one of the areas defined in this way may be located in the left-hand half and one may be located in the right-hand half of the display panel, as a result of which operation of the associated operator control element involves the rotation of the object about the vertical center axis conveying to the user the impression that he himself may be pushing the side of the object toward the rear. The delimited areas may also be located at other, potentially diametrically opposite, positions on the display panel, for example at the top and bottom or, in the case of a plurality of such areas, at the bottom left and right and the top left and right.
In particular, the display panel has a touch-sensitive surface, and a control signal may be triggered by the operation of buttons within the respective defined areas on the display panel. Alternatively, it may be also possible to use what are known as softkeys, so that operation can also be effected by means of mechanical operator control elements which may be assigned to an area on the display panel on a context-specific basis. By way of example, the driver and the front-seat passenger can perform operation by means of buttons on the display panel, while other vehicle occupants do this by means of a remote operator control unit having a touchpad or mechanical operator control elements in their range.
Within the context of disclosed embodiments, a button is understood to mean a control element on a graphical user interface. A button is distinguished from elements and panels for the pure display of information, what are known as display elements and display panels, in that they may be selectable. Selecting a button prompts execution of a function associated therewith. The function can result in alteration of the display of information. In addition, the buttons can be used to control devices in which the operator control may be supported by the information display. The buttons can therefore replace conventional mechanical switches. The buttons can be produced and displayed arbitrarily on a user-programmable display panel of a display. Furthermore, provision may be made for a button to be able to be marked. In this case, the associated function may be not yet performed. However, the marked button may be presented in a form highlighted in comparison with other buttons. The marking and/or selection of a button can be effected by means of cursor control or by virtue of direct operator control of a touch-sensitive surface on the display.
When a control signal is formed from a plurality of features, it is, thus, possible for the rotation of the object to simultaneously perform user recognition when a button or another operator control element may be operated. This enables some contents to be reserved for a particular circle of people or to be blocked for user groups. By way of example, contents could be enabled for a user in his role as a driver, and other contents could be enabled for him in his role as a vehicle keeper. It would also be possible to implement a child safety lock in this manner, for example when seat sensors or a camera system recognize(s) that there may be children in the rear seat of the vehicle.
The information presented on the graphical object may be associated with a user menu, with the first side being used to display basic functions and/or standard settings and a second side being used to display user-specific functions and/or detail settings. In particular, the user menu may be associated with a functional device in a vehicle. The information which may be displayed on the second side of the graphical object when the first control signal has been triggered may provide setting options for the driver of the vehicle, and the information which may be displayed on the second side of the graphical object when the second control signal has been triggered may provides setting options for the front-seat passenger of the vehicle.
In one implementation of the method according to disclosed embodiments, the functional device may be an air conditioning system for which a plurality of air conditioning situations have been defined, which have associated setting parameters for controlling individual air conditioning control units. The selection of a particular air conditioning situation may prompt the individual air conditioning control units to be controlled or regulated using the setting parameters, which may be associated with this air conditioning situation, wherein the first side of the presented two-dimensional object enables the air conditioning situations to be selected and the second side enables the setting parameters to be adjusted on a user-dependent basis. The display for the driver enables air conditioning settings to be made for the driver, and the display for the front-seat passenger enables air conditioning settings to be made for the front-seat passenger. Individual adjustment in the case air conditioning systems may be desirable particularly because firstly the individual perception of cold and heat may be very different and also sensitivity toward air flow varies greatly from person to person. Secondly, it may be necessary to customize the setting of the air conditioning system according to the time of day or season. In addition, the orientation of the vehicle to the sunlight and the vehicle geometry may require very different air conditioning for each seat position. Operator control of air conditioning, as may also be used for the method and takes account of setting parameters for individual air conditioning control units that are specific to defined air conditioning situations, is described in DE 10 2008 017 051 A1.
A method according to presently disclosed embodiments may also be advantageous for controlling other functional devices, for example for the audio driving of a stereo system or of a loudspeaker system.
The apparatus according to presently disclosed embodiments for operating a user interface may comprise a display panel for presenting a two-dimensional, graphical object and also means for producing at least a first and a second control signal. The apparatus furthermore may comprise a control device, which can be used to produce graphics data, which present at least one two-dimensional, graphical object, which can be presented on the display panel in a first presentation, which shows a first side of the object, and in a second presentation, which shows the second side of the object, wherein different sides of the object can be used to present different information, wherein the presentation of the graphical object can be altered such that the graphical object may be rotated from the first side to the second side in a perspective presentation on the display panel when a first or a second control signal has been triggered, wherein a rotation from the first side to the second side may be followed by different information being able to be presented on the second side on the basis of whether the first or the second control signal has been triggered. The apparatus may be particularly suitable for carrying out the presently disclosed method. It, therefore, has the same advantages as the presently disclosed method.
The means for producing control signals may be implemented in different ways. Control signals can be produced by means of manual operator control elements, such as keys, rotary press controllers or touch-sensitive panels, which are known as touchpads. These operator control elements may be also suitable for the operator control of softkeys. Advantageously, control signals may be produced by means of a display panel having a touch-sensitive surface, in which buttons, which may be triggered by touch or proximity sensing, may be displayed to a user. The means for producing control signals can be supported by various sensing means for user recognition, which may comprise sensor networks, radio identification systems or camera systems, in particular.
In accordance with disclosed embodiments, the apparatus for operating a user interface provides a user interface for an air conditioning system in a vehicle.
The display panel 11 and the operator control elements 12 may be connected to a control device 14, so that control signals triggered by means of the operator control elements 12 or the touch-sensitive surface can be transmitted to the control device 14 and the display contents on the display panel 11 can be controlled.
The control device 14 may be also connected by means of a data bus 15 in the vehicle to an air conditioning system 17 and another functional device 16, for example an infotainment device or a navigation system. The air conditioning system 17 comprises various air conditioning units 18, e.g. ventilation, cooling and heating elements, in the seat areas and rests and also integrated into the cockpit and the interior equipment of the vehicle. The individual air conditioning units 18 can be actuated separately by means of the control portion 17a of the air conditioning system 17. Furthermore, the control device 14 may be connected by means of the vehicle bus 15 to sensing means 19 for user recognition, which can be used to associate a user as a driver or front-seat passenger and/or perform vehicle occupant identification. The sensing means 19 for user recognition are known per se. In particular, they are in the form of a camera system or sensor arrangement in the seats of the vehicle.
The presentation of a two-dimensional, graphical object 20 according to a disclosed embodiment, when a first control signals has been triggered, is now be described with reference to
a shows the two-dimensional object 20 from a first side 21, henceforth called the front (the two sides 22a, 22b shown later are accordingly called the backs). At the bottom left and right of the front 21 there may be respectively delimited areas 24a, 24b defined in, which a respective button 13a or 13b may be shown. The area 24a can be operated particularly comfortably from the driver's side, and the area 24b can be operated particularly comfortably from the front-seat passenger's side.
If the user 30, for example, the driver, uses an operating element, in this case his fingertip, to touch the button 13a in the area 24a, a first control signal may be produced, which may be associated with the driver of the vehicle. The presentation of the graphical object 20 may be then altered such that the graphical object 20 rotates in a perspective presentation on the display panel 11 from the front 21 to the back 22a about an axis of rotation 23, which may be formed by the vertical central axis. This rotation may be effected by virtue of the left-hand object half moving toward the rear in virtual terms, as shown in
a-3d show the presentation of a graphical object according to a disclosed embodiment of a method shown in
In this case, a user 30, that is to say the front seat passenger in this context, uses his fingertip to touch the button 13b in the area 24b. It may be the same user 30 or a different person. The crucial factor in this context may be the new role as a front seat passenger, which has been inferred from the operation of the button 13b in the area 24b. A second control signal may be produced, which is associated with the front seat passenger of the vehicle. This time, the presentation of the graphical object 20 may be altered such that the graphical object 20 rotates in a perspective presentation on the display panel 11 from the front 21 to the back 22b about the previously described axis of rotation 23, this time with the right-hand object half toward the rear, as shown in
Alternatively, it would also be possible for control signals to be produced by virtue of the operation of an operator control element 12, with individual operator control elements 12 being able to be associated with individual users 30. In this case, the operator control elements 12 do not need to be fitted on the display panel 11, but rather may be mounted at any location in the vehicle (not shown), for example in the arm rests or in the rear of the backrests of the front seat, so that they can be used in vehicles with a plurality of rows of seats but only one display panel. In particular, four backs can be provided, the display of which may be achieved by a control signal from a respective seat position in the vehicle at the front right and left and at the rear right and left. The rotation from the front to the respective back could accordingly be effected from the center thereof via one of the corners at the top right and left and at the bottom right and left, about a horizontal and a vertical central axis in one and the other direction of rotation or about the two diagonals in one and the other direction of rotation.
a and 4b show a further disclosed embodiment for a method, in which graphical objects 20 may be used for the provision of a user menu 25, in this case for an air conditioning system 17 in a vehicle. In this case, provision may be made for the control of basic functions and standard settings on the front 21, while user-specific detail settings can be made on different backs 22. The presentation of the rotation and also the algorithm that the control signal can be taken as a basis for displaying different information on the back 22 can be effected in accordance with the description relating to
For the user menu 25, a plurality of air conditioning situations 26 may be defined, which may be displayed on the front 21 of the user menu 25 according to
For the selection of the individual air conditioning situations 26, the display panel 11 may be used to present the front 21 of the graphical object 20, which is shown in
If a user now triggers a control signal in accordance with the method described previously, for example by touching one of the buttons 13a or 13b, then the front 21 of the user menu 25 rotates on the basis of the control signal to a back 22, the content of which may be dependent on the control signal. In particular, the back 22 provides detail settings, which a user can use to control only those air conditioning settings which relate to him, for example only for his seat or only for an area formed around his seat position.
b shows the back 22 of the graphical object 20 for the provision of a user menu 25, which may be displayed following operation of the button 13a or 13b. In this disclosed embodiment, the different backs 22 differ not in terms of their structure but rather only in terms of the setting parameters 27, for which reason a presentation of alternative backs 22 may be dispensed with. The air conditioning situations 26 already presented on the front 21 may be presented in the form of a tab menu with the associated setting parameters 27, which the relevant user can use to manually alter the setting parameters 27, which relate to him and which may be associated with the air conditioning situations 26. In this case, the setting parameters 27 can be selected in the form of buttons 13d on the tab menu. In particular, the user can individually adjust the setpoint temperature control and the supply of air for the area of his seat, with a supplementary window 28 being able to be used to visually display relevant setting parameters 27 and air conditioning units 18. A button 13a or 13b may be used to take the user back to the front 21.
The method described enables fine tuning of individual setting parameters 27 in the air conditioning system 17, in particular. In this case, not only is it possible to implement the customization to a fixed air conditioning situation 26, it may be therefore also possible to perform a customization by means of macro settings in order to take account of customer requirements based on country-specific or climate-specific customizations or equipment variants without unnecessarily complicating the number of operator control elements or the operator control concept in the process. This increases customer acceptance and operator control convenience and hence contributes to road safety.
In a similar manner to the user menu 25 shown in
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2010 011 039 | Mar 2010 | DE | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/EP2011/000963 | 2/28/2011 | WO | 00 | 10/25/2012 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2011/110294 | 9/15/2011 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5463725 | Henckel et al. | Oct 1995 | A |
| 6181301 | Inoguchi et al. | Jan 2001 | B1 |
| 6388684 | Iwamura et al. | May 2002 | B1 |
| 6430501 | Slominski | Aug 2002 | B1 |
| 6448987 | Easty et al. | Sep 2002 | B1 |
| 6526335 | Treyz et al. | Feb 2003 | B1 |
| 6577330 | Tsuda et al. | Jun 2003 | B1 |
| 6621471 | Ozaki et al. | Sep 2003 | B1 |
| 6769320 | Bollgohn et al. | Aug 2004 | B1 |
| 7081882 | Sowden et al. | Jul 2006 | B2 |
| 7171630 | O'Leary et al. | Jan 2007 | B2 |
| 7222134 | Maruyama et al. | May 2007 | B1 |
| 7315312 | Hemmings | Jan 2008 | B2 |
| 7730425 | de los Reyes et al. | Jun 2010 | B2 |
| 7814419 | Fabritius | Oct 2010 | B2 |
| 7865301 | Rasmussen et al. | Jan 2011 | B2 |
| 7966577 | Chaudhri et al. | Jun 2011 | B2 |
| 8018579 | Krah | Sep 2011 | B1 |
| 8327291 | Oguchi | Dec 2012 | B2 |
| 20010017615 | Lin et al. | Aug 2001 | A1 |
| 20020016235 | Ashby et al. | Feb 2002 | A1 |
| 20030142136 | Carter et al. | Jul 2003 | A1 |
| 20030230443 | Cramer et al. | Dec 2003 | A1 |
| 20050195157 | Kramer et al. | Sep 2005 | A1 |
| 20050267676 | Nezu et al. | Dec 2005 | A1 |
| 20070024580 | Sands et al. | Feb 2007 | A1 |
| 20070073944 | Gormley | Mar 2007 | A1 |
| 20070297064 | Watanabe et al. | Dec 2007 | A1 |
| 20080024463 | Pryor | Jan 2008 | A1 |
| 20080133122 | Mashitani et al. | Jun 2008 | A1 |
| 20080242511 | Munoz et al. | Oct 2008 | A1 |
| 20090002145 | Berry et al. | Jan 2009 | A1 |
| 20090146846 | Grossman | Jun 2009 | A1 |
| 20090160803 | Hashimoto | Jun 2009 | A1 |
| 20090199120 | Baxter et al. | Aug 2009 | A1 |
| 20090261966 | Cutchis | Oct 2009 | A1 |
| 20090273574 | Pryor | Nov 2009 | A1 |
| 20090278390 | Carter | Nov 2009 | A1 |
| 20100100844 | Narahashi et al. | Apr 2010 | A1 |
| 20100106323 | Wallaert et al. | Apr 2010 | A1 |
| 20100214238 | Christoph et al. | Aug 2010 | A1 |
| 20100315417 | Cho et al. | Dec 2010 | A1 |
| 20110001726 | Buckingham et al. | Jan 2011 | A1 |
| 20110012719 | Hilger et al. | Jan 2011 | A1 |
| 20110047460 | Choe | Feb 2011 | A1 |
| 20110050591 | Kim | Mar 2011 | A1 |
| 20110179363 | Dehmann et al. | Jul 2011 | A1 |
| 20110205162 | Waller et al. | Aug 2011 | A1 |
| 20120054690 | Lim | Mar 2012 | A1 |
| 20120109455 | Newman et al. | May 2012 | A1 |
| 20120200495 | Johansson | Aug 2012 | A1 |
| 20120260217 | Celebisoy | Oct 2012 | A1 |
| 20120314020 | Ng-Thow-Hing | Dec 2012 | A1 |
| 20130194308 | Privault et al. | Aug 2013 | A1 |
| 20130346911 | Sripada | Dec 2013 | A1 |
| Number | Date | Country |
|---|---|---|
| 4301766 | Aug 1993 | DE |
| 102004048956 | Apr 2006 | DE |
| 102007034272 | Jan 2009 | DE |
| 102008017051 | Oct 2009 | DE |
| 102008034507 | Jan 2010 | DE |
| 1672474 | Jun 2006 | EP |
| 1977926 | Oct 2008 | EP |
| 2000163193 | Jun 2000 | JP |
| 2005071286 | Mar 2005 | JP |
| 2008260519 | Oct 2008 | JP |
| 100861666 | Sep 2008 | KR |
| WO 2009024400 | Feb 2009 | WO |
| 2010010025 | Jan 2010 | WO |
| Entry |
|---|
| 2D Boy, “World of Goo,” screenshots from running program copyright 2009. |
| Imagine Games Network, “World of Goo Preview,” Jan. 22, 2008, http://www.ign.com/articles/2008/01/22/world-of-goo-preview. |
| Office Action for Korean Patent Application No. 10-2012-7025019; Oct. 2, 2014. |
| Search Report for International Patent Application No. PCT/EP2011/000963; Aug. 10, 2011. |
| Number | Date | Country | |
|---|---|---|---|
| 20130047112 A1 | Feb 2013 | US |
