Embodiments of the present invention relate generally to user interface technology and, more particularly, relate to a method, apparatus, and computer program product for providing adaptive soft key functionality on display devices.
As the use of display devices for commerce, communication, education, and recreation grows, the number of applications that must be handled by the display devices also increases. For example, a cellular telephone may have the capability to make and receive phone calls, take digital photographs, play music and video files, and access the internet, among many other functions. As a result, users require a greater number of controls in order to properly operate the display device depending upon which application is being used.
Some display devices include a keypad with hardware keys that allow the user to perform certain hard-coded functions, such as dialing a telephone number or scrolling through a displayed menu and selecting a particular entry. As greater functionality becomes required, the hardware user input interface cannot provide for all the user inputs. So-called “soft keys,” or keys that are not hard-coded and are capable of performing more than one function, depending on the operational situation, have been developed to address this issue. For example, on a cellular phone, actuation of a soft key when the phone is idle may access a list of contacts, whereas actuation of the same soft key when the phone is operating as a camera may zoom in on an object or record a picture.
As the function of the soft key does not remain the same, the function is generally described on a portion of the display to help the user operate the display device. For example, the soft key(s) may be located just under the display, and the portion of the display closest to each soft key may provide a brief description of the current function of the soft key, such as “Contacts” or “Zoom In.”
Display devices are increasingly used to communicate and access other display devices, networks, and communication systems. For example, some display devices are configured to receive advertising content to communicate promotions and items of interest to the user of the display device. Upon receiving such advertising content, the user may wish to learn more about the product or service being advertised as quickly as possible, such as with one actuation of a key.
Notwithstanding the prevalence of soft keys, there is always a desire to improve the ease and efficiency with which a user interacts with a display device. This desire is particularly apparent in conjunction with display devices having soft keys with functionality which may change depending upon the current application.
A method, apparatus and computer program product are therefore provided for providing adaptive soft key functionality for display devices. In particular, a method, apparatus and computer program product are provided that monitor interaction with user interface elements and reconfigure the soft key(s) to have a second, different functionality based on the interaction. In this way, the soft key may allow the user to control additional functions based on the user's operation of the display device.
In one exemplary embodiment, a method and computer program product for providing adaptive soft key functionality for display devices are provided. The method and computer program product provide for a display of a description of a first function of a soft key, where actuation of the soft key invokes the first function. Interaction with the soft key is monitored, and the soft key is reconfigured based on the interaction such that actuation of the soft key invokes a second function that is different from the first function. A display of a description of the second function is also provided.
In some cases, an amount of time that has passed since a last actuation of the soft key is monitored, and the soft key may be reconfigured after a predetermined amount of time has passed since the last actuation. Reconfiguring the soft key may include disabling the soft key in some circumstances.
Furthermore, a display of advertising content may be provided based on the interaction. In this case, the soft key may be configured to control an aspect of the display of the advertising content, such as the position of the advertising content and/or the size of the advertising content. The soft key may also be configured to scroll from the displayed advertising content to a different item of advertising content. Also, the soft key may be configured to perform a function such as accessing a website associated with the advertising content and/or calling a phone number associated with the advertising content.
In another exemplary embodiment, an apparatus for providing adaptive soft key functionality for display devices is provided. The apparatus may include a processing element. The processing element may be configured to provide for a display of a description of a first function of a soft key, where actuation of the soft key invokes the first function, and to monitor interaction with the soft key. The processing element may also be configured to reconfigure the soft key based on the interaction such that actuation of the soft key invokes a second function that is different from the first function. A description of the second function may be provided by the processing element.
The processing element may further be configured to monitor an amount of time that has passed since a last actuation of the soft key. For example, the processing element may reconfigure the soft key after a predetermined amount of time has passed since the last actuation. The processing element may also be configured to disable the soft key.
In some cases, the processing element is configured to provide for a display of advertising content based on the interaction. The processing element may configure the soft key to control an aspect of the display of the advertising, such as the position of the advertising content and/or the size of the advertising content. The processing element may configure the soft key to scroll from the displayed advertising content to a different item of advertising content in some cases. Also, the processing element may configure the soft key to perform a function such as accessing a website associated with the advertising content and/or calling a phone number associated with the advertising content.
In another exemplary embodiment, an apparatus for providing adaptive soft key functionality for display devices is provided. The apparatus includes means for providing for a display of a description of a first function of a soft key, where actuation of the soft key invokes the first function, and means for monitoring interaction with the soft key. The apparatus further includes means for reconfiguring the soft key based on the interaction such that actuation of the soft key invokes a second, different function, as well as means for providing for a display of a description of the second function.
In another exemplary embodiment, a system for providing adaptive soft key functionality for display devices is provided. The system includes an apparatus configured to display a description of a first function of a soft key and a description of a second function of the soft key, as well as a remote content source configured to receive data from the apparatus and to transmit content to the apparatus according to the data received. The second function may be based at least in part on the content transmitted from the remote content source to the apparatus. In some cases, the remote content source is configured to transmit content including the description of the second function to the apparatus.
Having thus described embodiments of the invention in general terms, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and wherein:
Embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the invention are shown. Indeed, the invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Like reference numerals refer to like elements throughout.
The apparatus and method of embodiments of the present invention will be primarily described below in conjunction with mobile communications applications. However, it should be understood that the apparatus and method of embodiments of the present invention can be utilized in conjunction with a variety of other display devices, both in the mobile communications industries and outside of the mobile communications industries.
The mobile terminal 10 includes an antenna 12 (or multiple antennae) in operable communication with a transmitter 14 and a receiver 16. The mobile terminal 10 further includes a processing element, such as a controller 20 or other type of processor or computing device, that provides signals to and receives signals from the transmitter 14 and receiver 16, respectively. The signals include signaling information in accordance with the air interface standard of the applicable cellular system, and also user speech, received data and/or user generated data. In this regard, the mobile terminal 10 is capable of operating with one or more air interface standards, communication protocols, modulation types, and access types. By way of illustration, the mobile terminal 10 is capable of operating in accordance with any of a number of first, second, third and/or fourth-generation communication protocols or the like. For example, the mobile terminal 10 may be capable of operating in accordance with second-generation (2G) wireless communication protocols IS-136 (Time Division Multiple Access (TDMA)), Global System for Mobile communications (GSM), and IS-95 (Code Division Multiple Access (CDMA)), or with third-generation (3G) wireless communication protocols, such as Universal Mobile Telecommunications System (UMTS), CDMA2000, Wideband CDMA (WCDMA) and Time Division-Synchronous Code Division Multiple Access (TD-SCDMA), with fourth-generation (4G) wireless communication protocols or the like.
It is understood that the apparatus, such as the controller 20, includes circuitry desirable for implementing audio and logic functions of the mobile terminal 10. For example, the controller 20 may be comprised of a digital signal processor device, a microprocessor device, and various analog to digital converters, digital to analog converters, and other support circuits. Control and signal processing functions of the mobile terminal 10 are allocated between these devices according to their respective capabilities. The controller 20 thus may also include the functionality to convolutionally encode and interleave message and data prior to modulation and transmission. The controller 20 can additionally include an internal voice coder, and may include an internal data modem. Further, the controller 20 may include functionality to operate one or more software programs, which may be stored in memory. For example, the controller 20 may be capable of operating a connectivity program, such as a conventional Web browser. The connectivity program may then allow the mobile terminal 10 to transmit and receive Web content, such as location-based content and/or other web page content, according to a Wireless Application Protocol (WAP), Hypertext Transfer Protocol (HTTP) and/or the like, for example.
The mobile terminal 10 may also comprise a user interface including an output device such as a ringer 22, a conventional earphone or speaker 24, a microphone 26, a display 28, and a hardware user input interface, all of which are coupled to the controller 20. The hardware user input interface, which allows the mobile terminal 10 to receive data, may include any of a number of devices allowing the mobile terminal 10 to receive data, such as a keypad 30, a touch display (not shown) or other input device. In embodiments including the keypad 30, the keypad 30 may include the conventional numeric (0-9) and related keys (#, *), and other keys used for operating the mobile terminal 10. Alternatively, the keypad 30 may include a conventional QWERTY keypad arrangement. The keypad 30 may also include various soft keys with associated functions. In addition, or alternatively, the mobile terminal 10 may include an interface device such as a joystick or other hardware user input interface. The mobile terminal 10 further includes a battery 34, such as a vibrating battery pack, for powering various circuits that are required to operate the mobile terminal 10, as well as optionally providing mechanical vibration as a detectable output.
The mobile terminal 10 may further include a user identity module (UIM) 38. The UIM 38 is typically a memory device having a processor built in. The UIM 38 may include, for example, a subscriber identity module (SIM), a universal integrated circuit card (UICC), a universal subscriber identity module (USIM), a removable user identity module (R-UIM), etc. The UIM 38 typically stores information elements related to a mobile subscriber. In addition to the UIM 38, the mobile terminal 10 may be equipped with memory. For example, the mobile terminal 10 may include volatile memory 40, such as volatile Random Access Memory (RAM) including a cache area for the temporary storage of data. The mobile terminal 10 may also include other non-volatile memory 42, which can be embedded and/or may be removable. The non-volatile memory 42 can additionally or alternatively comprise an EEPROM, flash memory or the like, such as that available from the SanDisk Corporation of Sunnyvale, Calif., or Lexar Media Inc. of Fremont, Calif. The memories can store any of a number of pieces of information, and data, used by the mobile terminal 10 to implement the functions of the mobile terminal 10. For example, the memories can include an identifier, such as an international mobile equipment identification (IMEI) code, capable of uniquely identifying the mobile terminal 10.
An exemplary embodiment of the invention will now be described with reference to
Referring now to
The processing element 56 may be embodied in a number of different ways. For example, the processing element 56 may be embodied as a processor, a coprocessor, a controller or various other processing means or devices including integrated circuits such as, for example, an ASIC (application specific integrated circuit). In an exemplary embodiment, the processing element 56 may be configured to execute instructions stored in the memory 58 or otherwise accessible to the processing element 56.
Referring to
The housing 60 also carries at least one soft key 54. In
The processing element 56 of the apparatus 50 is thus configured to provide for a display of a description of a first function of each soft key 54, where actuation of the soft key 54 invokes that particular function. Furthermore, the processing element 56 is configured to monitor interaction with the soft key 54 and to reconfigure that soft key 54 based on the interaction such that actuation of the same soft key 54 (following reconfiguration) invokes a second, different function. A description of the second function is provided for display by the processing element 56, e.g., replacing the description of the first function in the soft key description area 64. In some cases, only the appearance of the soft key description area 64 may be reconfigured to indicate the second function, such as through a different color, size, font, or shape of the soft key description area 64.
For example, the processing element 56 may be configured to monitor the amount of time that has passed since the last actuation of the soft key 54. In this way, after a certain amount of time has passed since a user last actuated the soft key 54 (such as after one minute, five minutes, half an hour, etc.), the processing element 56 may be configured to reconfigure the soft key 54 such that actuation of the soft key now causes a different function to be performed. As an example, an hour may have passed since the last time the user actuated the Middle Soft Key (M), which may be assigned a first function of “Select.” As a result, the processing element 56 may be configured to disable the Middle Soft Key (M), such that actuation of that key produces no result. Similarly, the Middle Soft Key (M) in the above situation may be reconfigured to have any number of second functions as appropriate, such as “Unlock” to unlock the hardware keys or “Go” to launch a certain application. The amount of time may also be a function of another event or time period, such as the amount of time before a screensaver is invoked, a display turns off, or any other event for which a time period is set by a user or the system. For example, if the apparatus is configured such that a screensaver is invoked after five minutes of idle time, the processing element 56 may be configured to reconfigure the soft key 54 one minute (for example) after the screensaver has been invoked.
In some cases, the soft keys 54 may be configured to have several functions, depending on the situation and/or the operation of the apparatus. In other words, the soft keys 54 may be reconfigured by the processing element 56 a number of times, such that the same soft key may also have a third function, a fourth function, a fifth function, etc. as appropriate for the convenience of the user. Each of the functions may be different than the other functions, and a description of the particular function may be provided in the soft key description area 64 as previously described.
In some cases, the processing element 56 may be configured to provide for a display of advertising content based on the interaction that is monitored. Turning to
The processing element 56 may be monitoring the user's interaction with one or more of the soft keys 54, such as the Left Soft Key (L) (which, in the example of
Advertising content may include any form of promotional, educational, and/or commercial information. The content may be in text format only, or it may include one or more forms of media content such as pictures, photos, music, and video. Other types of content may also be displayed in addition to or instead of advertising content. For example, the processing element 56 may provide for the display of WidSets or user defined content (such as weather forecasts, stock market reports, currently playing music, Instant Messaging presences, etc.), among other types of content.
The advertisement 68 may be presented on the display 52 in various ways. For example, the advertisement 68 may slide from the bottom of the display, covering the soft key description area at least momentarily. While the advertisement 68 is opening, one or more of the soft keys may continue to perform their first function(s) (such as turning to the next page in the article 66). Once the advertisement 68 is fully rendered, for example as shown in
In other embodiments, the advertisement 68 may slide from left to right (or vice versa), for example as scrolling text, or may appear as a progress bar. Furthermore, the advertising content may cover part or all of the soft key description area 64 and the main portion of the display when it is provided to the user, as shown in
In some cases, the advertisement 68 may be provided on the display 52 for a predetermined amount of time, during which the soft key description areas may be hidden. After the time has passed, such as after 5-10 seconds, the processing element 56 may cause the advertisement 68 to slide back down towards the bottom of the display 52, allowing the user to resume reading and/or controlling the article 66 (rather than the advertisement 68). User interaction with one or more of the soft keys 54 may inform the manner in which the advertisement 68 is provided and removed. For example, if there has been no actuation of the soft key(s) 54, the advertisement 68 may slide down towards the bottom of the display 52 slowly, and the soft key(s) may retain the second function (i.e., control of the advertisement 68) until the advertisement 68 has fully receded. Thus, in this case, actuation of a soft key 54 may cause the advertisement 68 to reappear, and the advertisement 68 may not slide off the display 52 again until the predetermined amount of time has passed once more.
In other cases, the soft key may retain its first function even if the advertising content covers or partially covers the corresponding soft key description area 64. For example, if the soft keys are idle for a certain time, advertising content may be presented in the soft key description area, at least partially covering up the description of the first function. However, upon actuation of the soft key, the corresponding first function may still be invoked. Furthermore, one of the soft keys, such as the Middle Soft Key (M), may be reconfigured so as to provide the user with the ability to focus on the advertising content such that the other soft keys may be used to manipulate and/or perform functions related to the advertising content. In this case, a user may actuate of the Middle Soft Key (M) to change focus to the advertising content and then actuate the Left Soft Key (L) or Right Soft Key (R) to control an aspect of the advertising content via the second function of the Left or Right Soft Key (L), (R). In this way, the user may provide input as to which function (first or second) is desired. Upon actuating the Middle Soft Key (M) to change focus in the example above, the soft key description area may also provide a display of a description of the second function of the corresponding soft keys to aid a user in manipulating the advertising content.
Once the advertisement 68 has been moved off the display 52, for example after the predetermined amount of time has passed, the processing element 56 may provide for an indication of the presence of the advertisement. For example, as shown in
In some cases, the apparatus may receive an advertisement or other content from a remote content source (such as another device, an advertising server, or other server). The remote content source may be configured to receive data from the apparatus (such as a request for content, an identification of the apparatus, etc.) and to transmit content to the apparatus according to the data received. In this way, the processing element may reconfigure the soft key based at least in part on the content transmitted from the remote content source to the apparatus. For example, if the remote content source is an advertising server and transmits an advertisement to the apparatus, the second function of the soft key may relate to access or manipulation of the advertisement. Furthermore, the remote content source may be configured to transmit the description of the second function to the apparatus for provision in the soft key description area (in addition to the content itself). Thus, the content provided on the display as well as the content provided in the soft key description area may both be streamed or otherwise downloaded from the remote content source.
The processing element may in some instances delay presentation of the advertisement or other content to the user for one reason or another. For example, the user may be operating the mobile terminal in a mode that does not allow for presentation of advertisements, or the user may be interacting with the soft keys such that provision of the advertisement on the display would be disruptive to the user. In this situation, the received advertisement may be placed into a buffer (i.e., stored in the memory 58 of
In some embodiments, the processing element may configure a soft key to scroll from advertising content that is displayed to a different item of advertising content via the second function of the soft key. For example, the second function of the Left Soft Key (L) may be to provide previous advertisements upon the display (i.e., by retrieving previously saved advertisements from the memory), and/or the second function of the Right Soft Key (R) may be to access new advertisements from a particular advertising source.
The processing element may also configure one or more of the soft keys to obtain more information about the advertisement for the user. For example, actuation of a soft key, such as the Middle Soft Key (M), may access a website 72 associated with the advertising content, as shown in
In some embodiments, the soft key label area may be used by the active program (such as a browser) for displaying link targets to a user when the user is hovering over (i.e., holding a cursor on top of) a link provided elsewhere on the display. In this case, if the user is viewing a particular website and moves his cursor over a provided link, the soft key description area may provide the web address of the particular link so that the user may view the address without clicking on the link.
The soft key description area may be used to provide the user with other information, as well. For example, pop-ups associated with certain “key words” on a web page (for example, word definitions, explanations, or cross-references) may be provided in the soft key description area when the user hovers over the key word rather than in the body of the display, where the pop-up may obscure the rest of the text. Other types of applications, such as document editors, radio players, music players, and spreadsheet editors, may also use the soft key description area to provide additional information to the user or additional functionality specific to the particular application. For example, a text document editor may provide a description of the font of the text in the soft key description area (e.g., bold, italic, underscore, etc.), may allow the user to change certain formatting options, and/or may provide help functions or information to the user. In a radio player, the soft key description area may be used for Radio Data System (RDS) transmissions, in which small amounts of digital information may be sent using conventional FM broadcasts. Similarly, in a music player, the soft key description area may be used for providing RIYL (Recommended If You Like) music, and in a spreadsheet, the formula corresponding to a selected cell may be displayed (and/or may be editable) in the soft key description area.
In addition to providing a description of the second function of a soft key (e.g., in the soft key description area 64 shown in
The processing element may be configured to detect the status or orientation of the apparatus and to adjust the provision of advertising content accordingly. For example, if the mobile terminal is upside down, a special advertising mode may be invoked in which the active application 76 is covered by a transparent gray layer 74 and a rotating advertising logo 78 (such as a company name) is provided in the center portion of the display 52, as shown in
In another embodiment, the advertising mode may involve the provision of advertising content 68 in cascading fashion across the display 52, as shown in
In other embodiments, a method for providing adaptive soft key functionality for display devices is provided. Referring to
The soft key is then reconfigured based on the interaction such that actuation of the soft key invokes a second, different function. Block 106. A display of the description of the second function is provided, simultaneously with or following reconfiguration of the soft key. For example, the description of the second function may be provided in the soft key description portion of the display, replacing the description of the first function. Block 108. In this way, a user may be aware of the function that is to be invoked when the soft key is actuated. As an example, the soft key may be reconfigured if it has been ten minutes since the user last actuated the soft key, and the soft key may be reconfigured to have a second function that “locks” the mobile terminal such that accidental actuation of the keys would provide no action. Alternatively, the soft key may be reconfigured such that the soft key is disabled.
In some cases, a display of advertising content may be provided based on the interaction. Block 110. For example, if it has been fifteen minutes since the user last interacted with the soft key, various forms of advertising content may be displayed for the user. Reconfiguration of the soft key in this scenario may thus involve allowing the user to control and/or access the advertising content via the soft key's second function.
The soft key may thus be configured to control the size of the advertising content (e.g., maximizing or minimizing the advertisement). Block 112. Or, the soft key may control the position of the advertising content, such that the advertisement may be moved to various locations on the display. Block 114. In some embodiments, the soft key may be configured to have a second function that allows the user to scroll from the displayed advertising content to a different item of advertising content, such as a saved advertisement or a new advertisement acquired from the advertising source, as previously described. Block 116. The soft key may further be configured to permit a user to obtain more information about the advertisement, such as by accessing a website associated with the advertising content and/or calling a phone number associated with the advertising content. Blocks 118 and 120. As another example, the soft key may be configured to launch another application when actuated by the user. Block 122.
Exemplary embodiments of the present invention have been described above with reference to block diagrams and flowchart illustrations of methods, apparatuses, and computer program products. It will be understood that each block of the block diagrams and flowchart illustrations, and combinations of blocks in the block diagrams and flowchart illustrations, respectively, can be implemented by various means including computer program instructions. These computer program instructions may be loaded onto a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions which execute on the computer or other programmable data processing apparatus create a means for implementing the functions specified in the flowchart block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus, such as a processing element including, for example, the controller 20 (shown in
Accordingly, blocks of the block diagrams and flowchart illustrations support combinations of means for performing the specified functions, combinations of steps for performing the specified functions and program instruction means for performing the specified functions. It will also be understood that each block of the block diagrams and flowchart illustrations, and combinations of blocks in the block diagrams and flowchart illustrations, can be implemented by special purpose hardware-based computer systems that perform the specified functions or steps, or combinations of special purpose hardware and computer instructions.
Many modifications and other embodiments of the inventions set forth herein will come to mind to one skilled in the art to which these embodiments pertain having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the inventions are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB08/54904 | 11/21/2008 | WO | 00 | 6/3/2010 |
Number | Date | Country | |
---|---|---|---|
60991989 | Dec 2007 | US |