Patent Application
20160080541
The present invention is related generally to a user interface for a personal digital assistant device.
Carrying a personal digital assistant (PDA) around is very convenient for tasks such as taking notes at a meeting or lecture, scheduling appointments, looking up addresses, and for performing a whole host of other functions. However, one function not easily performed with a PDA is that of telecommunications. A typical cellular telephone, meanwhile, offers a range of features, from speed dial to speakerphone to caller-ID, phonebook, etc. In order to have the functionality of a cellular telephone and the functionality of a PDA, consumers have generally had to choose from a selection of largely unsatisfactory options. The most common option is to carry both a PDA and cell phone. This is undesirable, however, because of the obvious impractical aspects of having to deal with two separate devices, both in terms of sheer bulk as well as the inconvenience of switching between units. Simply put, there are more things to buy, more things to break, and more things to lose.
Another option is to purchase an add-on telephone device for a PDA. While this option is preferable to carrying two devices around, it still has limitations. For example, an add-on telephone device adds bulk to and changes the form factor of the PDA. In addition, since such a PDA must be designed to operate without an add-on telephone, the degree to which the user interface of the PDA can be integrated with the user interface of the add-on telephone is limited. Thus, an add-on solution is of only limited value, since there is not a true integration between the cellular telephone device and the PDA, but rather two separate devices at best co-existing side-by-side.
Accordingly, what is needed is a system and method for providing a user interface to a device featuring integrated functionality of both a PDA and cellular telephone.
In accordance with the present invention there is provided a system and method for using an integrated device featuring functionality of both a PDA and cellular telephone. Features of the present invention include a power button offering control of both the computing and telephony functions of the device; a lid that turns the device on and off depending on its state, and can also be used to begin and terminate calls; a jog rocker that activates the device and is used to select from a variety of menu options; application buttons that offer direct access to applications stored on the device, and which can be configured to operate in conjunction with secondary keys to offer added functionality; an override-able ringer switch; a keyboard; and an Auto Word Completion function that verifies and corrects a user's typing in real time.
a and 6b are illustrations of a keyboard layout in accordance with an embodiment of the present invention.
a and 7b illustrates views of a display screen when Option mode and Option Lock mode are activate in accordance with an embodiment of the present invention.
In the discussion set forth below, for purposes of explanation, specific details are set forth in order to provide a thorough understanding of the invention. It will be appreciated by those skilled in the art that the present invention may be practiced without these specific details. In particular, those skilled in the art will appreciate that the methods described herein can be implemented in devices, systems and software other than the examples set forth. In other instances, conventional or otherwise well-known structures, devices, methods and techniques are referred to schematically or shown in block diagram form in order to facilitate description of the present invention.
The present invention includes steps that may be embodied in machine-executable software instructions, and includes method steps that are implemented as a result of one or more processors executing such instructions. In other embodiments, hardware elements may be employed in place of, or in combination with, software instructions to implement the present invention. The software instructions may be stored in RAM or ROM, or on other media including removable media.
The present invention includes a user interface for the operation of an integrated handheld personal computing device and wireless communication device. Referring now to
Device 100 includes an integrated GSM radio (also referred to as a cellular telephone), and while in alternative embodiments is of varying sizes and shapes, in one embodiment the device is designed to fit comfortably in a pocket. While the radio uses the GSM standard in one embodiment, in alternative embodiments the radio may use the CDMA standard, or any of a variety of other well-known wireless standards.
Device 100 has a power button 110, located in one embodiment on the top face, next to the antenna 112. In one embodiment, the power button 110 performs the following functions:
Referring now to
Referring now to
In addition, in one embodiment pressing the power button 110 when there is an incoming call silences the ring or vibrate. Further, if a call is in progress, pressing the power button turns off the device 100 but does not terminate the call. Finally, if the device is off when a call comes in, the device is turned on, and the backlight is illuminated, which helps to locate the device 100, e.g., in a poorly-lit room.
Referring again to
In one embodiment, lid 104 features a hardware switch for lid open and lid close detection, and may additionally include an integrated speaker for flip phone-like functionality. When closed, in one embodiment, lid 104 covers all of base 102 except for application and scroll buttons 106. In one embodiment, lid 104 also includes a transparent window for viewing the display 118 of device 100 while the lid 104 is closed.
The effect of opening and closing the lid 104 varies according to the state of device 100 at the time the lid 104 is opened or closed. In one embodiment, and referring now to
If the device is off, opening the lid turns on the device 100, and launches 502 a predetermined application. In one embodiment, the predetermined application is a speed dial view of a telephone application, however in other embodiments the application can be any application on the device 100, assignable by the user in one embodiment via a preferences control panel-type application. If the device is off, closing the lid has no effect 504.
If the device is on, then it is in one of three states: either a call is in progress, a call is incoming, or there is no call activity.
If a call is incoming, then an incoming call notification is given to the user. An illustration of such a notification is shown in
Similarly, if the user is in the process of closing the lid when a call comes in, it is desirable to assume that the lid is being closed not in response to the incoming call, but rather by coincidence. Thus if the lid is closed within an initial time, e.g., one second, of the first notification of an incoming call, no action is taken 510. After this initial period, if the lid is closed, then in one embodiment the ring is silenced, the call is ignored, and the device is turned off 512.
During an active call, the lid is open in a preferred embodiment, unless a headset is plugged in. If a call is in progress and the headset is being used, then opening the lid has no effect on the call 514. If the lid is closed while a headset call is in progress, the device is turned off, but the call is not disconnected 516. If a telephone call is in progress without using a headset, then closing the lid hangs up the telephone, in one embodiment after displaying a warning message confirming that the call is about to be disconnected, and turns the device off 518. During the confirmation warning message, the user has the opportunity to tell the device not to disconnect the call, e.g. by pressing the scroll-up button. In alternative embodiments, the call is disconnected as soon as the lid is closed.
If a telephone call is not in progress, then in one embodiment, opening the lid when the device is already on has no effect 520. That is, even if there is an application assigned to be launched upon the opening of the lid, when the power is already on, opening the lid does not launch the assigned application, but rather has no effect on what application is currently executing. Also, in one embodiment, if a call is not in progress, closing the lid turns the device off 522.
In addition, in one embodiment keyboard 108 is deactivated when the lid 104 is closed, whether the device 100 is on or off. This guards against inadvertent input to the device when pressure is applied to the lid, e.g., if the device is carried in a pocket, or if something heavy is placed on top of the device. In alternative embodiments, the keyboard 108 remains active at all times regardless of lid position. In one embodiment, application and scroll buttons 106 remain active even when the lid 104 is closed. This allows the scroll buttons to be used to respond to dialog boxes that may be presented to the user when the lid is closed. For example, if an alarm goes off, the user can dismiss the alarm by pressing a scroll button, instead of having to open the lid to tap the display 118 or press a button on the keyboard 108.
Device 100 includes a jog rocker 114 such as is pictured in
While individual applications provide specific responses to input from jog rocker 114, in one embodiment pressing the jog rocker 114 when device 100 is turned off wakes device 100 up and launches a predefined application, such as the phone application in one embodiment.
In one embodiment, this behavior is executed on jog rocker 114 press, not release, so one embodiment, this behavior is executed on jog rocker 114 press, not release, so that a press and hold of the jog rocker 114 wakes the device up, launches the predefined application on the press, and then executes within the application whatever that application has specified for a jog rocker 114 hold on the hold.
In another embodiment, jog rocker 114 can be used to provide a scroll-up and scroll-down function similar to that provided by scroll buttons 106. In one embodiment this is the default use for jog rocker 114 when an application does not provide additional functionality for the jog rocker.
Ringer switch 116 is used in a preferred embodiment to select whether incoming telephone calls should produce an audible ringing sound on device 100. In a first position, device 100 produces such a ring tone, which is customizable in one embodiment using application software stored on device 100. In a second position, device 100 does not produce a ring tone for an incoming call. In one embodiment, device 100 is configured to vibrate in response to an incoming telephone call. The vibrate feature of device 100 may additionally be activated by applications executing on device 100, for example even when ringer switch 116 is in the first position (the audible ring position).
In one embodiment, when ringer switch 116 is in the second position, all sounds made by device 100 are muted, and not just the ring tone. Thus, for example, while a number of applications executed on device 100, e.g., an alarm, a message alert, etc., may instruct device 100 to produce a sound, the location of the switch in the second position will stop device 100 from actually making the sounds. In yet another embodiment, device 100 allows software resident on device 100 to override the physical setting of ringer switch 116. This may be of particular use, for example, if the ringer switch is in the first position while a call is in progress and it is undesirable to have sounds from device 100 interfering with the call in an annoying fashion.
A device such as device 100 typically has one or more application and scroll buttons 106 located physically on the device, providing direct access to applications associated with the buttons, as well as up-down and left-right scroll functionality. Using a keyboard 108 of device 100, different applications are assignable to the application buttons 106 being pressed in combination with a modifier key. In one embodiment, an “option” key is the modifier key for these key combinations.
In one embodiment, the following applications are mapped to option and (“+”) application button combinations:
In one embodiment, the Option+Application button key combination works both in series and in parallel. For example, pressing and releasing the Option button (a serial combination), then pressing an application button 106 launches the application that is mapped to that application button's option modification. Similarly, pressing and holding the Option button while pressing the application button 106 (a parallel combination) also launches that application button's option modification.
If the option modification times out before the application button 106 is pressed, then the functionality is the same as if only the application button had been pressed.
Pressing and holding Option, and then pressing an application button 106 while Option is still held down also launches the application that is mapped to that applications button's option modification. What occurs if the user continues to hold the application button in is controlled on an application-by-application basis.
In one embodiment, the following application buttons 106 and combinations are mappable:
In alternative embodiments, the following combinations are also mappable:
In one embodiment, keyboard 108 includes the following keys:
a illustrates one embodiment of a keyboard 108 layout. In
b illustrations just the number/punctuation keys extracted from
In an unmodified state, the keys produce the main character printed on them. In one embodiment, there is no on screen-modification state indicator for the unmodified keyboard state. In Shift state, the keys produce a capital version of the main character printed on them, as illustrated in
In Option state, the keys produce the alternate character illustrated in
In one embodiment, pressing the Option key once puts device 100 in Option state. Pressing Option in Option state puts the device in Option Lock state. Pressing Option in Option Lock state clears the state. Option state is canceled upon the entry of the Option-modified character. Option Lock state is not canceled upon the entry of the Option-modified character, hence the Lock-ness. Option state can be canceled without entering a character by pressing the Option key twice (once for lock, the second for clear) or pressing backspace. Note that in one embodiment, backspace cancels Option state, but not Option Lock state.
Referring now to
Referring now to
Holding down a key for a prolonged period causes the key to repeat. In one embodiment, all text entry has the same repeat rate, i.e. holding down the j produces j's at the same rate as holding down shift+j produces J's and option+j produces 5's. The Option and Shift keys both “time out” if additional input is not received within a prescribed period of time, e.g., 3 seconds in one embodiment. Note that in one embodiment the Option Lock and Shift Lock states do not time out.
In addition, in a preferred embodiment, when the currently executing application on device 100 changes from a first application to a second application, the Shift state is cleared to avoid unintended Shifted input into the second application.
In order to provide a fast and easy way to enter awkward or often-misspelled text, device 100 includes a word auto-completion/correction system that in one embodiment checks every word that a user enters against a database of common misspellings and convenient abbreviations and replaces the entered word with a preset correct or complete version of the word. For example, if a user enters ‘beleive’, it will automatically be replaced with ‘believe’. If a user enters ‘μm’, it will be replaced with ‘I'm’.
In one embodiment, Word Completion executes whenever a user enters any character that signals that they are finished typing the previous word, e.g.:
For instance, when a user types b,e,l,e,i,v,e the word ‘beleive’ is still displayed. If the user then enters a space (or any of the characters listed above) then ‘beleive’ is replace by ‘believe’. Typing backspace once will erase the space (or tab, new line, etc.) that invoked the Word Completion. Typing backspace a second time will undo the word completion without deleting the last character of the word. At this point, typing any of the characters that usually invoke Word Completion will not invoke it again.
If the replacement word in the database is not capitalized, then the capitalization of the word to be replaced is maintained. For instance, there is an entry in the Word Completion database that has the wrong word “feild” marked to be replaced with “field” so:
If the replacement word in the database is capitalized, then the resulting word is capitalized no matter what the capitalization of the word to be replaced was. For instance, there is an entry in the Word Completion database that has the wrong word “im” marked to be replaced with “I'm” so:
In one embodiment, device 100 switches off or “sleeps” in order to conserve power after a predefined period of time. In such circumstance, pressing a key on the keyboard 108 wakes the device back up, i.e. restoring the device to a power on state in the same condition that it was in prior to going to sleep. In other embodiments, waking the device 100 up is equivalent to a power on command, which starts the device with a predefined initial application. Note that the keys which will wake the device up may be predetermined, or may be changeable by the user.
In one embodiment, some navigational activities of device 100 are keyboard enabled. Buttons such as “OK,” “Done,” and “Cancel” are mapped to certain keys and key combinations. Common actions, which may also be on-screen buttons like “New” and “Details . . . ,” are frequently included as menu items. These menu items have menu button+letter combinations assigned to them so that they may be executed easily from the keyboard 108.
In one embodiment, menus on device 100 are navigable via a menu key and menu mode. Pressing and releasing a dedicated hardware menu key on keyboard 108 displays a first pull-down menu of the current view. Pressing and releasing the menu key a second time dismisses the menu.
While the menu is being displayed, in one embodiment the user can navigate the menus and execute menu items with the following actions:
At any time, whether or not a menu is displayed, pressing and holding the menu key and pressing a one of the shortcut letters executes the corresponding menu item, in one embodiment, without the menu being drawn on the screen. Pressing and releasing the menu key and then pressing the shortcut letter will display the menu, however, in one embodiment.
Any menu that is being displayed is dismissed whenever a menu item is executed. Shift Lock and Option Lock are ignored when entering short cut letters. It is possible, however, to enter an option character as a short cut character in parallel:
Menu mode itself will not clear the modification state, but the execution of a menu item may clear the modifications state depending on what that menu item does.
Thus, when buttons containing certain text are on the screen, certain keys or key combinations can be pressed that will execute the buttons as if they were pressed on the screen.
The following four keys/key combinations are used for mapping to certain common on-screen buttons in one embodiment:
Globally, in one embodiment:
In one embodiment, if there is no opportunity for text entry on a particular screen, then the holding down of the Option key may be unnecessary. Thus, for example, within the context of alert dialogs:
Return and Backspace do not map to buttons in other contexts in one embodiment, since in other contexts there will likely be text areas in which Return and Backspace benefit from their normal functionality.
In addition, in one embodiment the mappings described above also apply to non-English based applications. For example, Option+Return is mapped to “Oui” in a French language application. This allows a user to execute a foreign-language application on device 100 while providing similar functionality to an English-language application.
The foregoing discloses exemplary methods and embodiments of the present invention. It will be understood that the invention may be embodied in other forms and variations without departing from the spirit or scope of the invention. Accordingly, this disclosure of the present invention is illustrative, but not limiting, of the invention, the scope of which is defined by the following claims.
This application is a continuation of U.S. patent application Ser. No. 13/117,729, filed on May 27, 2011, which is a Continuation of U.S. Pat. No. 8,224,379, filed on Jun. 27, 2008, which is a Continuation of U.S. Pat. No. 7,395,089, filed on Oct. 12, 2001, which claims priority and benefit under 35 USC §119(e) to U.S. Provisional Patent Application No. 60/297,817, filed on Jun. 11, 2001, each of which is incorporated herein by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 60297817 | Jun 2001 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 13117729 | May 2011 | US |
| Child | 14947513 | US | |
| Parent | 12163948 | Jun 2008 | US |
| Child | 13117729 | US | |
| Parent | 09976475 | Oct 2001 | US |
| Child | 12163948 | US |
