I. Field of the Invention
This invention relates to the operation and input of data to electronic devices and small or miniature computing devices. Such as personal digital assistants, watches, and other small form factor computing devices whose miniature form provides limited space for providing input means. In particular, this invention discloses a simple contextual navigation operating method for controlling data entry and display on electronic devices with limited space for input components and on small and miniature computing devices, both of which require a minimal number of buttons to accomplish a plurality of input and display operations. Using a unique combination of only two finger operated buttons, along with an optional but also preferred voice input button, the user is presented with an easy navigation and input system, for computing device having small surfaces for input components, which eliminates the need for keyboards and stylus-based entry which grows ever more cumbersome as the size of computing devices decrease.
II. Description of the Related Art
Small handheld and other computing devices requiring a generally small input device, represent one of the fastest growing sectors of the electronics industry. IDC predicts the demand for smart handheld devices alone will grow from 12.9 million units in 2000 to over 63.4 million by 2004, creating a worldwide market worth more than $26 billion. Automobile industry experts predict 50% of the 50 million vehicles produced each year will have in-vehicle telematics and multimedia systems by 2005. Further, as an example, more than 5 million U.S. consumers carry miniature computing devices secured to their key chains which will communicate with computers at gasoline service stations in order to speed up transaction times and take advantage of promotions.
The field of small and miniature computing devices, and devices with limited input space for a control set mounting surface is ever growing. Current devices include wrist-based computers, small cellular phones, MP3 players, USB engageable devices, PDAs, cameras, GPS units, car keys, automotive steering wheels, and military applications such as controls for use by soldiers having limited hand function.
However, unlike desktop and even laptop computers, miniature computing devices and many larger devices can have very limited input space in which to present data and to receive input from the user.
Additionally, many devices such as cars employ remote computers but have limited space for the input devices since they must be adjacent to the driver's hands. Further, with the continued shrinking of computing devices and increase in the memory carried by such devices, a computer the size of a wristwatch or car key with the computing power of a desktop computer is already a reality. As these devices shrink, and memory and processing in such devices grows, the input, retrieval, and display of data will continue to grow to increase as an ever more vexing problem. Further, while some devices may not shrink, the surface area for input to them may be very small.
Prior art attempts at solving this problem have included miniature keyboards and stylus based handwriting recognition. However, neither of these solutions is amendable to smaller form factor devices. Keyboards need to be large enough for adult fingers to reach every key without accidentally depressing adjacent keys to the desired key. Additional, shrinking display screens caused by physically shrinking computing devices make stylus-based input impractical, especially for those people who have trouble reading small type or hitting the correct point on a small screen with a very small stylus.
Other examples of prior art have dispensed with a full alphanumeric keyboard by providing a numeric keyboard in which multiple presses of a given numeric key to generate a specific letter. This type of operating method still imposes a significant size limitation on a device and tends to be slow to use. Furthermore, entry of punctuation and spaces, along with editing requires the user to remember the special functions of the numeric and other keys. However, because of the small size of the display and relatively large number of buttons, there is no way for these devices to show the effect of all of available buttons.
This usability problem is particularly important in miniature computing devices aimed at uses in telematics applications, key chains, and watches. These devices are typically aimed at broad consumer markets and thus require easy and intuitive usability by consumers with minimal experience with such devices and minimal interest in devoting substantial time to learning how to use such devices. One prior art solution is a stylus-based device utilizing handwriting recognition. However, as with keyboards, the need to provide sufficient writing space limits the minimum size of such a device. In addition, as devices become smaller, the stylus itself, which needs to be long enough to be securely held by the user, becomes a limitation on the minimal size of such devices. The stylus is also a liability in terms of the need to carry and secure them when not being used. Beyond these size and carrying limitations, stylus-based devices in the prior art have had problems with slow entry of data, and the need in some implementations for the user to learn a variant of the alphabet to allow the device to adequately distinguish between different characters.
An additional means of operating a computing device employed in the prior art is the wheel device that is rotated to operate. Some implementations include the ability to press the wheel to allow it to also act as a button. However, this potential solution also has its shortcomings. First, the wheel must be placed on the side of a device to be easily rotated, limiting use for applications such as watches where the device is worn rather than held. Further, the wheel mechanism is a liability in terms of device lifespan since the protruding portion of the wheel is easily damaged when dropped or bumped. Finally, while the use of a wheel to navigate through lists of data or functions is reasonably intuitive, the rotating wheel is unintuitive to use for other input operations. More importantly, because a wheel is easily rotated off the desired selection, use of the wheel requires that the user maintain eye contact with the device while using to ensure that desired navigation has occurred. This has obvious disadvantages in low light and driving applications.
What is needed to allow further miniaturization of computing devices is an operating method that does not place a substantial inherent limit on miniaturization and that requires only a minimal time investment to learn how to use.
An operating method for computing devices where space is limited for input components should optimally use a minimum number of buttons or other input means to receive user input to allow the input device to remain small in size. A virtual display device such as an LCD display, should provide constant feedback to the user as to the changing function of these buttons, individually or in combination thereby providing the user with means of contextual navigation of the various screens and operations of the device. Furthermore, the optional addition of a means of voice input to supplement the minimal button set simplifies input of additional data while also enabling usage in situations, such as driving, with little physical or eye contact required. Additionally, with space available, additional buttons may be provided for additional functions such as text input or exiting the device or moving forward or backward on a visual screen.
The present invention addresses the problems described above by providing an operating method for miniature computing devices and for input to computing devices with limited space for the input components. In accordance with the invention, the device employs at least two buttons and a visual display device. Additional buttons may be provided depending on available space and are anticipated. A unique visual indicium is used to indicate each button or button combination on the visual display and the corresponding function of that button or combination. A different function of the device is thereby performed in response to pressing one or both of these buttons. An additional visual indicator may be used to signify that holding both buttons for a predetermined period of time results in the device performing a fourth function in response.
A further problem addressed by the present invention is navigation through large volumes of textual data that may be stored on a miniature computing device as in a personal contact or address database. While this data may be acquired by the miniature computing device by synchronization or download from another computer or sharing of virtual business cards, “vcards,” between different miniature computing devices, navigation through the resulting large database of data records can be quite tedious. Prior art methods provide wheels to scroll through data items, or repeated key presses to stimulate entry of letter data (e.g. pressing the “2” key of a telephone keypad 3 times to enter a “C”). However, these methods are obviously very tedious for large databases and are particularly poorly suited to telematic applications.
In the operating method of the present invention, an additional third button or third means to input other commands may be provided. The third means to input can be pushing the first two buttons at the same time in the basic embodiment used where space is confined. In a particularly preferred mode of the device, the third button would provide for voice commands to be input to enable storing of a vocal input in association with a displayed screen or data item and to enable direct navigation to that associated screen upon later input of substantially the same vocal input. Thus, for example, simply by stating a contact's name, the miniature computing device can jump immediately to displaying that persons contact information, or in an alternative embodiment, a map to that person's home. Additionally, if space allows, the third button might also provide an input means for simple actions such as backspacing in the software or exiting the device or other simple actions and such is anticipated.
Still further, employing the method and apparatus herein disclosed with a minimal number of input buttons, text may also be entered. The disclosed system would not dependent on having a “qwerty,” ISO12 (telephone), or any other type of traditional, physical (hard) keyboard. Instead, the operation that is assigned to any of the buttons during text entering will employ a navigation through a list of items on the display to activate individual items, and selection of the active item. In the text entry mode, the button or collected sequence of button actions used to navigation would be navigation buttons which in the two button system would be the first and second buttons. The button or collected sequence of button actions used to select items is the third means for entry, which in the simplest form of the device, is the two buttons pressed simultaneously. For text entry, the display has a region to display the text that has been entered, called the “text display.” There is also a soft keypad for entering the text, called the “keypad.” The soft keypad consists of a series of graphical keys in a display grid, with each key representing a character. One of the keys will be the active key, and it will be highlighted in some manner. The active key is said to be the location of the “keypad cursor.” By pressing the navigation keys, the user changes which key is the active key. When the user presses the select button, the character represented by the active key will be entered and subsequently displayed on the text display. Text selection can be enhanced using software to present predictive characters from the characters on the grid.
In this respect, before explaining at least one embodiment of the operating method and apparatus for input to electronic devices in detail, it is to be understood that the invention is not limited in its application to the details of construction, and to the arrangement of the components set forth in the following description or illustrated in the drawings. The invention is thus capable of other embodiments and of being practiced and carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein are for the purpose of description and should not be regarded as limiting.
As such, those skilled in the art will appreciate that the conception, upon which the input method and apparatus employed therewith is based, may readily be utilized as a basis for designing of other methods and components for carrying out the several purposes of the present invention. It is important, therefore, that the claims be regarded as including such equivalent construction insofar as they do not depart from the spirit and scope of the present invention.
The Features, objectives, and advantages of the invention will become more apparent from the detailed description set forth below when taken in conjunction with the drawings wherein like parts are identified with like reference numerals throughout and wherein:
The function performed by the various button combinations may change based on the context of overall activity that is being performed by the device. As is obvious to those skilled in the art, the exact function of any of the easily accomplished possible four inputs from the two buttons can change depending on the software employed and the use the herein disclosed contextual navigation using only two buttons and an optional voice input for a multitude of different software input is anticipated.
An embodiment of the operating method according to the present invention is illustrated by the flow diagram of
Some embodiments of the present operating method may also provide for navigation using the addition of voice input of voice commands to display a screen that has previously been associated with that specific voice input.
The device 10 may accept the voice input in conjunction with depression of this third button 40, for a determined period after depression of this third button 40, or for a time period following depression of the third button 40 that is substantially equal to the depression time it was held. Or combinations of this timing could be combined to allow for vocal input and then confirmation or search activation for a match between the input voice command and a particular page of data. After the vocal input is complete, the vocal command so input is processed. One embodiment of the vocal input processing is voice recognition wherein the voice input is converted to corresponding text or phonetic data or a digital representation of the voice command and stored in the memory of the device 10. In other embodiments, other representations of the vocal input data may be stored, such as minimally processed PCM data or compressed data using the voice coding techniques utilized by mobile telephones. The voice command is thus converted to a format that may be stored in memory of the device 10 and associated with a display page for later retrieval when the voice command is repeated and input.
As further depicted in
When the voice entry function is selected at 230, the recording function is performed resulting in the display 250. The voice input is received here as was described previously. When voice input is completed, a final confirmation 270 is displayed. If the save function is selected, the voice input is stored in memory and associated with a particular display 210. This vocalink may be traversed at a later time following the method as shown in 230 and 240 wherein the user would simply repeat entering the voice command that was associated earlier with a particular entry and thus a user may “jump” to a particular display screen which is associated to the particular voice command that has been stored in memory and associated with that particular page of data.
When employed for text input on a computing device which has limited space for input components, the operation that is assigned to the buttons is navigation through a list of items on the display to activate individual items, and selection of the active item. The buttons or collected sequence of button actions used to navigate are called navigation buttons, which would generally be the first and second buttons. The button or collected sequence of button actions used to select items is called the select button, which would be the third means for input of either both buttons simultaneously, or a third button, or a voice command.
For text entry, the display has a region to display the text that has been entered, called the “text display.” There is also a soft keypad on a visual grid for entering the text. The soft keypad consists of a series of graphical keys on the grid with each key representing a character. One of the keys will be the active key, and it will be highlighted in some manner. The active key is said to be the location of the “keypad cursor.”
By pressing the navigation keys, the user can change which key is active and enhanced by the curser. When the user presses the select button or in the two button mode of the device, both buttons simultaneously, the character represented by the active key will be entered and subsequently displayed on the text display.
The keys in a soft keypad are arranged in a line or grid. Typing is typically very slow in this type of system because of the time it takes to find the proper key and to move the keypad cursor to it. However, the method herein in a particularly preferred mode, would employ predictive text to address both of these issues.
Using predictive text input, the keypad is arranged to have a fixed set of characters that will be used for data entry. Input will work with a minimum number of keys or may include a set of control keys, such as backspace, forward and back arrows, the shift key, and enter and space keys. The fixed keyboard will also consist of the letters of the alphabet, preferably arranged sequentially in alphabetical order, and the digits and punctuation symbols.
The keypad also has a group of “predictive” letters or symbols. This set of keys changes based on the previous characters that have been entered. The total number of characters should be small enough so the user can quickly and easily scan the keys to see if the desired key is present. The group of predictive letters is arranged in a preferred location, in such a way that the easiest keys to use are the predictive keys. The user also always has the option of using the fixed keys.
The predictive keys will be determined based on the most probable next character to type based on the previous characters typed. The most probable character will be the fastest character to find and select. As the characters are less probable, they are in a less favorable position. There are a total of N predictive keys. If the user wants to enter a character that is not in the top N most probable characters, he will have to enter that character from the set of fixed keys.
For computing devices sporting larger displays, an additional set of keys can be used for word completion. These keys will each include an entire word. As the user enters characters, the most probable words based on the previous typed characters will appear in these keys. Selecting one of these keys will enter the necessary letters to complete the word.
In a method for determining the probability for a character to be the next character typed, a list of words, or other groups of characters, is used with a weight value for each word, which is based on the frequency of use of that word for the relevant application. The software on the device keeps track of the letters that have been entered since the start of the current word. As each of these letters is typed, the subset of words from the list consistent with the entered letters is created. The likelihood of a given letter being typed next is determined from the number of times that letter appears next in the subset of consistent words combined with the weight of each of those words.
The following examples demonstrate a keypad with predictive text for systems with three and five buttons.
The device as shown in
As shown in
The characters available for input are arranged in the grid 51 with the first row of letters being control characters, the second row being the predictive characters, and the rest of the rows being fixed character keys. There generally are a maximum of eight predictive keys. However as shown in
During use of the method herein for the embodiment with five buttons, each time after the user selects a character, the cursor jumps to the start of the predictive row. This makes the first of the predictive characters the easiest key to reach. After the initial characters, the user should almost always be able to select the next character from the group displayed on the predictive row. This minimizes the number of letters the user must scan to find the desired next letter and the time it takes to reach that letter. At the same time, the user can always select from the keys in the fixed keypad, which are in known locations.
As an exemplar of the use of the control method for electronic devices where space for input components is limited,
Of course virtually any electronic device where a small footprint is desireable, or required for the input components, may be controlled by the method herein using minimum button sets, and such that would occur to those skilled in the art are anticipated. Further, while all of the fundamental characteristics and features of the operating method for computing devices with limited input buttons have been described herein, with reference to particular embodiments thereof, a latitude of modification, various changes and substitutions are intended in the foregoing disclosure and it will be apparent that in some instance, some features of the invention will be employed without a corresponding use of other features without departing from the scope of this invention as set forth. It should be understood that such substitutions, modifications, and variations may be made by those skilled in the art without departing from the spirit or scope of the invention. Consequently, all such modifications and variations are included within the scope of the invention defined herein.
This application is a continuation in part application from U.S. application Ser. No. 10,229,860 filed Aug. 27, 2002.
Number | Date | Country | |
---|---|---|---|
Parent | 10229860 | Aug 2002 | US |
Child | 11446439 | Jun 2006 | US |