Patent Grant
7495585
The invention relates to a method for inputting characters in an electronic device, to an electronic device, and to a computer program product.
Electronic devices, such as mobile communication devices, are often used in situations where a user cannot establish or maintain visual contact to the device when using the device. Entering digits using regular keypad is error prone and slow to do in eyes-busy situation. However, dialling a phone number is still a very basic call management feature even though often most of the phone numbers are stored in mobile terminal's phonebook. The user usually has to find a correct digit by relying a tactile feedback of the keypad. Unfortunately ergonomics of many keypads does not meet the requirements of such task. Also when using a regular keypad, the user has to detach his finger from the device when selecting digits, i.e., every time after typing the number, the user has to orient his/her typing finger with respect to keypad. This usually requires glance at the keypad, if the user is not very experienced in eyes-busy usage of the device. In addition, checking the phone number is not possible without seeing it. In order to do this, the user usually needs to quickly take a glance at the display and try to accomplish the task without causing any accidents or other troubles because of losing focus from the main activity like walking or driving a car.
GB2402105 discloses a data input method for a touch screen device. The method comprises selection of a virtual key on the touch screen and confirmation of said selection: The selection occurs when the user presses down on the screen overlying the virtual key with a force exceeding a first pre-defined force and confirmation of the selection occurs when the user presses down the on the screen overlying the virtual key with a force exceeding a second pre-defined force. The step of selection of a key may be associated with various forms of feedback to clearly indicate the user that a particular key has been selected. One possibility is voice feedback: the name of a key that has just been selected could be spoken by a synthetic voice. However, the solution is limited to inputs on a touch screen operations and for providing audio feedback only identifying a key that was directly manually selected by the user. The user probably still has to establish a visual contact to the touch screen in order to focus to the correct character amongst all characters on the visual display providing no key specific tactile feedback.
There is also specific software available assisting visually impaired users to use mobile phones. This software provides audible aid for the user when the user is browsing menu items: Audio prompt provides the name of a menu when the user locates a selector to this menu. Further, entries in a call menu may be identified in a similar fashion by audible guidance, whereby an audible identification of the name of a person whose call was missed is provided to the user. The user may then select a call set-up to the currently selected and already existing contact. Messages may be entered such that the audible feedback is provided after a button has been pressed, i.e. the audible feedback is specific to the physical button and is provided only after the button has been entered. However, audible guidance is limited to these aspects.
There is now provided an enhanced solution for providing feedback to a user of an electronic device. This solution may be achieved by a method, an electronic device and a computer program product which are characterized by what is disclosed in the independent claims. Some embodiments of the invention are set forth in the dependent claims.
According to an aspect of the invention, an enhanced audible feedback solution has been invented for electronic devices using an input device facilitating navigation though a plurality of available user interface input options and confirmation of a selected input option. The electronic device is arranged to define, as a response to detecting a selection of a character on the basis of a detection of a first input to an input device of the electronic device, an audio segment specific to the character. The electronic device is arranged to output the defined audio segment via the audio output means prior to a confirmation by a second input to the input device, the second input being associated with a function adding the character as part of a character sequence entered by the user. The selection of a character is to be understood to cover a first step for adding the character as a part of the entered character sequence. For instance, if a display is applied, the selection of a character may cause a focusing of a locator on a display to the character.
According to an embodiment of the invention, the control unit is arranged to display on a display of the electronic device a list of available characters which may be navigated in horizontal or vertical direction on the basis of inputs detected to the input device. The character represented by the first input option may in a further embodiment be highlighted on the basis of the detection of the first input to the input device.
According to another embodiment of the invention, the audio segment may be created by speech synthesis or an appropriate pre-stored audio segment may be selected for the selected character.
According to an embodiment of the invention, the electronic device is arranged to select a second input option associated with an action relating to the character sequence as a response to detection of a third input to the input device. The electronic device is arranged to cause an output of an audio segment specific to the action, and the electronic device is arranged to initiate an action associated with an inputted character sequence as a response to detection of a fourth input following the third input to the input device.
The embodiments of the invention provide several advantages. Audio feedback helps to input characters to the electronic device, for instance when entering digits and making a call, while doing something else on the same time requiring main visual attention. In addition to people in eyes-busy situations this invention also helps visually impaired users to use any mobile terminal without any additional accessories.
In the following, the invention will be described in greater detail with reference to exemplary embodiments and the accompanying drawings, in which
The embodiments of the invention are applicable to electronic devices, such as a mobile station used as a terminal in telecommunication systems comprising one or more base stations and terminals communicating with the base stations, for example. The device may be used for short-range communication implemented with a Bluetooth chip, an infrared or WLAN connection, for example. The electronic device is, for example, a portable telephone or another device including telecommunication means, such as a portable computer, a personal computer, a handheld computer or a smart telephone. The portable electronic device may be a PDA (Personal Digital Assistant) device including the necessary telecommunication means for establishing a network connection, or a PDA device that can be coupled to a mobile telephone, for instance, for a network connection. The portable electronic device may also be a computer, an accessory device, or a PDA device including no telecommunication means.
The control unit 100 controls functions of the electronic device. Computer program codes executed in a processing unit of the electronic device may be used for causing the electronic device to implement the control unit 100 and in general the means for providing inventive functions relating to giving audible user feedback, some embodiments of the inventive functions being illustrated below in association with
Inputs from the user of the electronic device are received by means of the input device 104. The control unit 100 is connected to the display 102 and configured to control different application views on the display 102. The control unit 100 receives user input commands from the input device 104. The input device 104 receives user inputs for navigating in different operating modes of the electronic device, such as navigating in menu structures, in application views, or, as in the present embodiment, between selectable input options, shown on the display 102. The input device 104 and the control unit 100 are configured to provide navigation means for navigating though a plurality of available user interface input options and confirmation means to confirm a selected input option. The control unit 100 interprets the detected selections to the user input device 104, performs given software functions based on thereon and, as a result of the performed software functions, defines and outputs appropriate audio segments specific to the selections, and displays an updated view on the display 104. In practise, there are a plurality of specific sets of input options, which may also be referred to as available information candidates, in a specific operating mode of the electronic device. These input options may be navigated by the input device 104, i.e. currently selected or active input option may be changed for instance by pushing up/down selectors of the input device 104.
In the present embodiment, a specific user input mode may be entered in which the input device 104 may be operated to select characters and confirm addition of selected characters to form character sequences. A character specific audio segment is echoed for the user via the audio output means 110 as a response to detection of a selection of the character. In a further embodiment, such character sequences are entered to form telephone numbers by which a telephone call may be established from the electronic device. The input device 104 is not limited to any specific input methodology, but could be arranged by a virtual button on a touch-screen display or a physical button on the cover of the electronic device, for instance.
The input device 104 of the electronic device is a navigation key with five selectable regions or buttons 211, 212, 213, and 214 for controlling given software functions. Depending on current operating mode or state of the user interface of the electronic device, up to five operations may be associated with the input device 104.
The navigating means may be arranged by regions 210, 211 and/or 213, 214. In the present embodiment the regions 210 and 211 are associated with functions for navigating the list 200 in upward and downward directions. The control unit 100 is arranged to detect control commands indicated by the input device 104, and to detect user inputs to given navigation blocks 210 to 213. On the basis of these user inputs to navigations blocks currently associated with a navigating function, the currently selected character or action, indicated by the broken line 220, may be changed and at the same time the list view 200 may be scrolled.
In on embodiment, the input device 104 comprises a specific confirmation or selection button or a selectable region for confirmation or selection. In
The appearance of the display and the form of the input device 104 may be set as desired. Different directions may be marked with individual icons, such as arrows up and down for navigation regions 210 and 211, and arrows left and right for horizontal navigation blocks 212 and 213, and crossed arrows for the control block 214. In one embodiment currently available functions of the user input device are displayed. Also appropriate colors, text, drawings or fill effects may be utilized for facilitating navigation and confirmation.
It is to be noted that
There are many implementation alternatives for the input device 104. The input device 104 may also be of any other shape than that of a square, such as a circle, for example. It is possible to apply 3-way navigation (up, down, select) key or 2-way navigation (up, down) key and a separate selection key, for instance. Another example is an 8-way navigation input device. The input device 104 may in a still another embodiment be a roller (navigation key) that may be rolled in vertical direction and/or horizontal direction to implement the navigating. Such roll may also be provided with the confirmation function, for instance by pushing the roll downwards towards the main body of the electronic device.
The control unit 100 is arranged to define, as a response to detecting a selection of a character on the basis of detection of a first navigating input causing a selection of a character or an action to a character sequence, an audio segment specific to the character or the action. The control unit 100 is arranged to cause echoing of the defined audio segment via the audio output means 110. Referring to
In one embodiment audible feedback is also produced in response to detecting a confirmation of a selection of a character or an action.
The audio segments may be speech and/or non-speech audio. In one embodiment the selections of characters and actions are represented by speech output, whereby the selected character may be spoken, whereas non-speech audio feedback on confirmations of the selections is applied. Also the feedback on the characters could be provided by non-speech audio, for instance by character specific tones. A non-speech audio may be produced after the confirmation in order not to disturb the user, but still giving confirmation of the selection. However, for ‘Call’ command a speech prompt may be played also when confirming this action to give a clear indication that a call will be established.
In one embodiment audio segments associated with characters or actions are stored in the memory 106. The control unit 100 is arranged to retrieve an associated audio segment from the memory 106 and play the audio segment in response to detecting a navigating input selecting a character or an action. In the embodiment of
In another embodiment the electronic device is arranged to generate the audio segment by speech synthesis. In this embodiment the electronic device may comprise a speech synthesizer, not illustrated in
Referring again to the step 304, if selection of a character was not detected on the basis of one or more user inputs to the input device 104, step 314 checks if a selection of an action is detected. If not, step 302 (or step 304) may be returned to detect user inputs to the input device 104. If the selection of an action was detected in step 314, the method proceeds to step 316 to define an audio segment specific to the detected action. Then, in step 318 the defined audio segment is echoed. In step 320 it is checked if a confirmation of the action is detected. If not, step 302 may be returned. If the confirmation is detected, an audible notification, which may be specific to the action, is echoed and in step 324 the action is performed. After steps 312 or 324 the method may check 326 if an exit command is detected. If an exit command is detected, the input mode may be ended in step 308, otherwise the method may return to step 302.
Thus, by applying the above illustrated features, as the user browses characters in the list 220 (provided as a roll), each item currently selected may be spoken out. In a further embodiment, in a situation where the user browses the list quickly enough, the electronic device is arranging the audible output only when the user stops the browsing. This embodiment may be carried out for instance by arranging the control unit 100 to apply a delay period after detecting an input. After the delay period, if there have been no further navigating inputs, the control unit 100 may continue by defining the appropriate audio segment specific to the selected character. In that case only the current item under focus is spoken out.
The display 102 may be updated on the basis of the detected input, illustrated by the return to step 302 in
There are many actions that may be performed (step 324 in the embodiment of
In one embodiment an action for removing digits may be selected and activated by the input device 104. This available user input option is also illustrated in
Referring to the example in
In one embodiment an action for checking the inputted character sequence 240 is one available user input option that may be selected and activated by the input device 104. This input option is also illustrated in
In a further embodiment the control unit 100 is arranged to turn the roll 200 automatically to have a focus on ‘Call’ command after checking the number, because it is more probable for an experienced user to make a call after the number is checked than to continue entering more number or deleting the entered one(s).
In one embodiment, audible representation of a further character sequence associated with the entered character sequence 240 may be provided for the user. For instance, a name associated in a contact list to a number in the character sequence 240 may be spoken to the user. In one further embodiment this feature is applied when the action for establishing a call or the action for checking the character sequence is confirmed.
Referring to the example in
In one embodiment additional instructions are spoken to the user. For example, if the user has entered a phone number, which is somehow wrong (illegal format), a warning message may be spoken.
As already illustrated, the characters entered by operating the input device 104 may include digits and other related characters, such as “+” for telephone numbers. However, the invention may be applied also for other characters and purposes. For instance, at least some of the above illustrated features related to providing the audible feedback to the operations made by an input device may be provided for a text input mode, where the user selects and confirms letters and numerals to form words. For instance, the input mode could be a message-editing mode.
In one embodiment, audible feedback on already inputted characters in the character sequence, such as the sequence 240 in
In a further another embodiment, an audio segment representing an inputted character sequence is outputted in connection with selection and/or confirmation of a selection related to the inputted character sequence. This action may be performed instead or in addition to defining and outputting an audio segment specific to the action or an audible notification for the confirmation of the action. For instance, the electronic device may be configured to define, in step 316 and/or after positive answer in step 320, an audio segment representing all or some of the inputted character sequence and output such audio segment in step 318 and/or 322 in addition to the audio segment specific to the action. An example is that the electronic device outputs speech representation of “Calling” and the dialled number “1234567” in step 322.
Above illustrated audio output and generation techniques may be applied also for generating audible output of the already inputted character sequence; already stored audio segments may be retrieved from the memory 106 or speech synthesis may be used.
In one embodiment, audible representation is specifically arranged for a character sequence representing a word separated from other words by a separating character such as a space or a punctuation mark. When such separating character is (confirmed to be) inserted from the character list 200, an audio segment representing the produced word (i.e. the text between the space mark and the previous space mark, punctuation mark or text buffer beginning) is defined and outputted to the user. As already illustrated, such audible representation of the word could be outputted in step 308 and/or 312 of the embodiment in
A reference is again made to exemplary input device 104 of
In an alternative embodiment, the input device 104 or the key can be a joystick, or some other type of 5-operation control device. The LEFT-press (212) can also act as the delete, where an IN-press (214) will switch modes between text buffer scrolling and character input. In this implementation, the characters may be inserted by the RIGHT-press (213) when text input mode is active. The active status is toggled by the SELECT-press. When text input mode is not active, LEFT- and RIGHT-presses 212, 213 may be configured to cause scrolling the text buffer word by word, and DOWN- and UP-presses 211, 210 may be configured to offer some supporting actions, such as selections to save, send or delete the text.
In one embodiment, the text input controller (100) is provided by a word-end predictor presenting a list of possible or predicted words based on the characters inputted so far (past a punctuation mark or space as already mentioned). These words may be included in the list 200 of characters, as shown in the
Above illustrated various embodiments provide many advantages. The audible feedback on characters or character sequences facilitates finding the right key to press and may even be an alternative for speech recognition where the user is able to operate the device but without looking the device. In the embodiment illustrated in connection with
Use cases for above illustrated embodiments include: a minimally sized device that has no keypad or display; a regular device that is being used in a visually demanding situation where the focus cannot be shifted often or long enough to the display and keypad (driving, walking in a hurry, monitoring and surveillance work, for instance). However, it is to be noted that the application of the present invention is not limited to any specific device or application type.
Even though the invention has been described above with reference to an example according to the accompanying drawings, it is clear that the invention is not restricted thereto but can be modified in several ways within the scope of the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| PCT/FI2005/050158 | May 2005 | WO | international |
| Number | Name | Date | Kind |
|---|---|---|---|
| 4870686 | Gerson et al. | Sep 1989 | A |
| 5095503 | Kowalski | Mar 1992 | A |
| 5311175 | Waldman | May 1994 | A |
| 5481595 | Ohashi et al. | Jan 1996 | A |
| 6477390 | Gum et al. | Nov 2002 | B1 |
| 6487424 | Kraft et al. | Nov 2002 | B1 |
| Number | Date | Country |
|---|---|---|
| 2 402 105 | Dec 2004 | GB |
| 11161406 | Jun 1999 | JP |
| 2003131790 | May 2003 | JP |
| WO 9920029 | Apr 1999 | WO |
| WO 0144912 | Jun 2001 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20060267931 A1 | Nov 2006 | US |
