Patent Application
20170045953
The present disclosure relates to virtual keyboards in graphical user interfaces for large display devices and in particular to enabling text entry into the graphical user interfaces using a directional remote control input.
Text entry such as virtual keyboards in a user interface provided by a set-top box, or connected television, is limited by the physical form factor of typical remote controls in respect of the buttons or keys defined on the remote control. Standard remote controls provide direction navigation for moving a “focus” area on the television such as in an electronic programming guide where a desired item can then be selected. Television or set top box (STB) remote controls do not typically provide a full alphabetical keyboard due to size constraints and the need for simplicity. Therefore when text entry is required, the user must move through an on-screen keyboard and select each letter and move through the keyboard to select the next letter. The on-screen display keyboards are typically either presented as a standard keyboard layout, such as QWERTY layout, or an alphabetical keyboard of a unique configuration requiring considerable movement amongst the letters to enter text using only the navigation buttons of the remote control. Entering text, such as in a search query, can require many navigation inputs into the remote control by the user and take considerable time to navigate to letters to enter text. Existing text entry methods can be time consuming and frustrating to the user due to the amount of navigation required. In addition, traditional keyboards for text entry presented in a television type interface, particularly where the viewer is sitting a typical viewing distance from the television such as in a family room viewing environment, can require significant screen real-estate to display all the character keys of the keyboard. It is therefore desirable to provide an improved system and method of text entry with a remote control for large displays such as televisions.
Further features and advantages of the present disclosure will become apparent from the following detailed description, taken in combination with the appended drawings, in which:
It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
In accordance with an aspect of the present disclosure there is provide a method for facilitating text entry in an input field displayed on a large display coupled to an electronic device, the method performed by a processor coupled to the large display, the method comprising: displaying a rotating character row on the large display when a text entry window is presented, the rotating character row comprising a first plurality of characters for selection from a first subset of characters of a character set, the character set loops around in a circular fashion when a beginning or an end of the character set is reached allowing continuous rotation of the character set; receiving horizontal directional input from a remote control input device wirelessly coupled to the electronic device, the remote control input device provide two dimensional input, wherein directional input rotates the character row to display a second subset of characters of the character set; receiving a selection of a character from the rotating character row; and displaying the selected character in text entry field.
In accordance with another aspect of the present disclosure there is provided a computer readable memory comprising instructions for execution by a processor, the instructions for performing the method for displaying a rotating character row on the large display when a text entry window is presented, the rotating character row comprising a first plurality of characters for selection from a first subset of characters of a character set, the character set loops around in a circular fashion when a beginning or an end of the character set is reached allowing continuous rotation of the character set; receiving directional input from a remote control input device wirelessly coupled to the electronic device, the remote control input device provide two dimensional input, wherein directional input rotates the character row to display a second subset of characters of the character set; receiving a selection of a character from the rotating character row; and displaying the selected character in text entry field.
In accordance with still yet another aspect of the present disclosure there is provided a device for providing a graphical user interface, the device comprising a processor and memory, the memory containing instructions for performing the method for displaying a rotating character row on the large display when a text entry window is presented, the rotating character row comprising a first plurality of characters for selection from a first subset of characters of a character set, the character set loops around in a circular fashion when a beginning or an end of the character set is reached allowing continuous rotation of the character set; receiving directional input from a remote control input device wirelessly coupled to the electronic device, the remote control input device provide two dimensional input, wherein directional input rotates the character row to display a second subset of characters of the character set; receiving a selection of a character from the rotating character row; and displaying the selected character in text entry field.
Embodiments are described below, by way of example only, with reference to
The STB 110 is configured to play media content provided from a plurality of media applications via the network 150. The media applications provided to the display device 101 includes, for example, but not limited to, television (e.g., digital multimedia broadcasting programming), radio, advertisement, games, audio and video on-demand, electronic programming guide (EPG), local or remotely stored content, and/or Internet-based applications. The viewer of the display device 101 may access the content by selecting a specific content source or item via the remote control 120 by using navigation buttons 124 to move through the channels, a guide, or application or media interface. A search function may also be provided to enable the user find content from one or more media sources. The buttons may be physical buttons or provided on a touch interface of the remote control 120.
The remote control 120 may contain multiple buttons each associated with one or more functions. Navigation buttons 124 (up, down, left, right), menu buttons for selecting applications, channel buttons for selecting channels of the TV programming, selection button may be provided by the remote control 120. As well appreciated by one of ordinary skill in the art that the remote control 120 may include buttons not illustrated in the drawings to provide additional functions. The buttons may be physical buttons or provided on a touch interface of a mobile device, tablet device or remote control.
The remote control 120 includes user navigation buttons 124 configured to issue commands associated with the display device 100. The navigation buttons 124 may be physical buttons on the remote or virtual buttons presented on a display screen of the remote. The remote control 120 includes a processor 126 (e.g., microprocessor) and memory (e.g., Random Access Memory (RAM), Read Only Memory (ROM), flash memory) configured to store instructions/codes/programs for processes executed on the processor 126. The processor 126 in the remote control 120 is configured to detect operation of any of the user navigation buttons 124 and/or receive signals from any of the user navigation buttons 124, generate commands for associated events, and transmit them to the STB 110 through a wireless, radio frequency, or optical interface provided by transmitter 122. The remote control can use infrared (IR), radio frequency (RF), Wi-Fi, Zigbee™, or other wireless standards to communicated with the STB 110 or display device 101. The buttons of the remote control 120 include a selection (OK/Enter/Select) key 170 and a plurality of navigation buttons 172-178. The navigation buttons 124 include direction arrow buttons including an up arrow button 172, a left arrow button 176, a right arrow button 178, and a down arrow button 174. Each arrow button may be used to move the selection of an option in the corresponding direction by sending a direction command to the STB. Although only four navigation arrow buttons are shown, a multi-directional button or multiple buttons may be provided to enable diagonal direction input and not necessarily be limited to x/y axes input. By using the navigation buttons 124, commands are provided to move a selection (e.g., highlight, cursor or mark) to the desired object within a user interface. The selection button 170 is used to send a command to select the highlighted or marked object and activate a function associated with the selected object, which will cause an operation event associated with the display device 101 by the STB 110. The selection button 170 and the navigation buttons 172-178 may be used to navigate the user interface presented on the display 102 screen by movements such as up, down, left, right. Alternatively a multi-directional input such as a touch pad, joystick or track ball may be provided for navigation input to limit navigation direction.
The media applications may be provided by a media provider 160 including, for example, but not limited to, a media server 162 for providing media content from a database and/or via Internet, a program guide provider 164, various audio/visual/Internet based devices 166 (e.g., DVD, streaming devices, handheld network devices, etc.).
The STB 110 is operatively coupled to the display device 101 and the network 150. The STB 110 includes a receiver 114, which may include a wireless or optical interface for receiving commands from the remote control 120 via infrared or radio frequency input, a network interface 116 for communication via the network 150, and a display interface 118 for output to the display 102. The transceiver in the STB 110 may include an interface for communication with any other electronic devices. The STB 110 is configured to implement bi-directional communication with the display device 101 and the network 150 and receive command from the remote control 120 to control programming and control the display device 101.
The STB 110 includes a processor 112 (e.g., microprocessor) and memory 113 (e.g., Random Access Memory (RAM), Read Only Memory (ROM), flash memory). The memory 113 in the STB 110 is configured to store instructions/codes/programs for processes executed on the processor 112 such as a navigation module 130 for processing navigation inputs from the remote control and for interacting with a user interface presented on the display 102 such as an EPG or media interface, a presentation module 132 for rendering elements of the user interface, a selection module 134 for enabling selection of objects presented in the user interface, an application dictionary 136 for providing words or phrases associated with a content source, a search module 138 for enabling the search of one or more content sources, and an input processing module 140 for processing commands received from the remote control 120 and determining interactions within the user interface. The memory 113 may also include content or media, metadata or instructions for accessing content media or metadata remote from the STB 110. The processor 112 in the STB 110 is configured to retrieve data (e.g., media content or information associated with the media content) over the network 150, and to convert the data in the form of signals provided to the display device 101. The processor 112 in the STB 110 is configured to receive and detect commands from the remote control 120 and to activate appropriate functions associated with the commands (e.g., setting the display device 101, converting media data to play it on the display device 101, transmitting media data to the display device 101).
It would be appreciated by one of ordinary skill in the art that the STB 110 may include components not shown in the drawings, for example, circuitry for converting (e.g., decoding) media content from the media providers 160 and/or operation commands from the remote control 120 to operate the display device 101.
The viewer of the display device 101, such as a television, operates the remote control 120 to generate commands to cause operation events related to the display device 101. The commands associated with the display device 101 include, for example, setting the display device 101 and associated devices (e.g., DVDs) and the network connection of the display device 101, and viewing/watching a desired program on the display screen 102.
As shown in
The recommendation row 206 presents alternate characters and words or phrases based upon the selected character from an application specific dictionary associated with the application. The dictionary can be derived from metadata associated with content in a content store and updates as the user places focus on (or selects) any character in the rotating horizontal character row 208. Each dictionary has a unique identifier which is used to determine when that specific dictionary should be used for recommendation or prediction. For example, this identifier may associate an application-specific dictionary with one content store, while an alternative content store may use another application-specific dictionary with a different identifier.
The recommendation row 206 does not loop, the left side of the recommendation row 206 can identify any diacritical marks 207 associated with the letter in focus in the rotating horizontal character row 208, for example if an “a” is in focus in the rotating horizontal character row 208 then the recommendation row 206 will display “å, à, á . . . ” etc if there is content having diacritical marks. The right side of the recommendation row 206 display predicted words. When focus is moved from the rotating horizontal character row 208 to the recommendation row 206, then items in the recommendation row 206 do not change.
The right side of the recommendation row 206 displays predicted words or phrases based on the first few characters in the text entry field as well as the character in focus in the horizontal character row 208. The words or phrases can be presented in the order of most likely on the left, to less likely as the user moves to the right. As soon as the user moves back down to the rotating horizontal character row 206 and moves left or right the recommendation row 208 updates again with the position between the diacritical marks and words or phrases within view. The application specific dictionary may be derived from for example metadata associated with a movie database associated with available content source. When a word in the recommendation row 206 is selected, it will enter the selected diacritical mark or complete the word in the text entry field 204. Focus then moves back down to the last letter in focus on the rotating horizontal character row 208.
An alternate input row 212 provides additional input buttons to enable changes to the character set or common editing or entry functions. For example a shift key 214 can be provided which has three states, the 1st state is for lower case characters, the 2nd state is for upper case characters but only one at a time (toggles back to 1st state after a character is selected), and the 3rd state is a locked shift which allows user to press multiple upper case characters without losing the state. A character set selection button 216 may be provided which can toggle between character sets such as alphabetical or numerical character sets. When the character set selection button 216 is pressed, the button toggles to an “a b c” state indicating that pressing it again returns the user to the alphabet. A space bar 218 produces a space character. A special character button 220 can be provided to select for example symbols or an alternate character set. Pressing the special character button 220 toggles the rotating horizontal character row 206 to special characters. Once a special character is selected, the rotating horizontal character row 206 toggles back to the alphabet. When pressed the button toggles to an “a b c” button indicating that when pressed it returns the user to the alphabet. Note, if this button is pressed at the same time as the “1 2 3” button is in the “a b c” state, then the “1 2 3” button will toggle back to “a b c”. Alternate input row 212 changes based on context, for example if entering text it would include the number or punctuation character buttons.
A delete button 222 can be provided to remove one letter from the text entry field 204. A content selection row 224 may also be provided for selecting the type of content to be searched and a related application specific dictionary or a filter to the selected application specific dictionary. The content may be limited to the type of program, location of programs, type of program, genre, or metadata associated with content which may be used to select the application specific dictionary for example all, recorded, live, subscribed, on-demand, etc. Alternatively the application specific dictionary may be determined based upon the presentation of the text entry field in relation to a certain function within the user interface, for example searching or web browsing.
Referring to
Although the display elements of the text interface have been shown in a particular layout it should be understood that rows or elements in the interface may be modified or positioned in different orientations horizontally or vertically to still achieve the desired function. For example the character row may be presented vertically rather than horizontally, where the direction input up/down vertical navigation keys would be used rather than the left/right horizontal navigation keys. Modifications to the direction of entry or positions of the elements are within the scope of the present disclosure.
Each element in the embodiments of the present disclosure may be implemented as hardware, software/program in a carrier, or any combination thereof. Software codes, either in its entirety or a part thereof, may be stored in a computer readable medium or memory (e.g., as a ROM, for example a non-volatile memory such as flash memory, CD ROM, DVD ROM, Blu-Ray™, a semiconductor ROM, USB, or a magnetic recording medium, for example a hard disk). The program may be in the form of source code, object code, a code intermediate source and object code such as partially compiled form, or in any other form.
It would be appreciated by one of ordinary skill in the art that the system and components shown in
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/CA2014/050396 | 4/25/2014 | WO | 00 |
