Embodiments of the present invention generally relate to a user interface on a device with a touch screen, and in particular to a user interface that supports data input by multiple finger taps.
A touch screen is an electronic visual display that a user may control through simple or multi-touch gestures by touching the screen with one or more fingers. Some touch screens can also detect objects such as a stylus or ordinary or specially coated gloves. The user may use the touch screen to react to what is displayed and to control how it is displayed, for example, by zooming the text size.
The touch screen enables the user to interact directly with what is displayed, rather than using a mouse, touchpad, or any other intermediate device, other than a stylus, which is optional for most modern touch screens.
Touch screens are common in devices such as game consoles, all-in-one computers, tablet computers, and smart phones. They can also be attached to computers or, as terminals, to networks. They also play a prominent role in the design of digital appliances such as personal digital assistants (PDAs), satellite navigation devices, mobile phones, and video games, for example.
The popularity of smart phones, tablets, and many other types of information appliances is driving the demand and acceptance of common touch screens for portable and functional electronics. Touch screens are popular in the medical field and in heavy industry, as well as in kiosks such as museum displays or room automation, where keyboard and mouse systems do not allow a suitably intuitive, rapid, or accurate interaction by the user with the display's content.
Various technologies have been used for touch screens, including: resistive layers separated by a space, surface acoustic waves, various forms of capacitance coupling, infrared emitters and detectors, optical imaging, acoustic pulse detection, etc.
A radial based user interface (UI) is provided for entering data into a computer device. The radial based UI has a central region with a plurality of radial regions. A location for the central region is defined on a touch sensitive display screen of the device and a value is assigned to each radial region. When a first touch is detected in the central region of the radial UI, an indication of a radial position responsive to a second touch on the touch sensitive screen may be determined. A value corresponding to the radial position of the second touch may then be input to an application being executed on the device. The first and second touches may be two separate finger taps, or may be sequential portions of a continuous stroke that occurs along one of the plurality of radial regions.
Particular embodiments in accordance with the invention will now be described, by way of example, and with reference to the accompanying drawings:
Specific embodiments of the invention will now be described in detail with reference to the accompanying figures. Like elements in the various figures are denoted by like reference numerals for consistency. In the following detailed description of embodiments of the invention, numerous specific details are set forth in order to provide a more thorough understanding of the invention. However, it will be apparent to one of ordinary skills in the art that the invention may be practiced without these specific details. In other instances, well-known features have not been described in detail to avoid unnecessarily complicating the description.
Embodiments of the present invention are discussed below with respect to an embodiment on a tablet computer that contains software applications that provide functionality that is similar to a hand held graphing calculator. It should be noted, however, that embodiments of the present invention may be useful for software applications other than calculator applications. It should also be noted that embodiments of the present invention may be useful for other types of electronic devices with touch screens, such as: laptop computers, desktop computers, handheld computing devices, wrist mounted devices, vehicle mounted devices, wall mounted devices, etc., for example. Examples of other types of handheld computing devices in which embodiments of the present invention may be useful include: scientific calculators, advanced calculators able to upload and run software applications, handheld-sized limited-purpose computer devices, handheld-sized educational computer devices, handheld-sized portable computer devices, portable computer devices, personal digital assistants (PDAs), palmtop computers, cellular or mobile telephones, and any combination thereof, for example.
Touch screen devices offer unique interface advantages, but the human interface for data entry is inferior to physical keys. The virtual keyboard takes up precious display space, and the keys are often squeezed tightly together.
Embodiments of the invention provide a radial based alpha numeric interface for data entry into touch sensitive devices. Numbers and characters may be mapped to various radial locations relative to a central region of the screen. One or more fingers may touch the screen to convey radial direction relative to the central region of the screen and thereby select a number or character corresponding to the conveyed radial direction. This scheme works well for number entry and is well suited for calculator or spreadsheet applications. However, various embodiments may also use radial based inputs for other types of data entry, such as alpha-numeric data, for example.
Display 102 includes touch detection circuitry that allows a user to interact with the display 102 by translating the motion and position of the user's fingers on the display 102 to provide functionality similar to using an external pointing device, such as a mouse, and a keyboard. A user may use the touch sensitive display 102 to perform operations similar to using a pointing device on a computer system, e.g., scrolling the display 102 content, pointer positioning, selecting, highlighting, etc. The general operation of a touch sensitive display screen is well known and need not be described in further detail herein. For example, in some embodiments, a detection circuitry may be located in a peripheral region 106 around the touch sensitive screen. In other embodiments, transparent circuitry may be formed on the face of the screen that detects the presence and location of a finger or pointing instrument that is placed near or in contact with the surface of the screen, etc. Embodiments of the invention that may be used with many types of currently known or later development touch sensitive screens. Notepad computer 100 may not have a dedicated keyboard; instead, one or more applications may provide a virtual, or a “soft keyboard” as illustrated by application window 108 that includes a set of keys 110. However, as will be described in more detail below, embodiments of the invention may perform data entry using a non-obtrusive radial based user interface in place of virtual keyboard 108 so that more screen area is available for user applications.
Touch sensitive display 102 includes control and interface circuitry and is controllably coupled to processor 201 so that touch location input data may be provided to processor 201. An input/output port 208 may provide connectivity to external devices. Input/output port 208 may be a bi-directional connection such as a mini-A USB port, for example. Also included in the notepad computer 100 may be an I/O interface 206. The I/O interface 206 provides an interface to couple input devices such as power control and volume control buttons, for example, to processor 201. In some embodiments, the notepad computer 100 may also include an integrated wireless interface (not shown) or a port for connecting an external wireless interface (not shown).
The 11 or 12 o'clock positions could be used to indicate a “Back”, “Shift”, or “Control” key which would allow the user to input other alphanumeric characters, static symbols, and controls. For example, selecting “shift” or “control” may cause a different set of numbers or characters to be assigned to one or more of the radial clock-face locations.
Referring to
Referring to
Referring to
As mentioned above, an actual UI does not need to be displayed since the user can easily visualize the location of the center and radial positions of the clock-faced target. This allows the user to see more screen space and allows the user to quickly and accurately enter numbers. Assuming common familiarity with clock number positions, this interface should be intuitive to the user and minimize the learning curve.
Template 730 may be displayed in response to user input to device 100. For example, an application may display a radial UI template in response to a user selecting to enter data into a field of an application. Alternatively, a radial UI template may be displayed in response to detecting two simultaneous finger taps, for example. Other triggers may be defined that may cause a radial UI to be displayed, depending on what application is active on a device.
A series of strokes 840-843 that originate from the center 810 and move to a number position in a radial manner and then back to the center may be used to string multiple characters (typically integers) into the targeted input control field.
Alternatively, the same template may be used for two finger entry as described with regard to
As described above in more detail, the center region of the radial based UI may be positioned at the center of the display for an intuitive radial UI in which a UI template is not displayed. Alternatively, a radial UI template may be displayed 1030 and positioned anywhere on the display screen. In either case, radial positions will be referenced to the center region of the radial UI.
Each time a touch is detected on the touch sensitive display screen, a check 1004 is made to see if the detected touch occurred in the central region of the radial UI. If not, the detected touch may be processed 1020 as another type of input to the device. In the case where a radial UI template is not displayed, it may be assumed that when a touch is detected in the center of the display screen that it may be intended as a radial UI input.
If a radial touch component is not received 1006, then a touch in the central region is treated 1020 as another type of input to the device. When a radial touch component is received 1006, then a determination 1008 of a radial position responsive to the radial touch component on the touch sensitive screen performed. As described above in more detail, the radial UI touch inputs may be two separate touches, or may be a first touch followed by continuous stroke motion in a radial direction. In the case of two essentially simultaneous touches in which one touch is located within the central region of the radial UI, the placement of the other touch relative to the central touch provides the radial position. In the case of a stroke that originates in the central region of the radial UI, the direction of the stroke provides the radial position.
A value corresponding to the radial position may then be input 1010 to a data entry field of an application being executed on the device. The data input field may be any type of field that may accept data for an application being executed on the device.
As described above, in some embodiments, a radial UI template, such as illustrated in
In this scheme, one finger 1101 (typically the index finger) taps and holds the finger on the screen to indicate the desire to input text. A second finger 1102, typically the middle finger, then slides up and down on the screen to rotate through a virtual wheel 1130 of possible characters to enter. Wheel 1130 may be visualized as a wheel that is oriented perpendicular to the display that has characters positioned around its edge. The characters on the edge roll into view and then roll out of view as the wheel rotates. The tap and slide user interface (TSUI) may show the characters on the wheel 1130 with one character highlighted 1132 as the currently selected character. One or more previous and next characters in line may also be visible but not selected. The TSUI 1130 wheel smoothly moves through characters as the finger slides up and down.
When the second finger 1102 is lifted, the currently selected character is input to a data field in an application being executed by device 100.
In some implementations, sliding two fingers, such as the middle and ring finger together up and down may be used to rotate though an alternate group of characters. For example, sliding just one finger while holding down the index finger may trigger a character selection wheel of numeric characters, while sliding two fingers while holding down the index finger may trigger a character selection of math operations, static symbols, or alphabet characters, for example. A three finger slide (Middle, Ring, and Pinky fingers) may also be used to represent an additional index of character selections, for example.
In some cases, words or phrases may be placed on the wheel for selection.
The Thumb may also be used as a sliding finger to rotate through a list of characters alone or in combination with other sliding fingers, for example. Since the thumb essentially slides left and right, it may also be used to move the cursor, select text, or delete previous entries while the index finger remains in place on the screen, for example.
The user may lift all of the sliding fingers but hold down the index finger to “re-clutch” the wheel. Re-clutch means the user has moved the sliding fingers to the maximum limit and would like to re-center the fingers to continue the sliding motion to select characters at the far reaches of an index of characters.
Acceleration and speed of finger sliding motion may be used to control the rate of “spin” of the character selection wheel 1130.
The TSUI may allow a user to focus on the content and not on a distracting virtual keyboard, which allows easier selection and editing of data. This provides for easier and intuitive selection of an indexed list of items, for example: entry history, dictionary entries, list of students, list of files or media, etc., for example.
Chorded input may be used for number entry and is well suited for calculator or spreadsheet applications; however, this chorded input is not limited to numeric input and may also be used for alphanumeric inputs. Numbers may be entered by taping one or more fingers on the screen to represent a binary number according to table 1. Software responsive to the touch screen may then interpret the binary number to a pre-mapped user focused input.
The general idea of a chorded keyboard is well known. Douglas Engelbart introduced the chorded keyset as a computer interface in 1968 at what is often called “The Mother of All Demos”, as discussed in Wikipedia and elsewhere. However, when implemented on a touch sensitive screen, several improvements are possible. Referring to
In use, thumb 1201 may remain pressed down to give the chorded input detection software a better reference point to the user's hand size and prevent mis-taps. For each data entry, all active fingers must touch the screen at approximately the same time to denote a chord. A threshold delta time may be defined to specify touch times, typically allowing a few milliseconds of delta.
In some implementations, the finger placement template may not be visible to a user. In other implementations, the finger placement template may be shown as an overlay over an application window on display screen 102, for example.
In some implementations, the finger placement template may be dynamically recalibrated each time a user places all five fingers on the touch sensitive screen while in a chorded input application, for example.
Additional swipe commands and touch gestures may be used to toggle between entry modes: Numeric, Alpha, Static Characters, for example. A visual indicator may alert the user to which entry mode is active.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as disclosed herein.
For example, embodiments are discussed described in which the digital devices may be a table computer. It should be noted, however, that other types of digital devices, e.g., laptop computers, desktop computers, and handheld computing devices may be used. Examples of other types of handheld computing devices include scientific calculators, advanced calculators able to upload and run software applications, handheld-sized limited-purpose computer devices, handheld-sized educational computer devices, handheld-sized portable computer devices, portable computer devices, personal digital assistants (PDA), palmtop computers, cellular or mobile telephones, and any combination thereof.
Embodiments of the invention may be used in calculators. Handheld calculators have progressed to be very sophisticated processing systems. A handheld calculator, such as the TI-Nspire™ from Texas Instruments, is capable of operating on one or more documents. In one version of such a calculator, each document may be divided into multiple problems. Each problem may contain many pages. Each page may be divided into several work areas. Each work area may contain any of the TI-Nspire™ applications: Calculator, Graph, Geometry, Lists & Spreadsheet, Data & Statistics, and Notes, for example.
Embodiments of multi-tap user interfaces may be used in conjunction with a calculation tool provided by the TI-Nspire™ and TI-Nspire™ CAS application programs. In other embodiments, a multi-tap user interface as described herein may be used in conjunction with calculation tools provided by other applications, such as Geogebra, MathStudio, PocketCAS, for example.
The techniques described in this disclosure may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the software may be executed in one or more processors, such as a microprocessor, application specific integrated circuit (ASIC), field programmable gate array (FPGA), or digital signal processor (DSP). The software that executes the techniques may be initially stored in a computer-readable medium such as compact disc (CD), a diskette, a tape, a file, memory, or any other computer readable storage device and loaded and executed in the processor. In some cases, the software may also be sold in a computer program product, which includes the computer-readable medium and packaging materials for the computer-readable medium. In some cases, the software instructions may be distributed via removable computer readable media (e.g., floppy disk, optical disk, flash memory, USB key), via a transmission path from computer readable media on another digital system, etc.
Although method steps may be presented and described herein in a sequential fashion, one or more of the steps shown and described may be omitted, repeated, performed concurrently, and/or performed in a different order than the order shown in the figures and/or described herein. Accordingly, embodiments of the invention should not be considered limited to the specific ordering of steps shown in the figures and/or described herein.
It is therefore contemplated that the appended claims will cover any such modifications of the embodiments as fall within the true scope and spirit of the invention.
The present application is a Continuation of U.S. patent application Ser. No. 14/226,794, filed Mar. 26, 2014, which claims priority to and incorporates by reference U.S. Provisional Application No. 61/805,597, filed Mar. 27, 2013, entitled “CHORDED BINARY BASED HUMAN INTERFACE TO MULTITAP CAPABLE DEVICES” all of which are hereby incorporated herein in their entireties.
Number | Name | Date | Kind |
---|---|---|---|
5281966 | Walsh | Jan 1994 | A |
5982302 | Ure | Nov 1999 | A |
6756969 | Nuovo et al. | Jun 2004 | B2 |
7286115 | Longe et al. | Oct 2007 | B2 |
7676036 | Takasaki et al. | Mar 2010 | B2 |
7778818 | Longe et al. | Aug 2010 | B2 |
9104308 | Au | Aug 2015 | B2 |
9176480 | Sadilek | Nov 2015 | B2 |
9250800 | Yano | Feb 2016 | B2 |
9261989 | Kuscher | Feb 2016 | B2 |
9342217 | Geithner | May 2016 | B2 |
20060117067 | Wright | Jun 2006 | A1 |
20070086825 | Min | Apr 2007 | A1 |
20080307945 | Gatzsche | Dec 2008 | A1 |
20090327964 | Mouilleseaux | Dec 2009 | A1 |
20100019940 | Oh | Jan 2010 | A1 |
20100026625 | Oh | Feb 2010 | A1 |
20100192102 | Chmielewski | Jul 2010 | A1 |
20100192103 | Cragun | Jul 2010 | A1 |
20100245244 | Oh | Sep 2010 | A1 |
20100266323 | Min | Oct 2010 | A1 |
20100306702 | Warner | Dec 2010 | A1 |
20110265041 | Ganetakos | Oct 2011 | A1 |
20120226978 | Harberts | Sep 2012 | A1 |
20120262386 | Kwon | Oct 2012 | A1 |
20130033448 | Yano | Feb 2013 | A1 |
20130104079 | Yasui | Apr 2013 | A1 |
20130127911 | Brown | May 2013 | A1 |
20130132904 | Primiani | May 2013 | A1 |
20130167085 | Roundtree | Jun 2013 | A1 |
20140071063 | Kuscher | Mar 2014 | A1 |
Number | Date | Country |
---|---|---|
2008100121 | Aug 2008 | WO |
Entry |
---|
Mark Wilson, “A Farmous Inventor's Forgotten Idea: A One-Handed Touch-Screen Keyboard”, pp. 1-3, Feb. 14, 2012, available at www.fastcodesign.com/1669042/a-famous-inventors-forgotten-idea-a-one-handedtouch-screen-keyboard on Mar. 25, 2014. |
“Chorded keyboard”, Wikipedia, pp. 1-8, last modified Aug. 23, 2013 available at http:/en.wikipedia.org/w/index.php?title=Chorded_keyboard&old:d=569869550 on Mar. 25, 2014. |
Trevor, “Smart phone chorded keyboard”, Trevor's Trinkets, pp. 1-6, Jul. 3, 2011, available at http://trevors-trinkets.blogspot.com/2011/07/smart-phone-chorded-keyboard.html on Mar. 25, 2014. |
Lambert Varias, “Virtual Chorded Keyboard for Tablets: Piano Prose,” Feb. 12, 2012, http://technabob.com/blog/2012/02/12/chorded-keyboard-for-tablets/, 3 pages. |
Teague Labs, “Doug Engelbart's Chorded Keyboard as a Multi-touch Interface,” Feb. 8, 2012, http://labs.teague.com/?p=1451 &cpage=1, pp. 1-4. |
Number | Date | Country | |
---|---|---|---|
20220317874 A1 | Oct 2022 | US |
Number | Date | Country | |
---|---|---|---|
61805597 | Mar 2013 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14226794 | Mar 2014 | US |
Child | 17844719 | US |