Patent Application
20150185883
The present techniques relate generally to using multi-point touch entry for identifying input devices for touch screen computing devices.
BACKGROUND ART
Touch is becoming a popular means of data entry in mobile computing devices such as, tablets, table tops, smartphones, and the like. In some devices, the firmware that tracks input, by stylus or other input device, uses an identifier for the input device. Unfortunately, low cost input devices, like a passive stylus, lack the capability of providing their unique identifier to a smartphone's firmware. An active stylus has the identification capability, but is more expensive both in cost, and the energy used for communication.
The same numbers are used throughout the disclosure and the figures to reference like components and features. Numbers in the 100 series refer to features originally found in
Some embodiments may be implemented in logic, which may include hardware, firmware, software, or any combination thereof. Some embodiments may also be implemented as instructions stored on a machine-readable medium, which may be read and executed by a computing platform to perform the operations described herein. A machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine, e.g., a computer. For example, a machine-readable medium may include read only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; flash memory devices; or electrical, optical, acoustical or other form of propagated signals, e.g., carrier waves, infrared signals, digital signals, or the interfaces that transmit and/or receive signals, among others.
An embodiment is an implementation or example. Reference in the specification to “an embodiment,” “one embodiment,” “some embodiments,” “various embodiments,” or “other embodiments” means that a particular feature, structure, or characteristic described in connection with the embodiments is included in at least some embodiments, but not necessarily all embodiments, of the present techniques. The various appearances of “an embodiment,” “one embodiment,” or “some embodiments” are not necessarily all referring to the same embodiments. Elements or aspects from an embodiment can be combined with elements or aspects of another embodiment.
Not all components, features, structures, characteristics, etc. described and illustrated herein need be included in a particular embodiment or embodiments. If the specification states a component, feature, structure, or characteristic “may”, “might”, “can” or “could” be included, for example, that particular component, feature, structure, or characteristic is not required to be included. If the specification or claim refers to “a” or “an” element, that does not mean there is only one of the element. If the specification or claims refer to “an additional” element, that does not preclude there being more than one of the additional element.
It is to be noted that, although some embodiments have been described in reference to particular implementations, other implementations are possible according to some embodiments. Additionally, the arrangement and/or order of circuit elements or other features illustrated in the drawings and/or described herein need not be arranged in the particular way illustrated and described. Many other arrangements are possible according to some embodiments.
In each system shown in a figure, the elements in some cases may each have a same reference number or a different reference number to suggest that the elements represented could be different and/or similar. However, an element may be flexible enough to have different implementations and work with some or all of the systems shown or described herein. The various elements shown in the figures may be the same or different. Which one is referred to as a first element and which is called a second element is arbitrary.
Embodiments of the present techniques use multi-point touch sensing to identify patterns that represent an identifier. Specific patterns may be formed on input devices, objects that are tracked, and so on. The patterns identify the input device to a touch platform without resorting to active devices that are resource-intensive (in terms of cost, power, and bandwidth). Instead, digitizer pens, stylus, dice, joysticks, controller pads, pawns, and so on may be uniquely identified by a pattern the input device presents as multiple points of a touch on the touch platform.
One or more input devices 118 are used to interact with the device 100 through the touch screen 116. The input device 118 includes a pattern 120 that uniquely identifies the input device 118 to the computing device 100. A detection manager 112 in the memory 104 uses learned patterns 114 to uniquely identify the pattern 120 on an input device 118. The detection manager 112 may be logic, such as, hardware logic. In some embodiments, the detection manager 112 is a set of instructions in memory 104 that, when executed, direct the processor 102 to perform operations including identifying a plurality of points of a touch on the touchscreen 116. A plurality of locations of the touch are identified. The pattern 120 is identified based on the points of the touch and the locations of the touch. The input device 118 is identified based on the pattern 120. The pattern 120 is formed on an object tracked by an application being executed by the computing device. The processor 102 may be a main processor that is adapted to execute the stored instructions. The processor 102 may be a single core processor, a multi-core processor, a computing cluster, or any number of other configurations. The processor 102 may be implemented as Complex Instruction Set Computer (CISC) or Reduced Instruction Set Computer (RISC) processors, x86 Instruction set compatible processors, multi-core, or any other microprocessor or central processing unit (CPU). The memory 104 can include random access memory (RAM) (e.g., static random access memory (SRAM), dynamic random access memory (DRAM), zero capacitor RAM, Silicon-Oxide-Nitride-Oxide-Silicon SONOS, embedded DRAM, extended data out RAM, double data rate (DDR) RAM, resistive random access memory (RRAM), parameter random access memory (PRAM), etc.), read only memory (ROM) (e.g., Mask ROM, programmable read only memory (PROM), erasable programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM), etc.), flash memory, or any other suitable memory systems. The main processor 102 may be connected through a system bus 108 (e.g., Peripheral Component Interconnect (PCI), Industry Standard Architecture (ISA), PCI-Express, HyperTransport®, NuBus, etc.) to components including the memory 104, the storage device 106, ports 110, NIC 110, and touch screen 116. The block diagram of
In one embodiment, touch controller firmware or logic, identifies the location of the touch, and identifies the pattern of the touch points. If the pattern 120 matches one of the learned patterns 114, a match signal may be broadcast. Additionally, the location of the input device 118 presenting the specific pattern 120 is noted. By extending existing firmware and software, the pattern recognition can be exposed to higher layers of software which can track the pattern (and hence, the movement of the input device 118) across the screen.
Advantageously, embodiments of the present techniques may be implemented without changes to existing touch hardware. For example, in the example of a stylus input device, the tip of the stylus includes a patterned tip. A firmware change to existing technology may enable the tracking feature of such a stylus. Additionally, applications can track passive input devices 118 without additional hardware cost, or power constraint. Also, manufacturers may use the present techniques to create a set of unique and useful accessories, i.e., input devices 118. The accessories may include wearable computing devices, such as a digital glove.
In another embodiment, the pattern 120 for an input device is dynamic. For example, by adding circuitry behind the patterns of an input device 118, a serial communication can be initiated between the computing device 100 and the input device 118. The patterns 120 presented by the device 118 on the touch screen 116 may be generated dynamically to perform the serial communication.
In some embodiments, the touch screen 116 is a capacitive touch screen. The capacitive touch screen works based on the amount of interaction between a capacitor (formed internal to the touch screen) and an external grounded object, e.g., a human hand. A touch controller (not shown) scans the touch screen's hundreds of capacitors and checks for a change in capacitance. At the area where the human finger is touching, the capacitance of the local capacitors changes—which is identified by the touch controller. Multi point touch controllers can track multiple finger touches. Similarly, palm rejection is a feature in software where the area formed by the palm resting on the screen is marked in software, and any touch within this area is rejected.
In some embodiments, the touch screen 116 incorporates existing multi-point touch sensing, or mutual capacitance based projected touch, where multiple points of touch are identified. This capability can be extended to identify patterns 120 formed on objects, such as the input device 118, which are identified or tracked, such as, digitizer pens, stylus, electronic accessories like dice, joysticks, controller pads, pawns, etc. Additionally, touch controller firmware, apart from identifying the location of the touch, also identifies the pattern 120 of the touch points.
Advantageously, embodiments of the present techniques provide useful functionality without making cost a limiting factor. Additionally, traceability is added to standard passive objects, such as a stylus or wearable device. In this way, multiple uniquely-traceable passive input devices may be used without changes to infrastructure that supports specific input devices 118. Another advantage arises from the abilities to detect raw touch inputs from a touch sensor integrated circuit, and process and check for patterns 114 within fast local circuitry, such as a processor cache, graphics processor, graphics cache, and the like.
In one embodiment, the die 302B is an electronic die that presents a serial stream through the pattern of the face 304B. When the serial stream is presented to the gates of the field-effect transistors of the touch screen, the pattern 308B of grounding points on the touch screen 116 varies. For example, a bi-phase coded serial stream may be used. Differential patterns, such as in universal serial bus—DP/DN ensure robust communication to the device 100. The pattern 308B can be identified by touch firmware, and by following standard serial communication protocol, such as preamble, clock recovery and data capture. In this way, a seemingly passive device can communicate to the computing device 100 through the touch surface 116 without wires, and without the use of power hungry (and expensive) wireless technology. This advantageously results in reduced battery usage over active input devices, as there is no power used for wireless, no wires and ultra cool ID. In another embodiment, the input device 118 is wearable.
The present techniques include several examples of input devices 118, such as uniquely traceable passive styli. Currently, only active styli carry ID which can be tracked. However, embodiments of the present techniques may be employed in low cost passive styli. Additionally, input devices 118 are not limited to stylus, and include a range of intelligent accessories that may be passive or active. Another example of passive styli is a set of 32 chess pieces for a chess game played on the device 100. Each chess piece has a unique pattern on its base, identifying the type of piece, which team the piece belongs to, and so on. In such an embodiment, when a virtual chess board is formed on a tablet or table top, the touch firmware tracks the location of each chess piece without user intervention.
Additional embodiments of input devices 118 include include wearables, such as a personal health monitor. Over the period of a day, the monitor tracks user health data, and at the end of the day, the monitor transfers data back to the cloud through a touch screen device 100. To enable this data dump, active pattern based communication can enable data to be securely transferred with low power and cost.
The serial communication protocol may be limited by the number of unique touch points and the report rate supported by the touch integrated circuit. For example, a touch controller supporting 20 touch points at 200 Hz can theoretically support a data rate of 4 Kbps in single ended mode and 2 Kbps in differential mode. The max number of touches is dependent on the touch processor. However, touch processing may be internal, which enables extending the report rate and touch points in a useful manner. With higher touch points and report rate, very high data transmission speeds can be increased, similar to established wireless protocols.
It is to be understood that specifics in the aforementioned examples may be used anywhere in one or more embodiments. For instance, all optional features of the computing device described above may also be implemented with respect to either of the methods or the computer-readable medium described herein. Furthermore, although flow diagrams and/or state diagrams may have been used herein to describe embodiments, the techniques are not limited to those diagrams or to corresponding descriptions herein. For example, flow need not move through each illustrated box or state or in exactly the same order as illustrated and described herein.
The present techniques are not restricted to the particular details listed herein. Indeed, those skilled in the art having the benefit of this disclosure will appreciate that many other variations from the foregoing description and drawings may be made within the scope of the present techniques. Accordingly, it is the following claims including any amendments thereto that define the scope of the present techniques.
