Finger tracking in wet environment

Description

FIELD OF THE DISCLOSURE

This relates generally to touch input processing for touch-sensitive devices, and more particularly, to filtering unintended contact detected on a touch sensor panel or touch screen.

BACKGROUND OF THE DISCLOSURE

Many types of input devices are presently available for performing operations in a computing system, such as buttons or keys, mice, trackballs, joysticks, touch sensor panels, touch screens and the like. Touch screens, in particular, are becoming increasingly popular because of their ease and versatility of operation as well as their declining price. Touch screens can include a touch sensor panel, which can be a clear panel with a touch-sensitive surface, and a display device such as a liquid crystal display (LCD) that can be positioned partially or fully behind the touch sensor panel so that the touch-sensitive surface can cover at least a portion of the viewable area of the display device. Touch screens can allow a user to perform various functions by touching the touch sensor panel using a finger, stylus or other object at a location often dictated by a user interface (UI) being displayed by the display device. In general, touch screens can recognize a touch and the position of the touch on the touch sensor panel, and the computing system can then interpret the touch in accordance with the display appearing at the time of the touch. Thereafter, the computing system can perform one or more actions based on the touch. In the case of some touch sensing systems, a physical touch on the display may not be needed to detect a touch. For example, in some capacitive-type touch sensing systems, fringing electrical fields used to detect touch can extend beyond the surface of the display, and objects approaching near the surface may be detected near the surface without actually touching the surface.

Touch sensor panels can include an array of touch sensors capable of detecting touches (the touching by an object such as a finger upon a touch-sensitive surface). Some touch sensor panels are able to detect multiple touches (e.g., the touching of multiple fingers upon a touch-sensitive surface at distinct locations at or about the same time) and near touches (e.g., fingers within the near-field detection capabilities of their touch sensors), and identify and track their locations.

In reality, however, not all touches detected on a touch sensor panel are intended user input. For example, water on the surface of the touch sensor panel can be detected as a touch. In particular, water on a touch-sensitive surface in contact with a metal housing of the device or a finger can be grounded and appear as a touch by a finger. As a result, water (or other unintentional touches) can result in unintended behavior by the device. This can negatively affect user experience, particularly in wet environments.

SUMMARY OF THE DISCLOSURE

This relates to touch input processing for touch-sensitive devices, and more particularly, to filtering unintended contact detected on a touch-sensitive surface. In wet environments in particular, water (e.g., from rain, shower, sweat, etc.) on the touch-sensitive surface can be erroneously detected as touch input and degrade touch performance. In some examples, input patches can be classified as touch patches or non-touch patches prior to computationally-intensive touch processing. Filtering out unintended touches classified as non-touch patches can reduce processing requirements and save power. Additionally, classifying input patches can improve touch performance in wet environments. In some examples, input patches can be classified as touch patches or non-touch patches based on characteristics of edge touch nodes. In some examples, input patches can be classified as touch patches or non-touch patches based on a state-based signal threshold.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A-1E illustrate exemplary systems with touch screens that can perform input processing according to examples of the disclosure.

FIG. 2 illustrates an exemplary computing system including a capacitive touch sensor panel that can perform input processing according to examples of the disclosure.

FIG. 3 illustrates an exemplary representation of an image of touch according to examples of the disclosure.

FIG. 4 illustrates an exemplary plot of touch signal thresholds corresponding to different objects proximate to or touching a touch-sensitive surface according to examples of the disclosure.

FIG. 5 illustrates an exemplary process for processing input to a touch-sensitive surface according to examples of the disclosure.

FIGS. 6A and 6B illustrate exemplary representations of input patches including edge touch nodes corresponding to one or more edges of a touch-sensitive surface according to examples of the disclosure.

FIG. 7 illustrates an exemplary process for classifying input patches based on a number of strong edges according to examples of the disclosure.

FIG. 8 illustrates an exemplary plot of a confidence value contributing parameter based on occupancy according to examples of the disclosure.

FIG. 9 illustrates an exemplary plot of a confidence value contributing parameter based on signal density according to examples of the disclosure.

FIG. 10 illustrates an exemplary process for processing input to a touch-sensitive surface according to examples of the disclosure.

FIG. 11 illustrates an exemplary process for determining a state according to examples of the disclosure.

FIG. 12 illustrates an exemplary determination of floating water area percentage according to examples of the disclosure.

FIG. 13 illustrates an exemplary process for classifying input patches (and/or paths) according to examples of the disclosure.

FIGS. 14A-C illustrate exemplary representations of input patches corresponding to floating water and one or more fingers on a touch-sensitive surface according to examples of the disclosure.

FIG. 15A-C illustrate another exemplary representation of input patches corresponding to floating water and/or one or more fingers on a touch-sensitive surface according to examples of the disclosure.

FIGS. 16A-F illustrate another exemplary representation of input patches corresponding to floating water and/or one or more fingers on a touch-sensitive surface according to examples of the disclosure.

DETAILED DESCRIPTION

In the following description of examples, reference is made to the accompanying drawings which form a part hereof, and in which it is shown by way of illustration specific examples that can be practiced. It is to be understood that other examples can be used and structural changes can be made without departing from the scope of the disclosed examples.

FIGS. 1A-1E illustrate exemplary systems with touch screens that can perform input processing according to examples of the disclosure. FIG. 1A illustrates an exemplary mobile telephone 136 that includes a touch screen 124 and can perform input processing according to examples of the disclosure. FIG. 1B illustrates an example digital media player 140 that includes a touch screen 126 and can perform input processing according to examples of the disclosure. FIG. 1C illustrates an example personal computer 144 that includes a touch screen 128 and a track pad 146 and can perform input processing according to examples of the disclosure (on inputs detected from the touchscreen 128 or track pad 146). FIG. 1D illustrates an example tablet computing device 148 that includes a touch screen 130 and can perform input processing according to examples of the disclosure. FIG. 1E illustrates an example wearable device 150 (e.g., a watch) that includes a touch screen 152 and can perform input processing according to examples of the disclosure. Wearable device 150 can be coupled to a user via strap 154 or any other suitable fastener. It should be understood that the example devices illustrated in FIGS. 1A-1E are provided by way of example, and other types of devices can perform input processing according to examples of the disclosure. Additionally, although the devices illustrated in FIGS. 1A-1E include touch screens, in some examples, input processing according to examples of the disclosure can be performed for touch sensor panels without a display (e.g., track pad 146). In some examples, touch screens 124, 126, 128, 130 and 152 can be based on self-capacitance or mutual capacitance. In some examples, a touch screen can be multi-touch, single touch, projection scan, full-imaging multi-touch, capacitive touch, etc.

FIG. 2 illustrates an exemplary computing system 200 including a capacitive touch sensor panel 224 that can perform input processing according to examples of the disclosure. Computing system 200 can be included in, for example, mobile telephone 136, digital media player 140, personal computer 144, tablet computing device 148, wearable device 150, or any mobile or non-mobile computing device that includes a touch sensor panel or touch screen. Computing system 200 can include a touch sensing system including one or more panel processors 202, peripherals 204, and panel subsystem 206. Peripherals 204 can include, but are not limited to, random access memory (RAM) or other types of memory or storage, watchdog timers and the like. Panel subsystem 206 can include, but is not limited to, one or more sense channels 208, channel scan logic (analog or digital) 210 and driver logic (analog or digital) 214. Touch sensor panel 224 can include row electrodes 234 and column electrodes 236. In mutual capacitance touch sensor panel examples, stimulation signals from driver logic 214 can be driven onto row electrodes 234, and sense signals on column electrodes 236 can be sensed by sense channels 208 (also referred to as sense circuitry). Touch or proximity events can alter the capacitive coupling Csig between row electrodes 234 and column electrodes 236 at touch nodes 226 and cause a change to the sense signals on column electrodes 236. However, in self-capacitance touch sensor panel examples, driver logic 214 and sense channels 208 can be combined, and the touch sensor panel can be driven and sensed on both row electrodes 234 and column electrodes 236. Channel scan logic 210 can access RAM 212, autonomously read data from sense channels 208 and provide control for the sense channels. In addition, channel scan logic 210 can control driver logic 214 to generate stimulation signals that can be sequentially or simultaneously applied to the row electrodes 234 of touch sensor panel 224. Panel processor 202 can process the data received from scanning the touch sensor panel. In some examples, panel subsystem 206, panel processor 202 and peripherals 204 can be integrated into a single application specific integrated circuit (ASIC) that can be referred to herein as a touch controller.

In mutual capacitance sensing examples, touch sensor panel 224 can include a capacitive sensing medium having one or more drive electrodes and one or more sense electrodes. The drive and sense electrodes can be formed from a transparent conductive medium such as Indium Tin Oxide (ITO) or Antimony Tin Oxide (ATO), although other transparent and non-transparent materials such as copper can also be used. The drive and sense electrodes can be formed on a single side of a transparent substrate. Each adjacency of drive and sense electrodes can represent a capacitive sensing node and can be viewed as touch picture element (touch pixel) or touch node 226, which can be particularly useful when touch sensor panel 224 is viewed as capturing an “image” of touch or proximity. (In other words, after panel subsystem 206 has determined whether a touch or proximity event has been detected at each sense electrode in the touch sensor panel, the pattern of sense electrodes in the touch sensor panel at which a touch or proximity event occurred can be viewed as an “image” of touch or proximity (e.g., a pattern of fingers touching the panel or proximate to, but not touching, the panel).) The capacitance between the drive and sense electrodes and local system ground can appear as a stray capacitance Cstray, and the capacitance at the intersections of the drive and sense electrodes, i.e., the touch nodes, can appear as a mutual signal capacitance Csig between the drive and sense electrodes when the given drive electrode is stimulated with an alternating current (AC) signal. The presence of a finger or other object (such as a stylus) near or on the touch sensor panel can be detected by measuring changes to a signal charge present at the nodes being touched, which can be a function of Csig. Each sense electrode of touch sensor panel 224 can be coupled to a sense channel 208 in panel subsystem 206. Touch sensor panel 224 can cover a portion or all of a surface of a device.

In some self-capacitance sensing examples, the touch sensor panel 224 can include a matrix of small plates of conductive material that can be referred to as a touch pixel, touch node, or a touch pixel electrode. The touch nodes can be formed from a transparent conductive medium such as ITO or ATO, although other transparent and non-transparent materials such as copper can also be used. The touch nodes can be formed on a single side of a transparent substrate. In some examples, a touch screen can include a plurality of individual touch nodes, each touch node identifying or representing a unique location on the touch screen at which touch or proximity (i.e., a touch or proximity event) is to be sensed, and each touch node being electrically isolated from the other touch nodes in the touch screen/panel. Such a touch screen can be referred to as a pixelated touch screen. During self-capacitance operation of the pixelated touch screen, a touch node can be stimulated with an AC waveform, and the self-capacitance to ground of the touch node can be measured. As an object approaches the touch node, the self-capacitance to ground of the touch node can change. This change in the self-capacitance of the touch node can be detected and measured by the touch sensing system to determine the positions of multiple objects when they touch, or come in proximity to, the touch sensor panel. Each touch node of touch sensor panel 224 can be coupled to a sense channel 208 in panel subsystem 206. Touch sensor panel 224 can cover a portion or all of a surface of a device. In some examples, the electrodes can be formed from rows and columns of conductive material, and changes in the self-capacitance to ground of the rows and columns can be detected.

Computing system 200 can also include host processor 228 for receiving outputs from panel processor 202 and performing actions based on the outputs that can include, but are not limited to, moving one or more objects such as a cursor or pointer, scrolling or panning, adjusting control settings, opening a file or document, viewing a menu, making a selection, executing instructions, operating a peripheral device coupled to the host device, answering a telephone call, placing a telephone call, terminating a telephone call, changing the volume or audio settings, storing information related to telephone communications such as addresses, frequently dialed numbers, received calls, missed calls, logging onto a computer or a computer network, permitting authorized individuals access to restricted areas of the computer or computer network, loading a user profile associated with a user's preferred arrangement of the computer desktop, permitting access to web content, launching a particular program, encrypting or decoding a message, and/or the like. Host processor 228 can also perform additional functions that may not be related to panel processing, and can be coupled to program storage 232 and display device 230 such as an LCD display for providing a UI to a user of the device. Display device 230 together with touch sensor panel 224, when partially or entirely overlapping with the touch sensor panel, can form a touch screen.

In some examples, touch sensor panel 224 and display device 230 together can form an integrated touch screen in which touch nodes of the touch sensing system can be integrated into the display pixel stack-ups of display device 230. The circuit elements in an integrated touch screen can include, for example, elements that can exist in LCD or other displays, such as one or more display pixel transistors (e.g., thin film transistors (TFTs)), gate lines, data lines, pixel electrodes and common electrodes. It is noted that circuit elements are not limited to whole circuit components, such as a whole capacitor, a whole transistor, etc., but can include portions of circuitry, such as only one of the two plates of a parallel plate capacitor. In some configurations, each common electrode in an integrated touch screen can serve as a multi-function circuit element that can operate as display circuitry of the display system of the touch screen and can also operate as touch nodes of the touch sensing system. Specifically, each common electrode can operate as a common electrode of the display circuitry of the touch screen (e.g., during a display phase), and can also operate as a common electrode (i.e., a touch node) of the touch sensing system of the touch screen (e.g., during a touch sensing phase). It should be understood that a display phase and a touch sensing phase of an integrated touch screen may be operated at the same time, e.g., partially or completely overlapping, or the display phase and touch sensing phase may operate at different times.

In general, each of the touch nodes may be either a multi-function circuit element that can form part of the touch sensing system and can perform one or more other functions, such as forming part of the display circuitry, or may be a single-function circuit element that can operate as a touch node only. Similarly, each of the display circuit elements may be either a multi-function circuit element that can operate as display circuitry and perform one or more other functions, such as operating as a touch node, or may be a single-function circuit element that can operate as display circuitry only. Therefore, in some examples, some of the circuit elements in the display pixel stack-ups can be multi-function circuit elements and other circuit elements may be single-function circuit elements. In other examples, all of the circuit elements of the display pixel stack-ups may be single-function circuit elements.

Note that one or more of the functions described herein, including the processing of inputs according to examples of the disclosure, can be performed by firmware stored in memory (e.g., one of the peripherals 204 in FIG. 2) and executed by panel processor 202, or stored in program storage 232 and executed by host processor 228. The firmware can also be stored and/or transported within any non-transitory computer-readable storage medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. In the context of this document, a “non-transitory computer-readable storage medium” can be any medium (excluding a signal) that can contain or store the program for use by or in connection with the instruction execution system, apparatus, or device. The non-transitory computer readable medium storage can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, a portable computer diskette (magnetic), a random access memory (RAM) (magnetic), a read-only memory (ROM) (magnetic), an erasable programmable read-only memory (EPROM) (magnetic), a portable optical disc such a CD, CD-R, CD-RW, DVD, DVD-R, or DVD-RW, or flash memory such as compact flash cards, secured digital cards, USB memory devices, memory sticks, and the like.

The firmware can also be propagated within any transport medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. In the context of this document, a “transport medium” can be any medium that can communicate, propagate or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The transport readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic or infrared wired or wireless propagation medium.

As discussed above, capacitive measurements (touch signals or data) at the touch nodes of touch sensor panel 224 can be viewed as an image of the touch (or touch image) when processed by panel processor 202 and/or host processor 228. FIG. 3 illustrates an exemplary representation of an image of touch according to examples of the disclosure. Touch screen 300 can include drive lines 302 and sense lines 304 arranged as a pattern of rows and columns, although other patterns can be possible. Touch nodes 306 can be formed at the intersection between drive lines 302 and sense lines 304, and the mutual capacitance (or change in mutual capacitance) therebetween can be measured. Each object touching or proximate to, but not touching, the touch screen 300 can produce a touch signal at proximate touch nodes 306. By processing the touch image, touch signals from proximate touch nodes 306 (e.g., those touch signals meeting a threshold signal level) can be grouped together to form input patches 308. Thus, the input patches 308 can be regions within the image of touch corresponding to touch nodes 306 having signal values produced by an object touching (or proximate to, but not touching, in some examples) the touch screen 300. The input patches identified in a touch image can be tracked through multiple successive touch images. Input patches from a corresponding object captured across multiple touch images can be assigned to a corresponding path. Assigning input patches to paths can allow for tracking gesture inputs (e.g., swipe, pinch, etc.). In some examples, the path can track the input contact from an initial touchdown on the touch-sensitive surface through a liftoff from the touch-sensitive surface. In some examples, the input patches of a path can be analyzed to identify movement of the input patch across one or more touch images and thereby track movement of an object corresponding to the input patches. Although a path can be used to identify movement, some paths may not include movement (e.g., when the input patch remains in the same position from touchdown to liftoff, such as in a tap). The tracking can include tracking position, velocities, and/or geometries (e.g., shape, number of touch nodes) of the input patches from various touch images corresponding to a path.

Various characteristics can be computed for each input patch in the touch image that can be used for further processing. For example, each input patch can be characterized by total signal, peak signal, position, shape, size and/or orientation. In some examples, each input patch can be represented by an ellipse defined by a centroid (location of touch), major and minor axis lengths and/or a major axis orientation. In some examples, the number of touch nodes, peak signal, total signal and/or signal density for each input patch can be computed. In some examples, the number of touch nodes, peak signal and/or peak signal density can be tracked for each path across multiple touch images.

For example, the number of touch nodes in a path can be calculated by counting the number of touch nodes with the threshold signal level included in the input patch. The peak signal can, for example, be calculated by taking the maximum signal measured at the touch nodes included in the input patch. An input patch's total signal can, for example, be calculated by summing the square of the signal value at each touch node in the input patch. Thus, total signal for an input patch can be expressed mathematically as in Equation (1):

$\begin{matrix} Z_{p} = \sum_{i, j in p} [V_{[i] [j]}^{2}] & (1) \end{matrix}$

where Z_Pcan represent the total signal for an input patch, V can represent the signal value at a touch node and i, j can represent the row and column coordinate of each touch node. In some examples, the signal value at each touch node can be calibrated (e.g., normalized) before computing the total signal.

An input patch's signal density can be computed based on the input patch's total signal. In some examples, an input patch's signal density can be calculated by dividing the total signal for an input patch by the geometric mean radius of the input patch. In other examples, the input patch's signal density can be calculated by dividing the total signal for an input patch by the number of touch nodes in the input patch. Thus, signal density for an input patch can be expressed mathematically, for example, as in Equations (2) or (3):

$\begin{matrix} Z_{density, p} = \frac{Z_{p}}{geometric mean radius of P} & (2) \\ Z_{density, p} = \frac{Z_{p}}{number of touch nodes forming P} & (3) \end{matrix}$

A conventional touch sensing systems may process and compute characteristics for all input patches identified in an acquired image. In other words, these conventional touch sensing systems may process patches corresponding to intentional, actual touches as well as input patches corresponding to unintended touches or liquids (e.g., water). In some examples, further processing can be used to identify and reject touches from water or unintended touches. However, processing all input patches this way can be viewed as a brute force approach to handling input patches. In some examples of the disclosure, input patches can be classified based on information gathered by initial processing of the input patches with relatively low-intensity processing before performing the relatively computation-intensive processing applied to likely touches. Classifying input patches can improve efficiency by excluding input patches that are likely not intended touch input before applying computation-intensive touch processing algorithms. As described herein, in some examples, the initial input patch processing can include segmentation of the touch image to identify input patches exceeding a signal threshold (e.g., a first signal threshold), a determination of peak signal for each respective patch, and a determination of a number of touch nodes for each respective patch. In some examples, the initial input patch processing can include computing a signal density and/or an occupancy for respective input patches. In some examples, the input patch processing can include low-intensity image processing, such as image filtering and/or computing a difference image. In subsequent processing, input patches identified as touches can be fully parametrized and processed to generate touch input for a computing system. Excluding input patches based on the initial processing without the subsequent further processing can reduce processing requirements of, and thereby reduce power consumption by, the touch sensing system. Additionally, eliminating likely non-touch input patches before processing can avoid false positives when the further processing algorithms fail to differentiate between intended and non-intended touches.

As described in more detail below with respect to FIGS. 5-9, some input patches can be excluded from further processing based on characteristics of signals measured at edge touch nodes. As described in more detail below with respect to FIGS. 10-16F, some input patches can be excluded from further processing based on a state-determined characteristic of signals measured at touch nodes. For example, a signal threshold can be increased from a first signal threshold to a second signal threshold to classify the input patch as a touch patch or non-touch patch.

FIG. 4 illustrates an exemplary plot 400 of touch signal thresholds corresponding to different objects proximate to or touching a touch-sensitive surface according to examples of the disclosure. FIG. 4 illustrates example peak signals for an input patch corresponding to a finger proximate to, but not in contact with, a touch-sensitive surface, a finger indirectly contacting the touch-sensitive surface (e.g., via a glove or bandage), a finger in contact with a touch-sensitive surface, a floating or partially grounded water drop (or other liquid), and a bezel-grounded water drop (or other liquid). It should be understood that these are representative peak signal measurements for input patches, and that a range of peak signal values are possible for these objects. For example, an indirectly contacting finger may have a peak signal larger than a floating water drop when the separation between the indirectly contacting finger and the touch-sensitive is within a threshold distance of the screen (e.g., <1 mm). Among the represented objects in FIG. 4, peak signal for an input patch can be greatest for a finger in contact with a touch-sensitive surface and least for a fingering proximate to, but not in contact with, the touch sensitive surface. Peak signal for an input patch corresponding to a bezel-grounded water drop can be less than for an input patch corresponding to a finger in contact with the touch-sensitive surface, but greater than for an input patch corresponding to a floating or partially grounded water drop. Peak signal for an input patch corresponding to a floating or partially-grounded water drop can be less than for an input patch corresponding to a bezel-grounded water drop, but greater than for an input patch corresponding to an indirectly contacting finger or a proximate, non-contacting finger.

In some touch sensing systems, a first touch signal threshold 402 can be defined to differentiate between input patches corresponding to touches and non-touches. In some examples, this first touch signal threshold can be used to identify input patches in a touch image. For example, the peak signal corresponding to a finger in contact with a touch sensitive surface can meet the first touch signal threshold 402, but the peak signal corresponding to a proximate, non-contacting finger can fail to meet the first touch signal threshold 402. The peak signal corresponding to a water drop (grounded or floating), however, can also meet the first touch signal threshold. Raising the threshold from the first touch signal threshold 402 to a second touch signal threshold 406 can better reject input patches corresponding to water, but can cause the touch sensing system to miss actual finger touches (increasing false negatives). In some examples, as described in more detail below, in a first mode of operation (e.g., corresponding to a dry environment) the first touch signal threshold 402 can be used to classify input patches, and in a second mode of operation (e.g., corresponding to a wet environment) a second touch signal threshold 406, higher than the first touch signal threshold, can be used. Using the second touch signal threshold 406 can result in rejecting input patches corresponding to water (grounded and/or floating).

In some touch sensing systems, a proximity threshold 404 can be defined to identify input patches corresponding to objects proximate to, but not in contact with, the touch sensitive surface. In some examples, these proximate, non-contacting patches can be used to wake up the device or otherwise prepare for touch input. Additionally, in some touch sensing systems, indirectly contacting fingers or objects can be detected using a dynamically adjustable touch signal threshold 402 or using other conditions as described in U.S. Pat. No. 9,690,417 to Ari Y. BENBASAT, the disclosure of which is herein incorporated by reference in its entirety for all intended purposes.

FIG. 5 illustrates an exemplary process 500 for processing input to a touch-sensitive surface according to examples of the disclosure. At 505, a touch image can be acquired. For example, signals can be measured by performing a mutual capacitance or self-capacitance scan of touch nodes of the touch screen or touch sensor panel of exemplary systems illustrated in FIGS. 1A-1E. The touch image can be formed from the signals measured during the scan. In some examples, the signals can be arranged in a two-dimensional image such that the x-coordinate and y-coordinate of the touch image corresponds to the x-coordinate and y-coordinate of the touch node. At 510, input patches can be identified. In some examples, the input patches can be identified using an image segmentation processes. The image segmentation process can include image filtering (e.g., subtracting a baseline from the touch image and/or spatial-smoothing using a two-dimensional diffusion operator or Gaussian kernel) and segmenting the filtered touch image into input patches (groups touch nodes) corresponding to the distinguishable objects (e.g., fingers or other hand parts, styli, etc.). The touch nodes in the input patches can include a local maximum signal and proximate signals which meet a signal threshold (e.g., one of the signal threshold illustrated in FIG. 4). Some parameters of the input patches can be determined for identified input patches. In some examples, the parameters can include signal measurements for the touch nodes of the input patches, the number of touch nodes of the input patches, and/or signal density of the input patches. At 515, input patches can be classified. The classification can classify input patches (and/or corresponding paths) as corresponding to likely intended/actual touches (also referred to herein as “valid touches” or “touch patches”) or as corresponding to likely unintended touches or liquids such as water (also referred to herein as “invalid touches” or “non-touch patches”). In some examples, input patches (and/or corresponding paths) can be classified as proximity patches. At 520, input patches classified as touch patches can be further processed to determine touch input for the computing system. The further processing can include further parameterization of the input patches (and/or paths). In some examples, the further processing can include ellipse fitting and centroid determination. In some examples, the further processing can include algorithms to compensate for ungrounded and/or poorly grounded objects, to compensate for negative touch pixel effects, to reject contacts from liquids (e.g., water), and/or to detect gestures. Input patches classified as non-touch patches and/or proximity patches can be excluded from the further processing, in some examples. By forgoing this further processing, the touch sensing system can reduce processing requirements (and power consumption). Additionally, the classification of touches can improve touch performance when operating in wet environments, as described in more detail herein.

In some examples, an input patch along one or more edges of a touch-sensitive surface can be identified as a touch patch or non-touch patch based on one or more characteristics of one or more edge touch nodes corresponding to the input patch. FIGS. 6A and 6B illustrate exemplary representations of input patches including edge touch nodes corresponding to one or more edges of a touch-sensitive surface according to examples of the disclosure. An edge touch node can be defined as a touch node within a threshold distance from an edge of the touch sensitive surface. For example, as illustrated in FIGS. 6A and 6B, touch-sensitive surface 600 can include an array of touch nodes. In some examples, the threshold distance can be such that only touch nodes 610, which are immediately adjacent to an edge of the touch-sensitive surface 600, can be included as edge touch nodes. In some examples, the threshold distance can be such that touch nodes 612, which are not immediately adjacent with the edge of the touch-sensitive surface 600, can be included as touch nodes as well.

FIG. 6A illustrates an input patch 602 on touch-sensitive surface 600. Input patch 602 can correspond, for example, to an object covering a portion of a touch screen and touching multiple sides of the touch screen. For example, input patch 602 and touch-sensitive surface 600 can correspond to a touch screen 152 of wearable device 150 partially submerged in a liquid (e.g., water). The liquid can be grounded (at least partially) by contacting a conductive bezel of the touch-sensitive device. As a result of bezel-grounding, input patch 602 may be detected and identified as a touch by a conventional touch-sensing system. As another example, input patch 602 and touch-sensitive surface 600 can correspond to an arm resting on touch screen 130 of tablet computing device 148). Input patch 602 can be an undesired touch (e.g., because such an input patch can be atypical for a touch-sensitive surface), but may be detected and identified as a touch by a conventional touch-sensing system.

In some examples, further processing of the input patches can cause these input patches corresponding to water or unintended touch to be ignored rather than provide touch input that can be used by the user interface. However, as described herein, classifying input patches and then forgoing processing of input patches classified as non-touch patches can reduce processing (and power) requirements for the touch sensing system. As described in more detail below, in some examples, input patch 602 can be identified as a non-touch patch based on characteristics of one or more edge touch nodes 610 (and 612) corresponding to input patch 602. For example, a touch sensing system can determine from an acquired touch image a number of “strong” edges of a respective input patch. The number of strong edges of an input patch can be used to classify input patches as touch patches or non-touch patches.

FIG. 6B illustrates touch-sensitive surface 600 with input patches 604, 606 and 608. Input patch 604 can correspond, for example, to an object covering a corner of a touch screen and touching two sides of the touch screen 600. Input patch 606 can correspond, for example, to an object touching along one side of the touch screen 600. Input patch 608 can correspond, for example, to an object touching along multiple sides of touch screen 600, but primarily touching along one side of touch screen 600. Input patches 604, 606 and 608 can correspond to cases in which the input patch may correspond to a touch patch or may correspond to a non-touch patch. For example, input patches 604, 606 and 608 can correspond to grounded water on the touch-sensitive surface 600 or to a touch object (e.g., a finger) contacting the touch-sensitive surface. In some examples, further processing of the input patches can cause these input patches corresponding to water or unintended touch to be ignored rather than provide touch input that can be used by the user interface. However, as described herein, classifying input patches and then forgoing processing of input patches classified as non-touch patches can reduce processing (and power) requirements for the touch sensing system. As described in more detail below, in some examples, input patches 604, 606 and 608 can be classified as a touch patch or non-touch patch based on characteristics of one or more edge touch nodes 610 (and 612) corresponding to the respective input patches. For example, a touch sensing system can determine from an acquired touch image a number of “strong” edges of a respective input patch. The number of strong edges of a respective input patch can be used to classify the respective input patch as a touch patch or a non-touch patch.

FIG. 7 illustrates an exemplary process 700 for classifying input patches based on a number of strong edges according to examples of the disclosure. Process 700, for example, can be performed at 515 in process 500 illustrated in FIG. 5. The number of strong edges can be used to classify input patches and thereby determine whether to process and how the process the input patches. In some examples, the number of strong edges can be used to determine a confidence value that can be used for classifying an input patch. When the confidence value meets a confidence value threshold, the input patch can be classified as a non-touch patch and the touch sensing system can forgo further processing of the input patch. When the confidence value fails to meet the confidence value threshold, the input patch can be classified as a touch patch and the touch sensing system can further process the input patch for touch input. In the examples described below, the confidence value can range between zero and one, where zero corresponds to a maximum likelihood that an input patch is a touch patch, and one corresponds to a maximum likelihood that an input patch is a non-touch patch (e.g., corresponding to water). It should be understood, however, that the classification of input patches can be based on different conventions or be done without calculating a confidence value.

At 705, a number of strong edges can be determined for a respective input patch. The number of strong edges can be determined from the edge touch nodes of the acquired touch image (e.g., acquired at 505 in process 500). In some examples, a smoothing filter can be applied to the acquired touch image before determining the number of strong edges. In some examples, to avoid input patch splitting, the smoothing filter can be applied to edge touch nodes only. An edge of a respective input patch can be identified as a strong edge based on a threshold number of edge touch nodes meeting one or more criteria (710). In some examples, an edge of a respective input patch can be identified as a strong edge based on the signal measurements at touch nodes corresponding to the respective input patch and corresponding to an edge of the touch-sensitive surface (i.e., edge touch nodes). As discussed above, edge touch nodes can be defined as touch nodes within a threshold distance from an edge of the touch-sensitive surface. In some examples, the threshold distance can be defined to include touch nodes along the perimeter of the touch sensitive surface (e.g., touch nodes 610 in FIGS. 6A-6B). In some examples, the threshold distance can be defined to include additional touch nodes as edge touch nodes (e.g., touch nodes 612 in FIGS. 6A-6B). In some examples, a strong edge can be identified based on a threshold number of edge touch nodes meeting a signal threshold criterion. In some examples, the signal threshold criterion can be set based on the size of the touch sensor panel. For example, a smaller touch sensor panel can more readily encounter touches close to edges of the touch sensor panel and therefore a larger signal threshold can be used relative to signal threshold used for a larger touch sensor panel. In some examples, the threshold number of edge touch nodes can be set at one, such that any edge touch node exceeding a signal threshold can be sufficient to identify the edge as a strong edge. In some examples, the threshold number of edge touch nodes can be set at some other threshold number of edge touch nodes greater than one (e.g., 2, 5, 10, etc.). In some examples, in order to be identified as a strong edge the threshold number of edge touch nodes must be contiguous. For example, if the threshold number of edge touch nodes corresponds to four edge touch nodes, the four edge touch nodes must be contiguous (e.g., adjacent to one another). In some examples, the threshold number of edge touch nodes need not be contiguous.

At 715, the touch sensing system can compare the number of strong edges corresponding to a respective input patch to a first number-of-edges threshold. When the number of edges fails to meet the first number-of-edges threshold, the touch sensing system can identify the input patch as a touch patch and further process the touch patch accordingly (720). In examples using a confidence value, when the number of edges fails to meet the first number-of-edges threshold, the touch sensing system can set a confidence value for the respective input patch to indicate a high-likelihood that the respective input patch is a touch patch. In some examples, a confidence value of the respective input patch can be set to a minimum value (i.e., zero). In some examples, rather than setting the confidence value to a minimum value, a confidence value can be determined (as described in more detail below) and then decreased (e.g., scaled by a factor less than one, decreased by a constant value, etc.). When the number of edges meets the first number-of-edges threshold, the touch sensing system can, at 725, compare the number of strong edges corresponding to the respective input patch to a second number-of-edges threshold. The second number-of-edges threshold can be greater than the first number-of-edges threshold. When the number of edges meets the second number-of-edges threshold, the touch sensing system can identify the input patch as a non-touch patch (e.g., as water) and further process the non-touch patch accordingly or not at all (730). In examples using a confidence value, when the number of edges meets the second number-of-edges threshold, the touch sensing system can set a confidence value for the respective input patch to indicate a high-likelihood that the respective input patch is a non-touch patch. In some examples, a confidence value of the respective input patch can be set to a maximum value (i.e., one). In some examples, rather than setting the confidence value to a maximum value, a confidence value can be determined (as described in more detail below) and then increased (e.g., scaled by a factor greater than one, incremented by a constant value, etc.).

At 735, when the number of edges fails to meet the second number-of-edges threshold, the touch sensing system can perform further analysis to determine how to classify the input patch and thereby determine treatment for subsequent processing (or lack thereof). The further analysis can be based on signal density and/or occupancy of the respective input patch. In examples using a confidence value, the further analysis can include calculating a confidence value. The confidence value can be determined based on various characteristics acquired from the initial processing of the acquired touch image. For example, the confidence value can be based on signal density of the respective input patch (740) and/or the occupancy of the respective input patch (745). As described above, the signal density of the respective input patch can be calculated based on the total signal and the size of the respective input patch. The occupancy of the respective input patch can be a measure of the variability of the touch signal across touch nodes of a respective input patch. For example, an input patch whose touch nodes report uniform signal measurements can have an occupancy measure of 100%. The occupancy can decline as the variance in the signal measurements from the touch nodes of a respective input patch increases. In some examples, the confidence value can be based on the maximum of the signal density and the occupancy (750). The signal density and the occupancy can be normalized to correspond to the likelihood that an input patch is a touch patch or a non-touch patch. In some examples, the maximum of the signal density and the occupancy can provide an instantaneous confidence value for the respective input patch and corresponding touch image. In some examples, the confidence value can be based on a history of confidence values (755) and the instantaneous confidence value to avoid switching the classification between a touch patch and non-touch patch too easily. For example, the confidence value can be based on a maximum of an instantaneous confidence value for the touch image and a weighted historical confidence value. In some examples, the weighting can be a decay parameter to scale the historical confidence value. In some examples, the weighting can be reduced to minimize the impact of the historical confidence value when the number of strong edges changes (e.g., from two strong edges to one strong edge). Reducing the weighting in such a way can prevent identifying an input patch corresponding to an actual finger from being identified as water for too long after the reduction in the number of strong edges (where the historical confidence value parameter would otherwise delay recognition of the input patch as a touch patch, thereby reducing responsiveness of the touch system). In some examples, the historical confidence value can be based on one or more prior confidence values. In some examples, the historical confidence value can be based on the confidence value of the respective input patch from the last touch image. In some examples, the historical confidence value can be based on confidence values of the respective input patch from the last plurality of touch images (e.g., the arithmetic average or otherwise weighted average of the confidence values from the last integer number of touch images). In some examples, when the instantaneous confidence value exceeds a threshold, the confidence value calculation can bypass the history of confidence values and adopt the instantaneous confidence value. In some examples, when the instantaneous confidence value exceeds a threshold, the confidence value can bypass the history of confidence values and adopt the maximum of the instantaneous confidence value and the last confidence value.

As described herein, the confidence value of a respective input patch can be compared with a confidence value threshold. When the confidence value of the respective input patch meets the confidence value threshold, the touch sensing system can forgo further processing of the respective input patch. When the confidence value of the respective input patch fails to meet the confidence value threshold, the touch sensing system can further process the respective input patch to determine touch input. In some examples, the confidence value threshold can be at the midpoint of the confidence value range. In some examples, the confidence value threshold can be set higher (e.g., 60%, 75%, 90% of the confidence value range) or lower than the midpoint. Setting the confidence value threshold higher can result in fewer missed touches (false negatives), but require increased processing to reject unintentional touches or water touches. Setting the confidence value threshold lower can result in more false negatives, but reduces processing requirements for non-touches.

In some examples, the confidence value threshold can depend on the mode of operation. For example, the confidence value threshold can be adjusted to default to a higher confidence value threshold, and more liberally process input patches that may not be actual touches, to avoid missing actual touches. However, when a wet environment is encountered, the confidence value threshold can be lowered to avoid processing input patches more likely corresponding to water. In some examples, the confidence value threshold can also be lowered when a touch-sensitive device is in a state in which reducing processing requirements can be desired (e.g., low battery state).

FIGS. 8 and 9 illustrate exemplary plots of confidence value contributing parameters based on occupancy and signal density according to examples of the disclosure. FIG. 8 illustrates an exemplary plot 800 of a confidence value contributing parameter based on occupancy according to examples of the disclosure. Input patches corresponding to water (or other liquids) on a touch-sensitive surface can have relatively uniform signal measurements across touch nodes of an input patch. Input patches corresponding to fingers or other grounded touch objects on the touch-sensitive surface can have distributed signal measurements across touch nodes of an input patch. For example, a touch patch can have a local maximum signal and signals can decay (e.g., exponentially) for touch nodes moving away from the local maximum. As a result, for occupancies less than a first threshold (X₁in plot 800), the confidence value contributing parameter based on occupancy can be zero (high likelihood of touch patch) and for occupancies above a second threshold (X₂in plot 800), the confidence value contributing parameter based on occupancy can be one (high likelihood of touch non-touch patch, e.g., water). For occupancies between the first and second thresholds, the confidence value contributing parameter based on occupancy can increase as occupancy increases from X₁to X₂. Although plot 800 illustrates a linear increase in the confidence value contributing parameter, the behavior may be non-linear in some examples. In some examples, the confidence value (e.g., instantaneous) can be set to the confidence value contributing parameter based on occupancy.

FIG. 9 illustrates an exemplary plot 900 of a confidence value contributing parameter based on signal density according to examples of the disclosure. Input patches corresponding to water (or other liquids) on a touch-sensitive surface can have relatively low signal density. Input patches corresponding to fingers or other grounded touch objects on the touch-sensitive surface can have a relatively high signal density. As a result, for signal densities less than a first threshold (X₁in plot 900), the confidence value contributing parameter based on signal density can be one (high likelihood of touch non-touch patch, e.g., water) and for signal densities above a second threshold (X₂in plot 900), the confidence value contributing parameter based on signal density can be zero (high likelihood of touch patch). For signal densities between the first and second thresholds, the confidence value contributing parameter based on occupancy can decrease as signal density increases from X₁to X₂. Although plot 900 illustrates a linear decrease in the confidence value contributing parameter, the behavior may be non-linear in some examples. In some examples, the confidence value (e.g., instantaneous) can be set to the confidence value contributing parameter based on signal density.

Returning to the exemplary process of FIG. 7, in some examples, the first number-of-edges threshold can be set to two edges and the second number-of-edges threshold can be set to three edges. When the second number-of-edges threshold is met (i.e., three or more strong edges), the confidence value of an input patch can either be set to the maximum confidence value (bypassing the need for computing a confidence value) or the computed confidence value can be increased. As a result, input patches, such as input patch 602 in FIG. 6A, that can have three strong edges, can be more likely to be classified (and with relatively low processing requirements) as a non-touch patch, and thereby further processing can be avoided. When the first number-of-edges threshold is not met (i.e., one or no strong edge), the confidence value of an input patch can either be set to the minimum confidence value (bypassing the need for computing a confidence) or the computed confidence value can be decreased. As a result, input patches, such as input patch 606 in FIG. 6B, that can have one (or no) strong edge, can be more likely to be classified (and with relatively low processing requirements) as a touch patch, and further processed to determine touch input.

When the first number-of-edges threshold is met, but the second number-of-edge threshold is not met, a confidence value can be calculated to improve accuracy of the classification of the input patch as a touch patch or non-touch patch. As a result, input patches with two strong edges (e.g., input patches 604 and 608 in FIG. 6B, which may correspond to water or a finger, for example), can be evaluated based on the confidence values before classifying the input patch as a touch patch or a non-touch patch.

It should be noted that although input patches 604, 606 and 608 may correspond to water, and their classification based on strong edges may fail to identify the input patch as non-touch patches, additional classification processes (discussed in more detail below), may properly classify the input patches as corresponding to non-touch patches.

In some examples, floating or partially grounded liquids (e.g., water) can degrade touch performance. In some examples, floating or partially grounded water can interfere with the detection of a touchdown or a liftoff of an object (e.g., a finger). In some examples, floating or partially grounded water can interfere with the detection of a swipe gesture or cause a swipe gesture to be unintentionally canceled. In some examples, floating or partially ground water can merge with an object (e.g., a finger) and offset centroid detection (causing unwanted jitter in the touch sensing system performance). In some examples, small droplets of water along the edges of a touch sensor panel (which may not be detected based on the process of FIG. 7) can be detected as false taps or swipes, for example. In some examples, to improve performance in wet environments, input patches can be classified as touch or non-touch patches (or paths). Non-touch patches can be ignored which can reduce processing requirements for the touch sensing system and can improve touch detection performance in wet environments.

In some examples, a state of the device can be determined, and different criteria, chosen based on the state of the device, can be used to classify an input patch as a touch patch or a non-touch patch. FIG. 10 illustrates an exemplary process 1000 for processing input to a touch-sensitive surface according to examples of the disclosure. A touch image can be acquired at 1005, and input patches can be identified based on the touch image at 1010. The details of touch image acquisition and input patch identification can correspond to the process 500 described above with respect to FIG. 5 (the details of which are omitted here for brevity). At 1015, input patches can be assigned to paths. As described herein, a path can be used to track input patches corresponding to an object across multiple touch images. For example, when an input patch corresponding to a previously detected and tracked object is detected in a touch image, the input patch can be assigned to an existing path tracking the object. When an input patch is detected that does not correspond to a previously detected and tracked object (e.g., touchdown condition), a new path can be created. When no input patch is detected in a touch image that corresponds to a previously existing path (e.g., liftoff condition), the path can be subsequently deleted (e.g., after processing touch input associated with the path). It should be understood that the touch sensing system of a touch-sensitive device determines whether an input patch belongs to a previously existing path or to a new path based on the inputs on the touch sensor. As a result, in some instances an input patch from the same object may be assigned to a new path or an input patch from a different object may be assigned to a previously existing path based on a mistaken determination by the touch sensing system. A well designed touch sensing system can, however, reduce the number of false positives/negatives in determining whether or not to assign an input patch to a new or previously existing path.

At 1020, a state of the device can be determined. For example, the state of the device can be a first state corresponding to a dry environment and a second state corresponding to a wet environment. The determination of state can be based on an amount of floating and/or partially grounded water detected on the touch-sensitive surface, as described in more detail below. It should be understood that the touch sensing system measures touch signals from the touch nodes and identifies touch signals or input patches meeting one or more characteristics that can indicate the presence of floating and/or partially grounded water (e.g., touch signals or input patches remaining after subtracting a guarded scan touch image from a non-guarded scan tough image). For ease of description the touch signals and input patches conditions corresponding to floating and/or partially grounded water can be referred to as the amount of floating and/or partially grounded water. Although illustrated as following the identification of input patches and assignment of input patches to paths, the determination of state can occur before or in parallel with the identification of input patches or assignment of input patches to paths.

At 1025, input patches (and/or paths) can be classified. The classification can identify input patches (and/or corresponding paths) as corresponding to likely intended/actual touches (also referred to herein as “valid touches” or “touch patches”) or as corresponding to likely unintended touches or liquids such as water (also referred to herein as “invalid touches” or “non-touch patches”). In some examples, input patches (and/or corresponding paths) can be classified as proximity patches/paths. The classification can be based on the determined state, as described below in more detail.

At 1030, input patches identified as touch patches can be further processed to determine touch input for the computing system. The further processing can include further parameterization of the input patches (and/or paths). In some examples, the further processing can include algorithms to compensate for ungrounded or poorly grounded objects, to compensate for negative touch pixel effects, to reject contacts from liquids (e.g., water), and/or to detect gestures. Input patches classified as non-touch patches and/or proximity patches can be excluded from the further processing. By forgoing this further processing, the touch sensing system can reduce processing requirements and can improve touch performance when operating in wet environments.

FIG. 11 illustrates an exemplary process 1100 for determining a state according to examples of the disclosure. Process 1100 can correspond to the state determination at 1020 in process 1000. As discussed above, in some examples, a first state can correspond to a dry environment and a second state can correspond to a wet environment. In some examples, the state of the device can be based on a characteristic of an acquired touch image. At 1105, a characteristic can be determined from an acquired touch image. In some examples, the characteristic can be an amount of floating and/or partially grounded water. The amount of floating and/or partially grounded water can be represented as a percentage of area of the touch nodes/touch-sensitive surface (referred to herein as floating water area percentage).

The floating water area percentage can be computed from one or more acquired touch images. For example, at 1110, a difference image between a guarded scan image and a non-guarded scan image can indicate touch nodes detecting floating or partially grounded water. A guarded scan image can be generated by driving non-sensed touch nodes with the same stimulation as sensed touch nodes. The stimulation applied to non-sensed touch nodes can cause objects, such as floating water, to have a voltage corresponding to the stimulation. However, other objects, such as a finger, can be unaffected (or be negligibly affected) by the stimulation applied to the non-sensed touch nodes. As a result, the guarded scan image can capture fingers and exclude floating water. A non-guarded scan image can be generated by grounding non-sensed touch nodes. As a result, objects such as floating water can be grounded. Thus, the non-guarded scan image can capture both fingers and floating water. Taking a difference between the guarded and non-guarded scan images can result in an image including floating water but filtering out touches from objects (e.g., fingers, styli, etc.).

FIG. 12 illustrates an exemplary determination of floating water area percentage according to examples of the disclosure. Touch image 1200 can correspond to four floating water drops 1202 and one bezel-contacting water drop 1204. Due to properties of water, the bezel-contacting water drop 1204 may only be partially grounded. A portion 1206 of the bezel-contacting water drop 1204 may appear as grounded and portion 1208 of the bezel-contacting water drop 1204 may appear as floating (based on the signals at the corresponding touch nodes). A first image (a non-guarded scan image) can capture all floating and grounded objects including the four floating water drops 1202 and one bezel-contacting water drop 1204. A second image (a guarded scan image) can capture only well-grounded objects including portion 1206 of the bezel-contacting water drop 1204. The difference between the first and second images (i.e., a difference image) can leave behind the floating and partially grounded objects including the four floating water drops 1202 and portion 1208 of bezel-contacting water drop 1204. The number of touch nodes in the difference image can be divided by the total number of touch nodes of the touch-sensitive surface to determine the floating water area percentage.

In some examples, the state of the device can be determined to be the first state when the floating water area percentage fails to meet the floating water area threshold, and the state of the device can be determined to be the second state when the floating water area percentage meets the floating water area threshold. In some examples, to avoid high frequency switching between these states, hysteresis can be applied in the state determination. For example, transition from the first state to the second state can occur when the floating water area percentage meets (e.g., exceeds) a first floating water area threshold. Transition from the second state to the first state can occur when the floating water area percentage meets (falls below) a second floating water area threshold. The first floating water area threshold can be higher than the second floating water area threshold. For example, the first floating water area threshold can be set between 5%-25% (e.g., 10%) and the second floating water area threshold can be set lower than the first floating water area threshold. In some examples, the second floating water area threshold can be between 1% and 10% (e.g., 5%).

In some examples, a transition between the first and second state can also require the floating water area threshold(s) be satisfied for a threshold number of touch images. For example, the second state can be entered into when the floating water area percentage meets the floating water area threshold (or the first floating water area threshold) for a first threshold number of touch images. The first state can be entered into when the floating water area percentage fails to meet the floating water area threshold (or meets (falls below) the second floating water area threshold) for a second threshold number of touch images. In some examples, the first threshold number of touch images and the second threshold number of touch images can be the same. In some examples, the first threshold number of touch images and the second threshold number of touch images can be different. For example, to be responsive to sudden wet environments, the first threshold number of touch images can be one in some examples. However, due to chaotic nature of water in wet environments, floating or partially grounded water may not be detected in every touch image, so the second threshold number of touch images can be greater than one (e.g., five) to avoid transitioning to the first state prematurely when the environment is still a wet environment.

The remainder of process 1100 in FIG. 11 represents an exemplary hysteresis applied to the state determination. At 1115, the touch sensing system can determine the previous state. When the touch sensing system was previously in the first state, the system can compare, at 1120, the characteristic (e.g., floating water area percentage) to a first characteristic threshold (e.g., first floating water area threshold). When the characteristic meets the first characteristic threshold, the touch sensing system can transition to the second state for classifying the input patches in the touch image (1130). When the characteristic fails to meet the first characteristic threshold, the touch sensing system can remain in the first state for classifying the input patches in the touch image (1125). When the touch sensing system was previously in the second state, the system can compare, at 1135, the characteristic (e.g., floating water area percentage) to a second characteristic threshold (e.g., second floating water area threshold). When the characteristic fails to meet (remains above) the second characteristic threshold, the touch sensing system can remain in the second state for classifying the touch image (1130). When the characteristic meets (falls below) the second characteristic threshold, a counter can be incremented at 1140. When the counter meets a counter threshold (corresponding to the threshold number of touch images), the counter can be reset at 1150, and the touch sensing system can transition to the first state (1125). When the counter fails to meet the counter threshold, the touch sensing system can remain in the second state (1130).

FIG. 13 illustrates an exemplary process 1300 for classifying input patches (and/or paths) according to examples of the disclosure. Process 1300 can correspond to the classification of input patches (and/or paths) at 1025 in process 1000. As discussed above, the classification can be based on the determined state (e.g., as determined in process 1100). For example, the criteria used to classify an input patch in the first state can be different from the criteria used to classify an input patch in the second state. For example, in the first state (e.g., corresponding to a dry environment), input patches identified in a touch image (e.g., at 1010 in process 1000) using a first (default) signal threshold can be classified as touch patches. For example, a peak signal from among the plurality of touch nodes of an input patch can be determined (and/or tracked for a corresponding path) and compared to the first signal threshold. In a second state (e.g., corresponding to a wet environment), input patches identified in a touch image (e.g., at 1010 in process 1000) can be classified as touch patches when the input patch meets a heighted second signal threshold or meets a size threshold. However, in the second state, input patches identified in the touch image that fail to meet the heightened second signal threshold and fail to meet the size threshold can be classified as non-touch patches. For example, the peak signal from among the plurality of touch nodes of an input patch can be determined (and/or tracked for a corresponding path) and compared to the second signal threshold. In some examples, the size threshold can be a threshold number of touch nodes corresponding to the input patch. In some examples, the size threshold can be a threshold geometric mean radius.

Additionally, transitions between states can require special handling of existing or new paths. For example, when transitioning from the first state to the second state, an input patch in a touch image classified in the second state may be classified as a non-touch patch, but the input patch may have been classified as a touch patch in the first state (e.g., the input patch corresponds to a previously identified touch contact path. As a result, the transition from the first state to the second state can appear as a liftoff of a contact/path. This liftoff, however, may a false positive liftoff triggered by the state transition. To avoid mistakenly determining touch input based on this false positive liftoff, the touch sensing system can cancel input from the corresponding path when transition into the second state. As another example, when transition from the second state to the first state, an input patch in a touch image classified in the first state may be classified as a touch patch, but the input patch may correspond to a non-touch patch/path in the second state. As a result, the transition from the second state to the first state can appear as a touchdown of a contact. This touch-down, however, may be a false positive touchdown triggered by the state transition. To avoid mistakenly determining touch input based on this false positive touchdown, the touch sensing system can classify input patches and/or paths that exist in the touch image at transition and that fail to satisfy the second signal threshold as proximity patches/paths. These input patches and/or paths can continue to be reported as proximity patches/paths until the input patches and/or paths meet the second signal threshold or until the path disappears.

At 1305, a determination of state can be made. As discussed above, the determination of the state can correspond to process 1100 of FIG. 11. When the state is determined to be the first state, the touch sensing system can determine, at 1110, whether (1) the state transitioned based on the acquired touch frame or (2) whether there are remaining proximity paths corresponding to an earlier transition from the second state to the first state. In accordance with no state transition and no remaining proximity paths from an earlier transition, input patches identified in the acquired touch image can be classified as touch patches (1315). In accordance with a state transition or remaining proximity paths from an earlier transition, the touch sensing system can determine for each input patch, at 1320, whether the input patch or its corresponding pre-transition path meets the third signal threshold. When the input patch and/or its corresponding pre-transition path meets the third signal threshold, the input patch/path can be classified as a touch patch/path (1315). When the input patch and/or its corresponding pre-transition path fail to meet the third signal threshold, the input patch/path can be classified as a proximity patch/path (1325). In some examples, the third signal threshold and the second signal threshold can be the same. In some examples, the third signal threshold can be different than the second signal threshold (e.g., between the first and second signal thresholds).

When the state is determined to be the second state at 1305, the touch sensing system can determine, at 1330, whether the input patch meets the second signal threshold. When the input patch meets the second signal threshold, the input patch can be classified as a touch patch (1315). When the input patch fails to meet the second signal threshold, the touch sensing system can determine, at 1335, whether the input patch meets a size threshold. When the input patch meets the size threshold, the input patch can be classified as a touch patch (1315). When the input patch fails to meet the size threshold, the touch sensing system can determine, at 1340, whether the state transitioned based on the acquired touch frame from the first state to the second state. In accordance with no state transition, the input patches identified in the acquired touch image can be classified as non-touch patches (1350). In accordance with a state transition, the touch sensing system can cancel a path corresponding to the input patch (1345) and then classify the input patch as a non-touch patch (1350).

In some examples, the processes of FIGS. 10-13 can be used to avoid jitter in wet environments. FIGS. 14A-C illustrate exemplary representations of input patches corresponding to floating water and one or more fingers on a touch-sensitive surface according to examples of the disclosure. FIGS. 14A-C illustrate a touch-sensitive surface 1400 with one or more input patches. In FIG. 14A, input patch 1402 can correspond, for example, to floating water on touch sensitive surface 1400. Input patch 1402 can have a centroid 1404. In FIG. 14B, input patch 1406 can correspond to an object (e.g., a finger indicated in region 1408) and the floating water (indicated in region 1410). Input patch 1406 can have a centroid 1412. When the object lifts off, the water remaining on the touch sensitive surface can return to its previous position and shape (as illustrated in FIG. 14A) or remain on the touch-sensitive surface with a new position and shape, as illustrated by input patch 1414 with centroid 1416 in FIG. 14C. In a conventional touch sensing system, each of input patches 1402, 1406 and 1414 can be detected as touches, but the centroid of the touch can rapidly change at the touchdown condition or the liftoff condition, introducing some jitter into the touch sensing system.

However, using the processes described with reference to FIGS. 10-13, floating water of input patch 1402 can cause the touch sensing system to enter the second state, and in the second state, input patch 1402 can be classified as a non-touch for failing to meet the second signal threshold (i.e., without requiring downstream processing to identify and reject the input patch 1402). Additionally, in the second state, input patch 1414 can also be classified as a non-touch for failing to meet the second threshold. While the finger is down, input patch 1406 can meet the second signal threshold and its centroid can be used for touch input. As a result, the touchdown and liftoff of the finger can be detected and trigger touch input (e.g., corresponding to a tap) without jitter in the position.

Although FIG. 14B illustrates a centroid 1412, which is offset with respect to the true center of the object (indicated in region 1408), in some examples, the further processing of input patch 1406 can improve the centroid detection. For example, a suppression threshold can be applied to input patch 1406 to reduce noise of that may impact centroid computation. In some examples, a signal strength threshold can be applied to suppress weaker touch node contributions (usually near the border of the input patch). In some examples, the suppression can be achieved by weighting touch nodes based on their location in the input patch, such that measurements of touch nodes near the border of the input patch can have less impact on the centroid. The floating water in region 1410, which can be grounded by the finger in region 1408, can have weaker signal levels when compared with the finger (especially moving away from the finger). As a result, the further processing of input patch 1406 including suppression of weaker signal measurements and/or border measurements can improve the centroid to better reflect the centroid of the finger in region 1408.

In some examples, the processes of FIGS. 10-13 can be used to improve detection of liftoff in wet environments. FIG. 15A-C illustrate another exemplary representation of input patches corresponding to floating water and/or one or more fingers on a touch-sensitive surface according to examples of the disclosure. FIGS. 15A-C illustrate a touch-sensitive surface 1500 with one or more input patches. In FIG. 15A, input patch 1502 can correspond, for example, to floating water on touch sensitive surface 1500. In FIG. 15B, input patch 1504 can correspond to an object (e.g., a finger indicated in region 1506) and the floating water (indicated in region 1508). When the object touches down, the floating water may move and come into contact with the object and/or a bezel on an edge of touch-sensitive surface 1500. After liftoff of the object, the floating water can remain on the touch sensitive surface 1500 as indicated by input patch 1510 in FIG. 15C. The floating water of input patch 1510 can be displaced from and/or have a different shape than the floating water of input patch 1502. In particular, input patch 1510 can be contacting the bezel on the edge of touch-sensitive surface 1500, whereas input patch 1502 can be floating and not in contact with the bezel. In a conventional touch sensing system, each of input patches 1502, 1504 and 1510 can be detected as touches, though the floating water of input patch 1502 can be rejected by further processing. However, due to bezel-grounding of the water corresponding to input patch 1510, input patch 1510 can still be processed as a touch patch. As a result, although touchdown of the object (indicated by region 1506 in FIG. 15B) may be detected, the liftoff of the object may not be detected, leading to degraded touch performance.

However, using the processes described with reference to FIGS. 10-13, floating water of input patch 1502 can cause the touch sensing system to enter the second state, and in the second state, input patch 1502 can be classified as a non-touch for failing to meet the second signal threshold (i.e., without requiring downstream processing to identify and reject the input patch 1502). Additionally, in the second state, input patch 1510 can also be classified as a non-touch for failing to meet the second threshold even though it may be grounded by the bezel. While the object is down, input patch 1504 can meet the second signal threshold. As a result, the touchdown and liftoff of the object can be detected and trigger touch input (e.g., corresponding to a tap).

Additionally, in some examples, a small water droplet that falls on a touch-sensitive surface and becomes grounded by the bezel can be falsely detected as a touchdown. When the small water droplet then rolls over the edge and is no longer detected by the touch-sensitive surface, the touch sensing system can falsely detect a liftoff. As a result, the water droplet could be falsely detected as a tap touch input in a conventional touch sensing system. Alternatively, in some examples, a small water droplet along the edge can roll down the edge of the touch-sensitive surface while remaining grounded to the edge can be falsely detected as a swipe gesture input in a conventional touch sensing system. Using the processes of FIGS. 10-13, however, the water droplets can be classified as non-touch patches when they fail to meet the second signal threshold. In some examples, a path classified as a non-touch can still be tracked across multiple frames and ignored without requiring reevaluation of the input patches associated with the path in each touch frame as the water drop moves across the touch-sensitive surface.

In some examples, the processes of FIGS. 10-13 can be used to improve detection of swipe gestures in wet environments. FIGS. 16A-F illustrate another exemplary representation of input patches corresponding to floating water and/or one or more fingers on a touch-sensitive surface according to examples of the disclosure. FIGS. 16A-F illustrate a touch-sensitive surface 1600 with one or more input patches. In FIG. 16A, input patch 1502 can correspond, for example, to water on touch sensitive surface 1600. In FIG. 16B, input patch 1604 can correspond to an object (e.g., a finger indicated in region 1608) and the water (indicated in region 1606). When the object touches down, the floating water may move and come into contact with the object. The object (e.g., a finger) can swipe upward and a trail of water can follow behind it. As illustrated in FIG. 16C, input patch 1610 can correspond to the object (indicated in region 1614) and the trail of water (indicated in region 1612). After liftoff of the object, the water can remain on the touch sensitive surface and eventually return back to the edge of the touch screen as illustrated by input patches 1616, 1618 and 1620 in FIGS. 16D-F. In a conventional touch sensing system, each of input patches 1602, 1604, 1610, 1616, 1618 and 1620 can be detected as touches. As a result, the touch sensing system can view a centroid of the input patches (biased toward the edge by the trail of floating water) swiping up and then swiping back down. As a result, rather than detecting a swipe gesture and performing the corresponding action in response to the detected swipe gesture, the touch sensing system can detect a swipe gesture followed by a reverse swipe gesture, without an intermediate liftoff. As a result, the reverse swipe gesture can cancel the swipe gesture, leading to degraded touch performance.

However, using the processes described with reference to FIGS. 10-13, water of input patch 1602 (or other water on the touch-sensitive surface) can cause the touch sensing system to enter the second state, and in the second state, input patch 1602 can be classified as a non-touch for failing to meet the second signal threshold (i.e., without requiring downstream processing to identify and reject the input patch 1602). Additionally, in the second state, input patch 1604 and 1610 can meet the second threshold and be classified as a touch patches, allowing for the detection of the swipe gesture. Once the object lifts off, input patches 1616, 1618 and 1620 can be classified as non-touch patches for failing to meet the second threshold. As a result, the swipe gesture and liftoff of the object can be detected and trigger touch input (e.g., corresponding to the swipe gesture), without detecting a false reverse swipe gesture.

As described above with respect to FIG. 14B, the further processing of input patches 1504, 1604 and 1614 can include suppression techniques to improve centroid detection. The suppression techniques can weaken or exclude signal measurements corresponding to floating or partially grounded water. As a result, a more accurate centroid can be determined to better detect the intended location of a tap gesture or to better detect a swipe gesture that might otherwise be masked by a trail of water behind the finger.

Although the processes 700 is described herein separately from processes 1000, 1100 and 1300, it should be understood that these processes can be used in combination (e.g., at 515 of process 500) to classify input patches.

Therefore, according to the above, some examples of the disclosure are directed to a method. The method can comprise acquiring a first touch image, processing the first touch image to identify one or more input patches, and determining a state from a first state and a second state based on the first touch image. The method can further comprise, for a respective input patch of the one or more input patches: classifying the respective input patch as a touch patch or a non-touch patch based on the determined state. In the first state, the respective patch can be classified as a touch patch when a first signal parameter associated with the respective input patch meets a first signal threshold and the respective patch can be classified as a non-touch patch when the first signal parameter associated with the respective input patch fails to meet the first signal threshold. In the second state, the respective patch can be classified as a touch patch when the first signal parameter associated with the respective input patch meets a second signal threshold, the second signal threshold greater than the first signal threshold, or when a size parameter of the respective input patch meets a size threshold, and the respective patch can be classified as a non-touch patch when the first signal parameter associated with the respective input patch fails to meet the second signal threshold and the size parameter fails to meet the size threshold. The method can further comprise further processing the first touch image to determine touch input. The further processing can comprise processing respective input patches classified as touch patches and forging processing of respective input patches classified as non-touch patches. Additionally or alternatively, in some examples, determining the state can comprise determining a characteristic of the first touch image. Additionally or alternatively, in some examples, the characteristic can correspond to an area of a touch-sensitive surface contacted by one or more floating objects. Additionally or alternatively, in some examples, determining the characteristic can comprise acquiring a second touch image, the second touch image generated by a stimulation guarded scan, and subtracting the second touch image from the first touch image. Additionally or alternatively, in some examples, determining the state can comprise transitioning from the first state to the second state when the characteristic meets a first characteristic threshold. Additionally or alternatively, in some examples, determining the state can comprise transitioning from the second state to the first state when the characteristic fails to meet a second characteristic threshold for a threshold number of touch images. Additionally or alternatively, in some examples, determining the state can comprise maintaining the state when the characteristic fails to meet a first characteristic threshold, but meets a second characteristic threshold. Additionally or alternatively, in some examples, the method can further comprise, for the respective input patch of the one or more input patches: in accordance with classifying the respective input patch as a non-touch patch, when transitioning from the first state to the second state and when a corresponding respective patch was classified pre-transition as a touch patch, canceling touch input resulting from processing of the corresponding respective patch. Additionally or alternatively, in some examples, the method can further comprise for the respective input patch of the one or more input patches: in accordance with classifying the respective input patch as a touch patch, when transitioning from the second state to the first state and when a corresponding respective patch was classified pre-transition a as non-touch patch, reclassifying the respective input patch as a non-touch patch until liftoff of an object corresponding to the corresponding respective patch or until the respective input patch meets a third signal threshold. Some examples of the disclosure are directed to a non-transitory computer readable storage medium. The non-transitory computer readable storage medium can store instructions, which when executed by one or more processors, can cause the one or more processors to perform any of the above methods. Some examples of the disclosure are directed to an electronic device. The electronic device can comprise a touch-sensitive surface and one or more processors coupled to the touch-sensitive surface. The one or more processors can be capable of performing and/or programmed to perform any of the above methods.

Some examples of the disclosure are directed to a method. The method can comprise acquiring a touch image and identifying one or more input patches based on the touch image. The method can further comprise, for a respective input patch of the one or more input patches: identifying a number of strong edges of the respective input patch. A strong edge can correspond to measurements of one or more sensors of a respective edge of a touch-sensitive surface indicative of grounding of an object corresponding to the respective input patch. The method can further comprise, for the respective input patch of the one or more input patches: in accordance with the identified number of strong edges meeting a first threshold, calculating a confidence value of the respective input patch; in accordance with the confidence value meeting a confidence threshold, forgo processing the respective input patch; and in accordance with the confidence value fail to meet a confidence threshold, processing the respective input patch. Additionally or alternatively, in some examples, the method can further comprise, for the respective input patch of the one or more input patches: in accordance with the identified number of strong edges meeting a second threshold, the second threshold greater than the first threshold, forgo calculating the confidence value of the respective input patch and setting the confidence value of the respective input patch to a value corresponding to a maximum confidence. Additionally or alternatively, in some examples, the method can further comprise, for the respective input patch of the one or more input patches: in accordance with the identified number of strong edges meeting a second threshold, the second threshold greater than the first threshold, increasing the calculated confidence value of the respective input patch. Additionally or alternatively, in some examples, the method can further comprise, for the respective input patch of the one or more input patches: in accordance with the identified number of strong edges failing to meet the first threshold, forgo calculating the confidence value of the respective input patch and setting the confidence value of the respective input patch to a value corresponding to a minimum confidence. Additionally or alternatively, in some examples, the confidence value can be calculated based on a signal density of the respective input patch. Additionally or alternatively, in some examples, the confidence value can be calculated based on an occupancy of the respective input patch. Additionally or alternatively, in some examples, the confidence value can selected from the larger of a normalized signal density of the respective input patch and a normalized occupancy of the respective input patch. Additionally or alternatively, in some examples, the confidence value can calculated based on a history of confidence values calculated from previous touch images. Additionally or alternatively, in some examples, an edge of the respective input patch can be a strong edge when a threshold number of sensors of the respective edge of the touch-sensitive surface meets a threshold signal threshold. Some examples of the disclosure are directed to a non-transitory computer readable storage medium. The non-transitory computer readable storage medium can store instructions, which when executed by one or more processors, can cause the one or more processors to perform any of the above methods. Some examples of the disclosure are directed to an electronic device. The electronic device can comprise a touch-sensitive surface and one or more processors coupled to the touch-sensitive surface. The one or more processors can be capable of performing and/or programmed to perform any of the above methods.

Some examples of the disclosure are directed to a method. The method can comprise acquiring a first touch image, processing the first touch image to identify one or more input patches, and determining a state from a first state and a second state based on an amount of floating water in the first touch image. The method can further comprise, for a respective input patch of the one or more input patches: classifying the respective input patch as a touch patch or a non-touch patch based on the determined state. In the first state the classification can be based on one or more first criteria, and in the second state, the classification can based on one or more second criteria, different than the one or more first criteria. The method can further comprise further processing the first touch image to determine touch input. The further processing can comprise processing respective input patches classified as touch patches and forging processing of respective input patches classified as non-touch patches. Additionally or alternatively, in some examples, determining the amount of floating water can comprise acquiring a second touch image, the second touch image generated by a stimulation guarded scan, and subtracting the second touch image from the first touch image. Additionally or alternatively, in some examples, determining the state can comprise transitioning from the first state to the second state when the amount of floating water meets a first amount of floating water threshold. Additionally or alternatively, in some examples, determining the state can comprise transitioning from the second state to the first state when the amount of floating water fails to meet a second amount of floating water threshold for a threshold number of touch images. Additionally or alternatively, in some examples, determining the state can comprise: maintaining the state when the amount of floating water fails to meet a first amount of floating water threshold, but meets a second amount of floating water threshold. Additionally or alternatively, in some examples, the method can further comprise, for the respective input patch of the one or more input patches: in accordance with classifying the respective input patch as a non-touch patch, when transitioning from the first state to the second state and when a corresponding respective patch was classified pre-transition a as touch patch, canceling touch input resulting from processing of the corresponding respective patch. Additionally or alternatively, in some examples, the method can further comprise, for the respective input patch of the one or more input patches: in accordance with classifying the respective input patch as a touch patch, when transitioning from the second state to the first state and when a corresponding respective patch was classified pre-transition as a non-touch patch, reclassifying the respective input patch as a non-touch patch until liftoff of an object corresponding to the corresponding respective patch or until the respective input patch meets a third signal threshold. Some examples of the disclosure are directed to a non-transitory computer readable storage medium. The non-transitory computer readable storage medium can store instructions, which when executed by one or more processors, can cause the one or more processors to perform any of the above methods. Some examples of the disclosure are directed to an electronic device. The electronic device can comprise a touch-sensitive surface and one or more processors coupled to the touch-sensitive surface. The one or more processors can be capable of performing and/or programmed to perform any of the above methods.

Some examples of the disclosure are directed to a method. The method can comprise acquiring a touch image including measurements from a plurality of touch nodes of a touch-sensitive surface and identifying one or more input patches based on the touch image. The one or more input patches can include touch nodes measurements meeting a first signal threshold. The method can further comprise, for a respective input patch of the one or more input patches: estimating a number of respective edges of the touch-sensitive surface included in the respective input patch that meet one or more edge criteria. The one or more edge criteria can comprises a threshold number of touch node measurements from touch nodes within a threshold distance of the respective edge of the touch-sensitive surface meeting a second signal threshold, the second signal threshold greater than the first signal threshold. he method can further comprise, for a respective input patch of the one or more input patches: in accordance with the estimated number of respective edges meeting a first threshold, calculating a confidence value of the respective input patch; in accordance with the confidence value meeting a confidence threshold, forgo processing the respective input patch; and in accordance with the confidence value failing to meet a confidence threshold, processing the respective input patch. Additionally or alternatively, in some examples, the threshold distance can include only touch nodes around a perimeter of the touch-sensitive surface. Additionally or alternatively, in some examples, the threshold number of touch nodes measurements can be one touch node measurement for the respective edge. Additionally or alternatively, in some examples, the one or more edge criteria can further comprise the threshold number of touch node measurements are from consecutive touch nodes. Some examples of the disclosure are directed to a non-transitory computer readable storage medium. The non-transitory computer readable storage medium can store instructions, which when executed by one or more processors, can cause the one or more processors to perform any of the above methods. Some examples of the disclosure are directed to an electronic device. The electronic device can comprise a touch-sensitive surface and one or more processors coupled to the touch-sensitive surface. The one or more processors can be capable of performing and/or programmed to perform any of the above methods.

Although examples of this disclosure have been fully described with reference to the accompanying drawings, it is to be noted that various changes and modifications will become apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of examples of this disclosure as defined by the appended claims.

Claims

1. An electronic device comprising: a touch-sensitive surface; andone or more processors coupled to the touch-sensitive surface programmed to: acquire a first touch image;process the first touch image to identify one or more input patches;determine a state from a first state and a second state based on an amount of floating water in the first touch image;for a respective input patch of the one or more input patches identified in the first touch image, classify the respective input patch as a touch patch or a non-touch patch based on the state determined based on the amount of floating water in the first touch image, wherein in the first state the classification is based on one or more first criteria, and in the second state, the classification is based on one or more second criteria, different than the one or more first criteria; andfurther process the first touch image to determine touch input, wherein the further processing comprises processing respective input patches classified as touch patches and forgoing processing of respective input patches classified as non-touch patches.
2. The electronic device of claim 1, wherein determining the amount of floating water comprises: acquiring a second touch image, the second touch image generated by a stimulation guarded scan; andsubtracting the second touch image from the first touch image.
3. The electronic device of claim 1, wherein determining the state comprises: transitioning from the first state to the second state when the amount of floating water meets a first amount of floating water threshold.
4. The electronic device of claim 1, wherein determining the state comprises: transitioning from the second state to the first state when the amount of floating water fails to meet a second amount of floating water threshold for a threshold number of touch images.
5. The electronic device of claim 1, wherein determining the state comprises: maintaining the state when the amount of floating water fails to meet a first amount of floating water threshold, but meets a second amount of floating water threshold.
6. The electronic device of claim 1, the one or more processors further programmed to: for the respective input patch of the one or more input patches: in accordance with classifying the respective input patch as a non-touch patch, when transitioning from the first state to the second state and when a corresponding respective patch was classified pre-transition a as touch patch, cancel touch input resulting from processing of the corresponding respective patch.
7. The electronic device of claim 1, the one or more processors further programmed to: for the respective input patch of the one or more input patches: in accordance with classifying the respective input patch as a touch patch, when transitioning from the second state to the first state and when a corresponding respective patch was classified pre-transition as a non-touch patch, reclassify the respective input patch as a non-touch patch until liftoff of an object corresponding to the corresponding respective patch or until the respective input patch meets a third signal threshold.
8. A method comprising: acquiring a first touch image;processing the first touch image to identify one or more input patches;determining a state from a first state and a second state based on an amount of floating water in the first touch image;for a respective input patch of the one or more input patches identified in the first touch image, classifying the respective input patch as a touch patch or a non-touch patch based on the state determined based on the amount of floating water in the first touch image, wherein in the first state the classification is based on one or more first criteria, and in the second state, the classification is based on one or more second criteria, different than the one or more first criteria; andfurther processing the first touch image to determine touch input, wherein the further processing comprises processing respective input patches classified as touch patches and forgoing processing of respective input patches classified as non-touch patches.
9. The method of claim 8, wherein determining the amount of floating water comprises: acquiring a second touch image, the second touch image generated by a stimulation guarded scan; andsubtracting the second touch image from the first touch image.
10. The method of claim 8, wherein determining the state comprises: transitioning from the first state to the second state when the amount of floating water meets a first amount of floating water threshold;transitioning from the second state to the first state when the amount of floating water fails to meet a second amount of floating water threshold for a threshold number of touch images; andmaintaining the state when the amount of floating water fails to meet the first amount of floating water threshold, but meets the second amount of floating water threshold.
11. The method of claim 8, further comprising: for the respective input patch of the one or more input patches: in accordance with classifying the respective input patch as a non-touch patch, when transitioning from the first state to the second state and when a corresponding respective patch was classified pre-transition a as touch patch, canceling touch input resulting from processing of the corresponding respective patch.
12. The method of claim 8, further comprising: for the respective input patch of the one or more input patches: in accordance with classifying the respective input patch as a touch patch, when transitioning from the second state to the first state and when a corresponding respective patch was classified pre-transition as a non-touch patch, reclassifying the respective input patch as a non-touch patch until liftoff of an object corresponding to the corresponding respective patch or until the respective input patch meets a third signal threshold.
13. A non-transitory computer readable storage medium storing instructions, which when executed by one or more processors, cause the one or more processors to perform a method, the method comprising: acquiring a first touch image;processing the first touch image to identify one or more input patches;determining a state from a first state and a second state based on the first touch image;for a respective input patch of the one or more input patches identified in the first touch image: classifying the respective input patch as a touch patch or a non-touch patch based on the state determined based on the amount of floating water in the first touch image, wherein: in the first state, the respective patch is classified as a touch patch when a first signal parameter associated with the respective input patch meets a first signal threshold and the respective patch is classified as a non-touch patch when the first signal parameter associated with the respective input patch fails to meet the first signal threshold; andin the second state, the respective patch is classified as a touch patch when the first signal parameter associated with the respective input patch meets a second signal threshold, the second signal threshold greater than the first signal threshold, or when a size parameter of the respective input patch meets a size threshold, and the respective patch is classified as a non-touch patch when the first signal parameter associated with the respective input patch fails to meet the second signal threshold and the size parameter fails to meet the size threshold; andfurther processing the first touch image to determine touch input, wherein the further processing comprises processing respective input patches classified as touch patches and forgoing processing of respective input patches classified as non-touch patches.
14. The non-transitory computer readable storage medium of claim 13, wherein determining the state comprises: determining a characteristic of the first touch image.
15. The non-transitory computer readable storage medium of claim 14, wherein the characteristic corresponds to an area of a touch-sensitive surface contacted by one or more floating objects.
16. The non-transitory computer readable storage medium of claim 14, wherein determining the characteristic comprises: acquiring a second touch image, the second touch image generated by a stimulation guarded scan; andsubtracting the second touch image from the first touch image.
17. The non-transitory computer readable storage medium of claim 14, wherein determining the state comprises: transitioning from the first state to the second state when the characteristic meets a first characteristic threshold.
18. The non-transitory computer readable storage medium of claim 14, wherein determining the state comprises: transitioning from the second state to the first state when the characteristic fails to meet a second characteristic threshold for a threshold number of touch images.
19. The non-transitory computer readable storage medium of claim 13, the method further comprising: for the respective input patch of the one or more input patches: in accordance with classifying the respective input patch as a non-touch patch, when transitioning from the first state to the second state and when a corresponding respective patch was classified pre-transition as a touch patch, canceling touch input resulting from processing of the corresponding respective patch.
20. The non-transitory computer readable storage medium of claim 13, the method further comprising: for the respective input patch of the one or more input patches: in accordance with classifying the respective input patch as a touch patch, when transitioning from the second state to the first state and when a corresponding respective patch was classified pre-transition a as non-touch patch, reclassifying the respective input patch as a non-touch patch until liftoff of an object corresponding to the corresponding respective patch or until the respective input patch meets a third signal threshold.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims benefit of U.S. Provisional Patent Application No. 62/488,014, filed Apr. 20, 2017, which is hereby incorporated by reference in its entirety.

US Referenced Citations (529)

Number	Name	Date	Kind
4087625	Dym et al.	May 1978	A
4090092	Serrano	May 1978	A
4304976	Gottbreht et al.	Dec 1981	A
4475235	Graham	Oct 1984	A
4550221	Mabusth	Oct 1985	A
4659874	Landmeier	Apr 1987	A
5194862	Edwards	Mar 1993	A
5317919	Awtrey	Jun 1994	A
5459463	Gruaz et al.	Oct 1995	A
5483261	Yasutake	Jan 1996	A
5488204	Mead et al.	Jan 1996	A
5543590	Gillespie et al.	Aug 1996	A
5631670	Tomiyoshi et al.	May 1997	A
5825352	Bisset et al.	Oct 1998	A
5835079	Shieh	Nov 1998	A
5841078	Miller et al.	Nov 1998	A
5844506	Binstead	Dec 1998	A
5847690	Boie et al.	Dec 1998	A
5880411	Gillespie et al.	Mar 1999	A
5889236	Gillespie et al.	Mar 1999	A
5914465	Allen et al.	Jun 1999	A
6057903	Colgan et al.	May 2000	A
6137427	Binstead	Oct 2000	A
6163313	Aroyan et al.	Dec 2000	A
6188391	Seely et al.	Feb 2001	B1
6204897	Colgan et al.	Mar 2001	B1
6239788	Nohno et al.	May 2001	B1
6310610	Beaton et al.	Oct 2001	B1
6323846	Westerman et al.	Nov 2001	B1
6329044	Inoue et al.	Dec 2001	B1
6452514	Philipp	Sep 2002	B1
6456952	Nathan	Sep 2002	B1
6587358	Yasumura	Jul 2003	B1
6690387	Zimmerman et al.	Feb 2004	B2
6730863	Gerpheide et al.	May 2004	B1
6847354	Vranish	Jan 2005	B2
6970160	Mulligan et al.	Nov 2005	B2
7015894	Morohoshi	Mar 2006	B2
7030860	Hsu et al.	Apr 2006	B1
7129935	Mackey	Oct 2006	B2
7138686	Banerjee et al.	Nov 2006	B1
7180508	Kent et al.	Feb 2007	B2
7184064	Zimmerman et al.	Feb 2007	B2
7337085	Soss	Feb 2008	B2
7395717	DeAngelis et al.	Jul 2008	B2
7412586	Rajopadhye et al.	Aug 2008	B1
7504833	Seguine	Mar 2009	B1
7538760	Hotelling et al.	May 2009	B2
7548073	Mackey et al.	Jun 2009	B2
7580030	Marten	Aug 2009	B2
7639234	Orsley	Dec 2009	B2
7663607	Hotelling et al.	Feb 2010	B2
7719523	Hillis	May 2010	B2
7701539	Shih et al.	Aug 2010	B2
7864503	Chang	Jan 2011	B2
7898122	Andrieux et al.	Mar 2011	B2
7907126	Yoon et al.	Mar 2011	B2
7932898	Philipp et al.	Apr 2011	B2
8026904	Westerman	Sep 2011	B2
8040321	Peng et al.	Oct 2011	B2
8040326	Hotelling et al.	Oct 2011	B2
8045783	Lee et al.	Oct 2011	B2
8058884	Betancourt	Nov 2011	B2
8068097	GuangHai	Nov 2011	B2
8120371	Day et al.	Feb 2012	B2
8125312	Orr	Feb 2012	B2
8169421	Wright et al.	May 2012	B2
8223133	Hristov	Jul 2012	B2
8258986	Makovetskyy	Sep 2012	B2
8259078	Hotelling et al.	Sep 2012	B2
8283935	Liu et al.	Oct 2012	B2
8319747	Hotelling et al.	Nov 2012	B2
8339286	Cordeiro	Dec 2012	B2
8355887	Harding et al.	Jan 2013	B1
8441464	Lin et al.	May 2013	B1
8479122	Hotelling et al.	Jul 2013	B2
8484838	Badaye et al.	Jul 2013	B2
8487898	Hotelling	Jul 2013	B2
8507811	Hotelling et al.	Aug 2013	B2
8508495	Hotelling et al.	Aug 2013	B2
8537126	Yousefpor et al.	Sep 2013	B2
8542208	Krah et al.	Sep 2013	B2
8576193	Hotelling	Nov 2013	B2
8593410	Hong et al.	Nov 2013	B2
8593425	Hong et al.	Nov 2013	B2
8614688	Chang	Dec 2013	B2
8633915	Hotelling et al.	Jan 2014	B2
8665237	Koshiyama et al.	Mar 2014	B2
8680877	Lee et al.	Mar 2014	B2
8760412	Hotelling et al.	Jun 2014	B2
8766950	Morein et al.	Jul 2014	B1
8773146	Hills et al.	Jul 2014	B1
8773351	Rekimoto	Jul 2014	B2
8810543	Kurikawa	Aug 2014	B1
8884917	Seo	Nov 2014	B2
8902172	Peng et al.	Dec 2014	B2
8917256	Roziere	Dec 2014	B2
8922521	Hotelling et al.	Dec 2014	B2
8957874	Elias	Feb 2015	B2
8976133	Yao et al.	Mar 2015	B2
8982096	Hong et al.	Mar 2015	B2
8982097	Kuzo	Mar 2015	B1
9000782	Roziere	Apr 2015	B2
9001082	Rosenberg et al.	Apr 2015	B1
9035895	Bussat et al.	May 2015	B2
9075463	Pyo et al.	Jul 2015	B2
9086774	Hotelling et al.	Jul 2015	B2
9151791	Roziere	Oct 2015	B2
9189119	Liao	Nov 2015	B2
9250757	Roziere	Feb 2016	B2
9261997	Chang et al.	Feb 2016	B2
9280251	Shih	Mar 2016	B2
9292137	Kogo	Mar 2016	B2
9317165	Hotelling et al.	Apr 2016	B2
9329674	Lee et al.	May 2016	B2
9329723	Benbasat et al.	May 2016	B2
9372576	Westerman	Jun 2016	B2
9442330	Huo	Sep 2016	B2
9535547	Roziere	Jan 2017	B2
9582131	Elias	Feb 2017	B2
9640991	Blondin et al.	May 2017	B2
9690397	Shepelev et al.	Jun 2017	B2
9785295	Yang	Oct 2017	B2
9804717	Schropp, Jr.	Oct 2017	B2
9874975	Benbasat et al.	Jan 2018	B2
9880655	O'Connor	Jan 2018	B2
9886141	Yousefpor	Feb 2018	B2
9904427	Co	Feb 2018	B1
9996175	Hotelling et al.	Jun 2018	B2
10001888	Hong et al.	Jun 2018	B2
10061433	Imai	Aug 2018	B2
10175832	Roziere	Jan 2019	B2
10289251	Shih et al.	May 2019	B2
10365764	Korapati	Jul 2019	B2
20020015024	Westerman et al.	Feb 2002	A1
20020152048	Hayes	Oct 2002	A1
20030075427	Caldwell	Apr 2003	A1
20030076325	Thrasher	Apr 2003	A1
20030164820	Kent	Sep 2003	A1
20030210235	Roberts	Nov 2003	A1
20040017362	Mulligan et al.	Jan 2004	A1
20040061687	Kent et al.	Apr 2004	A1
20040090429	Geaghan et al.	May 2004	A1
20040119701	Mulligan et al.	Jun 2004	A1
20040188151	Gerpheide et al.	Sep 2004	A1
20040239650	Mackey	Dec 2004	A1
20040243747	Rekimoto	Dec 2004	A1
20050007353	Smith et al.	Jan 2005	A1
20050012724	Kent	Jan 2005	A1
20050069718	Voss-Kehl et al.	Mar 2005	A1
20050073507	Richter et al.	Apr 2005	A1
20050083307	Aufderheide et al.	Apr 2005	A1
20050104867	Westerman et al.	May 2005	A1
20050126831	Richter et al.	Jun 2005	A1
20050146509	Geaghan et al.	Jul 2005	A1
20050219228	Alameh et al.	Oct 2005	A1
20050239532	Inamura	Oct 2005	A1
20050270039	Mackey	Dec 2005	A1
20050270273	Marten	Dec 2005	A1
20050280639	Taylor et al.	Dec 2005	A1
20060001640	Lee	Jan 2006	A1
20060017710	Lee et al.	Jan 2006	A1
20060026521	Hotelling et al.	Feb 2006	A1
20060038791	Mackey	Feb 2006	A1
20060097991	Hotelling et al.	May 2006	A1
20060132463	Lee et al.	Jun 2006	A1
20060146484	Kim et al.	Jul 2006	A1
20060161871	Hotelling et al.	Jul 2006	A1
20060197753	Hotelling	Sep 2006	A1
20060202969	Hauck	Sep 2006	A1
20060227115	Fry	Oct 2006	A1
20060238522	Westerman et al.	Oct 2006	A1
20060267953	Peterson et al.	Nov 2006	A1
20060278444	Binstead	Dec 2006	A1
20060279548	Geaghan	Dec 2006	A1
20060293864	Soss	Dec 2006	A1
20070008299	Hristov	Jan 2007	A1
20070012665	Nelson et al.	Jan 2007	A1
20070023523	Onishi	Feb 2007	A1
20070074914	Geaghan et al.	Apr 2007	A1
20070075982	Morrison et al.	Apr 2007	A1
20070216637	Ito	Sep 2007	A1
20070216657	Konicek	Sep 2007	A1
20070229468	Peng et al.	Oct 2007	A1
20070229470	Snyder et al.	Oct 2007	A1
20070247443	Philipp	Oct 2007	A1
20070262963	Xiao-Ping et al.	Nov 2007	A1
20070262969	Pak	Nov 2007	A1
20070268273	Westerman et al.	Nov 2007	A1
20070268275	Westerman et al.	Nov 2007	A1
20070279395	Philipp	Dec 2007	A1
20070279619	Chang	Dec 2007	A1
20070283832	Hotelling	Dec 2007	A1
20070285365	Lee	Dec 2007	A1
20070296709	Guanghai	Dec 2007	A1
20080006454	Hotelling	Jan 2008	A1
20080007533	Hotelling	Jan 2008	A1
20080012835	Rimon et al.	Jan 2008	A1
20080018581	Park et al.	Jan 2008	A1
20080024456	Peng et al.	Jan 2008	A1
20080036742	Garmon	Feb 2008	A1
20080042985	Katsuhito et al.	Feb 2008	A1
20080042986	Westerman et al.	Feb 2008	A1
20080042987	Westerman et al.	Feb 2008	A1
20080042992	Kim	Feb 2008	A1
20080047764	Lee et al.	Feb 2008	A1
20080062140	Hotelling et al.	Mar 2008	A1
20080062148	Hotelling et al.	Mar 2008	A1
20080062151	Kent	Mar 2008	A1
20080074398	Wright	Mar 2008	A1
20080100572	Boillot	May 2008	A1
20080136787	Yeh et al.	Jun 2008	A1
20080136792	Peng et al.	Jun 2008	A1
20080158145	Westerman	Jul 2008	A1
20080158146	Westerman	Jul 2008	A1
20080158167	Hotelling et al.	Jul 2008	A1
20080158172	Hotelling et al.	Jul 2008	A1
20080158174	Land et al.	Jul 2008	A1
20080158181	Hamblin et al.	Jul 2008	A1
20080158182	Westerman	Jul 2008	A1
20080158185	Westerman	Jul 2008	A1
20080162996	Krah et al.	Jul 2008	A1
20080174321	Kang et al.	Jul 2008	A1
20080180365	Ozaki	Jul 2008	A1
20080188267	Sagong	Aug 2008	A1
20080224962	Kasai et al.	Sep 2008	A1
20080231292	Ossart et al.	Sep 2008	A1
20080238871	Tam	Oct 2008	A1
20080246496	Hristov et al.	Oct 2008	A1
20080264699	Chang et al.	Oct 2008	A1
20080277259	Chang	Nov 2008	A1
20080283175	Hagood et al.	Nov 2008	A1
20080303022	Tai et al.	Dec 2008	A1
20080303964	Lee et al.	Dec 2008	A1
20080309626	Westerman et al.	Dec 2008	A1
20080309627	Hotelling et al.	Dec 2008	A1
20080309629	Westerman et al.	Dec 2008	A1
20080309632	Westerman et al.	Dec 2008	A1
20080309633	Hotelling et al.	Dec 2008	A1
20080309635	Matsuo	Dec 2008	A1
20090002337	Chang	Jan 2009	A1
20090009485	Bytheway	Jan 2009	A1
20090019344	Yoon et al.	Jan 2009	A1
20090020343	Rothkopf et al.	Jan 2009	A1
20090054107	Feland, III et al.	Feb 2009	A1
20090070681	Dawes et al.	Mar 2009	A1
20090073138	Lee et al.	Mar 2009	A1
20090085894	Gandhi et al.	Apr 2009	A1
20090091546	Joo et al.	Apr 2009	A1
20090091551	Hotelling et al.	Apr 2009	A1
20090109192	Liu et al.	Apr 2009	A1
20090114456	Wisniewski	May 2009	A1
20090128516	Rimon et al.	May 2009	A1
20090135157	Harley	May 2009	A1
20090141046	Rathnam et al.	Jun 2009	A1
20090160787	Westerman et al.	Jun 2009	A1
20090174676	Westerman	Jul 2009	A1
20090174688	Westerman	Jul 2009	A1
20090179868	Ayres et al.	Jul 2009	A1
20090182189	Lira	Jul 2009	A1
20090184937	Grivna	Jul 2009	A1
20090194344	Harley et al.	Aug 2009	A1
20090205879	Halsey, IV et al.	Aug 2009	A1
20090212642	Krah	Aug 2009	A1
20090213090	Mamba et al.	Aug 2009	A1
20090236151	Yeh et al.	Sep 2009	A1
20090242283	Chiu	Oct 2009	A1
20090251427	Hung et al.	Oct 2009	A1
20090267902	Nambu et al.	Oct 2009	A1
20090267903	Cady et al.	Oct 2009	A1
20090273577	Chen et al.	Nov 2009	A1
20090277695	Liu et al.	Nov 2009	A1
20090303189	Grunthaner et al.	Dec 2009	A1
20090309850	Yang	Dec 2009	A1
20090309851	Bernstein	Dec 2009	A1
20090314621	Hotelling	Dec 2009	A1
20090315854	Matsuo	Dec 2009	A1
20090322702	Chien et al.	Dec 2009	A1
20100001973	Hotelling et al.	Jan 2010	A1
20100004029	Kim	Jan 2010	A1
20100006350	Elias	Jan 2010	A1
20100007616	Jang	Jan 2010	A1
20100019779	Kato et al.	Jan 2010	A1
20100031174	Kim	Feb 2010	A1
20100039396	Ho et al.	Feb 2010	A1
20100059294	Elias et al.	Mar 2010	A1
20100060608	Yousefpor	Mar 2010	A1
20100079384	Grivna	Apr 2010	A1
20100079401	Staton	Apr 2010	A1
20100090964	Soo et al.	Apr 2010	A1
20100097346	Sleeman	Apr 2010	A1
20100102027	Liu et al.	Apr 2010	A1
20100110035	Selker	May 2010	A1
20100117985	Wadia	May 2010	A1
20100123667	Kim et al.	May 2010	A1
20100139991	Philipp et al.	Jun 2010	A1
20100143848	Jain et al.	Jun 2010	A1
20100149108	Hotelling et al.	Jun 2010	A1
20100149127	Fisher et al.	Jun 2010	A1
20100156810	Barbier et al.	Jun 2010	A1
20100156846	Long et al.	Jun 2010	A1
20100182018	Hazelden	Jul 2010	A1
20100182278	Li	Jul 2010	A1
20100194695	Hotelling et al.	Aug 2010	A1
20100194696	Chang et al.	Aug 2010	A1
20100194697	Hotelling	Aug 2010	A1
20100194698	Hotelling et al.	Aug 2010	A1
20100194707	Hotelling et al.	Aug 2010	A1
20100201635	Klinghult et al.	Aug 2010	A1
20100245286	Parker	Sep 2010	A1
20100253638	Yousefpor et al.	Oct 2010	A1
20100277418	Huang et al.	Nov 2010	A1
20100328228	Elias	Dec 2010	A1
20100328248	Mozdzyn	Dec 2010	A1
20100328262	Huang et al.	Dec 2010	A1
20100328263	Lin	Dec 2010	A1
20110001491	Huang et al.	Jan 2011	A1
20110006832	Land et al.	Jan 2011	A1
20110007020	Hong et al.	Jan 2011	A1
20110007021	Bernstein et al.	Jan 2011	A1
20110007030	Mo et al.	Jan 2011	A1
20110025623	Lin	Feb 2011	A1
20110025629	Grivna et al.	Feb 2011	A1
20110025635	Lee	Feb 2011	A1
20110061949	Krah et al.	Mar 2011	A1
20110074705	Yousefpor et al.	Mar 2011	A1
20110080391	Brown et al.	Apr 2011	A1
20110096016	Yilmaz	Apr 2011	A1
20110134050	Harley	Jun 2011	A1
20110157068	Parker	Jun 2011	A1
20110175846	Wang et al.	Jul 2011	A1
20110199105	Otagaki et al.	Aug 2011	A1
20110227874	Faahraeus et al.	Sep 2011	A1
20110231139	Yokota	Sep 2011	A1
20110234523	Chang et al.	Sep 2011	A1
20110241907	Cordeiro	Oct 2011	A1
20110248949	Chang et al.	Oct 2011	A1
20110254795	Chen	Oct 2011	A1
20110261005	Joharapurkar et al.	Oct 2011	A1
20110261007	Joharapurkar et al.	Oct 2011	A1
20110282606	Ahed et al.	Nov 2011	A1
20110298727	Yousefpor et al.	Dec 2011	A1
20110310033	Liu et al.	Dec 2011	A1
20110310064	Keski-Jaskari et al.	Dec 2011	A1
20120026099	Harley	Feb 2012	A1
20120044199	Karpin et al.	Feb 2012	A1
20120050206	Welland	Mar 2012	A1
20120050214	Kremin	Mar 2012	A1
20120050216	Kremin et al.	Mar 2012	A1
20120054379	Leung et al.	Mar 2012	A1
20120056662	Wilson et al.	Mar 2012	A1
20120056851	Chen et al.	Mar 2012	A1
20120075239	Azumi	Mar 2012	A1
20120092288	Wadia	Apr 2012	A1
20120098776	Chen	Apr 2012	A1
20120113047	Hanauer et al.	May 2012	A1
20120146726	Huang	Jun 2012	A1
20120146920	Lin et al.	Jun 2012	A1
20120146942	Kamoshida et al.	Jun 2012	A1
20120154324	Wright et al.	Jun 2012	A1
20120162121	Chang et al.	Jun 2012	A1
20120162133	Chen	Jun 2012	A1
20120162134	Chen	Jun 2012	A1
20120169652	Chang	Jul 2012	A1
20120169653	Chang	Jul 2012	A1
20120169655	Chang	Jul 2012	A1
20120169656	Chang	Jul 2012	A1
20120169664	Milne	Jul 2012	A1
20120182251	Krah	Jul 2012	A1
20120187965	Roziere	Jul 2012	A1
20120211264	Milne	Aug 2012	A1
20120249446	Chen et al.	Oct 2012	A1
20120262395	Chan	Oct 2012	A1
20120262410	Lim	Oct 2012	A1
20120287068	Colgate et al.	Nov 2012	A1
20120313881	Ge et al.	Dec 2012	A1
20120320385	Mu et al.	Dec 2012	A1
20130015868	Peng	Jan 2013	A1
20130021291	Kremin et al.	Jan 2013	A1
20130027118	Ho et al.	Jan 2013	A1
20130027346	Yarosh et al.	Jan 2013	A1
20130038573	Chang	Feb 2013	A1
20130057511	Shepelev et al.	Mar 2013	A1
20130069911	You	Mar 2013	A1
20130076648	Krah et al.	Mar 2013	A1
20130093712	Liu et al.	Apr 2013	A1
20130100038	Yilmaz et al.	Apr 2013	A1
20130100071	Wright	Apr 2013	A1
20130120303	Hong et al.	May 2013	A1
20130127739	Guard et al.	May 2013	A1
20130141383	Woolley	Jun 2013	A1
20130154996	Trend et al.	Jun 2013	A1
20130173211	Hoch et al.	Jul 2013	A1
20130176271	Sobel et al.	Jul 2013	A1
20130176273	Li et al.	Jul 2013	A1
20130215049	Lee	Aug 2013	A1
20130224370	Cok et al.	Aug 2013	A1
20130234964	Kim et al.	Sep 2013	A1
20130257785	Brown et al.	Oct 2013	A1
20130257797	Wu et al.	Oct 2013	A1
20130257798	Tamura et al.	Oct 2013	A1
20130265276	Obeidat et al.	Oct 2013	A1
20130271427	Benbasat et al.	Oct 2013	A1
20130278447	Kremin	Oct 2013	A1
20130278498	Jung et al.	Oct 2013	A1
20130278525	Lim et al.	Oct 2013	A1
20130278543	Hsu	Oct 2013	A1
20130307821	Kogo	Nov 2013	A1
20130314342	Kim	Nov 2013	A1
20130320994	Brittain	Dec 2013	A1
20130321289	Dubery et al.	Dec 2013	A1
20130328759	Al-Dahle et al.	Dec 2013	A1
20130342479	Pyo et al.	Dec 2013	A1
20140002406	Cormier et al.	Jan 2014	A1
20140009438	Liu et al.	Jan 2014	A1
20140022186	Hong et al.	Jan 2014	A1
20140022201	Boychuk	Jan 2014	A1
20140043546	Yamazaki et al.	Feb 2014	A1
20140070823	Roziere	Mar 2014	A1
20140071084	Sugiura	Mar 2014	A1
20140078096	Tan et al.	Mar 2014	A1
20140098051	Hong et al.	Apr 2014	A1
20140104194	Davidson et al.	Apr 2014	A1
20140104225	Davidson	Apr 2014	A1
20140104228	Chen et al.	Apr 2014	A1
20140111707	Song et al.	Apr 2014	A1
20140118270	Moses	May 2014	A1
20140125628	Yoshida et al.	May 2014	A1
20140132534	Kim	May 2014	A1
20140132560	Huang et al.	May 2014	A1
20140132860	Hotelling et al.	May 2014	A1
20140145997	Tiruvuru	May 2014	A1
20140152615	Chang et al.	Jun 2014	A1
20140160058	Chen et al.	Jun 2014	A1
20140160376	Wang et al.	Jun 2014	A1
20140168540	Wang et al.	Jun 2014	A1
20140192027	Ksondzyk et al.	Jul 2014	A1
20140204043	Lin et al.	Jul 2014	A1
20140204058	Huang et al.	Jul 2014	A1
20140210779	Katsuta et al.	Jul 2014	A1
20140232955	Roudbari et al.	Aug 2014	A1
20140240291	Nam	Aug 2014	A1
20140247245	Lee	Sep 2014	A1
20140253470	Havilio	Sep 2014	A1
20140267070	Shahparnia et al.	Sep 2014	A1
20140267128	Bulea et al.	Sep 2014	A1
20140267146	Chang et al.	Sep 2014	A1
20140267165	Roziere	Sep 2014	A1
20140285469	Wright et al.	Sep 2014	A1
20140306924	Lin	Oct 2014	A1
20140347574	Tung et al.	Nov 2014	A1
20140354301	Trend	Dec 2014	A1
20140362030	Mo et al.	Dec 2014	A1
20140362034	Mo et al.	Dec 2014	A1
20140368436	Abzarian et al.	Dec 2014	A1
20140368460	Mo et al.	Dec 2014	A1
20140375598	Shen et al.	Dec 2014	A1
20140375603	Hotelling et al.	Dec 2014	A1
20140375903	Westhues et al.	Dec 2014	A1
20150002176	Kwon et al.	Jan 2015	A1
20150002448	Brunet et al.	Jan 2015	A1
20150002464	Nishioka et al.	Jan 2015	A1
20150009421	Choi	Jan 2015	A1
20150015528	Vandermeijden	Jan 2015	A1
20150026398	Kim	Jan 2015	A1
20150042600	Lukanc et al.	Feb 2015	A1
20150042607	Takanohashi	Feb 2015	A1
20150049043	Yousefpor	Feb 2015	A1
20150049044	Yousefpor	Feb 2015	A1
20150077375	Hotelling et al.	Mar 2015	A1
20150091587	Shepelev et al.	Apr 2015	A1
20150091849	Ludden	Apr 2015	A1
20150103047	Hanauer et al.	Apr 2015	A1
20150116263	Kim	Apr 2015	A1
20150123939	Kim et al.	May 2015	A1
20150227240	Hong et al.	Aug 2015	A1
20150242028	Roberts et al.	Aug 2015	A1
20150248177	Maharyta	Sep 2015	A1
20150253907	Elias	Sep 2015	A1
20150268789	Liao et al.	Sep 2015	A1
20150268795	Kurasawa et al.	Sep 2015	A1
20150309610	Rabii et al.	Oct 2015	A1
20150324035	Yuan	Nov 2015	A1
20150338937	Shepelev et al.	Nov 2015	A1
20150370387	Yamaguchi et al.	Dec 2015	A1
20150378465	Shih et al.	Dec 2015	A1
20160011702	Shih	Jan 2016	A1
20160018348	Yau et al.	Jan 2016	A1
20160022218	Hayes et al.	Jan 2016	A1
20160034102	Roziere et al.	Feb 2016	A1
20160041629	Rao	Feb 2016	A1
20160048234	Chandran et al.	Feb 2016	A1
20160062533	O'Connor	Mar 2016	A1
20160077667	Chiang	Mar 2016	A1
20160139728	Jeon et al.	May 2016	A1
20160154505	Chang	Jun 2016	A1
20160154529	Westerman	Jun 2016	A1
20160170533	Roziere	Jun 2016	A1
20160195954	Wang et al.	Jul 2016	A1
20160216808	Hotelling et al.	Jul 2016	A1
20160224177	Krah	Aug 2016	A1
20160224189	Yousefpor et al.	Aug 2016	A1
20160246423	Fu	Aug 2016	A1
20160253041	Park	Sep 2016	A1
20160259448	Guarneri	Sep 2016	A1
20160266676	Wang et al.	Sep 2016	A1
20160266679	Shahparnia et al.	Sep 2016	A1
20160282980	Chintalapoodi	Sep 2016	A1
20160283023	Shin et al.	Sep 2016	A1
20160299603	Tsujioka et al.	Oct 2016	A1
20160357344	Benbasat et al.	Dec 2016	A1
20170060318	Gu et al.	Mar 2017	A1
20170090619	Yousefpor	Mar 2017	A1
20170090622	Badaye et al.	Mar 2017	A1
20170097703	Lee	Apr 2017	A1
20170108968	Roziere	Apr 2017	A1
20170139539	Yao et al.	May 2017	A1
20170168626	Konicek	Jun 2017	A1
20170220156	Blondin et al.	Aug 2017	A1
20170229502	Liu	Aug 2017	A1
20170269729	Chintalapoodi	Sep 2017	A1
20170285804	Yingxuan et al.	Oct 2017	A1
20170315646	Roziere	Nov 2017	A1
20170357371	Kim	Dec 2017	A1
20180067584	Zhu et al.	Mar 2018	A1
20180275824	Li et al.	Sep 2018	A1
20180307375	Shah et al.	Oct 2018	A1
20190034032	Westerman	Jan 2019	A1
20190138152	Yousefpor et al.	May 2019	A1

Foreign Referenced Citations (165)

Number	Date	Country
1202254	Dec 1998	CN
1246638	Mar 2000	CN
1527274	Sep 2004	CN
1672119	Sep 2005	CN
1689677	Nov 2005	CN
1711520	Dec 2005	CN
1782837	Jun 2006	CN
1818842	Aug 2006	CN
1864124	Nov 2006	CN
1945516	Apr 2007	CN
101046720	Oct 2007	CN
101071354	Nov 2007	CN
101419516	Apr 2009	CN
201218943	Apr 2009	CN
101840293	Sep 2010	CN
102023768	Apr 2011	CN
102411460	Apr 2012	CN
103049148	Apr 2013	CN
103052930	Apr 2013	CN
103221910	Jul 2013	CN
103294321	Sep 2013	CN
103365500	Oct 2013	CN
103365506	Oct 2013	CN
103809810	May 2014	CN
104020908	Sep 2014	CN
102648446	Jan 2016	CN
105474154	Apr 2016	CN
11 2008 001 245	Mar 2010	DE
102011089693	Jun 2013	DE
102011089693	Aug 2014	DE
0 853 230	Jul 1998	EP
1 192 585	Apr 2002	EP
1 192 585	Apr 2002	EP
1 573 706	Feb 2004	EP
1 573 706	Feb 2004	EP
1 455 264	Sep 2004	EP
1 455 264	Sep 2004	EP
1 644 918	Dec 2004	EP
1 717 677	Nov 2006	EP
1 717 677	Nov 2006	EP
1918803	Nov 2006	EP
1745356	Jan 2007	EP
1 986 084	Oct 2008	EP
2 077 489	Jul 2009	EP
2144146	Jan 2010	EP
2148264	Jan 2010	EP
2224277	Sep 2010	EP
2 256 606	Dec 2010	EP
1455264	May 2011	EP
2756048	May 1998	FR
2896595	Jul 2007	FR
2949008	Feb 2011	FR
3004551	Oct 2014	FR
1 546 317	May 1979	GB
2 144 146	Feb 1985	GB
2 428 306	Jan 2007	GB
2 437 827	Nov 2007	GB
2 450 207	Dec 2008	GB
10-505183	May 1998	JP
2000-163031	Jun 2000	JP
3134925	Feb 2001	JP
2002-342033	Nov 2002	JP
2003-066417	Mar 2003	JP
2004-503835	Feb 2004	JP
2004-526265	Aug 2004	JP
2005030901	Feb 2005	JP
2005-084128	Mar 2005	JP
2005-301373	Oct 2005	JP
2006-251927	Sep 2006	JP
2007-018515	Jan 2007	JP
2008-510251	Apr 2008	JP
2008-117371	May 2008	JP
2008-225415	Sep 2008	JP
2009-86240	Apr 2009	JP
2009-157373	Jul 2009	JP
2010-528186	Aug 2010	JP
10-2004-0002983	Jan 2004	KR
10-20040091728	Oct 2004	KR
10-20070002327	Jan 2007	KR
10-2008-0019125	Mar 2008	KR
10-2008-0041278	May 2008	KR
10-2011-0044670	Apr 2011	KR
10-2012-0085737	Aug 2012	KR
10-2013-0094495	Aug 2013	KR
10-2013-0117499	Oct 2013	KR
10-2014-0074454	Jun 2014	KR
10-1609992	Apr 2016	KR
200715015	Apr 2007	TW
200826032	Jun 2008	TW
2008-35294	Aug 2008	TW
M341273	Sep 2008	TW
M344522	Nov 2008	TW
M344544	Nov 2008	TW
M352721	Mar 2009	TW
201115442	May 2011	TW
201203069	Jan 2012	TW
201401129	Jan 2014	TW
201419071	May 2014	TW
WO-9935633	Jul 1999	WO
1999035633	Sep 1999	WO
2000073984	Dec 2000	WO
WO-01097204	Dec 2001	WO
2002080637	Oct 2002	WO
2003079176	Sep 2003	WO
2004013833	Feb 2004	WO
2004114265	Dec 2004	WO
2004013833	Aug 2005	WO
WO-2005114369	Dec 2005	WO
WO-2005114369	Dec 2005	WO
WO-2006020305	Feb 2006	WO
WO-2006023147	Mar 2006	WO
WO-2006023147	Mar 2006	WO
WO-2006104745	Oct 2006	WO
WO-2006104745	Oct 2006	WO
2006126703	Nov 2006	WO
WO-2006130584	Dec 2006	WO
WO-2006130584	Dec 2006	WO
WO-2007012899	Feb 2007	WO
WO-2007034591	Mar 2007	WO
2006020305	May 2007	WO
2007054018	May 2007	WO
WO-2007066488	Jun 2007	WO
WO-2007089766	Aug 2007	WO
WO-2007115032	Oct 2007	WO
2007146780	Dec 2007	WO
WO-2007146785	Dec 2007	WO
WO-2007146785	Dec 2007	WO
2007115032	Jan 2008	WO
2008000964	Jan 2008	WO
WO-2008007118	Jan 2008	WO
WO-2008007118	Jan 2008	WO
2008030780	Mar 2008	WO
WO-2008047990	Apr 2008	WO
WO-2008076237	Jun 2008	WO
2008076237	Aug 2008	WO
2007089766	Sep 2008	WO
2007146780	Sep 2008	WO
WO-2008108514	Sep 2008	WO
WO-2008135713	Nov 2008	WO
WO-2009046363	Apr 2009	WO
WO-2009103946	Aug 2009	WO
WO-2009132146	Oct 2009	WO
WO-2009132150	Oct 2009	WO
WO-2010088659	Aug 2010	WO
WO-2010117882	Oct 2010	WO
2011015795	Feb 2011	WO
2011071784	Jun 2011	WO
2011015795	Jul 2011	WO
WO-2011137200	Nov 2011	WO
2013093327	Jun 2013	WO
WO-2013158570	Oct 2013	WO
2014105942	Jul 2014	WO
WO-2014127716	Aug 2014	WO
WO-2015017196	Feb 2015	WO
WO-2015023410	Feb 2015	WO
WO-2015072722	May 2015	WO
WO-2015107969	Jul 2015	WO
WO-2015178920	Nov 2015	WO
WO-2016048269	Mar 2016	WO
2016066282	May 2016	WO
WO-2016069642	May 2016	WO
WO-2016126525	Aug 2016	WO
WO-2016144437	Sep 2016	WO
2017058413	Apr 2017	WO
WO-2017058415	Apr 2017	WO

Non-Patent Literature Citations (222)

Entry
European Search Report dated Jan. 31, 2018, for EP Application No. 17183937.6, four pages.
Notice of Allowance dated Feb. 9, 2018, for U.S. Appl. No. 14/550,686, filed Nov. 21, 2014, 11 pages.
Notice of Allowance dated Mar. 1, 2018, for U.S. Appl. No. 14/645,120, filed Mar. 11, 2015, five pages.
Final Office Action dated Jul. 27, 2018, for U.S. Appl. No. 15/097,179, filed Apr. 12, 2016, 11 pages.
Non-Final Office Action dated Jun. 20, 2018, for U.S. Appl. No. 15/009,774, filed Jan. 28, 2016, 17 pages.
Non-Final Office Action dated Sep. 14, 2017 , for U.S. Appl. No. 15/017,463, filed Feb. 5, 2016, 22 pages.
Notice of Allowance dated Sep. 20, 2017, for U.S. Appl. No. 14/082,003, filed Nov. 15, 2013, eight pages.
Notice of Allowance dated Sep. 20, 2017, for U.S. Appl. No. 15/144,706, filed May 2, 2016, nine pages.
Final Office Action dated Dec. 5, 2017, for U.S. Appl. No. 15/006,987, filed Jan. 26, 2016, 16 pages.
Non-Final Office Action dated Dec. 22, 2017 , for U.S. Appl. No. 14/993,017, filed Jan. 11, 2016, 23 pages.
Non-Final Office Action dated Jan. 22, 2018 , for U.S. Appl. No. 15/097,179, filed Apr. 12, 2016, 11 pages.
Non-Final Office Action dated Dec. 21, 2018, for U.S. Appl. No. 15/313,549, filed Nov. 22, 2016, thirteen pages.
Non-Final Office Action dated Jan. 2, 2019, for U.S. Appl. No. 15/522,737, filed Apr. 27, 2017, thirteen pages.
Non-Final Office Action dated Jan. 18, 2019 , for U.S. Appl. No. 14/993,017, filed Jan. 11, 2016, 34 pages.
Non-Final Office Action dated Jan. 18, 2019 , for U.S. Appl. No. 15/087,956, filed Mar. 31, 2016, twelve pages.
Notice of Allowance dated Dec. 31, 2018, for U.S. Appl. No. 14/318,157, filed Jun. 27, 2014, eight pages.
Final Office Action dated Feb. 6, 2019, for U.S. Appl. No. 15/009,774, filed Jan. 28, 2016, fifteen pages.
Non-Final Office Action dated Feb. 11, 2019 , for U.S. Appl. No. 15/507,722, filed Feb. 28, 2017, fifteen pages.
Notice of Allowance dated Oct. 3, 2017, for U.S. Appl. No. 14/082,003, filed Nov. 15, 2013, nine pages.
Notice of Allowance dated Oct. 13, 2017, for U.S. Appl. No. 14/558,529, filed Dec. 2, 2014, eight pages.
Cassidy, R. (Feb. 23, 2007). “The Tissot T-Touch Watch—A Groundbreaking Timepiece,” located at <http://ezinearticles.com/?The-Tissot-T-Touch-Watch---A-Groundbreaking-Timepiece&id . . . >, last visited Jan. 23, 2009, two pages.
Chinese Search Report completed Dec. 14, 2011, for CN Patent Application No. ZL201020108330X, filed Feb. 2, 2010, with English Translation, 12 pages.
Chinese Search Report completed May 18, 2015, for CN Patent Application No. 201310042816.6, filed Feb. 2, 2010, two pages.
European Search Report dated Jul. 21, 2010, for EP Patent Application 10151969.2, three pages.
European Search Report dated Apr. 25, 2012, for EP Patent Application No. 08022505.5, 12 pages.
European Search Report dated Dec. 3, 2012, for EP Patent Application No. 12162177.5, seven pages.
European Search Report dated Feb. 13, 2013, for EP Patent Application No. 12192450.0, six pages.
European Search Report dated Aug. 31, 2015, for EP Application No. 15166813.4, eight pages.
European Search Report dated Jul. 27, 2017, for EP Application No. 14902458.0, four pages.
Final Office Action dated Jan. 5, 2012, for U.S. Appl. No. 12/206,680, filed Sep. 8, 2008, 15 pages.
Final Office Action dated Jan. 3, 2013, for U.S. Appl. No. 11/818,498, filed Jun. 13, 2007, 17 pages.
Final Office Action dated Feb. 1, 2013, for U.S. Appl. No. 12/642,466, filed Dec. 18, 2009, nine pages.
Final Office Action dated Feb. 5, 2013, for U.S. Appl. No. 12/500,911, filed Jul. 10, 2009, 15 pages.
Final Office Action dated Apr. 30, 2013, for U.S. Appl. No. 12/494,173, filed Jun. 29, 2009, 7 pages.
Final Office Action dated May 22, 2013, for U.S. Appl. No. 12/206,680, filed Sep. 8, 2008, 16 pages.
Final Office Action dated Jun. 21, 2013, for U.S. Appl. No. 12/545,754, filed Aug. 21, 2009, 6 pages.
Final Office Action dated Jul. 19, 2013, for U.S. Appl. No. 12/545,604, filed Aug. 21, 2009, 17 pages.
Final Office Action dated Aug. 12, 2013, for U.S. Appl. No. 12/238,333, filed Sep. 25, 2008, 19 pages.
Final Office Action dated Aug. 13, 2013, for U.S. Appl. No. 12/238,342, filed Sep. 25, 2008, 14 pages.
Final Office Action dated Jan. 27, 2014, for U.S. Appl. No. 12/206,680, filed Sep. 8, 2008, 20 pages.
Final Office Action dated Apr. 23, 2014 for U.S. Appl. No. 12/847,987, filed Jul. 30, 2010, 16 pages.
Final Office Action dated May 9, 2014, for U.S. Appl. No. 12/642,466, filed Dec. 18, 2009, 13 pages.
Final Office Action dated Jul. 16, 2014, for U.S. Appl. No. 12/545,604, filed Aug. 21, 2009, 18 pages.
Final Office Action dated Oct. 22, 2014, for U.S. Appl. No. 12/238,342, filed Sep. 25, 2008, 16 pages.
Final Office Action dated Oct. 22, 2014, for U.S. Appl. No. 13/448,182, filed Apr. 16, 2012, 11 pages.
Final Office Action dated Apr. 22, 2015, for U.S. Appl. No. 12/238,333, filed Sep. 25, 2008, 23 pages.
Final Office Action dated Jun. 11, 2015, for U.S. Appl. No. 13/448,182, filed Apr. 16, 2012, 12 pages.
Final Office Action dated Nov. 12, 2015, for U.S. Appl. No. 14/082,074, filed Nov. 15, 2013, 22 pages.
Final Office Action dated Jan. 4, 2016, for U.S. Appl. No. 14/082,003, filed Nov. 15, 2013, 25 pages.
Final Office Action dated Jan. 29, 2016, for U.S. Appl. No. 12/642,466, filed Dec. 18, 2009, nine pages.
Final Office Action dated Apr. 8, 2016, for U.S. Appl. No. 13/899,391, filed May 21, 2013, ten pages.
Final Office Action dated May 9, 2016, for U.S. Appl. No. 14/318,157, filed Jun. 27, 2014, ten pages.
Final Office Action dated May 27, 2016, for U.S. Appl. No. 14/645,120, filed Mar. 11, 2015, twelve pages.
Final Office Action dated Jun. 14, 2016, for U.S. Appl. No. 14/550,686, filed Nov. 21, 2014, ten pages.
Final Office Action dated Sep. 29, 2016, for U.S. Appl. No. 14/558,529, filed Dec. 2, 2014, 22 pages.
Final Office Action dated Nov. 4, 2016, for U.S. Appl. No. 14/082,003, filed Nov. 15, 2013, 18 pages.
Final Office Action dated Jul. 26, 2017, for U.S. Appl. No. 14/318,157, filed Jun. 27, 2014, 10 pages.
Final Office Action dated Aug. 10, 2017, for U.S. Appl. No. 14/645,120, filed Mar. 11, 2015, twelve pages.
Final Office Action dated Aug. 21, 2017, for U.S. Appl. No. 14/550,686, filed Nov. 21, 2014, 11 pages.
International Search Report dated Mar. 10, 2010, for PCT Application No. PCT/US2010/22868, filed Feb. 2, 2010, three pages.
International Search Report dated Jan. 14, 2011, for PCT Application No. PCT/US2010/029698, filed Apr. 1, 2010, 4 pages.
International Search Report dated May 2, 2011, for PCT Application No. PCT/US2010/058988, filed Dec. 3, 2010, five pages.
International Search Report dated Aug. 6, 2013, for PCT Application No. PCT/US2013/036662, filed Apr. 15, 2013, three pages.
International Search Report dated Jan. 29, 2015, for PCT Application No. PCT/US2014/047888, filed Jul. 23, 2014, six pages.
International Search Report dated May 9, 2016, for PCT Application No. PCT/US2016/015479, filed Jan. 28, 2016, five pages.
International Search Report dated May 11, 2016, for PCT Application No. PCT/US2016/016011, filed Feb. 1, 2016, six pages.
Lee, S.K. et al. (Apr. 1985). “A Multi-Touch Three Dimensional Touch-Sensitive Tablet,” Proceedings of CHI: ACM Conference on Human Factors in Computing Systems, pp. 21-25.
Malik, S. et al. (2004). “Visual Touchpad: A Two-Handed Gestural Input Device,” Proceedings of the 6th International Conference on Multimodal Interfaces, State College, PA, Oct. 13-15, 2004, ICMI '04, ACM pp. 289-296.
Non-Final Office Action dated Feb. 4, 2011, for U.S. Appl. No. 12/038,760, filed Feb. 27, 2008, 18 pages.
Non-Final Office Action dated Jun. 9, 2011, for U.S. Appl. No. 12/206,680, filed Sep. 8, 2008, 13 pages.
Non-Final Office Action dated Mar. 9, 2012, for U.S. Appl. No. 12/238,342, filed Sep. 25, 2008, 26 pages.
Non-Final Office Action dated May 3, 2012, for U.S. Appl. No. 12/238,333, filed Sep. 25, 2008, 22 pages.
Non-Final Office Action dated May 25, 2012, for U.S. Appl. No. 11/818,498, filed Jun. 13, 2007, 16 pages.
Non-Final Office Action dated Jun. 7, 2012, for U.S. Appl. No. 12/500,911, filed Jul. 10, 2009, 16 pages.
Non-Final Office Action dated Aug. 28, 2012, for U.S. Appl. No. 12/642,466, filed Dec. 18, 2009, nine pages.
Non-Final Office Action dated Sep. 26, 2012, for U.S. Appl. No. 12/206,680, filed Sep. 8, 2008, 14 pages.
Non-Final Office Action dated Oct. 5, 2012, for U.S. Appl. No. 12/545,754, filed Aug. 21, 2009, 10 pages.
Non-Final Office Action dated Nov. 23, 2012, for U.S. Appl. No. 12/545,557, filed Aug. 21, 2009, 11 pages.
Non-Final Office Action dated Nov. 28, 2012, for U.S. Appl. No. 12/494,173, filed Jun. 29, 2009, six pages.
Non-Final office Action dated Jan. 7, 2013, for U.S. Appl. No. 12/545,604, filed Aug. 21, 2009, 12 pages.
Non-Final Office Action dated Jan. 7, 2013, for U.S. Appl. No. 12/238,333, filed Sep. 25, 2008, 20 pages.
Non-Final Office Action dated Feb. 15, 2013, for U.S. Appl. No. 12/238,342, filed Sep. 25, 2008, 15 pages.
Non-Final Office Action dated Mar. 29, 2013 for U.S. Appl. No. 13/737,779, filed Jan. 9, 2013, nine pages.
Non-Final Office Action dated Sep. 6, 2013, for U.S. Appl. No. 12/847,987, filed Jul. 30, 2010, 15 pages.
Non-Final Office Action dated Sep. 10, 2013, for U.S. Appl. No. 12/545,754, filed Aug. 21, 2009, six pages.
Non-Final Office Action dated Sep. 30, 2013, for U.S. Appl. No. 12/206,680, filed Sep. 8, 2008, 18 pages.
Non-Final Office Action dated Nov. 8, 2013, for U.S. Appl. No. 12/642,466, filed Dec. 18, 2009, 12 pages.
Non-Final Office Action dated Dec. 19, 2013, for U.S. Appl. No. 12/545,604, filed Aug. 21, 2009, 17 pages.
Non-Final Office Action dated Jan. 2, 2014, for U.S. Appl. No. 12/545,754, filed Aug. 21, 2009, 11 pages.
Non-Final Office Action dated Jan. 3, 2014 , for U.S. Appl. No. 12/545,557, filed Aug. 21, 2009, 9 pages.
Non-Final Office Action dated Jan. 31, 2014, for U.S. Appl. No. 13/448,182, filed Apr. 16, 2012, 18 pages.
Non-Final Office Action dated Mar. 12, 2014, for U.S. Appl. No. 12/238,342, filed Sep. 25, 2008, 15 pages.
Non-Final Office Action dated Apr. 10, 2014, for U.S. Appl. No. 14/055,717, filed Oct. 16, 2013, 10 pages.
Non-Final Office Action dated Sep. 18, 2014, for U.S. Appl. No. 12/238,333, filed Sep. 25, 2008, 21 pages.
Non-Final Office Action dated Apr. 10, 2015, for U.S. Appl. No. 14/082,074, filed Nov. 15, 2013, 23 pages.
Non-Final Office Action dated May 4, 2015, for U.S. Appl. No. 12/642,466, filed Dec. 18, 2009, nine pages.
Non-Final Office Action dated May 8, 2015, for U.S. Appl. No. 14/082,003, filed Nov. 15, 2013, 25 pages.
Non-Final Office Action dated Aug. 20, 2015 , for U.S. Appl. No. 14/550,686, filed Nov. 21, 2014, ten pages.
Non-Final Office Action dated Oct. 5, 2015, for U.S. Appl. No. 13/899,391, filed May 21, 2013, ten pages.
Non-Final Office Action dated Oct. 6, 2015, for U.S. Appl. No. 14/318,157, filed Jun. 27, 2014, seven pages.
Non-Final Office Action dated Oct. 27, 2015, for U.S. Appl. No. 14/645,120, filed Mar. 11, 2015, eight pages.
Non-Final Office Action dated Apr. 14, 2016, for U.S. Appl. No. 14/558,529, filed Dec. 2, 2014, twenty pages.
Non-Final Office Action dated May 25, 2016, for U.S. Appl. No. 14/082,003, filed Nov. 15, 2013, 23 pages.
Non-Final Office Action dated Jun. 1, 2016, for U.S. Appl. No. 14/615,186, filed Feb. 5, 2015, eight pages.
Non-Final Office Action dated Dec. 14, 2016, for U.S. Appl. No. 14/550,686, filed Nov. 21, 2014, eight pages.
Non-Final Office Action dated Dec. 16, 2016, for U.S. Appl. No. 14/645,120, filed Mar. 11, 2015, ten pages.
Non-Final Office Action dated Dec. 19, 2016, for U.S. Appl. No. 14/318,157, filed Jun. 27, 2014, eleven pages.
Non-Final Office Action dated Mar. 13, 2017, for U.S. Appl. No. 14/082,003, filed Nov. 15, 2013, 20 pages.
Non-Final Office Action dated Apr. 7, 2017, for U.S. Appl. No. 15/144,706, filed May 2, 2016, eight pages.
Non-Final Office Action dated Jun. 14, 2017, for U.S. Appl. No. 15/006,987, filed Jan. 26, 2016, 14 pages.
Non-Final Office Action dated Jun. 26, 2017, for U.S. Appl. No. 14/558,529, filed Dec. 2, 2014, six pages.
Notice of Allowance dated Jun. 10, 2013, for U.S. Appl. No. 12/545,557, filed Aug. 21, 2009, 9 pages.
Notice of Allowance dated Aug. 19, 2013, for U.S. Appl. No. 12/500,911, filed Jul. 10, 2009, six pages.
Notice of Allowance dated Sep. 3, 2013, for U.S. Appl. No. 13/737,779, filed Jan. 9, 2013, 10 pages.
Notice of Allowance dated Apr. 11, 2014, for U.S. Appl. No. 12/545,557, filed Aug. 21, 2009, 9 pages.
Notice of Allowance dated Aug. 21, 2014, for U.S. Appl. No. 12/545,754, filed Aug. 21, 2009, ten pages.
Notice of Allowance dated Oct. 15, 2014, for U.S. Appl. No. 12/494,173, filed Jun. 29, 2009, eight pages.
Notice of Allowance dated Nov. 7, 2014, for U.S. Appl. No. 14/055,717, filed Oct. 16, 2013, six pages.
Notice of Allowance dated Mar. 16, 2015, for U.S. Appl. No. 14/312,489, filed Jun. 23, 2014, eight pages.
Notice of Allowance dated Dec. 1, 2015, for U.S. Appl. No. 12/238,333, filed Sep. 25, 2008, nine pages.
Notice of Allowance dated Jan. 8, 2016, for U.S. Appl. No. 13/448,182, filed Apr. 16, 2012, nine pages.
Notice of Allowance dated Dec. 2, 2016, for U.S. Appl. No. 14/615,186, filed Feb. 5, 2015, seven pages.
Rekimoto, J. (2002). “SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces,” CHI 2002, Apr. 20-25, 2002. [(Apr. 20, 2002). 4(1):113-120.].
Rubine, D.H. (Dec. 1991). “The Automatic Recognition of Gestures,” CMU-CS-91-202, Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Computer Science at Carnegie Mellon University, 285 pages.
Rubine, D.H. (May 1992). “Combining Gestures and Direct Manipulation,” CHI '92, pp. 659-660.
Search Report dated Apr. 29, 2009, for NL Application No. 2001672, with English translation of Written Opinion, eight pages.
Search Report dated Oct. 14, 2015, for TW Application No. 103116003, one page.
Search Report dated Nov. 12, 2015, for ROC (Taiwan) Patent Application No. 103105965, with English translation, two pages.
TW Search Report dated May 3, 2016, for TW Application No. 104115152, one page.
Westerman, W. (Spring 1999). “Hand Tracking, Finger Identification, and Chordic Manipulation on a Multi-Touch Surface,” A Dissertation Submitted to the Faculty of the University of Delaware in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Electrical Engineering, 364 pages.
Wilson, A.D. (Oct. 15, 2006). “Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input,” ACM, USIT '06, Montreux, Switzerland, Oct. 15-18, 2006, pp. 255-258.
Yang, J-H. et al. (Jul. 2013). “A Noise-Immune High-Speed Readout Circuit for In-Cell Touch Screen Panels,” IEEE Transactions on Circuits and Systems—1: Regular Papers 60(7):1800-1809.
Final Office Action dated Aug. 16, 2018, for U.S. Appl. No. 14/993,017, filed Jan. 11, 2016, 35 pages.
Final Office Action dated May 14, 2018, for U.S. Appl. No. 15/006,987, filed Jan. 26, 2016, 11 pages.
Final Office Action dated May 17, 2018, for U.S. Appl. No. 15/017,463, filed Feb. 5, 2016, 22 pages.
Non-Final Office Action dated Apr. 3, 2018, for U.S. Appl. No. 14/318,157, filed Jun. 27, 2014, twelve pages.
Notice of Allowance dated Mar. 11, 2019, for U.S. Appl. No. 15/087,956, filed Mar. 31, 2016, ten pages.
Notice of Allowance dated Apr. 3, 2019, for U.S. Appl. No. 15/687,078, filed Aug. 25, 2017, eight pages.
Advisory Action received for U.S. Appl. No. 11/818,498, dated May 17, 2013, 5 pages.
Advisory Action received for U.S. Appl. No. 11/818,498, dated Oct. 14, 2011, 5 pages.
Advisory Action received for U.S. Appl. No. 12/206,680, dated Apr. 16, 2012, 3 pages.
Advisory Action received for U.S. Appl. No. 12/238,333, dated Dec. 17, 2013, 3 pages.
Advisory Action received for U.S. Appl. No. 12/238,333, dated Oct. 21, 2015, 4 pages.
Advisory Action received for U.S. Appl. No. 12/500,911, dated May 17, 2013, 3 pages.
Advisory Action received for U.S. Appl. No. 12/642,466, dated May 23, 2013, 2 pages.
Advisory Action received for U.S. Appl. No. 14/082,003, dated Mar. 10, 2016, 3 pages.
Advisory Action received for U.S. Appl. No. 14/645,120, dated Nov. 25, 2016, 3 pages.
Advisory Action received for U.S. Appl. No. 15/017,463, dated Aug. 8, 2018, 3 pages.
Connor, Todd, “mTouch Projected Capacitive Touch Screen Sensing Theory of Operation”, Microchip TB3064, Microchip Technology Inc., 2010, pp. 1-16.
Decision to Grant received for European Patent Application No. 16704768.7, dated May 23, 2019, 1 page.
Final Office Action received for U.S. Appl. No. 11/818,498, dated Jun. 10, 2011, 16 pages.
Final Office Action received for U.S. Appl. No. 14/997,031, dated Jun. 14, 2018, 19 pages.
Final Office Action received for U.S. Appl. No. 15/090,555, dated Aug. 29, 2018, 18 pages.
Final Office Action received for U.S. Appl. No. 15/228,942, dated Apr. 17, 2019, 9 pages.
Final Office Action received for U.S. Appl. No. 15/313,549, dated Dec. 18, 2019, 24 pages.
Final Office Action received for U.S. Appl. No. 15/507,722, dated Sep. 13, 2019, 18 pages.
Final Office Action received for U.S. Appl. No. 15/522,737, dated Sep. 12, 2019, 15 pages.
Final Office Action received for U.S. Appl. No. 16/201,730, dated Nov. 1, 2019, 11 pages.
First Action Interview received for U.S. Appl. No. 15/228,942, dated Nov. 26, 2018, 5 pages.
Gibilisco, Stan, The Illustrated Dictionary of Electronics, Eighth Edition, 2001, p. 173.
Intention to Grant received for European Patent Application No. 15166813.4, dated Sep. 20, 2019, 8 pages.
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2010/022868, dated Jan. 27, 2011, 10 pages.
International Search Report received for PCT Patent Application No. PCT/US2014/039245, dated Sep. 24, 2014, 3 pages.
International Search Report received for PCT Patent Application No. PCT/US2014/056795, dated Dec. 12, 2014, 3 pages.
International Search Report received for PCT Patent Application No. PCT/US2015/057644, dated Jan. 8, 2016, 3 pages.
Non-Final Office Action received for U.S. Appl. No. 11/818,498, dated Dec. 13, 2010, 16 pages.
Non-Final Office Action received for U.S. Appl. No. 15/009,774, dated Sep. 4, 2019, 18 pages.
Non-Final Office Action received for U.S. Appl. No. 15/017,463, dated May 15, 2019, 20 pages.
Non-Final Office Action received for U.S. Appl. No. 15/313,549, dated Jul. 10, 2019, 25 pages.
Non-Final Office Action received for U.S. Appl. No. 16/152,326, dated Aug. 14, 2019, 12 pages.
Non-Final Office Action received for U.S. Appl. No. 16/201,730, dated May 10, 2019, 9 pages.
Notice of Allowance received for Taiwanese Patent Application No. 103116003, dated May 24, 2019, 3 pages (Official Copy only).
Notice of Allowance received for U.S. Appl. No. 12/545,604, dated Oct. 5, 2015, 9 pages.
Notice of Allowance received for U.S. Appl. No. 14/993,017, dated Jul. 12, 2019, 10 pages.
Notice of Allowance received for U.S. Appl. No. 15/090,555, dated Feb. 12, 2019, 7 pages.
Notice of Allowance received for U.S. Appl. No. 15/228,942, dated Aug. 30, 2019, 12 pages.
Notice of Allowance received for U.S. Appl. No. 15/691,283, dated Jun. 5, 2019, 10 pages.
Notification of Grant received for Korean Patent Application No. 10-2016-7003645, dated May 31, 2019, 3 pages (1 page of English Translation and 2 pages of Official Copy).
Notification to Grant received for Chinese Patent Application No. 201610790093.1, dated Apr. 30, 2019, 4 pages (2 pages of English Translation and 2 page of Official Copy).
Office Action received for Australian Patent Application No. 2019200698, dated Nov. 23, 2019, 3 pages.
Office Action received for Chinese Patent Application No. 201480081612.6, dated Jun. 4, 2019, 22 pages (11 of English Translation and 11 pages of Official Copy).
Office Action received for Chinese Patent Application No. 201580058366.7, dated May 28, 2019, 19 pages (10 pages of English Translation and 9 pages of Official Copy).
Office Action received for Chinese Patent Application No. 201680012966.4, dated Nov. 1, 2019, 19 pages (10 pages of English Translation and 9 pages of Official copy).
Preinterview First Office Action received for U.S. Appl. No. 15/228,942, dated Sep. 13, 2018, 4 pages.
Restriction Requirement received for U.S. Appl. No. 12/238,333, dated Mar. 8, 2012, 6 pages.
Restriction Requirement received for U.S. Appl. No. 12/494,173, dated Aug. 8, 2012, 5 pages.
Restriction Requirement received for U.S. Appl. No. 13/899,391, dated Apr. 8, 2015, 6 pages.
Restriction Requirement received for U.S. Appl. No. 15/087,956, dated Feb. 13, 2018, 8 pages.
Restriction Requirement received for U.S. Appl. No. 15/097,179, dated Sep. 28, 2017, 6 pages.
Restriction Requirement received for U.S. Appl. No. 15/228,942, dated Mar. 21, 2018, 6 pages.
Restriction Requirement received for U.S. Appl. No. 15/691,283, dated Mar. 5, 2019, 6 pages.
Written Opinion received for PCT Patent Application No. PCT/US2010/022868, dated Mar. 10, 2010, 4 pages.
Final Office Action received for U.S. Appl. No. 12/038,760, dated Jul. 23, 2013, 20 pages.
Final Office Action received for U.S. Appl. No. 12/038,760, dated Jun. 8, 2011, 21 pages.
Final Office Action received for U.S. Appl. No. 12/110,024, dated Dec. 24, 2012, 21 pages.
Final Office Action received for U.S. Appl. No. 12/110,024, dated Jan. 19, 2012, 12 pages.
Final Office Action received for U.S. Appl. No. 12/110,075, dated Aug. 31, 2012, 15 pages.
Final Office Action received for U.S. Appl. No. 12/333,250, dated Dec. 15, 2011, 13 pages.
Final Office Action received for U.S. Appl. No. 14/157,737, dated Aug. 31, 2015, 28 pages.
International Search Report received for PCT Patent Application No. PCT/US2008/078836, dated Mar. 19, 2009, 4 pages.
International Search Report received for PCT Patent Application No. PCT/US2009/041460, dated Jul. 17, 2009, 3 pages.
International Search Report received for PCT Patent Application No. PCT/US2009/041465, dated Aug. 5, 2009, 4 pages.
International Search Report received for PCT Patent Application No. PCT/US2016/048694, dated Oct. 31, 2016, 6 pages.
Non-Final Office Action received for U.S. Appl. No. 12/038,760, dated Jan. 2, 2013, 20 pages.
Non-Final Office Action received for U.S. Appl. No. 12/110,024, dated Jul. 3, 2012, 20 pages.
Non-Final Office Action received for U.S. Appl. No. 12/110,024, dated Jul. 11, 2011, 13 pages.
Non-Final Office Action received for U.S. Appl. No. 12/110,075, dated Jan. 25, 2012, 22 pages.
Non-Final Office Action received for U.S. Appl. No. 12/110,075, dated Jul. 8, 2011, 15 pages.
Non-Final Office Action received for U.S. Appl. No. 12/110,075, dated Mar. 28, 2013, 14 pages.
Non-Final Office Action received for U.S. Appl. No. 12/333,250, dated Aug. 17, 2011, 13 pages.
Non-Final Office Action received for U.S. Appl. No. 14/157,737, dated Feb. 10, 2015, 24 pages.
Non-Final Office Action received for U.S. Appl. No. 15/090,555, dated Nov. 3, 2017, 28 pages.
Notice of Allowance received for U.S. Appl. No. 12/038,760, dated Nov. 8, 2013, 15 pages.
Notice of Allowance received for U.S. Appl. No. 12/110,024, dated May 23, 2013, 5 pages.
Notice of Allowance received for U.S. Appl. No. 12/110,075, dated Aug. 19, 2013, 8 pages.
Notice of Allowance received for U.S. Appl. No. 12/333,250, dated Aug. 28, 2012, 10 pages.
Notice of Allowance received for U.S. Appl. No. 14/157,737, dated Dec. 14, 2015, 5 pages.
Notice of Allowance received for U.S. Appl. No. 14/329,719, dated Nov. 2, 2015, 9 pages.
Office Action received for Chinese Patent Application No. 201310330348.2, dated Nov. 3, 2015, 7 pages.
Search Report received for European Patent Application No. 08017396.6, dated Mar. 19, 2009, 7 pages.
Search Report received for Great Britain Patent Application No. GB0817242.1, dated Jan. 19, 2009, 2 pages.
Search Report received for Great Britain Patent Application No. GB0817242.1, dated Jan. 19, 2010, 2 pages.

Related Publications (1)

	Number	Date	Country
	20180307374 A1	Oct 2018	US

Provisional Applications (1)

	Number	Date	Country
	62488014	Apr 2017	US

Finger tracking in wet environment

Information

Patent Number

Date Filed

Date Issued

Inventors

Original Assignees

Examiners

Agents

CPC

Field of Search

CPC

International Classifications

Term Extension

Abstract