Single-chip multi-stimulus sensor controller

Information

  • Patent Grant
  • 10042472
  • Patent Number
    10,042,472
  • Date Filed
    Monday, July 24, 2017
    8 years ago
  • Date Issued
    Tuesday, August 7, 2018
    7 years ago
Abstract
A multi-stimulus controller for a multi-touch sensor is formed on a single integrated circuit (single-chip). The multi-stimulus controller includes a transmit oscillator, a transmit signal section that generates a plurality of drive signals based on a frequency of the transmit oscillator, a plurality of transmit channels that transmit the drive signals simultaneously to drive the multi-touch sensor, a receive channel that receives a sense signal resulting from the driving of the multi-touch sensor, a receive oscillator, and a demodulation section that demodulates the received sense signal based on a frequency of the receive oscillator to obtain sensing results, the demodulation section including a demodulator and a vector operator.
Description
FIELD OF THE INVENTION

This relates generally to controllers for multi-stimulus sensors, and in particular, to single-chip controllers for multi-stimulus touch sensors.


BACKGROUND OF THE INVENTION

Many types of input devices are presently available for performing operations in a computing system, such as buttons or keys, mice, trackballs, joysticks, touch sensor panels, touch screens and the like. Touch screens, in particular, are becoming increasingly popular because of their ease and versatility of operation as well as their declining price. Touch screens can include a touch sensor panel, which can be a clear panel with a touch-sensitive surface, and a display device such as a liquid crystal display (LCD) that can be positioned partially or fully behind the panel so that the touch-sensitive surface can cover at least a portion of the viewable area of the display device. Touch screens can allow a user to perform various functions by touching the touch sensor panel using a finger, stylus or other object at a location dictated by a user interface (UI) being displayed by the display device. In general, touch screens can recognize a touch event and the position of the touch event on the touch sensor panel, and the computing system can then interpret the touch event in accordance with the display appearing at the time of the touch event, and thereafter can perform one or more actions based on the touch event.


Mutual capacitance touch sensor panels can be formed from a matrix of drive and sense lines of a substantially transparent conductive material such as Indium Tim Oxide (ITO), often arranged in rows and columns in horizontal and vertical directions on a substantially transparent substrate. Drive signals can be transmitted through the drive lines, resulting in signal capacitances at the crossover points (sensing pixels) of the drive lines and the sense lines. The signal capacitances can be determined from sense signals that are generated in the sense lines due to the drive signals. In some touch sensor panel systems, multiple drive lines are stimulated simultaneously to generate composite sense signals in the sense lines. While these systems offer some advantages, conventional multi-stim systems can be inflexible because their design typically limits the operation of the system to a specific stimulation scenario. For example, a typical multi-stim system must use specific combinations of drive signals to generate specific sense signals, and must extract the signal capacitance from the sense signals in a specific manner.


SUMMARY OF THE INVENTION

In view of the foregoing, a multi-stimulus controller for a multi-touch sensor is formed on a single integrated circuit (single-chip) to include a transmit oscillator, a transmit signal section that generates a plurality of drive signals based on a frequency of the transmit oscillator, a plurality of transmit channels that transmit the drive signals simultaneously to drive the multi-touch sensor, a receive channel that receives a sense signal resulting from the driving of the multi-touch sensor, a receive oscillator, and a demodulation section that demodulates the received sense signal based on a frequency of the receive oscillator to obtain sensing results, the demodulation section including a demodulator and a vector operator. Such an implementation may provide a more flexible system than conventional designs. For example, the vector operation can allow for selection and testing of arbitrary vectors, allowing system designers to test and implement different stimulation matrix/decode matrix combinations, for example, without the need to extensive redesign of the sensing system.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 illustrates an example computing system according to embodiments of the invention.



FIG. 2a illustrates an exemplary mutual capacitance touch sensor panel according to one embodiment of this invention.



FIG. 2b is a side view of an exemplary pixel in a steady-state (no-touch) condition according to one embodiment of this invention.



FIG. 2c is a side view of an exemplary pixel in a dynamic (touch) condition according to one embodiment of this invention.



FIG. 3 illustrates an example application specific integrated circuit (ASIC) single chip multi-touch controller according to embodiments of the invention.



FIG. 4 illustrates an example transmit channel according to embodiments of the invention.



FIG. 5 illustrates an example stimulation of touch sensor panel according to embodiments of the invention.



FIG. 6 illustrates an example sense channel and the first stage of the multi-stage vector demodulation engine according to embodiments of the invention.



FIG. 7 illustrates an example second stage of the multi-stage vector demodulation engine according to embodiments of the invention.



FIG. 8 illustrates an example receive NCO according to embodiments of the invention.



FIG. 9a illustrates an example mobile telephone having a touch sensor panel including a single-chip multi-stimulus controller according to embodiments of the invention.



FIG. 9b illustrates an example digital media player having a touch sensor panel including a single-chip multi-stimulus controller according to embodiments of the invention.



FIG. 9c illustrates an example personal computer having a touch sensor panel (trackpad) and/or display including a single-chip multi-stimulus controller according to embodiments of the invention.





DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

In the following description of preferred embodiments, reference is made to the accompanying drawings which form a part hereof, and in which it is shown by way of illustration specific embodiments in which the invention can be practiced. It is to be understood that other embodiments can be used and structural changes can be made without departing from the scope of the embodiments of this invention.


This relates to a multi-stimulus controller for a multi-touch sensor that is formed on a single integrated circuit (single-chip). The controller includes a receive section, a multistage vector demodulation engine, a transmit section, and various peripherals, such as memory, logic, interfaces, signal generators, processors, etc. The multi-stimulus controller can drive a sensor, such as a touch sensor panel, using multiple, simultaneous drive signals, and can receive sense signals from the sensor that result from the multiple stimuli. The sense signals received by the multi-stimulus controller can be composite signals that are formed of a superposition of multiple component sense signals, each component signal resulting from a drive signal, and each component signal carrying measurement data. The multi-stimulus controller can demodulate and decode multiple composite signals to extract the individual measurement data carried by the component signals.


Although embodiments of the invention may be described and illustrated herein in terms of mutual capacitance touch sensor panels, it should be understood that embodiments of this invention are not so limited, but are additionally applicable to self-capacitance sensor panels, and both single and multi-touch sensor panels, and other sensors, in which multiple simultaneous stimulation signals are used to generate a composite sense signal. Furthermore, although embodiments of the invention may be described and illustrated herein in terms of double-sided ITO (DITO) touch sensor panels, it should be understood that embodiments of the invention are also applicable to other touch sensor panel configurations, such as configurations in which the drive and sense lines are formed on different substrates or on the back of a cover glass, and configurations in which the drive and sense lines are formed on the same side of a single substrate.



FIG. 1 illustrates example computing system 100 that utilizes a single-ASIC multi-touch controller 106 with integrated drive system according to embodiments of the invention. Touch controller 106 is a single application specific integrated circuit (ASIC) that can include one or more processor subsystems 102, which can include, for example, one or more main processors, such as ARM968 processors or other processors with similar functionality and capabilities. However, in other embodiments, the processor functionality can be implemented instead by dedicated logic, such as a state machine. Processor subsystems 102 can also include, for example, peripherals (not shown) such as random access memory (RAM) or other types of memory or storage, watchdog timers and the like. Touch controller 106 can also include, for example, a receive section 107 for receiving signals, such as touch sense signals 103 of one or more sense channels (not shown), other signals from other sensors such as sensor 111, etc. Touch controller 106 can also include, for example, a demodulation section such as multistage vector demod engine 109, panel scan logic 110, and a drive system including, for example, a transmit section 114. Panel scan logic 110 can access RAM 112, autonomously read data from the sense channels and provide control for the sense channels. In addition, panel scan logic 110 can control transmit section 114 to generate stimulation signals 116 at various frequencies and phases that can be selectively applied to rows of a touch sensor panel 124.


A charge pump 115 can be used to generate the supply voltage for the transmit section. The stimulation signals 116 (Vstim) that can have amplitudes higher than the maximum voltage the ASIC process can tolerate by cascoding transistors. Therefore, the stimulus voltage can be higher (e.g. 6V) than the voltage level a single transistor can handle (e.g. 3.6 V). Although FIG. 1 shows charge pump 115 separate from transmit section 114, the charge pump can be part of the transmit section.


Touch sensor panel 124 can include a capacitive sensing medium having a plurality of row traces (e.g., drive lines) and a plurality of column traces (e.g., sense lines), although other sensing media can also be used. The row and column traces can be formed from a transparent conductive medium such as Indium Tin Oxide (ITO) or Antimony Tin Oxide (ATO), although other transparent and non-transparent materials such as copper can also be used. In some embodiments, the row and column traces can be perpendicular to each other, although in other embodiments other non-Cartesian orientations are possible. For example, in a polar coordinate system, the sensing lines can be concentric circles and the driving lines can be radially extending lines (or vice versa). It should be understood, therefore, that the terms “row” and “column,” “first dimension” and “second dimension,” or “first axis” and “second axis” as used herein are intended to encompass not only orthogonal grids, but the intersecting traces of other geometric configurations having first and second dimensions (e.g. the concentric and radial lines of a polar-coordinate arrangement). The rows and columns can be formed on, for example, a single side of a substantially transparent substrate separated by a substantially transparent dielectric material, on opposite sides of the substrate, on two separate substrates separated by the dielectric material, etc.


At the “intersections” of the traces, where the traces pass above and below (cross) each other (but do not make direct electrical contact with each other), the traces can essentially form two electrodes (although more than two traces could intersect as well). Each intersection of row and column traces can represent a capacitive sensing node and can be viewed as picture element (pixel) 126, which can be particularly useful when touch sensor panel 124 is viewed as capturing an “image” of touch. (In other words, after touch controller 106 has determined whether a touch event has been detected at each touch sensor in the touch sensor panel, the pattern of touch sensors in the multi-touch panel at which a touch event occurred can be viewed as an “image” of touch (e.g. a pattern of fingers touching the panel).) The capacitance between row and column electrodes appears as a stray capacitance when the given row is held at direct current (DC) voltage levels and as a mutual signal capacitance Csig when the given row is stimulated with an alternating current (AC) signal. The presence of a finger or other object near or on the touch sensor panel can be detected by measuring changes to a signal charge Qsig present at the pixels being touched, which is a function of Csig.


Computing system 100 can also include host processor 128 for receiving outputs from processor subsystems 102 and performing actions based on the outputs that can include, but are not limited to, moving an object such as a cursor or pointer, scrolling or panning, adjusting control settings, opening a file or document, viewing a menu, making a selection, executing instructions, operating a peripheral device connected to the host device, answering a telephone call, placing a telephone call, terminating a telephone call, changing the volume or audio settings, storing information related to telephone communications such as addresses, frequently dialed numbers, received calls, missed calls, logging onto a computer or a computer network, permitting authorized individuals access to restricted areas of the computer or computer network, loading a user profile associated with a user's preferred arrangement of the computer desktop, permitting access to web content, launching a particular program, encrypting or decoding a message, and/or the like. Host processor 128 can also perform additional functions that may not be related to panel processing, and can be coupled to program storage 132 and display device 130 such as an LCD display for providing a UI to a user of the device. In some embodiments, host processor 128 can be a separate component from touch controller 106, as shown. In other embodiments, host processor 128 can be included as part of touch controller 106. In still other embodiments, the functions of host processor 128 can be performed by processor subsystem 102 and/or distributed among other components of touch controller 106. Display device 130 together with touch sensor panel 124, when located partially or entirely under the touch sensor panel, can form touch screen 118.


Note that one or more of the functions described above can be performed, for example, by firmware stored in memory (e.g., one of the peripherals) and executed by processor subsystem 102, or stored in program storage 132 and executed by host processor 128. The firmware can also be stored and/or transported within any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. In the context of this document, a “computer-readable medium” can be any medium that can contain or store the program for use by or in connection with the instruction execution system, apparatus, or device. The computer readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, a portable computer diskette (magnetic), a random access memory (RAM) (magnetic), a read-only memory (ROM) (magnetic), an erasable programmable read-only memory (EPROM) (magnetic), a portable optical disc such a CD, CD-R, CD-RW, DVD, DVD-R, or DVD-RW, or flash memory such as compact flash cards, secured digital cards, USB memory devices, memory sticks, and the like.


The firmware can also be propagated within any transport medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. In the context of this document, a “transport medium” can be any medium that can communicate, propagate or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The transport readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic or infrared wired or wireless propagation medium.



FIG. 2a is a partial view of example touch sensor panel 124 that shows more detail according to embodiments of the invention. FIG. 2a indicates the presence of a stray capacitance Cstray at each pixel 202 located at the intersection of a row 204 and a column 206 trace (although Cstray for only one column is illustrated in FIG. 2a for purposes of simplifying the figure). In the example of FIG. 2a, drive signals transmitted by transmit section 114 can be applied to the rows of touch panel. For example, AC stimulus Vstim 214, Vstim 215 and Vstim 217 can be applied to several rows, while other rows can be connected to DC. Vstim 214, Vstim 215 and Vstim 217 can be, for example, signals having different phases, as will be explained later. Each stimulation signal on a row can cause a charge Qsig to be injected into the columns through the mutual capacitance present at the affected pixels, where:

Qsig=Csig×Vstim  (1)


A change in the injected charge (Qsig_sense) can be detected when a finger, palm or other object is present at one or more of the affected pixels. Vstim signals 214, 215 and 217 can include one or more bursts of sine waves, square waves, etc. Vstim signals could be comprised of signals with one specific phase, amplitude and frequency but could be composite in nature, e.g. can be comprised of multiple signals, each having a specific phase, amplitude and frequency. Each signal component could be frequency, phase or amplitude modulated. For example, amplitude modulation can be used for windowing purposes to provide a stimulus signal that is narrow band and has little harmonic content as to prevent unwanted noise sources to enter the receive channel. For example, having a stimulus signal with a square wave-shape has higher order harmonics. These higher order harmonics may cause in band noise components due to intermodulation between external noise components with the higher order harmonics of the stimulus. Note that although FIG. 2a illustrates rows 204 and columns 206 as being substantially perpendicular, they need not be so aligned, as described above. Each column 206 can be connected to a sense channel, for example.



FIG. 2b is a side view of example pixel 202 in a steady-state (no-touch) condition according to embodiments of the invention. In FIG. 2b, an electric field of electric field lines 208 of the mutual capacitance between column 206 and row 204 traces or electrodes separated by dielectric 210 is shown.



FIG. 2c is a side view of example pixel 202 in a dynamic (touch) condition. In FIG. 2c, finger 212 has been placed near pixel 202. Finger 212 is a low-impedance object at signal frequencies, and has an AC capacitance Cfinger from the column trace 206 to the body. The body has a self-capacitance to ground Cbody of about 200 pF, where Cbody is much larger than Cfinger. If finger 212 blocks some electric field lines 208 between the row and column electrodes (those fringing fields that exit the dielectric and pass through the air above the row electrode), those electric field lines are shunted to ground through the capacitance path inherent in the finger and the body, and as a result, the steady state signal capacitance Csig is reduced by ΔCsig. In other words, the combined body and finger capacitance act to reduce Csig by an amount ΔCsig (which can also be referred to herein as Csig_sense), and can act as a shunt or dynamic return path to ground, blocking some of the electric fields as resulting in a reduced net signal capacitance. The signal capacitance at the pixel becomes Csig−ΔCsig, where Csig represents the static (no touch) component and ΔCsig represents the dynamic (touch) component. Note that Csig−ΔCsig may always be nonzero due to the inability of a finger, palm or other object to block all electric fields, especially those electric fields that remain entirely within the dielectric material. In addition, it should be understood that as a finger is pushed harder or more completely onto the multi-touch panel, the finger can tend to flatten, blocking more and more of the electric fields, and thus ΔCsig can be variable and representative of how completely the finger is pushing down on the panel (e.g., a range from “no-touch” to “full-touch”).



FIG. 3 is a more detailed block diagram of example single-ASIC multi-touch controller 106 according to embodiments of the invention. Receive (RX) section 107 of touch controller 106 includes miscellaneous channels 305 (e.g., channels for infrared sensors, temperature sensors, etc.) and a total of N receive channels, such as sense channels 307. Sense channels 307 are connected to an offset compensator 309. Multistage vector demodulation engine 109 includes a digital demodulation section 313, a result memory 315, and a vector operator 317. Digital demodulation section 313 is connected to a receive NCO 319, and vector operator 317 is connected to a decode matrix RAM 321 and connected to a result RAM 323. Transmit (TX) section 114 includes a transmit logic 327, a transmit DAC 329, and a total of M transmit channels 333. Transmit NCO 335 provides a clock to transmit logic and TX DAC and charge pump 115 provides power to the transmit channels. Transmit channels 333 are connected to a stimulation matrix RAM 337 via an analog bus 339. Decode matrix RAM 321, result RAM 323, and stimulation matrix RAM 337 could be, for example, part of RAM 112. Processor subsystem 102 can store and update, for example, a decode matrix in decode matrix RAM 321 and a stimulation matrix in stimulation matrix RAM 337, initialize the multi-touch subsystem, process data from the receive channels and facilitate communications with the host processor.



FIG. 3 shows processor subsystem 102, panel scan logic 110, and host processor 128. FIG. 3 also shows a clock generator 343 and a processor interface 347. Various components of touch controller 106 are connected together via a peripheral bus 349. Processor interface 347 is connected to host processor 128 via a processor interface (PI) connection 353.


An example drive signal transmission operation of touch controller 106 according to embodiments of the invention will now be described with reference to FIG. 4, which is a block diagram showing more details of touch controller 106. Transmit logic 327, which is powered by charge pump 115, generates digital signals based on TX NCO 335. TX DAC 329 is a differential DAC and converts the digital signals from transmit logic 327 into stimulation signals Vstim+ and Vstim−. Vstim+ is a signal having a waveform at the same frequency as TX NCO 335, and Vstim− is a signal with the waveform of Vstim+ that is inverted about a common voltage Vcm. In this example, the common voltage, Vcm, is equal to 2.5 V. Vstim+ is a sine wave of frequency ω having a DC offset of 2.5 V and a maximum amplitude of 4.75 V:

Vstim+=2.5V+2.25V*sin(ωt)

Vstim− a sine wave of frequency ω with a DC offset of 2.25 V and a maximum amplitude of 4.75 V, that is out of phase with Vstim+ by 180 degrees:

Vstim−=2.5V+2.25V*sin(ωt+180°)


Of course, other stimulation signals and signal generation methods could be used. For example, TX NCO 335 could include a mixer to mix the sine wave Vstim+ and Vstim− signals above with an envelope waveform generated from an envelope look-up-table (LUT). The envelope shaping/windowing capability can be beneficial in that it allows the control the spectral properties of the stimulus waveform and also how much energy is put into the multi-touch panel. Both of these properties control the amount of interference rejection. The more energy is put into the panel the better the interference rejection toward external interferers. Examples of windowing functions are Gaussian, Chebychev or Rectangular. Using, for example, a Chebychev window vs. Rectangular window results in a stimulus waveform that, in the frequency domain, has reduced sideband ripple and therefore allows less noise to enter the receive channel post demodulation.


TX DAC 329 supplies Vstim+ and Vstim− to separate lines of analog bus 339. Bus 339 also includes a line carrying the common voltage, Vcm, and a line that is grounded, gnd. Each transmit channel 333 includes an analog MUX 401 and buffer 403. Analog MUX 401 is connected to each line of bus 339, and can select one of the drive signals, Vstim+, Vstim−, Vcm, or gnd to supply to buffer 403. The use of a single TX DAC 329 together with analog bus 339 and multiple MUXs 401 (one for each transmit channel) can allow for a reduced footprint on chip versus other designs, while allowing stimulation signals of different phases to be generated. However, more than one TX DAC 329 could be used. TX DAC 329 can be, for example, an R2-R DAC, a thermometer coded DAC, a sigma-delta DAC, or other type of DAC. MUX 401 selects a drive signal based on a stimulation matrix 407 stored in stimulation matrix RAM 337, as described in more detail below. The buffers 403 of the transmit channels 333 may have a gain of 1 (unity) or a gain higher than 1 dependent on the maximum stimulus voltage level at the output of the TX DAC. Therefore, the buffers may serve the purpose of not only gaining up the signal from the TX DAC but also to provide the drive capability to drive the mostly capacitive load presented to them by the multi-touch sensor panel 124.


Output buffer 403 can provide the benefit of preventing the noise present on the charge pump supply to propagate to the VSTM outputs. This is important as to prevent any unwanted noise on the VSTM ports generated by the charge-pump to reduce the signal-to-noise ratio and inadvertently to affect the touch-performance. In other words, buffers 403 are essentially self-regulating because each has negative feedback. The power supply ripple rejection of the output buffers 403 can suffice to suppress any power supply ripple present on the charge pump supply. In some embodiments, using buffer 403 in transmit section 114 may provide enough power supply ripple rejection to allow the use of an unregulated charge pump. This can allow the design of the charge pump to be simpler and more efficient. Furthermore the charge-pump operating frequency can selected either as a function of the stimulus frequency or outside the stimulus frequency range to prevent charge-pump introduced noise to affect the touch performance.


During each step of a multi-step scan of touch sensor panel 124, each MUX 401 selects one of Vstim+, Vstim−, Vcm, or GND for transmission to a corresponding drive line of the touch sensor panel. GND can be used to put the corresponding output buffer into a low power state to conserve power if that buffer is not used. The selection is made based on stim matrix 407. As shown in FIG. 4, each row of stim matrix 407 correspond to one step in the scan, and the data values in a row specify the selections of drive signals for each TX channel 333. For each step in the scan, the MUXs 401 select drive signals based on the data values in a row of stim matrix 407. For example, in the first step, the STEP 0 row in FIG. 4 specifies a signal selection for the MUX 401 of the first TX channel (MUX0_SEL), a selection for the MUX 401 of the second TX channel (MUX1_SEL), etc. At each step, the MUXs can select different signal combinations to stimulate the panel differently than in other steps. Panel scan logic 110 can control the timing of the steps by incrementing a step address stored in stimulation matrix RAM 337 through a connection via peripheral bus 349. Once the MUXs select the signals, the signals are sent to buffers 403 of the TX channel 405 to be transmitted to the panel sensor. It is noted that panel scan logic can also modify stim matrix 407 through peripheral bus 349, for example, to adjust the data entry values of the stim matrix, to replace the stim matrix with another stim matrix, etc.



FIG. 5 illustrates an example stimulation of touch sensor panel 124 according to embodiments of the invention. In particular, FIG. 5 illustrates signal paths of drive signals through rows 204 and sense signals through columns 206 of touch sensor panel 124. FIG. 5 shows touch controller 106 driving and sensor panel 124 during one step of a scan of the sensor panel. In FIG. 5, touch controller 106 is shown having M transmit channels 333 and N sense channels 501, which correspond to M drive lines (rows) 204 and N sense lines (columns), respectively, of sensor panel 124. Transmit channels 333 transmit drive signals Vstim[0], Vstim[1], . . . Vstim[M−1] through drive lines 204. Sense signals SenseSig[0], SenseSig[1], . . . SenseSig[N−1] are generated as a result of signal charges Qsig injected into the sense lines 206 of each pixel driven with Vstim, in proportion to the signal capacitances Csig of the pixels, as described above. Assuming a linear system, the total signal charge Qsig_tot injected into a sense line 206 is the sum of the signal charges injected at each pixel of the sense channel C:

Qsig_totC=QsigC(0)+QsigC(1)+ . . . +QsigC(M−1)  (2)

where QsigC(R) is the injected charge at the pixel corresponding to drive line R of sense channel C. Thus, referring to equation (1) above:

Qsig_totC=Vstim(0)×CsigC(0)+Vstim(1)×CsigC(1)+ . . . Vstim(M−1)×CsigC(M−1)  (3)

At each step in a scan of sensor panel 124, a Qsig_totC is generated in each sense channel when drive lines 204 are driven with particular drive signals based on the MUX_SEL values in stim matrix 407 for that step. A complete scan of sensor panel 124 results in a plurality of Qsig_totC measurements, i.e., one Qsig_totC per channel per step. For a scan having P steps, equation (3) can be written as a series of equations, one equation for each step in the scan of sense channel C:











Q






sig_tot
C



(
S
)


=


Vstim
×

cos


(


Pz_stim
C



(

0
,
S

)


)


×


Csig
C



(
0
)



+

Vstim
×

cos


(


Pz_stim
C



(

1
,
S

)


)


×


Csig
C



(
1
)



+







Vstim
×

cos


(


Pz_stim
C



(


(

M


-


1

)

,
S

)


)


×


Csig
C



(

M


-


1

)















where


:












S
=

step





index






(

from





0





to





P


-


1

)













C
=

channel





index






(

from





0





to





N


-


1

)














Q






sig_tot
C



(
S
)


=

Qsig_tot





for





sense





channel





C





at





step





S


















Pz_stim
C



(

R
,
S

)


=



{





0


°



if



Vstim


(

R
,
S

)




=

Vstim
+








180


°



if



Vstim


(

R
,
S

)




=

Vstim
-













=



stimulation





phase





of






Vstim


(

R
,
S

)







for





sense










channel





C

















Csig
C



(
R
)


=

signal





capacitance





at





the





pixel
















corresponding





to





drive





line





R





of





sense





channel





C





(
4
)








Equation (4) can be written in matrix form as:







[




Q






sig_tot
C



(
0
)







Q






sig_tot
C



(
1
)







Q






sig_tot
C



(
2
)





















Q






sig_tot
C



(

P


-


1

)





]

=

Vstim
×




[





M
C



(

0
,
0

)






M
C



(

0
,
0

)









M
C



(


M


-


1

,
0

)








M
C



(

0
,
1

)






M
C



(

1
,
1

)


















M
C



(

0
,
2

)






M
C



(

1
,
2

)






















































M
C



(

0
,

P


-


1


)






M
C



(

1
,

P


-


1


)











M
C



(


M


-


1

,

P


-


1


)





]

×

[





Csig
C



(
0
)








Csig
C



(
1
)








Csig
C



(
2
)






















Csig
C



(

M


-


1

)





]










    • where: MC(R,S)=cos(Pz_stimC(R,S))


      or, in simplified form:

      {tilde over (Q)}sig_totC=Vstim×{tilde over (M)}C×{tilde over (C)}sigC  (5)

    • where: {tilde over (M)}C=the phase matrix for sense channel C


      The Vstim×{tilde over (M)}C portion of equation (5) represents the selection of drive signals in stim matrix 407 in view of the particular processing methodology of the system. In particular, the entries in the phase matrix {tilde over (M)}C are the cosine values of the phases of the stimulation signals)(cos(0° for Vstim+ and cos(180°) for Vstim−). This representation accounts for the particular demodulation process used in the present example embodiment, which is described in more detail below with reference to FIG. 6. Although different sense channels have the same phase matrix in this example embodiment, in other embodiments, the phase matrix may vary from sense channel to sense channel.





Thus, by stimulating the pixels of a channel with different combinations of Vstim signals, each combination of Vstim signals defined by a row in stim matrix 407, and obtaining the total signal charges Qsig_totC from the sense signals resulting from the different stimulation combinations, for example, the signal capacitance CsigC at each pixel of the channel may be determined:












C
~



sig
C


=




M
~

C

-
1


Vstim

×

Q
~



sig_tot
C










where


:









M
~

C

-
1


Vstim


=

the





decode





matrix






(
6
)








However, while the stimulation matrix (and by extension, Vstim×MC) represents the drive signals that are selected for each drive line for each step in a scan, the stimulation matrix might not reflect how the system is actually being stimulated once the drive signals are selected. In other words, the stimulation matrix may not capture other factors in the stimulation of pixels and the measurement of sense signals that may depend on the configuration and operation of the system. One example factor not taken into account by the stimulation matrix is variation in signal delay. FIG. 5, for example, illustrates that both the drive signals and the sense signals can have different signal path lengths in this particular example.


For the sake of clarity, FIG. 5 shows only drive signals 511 (Vstim[0]) and 513 (Vstim[M−1]), corresponding to drive lines 204a and 204b (the first and the last drive lines), and the resulting component signals 517 and 519 of sense signal SenseSig[0] generated on a sense line 206a and component signals 521 and 523 of sense signal SenseSig[1] generated on sense line 206b (the first and second sense lines). FIG. 5 illustrates that each sense signal is a composite signal formed by the superposition of multiple component signals generated at the sense line's pixels.



FIG. 5 illustrates that the length of a signal path from a transmit channel to a sense channel can be different depending on the particular drive line and sense line pair. For example, the signal path lengths of the component signals from the pixels to the receive channel can be different. In sense line 206a, for example, the path length of component signal 517 is longer than the path length of component signal 519. Likewise, in sense line 206b, the path length of component signal 521 is longer than the path length of component signal 523. In addition, the signal path lengths of the drive signals can vary by channel. For example, the path length from TransmitC[0] to pixel 512 of drive line 204a with sense line 206a is less than the path length from TransmitC[0] to a pixel 525 of drive line 204a with sense line 206b. For AC signals, for example, variations in the delays in the signals can cause the phases of the component signals to be different, which can be reflected in the superposition of the component signals forming the composite sense signal SenseSig used to obtain Qsig_totC. Therefore, stimulation matrix 407 (and therefore, Vstim×{tilde over (M)}C) might not accurately reflect the how the sense signals are actually formed, e.g., because the stim matrix does not account for the signal delays in the system. Because the total signal charges Qsig_totC of equation (4) are obtained from the sense signals, the resulting phase matrix might not yield accurate results for the CsigC values. However, the phase components of equation (4) may be modified to compensate for factors such as variation in phase delay associated with, for example, a particular drive/sense line pair.


For example, a phase delay associated with the stimulation signal of each pixel in a channel can be added to the corresponding phase components of equation (4):

Qsig_totC(S)=Vstim×cos(Pz_stimC(0,S)+ϕC(0))×CsigC(0)+
Vstim×cos(Pz_stimC(1,S)+ϕC(1))×CsigC(1)+ . . . Vstim×cos(Pz_stimC((M−1),S)+ϕC(M−1))×CsigC(M−1)  (7)

    • where: ϕC(R)=the phase delay associated with drive line R of sense channel C


      The modified phase components result is a compensated phase matrix for that channel:











M
~

C_comp

=



[





M
C_comp



(

0
,
0

)






M
C_comp



(

1
,
0

)









M
C_comp



(


M


-


1

,
0

)








M
C_comp



(

0
,
1

)






M
C_comp



(

1
,
1

)


















M
C_comp



(

0
,
2

)






M
C_comp



(

1
,
2

)






















































M
C_comp



(

0
,

P


-


1


)






M
C_comp



(

1
,

P


-


1


)











M
C_comp



(


M


-


1

,

P


-


1


)





]






(
8
)









    • where: MC_comp(R,S)=cos(Pz_stimC(R,S)+ϕC(R))


      The inverse of the compensated phase matrix is used as the decode matrix in equation (6):














C
~



sig
C


=




M
~

C_comp

-
1


Vstim

×

Q
~



sig_tot
C






(
9
)








The decode matrix








M
~

C_comp

-
1


Vstim





can be stored in decode matrix RAM 321 and used along with Qsig_totC measurements obtained from the sense signals and stored in result memory 315 to determine CsigC values by calculating equation (9).


An example process of obtaining CsigC values from the sense signals according to embodiments of the invention will now be described with reference to FIGS. 6-7. The example process implements a multi-stage demodulation/decode in which Qsig_totC measurements are obtained through a signal demodulation in one stage and a vector/matrix operation is performed in the 2nd stage to determine the CsigC values FIG. 6 illustrates details of one of the sense channels 307 and digital demodulation section 313 according to embodiments of the invention. As shown in FIG. 6, sense channel 307 includes a charge amplifier 601, an anti-alias filter (AAF) 603, and an analog-to-digital converter (ADC) 605. Digital demod section 313 includes a programmable delay 607, a mixer (signal multiplier) 609, and an integrator 611. In each step of the scan, amplifier 601 of sense channel 307 receives a composite signal charge as described in equation (7) along with a programmable offset charge. The charge amplifier 601 then converts the offset compensated composite signal charge into a voltage VSIG via feedback capacitor CFB such that the output of the pre-amplifier becomes: VsigC=(Qsig_totC−QoffC)/CfbkC.


In some cases, the sense signal can be adjusted by offset compensator 309 prior to being input to amplifier 601. Adjusting the offset of the digital signal can reduce the dynamic range of some stimulation signals generated from highly variable stimulation matrices. In particular, some highly variable stimulation matrices may result in sense signals having a dynamic range greater than the dynamic input range of the charge amplifier 601, that is, the maximum signal magnitude that the amplifier can accept before the charge amplifier saturates. For example, in the case that the stimulation matrix is a Hadamard matrix, in one of the steps in the scan all of the channels are driven with stimulation signals having the same phase, and it is possible that all of the resulting component sense signals would add up to generate a composite sense signal with an amplitude that saturates amplifier 601. In this case, offset compensation would be used to subtract sufficient charge from the input charge as to prevent the charge amplifier from saturating. Offset compensation during a scan can be performed on-the-fly, that is, different offset compensation can be applied during different steps of the scan.


In another example embodiment, saturation of amplifier 601 may be mitigated by adjusting, for example, the feedback capacitance of the amplifier. In this case, individual sense channels could be adjusted, but the adjustment would remain the same for each step in a scan. This approach may be acceptable in the case that the stimulation matrix being used causes the same or similar imbalances of signals in the channels throughout the scan, and the amount of adjustment is not too great, e.g., up to a factor of 2. For example, using a circulant matrix as the stimulation matrix causes a fixed imbalance across all steps.


For the sake of clarity, the processing of a sense signal to obtain a value for Qsig_total is described below in reference to processing a single component of the sense signal of one sense channel (resulting from the stimulation of one of the channel's pixels) to obtain a single Qsig component of Qsig_total for that sense channel. However, it is understood that the analysis applies to all component signals, and that an actual Qsig_total result may be understood as simply a superposition of the individual Qsig results of the other component signals.


When a stimulation signal, Vstim, is applied to the drive line of a pixel, the AC portion of the stimulation signal, Vstim_AC(t), is coupled through to the sense line, generating a signal charge Qsig(t) that tracks Vstim_AC(t) with an amplitude proportional to the signal capacitance Csig of the pixel. From equation (1) above:

Qsig(t)=Csig×Vstim_AC(t)  (10)

The feedback capacitance in the feedback path of the charge amplifier 601 converts the injected signal charge into an output voltage relative to the reference voltage of VREF of the charge amplifier











V
amp_out



(
t
)


=


Qsig


(
t
)



C
f






(
11
)








Substituting for Qsig(t) using equation (10) yields:











V
amp_out



(
t
)


=


Csig

C
f


×
Vstim_AC






(
t
)






(
12
)







Thus, charge amplifier 601 outputs a signal whose amplitude is the stimulus amplitude Vamp_out(t) scaled by the gain (Csig/Cf) of the charge amplifier. In more general terms, sensor panel 124 adds an amplitude modulation to the drive signal, the amplitude modulation carrying information about something to be sensed, e.g. the a finger, water level, etc.


The output of charge amplifier 601 is fed into AAF 603. AAF 603 can attenuate noise components above the nyquist sampling limit of the ADC sufficiently to prevent those components from aliasing back into the operating frequency range of the multi-touch controller. Furthermore, AAF 603 can attenuate any noise outside the frequency operating range of the multi-touch controller and therefore helps to improve the Signal-to-Noise ratio. It also can be important to properly select the sampling clock FCLK_DAC of the TX DAC. Generating a signal of frequency FSTM at the TX DAC clock rate will introduce images in the spectrum of the TX DAC output signal at n*FCLK_DAC+/−FSTM whereas N=1, 2 . . . , to infinity. The images will appear in the composite signal entering the receive channel. Upon sampling the composite signal with the ADC in the receive channel, those images will be folded around the sampling frequency FCLK_ADC at which the ADC samples the composite touch signal. The output of the ADC therefore has the following frequency components: N*(FCLK_DAC+/−FCLK_ADC)+/−FSTM. If the DAC and ADC clock rate FCLK_DAC and FCLK_ADC, respectively, are the same frequency, these images appear in the pass-band. In the above example, one possible frequency component would be (FCLK_DAC −FCLK_ADC)+FSTM=FSTM and therefore would appear as a undesirable in band component which would lead to reduced SNR and therefore reduced touch performance. Therefore, it is beneficial to select a TX DAC sampling frequency FCLK_DAC that is different from the ADC sampling rate. This can prevent the images from folding back into the pass-band. In one embodiment, FCLK_DAC can be twice of the ADC clock rate FCLK_ADC. The two clock sources should be correlated, i.e. based on the same master clock. It can be beneficial to make the DAC sampling clock higher in frequency than the ADC sampling clock as DACs can consume less power than the power consumed by all ADCs combined for the same increase in sampling clock frequency.


The output of AAF 603 is converted by ADC 605 into a digital signal, which is sent from sense channel 307 to digital demodulation section 313. Digital demodulation section 313 demodulates the digital signal received from sense channel 307 using a homodyne mixing process in which the signal is multiplied with a demodulation signal of the same frequency. In order to increase the efficiency of the mixing process, it may be desirable to adjust the phase of the sense channel output signal to match the phase of the demodulation signal. Stimulating a pixel of sensor panel 124 with Vstim+ and processing the resulting sense signal as described above would result in the following output from sense channel 307:











V


sense_ch

_outV

+




(
t
)


=


Csig

C
f


×

V
0



sin


(


ω





t

+
θ

)







(
13
)









    • where: V0=the amplitude of the AC portion of Vstim=2.25V
      • θ=the relative phase delay between the signal output of ADC 605 and the demodulation signal for a given sense channel


        For stimulation with Vstim−, the resulting output from ADC 605 would be:














V


sense_ch

_outV

-




(
t
)


=


Csig

C
f


×

V
0



sin


(


ω





t

+

180

°

+
θ

)







(
14
)








The relative phase delay θ can be an aggregate of delays caused by various elements of the system, such as the geometry of the signal paths, the operation of the output buffers, etc. In general, the various delays in the system can be separated into two categories, delays that apply equally to all drive lines of a sense channel, referred to as global delays herein, and delays that vary among the drive lines of the sense channel, referred to as individual line delays herein. In other words, global delays affect all component signals of the composite sense signal equally, while individual line delays results in different amounts of delay for different component signals. The relative phase delay can be represented as:

θ=DCL+ϕ(R)  (15)

    • where: DCL=the sum of all global delays (referred to herein as the composite global delay) affecting a sense channel
      • ϕ(R)=the individual line delay associated with drive line R of a sense channel


        Substituting equation (15) into equations (13) and (14) yields:











V


sense_ch

_outV

+




(
t
)


=


Csig

C
f


×

V
0



sin


(


ω





t

+
DCL
+

ϕ


(
R
)



)







(
16
)








V


sense_ch

_outV

-




(
t
)


=


Csig

C
f


×

V
0



sin


(


ω





t

+

180

°

+
DCL
+

ϕ


(
R
)



)







(
17
)








Since the global delays affect all of the component signals of the sense signal equally, once the composite global delay DCL has been determined for a channel, the global portion of the phase delay of sense channel output signal can be removed by programmable delay 607, yielding:











V

mixer_inV
+




(
t
)


=


Csig

C
f


×

V
0



sin


(


ω





t

+

ϕ


(
R
)



)







(
18
)








V

mixer_inV
-




(
t
)


=


Csig

C
f


×

V
0



sin


(


ω





t

+

180

°

+

ϕ


(
R
)



)







(
19
)








as the signals corresponding to Vstim+ and Vstim−, respectively, that are input into mixer 609.


Since the individual line delays are different for different signal components of the sense signal, the individual line delays cannot be removed from the sense signal simply by using a single phase adjustment to the composite sense signal, such as the phase adjustment made by programmable delay 607. However, the individual line delays may be accounted for by the compensated phase matrix {tilde over (M)}comp−1, which is described in more detail below.


The phase-adjusted signal is sent from programmable delay 607 to mixer 609. Mixer 609 multiplies the phase-adjusted signal with a demodulation signal,

Vdemod=sin(ωt),  (20)

which is generated by RX NCO 319 based on a master oscillator 615. It is noted that the mixing is performed using digital signals. This can provide higher resolution than in some previous designs, which can result in improved suppression of noise.


The resulting demodulated signal output from mixer 609 as:











V

mixer_outV
+




(
t
)


=


1
2

×

Csig

C
f


×

V
0

×

(


cos


(

ϕ


(
R
)


)


-

cos


(


2

ω





t

+

ϕ


(
R
)



)



)






(
21
)








V

mixer_outV
-




(
t
)


=


1
2

×

Csig

C
f


×

V
0

×

(


cos


(


180

°

+

ϕ


(
R
)



)


-

cos


(


2

ω





t

+

180

°

+

ϕ


(
R
)



)



)






(
22
)








The mixer output is integrated by integrator 611, yielding:










V

int_outV
+


=


1
2

×

Csig

C
f


×

V
0

×

cos


(

ϕ


(
R
)


)







(
23
)







V

int_outV
-


=


1
2

×

Csig

C
f




V
0

×

cos


(


180

°

+

ϕ


(
R
)



)







(
24
)








Since the integrator has essentially a low pass response, the high frequency component cos(2 ωt+180°+ϕ(R)) is eliminated leaving only the DC component.


Scaling of the results in integrator 611 by a factor of 2Cf results in output signals:

Vint_scaledV+=V0×cos(ϕ(R))×Csig, if Vstim(R)=Vstim+  (25)
Vint_scaledV−=V0×cos(180°+ϕ(R))×Csig, if Vstim(R)=Vstim−  (26)

from integrator 611. In each step S in a scan of sensor panel 124, drive lines 204 are driven with either Vstim+ or Vstim− drive signals based on the MUX_SEL values in stim matrix 407 for that step, each stimulation signal generating a component output (25) or (26) of integrator 611 for each sense channel. Thus, for a channel C, the output of integrator 611 is a linear combination of corresponding components (25) and (26):












V

int_scaled

_tot

_C




(
S
)


=



V
0

×


W
C



(

0
,
S

)


×

Csig


(
0
)



+


V
0

×


W
C



(

1
,
S

)


×

Csig


(
1
)



+








V
0

×


W
C



(


M


-


1

,
S

)


×

Csig


(

M


-


1

)












where


:








W
C



(

R
,
S

)



=

{






cos


(


ϕ
C



(
R
)


)





if



Vstim


(

R
,
S

)



=

Vstim
+









cos


(


180

°

+


ϕ
C



(
R
)



)





if



Vstim


(

R
,
S

)



=

Vstim
-











(
27
)








The right hand side of equation (27) is the same as the right hand side of equation (7), with V0 equal to the amplitude, Vstim, of the stimulation signals and WC(R,S) equal to the components of the compensated phase matrix {tilde over (M)}C_comp. Therefore, the output voltage of integrator 611, Vint_scaled_tot_C(S), at each step is simply the composite signal charge Qsig_totC(S).


The Qsig_totC values output by a channel's integrator 611 are posted to result memory 315, forming a Qsig_totC vector:











Qsig_tot
C



(
S
)


=

[





Qsig_tot
C



(
0
)








Qsig_tot
C



(
1
)








Qsig_tot
C



(
2
)






















Qsig_tot
C



(

P
-
1

)





]





(
28
)








that is used in a decoding operation to determine the Csig values for that channel. An example vector decode operation according to embodiments of the invention will now be described. Referring to FIG. 3, vector operator 317 reads the Qsig_totC vector from memory 315 and reads the decode matrix








M
~

C_comp

-
1


Vstim





from decode matrix RAM 321. Vector operator 317 then performs vector multiplication of the Qsig_totC vector and the decode matrix








M
~

C_comp

-
1


Vstim





according to equation (9) to obtain the CsigC vector for channel C:











C
~



sig
C


=

[





Csig
C



(
0
)








Csig
C



(
1
)








Csig
C



(
2
)






















Csig
C



(

M
-
1

)





]





(
29
)








The CsigC vector is posted to result RAM 323, where it can be read by other systems, such as processor subsystem 102, host processor 128, etc., for sensing touch by comparing the CsigC vector components with known, static (no touch) values for Csig, for example.



FIG. 7 shows the 2nd stage of the multi-stage vector demodulation engine 109. Upon assertion of signal START_FRAME, the vector demodulation engine, step counter and registers are reset. After the first step multipliers 701 (one for each drive line, 0 to M−1) multiply the digital representation of Qsig_totC available at the output of integrator 611 and stored in result memory 315 with a corresponding decode matrix coefficient stored in {tilde over (M)}C_comp−1 for step 0, and the result is accumulated in accumulators 703 (1 to 16), respectively, after assertion of signal LOAD_STEP. After the 2nd step, multipliers 701 (0 to M−1) multiply the digital representation of Qsig_totC available at the output of integrator 611 with a decode matrix coefficient MC_comp−1 for step 1 and the result is accumulated in accumulators 703 (1 to 16), respectively, after assertion of signal LOAD_STEP. This process is repeated until the data for the last step P have been processed, at which time the accumulated data in accumulators 1 to 16, which are now representative of pixel data CsigC, are stored in the result register RAM 323 after assertion of signal LOAD_PIXEL. Note that signal LOAD_STEP also resets the first stage of the multi-stage vector demodulation engine 109 at the end of a given step in preparation for processing the composite data of the next step. The 2nd stage of the multi-stage vector demodulation engine essentially performs the operation in equation (9). Multipliers 701 (1-16) and accumulators 703 (1-16) need not be implemented as separate multipliers, but can be implemented with a single multiplier and accumulator that can be shared (i.e. time multiplexed) between multiple channels. An example of this is described in U.S. patent application Ser. No. 12/208,303, titled “ADVANCED RECEIVE CHANNEL ARCHITECTURE” by Thomas Wilson, which is being filed on the same day as the present application, and the contents of which is incorporated herein by reference in entirety for all purposes.


Implementing a multi-stage vector demodulation such as the in the present example may provide a more flexible system than conventional designs. For example, the vector operation can allow for selection and testing of arbitrary vectors, allowing system designers to test and implement different stimulation matrix/decode matrix combinations, for example, without the need to extensive redesign of the sensing system. Likewise, use of a vector operation stage may allow the sensing system to use matrices that are not easily invertible. For example, a Hadamard stimulation matrix containing 0s, 1s, and −1s only (in order to stimulate with a single frequency of phase 0° or 180°) has an inverse that contains just 0s, 1s, and −1s. However, the inverse of a circulant matrix, for example, contains fractional numbers. The current implementation, using matrix decode, allows the use of matrices such as a circulant matrix. In another potential benefit, scaling a system may be easier to accomplish. For example, in the case that the drivers on a chip are not uniform (e.g., in a case that the manufacturing process for the chip does not produce uniform drivers), the channels may be more easily scaled to reduce or correct the mismatch.


Referring to FIG. 3, an example optional feature according to embodiments of the invention will now be described. FIG. 3 illustrates that, in addition to receiving sense signals from sense channels 307, digital demod section 313 also can receive signals from other channels, such as miscellaneous channels 305 (see FIG. 3), which may include signals from e.g., sensor 111 (see FIG. 1). Sensor 111 can be, e.g., infrared sensors, temperature sensors, ambient light sensors, proximity sensors, etc. These miscellaneous channel signals may be used, for example, to calibrate the system, for example, during the demod/decode process, to display information, for additional sensing, for far field detection, etc. The miscellaneous channel signals may be demodulated and/or decoded similar to the sense signals, described above.



FIG. 8 illustrates an example receive NCO 801 according to embodiments of the invention. The RX NCO is comprised of a sine phase accumulator 803, sine lookup table 805, mixer 807, amplitude phase accumulator 809 and amplitude lookup table 811. The programmable phase increment sine_phase_inc determines the frequency of the demodulation waveform. The phase accumulator 803 accumulates the sine phase increment sine_phase_inc. The output of the sine phase accumulator 803 represents an address into the sine lookup table 805. The synthesized waveform out of the sine lookup table 805 has a constant amplitude which then is envelope shaped by multiplying it with the envelope. The envelope shape is stored in an amplitude table 811 and is retrieved from the amplitude LUT at a rate set by the amplitude phase increment amp_phase_inc. Similarly to the sine phase increment, the amplitude phase increment amp_phase_inc is accumulated by an amplitude phase accumulator 809. The output of the amplitude phase accumulator 809 represents an address into the amplitude RAM. For example, the sine lookup table 805 may store 2048 coefficients, representing exactly one sine-wave cycle. The sine phase increment may be a 16 bit number, i.e. the phase accumulator 809 is also 16 bits. Since the sine lookup table 805 stores 2048 coefficients, representing an address space of 11 bits, only the upper 11 bits out of the sine phase accumulator 809 would be passed into the address port of the sine lookup table. Assuming that the demodulation waveform is generated at the ADC clock rate, FCLK_ADC, the phase increment for a given stimulus frequency FSTM may be phase_inc=2^16*FSTM/FCLK_ADC. The benefit of having envelope shaping is that the spectral properties of the passband of the demodulation can be precisely controlled. The frequency response of the demodulation is essentially the convolution of the time domain representation of the envelope and the sine wave out of the sine lookup table 805. For example, for a rectangular window the frequency domain representation the demodulation would be a single frequency component convoluted with the time domain representation of the rectangular window (sinc function sin(x)/x). By using appropriate window functions such as Chebychev or Gaussian windows, the passband response can be optimized to fit a given application. The TX NCO may be constructed in a similar fashion and may or may not feature envelope shaping.


In addition to stimulating scanning touch sensor panel 124 to detect touch events, touch controller 106 can perform other functions. For example, controller 106 can perform a spectrum analyzer function prior to actively scanning panel 124 for touch detection. In a spectrum analyzer function, controller 106 drives panel 124 with drive signals of different frequencies in order to determine one or more frequencies that have the lowest noise. The low-noise frequency or frequencies can then be used to drive panel 124 during the active scanning phase. An example spectrum analyzer function is disclosed in U.S. patent application Ser. No. 12/208,334, titled “SINGLE-CHIP TOUCH CONTROLLER WITH INTEGRATED DRIVE SYSTEM” by Christoph Horst Krah, Steve Porter Hotelling, Marduke Yousefpor and Tom Wilson, which is being filed on the same day as the present application, and which is a Continuation-In-Part (CIP) application of U.S. patent application Ser. No. 11/818,345, filed Jun. 13, 2007, the contents of both applications are incorporated herein by reference in entirety for all purposes.



FIG. 9a illustrates example mobile telephone 936 that can include touch sensor panel 924 and display device 930, the touch sensor panel including a single-chip multi-stimulus controller according to embodiments of the invention.



FIG. 9b illustrates example digital media player 940 that can include touch sensor panel 924 and display device 930, the touch sensor panel including a single-chip multi-stimulus controller according to embodiments of the invention.



FIG. 9c illustrates example personal computer 944 that can include touch sensor panel (trackpad) 924 and display 930, the touch sensor panel and/or display of the personal computer (in embodiments where the display is part of a touch screen) including a single-chip multi-stimulus controller according to embodiments of the invention.


Although embodiments of this invention have been fully described with reference to the accompanying drawings, it is to be noted that various changes and modifications will become apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of embodiments of this invention as defined by the appended claims.

Claims
  • 1. An integrated multi-touch controller comprising: drive circuitry configured to be coupled to drive lines of a touch sensor panel and capable of applying a plurality of stimulation signals simultaneously to a plurality of the drive lines;receive circuitry configured to be coupled to sense lines of the touch sensor panel and capable of receiving sense signals generated in response to the plurality of stimulation signals; andprocessing circuitry coupled to the receive circuitry, the processing circuitry comprising: a demodulator capable of obtaining first capacitance measurements from the sense signals; anda decoder capable of obtaining second capacitance measurements corresponding to sensing nodes from the first capacitance measurements.
  • 2. The integrated multi-touch controller of claim 1, wherein the drive circuitry comprises a transmit oscillator, wherein the plurality of stimulation signals are generated by the drive circuitry based on a frequency of the transmit oscillator.
  • 3. The integrated multi-touch controller of claim 2, wherein the drive circuitry further comprises: transmit logic capable of generating one or more digital signals from signals received from the transmit oscillator;one or more digital-to-analog converters (DACs), the one or more DACs capable of receiving the one or more digital signals from the transmit logic and generating one or more analog signals;a bus capable of receiving the one or more analog signals from the one or more DACs; andswitching circuitry connected to the bus and capable of selecting, for each of the plurality of the drive lines, one of a plurality of bus signals for transmission to the drive lines, wherein the plurality of bus signals includes the one or more analog signals from the one or more DACs.
  • 4. The integrated multi-touch controller of claim 3, wherein the drive circuitry further comprises: a plurality of analog output buffers connected to the switching circuitry configured to buffer, for each of the plurality of the drive lines, the one of the plurality of bus signals selected by the switching circuitry for transmission to the touch sensor panel as one of the plurality of stimulation signals.
  • 5. The integrated multi-touch controller of claim 3, wherein the plurality of bus signals includes a first signal having a first frequency matching a frequency of the transmit oscillator and a first phase, and a second stimulation signal having second frequency matching the frequency of the transmit oscillator and a second phase, the second phase different than the first phase.
  • 6. The integrated multi-touch controller of claim 3, wherein the plurality of bus signals include at least one common voltage signal, the common voltage signal comprising a direct current (DC) signal or a ground (GND).
  • 7. The integrated multi-touch controller of claim 3, wherein the one or more DACs consist of a single DAC, the single DAC capable of outputting two alternating current (AC) signals at a common frequency and with a 180° phase difference.
  • 8. The integrated multi-touch controller of claim 1, further comprising a first memory, wherein the first memory stores parameters specifying which of the plurality of stimulation signals the drive circuitry applies to the plurality of the drive lines during a touch-sensing scan of the touch sensor panel.
  • 9. The integrated multi-touch controller of claim 1, wherein the receive circuitry comprises a plurality of sense channels, each sense channel including: a charge amplifier;a filter; andan analog-to-digital converter (ADC).
  • 10. The integrated multi-touch controller of claim 9, wherein the receive circuitry further comprises offset compensation circuitry capable of subtracting a charge offset from the sense signals.
  • 11. The integrated multi-touch controller of claim 1, wherein the demodulator comprises a plurality of mixers configured to mix each of the sense signals with a demodulation signal to obtain the first capacitance measurements.
  • 12. The integrated multi-touch controller of claim 1, wherein obtaining the second capacitance measurements corresponding to the sensing nodes from the first capacitance measurements comprises decoding the first capacitance measurements based on a plurality of parameters used to generate the plurality of stimulation signals.
  • 13. The integrated multi-touch controller of claim 12, wherein decoding the first capacitance measurements is based on a second plurality of parameters, the second plurality of parameters based on an inverse of the plurality of parameters used to generate the plurality of stimulation signals.
  • 14. The integrated multi-touch controller of claim 13, wherein the second plurality of parameters includes adjustments to compensate for differences in phase delays among the sensing nodes corresponding to the second capacitance measurements.
  • 15. The integrated multi-touch controller of claim 11, the processing circuitry further comprising: a receive oscillator configured to output the demodulation signal to the demodulator.
  • 16. The integrated multi-touch controller of claim 15, wherein the receive oscillator forms the demodulation signal by generating a periodic waveform and mixing the periodic waveform with an envelope waveform.
  • 17. The integrated multi-touch controller of claim 11, wherein the demodulator is further capable of applying a programmable delay to each of the sense signals to match a phase of the demodulation signal.
  • 18. The integrated multi-touch controller of claim 11, wherein the demodulator further comprises a plurality of integrators, wherein each integrator is capable of integrating an output from one of the plurality of mixers to obtain the first capacitance measurements.
  • 19. The integrated multi-touch controller of claim 1, further comprising one or more memory circuits, wherein the first capacitance measurements and the second capacitance measurements are stored in the one or more memory circuits.
  • 20. The integrated multi-touch controller of claim 1, wherein demodulating and decoding the sense signals are performed using digital signals.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of U.S. patent application Ser. No. 15/270,950, filed Sep. 20, 2016 and published on Jan. 12, 2017 as U.S. Patent Publication No. 2017/0010744, which is a continuation of U.S. patent application Ser. No. 14/704,885, filed May 5, 2015 and issued on Nov. 1, 2016 as U.S. Pat. No. 9,483,141, which is a continuation application of U.S. patent application Ser. No. 14/056,841, filed Oct. 17, 2013 and issued on Jun. 30, 2015 as U.S. Pat. No. 9,069,408, which is a continuation application of U.S. patent application Ser. No. 12/283,423, filed Sep. 10, 2008, and issued on Nov. 26, 2013 as U.S. Pat. No. 8,592,697, the contents of which are incorporated herein by reference in their entirety for all purposes.

US Referenced Citations (222)
Number Name Date Kind
3342935 Leifer et al. Sep 1967 A
3732369 Cotter May 1973 A
3767858 Rodgers Oct 1973 A
3818133 Cotter Jun 1974 A
3875472 Schermerhorn Apr 1975 A
3886539 Gould, Jr. May 1975 A
4071691 Pepper, Jr. Jan 1978 A
4080515 Anderson Mar 1978 A
4103252 Bobick Jul 1978 A
4129747 Pepper, Jr. Dec 1978 A
4444998 House Apr 1984 A
4550221 Mabusth Oct 1985 A
4560830 Perl Dec 1985 A
4680429 Murdock et al. Jul 1987 A
4698460 Krein et al. Oct 1987 A
4733222 Evans Mar 1988 A
4853498 Meadows et al. Aug 1989 A
4916308 Meadows Apr 1990 A
4922061 Meadows et al. May 1990 A
5105186 May Apr 1992 A
5270711 Knapp Dec 1993 A
5305017 Gerpheide Apr 1994 A
5355149 Casebolt Oct 1994 A
5357266 Tagawa Oct 1994 A
5483261 Yasutake Jan 1996 A
5488204 Mead et al. Jan 1996 A
5495077 Miller et al. Feb 1996 A
5526294 Ono et al. Jun 1996 A
5543590 Gillespie et al. Aug 1996 A
5565658 Gerpheide et al. Oct 1996 A
5606346 Kai Feb 1997 A
5621425 Hoshino et al. Apr 1997 A
5650597 Redmayne Jul 1997 A
5650801 Higashi Jul 1997 A
5686705 Conroy et al. Nov 1997 A
5766463 Janik et al. Jun 1998 A
5790107 Kasser et al. Aug 1998 A
5816225 Koch et al. Oct 1998 A
5825352 Bisset et al. Oct 1998 A
5831600 Inoue et al. Nov 1998 A
5835079 Shieh Nov 1998 A
5838308 Knapp et al. Nov 1998 A
5861583 Schediwy et al. Jan 1999 A
5880411 Gillespie et al. Mar 1999 A
5920309 Bisset et al. Jul 1999 A
5945980 Moissev et al. Aug 1999 A
5996082 Cortopassi Nov 1999 A
6025726 Gershenfeld Feb 2000 A
6043810 Kim et al. Mar 2000 A
6057903 Colgan et al. May 2000 A
6075520 Inoue et al. Jun 2000 A
6177918 Colgan et al. Jan 2001 B1
6188391 Seely et al. Feb 2001 B1
6204897 Colgan et al. Mar 2001 B1
6222528 Gerpheide Apr 2001 B1
6246729 Richardson Jun 2001 B1
6310610 Beaton et al. Oct 2001 B1
6323846 Westerman et al. Nov 2001 B1
6327011 Kim Dec 2001 B2
6380931 Gillespie et al. Apr 2002 B1
6424094 Feldman Jul 2002 B1
6429857 Masters et al. Aug 2002 B1
6452514 Philipp Sep 2002 B1
6483498 Colgan et al. Nov 2002 B1
6492979 Kent et al. Dec 2002 B1
6501529 Kurihara et al. Dec 2002 B1
6559658 Brandt May 2003 B1
6583676 Krah et al. Jun 2003 B2
6621484 Yee Sep 2003 B1
6680448 Kawashima et al. Jan 2004 B2
6690387 Zimmerman et al. Feb 2004 B2
6730863 Gerpheide et al. May 2004 B1
6816750 Klaas Nov 2004 B1
7015894 Morohoshi Mar 2006 B2
7030782 Ely et al. Apr 2006 B2
7031886 Hargreaves Apr 2006 B1
7042444 Cok May 2006 B2
7050046 Park et al. May 2006 B1
7129935 Mackey Oct 2006 B2
7129939 Toyozawa et al. Oct 2006 B2
7133032 Cok Nov 2006 B2
7184064 Zimmerman et al. Feb 2007 B2
7202856 Cok Apr 2007 B2
7230608 Cok Jun 2007 B2
7230609 Chao et al. Jun 2007 B2
7277087 Hill et al. Oct 2007 B2
7280167 Choi et al. Oct 2007 B2
7289142 Silverbrook Oct 2007 B2
7339499 Khlat Mar 2008 B2
7362313 Geaghan et al. Apr 2008 B2
7372455 Perski et al. May 2008 B2
7379054 Lee May 2008 B2
7436393 Hong et al. Oct 2008 B2
7643011 O'Connor et al. Jan 2010 B2
7649524 Haim et al. Jan 2010 B2
7663607 Hotelling et al. Feb 2010 B2
7812827 Hotelling et al. Oct 2010 B2
7859522 Takahashi et al. Dec 2010 B2
7986193 Krah Jul 2011 B2
8026904 Westerman Sep 2011 B2
8144125 Peng Mar 2012 B2
8144126 Wright Mar 2012 B2
8232970 Krah et al. Jul 2012 B2
8237667 Krah Aug 2012 B2
8479122 Hotelling et al. Jul 2013 B2
8493331 Krah et al. Jul 2013 B2
8514185 Hotelling Aug 2013 B2
8552998 Hotelling et al. Oct 2013 B2
8592697 Hotelling et al. Nov 2013 B2
8659556 Wilson Feb 2014 B2
8754867 Krah et al. Jun 2014 B2
8791920 Krah Jul 2014 B2
8928617 Hotelling et al. Jan 2015 B2
8976124 Wright Mar 2015 B1
8988390 Krah et al. Mar 2015 B1
9086750 Krah Jul 2015 B2
9092086 Krah et al. Jul 2015 B2
9348451 Wilson et al. May 2016 B2
9430087 Krah et al. Aug 2016 B2
9552115 Hotelling et al. Jan 2017 B2
9606663 Yousefpor et al. Mar 2017 B2
20020015024 Westerman et al. Feb 2002 A1
20020067348 Masters et al. Jun 2002 A1
20020067845 Griffis Jun 2002 A1
20020084992 Agnew Jul 2002 A1
20020136269 Kurabe et al. Sep 2002 A1
20020140689 Huang et al. Oct 2002 A1
20020196066 Krah et al. Dec 2002 A1
20030025676 Cappendijk Feb 2003 A1
20030048261 Yamamoto et al. Mar 2003 A1
20030063073 Geaghan et al. Apr 2003 A1
20030067447 Geaghan et al. Apr 2003 A1
20030132922 Philipp Jul 2003 A1
20030157893 Peeples Aug 2003 A1
20030197691 Fujiwara et al. Oct 2003 A1
20040056845 Harkcom et al. Mar 2004 A1
20040081339 Benkley, III Apr 2004 A1
20040109097 Mai Jun 2004 A1
20040141096 Mai Jul 2004 A1
20040151235 Olson et al. Aug 2004 A1
20040183833 Chua Sep 2004 A1
20040189587 Jung et al. Sep 2004 A1
20040227743 Brown Nov 2004 A1
20050052427 Wu et al. Mar 2005 A1
20050052582 Mai Mar 2005 A1
20050094038 Choi et al. May 2005 A1
20050104867 Westerman et al. May 2005 A1
20050146512 Hill et al. Jul 2005 A1
20050146513 Hill et al. Jul 2005 A1
20050151727 Kwong Jul 2005 A1
20050231487 Ming Oct 2005 A1
20050243023 Reddy et al. Nov 2005 A1
20060007165 Yang et al. Jan 2006 A1
20060022955 Kennedy Feb 2006 A1
20060022959 Geaghan Feb 2006 A1
20060114247 Brown Jun 2006 A1
20060114650 Wang et al. Jun 2006 A1
20060132462 Geaghan Jun 2006 A1
20060145365 Halls et al. Jul 2006 A1
20060146033 Chen et al. Jul 2006 A1
20060146034 Chen et al. Jul 2006 A1
20060161870 Hotelling et al. Jul 2006 A1
20060197750 Kerr et al. Sep 2006 A1
20060197753 Hotelling Sep 2006 A1
20060244736 Tseng Nov 2006 A1
20060279548 Geaghan Dec 2006 A1
20070018969 Chen et al. Jan 2007 A1
20070062739 Philipp et al. Mar 2007 A1
20070075977 Chen et al. Apr 2007 A1
20070109274 Reynolds May 2007 A1
20070176905 Shih et al. Aug 2007 A1
20070216657 Konicek Sep 2007 A1
20070229468 Peng et al. Oct 2007 A1
20070257890 Hotelling et al. Nov 2007 A1
20070262967 Rho Nov 2007 A1
20070268272 Perski et al. Nov 2007 A1
20070273663 Park et al. Nov 2007 A1
20070274411 Lee et al. Nov 2007 A1
20080006453 Hotelling Jan 2008 A1
20080012835 Rimon et al. Jan 2008 A1
20080018618 Hill et al. Jan 2008 A1
20080042964 Sako et al. Feb 2008 A1
20080048989 Yoon et al. Feb 2008 A1
20080048994 Lee et al. Feb 2008 A1
20080055221 Yabuta et al. Mar 2008 A1
20080055268 Yoo et al. Mar 2008 A1
20080062147 Hotelling et al. Mar 2008 A1
20080067528 Choi et al. Mar 2008 A1
20080074401 Chung et al. Mar 2008 A1
20080079697 Lee et al. Apr 2008 A1
20080088594 Liu et al. Apr 2008 A1
20080129898 Moon Jun 2008 A1
20080136980 Rho et al. Jun 2008 A1
20080143683 Hotelling Jun 2008 A1
20080150901 Lowles et al. Jun 2008 A1
20080156546 Hauck Jul 2008 A1
20080157867 Krah Jul 2008 A1
20080158167 Hotelling et al. Jul 2008 A1
20080158169 O'Connor et al. Jul 2008 A1
20080158172 Hotelling et al. Jul 2008 A1
20080158180 Krah et al. Jul 2008 A1
20080158184 Land et al. Jul 2008 A1
20080165203 Pantfoerder Jul 2008 A1
20080278143 Cox et al. Nov 2008 A1
20080309625 Krah et al. Dec 2008 A1
20080309628 Krah et al. Dec 2008 A1
20090009483 Hotelling et al. Jan 2009 A1
20090189867 Krah et al. Jul 2009 A1
20090283340 Liu et al. Nov 2009 A1
20090314621 Hotelling Dec 2009 A1
20100060589 Wilson Mar 2010 A1
20100060608 Yousefpor Mar 2010 A1
20100328265 Hotelling et al. Dec 2010 A1
20110084857 Marino et al. Apr 2011 A1
20120044194 Peng et al. Feb 2012 A1
20120280932 Krah et al. Nov 2012 A1
20140022203 Karpin et al. Jan 2014 A1
20140092063 Krah Apr 2014 A1
20140168143 Hotelling et al. Jun 2014 A1
20160266718 Wilson et al. Sep 2016 A1
20160364078 Krah et al. Dec 2016 A1
20170097728 Hotelling et al. Apr 2017 A1
Foreign Referenced Citations (27)
Number Date Country
1175315 Mar 1998 CN
1254902 May 2000 CN
1773442 May 2006 CN
1914585 Feb 2007 CN
0 818 751 Jan 1998 EP
1 387 242 Feb 2004 EP
1 387 242 Feb 2004 EP
2 453 341 May 2012 EP
1 440 130 Jun 1976 GB
2 451 973 Feb 2009 GB
2 451 973 Feb 2009 GB
2000-163031 Jun 2000 JP
2002-342033 Nov 2002 JP
1998-0010726 Apr 1998 KR
WO-9618179 Jun 1996 WO
WO-9802964 Jan 1998 WO
WO-9807127 Feb 1998 WO
WO-2004099964 Nov 2004 WO
WO-2004099964 Nov 2004 WO
WO-2008010917 Jan 2008 WO
WO-2008085416 Jul 2008 WO
WO-2008085457 Jul 2008 WO
WO-2008085457 Jul 2008 WO
WO-2008085719 Jul 2008 WO
WO-2008157245 Dec 2008 WO
WO-2010-030706 Mar 2010 WO
WO-2010030709 Mar 2010 WO
Non-Patent Literature Citations (92)
Entry
Non-Final Office Action dated Jan. 31, 2018, for U.S. Appl. No. 15/380,747, filed Dec. 15, 2016, six pages.
Chinese Search Report dated Nov. 24, 2011, for CN Application No. ZL2008201335089, with English Translation, nine pages.
European Search Report dated Apr. 17, 2012, for EP Patent Application No. 11188985.3, six pages.
European Search Report dated Oct. 4, 2016, for EP Patent Application No. 16178444.2, four pages.
Fakatselis, J. (Aug. 1996). “Processing Gain for Direct Sequence Spread Spectrum Communication Systems and PRISM®,” Application Note AN9633, Intersil, four pages.
Final Office Action dated Feb. 1, 2011, for U.S. Appl. No. 11/818,345, filed Jun. 13, 2007, 20 pages.
Final Office Action dated May 3, 2011, for U.S. Appl. No. 11/650,046, filed Jan. 3, 2007, nine pages.
Final Office Action dated Sep. 1, 2011, for U.S. Appl. No. 12/874,184, filed Sep. 1, 2010, 19 pages.
Final Office Action dated Aug. 17, 2012, for U.S. Appl. No. 13/250,984, filed Sep. 30, 2011, 14 pages.
Final Office Action dated Aug. 28, 2012, for U.S. Appl. No. 12/283,423, filed Sep. 10, 2008, nine pages.
Final Office Action dated Oct. 12, 2012, for U.S. Appl. No. 12/208,315, filed Sep. 10, 2008, 21 pages.
Final Office Action dated Dec. 5, 2013, for U.S. Appl. No. 12/208,315, filed Sep. 10, 2008, 22 pages.
Final Office Action dated Dec. 30, 2013, for U.S. Appl. No. 12/208,329, filed Sep. 10, 2008, 12 pages.
Final Office Action dated Oct. 7, 2014, for U.S. Appl. No. 12/208,315, filed Sep. 10, 2008, 28 pages.
Final Office Action dated Feb. 26, 2015, for U.S. Appl. No. 12/208,329, filed Sep. 10, 2008, 13 pages.
Final Office Action dated Dec. 24, 2015, for U.S. Appl. No. 12/208,315, filed Sep. 10, 2008, 28 pages.
Final Office Action dated Feb. 4, 2016, for U.S. Appl. No. 14/482,979, filed Sep. 10, 2014, 12 pages.
Final Office Action dated Jun. 1, 2017, for U.S. Appl. No. 15/158,461, filed May 18, 2016, 17 pages.
International Search Report dated Jun. 11, 2008, for PCT Application No. PCT/US2007/026177, filed Dec. 21, 2007, three pages.
International Search Report dated Apr. 6, 2009, for PCT Application No. PCT/US2007/088750, filed Dec. 21, 2007, six pages.
International Search Report dated Oct. 30, 2009, for PCT Application No. PCT/US2008/066743, filed Jun. 12, 2008, six pages.
International Search Report dated Dec. 21, 2009, for PCT Application No. PCT/US2009/056413, filed Sep. 9, 2009, three pages.
International Search Report dated Dec. 22, 2009, for PCT Application No. PCT/US2009/056410, filed Sep. 9, 2009, three pages.
Kanda, E. et al. (2008). “55.2: Integrated Active Matrix Capacitive Sensors for Touch Panel LTPS-TFT LCDs,” SID 08 Digest, pp. 834-837.
Lee, S.K. et al. (Apr. 1985). “A Multi-Torch Three Dimensional Touch-Sensitive Tablet,” Proceedings of CHI: ACM Conference on Human Factors in Computing Systems, pp. 21-25.
Non-Final Office Action dated Nov. 4, 2009, for U.S. Appl. No. 11/619,433, filed Jan. 3, 2007, 33 pages.
Non-Final Office Action dated May 12, 2010, for U.S. Appl. No. 11/818,345, filed Jun. 13, 2007, 27 pages.
Non-Final Office Action dated Jun. 8, 2010, for U.S. Appl. No. 11/650,046, filed Jan. 3, 2007, 11 pages.
Non-Final Office Action dated Nov. 22, 2010, for U.S. Appl. No. 11/650,046, filed Jan. 3, 2007, 10 pages.
Non-Final Office Action dated Apr. 27, 2011, for U.S. Appl. No. 12/874,184, filed Sep. 1, 2010, 18 pages.
Non-Final Office Action dated May 20, 2011, for U.S. Appl. No. 12/283,435, filed Sep. 10, 2008, six pages.
Non-Final Office Action dated Sep. 8, 2011, for U.S. Appl. No. 12/208,334, filed Sep. 10, 2008, 16 pages.
Non-Final Office Action dated Nov. 7, 2011, for U.S. Appl. No. 13/250,984, filed Sep. 30, 2011, nine pages.
Non-Final Office Action dated Nov. 17, 2011, for U.S. Appl. No. 12/283,423, filed Sep. 10, 2008, nine pages.
Non-Final Office Action dated Nov. 25, 2011, for U.S. Appl. No. 12/208,329, filed Sep. 10, 2008, 31 pages.
Non-Final Office Action dated Dec. 19, 2011, for U.S. Appl. No. 12/208,315, filed Sep. 10, 2008, 21 pages.
Non-Final Office Action dated Apr. 13, 2012, for U.S. Appl. No. 13/250,984, filed Sep. 30, 2011, 14 pages.
Non-Final Office Action dated May 2, 2012, for U.S. Appl. No. 12/874,184, filed Sep. 1, 2010, 20 pages.
Non-Final Office Action dated Sep. 28, 2012, U.S. Appl. No. 12/208,329, filed Sep. 10, 2008, 33 pages.
Non-Final Office Action dated Oct. 5, 2012, for U.S. Appl. No. 13/568.027, filed Aug. 6, 2012, six pages.
Non-Final Office Action dated Oct. 25, 2012, for U.S. Appl. No. 12/874,184, filed Sep. 1, 2010, 23 pages.
Non-Final Office Action dated Dec. 7, 2012, for U.S. Appl. No. 13/250,984, filed Sep. 30, 2011, 10 pages.
Non-Final Office Action dated Apr. 23, 2013, for U.S. Appl. No. 13/568,027, filed Aug. 6, 2012, 8 pages.
Non-Final Office Action dated Apr. 25, 2013, for U.S. Appl. No. 13/553,421, filed Jul. 19, 2012, 10 pages.
Non-Final Office Action dated Apr. 30, 2013, for U.S. Appl. No. 12/208,315, filed Sep. 10, 2008, 21 pages.
Non-Final Office Action dated Aug. 23, 2013, for U.S. Appl. No. 13/916,357, filed Jun. 12, 2013, 17 pages.
Non-Final Office Action dated Aug. 29, 2013, for U.S. Appl. No. 12/208,329, filed Sep. 10, 2008, 13 pages.
Non-Final Office Action dated Mar. 14, 2014, for U.S. Appl. No. 12/208,315, filed Sep. 10, 2008, 25 pages.
Non-Final Office Action dated May 13, 2014, for U.S. Appl. No. 14/056,841, filed Oct. 17, 2013, seven pages.
Non-Final Office Action dated Jun. 6, 2014, for U.S. Appl. No. 12/208,329, filed Sep. 10, 2008, 12 pages.
Non-Final Office Action dated Sep. 29, 2014, for U.S. Appl. No. 14/315,162, filed Jun. 25, 2014, seven pages.
Non-Final Office Action dated May 14, 2015, for U.S. Appl. No. 12/208,315, filed Sep. 10, 2008, 25 pages.
Non-Final Office Action dated Jul. 29, 2015, for U.S. Appl. No. 14/482,979, filed Sep. 10, 2014, 19 pages.
Non-Final Office Action dated Dec. 14, 2015, for U.S. Appl. No. 12/208,329, filed Sep. 10, 2008, 14 pages.
Non-Final Office Action dated Aug. 8, 2016, for U.S. Appl. No. 15/158,461, filed May 18, 2016, 15 pages.
Non-Final Office Action dated Oct. 28, 2016, for U.S. Appl. No. 15/270,950, filed Sep. 20, 2016, six pages.
Notice of Allowance dated Jun. 7, 2010, for U.S. Appl. No. 11/619,433, filed Jan. 3, 2007, 10 pages.
Notice of Allowance dated Mar. 28, 2012, for U.S. Appl. No. 11/650,046, filed Jan. 3, 2007, seven pages.
Notice of Allowance dated Apr. 5, 2012, for U.S. Appl. No. 12/283,435, filed Sep. 10, 2008, seven pages.
Notice of Allowance dated Mar. 21, 2013, for U.S. Appl. No. 12/208,329, filed Sep. 10, 2008, 14 pages.
Notice of Allowance dated Apr. 8, 2013, for U.S. Appl. No. 11/818,345, filed Jun. 13, 2007, 14 pages.
Notice of Allowance dated May 23, 2013, for U.S. Appl. No. 13/250,984, flied Sep. 30, 2011, 10 pages.
Notice of Allowance dated Jun. 4, 2013, for U.S. Appl. No. 12/874,184, filed Sep. 1, 2010, 12 pages.
Notice of Allowance dated Aug. 23, 2013, for U.S. Appl. No. 13/250,984, filed Sep. 30, 2011, 10 pages.
Notice of Allowance dated Aug. 29, 2013, for U.S. Appl. No. 12/283,423, filed Sep. 10, 2008, eight pages.
Notice of Allowance dated Sep. 27, 2013, for U.S. Appl. No. 13/553,421, filed Jul. 19, 2012, 8 pages.
Notice of Allowance dated Nov. 25, 2013, for U.S. Appl. No. 13/568,027, filed Aug. 6, 2012, nine pages.
Notice of Allowance dated Feb. 6, 2014, for U.S. Appl. No. 13/916,357, filed Jun. 12, 2013, 25 pages.
Notice of Allowance dated Mar. 11, 2014, for U.S. Appl. No. 13/568,027, filed Aug. 6, 2012, eight pages.
Notice of Allowance dated Jun. 13, 2014, for U.S. Appl. No. 14/019,264, filed Sep. 5, 2013, 13 pages.
Notice of Allowance dated Dec. 3, 2014, for U.S. Appl. No. 13/935,333, filed Jul. 3, 2013, nine pages.
Notice of Allowance dated Jan. 15, 2015, for U.S. Appl. No. 14/056,841, filed Oct. 17, 2013, ten pages.
Notice of Allowance (corrected) dated Mar. 19, 2015, for U.S. Appl. No. 14/056,841, filed Oct. 17, 2013, seven pages.
Notice of Allowance dated Mar. 25, 2015, for U.S. Appl. No. 14/270,147, filed May 5, 2014, nine pages.
Notice of Allowance dated May 18, 2015, for U.S. Appl. No. 14/315,162, filed Jun. 25, 2014, eights pages.
Notice of Allowance dated Mar. 14, 2016, for U.S. Appl. No. 12/208,315, filed Sep. 10, 2008, 12 pages.
Notice of Allowance dated May 11, 2016, for U.S. Appl. No. 14/791,145, filed Jul. 2, 2015, 17 pages.
Notice of Allowance dated Jul. 15, 2016, for U.S. Appl. No. 14/704,885, filed May 5, 2015, seven pages.
Notice of Allowance dated Aug. 29, 2016, for U.S. Appl. No. 14/482,979, filed Sep. 10, 2014, 15 pages.
Notice of Allowance dated Sep. 14, 2016, for U.S. Appl. No. 12/208,329, filed Sep. 10, 2008, seven pages.
Notice of Allowance dated Dec. 14, 2016, for U.S. Appl. No. 12/208,329, filed Sep. 10, 2008, seven pages.
Notice of Allowance dated Apr. 6, 2017, for U.S. Appl. No. 15/270,950, filed Sep. 20, 2016, seven pages.
Rubine, D.H. (Dec. 1991). “The Automatic Recognition of Gestures,” CMU-CS-91-202, Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Computer Science at Carnegie Mellon University, 285 pages.
Rubine, D.H. (May 1992). “Combining Gestures and Direct Manipulation,” CHI '92, pp. 659-660.
Search Report dated Oct. 15, 2008, for GB Patent Application No. 0808783.5, filed May 15, 2008, two pages.
Search Report dated Apr. 24, 2009, for NL Application No. 2001666, English translation, 12 pages.
Search Report dated May 25, 2015, for ROC (Taiwan) Patent Application No. 102100040, with English translation, two pages.
Taiwanese Search Report dated Aug. 16, 2012, for TW Patent Application No. 097100216, two pages.
Westerman, W. (Spring 1999). “Hand Tracking, Finger Identification, and Chordic Manipulation on a Multi-Touch Surface,” A Dissertation Submitted to the Faculty of the University of Delaware in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Electrical Engineering, 364 pages.
Wikipedia, Online-Encyclopedia. (Jun. 11, 2007). “Signal generator,” retrieved on Jan. 13, 2016, located at: http://en.wikipedia.org/w/index.php?title=signal_generator$oldid=137433567, two pages.
Wikipedia, Online-Encyclopedia. (Jun. 6, 2007). “Phase (waves),” retrieved on Jan. 18, 2016, located at: http://en.wikipedia.org/w/index.php?title=phase_(wave)$oldid=136332745, two pages.
Notice of Allowance dated Apr. 10, 2018, for U.S. Appl. No. 15/250,736, filed Aug. 29, 2016, nine pages.
Related Publications (1)
Number Date Country
20170322669 A1 Nov 2017 US
Continuations (4)
Number Date Country
Parent 15270950 Sep 2016 US
Child 15658314 US
Parent 14704885 May 2015 US
Child 15270950 US
Parent 14056841 Oct 2013 US
Child 14704885 US
Parent 12283423 Sep 2008 US
Child 14056841 US