This relates generally to sensing user contact with a device, and more particularly, to an acoustic (e.g., ultrasonic) touch screen including a composite cover material with improved sensitivity for detecting a touch object.
Many types of input devices are presently available for performing operations in a computing system, such as buttons or keys, mice, trackballs, joysticks, touch sensor panels, touch screens, and the like. Touch screens, in particular, are becoming increasingly popular because of their ease and versatility of operation as well as their declining price. Touch screens can include a touch sensor panel, which can be a clear panel with a touch-sensitive surface and a display device such as a liquid crystal display (LCD) that can be positioned partially or fully behind the panel so that the touch-sensitive surface can cover at least a portion of the viewable area of the display device. Touch screens can allow a user to perform various functions by touching the touch sensor panel using a finger, stylus, or other object at a location often dictated by a user interface (UI) being displayed by the display device. In general, touch screens can recognize a touch and the position of the touch on the touch sensor panel. The computing system can then interpret the touch in accordance with the display appearing at the time of the touch, and thereafter can perform one or more actions based on the touch. In the case of some touch sensing systems, a physical touch on the display may not be needed to detect a touch. For example, in some capacitive-type touch sensing systems, fringing electrical fields used to detect touch can extend beyond the surface of the display, and objects approaching near the surface may be detected near the surface without actually touching the surface.
The present disclosure relates to one or more intermediate layers located on a surface of a cover material of an acoustic touch screen. Acoustic touch sensing can utilize transducers, such as piezoelectric transducers, to transmit ultrasonic acoustic waves along a surface or through the thickness of an electronic device. As the wave propagates through the material that comprises the surface, one or more objects in contact with the surface and/or discontinuities in the surface can disrupt the wave, attenuating and/or reflecting a portion of the transmitted wave. Portions of the transmitted wave energy after disruption by the one or more objects can be measured to determine the touch location(s) of the one or more objects on the device. For example, a transmitted wave can encounter a finger touching a surface of the device. A portion of the wave can be reflected by the finger and detected by one or more receivers. In the immediately preceding example, the location of the object can be determined based on the amount of time elapsing between the transmission of the wave and the detection of the reflected wave. In some examples, acoustic energy can be transmitted through the thickness of the material. The acoustic energy can be reflected at the interface between the material and air if no finger is present, or the acoustic energy can be reflected at the interface between the material and a finger. In the above example, the finger (if present) can absorb a portion of the acoustic energy, and differences in reflected energy can be used to determine whether a finger is present. Acoustic touch sensing can be used instead of, or in conjunction with, other touch sensing techniques, such as resistive, optical, and/or capacitive touch sensing.
In some examples, the one or more layers can include one or more intermediate layers. The one or more intermediate layers can include a first layer including a plurality of features and a second layer located between the first layer and the cover material. Each feature can be any type of protrusion configured to transfer force applied by the touch object to the cover material. In a no-touch condition, the second layer can act to separate the plurality of features from the cover material. In a touch condition, the touch object can apply a force to the top surface of the acoustic touch sensor. The applied force can cause a change in at least some of the properties of intermediate layer. For example, the force can create one or more local bends in the intermediate layer where the plurality of features is located. The plurality of features can move closer to the cover material and can cause one or more surface discontinuities in the cover material. The acoustic waves can undergo reflections (e.g., causing the signal to be attenuated) due to the discontinuities located in the path of the wave propagation. Time-of-flight information can be measured for purposes of determining touch location.
In the following description of various examples, reference is made to the accompanying drawings which form a part hereof, and in which it is shown by way of illustration specific examples that can be practiced. It is to be understood that other examples can be used and structural changes can be made without departing from the scope of the various examples.
The present disclosure relates to one or more intermediate layers located on a surface of a cover material of an acoustic touch screen. Acoustic touch sensing can utilize transducers, such as piezoelectric transducers, to transmit ultrasonic acoustic waves along a surface or through the thickness of an electronic device. As the wave propagates through the material that comprises the surface, one or more objects in contact with the surface and/or discontinuities in the surface can disrupt the wave, attenuating and/or reflecting a portion of the transmitted wave. Portions of the transmitted wave energy after disruption by the one or more objects can be measured to determine the touch location(s) of the one or more objects on the device. For example, a transmitted wave can encounter a finger touching a surface of the device. A portion of the wave can be reflected by the finger and detected by one or more receivers. In the immediately preceding example, the location of the object can be determined based on the amount of time elapsing between the transmission of the wave and the detection of the reflected wave. In some examples, acoustic energy can be transmitted through the thickness of the material. The acoustic energy can be reflected at the interface between the material and air if no finger is present, or the acoustic energy can be reflected at the interface between the material and a finger. In the above example, the finger (if present) can absorb a portion of the acoustic energy, and differences in reflected energy can be used to determine whether a finger is present. Acoustic touch sensing can be used instead of, or in conjunction with, other touch sensing techniques, such as resistive, optical, and/or capacitive touch sensing.
In some examples, the one or more layers can include one or more intermediate layers. The one or more intermediate layers can include a first layer including a plurality of features and a second layer located between the first layer and the cover material. Each feature can be any type of protrusion configured to transfer force applied by the touch object to the cover material. In a no-touch condition, the second layer can act to separate the plurality of features from the cover material. In a touch condition, the touch object can apply a force to the top surface of the acoustic touch sensor. The applied force can cause a change in at least some of the properties of intermediate layer. For example, the force can create one or more local bends in the intermediate layer where the plurality of features is located. The plurality of features can move closer to the cover material and can cause one or more surface discontinuities in the cover material. The acoustic waves can undergo reflections (e.g., causing the signal to be attenuated) due to the discontinuities located in the path of the wave propagation. Time-of-flight information can be measured for purposes of determining touch location.
In some examples, transducers 204 can also be partially or completely disposed on a portion of a touch screen 208. For example, the touch screen 208 may comprise a cover material (e.g., glass panel), and a display region of the touch screen may be surrounded by a non-display region (e.g., an opaque border region surrounding the periphery of the display region of the touch screen). In some examples, transducers 204 can be disposed partially or completely in the opaque mask region of the touch screen 208 glass panel (e.g., on the back side of the glass panel behind the opaque mask) such that the transducers are not visible (or are only partially visible) to a user. The device can further comprise acoustic touch sensing circuitry 206, which can include circuitry for driving electrical signals to stimulate vibration of the transducers 204 (e.g., transmit circuitry), as well as circuitry for sensing electrical signals output by the transducers (e.g., receive circuitry) when the transducer is stimulated by received acoustic energy. In some examples, timing operations for the acoustic touch sensing circuitry 206 can optionally be provided by a separate acoustic touch sensing controller 210 that can control timing of acoustic touch sensing circuitry 206 operations. In some examples, controller functions can be integrated with the acoustic touch sensing circuitry 206 (e.g., on a single integrated circuit). Output data from acoustic touch sensing circuitry 206 can be output to a host processor 214 for further processing to determine a location of an object contacting the device, as described in more detail below. In some examples, the processing for determining the location of a contacting object can be performed by the acoustic touch sensing circuitry 206 or a separate sub-processor of the device (not shown).
In addition to acoustic touch sensing, the device can include additional touch circuitry 212 that can be coupled to the touch screen 208. The touch circuitry 212 can, for example, be capacitive or resistive touch sensing circuitry and can be used to detect contact and/or hovering of objects (e.g., fingers) in contact with and/or in proximity to the touch screen 208, particularly in the display region of the touch sensor. Thus, the device can include multiple types of sensing circuitry (e.g., touch circuitry 212 and acoustic touch sensing circuitry 206) for detecting objects (and their positions) in different regions of the device and/or for different purposes, as described in more detail below.
At step 304, the method can receive returning acoustic energy, and the acoustic energy can be converted to an electrical signal by the transducers (e.g., transducers 204 illustrated in
A pair of demultiplexers 404 (e.g., in a differential implementation) can be used to selectively couple the transmitter 402 to one of the transducers 406 that can be the active transducer for a particular measurement cycle. In some examples, the demultiplexers 404 can have a ground connection, and the non-selected demultiplexer outputs can be shorted, open, or grounded. As described above, transducers 406 can also generate output electrical signals when motion is induced in the transducers by acoustic energy. A pair of multiplexers 408 (e.g., in a differential implementation) can be used to select a transducer 406 for coupling to a programmable gain amplifier 410 configured to amplify the received signals. In some examples, the same transducer 406 can be coupled to the transmitter 402 by the demultiplexers 404 and coupled to the programmable gain amplifier 410 by the multiplexers 408. Thus, a single transducer 406 can be used both for transmitting and for receiving acoustic energy. In some examples, a first transducer can be coupled to the transmitter 402 by the demultiplexers and a second transducer can be coupled by the multiplexers to the programmable gain amplifier 410. For example, the transmitting transducer and the receiving transducer can be discrete piezoelectric elements, where the transmitting transducer can be designed for being driven by higher voltages (or currents) to produce sufficient motion in the transducer 406 to generate an acoustic wave in the surface of a device (e.g., device 200 above), and the receiving transducer can be designed for receiving smaller amplitude reflected energy. In such an architecture, the transmit side circuitry (e.g., 402 and 404) can be optionally implemented in a high-voltage process, and the receive side circuitry (e.g., 408-420) can be optionally implemented on a separate low-voltage process. In some examples, the programmable gain amplifier output can be coupled to gain and offset correction circuit 412. It should be understood that for a single-ended implementation, a single demultiplexer 404 and a single multiplexer 408 can be used, and transmitter 402, programmable gain amplifier 410, and the input to gain and offset correction circuit 412 can be single-ended as well.
In some examples, the output of gain and offset correction circuit 412 can optionally be coupled to one or more analog processing circuits. In some examples the output of gain and offset correction circuit 412 can be coupled to a demodulation circuit 414 configured to demodulate the received signals (e.g., by I/Q demodulation). In some examples, the output of the gain and offset correction circuit 412 can be coupled to an envelope detection circuit 415 configured to perform envelope detection on the received signals. In some examples, the output of gain and offset correction circuit 412 can be filtered at a filter 416.
The received signals, whether raw or processed by one or more of the demodulation circuit 414, envelope detection circuit 415 or filter 416 can be passed to an analog-to-digital converter (ADC) 418 for conversion to a digital signal. In some examples, an input/output (I/O) circuit 420 can be used to transmit received data for processing. In some examples, the output of I/O circuit 420 can be transferred to a host processor of the device, or to an auxiliary sub-processor separate from the host processor. In some examples, some digital signal processing can be performed (e.g., by the acoustic touch sensing circuitry or acoustic touch sensing controller) before transmitting the data to other processors in the system. A control circuit 422 can be used to control timing and operations of the acoustic touch sensing circuitry 402-420.
It is to be understood that the configuration of
As described herein, various acoustic sensing techniques can be used to determine position of an object touching a surface. In some examples, one or more time-of-flight (TOF) measurements can be performed using one or more acoustic transmitters/receivers/transceivers to determine boundaries of the position that the object is touching.
The position of a touch 506 from an object in contact with surface 502 can be determined by calculating TOF measurements in a measurement cycle using each of acoustic transceivers 502A-D. For example, in a first measurement step of the measurement cycle, acoustic transceiver 502A can transmit an acoustic wave and receive reflections from the acoustic wave. When no object is present, the received reflection can be the reflection from the acoustic wave reaching the opposite edge of cover material 500. However, when an object is touching cover material 500 (e.g., corresponding to touch 506), a reflection corresponding to the object can be received before receiving the reflection from the opposite edge. Based on the received reflection corresponding to the object received at transceiver 502A, the system can determine a distance to the edge of touch 506, marked by boundary line 510A. Similar measurements can be performed by transceivers 502B, 502C, and 502D to determine a distance to the remaining edges of touch 506, indicated by boundary lines 510B, 510C, and 510D. Taken together, the measured distances as represented by boundary lines 510A-510D can form a bounding box 508. Based on the bounding box, the acoustic touch sensing system can determine position of touch 506 (e.g., based on a centroid of the bounding box).
The distance between an object touching the surface and a transceiver can be calculated based on TOF principles. The acoustic energy received by transceivers can be used to determine a timing parameter indicative of a leading edge of a touch. The propagation rate of the acoustic wave through the material forming the surface can be a known relationship between distance and time. Taken together, the known relationship between distance and time and the timing parameter can be used to determine distance.
In some examples, the timing parameter can be a moment in time that can be derived from the reflected energy. For example, the time can refer to that time at which a threshold amplitude of a packet of the reflected energy is detected. In some examples, rather than a threshold amplitude, a threshold energy of the packet of reflected energy can be detected, and the time can refer to that time at which a threshold energy of the packet is detected. The threshold amplitude or threshold energy can indicate the leading edge of the object in contact with the surface. In some examples, the timing parameter can be a time range rather than a point in time. To improve the resolution of a TOF based sensing scheme, the frequency of the ultrasonic wave and sampling rate of the receivers can be increased (e.g., so that receipt of the reflected wave can be localized to a narrower peak that can be more accurately correlated with a moment in time).
In some examples, transceivers 502A-D can operate in a time multiplexed manner, such that each transceiver transmits and receives an acoustic wave at a different time during a measurement cycle so that the waves from one transceiver do not interfere with waves from another transceiver. In other examples, the transceivers can operate in parallel or partially in parallel in time. The signals from the respective transceivers can then be distinguished based on different characteristics of the signals (e.g., different frequencies, phases and/or amplitudes).
Although four transceivers are illustrated in
In some examples, a user's finger(s) can be characterized such that a two transceiver scheme can be used to detect touches by one or more fingers. In some examples, user input can be primarily from an index finger. The user's index finger can be characterized (e.g., dimensions or size) and the bounding box scheme can be applied to two TOF measurements and the finger dimensions. In some examples, multiple fingers can be characterized. During operation, the finger(s) can be identified and then the characteristics of the identified finger(s) can be used with two TOF measurements to determine position.
For example, TOF measurements can be performed by using transceivers 502A, 502B, 502C, and 502D to determine a distance to the two objects. For example, transceiver 502A can receive two packets of reflected acoustic energy corresponding to the two objects (e.g., as illustrated in
In some examples, the two actual touches can be disambiguated when they are sequential. The first touch can be registered and then the second sequential touch can be disambiguated based on the first touch. For example, in the example illustrated in
In some examples, e.g., when multiple touches cannot be resolved), bounding box 528 can be used to determine the position of touch. Bounding box 528 can be formed from boundary lines 530A-D.
The multi-touch capabilities described with reference to
TOF schemes described with reference to
In some instances, the touch sensitivity can be affected by one or more properties at the interface of the cover material. For example, when a touch object (e.g., finger) touches the top surface (i.e., surface located closer to the external surface of the device housing) of the cover material, at least one layer of unwanted material (e.g., water, contamination on the finger, gloves covering the finger) can be located between the finger and the top surface of the cover material. The unwanted layer can affect (e.g., decrease) the amplitude of the reflected waves from the finger and/or the unwanted layer. The change in amplitude of the reflected waves can lead to measurement inaccuracies. To maintain or increase the signal-to-noise ratio (SNR) levels, the acoustic touch sensing controller (e.g., acoustic touch sensing controller 210 illustrated in
To mitigate the effects from the unwanted layer, the touch sensor can include one or more layers disposed on the top surface of the cover material.
In some examples, the intermediate layer 634 can have a pre-determined thickness. The thickness of intermediate layer 634 can be selected based on the desired amount of propagated force to areas (e.g., areas where plurality of features 635A are located, as discussed below). For example, selecting a thickness greater than the optimal thickness value (e.g., 50-60 microns or 33% thinner than the thickness of cover material 602) can lead to the propagated force extending to areas outside (e.g., larger) than the contact area of the touch object (e.g., touch object 637 illustrated in
Located between the intermediate layer 634 and cover material 602 can be another intermediate layer 632. Intermediate layer 632 can act to separate the plurality of features 635 from cover material 602 in a no-touch condition, as illustrated in
The intermediate layer 634 can be configured such that other areas are unaffected (e.g., maintain structural properties) by touch object 637. For example, plurality of features 635A may not undergo movement when touch object 637 applies a force. The absence of movement with plurality of features 635A can confine the areas of the acoustic touch sensor that experience the force transfer, thereby allowing the system the ability to determine the coordinates, properties, and/or shape of the touch.
Including intermediate layers in the acoustic touch sensor can further mitigate the unwanted effects due to variability in the touch object properties. In the absence of the intermediate layer(s), different materials located at the surface of the cover material can cause touch objects to have differing levels of interference with the acoustic waves, which can lead to measurement inaccuracies and unpredictability. For example, the presence of water, contamination, and/or a user wearing a glove may cause the user's fingers to produce vastly different interactions with acoustic waves travelling in the cover material 602. For example, any of the water, contamination, and/or glove can reduce the amount of reflection of acoustic waves propagating in cover material 602 caused by the touch object 637 and the acoustic waves even when the same amount of force is applied under the various different conditions. This reduced reflection can result in a reduced signal received by acoustic touch sensor circuitry, requiring the receive circuitry to have a large dynamic range. By adding the intermediate layer 634 with features 635, the material properties of the material that produces physical conduct with the cover material 602 can remain consistent despite variations in the characteristics of the touch object 637 as described above. Accordingly, the system may be able to detect touch from both a touch object including a contamination layer and a user wearing a glove, for example, without requiring the system to have a large dynamic range.
As another example, unpredictability can result from variations in the spacing of ridges on different users' fingers. To account for the variations in the spacing of ridges, the system can be configured with a range of operability requirements (e.g., transmission frequencies, spatial resolution, etc.) that can increase complexity and production costs of the system. Since the properties of the intermediate layer(s) 632 and 634 and plurality of features 635 may be pre-determined and known at the time of manufacture, the reflections of the acoustic waves can be more controlled and predictable. Additionally, the dynamic range of the operability requirements may be reduced.
Although
In some examples, intermediate layer 634 may exclude features in one or more regions of the acoustic touch sensor. Exemplary regions can include regions of the touch sensor susceptible to accidental (or false) touches. For example, the border region may be a region where the user may apply a force due to holding the electronic device in their hand. One or more portions of the border region may exclude features such that the force applied in these one or more portions may not act as a discontinuity to the acoustic waves.
In some examples, the plurality of features can have different structural properties in one direction relative to the other direction (e.g., anisotropic). For example, the features can be rectangular-shaped, where the rectangles, when oriented perpendicular to the transducer 604 can lead to an increase in the measured signal. Rectangles oriented parallel to the transducer 604 can lead to a decrease in the measured signal. In this manner, the orientation of the touch object can be determined.
Although the figures illustrate the intermediate layer(s) as a layer or layers that have been deposited on the cover material, examples of the disclosure can include one or more layers located between the intermediate layers and the cover material. Additionally or alternatively, the intermediate layer(s) can be included in an overlay (e.g., a separate keyboard accessory component) that attaches to the acoustic touch sensor.
An acoustic touch sensor is disclosed. In some examples, the acoustic touch sensor can include a cover material; a transducer coupled to the cover material; one or more layers located on a surface of the cover material, the one or more layers configured to transfer a force applied by an object contacting a surface of a device to the cover material, wherein the device includes the acoustic touch sensor; and control circuitry configured to determine whether the object is contacting the surface of the device. Additionally or alternatively, in some examples, the one or more layers include: a first layer including a plurality of features, and a second layer located between first layer and the cover material. Additionally or alternatively, in some examples, the one or more layers including one or more bends such that some of the plurality of features touch the cover material, wherein the one or more bends create one or more surface discontinuities on the cover material. Additionally or alternatively, in some examples, at least some of the plurality of features of the first layer is configured to transfer the force applied by the object to the cover material, and at least others of the plurality of features of the first layer maintain structural properties when the force is applied by the touch object. Additionally or alternatively, in some examples, the surface of the device including one or more regions capable of being contacted by the object, at least some of the plurality of features are located at the one or more regions, and at least others of the plurality of features are located outside of the one or more regions. Additionally or alternatively, in some examples, the first layer includes one or more other regions that exclude features. Additionally or alternatively, in some examples, the one or more other regions are located at a border region of the device. Additionally or alternatively, in some examples, the first layer includes one or more of glass, onyx, and sapphire. Additionally or alternatively, in some examples, the second layer includes one or more of air and a gel. Additionally or alternatively, in some examples, the plurality of features includes a plurality of prisms. Additionally or alternatively, in some examples, the plurality of features is non-uniformly distributed throughout the first layer. Additionally or alternatively, in some examples, a size of each of the plurality of features is between 5-10 microns. Additionally or alternatively, in some examples, a thickness of first layer is between 50-60 microns. Additionally or alternatively, in some examples, the acoustic touch sensor further comprises: transmit circuitry configured to provide a stimulation signal to the transducer; and receive circuitry configured to capture a received signal based on motion of the transducer, wherein the control circuitry is further configured to: couple the transmit circuitry to the transducer, couple the receive circuitry to the transducer, stimulate the transducer to produce an excitation in the cover material, capture a reflected energy between the transducer and one or more surface discontinuities on the cover material, and determine a location of the object contacting the surface of the device based on the reflected energy.
An electronic device is disclosed. The electronic device can comprise: an acoustic touch sensor including: a cover material; a transducer coupled to the cover material; one or more layers located on a surface of the cover material, the one or more layers configured to transfer a force applied by an object contacting a surface of a device to the cover material, wherein the device includes the acoustic touch sensor; control circuitry configured to determine whether the object is contacting the surface of the device; and a display device, wherein a surface of the cover material is a display screen of the display device.
A method for detecting an object contacting a surface of a device is disclosed. The method can comprise: in accordance with the object contacting the surface of the device: propagating force applied by the touch object at the surface of the device to a surface of a cover material, and creating one or more bends in one or more layers located on the surface of the cover material, the one or more bends creating one or more surface discontinuities on the cover material; transmitting an acoustic wave into a surface of a cover material, the acoustic wave transmitted from a transducer; receiving an acoustic reflection; and determining whether the acoustic reflection corresponds to a signal attenuated by one or more surface discontinuities on the cover material. Additionally or alternatively, in some examples, creating the one or more surface discontinuities includes decreasing a gap between a plurality of features included in the one or more layers and the cover material such that the plurality of features contacts the cover material. Additionally or alternatively, in some examples, the one or more bends and one or more surface discontinuities are located in one or more regions of the device, the method further comprising: maintaining a space between a plurality of features included in the one or more layers and the cover glass outside of the one or more regions. Additionally or alternatively, in some examples, the method further comprises: in accordance with the touch object not contacting the surface of the device: maintaining a uniform spacing throughout the one or more layers, wherein the spacing is between a plurality of features included in the one or more layers and the cover material. Additionally or alternatively, in some examples, the method further comprises: determining a position of the object based on time of flight information.
Although examples of this disclosure have been fully described with reference to the accompanying drawings, it is to be noted that various changes and modifications will become apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of examples of this disclosure as defined by the appended claims.
Number | Name | Date | Kind |
---|---|---|---|
3673327 | Johnson | Jun 1972 | A |
4506354 | Hansen | Mar 1985 | A |
4746914 | Adler | May 1988 | A |
4825212 | Adler | Apr 1989 | A |
5451723 | Huang | Sep 1995 | A |
5483261 | Yasutake | Jan 1996 | A |
5488204 | Mead et al. | Jan 1996 | A |
5591945 | Kent | Jan 1997 | A |
5648643 | Knowles | Jul 1997 | A |
5766493 | Shin | Jun 1998 | A |
5816225 | Koch | Oct 1998 | A |
5825352 | Bisset et al. | Oct 1998 | A |
5835079 | Shieh | Nov 1998 | A |
5854450 | Kent | Dec 1998 | A |
5880411 | Gillespie et al. | Mar 1999 | A |
6078315 | Huang | Jun 2000 | A |
6091406 | Kambara | Jul 2000 | A |
6188391 | Seely et al. | Feb 2001 | B1 |
6225985 | Armstrong | May 2001 | B1 |
6229529 | Yano | May 2001 | B1 |
6310610 | Beaton et al. | Oct 2001 | B1 |
6323846 | Westerman et al. | Nov 2001 | B1 |
6327011 | Kim | Dec 2001 | B2 |
6459424 | Resman | Oct 2002 | B1 |
6467138 | Aime | Oct 2002 | B1 |
6690387 | Zimmerman et al. | Feb 2004 | B2 |
6856259 | Sharp | Feb 2005 | B1 |
7015894 | Morohoshi | Mar 2006 | B2 |
7079118 | Benard | Jul 2006 | B2 |
7098891 | Pryor | Aug 2006 | B1 |
7184064 | Zimmerman et al. | Feb 2007 | B2 |
7489308 | Blake | Feb 2009 | B2 |
7499039 | Roberts | Mar 2009 | B2 |
7573466 | Marzen | Aug 2009 | B1 |
7663607 | Hotelling et al. | Feb 2010 | B2 |
7683890 | Geaghan | Mar 2010 | B2 |
7907129 | Idzik | Mar 2011 | B2 |
7952568 | Ishii | May 2011 | B2 |
8077162 | Endo | Dec 2011 | B2 |
8169404 | Boillot | May 2012 | B1 |
8479122 | Hotelling et al. | Jul 2013 | B2 |
8743091 | Bernstein | Jun 2014 | B2 |
9307325 | Kent | Apr 2016 | B2 |
20020135570 | Iisaka | Sep 2002 | A1 |
20020167270 | Siwinski | Nov 2002 | A1 |
20040164970 | Benard | Aug 2004 | A1 |
20050017959 | Kraus | Jan 2005 | A1 |
20050052432 | Kraus | Mar 2005 | A1 |
20050083313 | Hardie-bick | Apr 2005 | A1 |
20050248548 | Tsumura | Nov 2005 | A1 |
20060197753 | Hotelling | Sep 2006 | A1 |
20070165009 | Sakurai | Jul 2007 | A1 |
20070171212 | Sakurai | Jul 2007 | A1 |
20070171326 | Taguchi | Jul 2007 | A1 |
20070176907 | Ishii | Aug 2007 | A1 |
20070211031 | Marc | Sep 2007 | A1 |
20070240913 | Schermerhorn | Oct 2007 | A1 |
20080030485 | Endo | Feb 2008 | A1 |
20080059761 | Norman | Mar 2008 | A1 |
20080114251 | Weymer | May 2008 | A1 |
20080266266 | Kent | Oct 2008 | A1 |
20080291177 | Kuo | Nov 2008 | A1 |
20100277426 | Han | Nov 2010 | A1 |
20110291996 | Gao | Dec 2011 | A1 |
20150055032 | Kato | Feb 2015 | A1 |
20150097814 | Lynn | Apr 2015 | A1 |
20160107194 | Panchawagh | Apr 2016 | A1 |
20160349879 | Wang | Dec 2016 | A1 |
Number | Date | Country |
---|---|---|
2000-163031 | Jun 2000 | JP |
2002-342033 | Nov 2002 | JP |
2005103872 | Nov 2005 | WO |
WO-2008020699 | Feb 2008 | WO |
WO-201541640 | Mar 2015 | WO |
Entry |
---|
Lee, S.K. et al. (Apr. 1985). “A Multi-Touch Three Dimensional Touch-Sensitive Tablet,” Proceedings of CHI: ACM Conference on Human Factors in Computing Systems, pp. 21-25. |
Rubine, D.H. (Dec. 1991). “The Automatic Recognition of Gestures,” CMU-CS-91-202, Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Computer Science at Carnegie Mellon University, 285 pages. |
Rubine, D.H. (May 1992). “Combining Gestures and Direct Manipulation,” CHI '92, pp. 659-660. |
Westerman, W. (Spring 1999). “Hand Tracking, Finger Identification, and Chordic Manipulation on a Multi-Touch Surface,” A Dissertation Submitted to the Faculty of the University of Delaware in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Electrical Engineering, 364 pages. |
Final Office Action dated Aug. 27, 2013, for U.S. Appl. No. 12/184,232, filed Jul. 31, 2008, 25 pages. |
Final Office Action dated Feb. 20, 2013, for U.S. Appl. No. 12/184,232, filed Jul. 31, 2008, 24 pages. |
Non-Final Office Action dated Jul. 25, 2012, for U.S. Appl. No. 12/184,232, filed Jul. 31, 2008, 18 pages. |
Non-Final Office Action dated Nov. 18, 2011, for U.S. Appl. No. 12/184,232, filed Jul. 31, 2008, 21 pages. |
Notice of Allowance dated Mar. 14, 2014, for U.S. Appl. No. 12/184,232, filed Jul. 31, 2008, eight pages. |
Number | Date | Country | |
---|---|---|---|
20180284947 A1 | Oct 2018 | US |