With the proliferation of the Internet, today's mobile devices can display a wealth of interactive Web content. The touch screen provides a particularly efficient user interface for mobile devices because it does not require any peripheral user interface components, like a keyboard, mouse, or track pad. All that is needed to interact with the touch screen's user interface is a finger or a stylus. But as devices shrink in size, the human finger is not always an ideal pointer.
Touch screens may be implemented in a device by overlaying a capacitive touch-sensitive pad over a surface of a display screen. The display screen displays information to a user, and the touch-sensitive pad receives input by detecting the user touching the touch-sensitive pad. Capacitive touch-sensitive pads generally comprise sensors that detect a user's touch by sensing a capacitance between the user's finger and one or more of the touch sensors. The touch (i.e., capacitance) detected by the touch-sensitive pad is received as a user input that is interpreted by the device in accordance with several variables and/or conditions relating to the user's touch. Some of these variables and conditions may include the content displayed on the screen, the status of the device, the location of the touch, the duration of the touch, and combinations thereof.
A human finger is generally much larger than the point of a stylus, and therefore the two create different capacitive effects on a capacitive touch screen. Today's devices commonly allow either a finger or stylus to be used, so they must be able to recognize either's electrical charge displacement. Some users prefer to use a stylus because it is smaller and provides greater precision for interacting with the touch screen. User preferences drive sales of mobile devices, so a device's inability to properly recognize stylus touches can quickly scare away customers.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key or essential features of the claimed subject matter, but instead is provided to illustrate different embodiments.
One aspect is directed to a touch screen device that detects the location of a stylus touching a touch screen. The stylus is equipped with a transmitter to emit wireless signals, and the touch screen includes conductors that can receive the wireless signals. An amplifier circuit filters and amplifies the wireless signals, as received by the conductors. An analog-to-digital converter (ADC) digitizes the filtered and amplified wireless signals. A processor determines the magnitude of each of digitized signal using an algorithmic transform. The stylus is assumed to be closer to conductors receiving stronger signals than others, so the location of the stylus on the touch screen can be determined based on the calculated magnitudes of the digital signals.
Another aspect is directed to receiving, at touch screen conductors, wireless signals from a stylus in contact with a touch screen surface. For each of the touch screen conductors, magnitudes of the wireless signals are determined using an algorithmic transform, and the location of the stylus is then determined using the magnitudes of the wireless signals. The location is stored and used to manipulate content being displayed on the touch screen device.
The foregoing and other features and advantages of the present disclosure will become more apparent from the following detailed description of the embodiments read in conjunction with the accompanying drawings. The detailed description and drawings are merely illustrative of some different embodiments, rather than limiting the scope of the invention as defined by the appended claims and equivalents thereof.
Embodiments are illustrated by way of example in the accompanying figures:
The present disclosure provides a touch screen device with wireless signal conductors and a circuit capable of locating touches of a stylus on a touch screen device. The stylus broadcasts wireless signals upon touching the touch screen device, and the location of a touch is determined using a relative-strength algorithm that compares the magnitude of the wireless signals received at a pattern of receiving, antennae-like conductors. To execute the relative-strength algorithm, some embodiments first digitize and then amplify received wireless signals from the stylus, and thereafter execute the relative-strength algorithm on the amplified digitized, amplified signals.
Generally speaking, capacitive touch screens are generally well known in the art and have been widely adopted in various types of electronic devices. Tablet computing devices (e.g., the iPad® from Apple Inc. of Cupertino, Calif.), smartphones (e.g., the iPhone® from Apple Inc. of Cupertino, Calif.), and global positioning devices (e.g., the Nuvi® from Garmin Corporation), as well as various other devices, all use touch-screen display panels. The styli and touch screens described herein may be incorporated in such devices.
Some embodiments may be described in the general context of computer code or machine usable instructions, including computer-executable instructions such as one or more program modules or objects executable by a processor of a touch screen device. Generally, program modules and objects may include source code, dynamic link libraries (DLLs), data structures, and the like, and refer to code that performs particular tasks or implement abstract data types. Such components are embodied in memory or other computer-readable medium of a computer device. As referenced herein, computer-readable media do not include propagating or other transitory signaling.
Having briefly described an overview of embodiments of the present invention, attention is directed to the accompanying figures.
An internal processor of the touch screen device 100 calculates the location of the touching stylus 104 on the touch screen 102 based on the magnitude of the wireless signals 106-112 detected by the conductors 114a-n and 116a-n. Wireless signals 106-112 dissipate over distance, so conductors 114a-n and 116a-n receiving stronger wireless signals 106-112 can be assumed to be closer to the stylus 104 touch than those with relatively weaker signal strengths. One embodiment performs relative strength calculations for each conductor 114a-n and 116a-n receiving wireless signals 106-112 to pinpoint where the location of the touching stylus 104. The relative strength calculations are described in more detail below.
Stylus 104 broadcasts wireless signals 106-112 at one or more frequencies. Some embodiments also encode information in wireless signals 106-112 using different frequencies. Such encoded information may indicate different information about the stylus 104, such as a stylus identifier, touch pressure (as measured by a pressure sensor in the tip of the stylus 104), incline of the stylus 104 (as measured by an internal gyroscope in the stylus 104), or the like. One particular embodiment indicates the encoded data by varying the frequencies of the wireless signals 106-112.
Noise may occur on certain frequencies on which the stylus 104 is emitting wireless signals 106-112. To minimize noise, the stylus 104 is configured, in some embodiments, to broadcast multiple (e.g., three) sets of wireless signals 106-112 on different frequencies. For example, a first set may be transmitted at 100 kHz, 120 kHz, 140 kHz, and 160 kHz; a second set may be transmitted at 200 kHz, 220 kHz, 240 kHz, and 260 kHz; and a third set may be transmitted at 300 kHz, 320 kHz, 340 kHz, and 360 kHz. Touch screen device 100 can then process each set to reveal which conductors 114a-n and 116a-n the stylus 104 is touching and compare the determined-to-be-touching conductors 114a-n and 116a-n for each set to each other to uncover a consensus group of conductors. For example, if conductors 114c and 116b are indicated by two sets of wireless signals 106-112 but not a third, software on the touch screen device 100 determines these two conductors to be the touch points while discarding the third set, which can be assumed to be influenced by some kind of noise.
Embodiments may include conductors 114a-n and 116a-n operating in one of two different configurations. One configuration is used to only detect wireless signals from stylus 104. In this configuration, both x and y directions of conductors 114a-n and 116a-n function solely as receivers for wireless signals, and are thus only capable of detecting stylus 104 that emit wireless signals—because fingers do not emit wireless signals.
In a second configuration, the touch screen 102 rapidly switches the functionality of the conductors 114a-n and/or 116a-n for short timeframes between applying voltages for capacitive-touch sensing and receiving wireless signals 106-112. In one embodiment using this configuration, conductors 114a-n and/or 116a-n may emit capacitive-touch voltages for detecting a finger during one timeframe (e.g., 7 ns), then switch to receiving wireless signals 106-112 during a second timeframe (3 ns), and continually repeat this cycle to be able to detect both a finger and stylus 104. In an alternative embodiment, conductors 116a-n in one direction always act as receivers for wireless signals 106-112, and conductors 114a-n in the other direction constantly switch between emitting voltages for capacitive-touch sensing and receiving wireless signals 106-112.
Stylus 104 is powered by power source 120, which, in one embodiment, includes one or more batteries. Signal generator 130 generates wireless signals 106-112, which include either pulsed or steady alternating current (AC) signals. Additionally or alternatively, the wireless signals 106-112 may be generated at different frequencies, such as in the range of 10-50 kHz. The frequency (or frequencies) of wireless signals 106-112 may be different or the same as the voltage frequencies typically used by the touch screen 102 to detect finger touches.
The stylus 104 may emit wireless signals 106-112 at the same or different frequencies than the voltages used by touch screen 102 for capacitive touch detection. Sylus 104 may also encode a signal or other data in the wireless signals 106-112 that is orthogonal to voltage frequencies, or signals therein, used by touch screen 102 for capacitive touch detection.
In one embodiment, stylus 104 includes a pressure sensitive tip 134 that conveys information regarding contact pressure applied to tip 134. In one embodiment, tip 134 recedes into housing 140 in axial direction 136 in response to applied contact pressure by a user operating the stylus (e.g. pressing tip 134 on a surface). Tip 134 is subsequently released when the contact pressure is released (e.g. a hovering state or non-operational state of the stylus 104). During axial movement, tip 134 may be engaged with a resilient element 138, e.g., a spring, whose properties are selected to obtain a desired relationship between contact pressure and axial displacement. Alternatively, tip 134 may be stationary and include one or more other types of pressure, voltage, and current switches or sensors to detect when the tip 134 is touching an object.
Pressure sensor unit 126 senses tip 134 touching an object like touch screen 102, and, in response, directs the signal generator 130 to generate wireless signals 106-112. Encoder 132 is a digital encoder operable to encode operational or identification information in wireless signals 106-112, including the aforementioned encoded information. Encoder 132 may encode such information into wireless signals 106-112 through the selection of different signal frequencies. For example, wireless signals 106-112 may be transmitted at one particular frequency to indicate a first range of inclination (e.g., 15-30 degrees) of the stylus 104 relative to the touch screen 102 and another frequency to indicate a second range of inclination (e.g., 40-60 degrees). Moreover, encoder 132 may use different encoding techniques to properly encode any of the aforementioned encoded information in wireless signals 106-112, such as, for example but without limitation, Amplitude Shift Keying (ASK), Phase Shift Keying (PSK) and Frequency Shift Keying (FSK). In one embodiment, the encode information in wireless signals 106-112 is transmitted over several transmission cycles (e.g., one bit of encoded information is transmitted per transmission cycle).
In one embodiment, each conductor 114a-n and 116a-n is electrically coupled to one of a set of transmit traces 200 and 202, respectively, that are coupled to control circuitry 220. Through transmit traces 200 and 202, conductors 114a-n and 116a-n pass the received wireless signals to control circuitry 220 for processing. In embodiments where one direction of conductors 114a-n or 116a-n function in a capacitive touch configuration, traces 200 and 202 supply the requisite voltage for application across conductors 114a-n or 116a-n, whichever conductors are configured in a capacitive touch manner.
Control circuitry 220 includes amplifier circuitry 222, a power supply 224, a processor 226, an ADC 240, and computer-readable memory 228, all of which may be operatively connected through one or more bus lines. Although the various blocks of control circuitry 220 are shown with lines for the sake of clarity, in reality, delineating various components is not so clear, and metaphorically, the lines would more accurately be grey and fuzzy. For example, processors 226 have memory themselves. Obviously, additional hardware and software may be included in different touch screen devices 100, but for the sake of clarity, only the illustrated components of control circuitry 220 are discussed herein.
When conductors 114a-n and 116a-n operate as receivers of wireless signals 106-112, received wireless signals 106-112 from stylus 104 are supplied, through traces 200 and 202, to amplifier circuitry 222. Not all conductors 114, 116 will receive the wireless signals 106-112. Only those conductors 114, 116 close enough to the transmitting stylus 104 will receive the wireless signals, and these conductors 114, 116 are referred to as the “receiving conductors.” To clarify different embodiments, an example is perpetuated below whereby four conductors 114 and four conductors 116 are receiving conductors. Embodiments are not limited, however, to any particular quantity of receiving conductors 114, 116.
Amplifier circuitry 222, discussed in more detail below, comprises a set of amplifiers that amplify wireless signals 106-112. In one embodiment, each conductor row 114a-n and 116a-n is electrically coupled to its own amplifier. For example, amplifier circuitry 222 may include a first amplifier for conductor 114a, a second amplifier for conductor 114b, and so on for all the 114 conductors. Similar one-to-one pairings of amplifiers can be used for conductors 116a-n. Alternative embodiments may use a one-to-many pairing of amplifiers to conductors 114a-n and 116a-n—e.g., employing a single amplifier for the 114 conductors and a single amplifier for the 116 conductor.
Memory 228 includes a variety of computer-readable media, such as, for example but without limitation, Random Access Memory (RAM); Read Only Memory (ROM); Electronically Erasable Programmable Read Only Memory (EEPROM); flash memory or other computer-storage technologies capable of storing computer-executable instructions. For purposes of this disclosure, “computer-readable memory” and “computer-readable media” do not include any propagating signals or carrier waves. The instructions embodied in memory 228 comprise a stylus detector 232 that includes a fast Fourier transform (FFT) 234 and a centroid calculator 236. Other transforms my alternatively be used, such as a discrete Fourier transform, discrete Hartley transform, or the like.
ADC 240 converts the amplified wireless signals 106-112 received by conductors 114a-n and/or 116a-n to digital representations. Processor 226 executes instructions embodied in memory 228 to determine the location of the stylus 104 on touch screen 102 based on the digital representations of the amplified wireless signals 106-112. For example, wireless signals 106-112 may be received at conductor rows 114b-e and 116b-e when stylus 104 contacts touch screen 102. Each of the four 114b-e conductors and the four 116b-e conductors provide their received wireless signal 106-112 to the amplifier circuitry 222 for amplification: In this example, eight signals—one for each receiving 114 and 116 conductor—are provided to the amplifier circuitry 222 for amplification. ADC 240 digitizes the eight amplified signals, and processor 226 performs a transform stored in FFT 234 on a sampling of the digitized signals to determine magnitudes of sampled digitized signals. The location of the stylus 104 can then be determined based on magnitudes from the FFT 234 of the sampled digitized signals.
Once magnitudes are determined from the FFT 234, the centroid calculator 236 determines where on the touch screen 102 the stylus 104 is touching. Centroid calculator 236, in one embodiment, calculates touch points in the x and y directions based on relative strengths of the magnitudes from the FFT 234 of the digitized, amplified, and sampled wireless signals 106-112. To do this, the magnitudes of the wireless signals 106-112 from receiving conductors 116 in the x direction are summed to calculate the total magnitude (Mag (total)) of the received signals 106-112. For example, if conductor 116b has a magnitude of 100, conductor 116c has a magnitude of 200, conductor 116d has a magnitude of 180, and magnitude 116e has a magnitude of 40, Mag(total) would equal 520. Each receiving conductor 116 is assigned a channel identifier that is multiplied by its magnitude to produce a Channel Strength Value, and all the Channel Strength Values summed to compute the Channel Strength Sum. Continuing with the above example, the four receiving conductors 116b-e may be assigned the following channel identifiers that will produce the following Channel Strength Values:
The touch point in the x direction is determined by dividing the Channel Strength Sum by Mag(total):
X Touch Point=Channel Strength Sum/Mag(total)
In the above example, Mag(total) equals 520 and the Channel Strength Sum equals 1200, resulting in an X Touch Point of 2.31 (1200/520). The X Touch Point indicates where, relative to the conductors 116 specified by the identifiers, the stylus 104 is determined to have touched in the x direction. In the above scenario, the touch is determined to be between conductor 116c and 116d, slightly closer to conductor 116c (as indicated by the 0.31). The X Touch Point can be determined to be an actual conductor 116 (e.g., 116c) or within a certain proximity to a conductor 116 (e.g., 0.31 the distance from 116c to 116d).
When operating in the pure wireless receiver configuration, centroid calculator performs the same relative strength calculation to determine a Y Touch Point. Processor 226 can then use the X and Y Touch Points to determine the location of the touch of stylus 104.
In embodiments where conductors 114a-n or 116a-n are configured to receive wireless signals and the other direction of conductors 116a-n or 114a-n are configured in a capacitive touch configuration, centroid calculator 236 only determines the largest magnitude digital amplified wireless signal in one direction. Detected changes in capacitance are used to locate the stylus 104 in the other direction.
Additionally, memory 228 may store recognition software that deciphers encoded commands in wireless signals 106-112, such as stylus identifier, pressure, incline, etc. The recognition software may recognize codes based on the different frequencies associated with the signals indicating the significance of bits. For example, wireless signals 106-112 respectively transmitted at frequencies of 100 kHz, 200 kHz, 300 kHz, and 400 kHz may be deciphered by the recognition software in the following manner: 100 kHz (most significant bit), 200 kHz (second least significant bit), 300 kHz (third least significant bit), and 400 kHz (most significant bit).
Conductors 114a-d receive and provide the wireless signals 106-112 to the amplifier circuitry 222 for amplification. In the shown embodiment, amplifier circuitry 222 comprises filters 300a-d and amplifiers 302a-d for each conductor. Filters 300a-d may include high-pass, low-pass, or band-pass filters that only pass certain portions of the wireless signals 106-112 to amplifiers 302a-d for amplification. While the shown embodiment illustrates each conductor 114 having its own filter 300 and amplifier 302, alternative embodiments may not use filters 300a-d at all, or may use a single filter 300 and amplifier 302 for multiple conductors 114a-d. ADC 240 converts the filtered and amplified versions of wireless signals 114a-d to generate sampled digital representations (D106-112) of wireless signals 106-112. The FFT 234 performs a transform on D106-112 to determine magnitudes M106-112 associated with the wireless signals 114a-d. Magnitudes M106-112 can then be used to determine the closest conductors 114a-d to stylus 104's touch, and thus calculate a Y Touch Point. Such a determination is made, in one embodiment, based on the relative strengths of M106-112, as described above.
Conductors 116 in the x direction may be coupled to similar hardware, and a similar relative-strength calculation can be performed to determine an X Touch Point. The intersecting X and Y Touch Points can then be used to determine the touch of the stylus 104.
The stylus 104's location is determined based on the magnitudes indicating which conductors 114a-n and/or 116a-n received the strongest wireless signals 106-112, as shown at 412. In one embodiment, such a determination is made using a relative-strength calculation. The location may be pinpointed by identifying, in one embodiment, the conductor 116a-n in the x direction receiving the largest magnitude wireless signal and the conductor 114a-n in the y direction receiving the largest magnitude wireless signal. Alternatively, when only one direction of conductors are configured to receive wireless signals 106-112, the perpendicular direction of conductors may use capacitive touch techniques to determine the closest conductor to stylus 104. The location of stylus 104 is stored in memory 228 of the touch screen device 100 and can then be used to manipulate content being displayed.
It should be appreciated that the various embodiments disclosed herein are exemplary. Accordingly, various modifications to these embodiments may be made without departing from the scope of the present disclosure and the claims provided below. The subject matter of the present invention is described with specificity herein to meet statutory requirements. The description itself is not, however, intended to limit the scope of this patent. The claimed subject matter might also be embodied in other ways, to include different steps or combinations of steps similar to the ones described herein, in conjunction with other present or future technologies.
Number | Name | Date | Kind |
---|---|---|---|
4563645 | Kerr | Jan 1986 | A |
5359156 | Chan et al. | Oct 1994 | A |
5854625 | Frisch et al. | Dec 1998 | A |
5977803 | Tsugai | Nov 1999 | A |
6002387 | Ronkka et al. | Dec 1999 | A |
6075520 | Inoue et al. | Jun 2000 | A |
6545612 | Lindgren et al. | Apr 2003 | B1 |
7030860 | Hsu et al. | Apr 2006 | B1 |
7454967 | Skurnik | Nov 2008 | B2 |
7812825 | Sinclair et al. | Oct 2010 | B2 |
8294678 | Wu | Oct 2012 | B2 |
8300024 | Wu | Oct 2012 | B2 |
8481872 | Zachut | Jul 2013 | B2 |
8618819 | Sawataishi et al. | Dec 2013 | B2 |
20030080755 | Kobayashi | May 2003 | A1 |
20030142081 | Iizuka et al. | Jul 2003 | A1 |
20050030724 | Ryhanen et al. | Feb 2005 | A1 |
20050094022 | Wang et al. | May 2005 | A1 |
20060125801 | Hsu et al. | Jun 2006 | A1 |
20070070050 | Westerman et al. | Mar 2007 | A1 |
20070089527 | Shank et al. | Apr 2007 | A1 |
20070159184 | Reynolds et al. | Jul 2007 | A1 |
20070195009 | Yamamoto | Aug 2007 | A1 |
20070229470 | Snyder et al. | Oct 2007 | A1 |
20070268266 | XiaoPing | Nov 2007 | A1 |
20070273660 | XiaoPing | Nov 2007 | A1 |
20080007534 | Peng et al. | Jan 2008 | A1 |
20090174679 | Westerman | Jul 2009 | A1 |
20090231294 | Wu | Sep 2009 | A1 |
20090244014 | Hotelling et al. | Oct 2009 | A1 |
20090296742 | Sicurello et al. | Dec 2009 | A1 |
20090303198 | Yilmaz | Dec 2009 | A1 |
20090322355 | Day et al. | Dec 2009 | A1 |
20090322410 | David et al. | Dec 2009 | A1 |
20100097077 | Philipp et al. | Apr 2010 | A1 |
20100097078 | Philipp et al. | Apr 2010 | A1 |
20100149125 | Klinghult et al. | Jun 2010 | A1 |
20100149126 | Futter | Jun 2010 | A1 |
20100188105 | Khanna et al. | Jul 2010 | A1 |
20100289503 | Reynolds et al. | Nov 2010 | A1 |
20100292945 | Reynolds et al. | Nov 2010 | A1 |
20100315099 | Ootaka | Dec 2010 | A1 |
20110074446 | Chou et al. | Mar 2011 | A1 |
20110096024 | Kwak | Apr 2011 | A1 |
20110115503 | Chou et al. | May 2011 | A1 |
20110133756 | Reime | Jun 2011 | A1 |
20110187666 | Min | Aug 2011 | A1 |
20110216094 | Murakami | Sep 2011 | A1 |
20110234528 | Guedon et al. | Sep 2011 | A1 |
20110242048 | Guedon et al. | Oct 2011 | A1 |
20110273400 | Kwon et al. | Nov 2011 | A1 |
20120044210 | Chen et al. | Feb 2012 | A1 |
20120146668 | Satake et al. | Jun 2012 | A1 |
20120200388 | Miura et al. | Aug 2012 | A1 |
20120229421 | Kim et al. | Sep 2012 | A1 |
20120256645 | Nguyen et al. | Oct 2012 | A1 |
20120327041 | Harley et al. | Dec 2012 | A1 |
20120331546 | Falkenburg et al. | Dec 2012 | A1 |
20130106725 | Bakken et al. | May 2013 | A1 |
20130154956 | Tudosoiu | Jun 2013 | A1 |
20140002108 | Soo et al. | Jan 2014 | A1 |
20140015595 | Van Ausdall et al. | Jan 2014 | A1 |
20140062922 | Tang | Mar 2014 | A1 |
20140267186 | Kreek | Sep 2014 | A1 |
Entry |
---|
Lei, et al., “An Oversampled Capacitance-to-Voltage Converter IC With Application to Time-Domain Characterization of MEMS Resonators”, IEEE Sensors Journal, vol. 5, No. 6, Dec. 2005, pp. 1353-1361. |
U.S. Appl. No. 12/972,159 entitled “Capacitive Sensing Analog Front End”, by Yannick Guedon et al, filed Mar. 31, 2010, 51 pgs. |
U.S. Appl. No. 12/732,581 entitled “Sample and Hold Capacitance to Digital Converter” by Yannick Guedon, filed Mar. 26, 2010, 20 pgs. |
U.S. Appl. No. 12/829,130 entitled “Sensing Phase Sequence to Suppress Single Tone Noise” by Inventor Kusuma Adi Ningrat, filed Jul. 1, 2010, 27 pgs. |
Number | Date | Country | |
---|---|---|---|
20150338950 A1 | Nov 2015 | US |