Patent Grant
11144149
This disclosure is related to the field of sensing the pressure of touches to a touch sensitive display, and, more particularly, to ways of obtaining usable touch pressure data even when one or more touch pressure sensors in the touch sensitive display are functioning abnormally.
Touch screen displays are widely employed for display of data and receipt of user input in a variety of devices, such as smartphones, tablets, and smartwatches. Touch screen displays can determine the X and Y coordinates of a touch thereto, which can be used as user input. In addition, touch screen displays can determine not only the location of a touch, but also the duration of a touch, permitting a tap to be differentiated from a long press, which can be used as another form of user input.
Still further, some touch screen displays can also determine the pressure or force applied during a touch, allowing for an even further type of user input. However, in some cases, touch pressure sensors used to sense deformation of the touch screen display resulting from the pressure or force applied during a touch can become damaged or broken, and function abnormally.
In current devices, the presence of damaged or broken touch pressure sensors can render the determination of pressure or force applied during a touch to be inaccurate. This could result in improper functionality of an electronic device incorporating the touch screen display.
New developments in the area of pressure or force sensing are therefore needed.
This summary is provided to introduce a selection of concepts that are further described below in the detailed description. This summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used as an aid in limiting the scope of the claimed subject matter.
Disclosed herein is a method including acquiring touch pressure data from a plurality of touch pressure sensors, and for each of the plurality of touch pressure sensors, a determination is made as to whether the touch pressure data from that touch pressure sensor is indicative of abnormal operation of that touch pressure sensor. Where no abnormal operation is indicated, the touch pressure data from each of the plurality of touch pressure sensors is summed to produce a touch pressure output. Where abnormal operation is indicated, the touch pressure data from each of the plurality of touch pressure sensors is summed and multiplied the sum by a correction factor to produce the touch pressure output.
Determining whether the touch pressure data from a given touch pressure sensor is indicative of abnormal operation may be performed by determining whether the touch pressure data from the given touch pressure sensor exceeds an upper limit or is below a lower limit.
In a calibration mode: a) for each of the plurality of touch pressure sensors, a same force may be applied to that touch pressure sensor while acquiring touch pressure data from each of the plurality of touch pressure sensors, and the touch pressure data acquired from each of the plurality of touch pressure sensors may be summed to produce a reference touch pressure output for that touch pressure sensor; and b) a given one of the plurality of touch pressure sensors is designated as being an abnormally operating touch pressure sensor, and, for each of the plurality of touch pressure sensors except the designated given one of the plurality of touch pressure sensors, a same force is applied to that touch pressure sensor while acquiring touch pressure data for each of the plurality of touch pressure sensors except the designated given one to produce an abnormal reference touch pressure output for the designated given one of the plurality of touch pressure sensors.
In the calibration mode a variation may be determined between normal and abnormal operation for each of the plurality of touch pressure sensors by determining a variation between each reference touch pressure output and its corresponding abnormal touch pressure output, and the correction factor may be generated as a function of the variation between each reference touch pressure output and its corresponding abnormal touch pressure output.
In the calibration mode: c) iteratively repetitions of b) may be performed for each of the plurality of touch pressure sensors, with a different given one of the plurality of touch pressure sensors being the designated given one for each iteration, and d) for each iteration of c) a variation may be determined between each reference touch pressure output and its corresponding abnormal touch pressure output.
In the calibration mode, for each iteration of c), a correction factor may be generated for the given one of the plurality of touch pressure sensors being the designated given one, as a function of the variation between each reference touch pressure output and its corresponding abnormal touch pressure output.
Where abnormal operation is indicated, the multiplication of the sum by the correction factor may include multiplication of the sum by the correction factor corresponding to which of the plurality of touch pressure sensors is operating normally.
In the calibration mode, for each iteration of (c), a plurality of different correction factors may be generated for the given one of the plurality of touch pressure sensors being the designated given one, as a function of the variation between each reference touch pressure output and its corresponding abnormal touch pressure output, with each of the plurality of different correction factors corresponding to a different touch zone.
Where abnormal operation is indicated, the summing of the touch pressure data from each of the plurality of touch pressure sensors may be performed by, for each of the different touch zones, summing the touch pressure data from each of the plurality of touch pressure sensors associated with that zone to produce a zone sum. The multiplication may be performed by multiplying each zone sum by a corresponding correction factor for that zone, and the touch pressure output may be produced by summing each zone sum after multiplication by its corresponding correction factor.
A device aspect is disclosed herein. The device includes a touch and pressure sensitive screen with a plurality of touch pressure sensors, and a touch and pressure sensitive screen controller. This controller is configured to acquire touch pressure data from the plurality of touch pressure sensors, and for each of the plurality of touch pressure sensors, determine whether the touch pressure data from that touch pressure sensor is indicative of abnormal operation of that touch pressure sensor. Where no abnormal operation is indicated, the controller sums the touch pressure data from each of the plurality of touch pressure sensors to produce a touch pressure output. Where abnormal operation is indicated, the controller sums the touch pressure data from each of the plurality of touch pressure sensors and multiplies the sum by a correction factor to produce the touch pressure output.
The touch and pressure sensitive screen controller may be configured to, in a calibration mode: a) for each of the plurality of touch pressure sensors, apply a same force to that touch pressure sensor while acquiring touch pressure data from each of the plurality of touch pressure sensors, and sum the touch pressure data acquired from each of the plurality of touch pressure sensors to produce a reference touch pressure output for that touch pressure sensor; and b) designate a given one of the plurality of touch pressure sensors as being an abnormally operating touch pressure sensor, and, for each of the plurality of touch pressure sensors except the designated given one of the plurality of touch pressure sensors, apply a same force to that touch pressure sensor while acquiring touch pressure data for each of the plurality of touch pressure sensors except the designated given one to produce an abnormal reference touch pressure output for the designated given one of the plurality of touch pressure sensors.
The touch and pressure sensitive screen controller may also be configured to, in the calibration mode, determine a variation between normal and abnormal operation for each of the plurality of touch pressure sensors by determining a variation between each reference touch pressure output and its corresponding abnormal touch pressure output, and generate the correction factor as a function of the variation between each reference touch pressure output and its corresponding abnormal touch pressure output.
The touch and pressure sensitive screen controller may be configured to, in the calibration mode: iteratively repeat b) for each of the plurality of touch pressure sensors, with a different given one of the plurality of touch pressure sensors being the designated given one for each iteration; and for each iteration of c) determine a variation between each reference touch pressure output and its corresponding abnormal touch pressure output.
The touch and pressure sensitive screen controller may also be configured to, in the calibration mode: for each iteration of c), generate a correction factor for the given one of the plurality of touch pressure sensors being the designated given one, as a function of the variation between each reference touch pressure output and its corresponding abnormal touch pressure output.
Where abnormal operation is indicated, the multiplication of the sum by the correction factor may be performed by multiplying the sum by the correction factor corresponding to which of the plurality of touch pressure sensors is operating normally.
The touch and pressure sensitive screen controller may be configured to, in the calibration mode: for each iteration of (c), generate a plurality of different correction factors for the given one of the plurality of touch pressure sensors being the designated given one, as a function of the variation between each reference touch pressure output and its corresponding abnormal touch pressure output, with each of the plurality of different correction factors corresponding to a different touch zone.
Where abnormal operation is indicated, the summing of the touch pressure data from each of the plurality of touch pressure sensors may be performed by, for each of the different touch zones, summing the touch pressure data from each of the plurality of touch pressure sensors associated with that zone to produce a zone sum, and the multiplication may be performed by multiplying each zone sum by a corresponding correction factor for that zone. The touch pressure output may be produced here by summing each zone sum after multiplication by its corresponding correction factor.
Disclosed herein is a method including determining whether touch pressure data acquired from each of a plurality of touch pressure sensors is indicative of abnormal operation. If abnormal operation is indicated, the method includes summing the touch pressure data from each of the plurality of touch pressure sensors except those touch pressure sensors having touch pressure data indicative of abnormal operation, and multiplying the sum by a correction factor to produce a touch pressure output indicative of physical force applied to the plurality of touch pressure sensors.
The correction factor may not be dependent upon which touch pressure sensors have touch pressure data indicative of abnormal operation.
One of the plurality of touch pressure sensors may have touch pressure data indicative of abnormal operation. The plurality of touch pressure sensors may be arranged into a plurality of different touch pressure sensing zones, with each touch pressure sensing zone containing at least two of the plurality of touch pressure sensors. The correction factor may be dependent upon which touch pressure sensing zone contains the touch pressure sensor having the touch pressure data indicative of abnormal operation.
At least two of the plurality of touch pressure sensors may have touch pressure data indicative of abnormal operation. The plurality of touch pressure sensors may be arranged into a plurality of different touch pressure sensing zones, with each touch pressure sensing zone containing at least two of the plurality of touch pressure sensors. For each of the at least two of the plurality of touch pressure sensors having the touch pressure data indicative of abnormal operation, a correction factor for the touch pressure sensing zone including that touch pressure sensor may be determined, and a touch pressure sum for the touch pressure sensing zone including that touch pressure sensor may be calculated and multiplied by the correction factor for that touch pressure sensing zone to produce a corrected touch pressure sum for that touch pressure sensing zone, wherein the touch pressure data for that touch pressure sensor indicative of abnormal operation is not included in the touch pressure sum for the touch pressure sensing zone including that touch pressure sensor. A touch pressure sum for each touch pressure sensing zone not including touch pressure sensors having touch pressure data indicative of abnormal operation may be calculated. The touch pressure sum for each touch pressure sensing zone not including at least one touch pressure sensor having touch pressure data indicative of abnormal operation may be summed with the corrected touch pressure sum for each touch pressure sensing zone including at least one touch pressure sensor having touch pressure indicative of abnormal operation.
Determining whether the touch pressure data from a given touch pressure sensor is indicative of abnormal operation may include comparing the touch pressure data from the given touch pressure sensor to a limit, and determining that the touch pressure data from that touch pressure sensor is abnormal based upon the comparison.
The limit may be an upper limit and the touch pressure data for that touch pressure sensor may be determined to be abnormal if the touch pressure data for that touch pressure sensor is greater than the upper limit.
The limit may be a lower limit and the touch pressure data for that touch pressure sensor may be determined to be abnormal if the touch pressure data for that touch pressure sensor is less than the lower limit.
In a calibration mode: a) for each of the plurality of touch pressure sensors, a reference touch pressure output for that touch pressure sensor may be produced; and b) a given one of the plurality of touch pressure sensors may be designated as being an abnormally operating touch pressure sensor, and, for each of the plurality of touch pressure sensors except the designated given one of the plurality of touch pressure sensors, a same force may be applied to that touch pressure sensor while acquiring touch pressure data for each of the plurality of touch pressure sensors except the designated given one to produce an abnormal reference touch pressure output for the designated given one of the plurality of touch pressure sensors.
In the calibration mode, the correction factor may be generated based upon a comparison between each reference touch pressure output and its corresponding abnormal touch pressure output.
Also disclosed herein is a method including for each of a plurality of touch pressure sensors, applying a same given force to that touch pressure sensor while acquiring touch pressure data from each of the plurality of touch pressure sensors to produce a reference sum for that touch pressure sensor. The method also includes for each of the plurality of touch pressure sensors, determining an abnormal operation sum for that touch pressure sensor by applying the same given force to that touch pressure sensor while acquiring touch pressure data from each of the plurality of touch pressure sensors but discarding the acquired touch pressure data for that touch pressure sensor. The method further includes calculating a variance for each touch pressure sensor based upon the reference sum and the abnormal operation sum for that touch pressure sensor, and calculating a correction factor for each touch pressure sensor based on its variance.
The method may also include summing acquired touch pressure data from each of the plurality of touch pressure sensors except the acquired touch pressure data from a touch pressure sensor having touch pressure data indicative of abnormal operation, and multiplying the sum by the correction factor for the touch pressure sensing having the touch pressure data indicative of abnormal operation to produce corrected touch pressure data.
Also disclosed herein is an apparatus including a controller for a touch and pressure sensitive screen including a plurality of touch pressure sensors, wherein the plurality of touch pressure sensors are arranged into a plurality of different touch sensing zones. The controller is configured to acquire touch pressure data from the plurality of touch pressure sensors and generate a zone sum for each of the plurality of different touch sensing zones. The zone sum for each of the plurality of different touch sensing zones may be generated by summing the touch pressure data from each of the plurality of touch pressure sensors within that touch sensing zone, if that touch sensing zone does not contain a touch pressure sensor having touch pressure data indicative of abnormal operation, to produce at least one zone sum, and summing the touch pressure data from each of the plurality of touch pressure sensors within that touch sensing zone except for the touch pressure data from a touch pressure sensor within that touch sensing zone indicative of abnormal operation to produce a zone sum to be corrected, and multiplying the zone sum to be corrected by a corresponding correction factor for that zone to produce at least one corrected zone sum. A touch pressure output may be produced by summing the at least one zone sum and the at least one corrected zone sum.
A touch and pressure sensing display may include the plurality of touch pressure sensors, and may include a plurality of touch location sensors separate from the plurality of touch pressure sensors.
Each touch pressure sensor may have touch pressure data indicative of abnormal operation is broken.
The plurality of touch pressure sensors are not touch location sensors.
One or more embodiments of the present disclosure will be described below. These described embodiments are only examples of the presently disclosed techniques. Additionally, in an effort to provide a concise description, all features of an actual implementation may not be described in the specification.
When introducing elements of various embodiments of the present disclosure, the articles “a,” “an,” and “the” are intended to mean that there are one or more of the elements. The terms “comprising,” “including,” and “having” are intended to be inclusive and mean that there may be additional elements other than the listed elements. Additionally, it should be understood that references to “one embodiment” or “an embodiment” of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features. Like reference numbers in the drawing figures refer to like elements throughout.
With initial reference to
In some instances, one or more of the touch pressure sensors PS1-PS15 may function abnormally, such as after becoming damaged. In these instances, the abnormally functioning touch pressure sensor or sensors PS1-PS15 may return incorrect touch pressure data, which can lead the controller 14 to provide incorrect data to other parts of the electronic device 10.
As can be seen, the touch pressure sensor PS1-PS15 can be separated into different pressure sensing zones 13a, 13b, 13c. These zones 13a, 13b, 13c are determined as groups of touch pressure sensors capable of influencing each other significantly if functioning abnormally. For example, for the arrangement of touch pressure sensors PS1-PS15 shown, pressure sensing zone 13a includes touch pressure sensors PS5, PS10, and PS15.
When any sensor in a zone is broken, the force applied to any place within this zone will have its output reading altered significantly because its output reading is equal to the sum of data from all sensors. Locations outside the zone may not see a significant change in results when a sensor within the zone is broken. Since any arrangement of touch pressure sensors may be used, it should be appreciated that the pressure sensing zones may be drawn in any suitable way, and that the techniques shown herein are not limited to the setup shown in
So as to permit touch and pressure sensing displays 12 with one or more abnormally functioning touch pressure sensors PS1-PS15 to still perform pressure sensing with satisfactory results, a touch pressure correction technique may be performed.
Such a touch pressure correction technique is now described with additional reference to flowchart 100 of
If the touch pressure data is not indicative of any abnormally operating touch pressure sensors PS1-PS15 at Block 106, then a sum of the touch pressure data from the touch pressure sensors PS1-PS15 is determined (at Block 107) by the controller 14 for use by other components of the electronic device 10, ending an iteration of the touch pressure correction technique (Block 116).
If the touch pressure data is indicative of an abnormally operating touch pressure sensor PS1-PS15, then one of two correction variants can be applied by the controller 14. A simpler correction variant includes selecting a correction factor dependent on which touch sensor is found to be operating abnormally (Block 109), summing the acquired touch pressure data while leaving out the item of data from the touch pressure sensor found to be operating abnormally (Block 111), and then multiplying the sum by the selected correction factor (Block 113). Thus, the corrected sum according to the simpler correction variant is calculated as:
S=αΣsensori,
where i includes all sensors except those found to be operating abnormally, sensori is the pressure data, and α is the correction factor.
For more accurate results, the more involved correction variant can be performed. Here, a different correction factor is selected for each pressure sensing zone 13a, 13b, 13c, dependent on which touch pressure sensor PS1-PS15 is operating abnormally (at Block 108). A touch pressure sum is then computed for each pressure sensing zone 13a, 13b, 13c (at Block 110), and each touch pressure sum is multiplied by the correction factor for that pressure sensing zone (at Block 112). Thus, the corrected sum according to the more involved correction variation variant is calculated, and each corrected touch pressure sum is summed. This is calculated as:
S=XΣsensori+YΣsensorj+ZΣsensork
where i includes the touch pressure sensors PS1, PS6, PS11 in zone 13c, j includes the touch pressure sensors PS2-PS4, PS7-PS9, PS12-PS14 in zone 13b, and k includes the touch pressure sensors PS5, P10, PS15 in zone 13a, X is the correction factor for zone 13c, Y is the correction factor for zone 13b, Z is the correction factor for zone 13a, and sensor is the pressure data. Note that data from touch pressure sensors considered to be operating abnormally is not included in this calculation.
This ends an iteration of this touch pressure correction technique (Block 116).
Determination of the correction factors in a calibration operation is now described with additional reference to the flowchart 200 of
Next, an abnormal operation sum is determined for each touch pressure sensor PS1-PS15 while having the same given force applied thereto, for a given touch pressure sensor assumed to be operating abnormally (Block 206). In greater detail, to determine the abnormal operation sum at the touch pressure sensor PS1, assuming the touch pressure sensor PS1 is operating abnormally, the same given force is applied to the touch pressure sensor PS1, and data is acquired from touch pressure sensors PS2-PS15 (or acquired from touch pressure sensors PS1-PS15, and then the data from touch pressure sensor PS1 is discarded). The touch pressure data from touch pressure sensors PS2-PS15 is summed, and this sum is the abnormal operation sum for touch pressure sensor PS1, assuming that touch pressure sensor PS1 is the touch pressure sensor operating abnormally. To determine the abnormal operation sum at the touch pressure sensor PS2, assuming the touch pressure sensor PS2 is operating abnormally, the same given force is applied to the touch pressure sensor PS2, and data is acquired from touch pressure sensors PS1-PS15 (or acquired from touch pressure sensors PS1-PS15, and then the data from touch pressure sensor PS2 is not used). The touch pressure data from touch pressure sensors PS1-PS15 is summed, excluding the data from touch pressure sensor PS2, and this sum is the abnormal operation sum for touch pressure sensor PS2, assuming that touch pressure sensor PS1 is the pressure sensor operating abnormally. This is performed for each touch pressure sensor PS1-PS15 to obtain the abnormal operation sum for the given touch pressure sensor (PS1 in the example).
Then, a variance for each touch pressure sensor PS1-PS15 is determined based upon the reference sum and the abnormal operation sum, for that given touch pressure sensor assumed to be operating abnormally (Block 208). A chart showing sample reference sums, abnormal operation sums, and variances is shown in
This sequence is repeated for each touch pressure sensor PS1-PS15 having a turn as the given touch pressure sensor assumed to be operating abnormally (Block 210). For example, Block 206 and Block 208 are performed for the touch pressure sensor PS1 being the given touch pressure sensor assumed to be operating abnormally, then Block 206 and 208 are performed for the touch pressure sensor PS2 being the given touch pressure sensor assumed to be operating abnormally, etc.
Next, if the simpler correction variant is to be used, then a different correction factor is determined for each touch pressure sensor presumed to be operating abnormally (Block 213), based on the variances. For example, correction factor α may be determined for touch pressure sensor PS1 being the given touch pressure sensor assumed to be operating abnormally, correction factor α may be determined for touch pressure sensor PS2 being the given touch pressure sensor assumed to be operating abnormally, etc. This way, the controller 14 can apply the proper correction factor based upon which touch pressure sensor PS1-PS15 is found to be operating abnormally.
If the more involved correction variant is to be used, then a different correction factor for each pressure sensing zone 13a, 13b, 13c is determined based on the variances (Block 212), for each touch pressure sensor presumed to be operating abnormally. For example, correction factors X, Y, and Z may be determined for touch pressure sensor PS1 being the given touch pressure sensor assumed to be operating abnormally, correction factors X, Y, Z may be determined for touch pressure sensor PS2 being the given touch pressure sensor assumed to be operating abnormally, etc. This way, the controller 14 can apply the proper correction factors to the pressure sensing zones 13a, 13b, and 13c based upon which touch pressure sensor PS1-PS15 is found to be operating abnormally.
Block 214 signifies the completion of the process for determination of the correction factors.
It should be understood that while the above has been described with reference to correction for one touch pressure sensor PS1-PS15 operating abnormally, it may be applied to correct for any number of abnormally operating touch pressure sensors PS1-PS15, by determining the correction factors the same way as described above but assuming two or more of the pressure sensors PS1-PS15 to be operating abnormally. In such a case, for example, with two sensors operating abnormally, the summation would not include the pressure for these two sensors.
While the disclosure has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments can be envisioned that do not depart from the scope of the disclosure as disclosed herein. Accordingly, the scope of the disclosure shall be limited only by the attached claims.
This application is a continuation of U.S. patent application Ser. No. 16/220,500, filed Dec. 14, 2018, which itself claims the benefit and priority of U.S. Provisional Patent Application No. 62/612,790, filed Jan. 2, 2018, the disclosures of both of which are incorporated by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 20080068343 | Hoshino et al. | Mar 2008 | A1 |
| 20110095919 | Ostermoller et al. | Apr 2011 | A1 |
| 20120032907 | Koizumi et al. | Feb 2012 | A1 |
| 20140043289 | Stern | Feb 2014 | A1 |
| 20150220198 | Yoo et al. | Aug 2015 | A1 |
| 20190018050 | Wang | Jan 2019 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20200310583 A1 | Oct 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62612790 | Jan 2018 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16220500 | Dec 2018 | US |
| Child | 16902938 | US |
