The present invention relates generally to the field of touch based interaction systems. More particularly, the present invention relates to a touch sensing apparatus for detecting touch pressure, and a related method.
In one category of touch-sensitive apparatuses a set of optical emitters are arranged around the perimeter of a touch surface of a panel to emit light that is reflected to propagate across the touch surface. A set of light detectors are also arranged around the perimeter of the touch surface to receive light from the set of emitters from the touch surface. I.e. a grid of intersecting light paths are created across the touch surface, also referred to as scanlines. An object that touches the touch surface will attenuate the light on one or more scanlines of the light and cause a change in the light received by one or more of the detectors. The coordinates, shape or area of the object may be determined by analysing the received light at the detectors. In one category of touch-sensitive apparatuses the light is reflected to propagate above the touch surface, i.e. the intersecting light paths extend across the panel above the touch surface. In some applications it is desirable to utilize the pressure of the interaction object, such as a stylus, against the touch surface for controlling the touch interaction. Such control may be desirable both in terms of varying the display of the touch operations on the screen, such as writing or drawing with different shapes of brushes or patterns, and for controlling different operations of a particular touch application. Previous techniques for such touch control typically rely on complex input devices, such as styluses, having various integrated sensors. This increases the complexity and limits the user's choices input devices. This may hinder the development towards highly customizable and intuitive touch systems.
An objective is to at least partly overcome one or more of the above identified limitations of the prior art.
One objective is to provide a touch-sensing apparatus which provides for facilitated user interaction and control of touch response, while keeping the cost of the touch interaction system at a minimum.
One or more of these objectives, and other objectives that may appear from the description below, are at least partly achieved by means of touch-sensing apparatuses according to the independent claims, embodiments thereof being defined by the dependent claims.
According to a first aspect a touch sensing apparatus a touch sensing apparatus for detecting touch pressure is provided, comprising a panel that defines a touch surface, the panel having a perimeter, a plurality of emitters arranged along the perimeter, wherein the emitters emit light across the panel, a plurality of detectors arranged along the perimeter, whereby the detectors are arranged to receive at least part of said light as detection light, wherein the touch sensing apparatus is configured to determine a difference in the received detection light between deflection of the panel from a first position (p1) to a second position (p2) along a normal of the touch surface when a touch object deflects the panel, and determine a pressure of the touch object against the touch surface based on said difference.
According to a second aspect a method is provided for detecting touch pressure in a touch sensing apparatus comprising a panel that defines a touch surface, the panel having a perimeter, the method comprising emitting light across the panel with a plurality of emitters arranged along the perimeter, receiving at least part of said light as detection light with a plurality of detectors arranged along the perimeter, determining, as a touch object deflects the panel along a normal of the touch surface, a difference in the received detection light between deflection of the panel from a first position (p1) to a second position (p2) along the normal, and determining a pressure of the touch object against the touch surface based on said difference.
According to a third aspect a computer program product is provided comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of the method according to the second aspect.
Further examples of the invention are defined in the dependent claims, wherein features for the first aspect may be implemented for the second aspect, and vice versa.
Some examples of the disclosure provide for a touch sensing apparatus with a facilitated user input.
Some examples of the disclosure provide for increasing a user's choice of touch input devices.
Some examples of the disclosure provide for improving the touch input from a passive stylus.
Some examples of the disclosure provide for a touch sensitive apparatus in which the modelling of pressure when writing or drawing on the touch surface is improved.
Some examples of the disclosure provide for producing a display of touch response with a more accurate brush-like shape.
Still other objectives, features, aspects and advantages of the present disclosure will appear from the following detailed description, from the attached claims as well as from the drawings.
It should be emphasized that the term “comprises/comprising” when used in this specification is taken to specify the presence of stated features, integers, steps or components but does not preclude the presence or addition of one or more other features, integers, steps, components or groups thereof.
These and other aspects, features and advantages of which examples of the invention are capable of will be apparent and elucidated from the following description of examples of the present invention, reference being made to the accompanying drawings, in which;
In the following, embodiments of the present invention will be presented for a specific example of a touch-sensitive apparatus. Throughout the description, the same reference numerals are used to identify corresponding elements.
The panel 101 has a perimeter 103. The touch sensing apparatus 100 comprises a plurality of emitters 104 arranged along the perimeter 103, as schematically shown in
The touch sensing apparatus 100 is configured to determine, as the touch object 107 deflects the panel 101 along the normal 108 of the touch surface 102, a difference in the received detection light 106′ between deflection of the panel 101 from a first position (p1) to a second position (p2) along the normal 108. The deflection of the panel 101 along the normal 108 will have effect on the number of reflection paths for the emitted light 106 towards the detectors 105. Thus, the amount of received detection light 106′ at the detectors 105 will be affected by the deflection, i.e. the curvature of the panel 101 relative the normal 108. For example, the deflection of the panel 101 from the essentially flat shape in
The touch sensing apparatus 100 is configured to determine a pressure of the touch object 107 against the touch surface 102 based on the determined difference in received detection light 106′. Thus, based on the increase or decrease in the amount of received detection light 106′, the touch sensing apparatus 100 determines the pressure applied onto the panel 101 and the touch surface 102 thereof. For example, as discussed above, detecting an increase in the amount of received detection light 106′ at the detectors 105 can be associated with an increased amount of deflection of the panel 101 along the normal direction 108, e.g. an increase in Δd1 or Δd2, and an increase in the amount of pressure applied by the touch object 107 on the panel 101. Likewise, detecting a decrease in the amount of received detection light 106′ at the detectors 105 can be associated with a decreased amount of deflection of the panel 101 and a decrease in the amount of pressure applied by the touch object 107 on the panel 101. The touch sensing apparatus 100 may thus be configured to control the touch interaction based on the determined variation in pressure. The user may accordingly use any touch object 107 for touch interaction since the pressure onto the touch surface 102 is determined based on the deflection of the panel 101, independently of the type of touch object 107. The user may thus use passive touch objects 107, such as the user's hand, or any passive stylus or brush, without the need of pressure sensors in the touch object 107 itself. This provides for a more intuitive touch interaction and a greater freedom for the user to use individual styluses or brushes.
An example is illustrated in
Detecting the pressure as described above provides for a less complex touch sensing apparatus 100. In addition to the mentioned benefits of utilizing passive touch objects 107, there is further no need to implement pressure sensors along the panel 101 itself. Determining the pressure based on the detected difference in the received detection light 106′ thus provides for a robust and facilitated control of touch input based on touch pressure while allowing for a less complex and costly touch sensing apparatus 100. A facilitated control and modelling of the touch response is also provided due to the improved pressure detection, e.g. when modelling the influence of the amount of pressure applied when writing or drawing on the touch surface, such as modelling the dynamics and visual touch response of a brush when the pressure on the brush is varied. The touch sensing apparatus 100 may allow producing a display of a virtual brush with a more accurate brush-like shape in such example.
The touch sensing apparatus 100 may accordingly be configured to output a control signal to display a visual output depending on the pressure, such as a shape of a brush which dynamically varies in size, shape and/or direction depending on the amount of pressure applied. The graphical rendering of strokes from a brush or pen may thus be modified depending on the pressure value. Thickness, opacity or other graphical aspect can be modified. Alternatively, or in addition, the touch sensing apparatus 100 may be configured to control the touch sensing apparatus 100 based on the pressure. A user may for example use a “knocking gesture”, as a short high-pressure interaction gesture, which is distinguished from a softer touch on the touch surface 102 to input a control command. Such gesture can be assigned to functions in the application such as moving elements in and out of the background, (un)pinning or (un)locking elements that was knocked on, trigger a “force” that will move graphical elements towards or away from the knock position, trigging a global effect such as “new document”, “close document” or other global command. It is conceivable that various other sequences of pressure values can be assigned a special meaning in different touch applications, such as double-clicking by two rapid increases in pressure allows trigging an event without lifting the pen from the surface.
The touch sensing apparatus 100 may be configured to determine the pressure continuously based on detected differences in the received detection light 106′ upon deflection of the panel 101. For example, as illustrated in
The touch sensing apparatus 100 may be configured to determine the pressure based on a difference between received detection light 106′ upon deflection of the panel 101 and a reference background signal of detection light 106′. For example, the reference background signal can be determined when the panel 101 has the position shown in
The pressure may be determined as being proportional to the aforementioned difference in the detection light 106′ being received at the detectors 105. E.g. the pressure may be determined as increasing as the distance Δd1 or Δd2 in the example of
For a given difference in the received detection light 106′ between a first emitter and a first detector, the pressure may be determined as inversely proportional to a length (Δed) between the first emitter and the first detector. For example, turning to
For a given difference in the received detection light 106′, between a first emitter 104 and a first detector 105, the pressure (P) may be determined as inversely proportional to the length Δl between a position (x,y) of the touch object 107 on the touch surface 102 and the first emitter 104, or the first detector 105, i.e. P∝1/Δ1. For example, if a pressure is applied close to the perimeter 103, i.e. close to the emitter 104 or detector 105 (thus for a short length Δl), the deflection of the panel 101 is less compared to a case where the same pressure would be applied close to the center of the panel 101, i.e. with an increase in the length Δl. Thus, for detected difference (v), the associated pressure may be determined as inversely proportional to the length (Δl). I.e. as Δl increases less pressure is required to deflect the panel 101 a certain distance (Δd1 or Δd2). Vice versa, for shorter lengths Δl, a greater pressure is needed to deflect the panel 101 a corresponding distance (Δd1 or Δd2). The pressure may be determined as inversely proportional to each of the associated lengths (Δl) between the emitters and detector pairs in the signal matrix.
The pressure may be determined as proportional to the aforementioned difference (v) divided by Δed*Δ1; P(k)=v/(Δed*Δ1), where k is the number of scanlines.
An estimated pressure may be determined as a mean value of the individual pressure values P(k) of the scanlines.
The length Δl may be chosen as the minimum of; the distance between the position (x,y) of the touch object 107 on the touch surface 102 and the first emitter 104, and the distance between said position (x,y) and the first detector 105.
The touch sensing apparatus 100 may be configured to define a region of interest 109 around a position (x,y) of the touch object 107 on the touch surface 102. The region of interest 109 may be a defined area around a currently determined coordinate (x,y) where the touch object 107 contacts the touch surface 102. The coordinate (x,y) may be determined based on the attenuation of the light as the touch object touches the touch surface 102, as described in the introductory part of the present disclosure. The touch sensing apparatus 100 may be configured to determine the aforementioned difference (v) for light passing through the region of interest 109, between respective pairs of emitters 104 and detectors 105. I.e. the difference (v) in the received detection light 106′ at the detectors 105, as the touch object 107 applies a pressure on the panel 101, is determined for scanlines passing through the region of interest 109. The touch sensing apparatus 100 may be configured to determine an averaged pressure based on the determined differences (v) for the pairs of emitters and detectors associated with the scanlines passing through the region of interest 109. This provides for a more effective determination of the pressure, as it is not necessary to determine the difference (v) for the entire signal matrix. The amount of deflection of the panel 101 along the normal 108 can be regarded as being largest around the touch coordinate (x,y) where the pressure is applied.
The touch sensing apparatus 100 may be configured to determine a first estimate of a pressure at a touch position (x,y) on the touch surface 102. The touch sensing apparatus 100 may be configured to calculate a detection light signal difference (v′) based on the first estimate of the pressure. The touch sensing apparatus 100 may be configured to solve the pressure by iteratively minimizing a differential between a measured value of the difference (v) in the received detection light 106′ and the calculated detection light signal difference (v′). I.e. a detection light signal difference (v′) is calculated for different candidate pressure values until |v-v′| is minimized and the best candidate for the pressure is obtained. The pressure may be iteratively determined at a plurality of positions (x1..xn,y1..yn) on the touch surface 102, e.g. when a plurality of pressure points is applied on the touch surface 102 by a user's hand or other touch objects 107. The plurality of touch positions (x1..xn,y1..yn) may be determined by the light attenuation as described in the introductory part of the present disclosure. Thus, the associated pressure (p1..pn) at the plurality of touch positions (x1..xn,y1..yn) may be determined iteratively as described above. This determination may be done for each scanline in the signal matrix or for a subset of the scanlines in the region of interest 109. The starting guess for (p1..pn) may be based on the last calculated pressure for the respective positions in a previous frame, for contact points that was present in such previous frame. For new pressure point interactions, a typical pressure value is assigned as starting guess. It should be noted that although reference is made to determining a pressure throughout the disclosure, it should be understood that this is analogous to determining a force, in which case a conversion factor is applied to convert between pressure and force values.
The touch sensing apparatus 100 may be configured to determine a deflection of the panel 101 along the normal 108 resulting from the first estimate of the pressure at the touch position (x,y). The touch sensing apparatus 100 may be configured to calculate the detection light signal difference (v′) resulting from such deflection. The deflection resulting from the different candidates of pressure values may be determined by analytical expressions, for given geometries of the panel 101, and/or by FEM-based numerical methods, and/or by empirically by applying known forces to a particular configuration of the touch sensing apparatus 100 and panel 101 and storing the parameters of the resulting model. The corresponding deflection resulting from the pressure estimates may thus be determined, as well as the associated detection light signal difference (v′) resulting from corresponding shapes of the panel 101 for these deflection values. The influence of the deflection and shape of the panel 101 on the number of reflection paths of the light 106, 106′, towards the detectors 105 and resulting detection light signal difference (v′) may be determined by different models, analogous to the above discussion, e.g. by analytical, numerical and/or empirical models. Once the detection light signal difference (v′) is calculated, the pressure may be iteratively determined by minimizing |v-v′| as described above.
The touch sensing apparatus 100 may be configured to determine the detection light signal difference (v′) based on a plurality of reference detection light signal differences resulting from a respective plurality of reference pressures on the touch surface 102. The reference detection light signal differences may be determined empirically. The best candidates of the associated reference pressures may thus be identified, which minimizes |v-v′|, to obtain the best estimate of the pressure. It is also conceivable that a plurality of reference detection light signal differences and a plurality of reference pressures are utilized in look-up tables to directly identify the best estimate of the pressure based on the currently measured signal difference (v). In one example, the closest comparing look-up tables may be interpolated to obtain the best estimate of the pressure.
The touch sensing apparatus 100 may be configured to determine an amount of deflection of the panel 101 along the normal direction 108 based on the pressure. As mentioned above, the deflection may be determined by analytical, numerical and/or empirical models. The amount of deflection and current shape of the panel 101 may be utilized for optimizing the touch detection, e.g. to improve accuracy and/or resolution of the touch detection, and/or to provide characteristics and diagnostics data of the touch sensing apparatus 100, such as the panel 101 and related components for attaching the panel 101 to frame elements of the touch sensing apparatus 100.
The touch sensing apparatus 100 may be configured to determine a vibration amplitude and/or a vibration frequency of the panel 101 based on a determined variation of the pressure over time. I.e. the deflection of the panel 101 may be a result of mechanical vibrations of the panel 101, which may in turn originate from other components of the touch sensing apparatus 100, and/or from motions in the environment surrounding the touch sensing apparatus 100. The vibration characteristics may be utilized for optimizing the touch detection, e.g. to improve accuracy and/or resolution of the touch detection, and/or to provide characteristics and diagnostics data of the touch sensing apparatus 100. In another example, the panel 101 may be assumed to vibrate with a particular default frequency, such as 10 Hz. If there has not been an interaction on the touch surface 102 recently, the source of the vibration can be assumed to originate from the environment around the touch sensing apparatus 100. Such vibration sources can be the on/off state of machinery nearby, a person walking (low amplitude) or jumping (higher amplitude). The vibration events detected in this way may be detected as “gesture”, such as a “jump gesture”. For example, in a touch application such as a game application, such “jump gesture” may trigger an in-game event. In another example, vibrations in a stand on which the touch sensing apparatus 100 may be mounted may result in a slower vibration, e.g. in the 1-2 Hz range. For variable height stands, the frequency of the slower stand oscillations can be used to estimate the current height of the stand.
A computer program product is provided comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of the method 200 as described above in relation to
The invention has mainly been described above with reference to a few embodiments. However, as is readily appreciated by a person skilled in the art, other embodiments than the ones disclosed above are equally possible within the scope and spirit of the invention, which is defined and limited only by the appended patent claims. For example, the specific arrangement of emitters and detectors as illustrated and discussed in the foregoing is merely given as an example.
Number | Date | Country | Kind |
---|---|---|---|
1930383-3 | Nov 2019 | SE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/SE2020/051117 | 11/24/2020 | WO |