Over recent years, touch sensing devices have become more and more important. Touch sensing devices can be divided into three different categories: optical, resistive, and capacitive tracking devices.
Optical touch solutions are highly dependent on ambient lighting and the material of the tracking object. In addition, the separation of ‘touch’ and ‘pen’ inputs is not easily possible.
Resistive array-based sensors usually consist of two layers of conductive material, one with horizontal lines and one with vertical lines. When a user touches the surface, the horizontal and vertical lanes are alternately connected, enabling the flow of current. Although this approach is inexpensive and energy-efficient, the tracking resolution is limited to the space between the sensing lines. Alternatively, plane-type conductors with well-defined resistivity are used as top and bottom electrodes. The touch signal is measured by applying a voltage to one of the electrodes and detecting the resistance of the other electrode relative to the electrode edges. This is similar to treating the electrodes as a voltage divider. Here the resolution is mainly determined by the sensitivity of the read-out electronic, the separation between the electrodes (spacer) and the homogeneity of the electrodes' conductivity. However, the standard resistive touch panel concept is not suitable for pressure sensing.
From US 2009/0256817 A1 there is known a resistive, pressure-sensitive touch-based input device for tracking both touches as well as pens based on Interpolating Force Sensitive Resistance (IFSR). In this setup, the sensing material is mounted on a paper-thin flexible/bendable material and is able to sense pressure input.
Capacitive touch sensors consist of a thin conductive layer placed on an insulator, such as a glass. This layer serves as the electrode of a capacitor. A touch on the surface results in a distortion of the panel's electrostatic field and is measurable as a change in capacitance. However, capacitive sensing can only measure the touch location (resolution is limited by touch area). It is not suitable for pressure sensing. Another major disadvantage of this technique is that it relies on the dielectric properties of the human body; thus, stylus or objects cannot be tracked.
State-of-the-Art piezoelectric sensing devices exploit the piezoelectric effect only indirectly by detection of touch-induced surface (acoustic) waves via piezoelectric transducers placed at the device corners. Such devices are expensive due to the costs of the required inorganic piezoelectric materials and the involved costly assembling process. They provide only limited user interaction as for example the detection of a motion-less finger is impossible.
WO 2012/025412 A1 describes a method of producing piezoelectric and pyroelectric coatings.
U.S. Pat. No. 8,138,882 B2 describes the use of a sensing device in an “intelligent floor”.
Although some of the above mentioned sensor concepts provide multi-touch sensing capabilities, it is often not possible to track the pressure of the input efficiently and accurately. Also, it is desirable to track pen and touch operations separately. In addition, it is desirable to combine the tracking of pen and touch operations with pressure tracking.
The present invention aims to address these and other issues.
The present invention is defined in the claims.
Exemplary embodiments of the invention will now be described with reference to the drawings.
In an embodiment of the present invention, there is provided a pressure-sensing input device that is based on a ferroelectric material that supports both pyro- and piezoelectric effects. The ferroelectric material can be used for sensing pressures changes on large, flat and/or bended surfaces. The input device has a sandwich structure of four layers that can be printed easily on any material. This material can be used in combination with a high-resolution optical based sensing foil, such as described in US 2011/0310066 A1, or an optical Stytlus as described in US 2012/0127110 A1.
The input device supports both hand and pen input tracking. The foil implementing the device is bendable, energy-efficient, and it can be produced easily in a printing process.
The input device also supports a hovering mode based on the pyroelectric effect.
Piezoelectric materials are like wet sponges when they are squeezed and water pours out. The amplitude and frequency of the signal is directly proportional to the mechanical deformation of the piezoelectric material. The induced deformation of the piezo-element causes a change in the surface charge density of the material resulting in a voltage between the electrodes (
A PVDF film, like all piezoelectric materials, is a dynamic material developing an electrical charge proportional to a change in mechanical stress. As a consequence, piezoelectric materials itself are not suitable for static measurements due to their internal resistance. The electric charges generated in the polymer film decay with a time constant determined by the dielectric constant, the internal resistance of the film and the input impedance of the interface electronics to which the film is connected (
Pyroelectric sensor materials are usually dielectric materials with a temperature-dependent molecular dipole moment. As these materials absorb thermal energy, they expand (or contract). Due to the expansion an indirect piezoelectric signal is caused. A reduction of the average polarization of the film (sum of molecular dipole moments) is caused by random motion of the dipoles upon heating; this generates a charge to be built up on the film surface. Analogous to piezoelectricity and stress, the pyroelectric output current is proportional to the rate of temperature change. The pyroelectric charge coefficient describes the amount of electrical charge generated per degree of temperature change.
According to an embodiment of the invention, based on the afore-mentioned material properties, piezo and pyroelectric polymer films are employed for sensing of pressure and temperature changes in a large area. In particular, by employing a printable formulation of a piezo- and pyroelectric polymer ink, in combination with an appropriate layout of sensors, the fabrication of cost efficient, large-area sensors by screen printing processes is made possible. These sensors are capable of pressure sensing and tracking (touch and/or pen input) as well as detecting the approach or proximity of IR-emitters such as human hands (hovering interaction).
In
These problems can be addressed either by adding an IR-light reflecting layer/lamination which might act as a heat sink as well, thus—reducing the pyroelectric response—or by providing a foil design as described below.
In an embodiment the sensing foil is based on a 16×8 array of screen printed, flexible, capacitive, circular sensor spots having a diameter of 10 mm. The basis of the touch foil is a transparent plastic substrate, which serves as a carrier for the printed materials. In the next step 128 circular spots (electrodes) are printed to the carrier material, which are connected horizontally. Subsequently, the plastic substrate is coated in its entirety with a ferroelectric material. After that, a second layer of vertically connected electrodes is printed. The two layers of electrodes form a capacitor. Charge changes in the ferroelectric sensor layer cause measurable voltages between the electrodes.
For applications with a strict pen and touch separation (e.g. if a pen is used for annotations and touches are used for manipulations), a stable separation of both inputs is necessary. To achieve this, in an embodiment, the illustrated sensor foil is combined with a foil of the type described in US 2011/0310066 A1 in order to provide a stable pen and touch tracking. Such additional foil acts as a temperature absorbing layer to reduce the pyroelectric response.
Using the afore described design for multi-touch sensing, so-called ghost points may occur due to the design of the sensor foil. For avoiding “ghosting” at multi-touch input, in an embodiment, a special type of sensor foil is used. The sensor foil comprises two sensor layers having a grid structure of orthogonal top- and bottom electrodes applied on both sides of the substrate. The direction of the top- and bottom electrodes of the two sensor grids are rotated by 45°, thus showing real touch points on both sensor layers at the equal position but generating ghost points at different positions. By subtracting the input signals of both foils, the remaining signals can definitely be attributed to the ghosting points, thus revealing the true touch positions in multi-touch applications.
Fabrication may be implemented by low-cost printing of a smart active matrix sensor array with four functional inks:
a fluoropolymer sensor ink,
a conductive polymer ink,
a conductive carbon paste, and
a conductive silver ink.
The sensor ink may be formed by a P(VDF-TrFE) (poly(vinylidene fluoride trifluoroethylene). The polymer ink may be formed by a PEDOT:PSS (poly(3,4-ethylenedioxythiophene):poly(styrene sulfonic acid)) ink.
A substrate is formed by a transparent, flexible (175 μm thick) plastic foil, thereby providing high flexibility and good adhesion of the functional materials (inks) applied during the screen printing process. The sensor ink is based on the pyro- and piezoelectric copolymer P(VDF-TrFE) which has a semi-crystalline structure and can be printed on the foil thus forming a 5 μm thick transparent layer. Silver conductive lines are printed for connecting the sensor electrodes to a Molex 1.00 mm Pitch FFC/FPC connector. After the printing step, each layer undergoes a short annealing treatment at 100° C. only. This calcination provides complete solvent evaporation thus increasing the functional properties (conductivity, piezo- and pyroelectric response) of each layer. Owing to the humble thermal requirements, the overall process can be considered a low temperature fabrication.
For providing improved macroscopic piezo- and pyroelectric response, the randomly ordered and dipole containing nano-crystallites that are embedded in an amorphous matrix are aligned vertically to the sensor electrodes. This can be implemented by hysteresis poling of the sensors using a Sawyer-Tower-Circuit. For sufficient and durable dipole alignment, an electric field in the range of 140 MV/m being twice as much as the coercive field strength is applied. This procedure leads to a very high remnant polarization of 70 mC/m2 at a poling frequency of 10 Hz.
The resulting sensor foil provides printed, large-area, flexible and durable polymer sensors, showing a piezoelectric coefficient d33 of 20-30 pC/N, a pyroelectric coefficient p33 of 40 μC/m2K at room temperature, and a Curie temperature of 125° C.
The equivalent circuit of a piezoelectric sensor is a current source with an internal resistance Rs (1 GΩ) and an internal capacitance Cs (1 nF), as depicted in
In the next step, the signal noise is reduced. According to the surrounding mains voltage, the electrical noise is around 50 Hz in the signal spectrum. Therefore, a 50 Hz Notch filter is used to remove this noise (
In the illustrated embodiment, a highly energy-efficient 32-bit Cortex-M3 micro-controller from ATMEL is employed (
In an embodiment the sensor matrix has 128 sensor spots covering a 210×130 mm2 area. The electrodes on the bottom are connected horizontally and the electrodes on the top are connected vertically. An ultra-low leakage analogue multiplexer is used to connect the horizontal row to ground. Meanwhile, all other rows are on high impedance (
Every column is connected to an impedance converter circuit. Additional analogue multiplexers are used to switch on/off the impedance converter outputs to one of the analogue digital converters' inputs of the micro-controller.
All sensor spots are measured and their output voltage is sent to a processing means (computer) every 10 ms. The scan for all 128 sensors takes 4.352 ms (128×34 μs). To sum up, it takes approximately 1 μs for driving the analogue multiplexer, 25 μs for waiting for the multiplexer and filtering circuits to settle to the new sensor output, and finally 8 μs for the A/D conversions. After scanning all sensors, it takes additional 2 μs to configure the DMA controller of the USB Core to send the results to the PC. Due to the short processing time enough capacity is left for larger foils or higher touch point density.
Every pressure-change on a sensor spot generates a charge and eventuates in a measurable voltage. If no further pressure-change occurs, the voltage discharges through internal resistance of the piezoelectric film and the input resistance of the measurement circuit. This discharge follows an exponential function and is predictable if the parameters of the exponential function are known.
Every deviation of the predicted value must be caused by a new pressure change on the sensor. This can be used to process the pressure changes from the sensor signal. In an additional step, the pressure progress can be calculated by integrating all pressure changes.
When a sampling rate of 100 Hz is used t is 10 ms. The time constant τ of the exponential function depends on the internal resistance and capacitance of the sensor as well as the input impedance of the measurement circuit. A pneumatic measurement setup may be used to apply repeatable forces to a sensor spot. This setup helps to measure the step response of one single sensor spot. A fitting tool can be used to interpolate the step response with an exponential function (
The interpolated exponential function has a τ of 17.72 ms. Thereafter, all parameters that are required to process the pressure progress from the sensor output, are known.
To provide a stable solution for a pen and touch tracking, it is preferred to combine the above described foil design with an additional dot pattern, as provided, for example, by ANOTO®.
The pen and touch separation is realized through software-based processing. A combined input driver analyses both pen and touch input data synchronously. Whenever a new touch is performed, the input driver waits for about 50 ms for a pen input at the same spot (within a small threshold). During this period, all touch data gets temporarily stored in the input driver. Whenever a pen input is noticed, the input driver forwards only the pen input and ignores the touch input. Otherwise, the temporarily stored touch data gets regularly forwarded to the applications.
Human Machine Interface (HMI) with Haptic/Acoustic Feedback
In an embodiment, the sensing device or the present invention is used to implement HMI. The HMI technology based on the PyzoFlex technology has the potential of providing touch-input functionality in a low-cost process by printing over large-areas on flexible substrates, optionally with nearly transparent electrodes. 3D-patterning of the active ferroelectric material by imprinting enables combining passive haptic with acoustic feedback in one functional layer.
In am embodiment, the basic element of the HMI technology is an array of printed ferroelectric sensor capacitors based on the semicrystalline ferroelectric polymer PVDF-TrFE as the dielectric sandwiched between transparent or IR-absorbing electrodes. The sensor is sensitive to changes either in pressure due to its piezoelectric nature or in temperature due to its pyroelectric nature. Such printed capacitive sensor array can be integrated monolithically with organic transistors and display elements and further be utilized as a flexible, easy processable, low-cost user interface that can be controlled either by touch or by proximity (non-touch).
All layers can be deposited by screen printing. If transparent and smooth layers are required, potential materials for the electrodes are (i) PEDOT:PSS or (ii) printable metallic nanowires, as an alternative to current ITO technologies. If low resistivity and/or good IR-absorbance are important, Carbon and Ag are the materials of choice.
In an embodiment, a new membrane button concept is provided. In particular, the printed piezoelectric polymer can serve as a pressure sensor for inputs and as an actuator for tactile feedback, but also as a loudspeaker enabling acoustic feedback.
As the input device of the present invention is printed, the rigidity of the backbone (substrate) in combination with the adhesion of the printed PVDF-TrFE affects the vibrational output of the sensor device. In an embodiment, in order to amplify the vibrational amplitude for tactile and/or acoustic user feedback, either a structured substrate is used, such as a perforated film, or a polymer film with cavities fabricated by hot embossing/imprinting and an imprinted dome-shaped sensor capacitor. This is illustrated in
The result is a simple input key with passive haptic feedback based on pressure induced deformation of the keypad which induces charges at the electrodes attached to the active polymer. After signal detection of the key, processing means connected to the input device can generate an active feedback on an actuator/speaker by producing a voltage signal of any defined frequency and amplitude (either for haptic sensing, acoustic sensing or both). The final impression of the feedback given to the user can be freely designed for any purposes and surroundings. The intensity of the feedback signal can be determined by the design of the backbone, the size of the keypads and the signal sent to the sensor. Moreover, it is desirable to optimize the sound response and acoustic pressure of a speaker without effecting the overall key design and functionality. A preferred embodiment comprises the fabrication of dome-shaped PVDF sensors with optimized stiffness for radiating acoustic waves at specified frequencies and sound levels.
For a piezoelectric multi touch panel, the electrode pattern according to an embodiment of the invention is either an array type with the resolution being limited by the printing process or a triangular type based on a low conducting laminar electrode with higher resolution.
In an embodiment of the invention there is provided a (multi-) touch panel based on a true piezoelectric sensor, especially generated by a low-cost, printable polymer paste. The embodiments described above can be used for fabricating large area, printed (multi-) touch sensors for different kinds of user interactions. Since the ferroelectric polymer is transparent in the visible range, it can also be used for fabricating touchscreens by means of transparent electrode materials. For reliable triggering of single touch-points, an array-like structure of orthogonally ordered bottom and top electrodes forming piezoelectric active, capacitive areas at the overlapping regions is provided.
However, when multi touch gestures are to be captured, the generation of ghost points due charge distribution described by the Kirchhoff's laws becomes difficult in a single layer approach. In an embodiment of the invention, this problem is addressed not by using a combination of complex and costly electronics and software as, for example, it is done in connection with prior art capacitive touchscreens. Rather, in this embodiment, reliable multi-touch recognition is achieved by adding a second sensor layer to the single-touch panel by tilting the direction of the electrodes by 45°. This design allows the determination of the touch inputs by subtracting the piezoelectric sensor signals from both sensor panels, thus eliminating the true touch-points and revealing the ghost-points caused by charge distribution. This is illustrated in
In another embodiment of the invention there is provided a triangulation based piezoelectric touch panel that exploits a difference in resistivity of the electrode materials. In this embodiment the signals are detected in the corner of the sensor foil and due to a distance-dependent decrease of the sensor signal, being related to the series resistance of the low-conducting electrode, the exact location of the excitation point can be calculated.
In an embodiment of the invention, the active Polymer used within the sensor device is piezo- and pyroelectric (PVDF-TrFE) or can be tuned to be one of both (PVDF-TrFE+nanocomposite), not only the detection of touch input caused by pressure changes but also the change of temperature can be sensed.
By using the sensor structure related to the (multi-) touch panel as described above, local changes of heat can be detected as well. In combination with suitable processing means, spatially resolved changes of heat can be recorded and analysed. This technology can be used for the cost efficient fabrication of active laser safety walls, for example for automated laser welding systems or in the vicinity of automated laser fabrication systems exceeding a certain laser class. For those applications, the thermally sensitive sensor-foil included in the sensing device of the present invention is attached to a passive laser housing (typically consisting of a metal plate of appropriate thickness) for forwarding the heat generated by a defocused or scattered laser beam directly to the sensor array. Processing means are provided to decide if and which kind of hazardous event occurs and to initiate an alarm or shut down the laser system if necessary, depending on the signal distribution and amplitude.
With this embodiment, it is possible to fabricate large area active laser-safety-walls by combining/stitching together an appropriate amount of sensor sheets. This also enables an easy replacement of damaged parts after a hazardous event. Further, the spatial resolution of the sensor sheets allows for simplified error diagnostics since the intensity and position of the temperature rise can be revealed by the processing means.
In an embodiment of the invention, the sensing device comprises a passive capacitive sensor which separates charges on the electrodes when a pressure and/or temperature change occurs. Because of these characteristics, the sensor can be employed as an energy converter which converts mechanical and thermal energy to electrical energy. In an embodiment, the sensing device can be used as energy harvester in the vicinity of vibrational changes and/or thermal fluctuations.
The charge generated in response to the detection of mechanical energy depends on the amplitude and frequency of vibrations and/or thermal changes as well as on the sensor area. Preferably, the design of the capacitive energy harvester is adapted to the existing surrounding. In particular, the thickness of the active polymer affects the current to voltage ratio and the size of the active area to be excited relates to the amount of generated charge. For example, using a single HMI-sensor with an area of 0.7 cm2, 3 nC can be generated in a single touch event. By adapting the sensor design, the generated energy can be used, for example, to bias a wireless sensor node within a wireless sensor network in an industrial automation surrounding or any appropriate appliance in the context of ambient assisted living.
The sensing device of the present invention is capable of detecting vibrations over a wide frequency spectrum. Accordingly, the sensing device can be used as a microphones, a solid bone sound sensor, or as an acceleration sensor.
In the context of ambient assisted living (e.g. intelligent floor) and security applications (e.g. detection of vandalism), typical sound patterns indicate certain incidents. In an embodiment of the invention, the sensing device is attached to a surface, for example the walls or floor of a room in a building. The vibrations in/of the surface can be detected and analyzed on the basis of the sensing device's capability of sensing various frequencies.
The acoustic sensitivity of the sensing device can be tuned to a certain frequency band by varying its size, shape and thickness. In the field of security applications, certain events (e.g. breaking glass) can be detected by comparing the recorded signal with a reference database storing data indicative of certain events, thus enabling their detection (e.g. vandalism, accidents or other security relevant events).
In the growing field of ubiquitous computing in daily surroundings (ambient assisted living), one aspect of growing interest is the “intelligent floor” (U.S. Pat. No. 8,138,882 B2).
In an embodiment of the invention, the sensing device is implemented in/on a floor structure. Due to the sensing device's robustness, shape and capability for uses as a sensor for pressure/temperature changes, acceleration sensor and/or solid bone sound sensor, the sensing device enables the detection and tracking of e.g. moving people/animals, acoustic events, temperature changes (e.g. fire) and much more.
It will be appreciated that the above described embodiments are described as examples only, and that modifications to these embodiments are included within the scope of the appended claims.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP2012/003687 | 9/4/2012 | WO | 00 | 5/13/2015 |