The present invention relates to a fingerprint sensing arrangement for sensing a fingerprint pattern of a user's finger, to an electronic device comprising such fingerprint sensing arrangement, and to a method for providing a fingerprint pattern signal representative of a fingerprint pattern of a user's finger.
Various types of biometric systems are used more and more in order to provide for increased security and/or enhanced user convenience. In particular, fingerprint sensing systems have been adopted in, for example, consumer electronic devices, thanks to their small form factor, high performance and user acceptance.
Fingerprint sensors are generally comprised of a pixel matrix which is configured to sense the fingerprint pattern of a finger. Signals from each of the pixel elements are collected and subsequently processed to form a fingerprint image. Ideally, the final fingerprint image is a low noise high resolution fingerprint image which can be used for fingerprint recognition applications and that can be acquired relatively fast.
However, forming a high quality fingerprint image is associated with a number of challenges. For example, the absolute signal level from each pixel element depends on several more or less uncontrollable factors such as the pressure of the finger on the pixel matrix and the level of humidity of the finger. A relatively successful way to sample an appropriate signal level is to adjust the signal offset and signal gain. A further challenge is to handle common mode noise which may affect the absolute noise level.
U.S. Pat. No. 7,965,877 discloses a fingerprint sensor which appears to provide for a reduced influence of noise and is configured to generate binary images. The binary images are formed by inputting the signal from a sensing capacitor of the fingerprint sensor and a voltage reference from a voltage source to a voltage comparator. The signal from the sensing capacitor is measured after having been charged, whereby the discharge time depends on the capacitive coupling to the finger (e.g. ridge or valley coupling). The output from the voltage comparator is high (e.g. “1”) as long as the capacitive discharge from the sensing capacitor provides a voltage larger than the voltage reference. The output from the voltage comparator is used as input in a pulse comparator where it is compared to a pulse reference. If the width of the output pulse from the voltage comparator is longer than that of the pulse reference it can be concluded that the sensed capacitance relates to a ridge capacitance.
Although the solution proposed by U.S. Pat. No. 7,965,877 seems to provide for acquiring fingerprint images with reduced influence to the absolute signal levels, there still appears to be room for improvement.
In view of above-mentioned and other drawbacks of the prior art, it is an object of the present invention to provide for sensing of a fingerprint pattern with reduced impact of the common mode noise in the sensing signals.
According to a first aspect of the present invention, there is provided a fingerprint sensing arrangement for sensing a fingerprint pattern of a user's finger for providing a fingerprint pattern signal, the fingerprint sensing arrangement comprising: an array of sensing elements for sensing the fingerprint pattern, each sensing element comprising: a sensing structure for capacitive coupling with the finger, each sensing structure being covered by a dielectric structure, and sensing circuitry for providing sensing signals indicative of the capacitive coupling between the sensing structure and the finger in response to a change in potential difference between a sensing structure potential of the sensing structure and a finger potential of the finger, wherein the fingerprint sensing arrangement is configured to provide a combined sensing signal based on a combination of at least two sensing signals according to an arithmetic operation, wherein the fingerprint sensing arrangement further comprises: a plurality of comparing circuits, wherein each comparing circuit is configured to compare a respective combined sensing signal to a threshold value, and output a binary value based on the comparison with the threshold value, wherein the fingerprint pattern signal comprises at least one set of binary values output from the plurality of comparing circuits.
The present invention is based upon the realization to compare sensing signals from individual sensing elements and output a binary value based on that comparison instead of relying directly on the absolute level of the sensing signal. The comparing of the sensing signals may be performed in an analogue domain. Accordingly, analog sensing signals are compared for providing a digital binary output.
Advantages with the invention includes that the absolute common-mode signal level of the sensing signals becomes less relevant (or even irrelevant).
The arithmetic operation may for example be to calculate a differential between the sensing signals, and in such case the differential signal may for example be centered on about zero. Determining a binary value based on the combined (analog) sensing signals, (e.g. the differential between the sensing signals), the common challenge in conventional sensing circuits to determine an appropriate signal offset before sampling is highly alleviated or even eliminated.
The sensing elements may, for example, be capacitive sensing elements, each providing a measure indicative of the capacitive coupling between that particular sensing element and a finger surface touching the sensor surface. Sensing elements at locations corresponding to ridges in the fingerprint will exhibit a stronger capacitive coupling to the finger than sensing elements at locations corresponding to valleys in the fingerprint.
Moreover, each sensing structure may advantageously be provided in the form of a metal plate, so that the equivalence of a parallel plate capacitor is formed by the sensing structure (the sensing plate), the local finger surface, and the protective dielectric top layer (and any air that may locally exist between the local finger surface and the protective layer, depending on location of ridges and valleys in the fingerprint pattern). A change of the charge carried by the sensing structure resulting from the change in potential difference between the finger and the sensing structure is an indication of the capacitance of such a parallel plate capacitor, which is in turn an indication of the distance between the sensing structure and the finger surface. Thereby, an image of the fingerprint pattern can be acquired by means of determining the capacitive coupling between each sensing structure and the finger.
The protective top dielectric structure, which also may be referred to as a coating, may advantageously be at least 20 μm thick and have a high dielectric strength to protect the underlying structures of the fingerprint sensing device from wear and tear as well as from electrostatic discharge (ESD). Even more advantageously, the protective top layer may be approximately 100 μm thick, or in the range of 500-700 μm thick, or even thicker.
The signals may be analog values indicative of a voltage, which may in turn be proportional to the capacitance of the capacitor constituted by the finger (or other conductive object in the vicinity of the finger detecting structure), the finger detecting structure and the dielectric material there between.
The sensed fingerprint pattern may be used for various purposes, such as biometric enrollment or authentication, or fingerprint pattern based navigation etc.
According to an embodiment, each sensing element in the array of sensing elements may comprise a comparing circuit. This advantageously enables a large number of combinations of sensing elements which sensing signals can be compared for outputting binary values. Furthermore, by incorporating a comparing circuit in the sensing element provides a compact solution for sensing a fingerprint pattern with reduced common mode noise.
According to embodiments, the fingerprint sensing arrangement may be configured to combine the sensing signal from one sensing element with the sensing signal from one other sensing element. Accordingly, in one advantageous possible implementation the combined sensing signal is a combination of only two sensing signals. By including the sensing signals from only two sensing elements in each combined sensing signal is advantageous from for example a signal routing perspective.
In another embodiment, the fingerprint sensing arrangement may be configured to apply gains to the sensing signals prior to combining the sensing signals to form the combined sensing signal, compare the combined sensing signal with the threshold value, and output a binary value based on the comparison with the threshold value. Applying gains to the sensing signals allows for giving the sensing signals from different sensing elements a different weight which provides for combining sensing signals from various combinations of sensing elements.
In one possible implementation the gains add up to zero. Thus, if the gain values are accumulated the accumulated value is zero.
According to possible implementations, a first gain may be applied to the sensing signals from a first set of sensing elements, and a second gain is applied to the sensing signal from at least one other sensing element not comprised in the first set of sensing elements, wherein the first gain is different from the second gain. Combining the sensing signals from the first set of sensing elements with the sensing signals from the at least one other sensing element advantageously enables to collect accumulated sensing signals in a single shot. Accordingly, the fingerprint pattern signal from a single shot measurement may in this way comprise spatial information of the fingerprint pattern in more than one direction across the array of sensing elements.
According to one embodiment, a first combined sensing signal may be compared to a first threshold value, and a second combined sensing signal may be compared to a second threshold value different from the first threshold value, wherein the comparing circuits are configured to output a first set of binary values based on the comparison with the first threshold value, and a second set of binary values based on the comparison with the second threshold value, wherein the fingerprint pattern signal comprises at least the first set of binary values and the second set of binary values.
The threshold values may be based on the position of at least one of the sensing elements from which one of the sensing signals is received, the position being the position in the array of sensing elements. Thus, the threshold may be different depending on the spatial location of the present sensing element (e.g. one of the sensing elements from which a sensing signal in the combined sensing signal originates) in the array of sensing element thereby providing a spatially varying threshold. This advantageously provides for adapting the threshold depending on the sensing signal quality which may vary across an image, for example it may be possible to reduce non-uniformity in the resulting fingerprint image which may be reconstructed from the fingerprint pattern signal.
According to one possible implementation a fingerprint sensing arrangement may be configured to: combine the sensing signals from sensing elements spatially separated from each other in a first spatial direction to produce a first combined sensing signal which is compared to a first threshold value, and output a first set of binary values based on the comparison with the first threshold value; combine the sensing signals from sensing elements spatially separated from each other in a second spatial direction to produce a second combined sensing signal which is compared to a second threshold value, and output a second set of binary values based on the comparison with the second threshold value; wherein the fingerprint pattern signal comprises at least the first set of binary values and the second set of binary values. In order to provide information in the fingerprint pattern signal that spans the two dimensions of the array of sensing elements, it is in some implementations advantageous to sample in two different directions separately and subsequently combine the sets of binary values. For example, this is advantageous in the case of combining sensing signals from two neighboring sensing elements in one direction at the time.
Accordingly, two sets of binary values may be provided, each representative of the comparison in a respective spatial direction. This also means that two differential samples are obtained per sensing element and thereby sufficient binary data is available for reconstructing a fingerprint image.
The first set of binary values may be a binary image representation in the first spatial direction, and the second set of binary values may be a binary image representation in the second spatial direction, wherein the fingerprint pattern signal may be a combined binary image representation based on the first set of binary values and the second set of binary values.
Furthermore, the first spatial direction may be orthogonal to the second spatial direction in a sensing plane of the array of sensing elements.
In addition, the first threshold may be different from the second threshold.
The threshold values may be zero. In some embodiments at least one of the threshold values is non-zero.
Using a non-zero threshold provides the advantage of compensating for imperfections in analog circuitry comprised in the fingerprint sensing arrangement. Such imperfections may cause imbalance between sensing elements. For example, applied gains to the sensing signals may not be perfectly accurate and this inaccuracy may result in an offset in the combined sensing signal. This offset may be compensated for by choosing an appropriate non-zero threshold.
Further, the threshold values may be variable which provides for tuning the threshold. For example, a fingerprint pattern signal may be provided and a fingerprint image may be reconstructed from the fingerprint pattern signal. Based on the quality of the reconstructed fingerprint image, the threshold(s) may be tuned and another fingerprint pattern signal may be determined based on further sensing signals. By collecting several sets of fingerprint pattern signals with different thresholds, a fine tuned reconstructed fingerprint image may be provided by selecting the highest quality fingerprint image.
According to embodiments, each sensing element comprises a one bit data storage unit for temporally storing the binary values associated with the respective sensing element. In this way, a fast one-shot capture from the entire array of sensing elements may be achieved.
Each comparing circuit may be configured to receive the sensing signal from at least two neighboring sensing elements. From a signal routing point of view, it may be advantageous for the comparing circuit to receive sensing signals from neighboring sensing elements.
The neighboring sensing elements may be orthogonally neighboring or diagonally neighboring, i.e. in a typical matrix of sensing elements (commonly denoted “pixel”) each sensing element (except at the edge of the matrix) is surrounded by eight neighboring sensing elements, four orthogonally neighboring and four diagonally neighboring.
The sensing circuitry may be a charge amplifier connected to at least one of the sensing structures for providing the sensing signal indicative of a change in charge carried by the at least one sensing structure, wherein each of the charge amplifiers comprises: a first input connected to the at least one sensing structure; a second input configured to receive a sensing reference potential (GND, or drive); an output providing the sensing signal; a feedback capacitor connected between the first input and the output; and at least one amplifier stage between the first and second inputs, and the output, wherein at least one of the comparing circuits is connected to the output to receive the sensing signal.
The comparing circuits may each be provided as a comparator which may take the differential between the sensing signals input to the comparator and output a binary value (i.e. 1 or 0) based on whether the differential is above zero or below zero.
The fingerprint arrangement may be comprised in an electronic device, comprising processing circuitry configured to receive the fingerprint pattern signal and reconstruct a fingerprint image based on the fingerprint pattern signal.
The fingerprint sensing arrangement may be part of a capacitive fingerprint sensor. The electronic device may be a mobile device such as a mobile phone, but may also be e.g. a desktop computer, tablet, smart card etc.
According to a second aspect of the present invention there is provided a method for providing a fingerprint pattern signal representative of a fingerprint pattern of a user's finger, the fingerprint pattern being sensed by a fingerprint sensing arrangement comprising: an array of sensing elements for sensing the fingerprint pattern, each sensing element comprising: a sensing structure for capacitive coupling with the finger, each sensing structure being covered by a dielectric structure, and sensing circuitry for providing sensing signals indicative of the capacitive coupling between the sensing structure and the finger in response to a change in potential difference between a sensing structure potential of the sensing structure and a finger potential of the finger, wherein the method comprises: determining a combined sensing signal based on at least two sensing signals according to an arithmetic operation, comparing the combined sensing signal to a threshold value;
outputting a binary value based on the comparison with the threshold value, and providing the fingerprint pattern signal comprising at least one set of binary values.
Combining sensing signals may comprise to calculate a differential between the sensing signals.
Further embodiments of, and effects obtained through this second aspect of the present invention are largely analogous to those described above for the first aspect of the invention.
In summary, the present invention relates to a fingerprint sensing arrangement and to a method for providing a fingerprint pattern signal. For providing the fingerprint pattern signal a sensing signals from the sensing circuits of at least two sensing elements are combined according to an arithmetic operation to form a combined sensing signal. The combined sensing signal is compared to a threshold value. Based on the comparison a binary value is output. The fingerprint pattern signal comprises at least one set of binary values.
Further features of, and advantages with, the present invention will become apparent when studying the appended claims and the following description. The skilled addressee realize that different features of the present invention may be combined to create embodiments other than those described in the following, without departing from the scope of the present invention.
These and other aspects of the present invention will now be described in more detail, with reference to the appended drawings showing an example embodiment of the invention, wherein:
In the present detailed description, various embodiments of the fingerprint sensing system and method according to the present invention are mainly described with reference to a mobile device in the form a mobile phone having an integrated fingerprint sensing device. However, it should be noted that many other kinds of electronic devices may have such a fingerprint sensing device integrated, such as tablets, desktop computers, laptops, smart cards, etc.
Turning now to the drawings and in particular to
Preferably and as is apparent for the skilled person, the mobile device 100 shown in
It should furthermore be noted that the invention may be applicable in relation to any other type of electronic devices, such as a laptop, a remote control, a tablet computer, smart card comprising a fingerprint sensor, or any other type of present or future similarly configured device, including any type of IoT (Internet of Things) devices where there is a desire to allow for user specific settings and/or identification/authentication of a user to be implemented.
With reference to
Based on comparing the combined sensing signals to threshold value(s), binary values are determined and form a set of binary values. The set of binary values is thus a binary representation of the fingerprint pattern sensed by the sensing elements. The fingerprint pattern signal comprises the set of binary values.
The determining of the set of binary values including the combining of sensing signals may be performed in hardware and does advantageously not require a full analog-to-digital converter. A fingerprint image that can be used for biometric authentication may be reconstructed from the set of binary values.
The threshold value may for example be zero, but in some possible implementations the threshold is non-zero. A non-zero threshold value may be advantageously implemented in order to take into account for imperfections in analog circuitry in the fingerprint sensing arrangement which may cause offsets in the sensing signals.
The sensing elements from which the sensing signals are received and combined to form the combined sensing circuit may be selected according to various patterns, some of which now will be described with reference to
When forming a fingerprint pattern signal comprising at least one set of binary values, the sensing elements may each provide a one bit binary value depending on the outcome of the comparison of a combined sensing signal with a threshold. Once the configuration of the combination of sensing signals is selected, each sensing element provides one binary value. For example, if the configuration of sensing elements is selected to be neighboring along the first spatial direction (y) (such as 402 and 403), then the sensing signal from each sensing element is combined with the sensing signal form its nearest neighbor in the first spatial direction (y). The combined sensing signals are each compared to a threshold and each comparison provides a binary value output. The combination of sensing signals is switchable, in other words, the sensing elements from which sensing signals are combined may be varied between sensing operations.
For reconstructing a fingerprint image from the set of binary values spatial information covering the both the x and y direction is preferably included. This means that the fingerprint pattern signal may comprise a set of binary values that include both the x and y direction based on having combined sensing signals from sensing elements that are spatially separated from each other in more than one direction, for example by combining sensing signals from three or more sensing elements (see example in
Alternatively, a first set of binary values is determined from combination of sensing signals from sensing elements spatially separated in the x direction (such as represented by 404 and 405) and a second set of binary values is determined from combination of sensing signals from sensing elements spatially separated in the y direction (such as represented by 402 and 403). The first set of binary values and the second set of binary values are combined and serve as a basis for reconstructing a fingerprint image. In this case, the binary values from comparisons in the x direction and comparisons in the y direction are determined for all sensing elements in the array 400.
In some embodiments, more than one binary value is output from each sensing element in the array 400. For example, a first set of binary values are determined based on comparing combined sensing signals from each sensing elements (e.g. sensing element 408) with a respective sensing element (e.g. sensing element 409) in the first spatial direction (y) to a threshold value. A second set of binary values are determined based on comparing combined sensing signals from each sensing element (e.g. sensing element 408) and a respective sensing element (e.g. sensing element 410) in the second spatial direction (x) to the threshold value. Effectively, this provides a 90 degree spatial pattern with two binary values provided from each sensing element. The fingerprint sensing signal is in this case comprised of the first set of binary values and the second set of binary values.
Further, the sensing elements from which the sensing signals are provided and that are used to form the combined sensing signal may not necessarily be neighboring sensing elements. For example, the sensing elements 406 and 407 spatially separated in both the x and y directions represent a possible pattern configuration of the sensing elements from which the combined sensing signal may be formed.
According to some possible embodiments in accordance with the inventive concept, a gain may be applied to the sensing signals prior to combining the sensing signals to form the combined sensing signal. In
As is schematically indicated in
The charge amplifier 38 comprises at least one amplifier stage, here schematically illustrated as an operational amplifier (op amp) 41 having a first input (negative input) 42 connected to the sensing structure 36, a second input (positive input) 43 connected to sensor ground or another reference potential, and an output 44. In addition, the charge amplifier 38 comprises a feedback capacitor 45 connected between the first input 42 and the output 44, and reset circuitry, here functionally illustrated as a switch 46, for allowing controllable discharge of the feedback capacitor 45. The charge amplifier 38 may be reset by operating the reset circuitry 46 to discharge the feedback capacitor 45.
As is often the case for an op amp 41 in a negative feedback configuration, the voltage at the first input 42 follows the voltage at the second input 43. Depending on the particular amplifier configuration, the potential at the first input 42 may be substantially the same as the potential at the second input 43, or there may be a substantially fixed offset between the potential at the first input 42 and the potential at the second input 43. In the configuration of
When a time-varying potential is provided to the finger 35 by the excitation signal providing circuitry 19, a corresponding time-varying potential difference occurs between the sensing structure 36 and the finger 35.
The above-described change in potential difference between the finger 35 and the sensing structure 36 results in a sensing voltage signal V, on the output 44 of the charge amplifier 38.
When the indicated sensing elements 8 are selected for sensing, the respective selection switch 40 is closed to provide the sensing signals to a comparing circuit 314. The comparing circuit 314 combines the sensing signals from the selected sensing elements 8 and compares the combined sensing signal to a threshold value. Based on the comparison the comparing circuit 314 outputs a binary value to form a binary representation of the fingerprint pattern of the finger 35 on the sensor 2.
In
The comparing circuit 314 may be provided in the form of a voltage comparator configure to compare received voltages (sensing signals) with a threshold value, and output a binary value based on the comparison.
By selecting the capacitance of the coupling capacitor 50, 51 with respect to the capacitance of the feedback capacitor 45a, 45b of the corresponding sensing element 8b, 8c, the corresponding gain of the respective sensing signal may be applied. For example, the gain of the sensing signal from the sensing element 8b is determined from the ratio between the capacitance of the feedback capacitor 45a and the coupling capacitor 50.
In the example embodiment illustrated in
Accordingly, the threshold may be different depending on the spatial location of the present sensing element in the array of sensing element thereby providing a spatially varying threshold. In this way it may be possible to reduce non-uniformity in the resulting fingerprint image reconstructed from the fingerprint pattern signal. For example, due to non-uniform pressure applied by a user's finger on the sensor surface which comprises the array 700 of sensing signals, the capacitive coupling between the finger and the sensing structures may vary across the array 700. This variation may cause non-uniformity in the resulting fingerprint image. Using a spatially varying threshold that depends on the position of the sensing element in the array may compensate for the non-uniform coupling to the array 700, varying electronics offset in amplifiers in the array, varying sensing distance from sensing structure to the surface of the sensor, or other effects that may cause non-uniformity across the array 700 of sensing elements 701.
A control unit may include a microprocessor, microcontroller, programmable digital signal processor or another programmable device. The control unit may also, or instead, include an application specific integrated circuit, a programmable gate array or programmable array logic, a programmable logic device, or a digital signal processor. Where the control unit includes a programmable device such as the microprocessor, microcontroller or programmable digital signal processor mentioned above, the processor may further include computer executable code that controls operation of the programmable device. It should be understood that all or some parts of the functionality provided by means of the control unit (or generally discussed as “processing circuitry”) may be at least partly integrated with the fingerprint sensing arrangement.
Although the figures may show a sequence the order of the steps may differ from what is depicted. Also two or more steps may be performed concurrently or with partial concurrence. Such variation will depend on the software and hardware systems chosen and on designer choice. All such variations are within the scope of the disclosure. Likewise, software implementations could be accomplished with standard programming techniques with rule based logic and other logic to accomplish the various connection steps, processing steps, comparison steps and decision steps. Additionally, even though the invention has been described with reference to specific exemplifying embodiments thereof, many different alterations, modifications and the like will become apparent for those skilled in the art.
In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.
Number | Date | Country | Kind |
---|---|---|---|
1751526-3 | Dec 2017 | SE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/SE2018/051243 | 12/4/2018 | WO | 00 |