This application claims the benefit of priority to Korean Patent Application No. 10-2007-0058760, filed Jun. 15, 2007, the contents of which are hereby incorporated by reference in its entirety.
The present disclosure relates generally to biometric technologies and, more particularly, to systems and methods for fingerprint matching.
The fingerprint is one of the most widely used physical characteristics in biometric identification and verification. Recently, fingerprint identification has become increasingly popular as a biometric technology, since it has a good balance of desirable properties in terms of performance, reliability, etc. Thus, in recent years, there has been a great deal of research and development in the field of automatic fingerprint identification systems (AFIS), systems that automatically match one or many unknown fingerprints against a database of known fingerprints. One stage of AFIS is the fingerprint matching stage, where input fingerprint data is matched with one or more template fingerprints.
Among fingerprint matching algorithms, the minutia-based approach is one of the most widely used and reliable methods. Minutiae are small details of a fingerprint, including endings and bifurcations of fingerprint ridges.
Referring to
To solve the above problems, various methods have been suggested, and recently, Kwon et al. proposed a fingerprint matching scheme using minutiae clustering and warping (“Fingerprint Matching Method Using Minutiae Clustering and Warping,” Proc. Int'l Conf. Pattern Recognition, volume 4, pages 525-528, 2006). The Kwon et al. method employs local neighborhood structures and the Thin-Plate Spline (TPS) model for the fingerprint matching.
However, as the TPS model basically is a surface interpolation scheme using the basis function having infinite responses, outliers or wrong correspondences between the minutiae would distort the fingerprint surface erroneously, resulting in global influences. This is the fundamental and common problem when the TPS model is used for fingerprint matching.
The present disclosure describes systems and methods for fingerprint matching. In one embodiment, a system may include a first minutiae obtaining unit and a second minutiae obtaining unit to obtain minutiae information of first and second fingerprints. On the minutiae of the first fingerprint, a deformable mesh can be constructed by a mesh construction unit, and a mesh transformation unit may be used to transform a state of the deformable mesh, thereby obtaining a distortion-compensated first fingerprint. Based on the distortion-compensated first fingerprint, a matching determination unit determines whether the first fingerprint matches the second fingerprint or not.
In another embodiment, a system may include an input minutiae obtaining unit to obtain input minutiae information of an input fingerprint, and a mesh construction unit to construct a deformable mesh on the input minutiae. The system may further include a mesh transformation unit to transform a state of the deformable mesh, thereby compensating for surface distortion of the input fingerprint.
In still another embodiment, a fingerprint matching method may obtain minutiae of a first fingerprint and minutiae of a second fingerprint. The method may also find correspondences between the minutiae of the first fingerprint and the minutiae of the second fingerprint, and construct a deformable mesh on the minutiae of the first fingerprint. The method may then transform the deformable mesh to obtain a distortion-compensated first fingerprint based on the correspondences, and based on the distortion-compensated first fingerprint, determine whether the first fingerprint matches the second fingerprint or not.
These drawings depict typical embodiments in accordance with the present disclosure and are, therefore, not to be considered limiting of its scope. The present disclosure will be described with additional specificity and detail through use of the accompanying drawings in which:
It will be readily understood that the components of the present disclosure, as generally described and illustrated in the Figures herein, could be arranged and designed in a wide variety of different configurations. Thus, the following more detailed description of the embodiments of systems and methods in accordance with the present disclosure, as represented in the Figures, is not intended to limit the scope of the present claims, but is merely representative of certain examples of presently contemplated embodiments in accordance with the present disclosure. The presently described embodiments can understood by reference to the drawings, wherein like parts are designated by like numerals throughout.
Referring to
The fingerprint matching system 206 generally receives a fingerprint from the fingerprint input unit 202, which will be referred to herein as an input fingerprint, and receives information of a previously recorded fingerprint from the fingerprint database 204, which will be referred to herein as a template fingerprint. In certain embodiments, upon receiving the input fingerprint and the template fingerprint, the fingerprint matching system 206 determines whether the input fingerprint matches the template fingerprint or not. For this purpose, the fingerprint matching system 206 may use the mesh-based warping unit 208. Further, although not illustrated, in other embodiments the fingerprint matching system 206 may be coupled with or incorporated into one or more other systems. These other systems can use the matching result from the fingerprint matching system 206 for a variety of purposes. For example, the fingerprint matching system 206 may be coupled with a computer, a lock or any other electronic devices, which operates when it is determined that the input fingerprint matches the template fingerprint.
Referring to
The second minutiae obtaining unit 304 obtains minutiae information of a second fingerprint, which generally is the template fingerprint. For example, if the fingerprint database 204 provides minutiae information to the second minutiae obtaining unit 304, the second minutiae obtaining unit 304 can provide the received minutiae information without any modification to the correspondence determination unit 306. The minutiae information obtained by the second minutiae obtaining unit 304 will be referred to herein as second minutiae information.
The correspondence determination unit 306 generally receives the first minutiae information and the second minutiae information, and determines correspondences between the first minutiae and the second minutiae. The correspondence determination unit 306 may use any method including existing methods (e.g., such as a method using adjustable bounding box disclosed by Jain et al. (“On-line fingerprint verification”, IEEE Trans. Pattern Anal. Machine Intell., 19(4):302-314, 1997) and a method using local neighborhood structures disclosed by Kwon et al. (“Fingerprint Matching Method Using Minutiae Clustering and Warping,” Proc. Int'l Conf. Pattern Recognition, volume 4, pages 525-528, 2006)), to obtain the minutiae correspondences. In one embodiment, the correspondence determination unit 306 uses the local neighborhood structures in the aforementioned Kwon et al. method. In this case, the local structures are constructed using neighborhood information of the minutiae. Then, minutiae correspondences are obtained by comparing local structure information of the first minutiae and that of the second minutiae. Then, optionally, outliers can be removed by a geometric verification operation using the rigid transformation, and matched minutiae clusters can be obtained by transforming the input fingerprint from aligned location iteratively. Note that some outliers are allowable in certain embodiments of the present disclosure, and therefore in the embodiments, even correspondences without the geometric verification can be provided as the resulting minutiae correspondences.
The resulting minutiae correspondences generally include a set of minutiae pairs, each of which contains corresponding minutiae between the first minutiae and the second minutiae. In some embodiments, a minutiae correspondence can be represented as: c=(c0, c1), where c0 and c1 represent locations of the corresponding minutiae in the first and second fingerprint, respectively. The output of the correspondence determination unit 208 may further include additional information. For example, in one embodiment the correspondence determination unit 208 may further determine a weight of each correspondence. The weight may vary from 0 to 1, a larger weight representing a higher reliability of the correspondence.
The mesh-based warping unit 308 generally receives the minutiae correspondences including the first and second minutiae, and performs a fingerprint surface warping operation based on the received information. By performing the surface warping, the mesh-based warping unit 308 can recover a distortion-compensated first fingerprint from the possibly distorted first fingerprint. Embodiments of the mesh-based warping unit 308 will be described later in more detail.
Based on the distortion-compensated first fingerprint, the matching determination unit 310 determines whether the first fingerprint matches the second fingerprint or not. For this purpose, the matching determination unit 310 may use any suitable matching method, including well known methods such as a global matching and scoring scheme. In one embodiment, the matching determination unit 310 may be configured to employ the global matching and scoring scheme as used in the Kwon et al. method.
Referring now to
Referring to
Now, one embodiment of the mesh transformation unit 404 will be described in more detail. In the embodiment, the mesh transformation unit 404 generally receives the minutiae correspondences, which include the first and second minutiae information, and the deformable mesh constructed on the first minutiae information. Then, as mentioned above, the mesh transformation unit 404 transforms the deformable mesh constructed on the first minutiae so that the first fingerprint surface represented by the deformable mesh approximates the second fingerprint surface, which corresponds to a fingerprint surface when the second minutiae were extracted.
The warping of the minutiae will be described in more detail with reference to
For the purpose of transformation used in this embodiment, the mesh transformation unit 404 may use an energy function. In other words, the mesh transformation unit 404 may use the energy function to determine a new state of the mesh. In one embodiment, the energy function is defined so that the energy becomes larger as the mesh deforms more, while the energy becomes smaller as the corresponding minutiae become closer. For example, for a given state S and correspondences C, the energy E can be defined as E(S, C, r)=λDED(S)+EC(S,C,r), where ED is a deformation energy, EC is a correspondence energy, λD is a control parameter of the regularity of the mesh, and r is a confidence radius. In this case, ED is a positive value, which increases as the mesh deforms more, and EC is a negative value, whose absolute value increases as the corresponding minutiae become closer. Then, minimization of the energy will transform the mesh so that the corresponding minutiae become closer, unless the deformation of the mesh caused by the transformation overweighs the approach between the minutiae. Thus, minimization of the energy can be regarded as transforming the first fingerprint to approximate the second fingerprint.
In another embodiment, the deformation energy ED can be defined as the approximation of the sum of the squares of second derivatives of the x and y coordinates of the mesh vertices. That is, if L represents an index set of successive collinear three vertices, the deformation energy ED can be defined as:
It can also be defined as:
where X and Y are row ordered matrices of x and y coordinates of mesh vertices, respectively. ED penalizes irregular spacing of vertices. K can be constructed from K′TK′ where K′ is a matrix containing one row per triplet in L and one column per mesh vertex. In detail, the rth row of K′ corresponding to triplet (i,j,k) can be defined as:
K′ri=−1, K′rj=2, K′rk=−1, K′rc=0 for c≠i,j,k. Note that the state S implies X and Y.
Further, the correspondence energy EC can be defined as:
In the equation, d=∥c1−TS(c0)∥, c1 is a minutiae in the second fingerprint corresponding to the minutiae c0 in the first fingerprint. That is, d denotes the distance between the warped location of the minutia c0 and the location of the minutia c1. Further, ωc is the weight of correspondence. If the weight of correspondence has not been determined, ωc can be set as a constant such as 1. ρ is a robust estimator. In one embodiment, the robust estimator ρ can be defined as follows:
The robust estimator has the following characteristics: if the confidence radius r is large, the weights of most correspondences will be summed in the energy; if the confidence radius r is small, the weights of only selected correspondences will be used. In light of the present disclosure those of ordinary skill in the art will appreciate that the characteristics of the robust estimator may be helpful in excluding outliers from the surface warping as the confidence radius r becomes smaller.
The mesh transformation unit 404 minimizes the energy E for a fixed confidence radius r, which can also be referred to as optimization. Pseudo code representation of one embodiment of the optimization is shown in
In the optimization shown in
where the derivative of the corresponding energy EC can be calculated using the equation:
where Ci is a set of correspondences and c0 is contained in the triangle which have vi as a vertex. Further, for the second derivative of x coordinate, the following equations can be used.
In the equations of the first and second derivatives, the summation is taken on the condition of d<r and (i,j,k)=V(c0) where V(c0) is a vertex index set of the triangle which contains c0. The derivatives of the y coordinate can be similarly calculated. The preconditioner matrix M uses the following equation:
M=∂2E/∂X2=∂2E/∂Y2. In one embodiment, M−1 (lines 4, 20) can be calculated using an LU decomposition for efficiency. Further, in one embodiment, the variable ε (lines 8, 16) can be set to, for example, 10−6, and the loop terminating variables imax (line 8) and jmax (line 16) can be fixed to small numbers.
Moreover, in some embodiments, the mesh transformation unit 404 may iterate the optimization. One embodiment of the iteration is represented as pseudo code in
Referring now to
One embodiment of the warping operation will be described in more detail with reference to
Although the embodiments provided herein assume that the first fingerprint is the input fingerprint and the second fingerprint is the template fingerprint, the present disclosure is not limited thereto, but other variations are also applicable. Furthermore, although the warping unit and the warping step described herein use an energy function for the warping operation, the warping unit and the warping step may perform the warping in various other ways. Moreover, although the energy function is optimized based on the analytically calculated first and second partial derivatives in the aforementioned embodiments, in light of the present disclosure it will be appreciated by one of ordinary skill in the art that other methods or variables can also be employed additionally or alternatively.
In light of this disclosure, it should also be appreciated by one of ordinary skill in the art that the systems and methods described herein may be implemented in hardware, software, firmware, middleware, or combinations thereof and utilized in systems, subsystems, components, or sub-components thereof. For example, a method implemented in software may include computer code to perform the steps of the method. This computer code may be stored in a machine-readable medium, such as a processor readable medium or a computer program product, or transmitted as a computer data signal embodied in a carrier wave, or a signal modulated by a carrier, over a transmission medium or communication link. The machine-readable medium or processor-readable medium may include any medium capable of storing or transferring information in a form readable and executable by a machine (e.g., a processor, a computer, mobile device, media player, etc.).
The disclosed systems and methods may be embodied in other specific forms without departing from their basic features or characteristics. Thus, the described embodiments are to be considered in all respects only as illustrative, and not restrictive. The scope of the present disclosure is, therefore, indicated by the appended claims, rather than by the foregoing description. All changes within the meaning and range of equivalency of the claims are to be embraced within their scope.
Number | Date | Country | Kind |
---|---|---|---|
10-2007-0058760 | Jun 2007 | KR | national |
Number | Name | Date | Kind |
---|---|---|---|
4310827 | Asai | Jan 1982 | A |
5953442 | Dydyk et al. | Sep 1999 | A |
6330347 | Vajna | Dec 2001 | B1 |
6961452 | Fujii | Nov 2005 | B2 |
Number | Date | Country |
---|---|---|
2002-298141 | Oct 2002 | JP |
2005-293399 | Oct 2005 | JP |
Entry |
---|
Yuan, Z. et al., “Approach of Fingerprint Matching Using Cupidity Algorithm Triangulation,” Computer Engineering and Applications, 2007 vol. 43, No. 10, 10 pages. |
Kwon et al. “Fingerprint Matching Method Using Minutiae Clustering and Warping,” 2006, Proc. Int'l Conf. Pattern Recognition, vol. 4, pp. 525-528. |
D. Kwon, I. Yun, D. Kim, S. Lee, “Fingerprint Matching Method Using Minutiae Clustering and Warping”, 2006 IEEE. |
Office Action for Chinese Application No. 200810111412.7 dated Mar. 16, 2010 (with English translation). |
Yuan, Z. et al., “Approach of fingerprint matching using cupidity algorithm triangulation,” Computer Engineering and Applications, vol. 43, No. 10, 2007, 10 pages (with English translation). |
“Thin-plate Spline,” http://en.wikipedia.org/wiki/Thin—plate—spline; Modified on Dec. 11, 2011, 4 pages. |
Maio, D. et al.“FVC2000: Fingerprint Verification Competition,” IEEE Transactions on Pattern Analysis Machine Intelligence, 2002, pp. 402-412, vol. 24, No. 3. |
Pilet, J. et al., “Fast Non-Rigid Surface Detection, Registration and Realistic Augmentation,” International Journal of Computer Vision, 2007, vol. 76, Issue 2, pp. 109-122. |
Watson, C.I. et al., “User's Guide to NIST Fingerprint Image Software 2 (NFIS2),” National Institute of Standards and Technology, 2004, 211 pages. |
Number | Date | Country | |
---|---|---|---|
20080310691 A1 | Dec 2008 | US |