This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2006-068902, filed on Mar. 14, 2006, the entire contents of which are incorporated herein by reference.
1. Field of the Invention
This invention relates to a biometric authentication method and a biometric authentication apparatus, which utilize biometrics characteristics which are a portion of a human body, to authorize individuals, and in particular relates to a biometric authentication method and a biometric authentication apparatus which are suitable for improving the speed of verification of numerous registered biometrics characteristic information sets against detected biometrics characteristic information.
2. Description of the Related Art
There are numerous portions of the human body which can be used to differentiate the individual, such as fingerprints and toeprints, the retinas of the eyes, facial features, and blood vessels. With advances in biometrics technology in recent years, various devices have been provided which identify biometrics features of a portion of the human body to authenticate individuals.
For example, comparatively large amounts of individual characteristic data are obtained from blood vessels in the fingers and palms of the hands, and from palmprints. Blood vessel (vein) patterns remain unchanged throughout life from infancy and are regarded as being completely unique, and so are well-suited to individual authentication.
In order to utilize this biometrics information to perform individual authentication, at the time of registration or of authentication the user brings his palm into proximity with an image capture device. The image capture device emits near-infrared rays, which are incident on the palm of the hand. The image capture device uses a sensor to capture near-infrared rays reflected from the palm of the hand. Hemoglobin in the red corpuscles flowing in the veins has lost oxygen. This hemoglobin (reduced hemoglobin) absorbs near-infrared rays at wavelengths near 760 nanometers. Consequently when near-infrared rays are made incident on the palm of a hand, reflection is reduced only in the areas in which there are veins, and the intensity of the reflected near-infrared rays can be used to identify the positions of veins (blood vessel images).
The user first uses an image capture device to register vein image data of the palm of his own hand in a server or on a card. Then, in order to perform individual authentication, the user employs an image capture device to cause the vein image data of his own hand to be read. The registered vein image is verified against the vein pattern of the vein image for verification thus read, and individual authentication is performed (see for example Japanese Patent Laid-open No. 2004-062826 (FIG. 2 through FIG. 9)).
In such a biometric authentication system for example in the field of fingerprint authentication, a method has been disclosed in which characteristic data A at a comparatively low level (at which outside leakage is tolerated), and characteristic data B at a comparatively high level which is to be kept confidential, are stored in an IC card. The characteristic data A is transmitted from the IC card to an external device comprising a fingerprint sensor, and the external device performs verification of the characteristic data A (called primary verification), and transmits the verification result and characteristic data B′ extracted from the image from the fingerprint sensor to the IC card; within the IC card, verification with the characteristic data B is performed (called secondary verification) (see for example Japanese Patent Laid-open No. 2000-293643 (FIG. 5 and FIG. 6)).
However, with progress in biometric authentication technology in recent years, a large amount of biometrics characteristic data has been registered. For example, a large number of biometrics characteristic data sets are registered on servers for use by security systems which manage ingress and egress in apartment buildings, office buildings and other facilities.
In such a mode of use, numerous verifications of captured biometrics information against registered biometrics information must be performed, so that time is required for verification. Particularly when precision is required in biometrics verification, the large quantity of biometrics characteristic data and the complexity of the verification algorithms used means that even more time is required for verification. As a result the wait time for users is lengthened, which in turn impedes adoption of the technology.
Methods are conceivable in which users are assigned IDs, the IDs are registered together with biometrics characteristic data, and the user also inputs his ID; however, the assigning of separate IDs to each user is troublesome, and may result in inconvenience to the user. For example, in the case of application to ingress and egress to and from a facility, it is more convenient to a user who enters and leaves the facility to be able to use an ID assigned to the facility to perform biometric authentication. In this case also, verification of captured biometrics information against biometrics information registered for the ID must be executed numerous times, so that time is required for verification.
And, in biometric authentication based on the above-described primary verification and secondary verification, the characteristic data A at the comparatively low level (at which outside leakage is tolerated) is specific to that user, and when applied to this mode of use also, the effect in shortening verification time is minimal.
Hence one object of the invention is to provide a biometric authentication method and biometric authentication apparatus to shorten the time for verification, even when numerous biometrics information sets have been registered.
A further object of the invention is to provide a biometric authentication method and biometric authentication apparatus to shorten the time for verification, and facilitate widespread adoption of biometric authentication using biometrics information for numerous different users.
Still a further object of the invention is to provide a biometric authentication method and biometric authentication apparatus to enable limitation of the range of registered biometrics information based on detected biometrics information, even when numerous biometrics information sets have been registered.
In order to attain these objects, a biometric authentication apparatus of this invention, which detects biometrics characteristic data and performs individual authentication, has a detection device, which detects a living body and obtains biometrics information; a control unit, which extracts, from the biometrics information, comparatively coarse first biometrics characteristic data and comparatively fine second characteristic data on the user; and a biometrics information database file, in which is stored, as biometrics information on the user, the first biometrics characteristic data and second biometrics characteristic data. The control unit extracts comparatively coarse first biometrics characteristic data and comparatively fine second characteristic data for use in verification from the biometrics information obtained by the detection device, calculates the degree of similarity between the first biometrics characteristic data for verification and first biometrics characteristic data sets stored in the biometrics database file, determines the order of verification with the second biometrics characteristic data sets stored in the biometrics database file according to the degrees of similarity, and performs verification of the second biometrics characteristic data for verification with the stored second biometrics characteristic data sets according to this verification order.
Further, a biometric authentication method of this invention, in which biometrics characteristic data is detected and individual authentication is performed, has a step of detecting a living body using a detection device; a step of extracting, from biometrics information of the detected living body, comparatively coarse first biometrics characteristic data and comparatively fine second characteristic data on the user; a step of calculating the degrees of similarity between the first biometrics characteristic data for verification and the first biometrics characteristic data sets stored in a biometrics database file, and for determining the order of verification with the second biometrics characteristic data sets stored in the biometrics database file according to the degrees of similarity; and a step of verifying the second biometrics characteristic data for verification against the stored second biometrics characteristic data sets according to this verification order.
Further, in this invention it is preferable that the control unit calculate scores for the first biometrics characteristic data for verification and first biometrics characteristic data sets stored in the biometrics database file, to obtain the degrees of similarity.
Further, in this invention it is preferable that the control unit extract, as the first biometrics characteristic data, direction components of patterns of the biometrics information.
Further, in this invention it is preferable that the control unit extract, as the first biometrics characteristic data, direction components and periodicity components of patterns of the biometrics information.
Further, in this invention it is preferable that the control unit extract, as the direction components of the patterns, curvature components of the patterns.
Further, in this invention it is preferable that the control unit extract, as the direction components of the patterns, angular components of the patterns.
Further, in this invention it is preferable that the control unit extract, as the periodicity components of the patterns, frequency components of the patterns.
Further, in this invention it is preferable that the control unit extracts a plurality of component segments of said patterns, vectorizes the component segments, and extracts the curvature direction components from said vectorized segments.
Further, in this invention it is preferable that the control unit generates a histogram of curvature directions from curvature components of each segment.
Further, in this invention it is preferable that the control unit calculate the spatial frequency components of the biometrics information, and extract, as the angular components, Fourier angular characteristic amounts from the spatial frequency components.
Further, in this invention it is preferable that the control unit calculate the spatial frequency components of the biometrics information, and extract, as the frequency components, Fourier texture characteristic amounts from the spatial frequency components.
Further, in this invention it is preferable that the control unit calculate a score for the first biometrics characteristic data for verification and first biometrics characteristic data sets stored in the database file, sort the distances between each of the stored data sets, and determine the verification order.
Further, in this invention it is preferable that the detection device comprise a unit which captures images of blood vessels for the user, that the first biometrics characteristic data is comparatively coarse characteristic data of a blood vessel image, and that the second biometrics characteristic data is comparatively fine characteristic data of a blood vessel image.
In this invention, broad characteristic quantities of biometrics data are registered together with characteristic data for verification, and at the time of authentication the degree of similarity of characteristic quantities is used to determine the verification order; the verification order determined in this way is used to perform verification of characteristic data. Hence because the verification order is determined based on biometrics information, verification can be performed using the verification order determined from the biometrics information for the user even when numerous characteristic data sets are registered, so that the speed of verification can be improved.
Below, embodiments of the invention are explained in the order of a biometric authentication system, biometrics information registration processing, biometrics information authentication processing, and other embodiments.
Biometric Authentication System
The operation of this system is explained. A user requesting vein authentication extends his hand over the palm image capture device (hereafter “image capture device”) 1. The image capture device 1 reads the palm image, and through blood vessel image extraction processing in the processing device 3, the vein pattern is extracted, and is registered (stored) as vein data in the biometrics database file 4.
In order to enter the facility, the user holds his hand over the image capture device 1 to perform vein authentication. The image capture device 1 reads the palm of the hand, and the vein pattern of the palm is extracted through blood vessel extraction processing by the processing device 3. The processing device 3 performs verification processing to verify the vein pattern, as vein data, against vein data registered in the biometrics database file 4, to authenticate the user.
As shown in
The front guide 14 guides the hand in front and supports the wrist. Hence the front guide 14 guides the user and supports the hand so as to guide the wrist above the sensor unit 18. As a result, the attitude of the palm of the hand, that is, the position, inclination, and size over the sensor unit 18 can be controlled. The cross-sectional shape of the front guide 14 has a vertical body and, in the top portion, a horizontal portion 14-1 to support the wrist. A depression 14-2 is formed continuously in the center of the horizontal portion 14-1, to facilitate positioning of the wrist. The rear guide 19 serves to support the fingers.
The sensor unit 18 is provided with an infrared sensor (CMOS sensor) and focusing lens 16 and a distance sensor 15 in the center; on the periphery thereof are provided a plurality of near-infrared light emission elements (LEDs) 12. For example, near-infrared light emission elements 12 are provided at eight places on the periphery, to emit near-infrared rays upwards.
The readable region V of this sensor unit 18 is regulated by the relation between the sensor, focusing lens, and near-infrared light emission region. Hence the position and height of the front guide 14 are set such that the supported palm is positioned in the readable region V.
When the hand 52 is extended with palm flat, the palm has maximum area, and moreover is flat, so that when the palm is subjected to image capture in the image capture region V of the sensor unit 18, an accurate vein pattern which can be used in registration and verification is obtained. When the distance from the sensor unit 18 to the palm is within a prescribed range, a sharp, focused image is obtained by the sensor 16 of the sensor unit 18.
Hence as shown in
The processing device 3 connected to the image capture device 1 executes the series of registration and verification processing 34-1 through 34-6, as shown in
Guidance message output processing 34-5 outputs to a display, not shown, a message to guide the palm to the left or right, forward or backward, upward or downward, when the distance measured by the distance sensor 15 or the position of the hand according to hand outline extraction indicates that the hand is outside the image capture range, or when the image cannot be used in registration and verification processing. By this means, the palm of the hand of the user is guided over the image capture device 1.
Blood vessel image extraction processing 34-2 extracts a vein image from the image of the hand when the hand outline detection processing 34-1 judges that an image has been captured with the hand held correctly. That is, an image of the palm such as that of
As can be understood from
On the other hand, in extraction of blood vessel image characteristic quantity data (the first characteristic data), characteristic quantities which are not affected by the circumstances of image capture are extracted. For example, as shown in
The curvature directions of characteristic quantity (1) can be extracted as a characteristic without being affected by the inclination of the hand at the time of image capture. The directions of characteristic quantity (2) can be extracted as a characteristic without being affected by instability of the state of image capture, such as for instance portions missing from the image. And, the frequencies of characteristic quantity (3) can be extracted as a characteristic without being affected by rotation of the blood vessel image.
These broad characteristics of blood vessel images are comparatively common among a plurality of human bodies, and while it is desirable in the interest of accuracy that these three characteristic quantities be used, one or two among them may be used. In particular, it is desirable that the characteristic quantities (1) and (2) be used.
In registration processing 34-6, detected blood vessel image data and the characteristic quantities (1), (2), (3) are registered (stored) in the biometrics information database file 4. As shown in
As explained below, the characteristic quantity (1) is curvature components (w1, w2, . . . , w36) in 36 directions; the characteristic quantity (2) is angular components (f1, f2, . . . , f8) in eight directions; and the characteristic quantity (3) is 32 frequency components (h1, h2, . . . , h32).
Registered blood vessel image search processing 34-4 retrieves the blood vessel image characteristic data shown in
Thus in this invention, broad characteristic quantities for blood vessel image data are registered together with characteristic data for use in verification, and at the time of authentication an order of verification is determined using the degrees of similarity of characteristic quantities, and verification of blood vessel image characteristic data is performed in the order of verification thus determined. Hence the order of verification is determined using the captured blood vessel image, so that even when numerous characteristic data sets have been registered, verification can be performed in a verification order based on the blood vessel image for the user, and the speed of verification can be improved.
Biometrics Characteristic Data Registration Processing
Next, the biometrics characteristic data registration processing explained using
(S10) First, the user holds his hand over the image capture device 1, to capture an image of the palm of the hand.
(S12) As explained above, the registered blood vessel image (vein) data such as that of
(S14) Next, the vein characteristic quantities (1), (2), (3) are computed from the blood vessel image (vein) data. This processing is explained below, using
(S16) The data for registration thus generated and the vein characteristic quantities (1), (2), (3) are registered in the vein database 4, as shown in
Next, processing to compute the vein characteristic quantity (1) of
The processing of
(S20) First, noise-like segments are removed. Here, segments forming circles, short isolated segments, and short branch segments are equivalent to noise when viewing overall trends (curvature directions), and so are removed. For example, from the extracted blood vessel image of
(S22) Next, segments of interest are approximated by polygonal lines in order to compute curvature directions for segments of interest. As shown in
(S24) Next, curvature directions B are calculated from the vectorized segments. This is explained using the model of
Hx=−(yc−ya)*(xc*ya−xa*yc)/((xc−xa)ˆ2+(yc−ya)ˆ2) (1)
Hy=(xc−xa)*(xc*ya−xa*yc)/((xc−xa)ˆ2+(yc−ya)ˆ2) (2)
The angle of the direction B is calculated using equation (3) below.
direction B=arctan(Hy/Hx) (3)
(S26) Next, a histogram of curvature directions B of the vectorized segments is created.
This curvature direction characteristic quantity is a broad representation of curvature directions of each of the segments in the blood vessel image.
Next, processing to compute the vein characteristic quantity (2) of
The processing of
(S30) First, the captured image f(x,y) is subjected to a two-dimensional FFT (Fast Fourier Transform), and the spatial frequency component F(u,v) of the image is computed using equation (4) below. The two-dimensional FFT is obtained by taking the Fourier transform of pixels in each line in the x direction of the image f(x,y), and then performing a y-direction Fourier transform of the FFT result for the line.
Here W1=exp(−j2π/M) and W2=exp(−j2π/N), where M and N are the numbers of pixels in the horizontal and vertical directions respectively.
(S32) Next, the square of the absolute value of the spatial frequency component F(u,v) is calculated, and the following equation (5) is used to compute the power spectrum P(r, θ). This represents the intensity of the spatial frequency (u,v).
P(u,v)=|F(u,v)|ˆ2 (5)
As indicated in
(S34) From the power spectrum in polar coordinates P(r, θ), the following equations (6) and (7) are used to calculate the angle spectrum q(θ).
Here w represents the magnitude of the domain of P(u,r).
Here θ is one of eight directions, which are θ=0°, 23°, 45°, 68°, 90°, 113°, 135°, 158°, as in
(S36) The fractions Pq(θ) of energy q(θ) in the eight directions are computed using the following equation (8).
Pq(θ)=q(θ)/Σq(θ) (8)
This is used to perform normalization such that the sum of Pq(θ) equals 1.0. In
Next, processing to compute the vein characteristic quantity (3) of
(S40) First, the image f(x,y) of the blood vessel image (veins) is subjected to the two-dimensional FFT (Fast Fourier Transform) using the above-described equation (4), to compute the spatial frequency component F(u,v) of the image. The two-dimensional FFT is obtained by taking the Fourier transform of pixels in each line in the x direction of the image f(x,y), and then performing a y-direction Fourier transform of the FFT result for the line.
(S42) Next, the above-described equation (5) is used to compute the square of the absolute value of the spatial frequency component F(u,v), to determine the power spectrum P(u,v). As shown in
(S44) From this polar-coordinate power spectrum P(r,θ), the following equation (9) is used to calculate the Fourier texture characteristic quantity p(r).
The Fourier texture characteristic quantity of equation (9) is the sum of the energy of a donut-shape area centered on the origin in the polar coordinate power vector space; here the characteristic quantity (3) is the 32 elements h1, h2, . . . , h32 of the intensity distribution. This characteristic quantity (3) indicates the periodicity of the image segments. Because of the extremely broad dynamic range of the intensity distribution, a logarithmic (log) representation is used.
In this way, the direction and periodicity in the blood vessel image are extracted as broad characteristic quantities.
Processing for Biometrics Characteristic Data Verification
Next, the biometrics characteristic data verification processing explained in
(S50) The user holds his hand over the image capture device 1 to capture an image of the palm.
(S52) As explained above, blood vessel image (vein) data such as that in
(S54) Next, vein characteristic quantities (1), (2), (3) are computed from the blood vessel image (vein) data. This processing was explained using
(S56) A vein characteristic quantity table (all the records with characteristic quantities (1), (2), (3) in
(S58) Scores for characteristic quantities are calculated from the vein characteristic quantities (1), (2), (3) thus generated and the characteristic quantities (1), (2), (3) in the vein characteristic quantity table. As shown in
score 1=|registered w1−verification w1|+ . . . +|registered w36−verification s36| (10)
Score 2 is the sum of the differences between angle components in eight directions for the registered data and generated data, and is calculated using the following equation (11).
score 2=|registered f1−verification f1|+ . . . +|registration f8−verification f8| (11)
Score 3 is the sum of the differences between the 32 frequency components for the registered data and generated data, and is calculated using the following equation (12).
score 3=|registered h1−verification h1|+ . . . +|registered h32−verification h32| (12)
(S60) The verification order determination processing of
(S62) At this time, verification processing is performed to finally confirm the identity of the individual. Registered characteristic data is retrieved from the vein database 4 according to the verification order determined as described above, and verification against the verification characteristic data generated in step S52 is performed. If the verification result is unsatisfactory, verification is performed against the registered characteristic data set ranked next in the verification order is performed. If the verification result is satisfactory, authentication processing ends.
Next, the verification order determination processing of step S60 is explained using
(S70) First, the scores 1[N], 2[N], 3[N] of all the records are sorted, and the order rankings of each of the scores 1, 2, 3 are determined.
(S72) The total score total[N] is calculated for each record (of the registered characteristic data). When α, β and γ are weighting coefficients, then the total score is as given in equation (13).
total[N]=α·score 1 order ranking+β·score 2 order ranking+γ score 3 order ranking (13)
(S74) These total scores are sorted, and the verification order is determined from the sorting results. As shown in
In this way, order rankings for verification with biometrics characteristic data are determined according to the distance from broad characteristic quantities, and verification of registered data against verification data is performed according to the verification order rankings; hence even when numerous biometrics information sets are stored, the speed of verification can be improved, contributing to the widespread adoption and increased scale of biometric authentication systems.
In the above embodiments, examples were explained in which biometric authentication is performed by authenticating the vein pattern in the palm of a hand; but the invention can also be applied to biometric authentication of vein patterns on the fingers or the back of the hand, palmprints or other characteristics of the palm of the hand, as well as to fingerprints, facial features, and other biometric authentication. Further, an example of a system to manage ingress to and egress from a facility was explained; but the invention can also be applied to the opening and closing of doors for which individual authentication is required, and other tasks in which authentication is performed in place of the use of a key, or similar.
In the above, embodiments of the invention have been explained; but various modifications to the invention are possible within the scope of the gist of the invention, and these modifications are not excluded from the scope of the invention.
Broad characteristic quantities of biometrics data are registered together with characteristic data for use in verification, and at the time of authentication the order of verification is determined based on the degrees of similarity of characteristic quantities, and verification against biometrics characteristic data is performed in the order of verification thus determined. Consequently, because the order of verification is determined based on biometrics information, verification can be performed in a verification order based on biometrics information for the user, even when numerous characteristic data sets have been registered, so that the speed of verification is improved.
Number | Date | Country | Kind |
---|---|---|---|
2006-068902 | Mar 2006 | JP | national |