This application is also related to the following commonly assigned applications and patents, the entire disclosure of each of which is incorporated herein by reference for all purposes: U.S. Pat. No. 6,560,352, entitled “APPARATUS AND METHOD OF BIOMETRIC IDENTIFICATION OR VERIFICATION OF INDIVIDUALS USING OPTICAL SPECTROSCOPY,” filed Apr. 11, 2001 by Robert K. Row. et al.; U.S. patent application Ser. No. 09/415,594, entitled “APPARATUS AND METHOD FOR IDENTIFICATION OF INDIVIDUALS BY NEAR-INFRARED SPECTRUM,” filed Oct. 8, 1999; U.S. patent application Ser. No. 09/874,740, entitled “APPARATUS AND METHOD OF BIOMETRIC DETERMINATION USING SPECIALIZED OPTICAL SPECTROSCOPY SYSTEM,” filed Jun. 5, 2001; U.S. patent application Ser. No. 10/262,403, entitled “SPECTROSCOPIC CROSS-CHANNEL METHOD AND APPARATUS FOR IMPROVED OPTICAL MEASUREMENTS OF TISSUE,” filed Sep. 30, 2002 by Robert K. Rowe et al.; and U.S. patent application Ser. No. 10/407,589, entitled “METHODS AND SYSTEMS FOR BIOMETRIC IDENTIFICATION OF INDIVIDUALS USING LINEAR OPTICAL SPECTROSCOPY,” filed Apr. 3, 2003 by Robert K. Rowe et al.
This application relates generally to electro-optical sensors. More specifically, this application relates to electro-optical sensors for use in biometric analysis of optical spectra of tissue.
Biometric determination is generally defined as the process of measuring and using one or more physical or behavioral features or attributes to gain information about identity, age, or sex of a person, animal, or other biological entity. As well, in order to ensure security, the biometric determination task may include further tasks that ensure that the sample being measured is authentic and being measured on a living being. This latter test is referred to as a determination of liveness.
There are two common modes in which biometric determinations of identity occur: one-to-many (identification) and one-to-one (verification). One-to-many identification attempts to answer the question of, “do I know you?” The biometric measurement device collects a set of biometric data and from this information alone it assesses whether the person is a previously seen (“authorized”) individual. Systems that perform the one-to-many identification task, such as the FBI's Automatic Fingerprint Identification System (AFIS), are generally very expensive ($10 million or more) and require many minutes to detect a match between an unknown sample and a large database containing hundreds of thousands or millions of entries. The one-to-one mode of biometric analysis answers the question of, “are you who you say you are?” This mode is used in cases where an individual makes a claim of identity using a user name, a personal identification number (PIN) or other code, a magnetic card, or other means, and the device collects a set of biometric data which it uses to confirm the identity of the person. “Identification” will be used in this document to denote both identification and verification tasks.
Although in general the one-to-many identification task is more difficult than one-to-one, the two tasks become the same as the number of recognized or authorized users for a given biometric device decreases to just a single individual. Situations in which a biometric identification task has only a small number of entries in the authorization database are quite common. For example, biometric access to a residence, to a personal automobile, to a personal computer, to a cellular telephone, and to other such personal devices typically require an authorization database of just a few people.
Biometric identification and verification is useful in many applications. Examples include verifying identity prior to activating machinery or gaining entry to a secure area. Another example would be identification of an individual for matching that individual to records on file for that individual, such as for matching hospital patient records especially when the individual's identity is unknown. Biometric identification is also useful to match police records at the time a suspect is apprehended, but true identity of the suspect is not known. Additional uses of biometric identification or verification include automotive keyless start and entry applications, secure computer and network access applications, automated financial transaction applications, authorized handgun use applications, and time-and-attendance applications. In general, protected property will be the term used to describe all of the goods, places, services, and information that may require biometric authorization to access.
In addition to performing a biometric identification or verification and ensuring that the sample being measured is living tissue, there may also exist a need to determine an estimate of the age, sex, and other demographic characteristics of the person under test as part of the biometric determination task. For example, the U.S. Federal Trade Commission recently established a commission to examine the issue of remotely determining age of a person who is attempting to access a web site in order to block access by children to inappropriate sites. The Commission on Online Child Protection (COPA) heard testimony on Jun. 9, 2000 that indicated that then-known biometric techniques could not be used to aid the determination of a person's age based on any known biometric features.
Embodiments of the invention thus provide methods and systems that extend the functionality of electro-optical sensors. In a first set of embodiments, a device is provided having such extended functionality. The device includes a plurality of light sources, a light detector, and a processor configured to operate the light sources and the light detector to perform a plurality of distinct functions. At least one of the distinct functions comprises a biometric identification function in which light is propagated from the plurality of light sources through presented material. The propagated light is received with the light detector, with the presented material being identified from the received light. Another of the distinct functions comprises a nonidentification function performed with the light sources and the light detector.
In some of these embodiments, the light detector may comprise a plurality of light detectors, which may further comprise an array of light detectors. In one embodiment, the nonidentification function comprises a liveness function to determine whether the presented material is alive. Such a determination may be used in some instances as part of providing operation of an optical switch having multistate functionality. In another embodiment, the nonidentification function comprises a nonbiometric function. For example, the nonidentification function may comprise operation of an optical communications port with the light sources and the light detector.
In a second set of embodiments, a portable electronic device having extended functionality is provided. The portable electronic device comprises an electronic arrangement for performing a standard function of the portable electronic device, a biometric sensor, and a processor. The biometric sensor includes a plurality of light sources and a light detector disposed relative to the light sources to detect light from the light sources that has propagated through tissue. The processor is configured to operate the electronic arrangement to perform the standard function and to operate the biometric sensor. Light is propagated from the plurality of light sources through the tissue and the propagated light is received with the light detector. The tissue is identified from the received light.
Examples of functions that may be performed by the electronic arrangement include functions of a cellular telephone, a personal digital assistant, an electronic fob, and a watch. In some instances, the processor may be further configured to operate the biometric sensor to perform a nonbiometric function. For example, the biometric sensor may be operated to perform a spectrometer function, such as a stress-detection function, a lie-detector function, a tanning-meter function, a complexion-monitor function, a toxicity-monitor function, an alcohol-monitor function, a bilirubin-monitor function, a hemoglobin-monitor function, a fruit-ripeness-monitor function, a counterfeit-document detection function, or a color-match function. In other instances, the nonbiometric function may use an illumination capacity of the plurality of light sources and use a detection capacity of the light detector, such as in performing an ambient-light-sensor function, an entertainment function, a personal-security function, a smoke-detector function, a motion-detection function, or an optical-strobe function. In some embodiments, the nonbiometric function may use an illumination capacity of the plurality of light sources, such as to provide an optical-ringer function, a flashlight function, or an optical-pointer function. In other embodiments, the nonbiometric function may use a detection capacity of the light detector, such as to provide a trickle-charge function or a light-meter function.
In a third set of embodiments, a method is provided for managing enrollment in a biometric identification system that accommodates extended functionality. A database is maintained that comprises spectrally derived biometric identification information for at least one individual and an identification of personalized settings for the at least one individual. Collected spectral data are correlated with the spectrally derived biometric identification information for the at least one individual. Parameters of an object are adjusted in accordance with the personalized settings. The at least one individual may comprise a plurality of individuals. In some instances, changes to the parameters made by the at least one individual may be tracked so that the personalized settings may be modified in accordance with the changes.
In a fourth set of embodiments, a method is provided for identifying a physiological state of an individual. Electromagnetic radiation is propagated into tissue of the individual. A measured spectral variation is received in the form of electromagnetic radiation scattered from the tissue of the individual. The measured spectral variation is compared with a reference spectral variation over a predetermined wavelength interval by comparing, at each of a plurality of wavelengths within the predetermined wavelength interval, a property of the measured and reference spectral variations. The physiological state of the individual is determined from a consistency of the measured spectral variation with the reference spectral variation.
In some embodiments, the physiological state may indicate a stress level of the individual, while in other embodiments, the physiological state may indicate a level of truthfulness of a statement made by the individual. The measured and reference spectral variations may be acquired substantially contemporaneously, such as in a common session. In other instances, the physiological state may indicate a concentration of a substance in the tissue of the individual, such as a concentration of alcohol, bilirubin, or hemoglobin, among others.
A further understanding of the nature and advantages of the present invention may be realized by reference to the remaining portions of the specification and the drawings wherein like reference numerals are used throughout the several drawings to refer to similar components. In some instances, a sublabel is associated with a reference numeral and follows a hyphen to denote one of multiple similar components. When reference is made to a reference numeral without specification to an existing sublabel, it is intended to refer to all such multiple similar components.
Embodiments of the invention are based on the recognition that an accurate, precise, and repeatable tissue spectrum of an individual in certain electromagnetic wavelength ranges contain spectral features and combinations of spectral features that are unique to the individual. In some embodiments, the wavelength ranges comprise the ultraviolet, visible, very-near-infrared, or near-infrared ranges, or combinations of these ranges. In addition, embodiments of the invention recognize that analysis, such as with discriminant-analysis techniques, can identify these unique features or combinations, which may not be readily apparent in visual analysis of a spectral output, so that an individual's identity may be determined by comparison of tissue spectral data taken at the time of use and compared to stored tissue spectral data from prior measurement.
In addition, the tissue spectrum has been found not only to contain information that is unique to an individual, but also to contain numerous features and combinations of features that indicate whether such spectral samples were taken while the sample was alive or not. The physiological effects that give rise to spectral features that indicate the “liveness” state of a sample, i.e. whether it is alive or dead, include, but are not limited to blood perfusion, temperature, hydration status, glucose and other analyte levels, and overall state of tissue decay. Thus, the biometric identification and verification methods of the present invention may also be used in conjunction with, or separately from, the determination of the state of the liveness of the tissue. Tissue from other biological systems, such as organs, animals, etc., has also been found to have spectral characteristics that are distinctly different from human skin due to differences in the tissue composition and form. Thus, the biometric identification methods of the present invention may also be used in conjunction with or separately from the determination of whether the sample is human skin or some other tissue. In addition, it has been found that tissue-like substances such as collagen gelatin, latex, water solutions, or others that have been used to attempt to spoof various biometric sensors have spectral characteristics that are distinctly different that human tissue due to differences in composition and form. The biometric identification and verification methods of the present invention can thus be used with or separately from the determination whether the sample is actual tissue or some other substance.
The inventors have also found that other spectral features observed in the tissue spectrum relate to the age and sex of the person being measured. It is believed that these features are due in part to the differences in dermal thickness between young and old people and between males and females. Such changes in skin thickness and composition affect the optical characteristics of the tissue by affecting the scattering properties of the sample. These properties in turn impose distinct spectral shapes on the measured tissue spectra, which can be extracted and used by appropriate multivariate techniques to provide age and sex estimates.
Referring now to
The light sources 34 may comprise light emitting diodes (“LEDs”), laser diodes, vertical cavity surface emitting lasers (“VCSELs”), quartz tungsten halogen incandescent bulbs with optical pass-band filters which may optionally include optical shutters, or any of a variety of other optical sources known in the art. The light sources 34 can each have the same wavelength characteristics or can be comprised of sources with different center wavelengths in a spectral range from about 300 nm to about 10,000 nm. In general, the collection of light sources 34 can include some sources that have the same wavelengths as others and some sources that are different. In one embodiment, the light sources 34 includes sets of LEDs, laser diodes, VCSELs, or other solid-state optoelectronic devices with differing wavelength characteristics that lie within the spectral range from about 350 nm to about 1100 nm.
The detector 36 may comprise a single element, a plurality of discrete elements, or a one- or two-dimensional array of elements. The detector type and material is chosen to be appropriate to the source wavelengths and the measurement signal and timing requirements. These detectors can include PbS, PbSe, InSb, InGaAs, MCT, bolometers and micro-bolometer arrays. In one embodiment where the light sources 34 are solid-state optoelectronic devices operating in the spectral range from about 350 nm to about 1100 nm, a suitable detector material is silicon.
The light sources 34 can be sequentially illuminated and extinguished to measure the tissue properties for each source by turning power to each of them on and off. Alternatively, multiple light sources 34 can be electronically modulated using encoding methods that are known to one knowledgeable in the art. These encoding patterns include Fourier intensity modulation, Hadamard modulation, random modulation, and other modulation methods.
Referring to
This mean optical path is, in general, different for different source-detector separation distances. If another light source 51 is located at the same distance from the detector 36 as light source 41 and the two light sources have the same wavelength characteristics, the resulting signals can be processed as separate elements or can be combined to increase the resulting signal-to-noise ratio of the measurement. If light source 51 has a different wavelength characteristic than light source 41 then, in general, the resulting signals provide unique and useful information about the tissue optical properties, especially as they relate to spectral biometric determinations and may be analyzed as distinct data points. In a similar manner, if two light sources have the same wavelength characteristics and are positioned at different distances from the detector 36 (for example light sources 41 and 43) then the resulting information in the two signals is different and the measurements may be recorded and analyzed as distinct data points. Differences in both wavelength characteristics and source-detector separation provide useful information about the optical characteristics of the tissue 40.
In general, the detector 36 can be located in the center of the sensor head or it can be offset to one side of the sensor head 32 in order to provide for greater source-detector separation distances. The sensor head 32 may have other shapes, including oval, square and rectangular shapes. The sensor head 32 may also have a compound curvature on the optical surface to match the profile of a device in which it is mounted, to incorporate ergonomic features that allow for good optical and mechanical coupling with the tissue being measured, or for other technical or stylistic reasons.
Light that reflects from the topmost layer of skin does not contain significant information about the deeper tissue properties. In fact, reflections from the top surface of tissue (known as “specular” or “shunted” light) are detrimental to most optical measurements. For this reason,
One embodiment of the sensor incorporates an optical relay (not shown) between the sensor surface 39 and the skin 40. This optical relay transfers the light from the light sources to the skin and from the skin back to the detector(s) while minimizing light loss and spreading. Methods of performing this function include fiber-optic face plates and tapers, individual optical fibers and fiber bundles, light pipes and capillaries, and other mechanisms known to one of skill in the art. Optionally, the surface of the light relay can be contoured to fit specific product applications and ergonomic requirements. This has the advantage that the structure of the basic sensor can remain constant, but adapted to various product applications by mounting the sensor to one of a series of optical relay units.
An alternative embodiment of a variable source-detector configuration is illustrated in
Alternatively, multiple source-detector distances can also be achieved by using a plurality of detector elements, as shown in
Another example of the use of multiple source and detector elements that provide multiple source-detector distances is shown with the top view of
The detector(s) can be any material appropriate to the spectral region being detected. For light in the region from about 350 nm to about 1100 nm, a suitable detector material is silicon and can be implemented as a single-element device, a collection of discrete elements, or a 1D or 2D array, depending upon the system configuration and encoding method used. For light in the region from about 1.25 to about 2.5 μm, a suitable detector material is InGaAs and can also be implemented as a single element, a collection of elements, or a 1D or 2D array. Additional detector materials and means of detection include InSb, Ge, MCT, PbS, PbSe, bolometers, and others known to one of ordinary skill in the art.
Once the light passing though the tissue is detected, the signals can be digitized and recorded by standard techniques. The recorded data can then be processed directly or converted into absorbance spectra or noised-scaled absorbance spectra as is known to one of ordinary skill in the art. The data can then be used for spectral identification or verification by the methods described in U.S. Pat. No. 6,560,352, U.S. patent application Ser. No. 09/415,594, and/or U.S. patent application Ser. No. 10/407,589, all of which have been incorporated herein by reference.
Because of the nature of optical spectroscopy, it is difficult to generate spectra of similar shape and absorbance characteristics without using similar material for the sample. For this reason, many common materials, such as latex and wax that are used to defeat other biometric systems such as fingerprint readers or hand geometry systems are ineffective tissue surrogates for a spectral biometric system. By performing a spectral comparison, most non-tissue samples will be rejected, resulting in a strong countermeasure capability against potential intruders.
Similarly, many of the spectral features that are present in the wavelength ranges disclosed by this invention are indicative of living tissue. These features include oxy- and deoxy-hemoglobin bands, temperature effects, intracellular hydration, and others. These effects contribute to the overall spectral signature of the sample being measured and ensure that a matching sample is one that is part of a living person and normally perfused. Thus, a good spectral comparison ensures the “liveness” of a sample and deters the use of dead or excised tissue as a means to circumvent the spectral biometric system.
In some applications, such as Internet access authorization, it may be useful to be able to verify the sex and/or age of the person using the spectral biometric system. Because of both age- and sex-specific difference in skin structure and composition, the optical spectra change in systematic and indicative ways such that the age and sex can be estimated using the biometric spectral data.
In practicing embodiments of the present invention, the tissue spectral data is determined by measuring the light intensity received by the output sensor for the various light sources which give indications of the optical properties of the tissue at different wavelengths and/or at different source-detector separations. As is well known to one of ordinary skill in the art, the signal produced by the detector in response to the incident light levels can be converted into spectral data that can be recorded and used for subsequent analysis for enrollment or authorization of identity.
A small spectral biometric subassembly, such as those discussed above, can be embedded in a variety of systems and applications. The spectral biometric reader can be configured as a dedicated system that is connected to a PC or a network interface, an ATM, securing an entryway, or allowing access to a particular piece of electronics such as a cellular phone, personal digital assistant (“PDA”), electronic fob, or any other portable electronic device. In this mode, one or more people can be enrolled in the biometric system and use a particular reader to gain access to a particular function or area.
Alternatively, the spectral biometric system can configured as a personal biometric system that confirms the identity of a person authorized to use the device (who could be one of a plurality of people authorized by the device), and transmits this authorization and any necessary identifying information about the user to any properly equipped PC, ATM, entryway, or piece of electronics, that requires access authorization. The personal biometric could, after confirming the identity of the user, transmit specific user information and device-specific information along with or instead of an authorization. User-specific information may include identity, financial information, medical information, or other pieces of personal information. Device-specific information may include serial number, tamper warnings, battery-low or other service messages, and other pieces of information.
Instead of performing the biometric authorization procedure onboard the personal biometric system, one can measure the spectral biometric data of the person and transmit the data and any associated identifying information about the user and device to the reader for authentication. One advantage of this latter approach is that the personal biometric system can transmit an identifying code to the reader unit and then use the biometric signal to confirm authorization, which implies that the system needs to perform a verification task rather than the more difficult identification task. Yet, from the user's perspective, the system recognizes the user without an explicit need to identify himself or herself. Thus, the system appears to operate in an identification mode, which is more convenient for the user.
An additional advantage of a personal biometric system is that if an unauthorized person is able to defeat the personal biometric system code for a particular biometric system-person combination, the personal biometric system can be reset or replaced to use a new identifying code and thus re-establish a secure biometric for the authorized person. This capability is in contrast to multi-person biometric systems that base their authorization solely on a biometric signature (spectral, as well as any of the other biometric techniques such as fingerprint, iris, facial, etc.). In this latter case, if an intruder is able to compromise the system by somehow imitating the signal from an authorized user, there is no capability to change the biometric code since it is based solely on a fixed physiological characteristic of a person.
A second embodiment of a personal spectral biometric system 110 is depicted in
In addition to the watch or fob, similar biometric capability can be built into other personal electronic devices. For example,
Still another example of a personal electronic device configured with biometric capability in accordance with an embodiment of the invention is shown in
Still other devices may be configured to include the biometric sensor in other embodiments. For example, the compact sensors disclosed can also be put into firearms to prevent unauthorized usage. In particular, the biometric sensor could be placed in the handgrip of a weapon such as a handgun or other firearm to sense tissue properties while the gun is being held in a normal manner.
Management of the functionality discussed herein for the biometric sensor may be performed with a computer system. The arrangement shown in
The computational device 330 also comprises software elements, shown as being currently located within working memory 350, including an operating system 352 and other code 354, such as a program designed to implement methods of the invention. It will be apparent to those skilled in the art that substantial variations may be used in accordance with specific requirements. For example, customized hardware might also be used and/or particular elements might be implemented in hardware, software (including portable software, such as applets), or both. Further, connection to other computing devices such as network input/output devices may be employed.
a. Initial Enrollment
In
Once the enrollment is enabled, the sequence 500 begins with the collection of personal information 502, which is linked to the spectral biometric data. At a minimum, this personal information consists of a unique identifier that can be used by automated or manual means to refer to the particular biometric enrollment data. The personal information can also include items such as name, addresses, contact information, demographic information, medical information, passwords and PIN's for other systems, authorization codes, links to other databases or systems, and any other information pertinent to the particular biometric application. These information can be entered by a variety of means including manual entry during an enrollment interview, read automatically from a magnetic card, proximity card, or smart card, or downloaded from other systems and databases.
When the collection of personal information 502 is complete, the next block shown in the sequence is the acquisition of spectral data 504. The acquisition commences when the person being enrolled places the appropriate portion of the hand or other body part in contact with the spectral biometric sensor and a trigger is given. The trigger can be manually activated or based on a mechanical, optical, electrical or magnetic switch that senses contact between the sensor and the skin site being enrolled. As few as a single enrollment sample can be taken, but more typically two or more independent samples are taken to ensure that the samples are consistent, as explained later in the sequence. If multiple enrollment samples are taken, the person being enrolled typically withdraws their hand from the sensor and replaces it in order to collect a new independent sample.
Once the candidate enrollment sample or samples are collected, they may undergo one or more preprocessing operations 506. Preprocessing of the spectral data may include a decoding step if the data were collected in an encoded fashion such as Hadamard, Fourier, frequency division multiplexing, spread spectrum techniques, and others of similar nature. Operations necessary to invert the encoding imposed by such techniques are well known to one of ordinary skill in the art. Other systems such as sequential illumination of different wavelength sources do not require decoding.
Whether or not the data are required to be decoded, additional preprocessing steps may include generating the ratio of the biometric spectra to an optical reference spectrum, performing a logarithmic transform of the spectral data, performing explicit corrections to account for sensor-to-sensor variations or environmental influences of temperature, humidity and pressure, scaling the data by some function, and selecting certain subsets of the spectral data for further processing. These and other techniques are well known in the art.
After preprocessing, if any, the spectra can then be checked for goodness 508, which confirms that the candidate enrollment spectra have optical characteristics that are similar to the type of tissue for which the sensor is calibrated. In particular, if the goodness check 508 generates a metric or metrics that ensures that the enrollment samples have optical properties that are similar to living skin collected from a human hand (for example). As such, this procedure performs the spectral liveness determination for the enrollment data. In order to do this, the candidate enrollment samples are compared to calibration factors that describe the spectral qualities of the calibration samples (which in this example are presumed to be taken from the skin on one or more living human hands). These factors can be generated using a variety of standard techniques including principal component analysis, linear discriminant analysis, partial least squares, Fourier analysis, cluster analysis and other numerical modeling methods known to one of ordinary skill in the art.
Analyses and metrics that can used to ensure that the candidate enrollment samples are good (i.e. consistent with the calibration data) include Mahalanobis distance, Euclidean distance, residuals of the enrollment spectra when fit by the calibration factors, cluster analysis and other methods that are known to one of ordinary skill in the art (see for example, Multivariate Calibration by Martens and Naes, John Wiley & Sons, 1993, chapter 5, which is incorporated herein by reference). The goodness decision 510 is based on one or more of these metrics to determine if each of the candidate enrollment spectra is consistent with the calibration data set. If so, the enrollment process continues with a consistency check described below. If not, the candidate enrollment data are discarded at block 512 (either all enrollment samples or only the ones that are deemed to be not good) and new enrollment data are collected to replace them. There are also a variety of logical options that the enrollment process can be incorporated in this loop that are not shown, such as a try counter to permit a limited number of enrollment attempts before flagging an error condition.
The next step in the enrollment process 500 is the generation of consistency metrics 514 followed by a consistency decision 516 based on those metrics. The consistency check confirms that the multiple candidate enrollment samples are sufficiently similar to each other to take them as valid. This portion over the overall procedure 500 is omitted in cases where the system operates with only a single candidate enrollment spectrum is taken. In cases where a consistency determination 516 is performed, the methods used can be similar to the methods used for goodness 510 with the difference being that the enrollment spectra are compared to themselves instead of compared to the calibration data. As an example, consider the case where Mahalanobis distance is used as a metric for both the goodness 508 and consistency 514 steps. In the case of goodness, the spectral mean of the calibration data is subtracted from each of the candidate enrollment data and the Mahalanobis distance of this difference is calculated. If the distance is consistent with the distances that the mean-centered calibration data produced, then the goodness according to this metric is acceptable. Conversely, when using the same data and same metric for a consistency check, the mean of the candidate enrollment spectra themselves are subtracted from each of the candidate spectra (or other similar operations can be performed such as subtracting on of the candidate spectra from each of the others). If the resulting Mahalanobis distances are sufficiently small, then the candidate enrollment spectra are deemed to be consistent in the consistency decision 516.
The outcome of the consistency decision 516 has similar options and results as the goodness decision 510. In the case where the candidate enrollment samples are found to be inconsistent, some or all of the samples are retaken. In the case where the samples are found to be consistent, then the enrollment process 500 may proceed to check for a match with the existing enrolled entries 518. Determining where there is a match with the existing enrolled data is particularly important in a biometric system that is being used in an identification mode where participants may have an incentive to assume false identities. Examples of such situations include biometrics systems used to authorize voting, the issuance of a driver's license, identification card, passport, credit card, welfare benefits or other item of tangible value.
Matching against the enrolled database 518 relies on the use of specific, predetermined spectral features or factors. These factors are determined during an earlier calibration phase and are chosen to enhance person-to-person effects relative to typical spectral changes experienced by a single person or changes that occur within and between biometric sensors. Examples of techniques for generating the factors include principal component analysis, linear discriminant analysis, quadratic discriminant analysis, partial least squares, and other multivariate methods as is known to one of skill in the art. In one embodiment, the factors for determining a match to the enrolled database 518 are generated using principal component analysis (PCA) operating on a set of calibration data that have been collected from multiple people in multiple environmental conditions over time spans that are representative for the actual operation of the biometric sensor.
In the case where a close match is found, a properly authorized supervisor can examine the pertinent details at block 520 and decide whether to authorize the enrollment 522 based on any evidence of falsification. In the cases where either no close matches are found or a supervisor authorizes enrollment in the presence of a close match at block 522, the enrollment data are stored in the enrollment database 524 and the enrollment process is completed.
b. Other Enrollment Functions
Several embodiments of the invention provide methods for managing enrollment. An outline of several aspects of such enrollment management is presented in
If there is no match between the collected spectrum and any of the stored spectra, the individual is either allowed access or denied access in accordance with a default setting of the system. It is expected more usually that the inability of the system to identify the individual will result in a default denial of access. If a spectral match is found at block 306, it is possible for the system to respond in a similar default manner, such as by providing access to any individuals that are properly identified. The flow diagram indicates additional embodiments, however, that provide for the possibility of specific denial of access to certain identified individuals. At block 308, enrollment criteria for the identified individual indicating whether that person is to be allowed or denied access are examined. In accordance with the check at block 310, access is either allowed or denied at block 312 or 314 depending on the enrollment type of the individual.
The ability to identify individuals who are explicitly to be denied access, as opposed to denying access on a default basis to those who cannot be identified, provides a number of advantages to the system. For example, if the biometric sensor is comprised by a handgun, the system may identify the owner as the only individual permitted to use the device, and may additionally explicitly prohibit individuals identified as the owner's children from using the device. Thus, in accordance with the flow diagram of
It is also possible to use the explicit-denial capability of a biometric system in a fixed installation such as a home, place of business, or an automobile. For example, a biometric system installed at the entryway of a place of business can be used to admit authorized employees and temporary workers. If an employee is fired or the term of the temporary employee expires, then their enrollment data can be shifted from the authorized to the unauthorized database, and an explicit check is made to deny access to the former employee if he or she attempts to enter.
In some embodiments, allowing access at block 312 may also comprise personalizing settings. For example, supplementary information regarding the identified individual may be stored in addition to storing identification indicia. This supplementary information may also be updated over time to reflect better identification of settings suitable for each individual. For example, in one embodiment the biometric sensor is comprised by an automobile that is used by multiple individuals and acts as a security device. When one of those individuals accesses the automobile, she is not only provided with access to it at block 312, but environmental aspects such as seat positions, radio settings, temperature, etc. and safety characteristics such as air-bag deployment profiles are automatically configured for her. In another embodiment, the biometric sensor is comprised by a television remote control and is positioned to identify the individual holding the device automatically. A processor programmed to track viewing habits is configured to discriminate by the identified individual. Thus, over time, whenever one of the individuals handles the remote control, it may automatically adjust settings, such as selecting certain preferred channels, volume levels, etc., that are individualized. The preceding are examples in which the biometric sensor is used to automatically personalize the device or environment to the specific person's requirements or tastes.
In applications that are dedicated to personalization tasks rather than providing security against unauthorized usage, a further processing step on initial enrollment may be performed. Once a good enrollment spectrum is collected, or an existing enrollment spectrum is updated, a mathematical analysis is initiated to determine features that best separate the existing enrolled users. The result of this discriminant analysis then modifies the calibration coefficients that are used in blocks 304 and 306 of
Block 316 of
Such an updating technique may also be used in other embodiments. For example, spectral variations may also result from differences in individual biometric sensor arrangements. Thus, in one embodiment, a spectral profile for each individual is stored for each sensor, either locally to the sensor or centrally with an identification of the sensor. Updates are then performed for each sensor when an individual uses it for identification, having the effect of tuning each biometric sensor to its own individual characteristics.
The enrollment-management methods described with respect to
A number of embodiments of the invention exploit the illumination and/or light-detection capabilities provided by the biometric sensor. These capabilities are used to provide functions that are supplementary to the identification and/or verification functions. As such, these embodiments are especially suitable when the biometric sensor is comprised by a portable device, such as a portable electronic device. In some embodiments, activation of the supplementary functions may be tied with a service contract. In these instances, some of the functions may be of interest to a customer for a modest increase in service fee even if the customer would not be inclined to purchase a separate device dedicated to performing those functions. For example, in one embodiment, the biometric sensor is comprised by a cellular telephone. The cell-phone provider offers extended functionality of the biometric sensor in accordance with the embodiments described below for the modest fee surcharge.
a. Spectrometer Capabilities
In one set of embodiments, the spectral-analysis capabilities of the biometric sensor are extended to spectral analysis of material other than tissue. While a number of specific examples are provided to illustrated such extended functionality, the examples are not intended to be limiting and several other examples will be evident to those of skill in the art after reading this description. In some of the embodiments, the spectral-analysis capabilities are to identify changes, such as for the detection of conditions in humans that manifest themselves through spectroscopic changes in skin or other tissue. In other embodiments, the spectral-analysis is performed according to an absolute scale where the specific spectral characteristics are independently relevant. In some of the specific embodiments discussed below, the spectral analysis is used to identify a physiological state of an individual. Identification of such a physiological state may be made by measuring the spectral variation of a measured spectrum for light scattered by tissue of the individual, and comparing it with a reference spectral variation. The consistency of the measured spectral variation with the reference spectral variation allows a determination of the physiological state.
For example, in one embodiment, the extended functionality comprises a stress and/or lie detector. It is known that stress in humans causes a characteristic change in skin color, usually reddening, that may be detected spectroscopically. The change in skin color is believed to result from changes in the flow of blood in tissue as a result of the stress. This extended functionality may be included in the device by storing a reference spectrum for individuals when they are not under stress. When a subsequent spectrum is measured in accordance with the descriptions above, it may be compared to the reference spectrum using an appropriate multivariate discrimination method such as linear or quadratic discriminant analysis to determine whether such indicia of stress are present. In some cases, the measured and reference spectra may be acquired close in time. For example, during a questioning session, an initial spectral baseline may be determined by having a subject respond to a base set of questions in a known manner, responding truthfully to some and falsely to others. These results then effectively provide a spectral calibration against which the response to questions whose truthfulness is unknown may be measured.
In another embodiment, the extended functionality comprises a tanning meter. Similar to the stress and/or lie detector, functionality as a tanning meter is included by identifying changes in skin color, in this instance in response to exposure to sunlight or other ultraviolet radiation, such as may be provided in a tanning booth. An advantage to this use of the device is that exposure levels may be quantified on an individual basis and close in time to the tanning activity in order to rapidly determine sufficient exposure and avoid overexposure. Other techniques for determining excessive exposure are qualitative, relying on such broad factors as general skin type, eye color, hair color, etc. These qualitative techniques provide, at best, a crude estimation of excessive exposure. Use of the spectral analysis provided by embodiments of the invention instead provides much more accurate information.
In a further embodiment, the extended functionality comprises a complexion monitor. In a number of applications, notably in the cosmetics industry, skin color and composition are used as a guide, such as for choices in make-up color, hair-dye color, clothing color, etc. Qualities of the skin of interest in this application may include amount and type of collagen, melanin, elastin, sebum, hemoglobin, moisture content, skin surface characteristics, and other physiological, chemical, and structural characteristics of the skin. The ability of embodiments of the invention to quantify skin characteristics permits more reliable choices than provided by purely qualitative evaluations of skin color.
In some instances, the physiological state of an individual may be defined by concentration of a substance in the individual's tissue. For instance, the extended functionality may comprise a hemoglobin monitor. Similar to the effects of stress, increased activity levels in individuals as well as certain medical conditions are manifested by changes in blood flow in the body. Such changes in blood flow cause spectroscopic changes that may be detected according to the methods described above. According to this embodiment, these spectroscopic changes are correlated with oxygenation and/or hemoglobin levels in the blood. In addition to medical uses, the ability to quantify oxygenation levels is useful for individuals in monitoring exercise levels.
Spectroscopic changes associated with different physiological states in human tissue may also result from the release of certain pigments in response to pathological conditions. One example is provided by bilirubin, which is a reddish bile pigment that is released when liver tissue is diseased. The presence of the pigment causes a jaundicing of the affected person's skin. Such changes in skin color may be identified using the methods described above. Accordingly, in one embodiment, an extended functionality of the biometric sensor allows it to function as a bilirubin monitor. In other embodiments, levels of other pigments may similarly be monitored.
The presence of toxic substances in an individual's blood may also manifest itself spectroscopically because of the effect such toxins have on vascularity as well as a direct spectroscopic signature in certain cases. For example, increases in alcohol levels result in spectroscopic changes that may be observed, particularly in the infrared portion of the electromagnetic spectrum. Thus, a further extended functionality of the biometric sensor permits it to function as an alcohol monitor. In other embodiments, the levels of other toxins and/or drugs may be similarly monitored.
While the above examples have focused on uses that correspond to identifying conditions in humans, it will be appreciated that similar spectroscopic information permits the extended functionality also to be used for veterinary purposes. Moreover, spectroscopic information may also be used in quantifying the quality of plant tissues. For example, in one embodiment, the extended functionality comprises use as a fruit-ripeness monitor. Color changes are a natural part of the ripening process for fruit, and these changes may be detected using the methods described above. Accordingly, a portable electronic device that includes a sensor of the type described above may conveniently be used to test the ripeness of fruit.
Spectroscopic information is also of use in characterizing inorganic materials. Thus, in another embodiment, the device may be used for matching the colors of paints, textiles, and other materials. Such information can be used, for example, to match colors of paint and other coatings, or to determine complimentary colors of textiles, clothing, etc. As a further example, ink colors used in documents such as currency and other government documents may be quantified. Comparison of measured spectra for such documents with stored spectral characteristics of approved inks permits the identification of counterfeit documents. Thus, a portable electronic device that includes a sensor of the type described above may be provided with extended functionality as a counterfeit-currency detector.
b. Combined Illumination and Detection Components
In other embodiments, additional extended functionality is provided by using combined illumination and detection capabilities of the biometric sensor. For example, in one embodiment, the device is used as a smart optical switch. In such an embodiment, the ability of the device to identify the liveness of tissue, as described above, is used so that an electronic device is turned on only when touched by living tissue, usually the finger of a person. Such functionality is particularly useful in the context of portable electronic devices, which are often left in purses, briefcases, pockets or other places where they may be activated inadvertently, possibly wasting significant battery life. Such inadvertent activation is avoided by the ability to confirm liveness of an object that touches the switch. As well, the smart switch functionality is applicable to power tools, manufacturing equipment, industrial machinery, and other potentially dangerous environments and conditions. In each of these cases, a smart switch can be used to ensure that the tool, piece of equipment, manufacturing station, etc. was turned on intentionally by a human hand or hands rather than by an accidental touch of an inanimate object. In cases where the smart switch functionality is the sole functionality required of the device, the configuration of the device can be simplified relative to a biometric sensor. More generally, however, the multifunction capabilities, including the smart optical switch, may be included with any implementation of the biometric sensor.
The optical switch may also be configured with trinary functionality in some embodiments. Such functionality may respond to different pressure levels with which a finger presses the optical switch. Such differences in pressure levels affect the optical properties of skin through a variety of physiological phenomena including changes in local tissue perfusion, changes in water volume, and other changes in the optical scattering and absorbance properties of the tissue that are close to the area in contact with the sensor. In general, these changes in the optical properties of the tissue are related to the pressure between the tissue and the sensor, and thereby the pressure can be ascertained optically. Thus, in one embodiment, the trinary functionality corresponds to the three states where (1) the switch is untouched, (2) the switch is touched lightly, and (3) the switch is touched firmly. Still more levels of functionality may be provided, such as where a fourth level corresponds to where the switch is touched with intermediate firmness. In principle, arbitrarily many levels of functionality may be included, although it is generally more difficult for an individual to discriminate levels of firmness if there are more than three or four levels. Since no moving parts are provided for the optical switch, there is no danger that mechanical parts will break or wear. In addition, the absence of mechanical parts makes the switch especially suitable for use with hermetically sealed packages where contamination by air and/or water is to be avoided.
In a further embodiment, the illumination and detection capabilities provided by the biometric sensor are combined to provide an ambient light sensor. In one such embodiment, the level of backlighting on a portable electronic device is adjusted in response to the ambient level of light in order to conserve battery life. For example, the backlight may be increased when the light level is low, such as in a dark room or at night, and decreased when the light level is high, such as during daytime.
In a specific embodiment, the device is configured to discriminate between darkness where the portable electronic device may be used, such as in a dark room or at night, and darkness where the portable electronic device is being stored, such as in a purse or briefcase. These different positions are distinguished by using a reflectance burst when darkness is identified. In a relatively small enclosed space, light is reflected back and detected by the light detector; in such cases, the backlighting is kept very low. In a larger space, such as a room or outdoors, the burst light is not reflected back to the device; accordingly, the backlighting is increased. Alternatively, the ambient sensing capability can be combined with a liveness sensing capability to sense the ambient light level only during or after the sensor has been activated by a genuine sample.
In another embodiment, the combined illumination and detection capabilities are used to provide extended functionality as a bar-code scanner. The bar code scanning capabilities are provided by using the light source to illuminate a bar code and by analyzing the spectrum received by the light detector to deduce the bar code. Such functionality may be used in numerous varied applications, some of which are indicated explicitly herein. For example, in one embodiment, the bar code scanning capability is used to provide an information service. For example, when the sensor is comprised by a portable electronic device that is equipped to access the Internet, scanning of a bar code causes the device to retrieve corresponding information from the Internet and to display the retrieved information on the portable electronic device. Alternatively, certain information may be retrieved directly from a storage device resident on the portable electronic device.
These capabilities permit a user to obtain product information quickly. In some instances, the request for information initiated by the scanning function is additionally recorded for marketing purposes. In particular, the scanning request, coupled with the biometric identification functions of the sensor provide information identifying a person and the type of information being requested. In some cases, this may also be coupled with location information, such as where the portable electronic device includes a GPS transponder. As information requests are made by the user, they may be compiled and subsequently analyzed for directed marketing.
In a particular embodiment, such directed marketing may be substantially contemporaneous with the scanning request. For example, a consumer may be shopping in a grocery store and is trying to decide which of several similar products to purchase. By scanning them to obtain additional information, a remote system may be provided with sufficient information to recognize the consumer's interest. Accordingly, an electronic coupon for a particular one of the products may be immediately directed to the consumer's portable electronic device for immediate use.
Another capability of the bar-code-scanning functionality may be illustrated in the form of a grocery-list compiler. For example, when this capability is enabled in a particular portable electronic device, a simple scan of an item in a household can be made whenever that item is depleted. A record is stored of the fact that the item is now needed, and these records accumulate over time. When the individual is ready to shop for groceries, a simple command on the portable electronic device provides the accumulated shopping list to identify those items for purchase. In an alternative embodiment, items may be added to the list remotely when two portable electronic devices are equipped to communicate with each other. Such an embodiment is useful where a first person is already at the store shopping and a second individual identifies an additional item for purchase. The item is scanned at home and is immediately added to the list at the store.
A further extended functionality that uses the combined illumination and detection capabilities of the sensor permits it to be used as an optical communications port. In such embodiments, the light sources provide encoded optical signals for transmission over short-distance connections. Similarly, the light detectors receive the encoded optical signals from a similarly equipped device. Typical applications for this extended functionality are the ability to use a cellular telephone or PDA as a television remote control and to communicate reprogramming functions to device. In some instances, the light detectors may be configured to respond to certain wavelengths, enabling the implementation of high-bandwidth, full-duplex optical communication.
The functionality of the sensor may also be extended to provide various entertainment functions. For example, in some embodiments, it may be integrated as part of a game provided on a portable electronic device. One aspect of the sensor, in particular, that may be integrated into games is its multiplicity of distinct colors. There are numerous different games that may use such a color feature, one of which is a memory game that requires the player to repeat a color sequence, similar to the game “SIMON.” Another game that integrates the functionality of the sensor is an increasingly popular version of “phone tag,” in which participants use GPS systems to locate other participants on cellular telephones. Confirmation that a participant has been found may be confirmed by using the biometric sensor described herein. Another entertainment function may use the sensor as a mood meter, providing a description of an individuals mood based on a spectral analysis of her skin.
The functionality of the sensor may also be extended to provide personal-security functions. For example, if the biometric sensor is configured to operate at infrared wavelengths, it may not require actual physical contact in order to perform identifications, but may instead rely on reflected infrared light or even black-body emissions in the infrared region of the electromagnetic spectrum. A variation of this embodiment that provides personal security functions permits the biometric sensor to detect motion at infrared wavelengths. Such a function is useful, for example, for travelers. The motion detection may be integrated with an alarm function so that an alarm is sounded when motion is detected. If the sensor is comprised by a cellular telephone or other portable electronic device, it may alternatively be configured automatically to dial an emergency number.
Another variation of the remote security functionality is offered by configuring the biometric sensor to be sensitive to mid-infrared wavelengths. In this way emitted black-body radiation can be used as the illumination source and the biometric determination can be done remotely, without physically contacting the sensor. In cases where it is desirable to determine that something moved, it is possible to just monitor changes in the amount of reflected or emitted light over time. In other cases where it is important to ensure that the light passes through the skin before being detected (such as a biometric determination), it is also possible to configure a sensor with active illumination to operate remotely by ensuring that the illumination spot and the spot of skin being detected do not overlap. In this way, detected light is ensured to have traveled through the skin rather than simply reflected from the surface. Optical systems for performing such a remote measurement can be developed from lenses, mirrors or other optical elements as know to one of skill in the art.
A further example of a personal-security function that may be provided as part of the extended functionality is a smoke detector. Such a detector may emit light from the light source and be configured to detect light reflected from particles in air as would result from the presence of smoke in a room. Such a feature may also be integrated with an alarm function or with an automatic dial function to respond to presence of smoke.
An additional example of an extended functionality is provided by an optical-strobe function. This function may use the illumination components to produce strobed light and may provide a feedback function based on the detection of reflected light to tune the frequency of the strobe. Such tuning may be applied, for example, to tune strings on musical instruments, such as guitars.
c. Use of Illumination Component
In other embodiments of the invention, extended functionality is provided using only the illumination capabilities provided by the biometric sensor. A simple example that illustrates such extended functionality is a flashlight capability. This capability is achieved simply by activating the light source(s). In some instances, the light source(s) may be configured to be substantially monochromatic and/or to be highly directional, permitting operation as a laser pointer.
More complex extended functionality makes use of the different colors that are available with the light sources. For example, a cellular telephone may use the sensor as an optical ringer, which functions to alert the owner to an incoming call in addition to or instead of by issuing an audible noise. An optical ringer is especially useful in circumstances where an audible ring would be intrusive, such as in a meeting, or would be difficult to detect, such as in a noisy environment. An optical ringer may also be used by people having a hearing impairment, who may nevertheless use short message services (“SMS”) that are available for cellular telephones. The color capability is used in certain embodiments to identify the caller by correlating the originating telephone number with a predefined color. Also, in certain embodiments, particular optical-ring patterns may be downloadable.
According to embodiments of the invention, specific sequences of colors may also be presented with the sensor as a form of branding to identify a product or service source. For example, in response to identifying an individual, a distinct temporal sequence of colors may be presented with the light sources. If the sensor is comprised by a product, such as a portable electronic device, the temporal sequence may be associated with the manufacturer of the product. If the sensor is positioned for use as part of a security screening system, such as in an airport, the temporal sequence may be associated with a security company that manages the screening system.
While the use of a temporal sequence of colors may be implemented with one of the sensor arrangements described above, the invention is not limited to such an implementation. More generally, embodiments of the invention include the broad use of any temporal sequence of colors as an identifier of a product or service source. In some embodiments, such a temporal sequence of colors may additionally be coupled with a temporal sequence of sounds. The combination of the temporal sequences of colors and sounds effectively provides a brief musical light show that serves a branding function.
d. Use of Optical Detection Component
In addition to embodiments where the extended functionality of the biometric sensor is provided with only the illumination component, the extended functionality may also be provided with only the optical detection component of the sensor in other embodiments. In one such embodiment, the light detector comprised by the sensor is used as a light meter to quantify light levels. There are a number of applications for such a light meter that are within the scope of the invention, including use in photography applications, in opthalmology applications, and as a meter for quantifying sun exposure, among others.
The collection of light with the detector also provides a means for collecting a small amount of energy from impinging photons. In such embodiments, the detector effective functions as a trickle charger when it is not in active use for identification and verification functions. The available of such trickle charging is especially useful in applications where battery lifetime is a paramount concern, notably in portable electronic devices such as cellular telephones. When the biometric sensor is incorporated into such a portable electronic device, its impact on battery lifetime is substantially mitigated by the use of trickle charging to recover battery lifetime that might be used in operating the sensor.
Having described several embodiments, it will be recognized by those of skill in the art that various modifications, alternative constructions, and equivalents may be used without departing from the spirit of the invention. Accordingly, the above description should not be taken as limiting the scope of the invention, which is defined in the following claims.
This application is a nonprovisional of and claims the benefit of the filing date of each of the following provisional applications under 35 U.S.C. § 119(e): U.S. Prov. Pat. Appl. No. 60/403,453, entitled “BIOMETRIC ENROLLMENT SYSTEMS AND METHODS,” filed Aug. 13, 2002 by Robert K. Rowe et al.; U.S. Prov. Pat. Appl. No. 60/403,452, entitled “BIOMETRIC CALIBRATION AND DATA ACQUISITION SYSTEMS AND METHODS,” filed Aug. 13, 2002 by Robert K. Rowe et al.; U.S. Prov. Pat. Appl. No. 60/403,593, entitled “BIOMETRIC SENSORS ON PORTABLE ELECTRONIC DEVICES,” filed Aug. 13, 2002 by Robert K. Rowe et al.; U.S. Prov. Pat. Appl. No. 60/403,461, entitled “ULTRA-HIGH-SECURITY IDENTIFICATION SYSTEMS AND METHODS,” filed Aug. 13, 2002 by Robert K. Rowe et al.; U.S. Prov. Pat. Appl. No. 60/403,449, entitled “MULTIFUNCTION BIOMETRIC DEVICES,” filed Aug. 13, 2002 by Robert K. Rowe et al; and U.S. Prov. Pat. Appl. No. 60/460,247, entitled “NONINVASIVE ALCOHOL MONITOR,” filed Apr. 4, 2003 by Robert K. Rowe et al. The entire disclosure of each of these six provisional applications is incorporated herein by reference for all purposes.
Number | Name | Date | Kind |
---|---|---|---|
3508830 | Hopkins el al. | Apr 1970 | A |
3910701 | Henderson et al. | Oct 1975 | A |
RE29008 | Ott | Oct 1976 | E |
4035083 | Woodriff et al. | Jul 1977 | A |
4142797 | Astheimer | Mar 1979 | A |
4169676 | Kaiser | Oct 1979 | A |
4260220 | Whitehead | Apr 1981 | A |
4427889 | Muller | Jan 1984 | A |
4537484 | Fowler | Aug 1985 | A |
4598715 | Machler et al. | Jul 1986 | A |
4653880 | Sting et al. | Mar 1987 | A |
4654530 | Dybwad | Mar 1987 | A |
4655225 | Dahne et al. | Apr 1987 | A |
4656562 | Sugino | Apr 1987 | A |
4657397 | Oehler et al. | Apr 1987 | A |
4661706 | Messerschmidt et al. | Apr 1987 | A |
4684255 | Ford | Aug 1987 | A |
4712912 | Messerschmidt | Dec 1987 | A |
4730882 | Messerschmidt | Mar 1988 | A |
4787013 | Sugino et al. | Nov 1988 | A |
4787708 | Whitehead | Nov 1988 | A |
4830496 | Young | May 1989 | A |
4853542 | Milosevic et al. | Aug 1989 | A |
4857735 | Noller | Aug 1989 | A |
4859064 | Messerschmidt et al. | Aug 1989 | A |
4866644 | Shenk et al. | Sep 1989 | A |
4867557 | Takatani et al. | Sep 1989 | A |
4882492 | Schlager | Nov 1989 | A |
4883953 | Koashi et al. | Nov 1989 | A |
4936680 | Henkes et al. | Jun 1990 | A |
4944021 | Hoshino et al. | Jul 1990 | A |
4975561 | Robinson et al. | Dec 1990 | A |
5015100 | Doyle | May 1991 | A |
5019715 | Sting et al. | May 1991 | A |
5028787 | Rosenthal et al. | Jul 1991 | A |
5051602 | Sting et al. | Sep 1991 | A |
5068536 | Rosenthal | Nov 1991 | A |
5070874 | Barnes et al. | Dec 1991 | A |
5158082 | Jones | Oct 1992 | A |
5163094 | Prokoski et al. | Nov 1992 | A |
5178142 | Harjunmaa et al. | Jan 1993 | A |
5179951 | Knudson | Jan 1993 | A |
5204532 | Rosenthal | Apr 1993 | A |
5222495 | Clarke et al. | Jun 1993 | A |
5222496 | Clarke et al. | Jun 1993 | A |
5223715 | Taylor | Jun 1993 | A |
5225678 | Messerschmidt | Jul 1993 | A |
5230702 | Lindsay et al. | Jul 1993 | A |
5237178 | Rosenthal et al. | Aug 1993 | A |
5243546 | Maggard | Sep 1993 | A |
5257086 | Fateley et al. | Oct 1993 | A |
5267152 | Yang et al. | Nov 1993 | A |
5268749 | Weber et al. | Dec 1993 | A |
5291560 | Daugman | Mar 1994 | A |
5299570 | Hatschek | Apr 1994 | A |
5303026 | Strobl et al. | Apr 1994 | A |
5311021 | Messerschmidt | May 1994 | A |
5313941 | Braig et al. | May 1994 | A |
5321265 | Block | Jun 1994 | A |
5331958 | Oppenheimer | Jul 1994 | A |
5348003 | Caro | Sep 1994 | A |
5351686 | Steuer et al. | Oct 1994 | A |
5355880 | Thomas et al. | Oct 1994 | A |
5360004 | Purdy et al. | Nov 1994 | A |
5361758 | Hall et al. | Nov 1994 | A |
5366903 | Lundsgaard et al. | Nov 1994 | A |
5372135 | Mendelson et al. | Dec 1994 | A |
5379764 | Barnes et al. | Jan 1995 | A |
5402778 | Chance | Apr 1995 | A |
5405315 | Khuri et al. | Apr 1995 | A |
5419321 | Evans | May 1995 | A |
5435309 | Thomas et al. | Jul 1995 | A |
5441053 | Lodder et al. | Aug 1995 | A |
5452723 | Wu et al. | Sep 1995 | A |
5459317 | Small et al. | Oct 1995 | A |
5459677 | Kowalski et al. | Oct 1995 | A |
5460177 | Purdy et al. | Oct 1995 | A |
5483335 | Tobias | Jan 1996 | A |
5494032 | Robinson et al. | Feb 1996 | A |
5505726 | Meserol | Apr 1996 | A |
5507723 | Keshaviah | Apr 1996 | A |
5515847 | Braig et al. | May 1996 | A |
5518623 | Keshaviah et al. | May 1996 | A |
5523054 | Switalski et al. | Jun 1996 | A |
5533509 | Koashi et al. | Jul 1996 | A |
5537208 | Bertram et al. | Jul 1996 | A |
5539207 | Wong et al. | Jul 1996 | A |
5552997 | Massart | Sep 1996 | A |
5559504 | Itsumi et al. | Sep 1996 | A |
5596992 | Haaland et al. | Jan 1997 | A |
5606164 | Price et al. | Feb 1997 | A |
5630413 | Thomas et al. | May 1997 | A |
5636633 | Messerschmidt et al. | Jun 1997 | A |
5655530 | Messerschmidt | Aug 1997 | A |
5672864 | Kaplan | Sep 1997 | A |
5672875 | Block et al. | Sep 1997 | A |
5677762 | Ortyn et al. | Oct 1997 | A |
5681273 | Brown | Oct 1997 | A |
5708593 | Saby et al. | Jan 1998 | A |
5719399 | Alfano et al. | Feb 1998 | A |
5719950 | Osten et al. | Feb 1998 | A |
5724268 | Sodickson et al. | Mar 1998 | A |
5737439 | Lapsley et al. | Apr 1998 | A |
5743262 | Lepper, Jr. et al. | Apr 1998 | A |
5747806 | Khalil | May 1998 | A |
5750994 | Schlager | May 1998 | A |
5751835 | Topping et al. | May 1998 | A |
5761330 | Stolanov et al. | Jun 1998 | A |
5782755 | Chance et al. | Jul 1998 | A |
5792050 | Alam et al. | Aug 1998 | A |
5792053 | Skladnev et al. | Aug 1998 | A |
5793881 | Stiver et al. | Aug 1998 | A |
5796858 | Zhou et al. | Aug 1998 | A |
5808739 | Turner et al. | Sep 1998 | A |
5818048 | Sodickson et al. | Oct 1998 | A |
5823951 | Messerschmidt et al. | Oct 1998 | A |
5828066 | Messerschmidt | Oct 1998 | A |
5830132 | Robinson | Nov 1998 | A |
5830133 | Osten et al. | Nov 1998 | A |
5850623 | Carman, Jr. et al. | Dec 1998 | A |
5853370 | Chance et al. | Dec 1998 | A |
5857462 | Thomas et al. | Jan 1999 | A |
5860421 | Eppstein et al. | Jan 1999 | A |
5867265 | Thomas | Feb 1999 | A |
5886347 | Inoue et al. | Mar 1999 | A |
5902033 | Levis et al. | May 1999 | A |
5914780 | Turner et al. | Jun 1999 | A |
5929443 | Alfano et al. | Jul 1999 | A |
5933792 | Andersen et al. | Aug 1999 | A |
5935062 | Messerschmidt et al. | Aug 1999 | A |
5945676 | Khalil | Aug 1999 | A |
5949543 | Bleier et al. | Sep 1999 | A |
5957841 | Maruo et al. | Sep 1999 | A |
5961449 | Toida et al. | Oct 1999 | A |
5963319 | Jarvis et al. | Oct 1999 | A |
5987346 | Benaron et al. | Nov 1999 | A |
5999637 | Toyoda et al. | Dec 1999 | A |
6005722 | Butterworth et al. | Dec 1999 | A |
6016435 | Maruo et al. | Jan 2000 | A |
6025597 | Sterling et al. | Feb 2000 | A |
6026314 | Amerov et al. | Feb 2000 | A |
6028773 | Hundt | Feb 2000 | A |
6031609 | Funk et al. | Feb 2000 | A |
6034370 | Messerschmidt | Mar 2000 | A |
6040578 | Malin et al. | Mar 2000 | A |
6041247 | Weckstrom et al. | Mar 2000 | A |
6041410 | Hsu et al. | Mar 2000 | A |
6043492 | Lee et al. | Mar 2000 | A |
6044285 | Chaiken et al. | Mar 2000 | A |
6045502 | Eppstein et al. | Apr 2000 | A |
6046808 | Fately | Apr 2000 | A |
6049727 | Crothall | Apr 2000 | A |
6056738 | Marchitto et al. | May 2000 | A |
6057925 | Anthon | May 2000 | A |
6061581 | Alam et al. | May 2000 | A |
6061582 | Small et al. | May 2000 | A |
6066847 | Rosenthal | May 2000 | A |
6069689 | Zeng et al. | May 2000 | A |
6070093 | Oosta et al. | May 2000 | A |
6073037 | Alam et al. | Jun 2000 | A |
6088605 | Griffith et al. | Jul 2000 | A |
6088607 | Diab et al. | Jul 2000 | A |
6097035 | Belongie et al. | Aug 2000 | A |
6100811 | Hsu et al. | Aug 2000 | A |
6115484 | Bowker et al. | Sep 2000 | A |
6115673 | Malin et al. | Sep 2000 | A |
6122042 | Wunderman et al. | Sep 2000 | A |
6122394 | Neukermans et al. | Sep 2000 | A |
6122737 | Bjorn et al. | Sep 2000 | A |
6125192 | Bjorn et al. | Sep 2000 | A |
6141101 | Bleier et al. | Oct 2000 | A |
6147749 | Kubo et al. | Nov 2000 | A |
6148094 | Kinsella | Nov 2000 | A |
6152876 | Robinson et al. | Nov 2000 | A |
6154658 | Caci | Nov 2000 | A |
6157041 | Thomas et al. | Dec 2000 | A |
6159147 | Lichter et al. | Dec 2000 | A |
6172743 | Kley et al. | Jan 2001 | B1 |
6175407 | Sartor | Jan 2001 | B1 |
6181414 | Raz et al. | Jan 2001 | B1 |
6181958 | Steuer et al. | Jan 2001 | B1 |
6188781 | Brownlee | Feb 2001 | B1 |
6212424 | Robinson | Apr 2001 | B1 |
6226541 | Eppstein et al. | May 2001 | B1 |
6229908 | Edmonds et al. | May 2001 | B1 |
6230034 | Messerschmidt et al. | May 2001 | B1 |
6230126 | Kuroda | May 2001 | B1 |
6240306 | Rohrscheib et al. | May 2001 | B1 |
6240309 | Yamashita et al. | May 2001 | B1 |
6241663 | Wu et al. | Jun 2001 | B1 |
6256523 | Diab et al. | Jul 2001 | B1 |
6272367 | Chance | Aug 2001 | B1 |
6280381 | Malin et al. | Aug 2001 | B1 |
6282303 | Brownlee | Aug 2001 | B1 |
6285895 | Ristolainen et al. | Sep 2001 | B1 |
6292576 | Brownlee | Sep 2001 | B1 |
6301815 | Sliwa | Oct 2001 | B1 |
6304767 | Soller et al. | Oct 2001 | B1 |
6307633 | Mandella et al. | Oct 2001 | B1 |
6309884 | Cooper et al. | Oct 2001 | B1 |
6317507 | Dolfing et al. | Nov 2001 | B1 |
6324310 | Brownlee | Nov 2001 | B1 |
6330346 | Peterson et al. | Dec 2001 | B1 |
6404904 | Einighammer et al. | Jun 2002 | B1 |
6419361 | Cabib et al. | Jul 2002 | B2 |
6483929 | Murakami et al. | Nov 2002 | B1 |
6504614 | Messerschmidt et al. | Jan 2003 | B1 |
6560352 | Rowe et al. | May 2003 | B2 |
6574490 | Abbink et al. | Jun 2003 | B2 |
6628809 | Rowe et al. | Sep 2003 | B1 |
6668071 | Minkin et al. | Dec 2003 | B1 |
6741729 | Bjorn et al. | May 2004 | B2 |
6799275 | Bjorn | Sep 2004 | B1 |
6813010 | Kono et al. | Nov 2004 | B2 |
6816605 | Rowe et al. | Nov 2004 | B2 |
6829375 | Higuchi | Dec 2004 | B1 |
20020101566 | Elsner et al. | Aug 2002 | A1 |
20020145507 | Foster | Oct 2002 | A1 |
20020171834 | Rowe et al. | Nov 2002 | A1 |
20020183624 | Rowe et al. | Dec 2002 | A1 |
20030016345 | Nagasaka et al. | Jan 2003 | A1 |
20030078504 | Rowe et al. | Apr 2003 | A1 |
20030095525 | Lavin et al. | May 2003 | A1 |
20040047493 | Rowe et al. | Mar 2004 | A1 |
20040240712 | Rowe et al. | Dec 2004 | A1 |
20050007582 | Villers et al. | Jan 2005 | A1 |
20050205667 | Rowe | Sep 2005 | A1 |
20060002597 | Rowe | Jan 2006 | A1 |
20060002598 | Rowe et al. | Jan 2006 | A1 |
Number | Date | Country |
---|---|---|
0 280 418 | Aug 1988 | EP |
0 426 358 | May 1991 | EP |
0 449 335 | Oct 1991 | EP |
0 573 137 | Dec 1993 | EP |
0 631 137 | Dec 1994 | EP |
0 670 143 | Sep 1995 | EP |
0 681 166 | Nov 1995 | EP |
0 757 243 | Feb 1997 | EP |
0 788 000 | Aug 1997 | EP |
0 801 297 | Oct 1997 | EP |
0 836 083 | Apr 1998 | EP |
0 843 986 | May 1998 | EP |
0 869 348 | Oct 1998 | EP |
0 897 164 | Feb 1999 | EP |
0 897 691 | Feb 1999 | EP |
0 317 121 | May 1999 | EP |
0 924 656 | Jun 1999 | EP |
0 982 583 | Mar 2000 | EP |
0 990 945 | Apr 2000 | EP |
WO 9200513 | Jan 1992 | WO |
WO 9217765 | Oct 1992 | WO |
WO 9300855 | Jan 1993 | WO |
WO 9307801 | Apr 1993 | WO |
WO 9522046 | Aug 1995 | WO |
WO 9723159 | Jul 1997 | WO |
WO 9727800 | Aug 1997 | WO |
WO 9728437 | Aug 1997 | WO |
WO 9728438 | Aug 1997 | WO |
WO 9801071 | Jan 1998 | WO |
WO 9837805 | Sep 1998 | WO |
WO 9840723 | Sep 1998 | WO |
WO 9909395 | Feb 1999 | WO |
WO 0115596 | Mar 1999 | WO |
WO 9937203 | Jul 1999 | WO |
WO 9943255 | Sep 1999 | WO |
WO 9946731 | Sep 1999 | WO |
WO 9955222 | Nov 1999 | WO |
WO 9956616 | Nov 1999 | WO |
WO 0118332 | Mar 2001 | WO |
WO 0127882 | Apr 2001 | WO |
WO 0152180 | Jul 2001 | WO |
WO 0152726 | Jul 2001 | WO |
WO 0153805 | Jul 2001 | WO |
WO 02084605 | Oct 2002 | WO |
WO 02099393 | Dec 2002 | WO |
WO 2004068388 | Aug 2004 | WO |
WO 2004068394 | Aug 2004 | WO |
Number | Date | Country | |
---|---|---|---|
60460247 | Apr 2003 | US | |
60403453 | Aug 2002 | US | |
60403452 | Aug 2002 | US | |
60403593 | Aug 2002 | US | |
60403461 | Aug 2002 | US | |
60403449 | Aug 2002 | US |