The present invention relates to the field of electronics, and, more particularly, to the field of optical image sensors and related methods.
Fingerprint sensing and matching is a reliable and widely used technique for personal identification or verification. In particular, a common approach to fingerprint identification involves scanning a sample fingerprint or an image thereof and storing the image and/or unique characteristics of the fingerprint image. The characteristics of a sample fingerprint may be compared to information for reference fingerprints already in a database to determine proper identification of a person, such as for verification purposes.
A fingerprint sensor may be particularly advantageous for verification and/or authentication in an electronic device, and more particularly, a portable device, for example. Such a fingerprint sensor may be carried by the housing of a portable electronic device, for example, and may be sized to sense a fingerprint from a single-finger.
Where a fingerprint sensor is integrated into an electronic device or host device, for example, as noted above, it may be desirable to more quickly perform authentication. Authentication may be delayed by other tasks or applications being performed on the electronic device, or by electronic device background processes.
An electronic device may include a dielectric cover layer defining a finger sensing surface and at least one optical image sensor below the dielectric cover layer. The electronic device may also include at least one optical element associated with the at least one optical image sensor and a plurality of light sources below the dielectric cover layer. A controller may be configured to sequentially operate respective adjacent subsets of light sources while acquiring biometric image data from the at least one optical image sensor.
The at least one optical element may include at least one pin-hole mask, for example. The at least one optical element may include at least one microlens, for example.
The plurality of light sources may include a plurality of dedicated illumination pixels. The plurality of light sources may include a plurality of display pixels, for example.
The controller may be configured to sequentially operate respective adjacent subsets of light sources in a first pass in a first direction, and in a second pass in a second direction transverse to the first direction. The first and second directions may be perpendicular, for example.
The controller may be configured to acquire the biometric image data as a respective biometric image associated with each operation of the subsets of light sources. The controller may be configured to sequentially operate respective adjacent subsets of light sources so that each subset of light sources has a same shape, for example.
The controller may be configured to sequentially operate respective adjacent subsets of light sources so that at least one subset of pixels has a different shape than a shape of at least one other subset of light sources. The controller may be configured to select the different shapes based upon the biometric image data, for example. The plurality of light sources may include a plurality of light emitting diodes (LEDs), for example.
A method aspect is directed to a method of acquiring biometric image data in an electronic device that includes a dielectric cover layer defining a finger sensing surface, at least one optical image sensor below the dielectric cover layer, at least one optical element associated with the at least one optical image sensor, and a plurality of light sources below the dielectric cover layer and selectively operable in subsets of light sources. The method may include using a controller to sequentially operate respective adjacent subsets of light sources while acquiring the biometric image data from the optical image sensor.
The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like numbers refer to like elements throughout, and prime and multiple prime notation and numbers in increments of 1000 are used to indicate similar elements in alternative embodiments.
Referring initially to
A display 1023 is also carried by the portable housing 1021 and is coupled to the controller 1022. The display 1023 may be a light emitting diode (LED) display, for example, and may have additional circuitry to provide touch display features, as will be appreciated by those skilled in the art. Further details of the display 1023 are described below.
The wireless communications circuitry 1025 is also carried within the housing 1021 and coupled to the controller 1022. The wireless communications circuitry 1025 cooperates with the controller 1022 to perform at least one wireless communications function, for example, for voice and/or data. In some embodiments, the electronic device 1020 may not include a wireless transceiver 1025 or other wireless communications circuitry.
A memory 1026 is also coupled to the controller 1022. The memory 1026 is for storing biometric template data, for example. The memory 1026 may store other or additional types of data.
As will be appreciated by those skilled in the art, if the display 1023 is in the form of a touch display, the touch display may operate as both an input device and a display. As such, the display 1023 would cooperate with the controller 1022 to perform one or more device functions in response to input. For example, a device function may include a powering on or off of the electronic device 1020, initiating communication via the wireless transceiver 1025, and/or performing a menu function based upon input to the touch display.
The controller 1022 may change the display 1023 to show a menu of available applications based upon pressing or input to the touch display. Of course, other device functions may be performed based upon input to the touch display 1023. Other or additional finger-operated user input devices may be carried by the portable housing 1021, for example, a pushbutton switch 1024, which may alternatively or additionally be used for device functions as will be appreciated by those skilled in the art.
An optical image sensor 1031 is carried by the housing 1021 under the display 1023. The optical image sensor senses biometric image data associated with a user, such as, for example, data representative of a biometric image of the fingerprint patterns of the user's finger 1040. The controller 1022 may perform an authentication function by matching the acquired biometric image data to the stored biometric template data stored in the memory 1026, for example. The controller 1022 may perform and/or restrict functionality of the electronic device 1020 based upon the authentication as will be appreciated by those skilled in the art. In some embodiments, there may be more than one optical image sensor 1031.
An optical element illustratively in the form of a pin-hole mask 1050 is associated with the optical image sensor 1031, for example, spaced from the optical image sensor by a substrate 1032. While a pin-hole mask is described in the present embodiment, as will be appreciated by those skilled in the art, and described in further detail below, the optical element 1050 may be another type of optical element and configured differently with the optical image sensor 1031 and other elements (e.g., co-planar).
The pin-hole mask 1050 may be an opaque mask and has a plurality of spaced apart openings 1051 or pin-holes therein to permit the passage of light therethrough. The pin-hole mask 1050 is opaque, and thus does not permit light to pass through. The pin-hole mask 1050 may include chromium, for example, a layer of chromium, to provide the opacity. Of course, other materials, may be used to provide opacity.
Light sources 1038 are carried by or within a display layer 1036, which may be part of the display 1023. The pixel display layer 1036 is above the pin-hole mask 1050. The light sources 1038 may be in the form of pixels, for example, display pixels 1039a arranged in an array and spaced apart for displaying images. In particular, the pixel display layer 1036 may be part of a light-emitting diode (LED) display and include LEDs, for example, organic LEDs (OLEDs). The space between the display pixels 1039a may be aligned with the openings 1051 or pin-holes. It should be appreciated by those skilled in the art that the pin-hole mask 1050 may be part of the display 1023 along with the pixel display layer 1036. In some embodiments, the light sources 1038 may be dedicated illumination pixels 1039b that may not be display pixels, but instead be dedicated to illumination for the optical image sensor 1031 (i.e., a separate or external light source). Of course, the pixels 1038 may include a combination of display pixels 1039a and dedicated illumination pixels 1039b.
A dielectric cover layer 1044 is over the pixel display layer 1036. The dielectric cover layer 1044 may be optically transparent and has an upper surface that defines a finger placement or sensing surface to receive the user's finger 1040 adjacent thereto.
Further details of the operation of the controller with respect to the light sources 1038 will now be described. As will be appreciated by those skilled in the art, to obtain or extract relevant information from acquired biometric image data, for example, three-dimensional graphic information from the user's finger 1040, illumination patterns may be used. Different illumination patterns may focus or highlight certain features of the user's finger 1040 from the acquired biometric image data. Accordingly, referring to
Referring additionally to
The controller 1022 may also sequentially operate respective adjacent subsets of light sources 1038 so that each subset of light sources has a same shape. More particularly, with respect to the example above, if a subset of light sources in a first iteration of the sequence has a rectangular shape, then the remaining iterations in the sequence or pass also have the same rectangular shape.
In other embodiments, the controller 1022 may sequentially operate respective adjacent subsets of light sources so that at least one subset of light sources 1038 has a different shape than a shape of at least one other subset of pixels. For example, if a subset of light sources in a first iteration of the sequence has a specific rectangular shape, then one or more of the remaining iterations in the sequence or pass may have a different shape. The different shapes may be selected by the controller 1022 based upon the biometric image data. For example, the shape of the subset of light sources 1038 for a current iteration in the sequence may be based upon the biometric image data acquired during a previous iteration. Accordingly, the illumination pattern may be considered dynamic.
Referring now additionally to
Referring now to
Referring now to
The table below illustrates the relative benefits of using the various types of reflection data:
Referring now to
By sequentially operating respective adjacent subsets of light sources 1038′ while acquiring biometric image data (i.e., patterned illumination) and using a collimation layer 1050′, reflection from valley walls 1086′ can be seen if the illumination angle is perpendicular to the ridge flow (
Various arrangements of the optical image sensor, light sources and optical element for use with the controller 1022 will now be described. Referring now additionally to
LEDs 2044 are carried by the interconnect layer 2042 laterally adjacent the LED controller circuitry 2043. The LEDs 2044 direct light to a dielectric cover layer 2047 above the substrate 2040. The dielectric cover layer 2047, which may be optically transparent, defines a finger sensing surface that receives a user's finger 2028 adjacent thereto.
Optical image sensors 2031 are carried by the substrate 2040 below the dielectric cover layer 2047 and laterally adjacent the LEDs 2044 and LED controller circuitry 2043. Each optical image sensor 2031 illustratively includes a photodetector 2032, for example, a photodiode, and a pin-hole mask 2033 above the photodetector. More than one photodetector 2032 may be included in each optical image sensor 2031.
The pin-hole mask 2033 may be an opaque mask that includes at least one opening 2034 or pin-hole therein to permit the passage of light therethrough. The pin-hole mask 2033 may be opaque, and thus does not permit light to pass through. The pin-hole mask 2033 may include chromium, for example, a layer of chromium, to provide the opacity. Of course, other materials, may be used to provide opacity.
An optical element 2035, illustratively in the form of a microlens, is above the pin-hole mask 2033 and cooperates therewith to collimate light reflected from the dielectric cover layer 2047 to the photodetector 2032. The microlens 2035 may have a thickness of about 1 micron, for example. An optically transparent dielectric spacer 2036 is between the microlens 2035 and the pin-hole mask 2033.
An optically clear adhesive 2046 may be between the optical image sensors 2031 and the LEDs 2044. A polarizer layer 2045 is carried below the dielectric cover layer 2047, and more particularly, between the dielectric cover layer and the optical images sensors 2031 (i.e., above the optically clear adhesive 2046). Of course, other and/or additional layers may be included. The substrate 2040, the dielectric cover layer 2047, the LEDs 2044, the optical image sensors 2031, and the associated layers and components described above may be integrated into the display 2023. For example, the components described above may be part of the display.
Referring now to
As will be appreciated by those skilled in the art and with reference to the embodiments described above, the field of view 2038′ for each photodetector is limited to a relatively narrow angle by using the microlens 2035′ and the pin-hole mask 2033′ (regardless of the type of substrate). This may advantageously permit collimation of the field of view 2038′ such that each photodetector 2032′ is imaging the information or reflected light from on top of itself.
In some embodiments, as stackable organic layers, the OLEDs 2044′ may be operated as photodetectors. In other words, the OLEDs 2044′ may be used to direct light to the dielectric cover layer 2047′ and also to sense an optical image. However, in this embodiment, it may be desirable to not use a microlens or pin-hole mask, but instead the deblurring circuitry.
Referring now to
Referring briefly to
The arrangement of the optical image sensors 2031 and the LEDs 2044 may be particularly advantageous for multiple applications, for example, fingerprint sensing, optical touch sensing, and/or heart rate sensing (e.g., if the LEDs are infrared (IR), near infrared (NIR), and/or ambient light sensing (ALS). Additionally, the IR-cut filter can be below or on top of the optically transparent dielectric spacer 2036 to permit fingerprint sensing below direct sunlight, for example.
A method aspect is directed to a method of acquiring biometric image data in an electronic device 1020 that includes a dielectric cover layer 1044, at least one optical image sensor 1035, at least one optical element 1050 associated with the at least one optical image sensor, and a plurality of light sources 1038 below the dielectric cover layer and selectively operable in subsets of light sources. The method includes using a controller 1022 to sequentially operate respective adjacent subsets of light sources 1037a-1037e while acquiring the biometric image data from the optical image sensor 1031.
While a controller 1022 is described herein, it should be noted that the controller performing the functions described herein may be embodied as a single integrated circuit (IC) or multiple integrated circuits. In other words, while a controller 1022 has been described, it will be appreciated that certain respective functionality may be performed by physically separate circuits.
The benefits of biometric data collected by a device as disclosed herein include convenient access to device features without the use of passwords. In other examples, user biometric data is collected for providing users with feedback about their health or fitness levels. The present disclosure further contemplates other uses for personal information data, including biometric data, that benefit the user of such a device.
Practicing the present invention requires that collecting, transferring, storing, or analyzing user data, including personal information, will comply with established privacy policies and practices. In particular, such entities should implement and consistently use privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining personal information data private and secure, including the use of data encryption and security methods that meets or exceeds industry or government standards. Personal information from users should not be shared or sold outside of legitimate and reasonable uses. Further, such collection should occur only after receiving the informed consent of the users. Additionally, such entities would take any needed steps for safeguarding and securing access to such personal information data and ensuring that others with access to the personal information data adhere to their privacy policies and procedures. Further, such entities can subject themselves to evaluation by third parties to certify their adherence to widely accepted privacy policies and practices.
The present disclosure also contemplates the selective blocking of access to, or use of, personal information data, including biometric data. Hardware and/or software elements disclosed herein can be configured to prevent or block access to such personal information data. Optionally allowing users to bypass biometric authentication steps by providing secure information such as passwords, personal identification numbers (PINS), touch gestures, or other authentication methods, alone or in combination, is well known to those of skill in the art. Users can further select to remove, disable, or restrict access to certain health-related applications collecting users' personal health or fitness data.
Many modifications and other embodiments of the invention will come to the mind of one skilled in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is understood that the invention is not to be limited to the specific embodiments disclosed, and that modifications and embodiments are intended to be included within the scope of the appended claims.
Number | Name | Date | Kind |
---|---|---|---|
7735729 | Rowe | Jun 2010 | B2 |
20160041663 | Chen | Feb 2016 | A1 |
20160098614 | Yamanashi | Apr 2016 | A1 |
20160266695 | Bae | Sep 2016 | A1 |
20160283772 | Nelson | Sep 2016 | A1 |
20170220844 | Jones | Aug 2017 | A1 |
20180012069 | Chung | Jan 2018 | A1 |
20180196985 | Ling | Jul 2018 | A1 |
20190026522 | Wang | Jan 2019 | A1 |
Entry |
---|
Yeke Yazdandoost et al., U.S. Appl. No. 15/718,887, filed Sep. 28, 2017. |
Number | Date | Country | |
---|---|---|---|
20190095671 A1 | Mar 2019 | US |