Fingerprint sensors have been massively integrated in electronic devices with displays, such as smartphones, tablets, laptops, for privacy and data protection, as well as identity authentication. Today the most common fingerprint sensor is a capacitive sensor that works independent from the display of the device. The present move towards displays covering almost the entire front of the device makes it difficult to integrate the fingerprint sensor with the front surface because the capacitive sensors are not easily integrated with the electronics displays
Optical fingerprint sensors can be placed beneath the cover glass of the displays, because reflections from a finger can be scattered back through the cover glass and display to the fingerprint sensor. But in order to avoid a blurred image of the fingerprint, an optical fingerprint sensor typically needs to filter out large angle backscattered reflections from the finger before the light rays impinge the pixels of the sensor array.
Current filtering technologies provide light absorbing channels located between the display and the sensor arrays thereby functioning as collimators, see for example US 2017/270342 and US 2018/012069. In order to substantially filter out undesired background light, the thickness of the channels must be about 300 microns with a diameter of every channel of about 30 microns with about 50 microns ditch.
A problem with these absorbing channels is that a substantial part of the desired light is absorbed. And the current technology used for manufacturing the absorbing channels is expensive and does not provide high yield. One purpose of the present invention is therefore to provide an optical sensor solution for fingerprint detection that is cost-efficient and which can be integrated with a transparent display in an electronic device.
The present disclosure solves these problems by employing a microlens structure, comprising an array of microlenses, for focusing the desired light onto the pixels of a sensor array whereas undesired light is scattered or absorbed. The present disclosure therefore relates to an optical sensor, aka optical sensor system, for placement under a (transparent) display panel for detecting light returned from an object, such as a fingerprint, on top of the display panel. In a first embodiment the optical sensor comprises a microlens structure having a front side with an array of light focusing/image forming elements and an at least partially transparent back side. The back side may be provided with an array of optically transparent/light transmissive apertures, e.g. in the form of windows, aligned with the focusing elements. I.e. the focal point of each microlens is preferably located in the corresponding aperture. In the preferred embodiment it is only the apertures that are transparent whereas the remaining area of the back side is not light transmissive, e.g. opaque, i.e. light blocking, e.g. in the form of a light blocking layer, such that light cannot be transmitted through the opaque part of the back side. Blocking light transmission can be provided by different means known in the art, such as an absorbing/light blocking colouring/reflective material or a certain roughness of the surface.
A sensor array of optical detectors may be provided, the sensor array facing the back side of the microlens structure. I.e. as the focal point of each microlens is preferably located in the corresponding aperture, the optical sensor system is preferably configured such that light returned from the object can be focused by the microlens structure onto the sensor array through the transparent apertures.
The optical sensor is preferably configured such that fingerprint light with an incident angle of less than or equal to a predefined value is focused to the sensor array whereas fingerprint light with an incident angle of more said predefined value is not detected. The predefined value of the incident angle may for example be 20 degrees, or 15 degrees, preferably 10 degrees, more preferably 8 degrees, even more preferably 6 degrees, most preferably 5 degrees. Or even 4 degrees or 3 degrees in selected embodiments. The presently disclosed optical sensor may be configured to work with the display panel as the light source and/or with one more separate light sources.
The present disclosure further relates to an image recognition device, such as a fingerprint detector, comprising the presently disclosed optical sensor. The fingerprint sensor may comprise a processing unit for processing the signal from the sensor array in order to recognize an image, e.g. detect a fingerprint. The fingerprint sensor may further comprise a storage unit for storing fingerprint information, preferably in encrypted format. The processing unit, the storage unit and the sensor array may be part of one integrated circuit/component.
A further embodiment relates to an electronic device, such as smartphone, tablet, laptop, etc., for optically detecting a fingerprint, comprising a display panel comprising a top transparent layer formed over the display panel as an interface for being touched by a user, and optical sensor which is disclosed herein. The display panel may comprise light emitting display pixels, wherein each pixel is configured to emit light for forming a portion of a display image; and wherein the top transparent layer is configured for transmitting the light from the display panel to display images.
The present disclosure further relates to a method for detecting light returned from a fingerprint on top of a transparent display panel, comprising the steps of focusing and imaging fingerprint light to a sensor array of optical detectors by means of microlenses arranged in a microlens structure located below the display panel, wherein the fingerprint light, i.e. light returned from an object, is received within a predefined incident angle as described above.
The present disclosure further relates to a method for fabrication of a microlens structure having aligned apertures that is suitable for use in the presently disclosed optical sensor system. The fabrication method is in a preferred embodiment directed to the use of a photosensitive material that is applied to the backside of the microlens structure. The photosensitive material may be any material which changes its properties upon receiving light, and by applying light, e.g. collimated light, through the front side of the microlens structure, the optical properties of the microlens structure can ensure that the precisely aligned transparent apertures are created in the photosensitive material on the backside of the microlens structure, thereby resulting in a precise but cost-efficient manufacturing of the microlens structure with transparent apertures in the backside.
The accompanying drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.
A major advantage of the present invention is that the microlens structure can focus the desired light such that the desired light within the predefined incident angle can be imaged to pixels on a sensor array. Compared to prior art solutions this means that more of the desired light is detected, i.e. the present microlens structure has a higher transmittance of the desired light. With more light to the detector a fingerprint can be detected faster and/or more precisely.
With the present microlens structure it is also possible to focus the light such that only part of the pixels, for example in a standard CCD or CMOS array, is used for detection, possibly only one third of the pixels. This makes it possible to use a sensor array with much fewer pixels which will be much faster to read, i.e. the fingerprint sensor can detect a fingerprint faster. The pixel could be a pixel of a CCD (Charge Coupled device), CMOS (Complementary Metal Oxide Semiconductor) or a photodiode.
Another advantage is that the presently disclosed structure can be made very compact. The prior art solutions need a certain height of the absorbing channels in order to function properly. The absorbing channels typically have a height of 300-500 μm, whereas the present microlens structure can be made with a height of only 50-100 μm. This fits much better with the current trend of making electronic display devices thinner and thinner.
Each focusing element of the microlens structure can be customized to a certain optical design and configuration. The focusing elements can be spherical, aspherical, pyramid-shaped, convex, concave, etc. The design depends on the medium surrounding the microlens. For example, if the interface is air the focusing element would typically be spherical. If the interface is glue, the focusing elements would typically be aspherical. The back side can be plane but could also be designed to help with focusing of the light, back focal length adjustment, aberration correction, etc. E.g. spherical, aspherical, pyramid-shaped, convex, concave, etc.
In order to reduce cost the present microlens structure can be manufactured such that all focusing elements are identical.
As stated previously the microlens structure may comprise a back side where through fingerprint light can be transmitted. In a preferred embodiment it is not the entire back side of the microlens array that is transparent but only transparent apertures, such as an array of transparent apertures, that correspond to the array of focusing element. The remaining part of the back side can be made opaque. The transparent apertures are exemplified in
In the preferred embodiment of the presently disclosed optical sensor is configured such that fingerprint light is focused and imaged to the sensor array. I.e. each microlens may be configured to focus and/or image fingerprint light to a corresponding pixel on the sensor array. Hence, the microlens structure may be configured such that each focusing element is capable of converging fingerprint light through a corresponding transparent aperture of the back side of the microlens structure. Focusing may for example be provided by providing at least a part of or all of the focusing elements with a spherical surface.
In the preferred embodiment there is no interface between the individual microlens elements in the microlens structure, the bulk inside the microlens is preferably a solid uniform block of a transparent material. The optical properties of the presently disclosed optical sensor could be improved if the side surfaces, i.e. the surfaces connecting the front and back sides, of each individual microlens element were opaque such that undesired light could be absorbed by the side surfaces. However, that would make the microlens structure much more complicated and expensive to manufacture. Instead the optical properties can be controlled by the apertures which can be cost-efficiently designed and manufactured.
A stated previously the sensor array may be a standard CCD sensor array. However, as typically only between ¼ and ½, possibly even between 1/10 and ½, of the pixels in a standard sensor are actually used in this setup, the sensor array used herein may be configured to comprise only one pixel for each microlens. Fewer pixels make read-out of the sensor array much faster, such that a fingerprint detector can be more efficient.
The presently disclosed optical sensor is typically optically designed to match a predefined display panel where the distance from the touch surface to the microlens structure provides an optical constraint for the design of the microlens structure and the sensor array. With a standard off-the-shelf sensor array the pixel size is predefined which provides another optical constraint. With a customized sensor array the pixel size can be part of the optical design space.
In a further embodiment the presently disclosed optical sensor comprises at least one optical filter. Such an optical filter may be a colour filter that can be configured to filter out light of a predefined wavelength range, such as undesired background light. A filter may also be configured such that only the wavelength range of the light source is allowed to pass. E.g. if an IR light source is use, the colour filter can be configured to transmit only IR light. An OLED display panel typically employs light with three different wavelength ranges. The colour filter can then be configured to transmit only one or two of these wavelength ranges. A filter may for example be provided between the backside of the microlens structure and the sensor array, e.g. just in front of the sensor array as exemplified in
The presently disclosed optical sensor may be configured to utilize light from a light emitting display panel, e.g. a display panel of an electronic device, e.g. by using the OLED light sources that typically are part of a display panel. However, an OLED typically illuminates light both upwards towards the display surface and downwards—towards the fingerprint sensor. Hence, this is not a preferred solution since it would be necessary to distinguish this downwards OLED light from the reflected light from the fingerprint. The preferred solution is therefore to provide at least one (separate) light source for transmitting light such that light is transmitted out from the touch surface where the fingerprints will be located. The light source(s) may advantageously be configured for emitting infrared light, such as around 700-900 nm or 800-900 nm, alternatively or additionally green light. However, other wavelength ranges are possible. The light source may at least one laser or LED which can be provided very cost efficiently and very compact. There are many solutions to integrate one or more light sources such that light is transmitted out from the touch surface. The drawings illustrate various examples. A preferred solution is four light sources distributed around the sensor array as exemplified in
In the preferred embodiment the microlens structure is manufactured in a polymeric material, such as PMMA or PC, preferably by injection moulding or film pressing. The microlens structures can be manufactured in large units, each unit comprising a plurality of microlens structures. The individual microlens structures for use in an optical sensor can then be provided by cutting the large units into smaller structures.
The transparent apertures can be provided by painting the back side of the microlens structure in an absorbing colour, preferably a dark colour such as black, except for the apertures thereby forming the transparent apertures. Painting can be provided by means of printing on the microlens structure, e.g. with the combination of a mask. The transparent apertures can be any geometric form, but a circular structure is the preferred for optical imaging reasons. The transparent apertures may advantageously have an area of less than 800 μm2, more preferably less than 400 μm2, more preferably less than 200 μm2, most preferably less than or around 100 μm2. I.e. the apertures may be cylindrical.
The transparent apertures can also be provided by making at least a part of the back side of the microlens structure at least partly reflective, such as fully reflective or partly reflective partly absorptive. This can be provided by attaching a reflective material to the back side of the microlens structure as exemplified in
In one embodiment of the present disclosure a reflective back side of the microlens structure is provided by means of a metal, such as a metal foil, such as an aluminium foil, which can be attached to the back side of the microlens structure. The transparent apertures can be provided by cutting and/or stamping holes in the metal foil such that correspondence is provided with the individual microlenses of the microlens structure.
In one embodiment of the presently disclosed optical sensor, the distance between the front side and the back side of the microlens structure is less than 400 μm, more preferably less than 300 μm, even more preferably less than 200 μm, yet more preferably less than 100 μm, even more preferably less than 75 μm, yet more preferably less than 60 μm, most preferably less than 55 μm. The focusing elements, i.e. the microlenses, of the microlens structure may have a diameter of less than 100 μm, more preferably less than 50 μm, even more preferably less than 30 μm, most preferably less than or around 25 μm. The individual focusing elements may be configured to have a back focal length of less than 30 μm, more preferably less than 20 μm, more preferably less than 15 μm, most preferably less than or approx. 10 μm. Hence, the footprint of the microlens structure in the plane of the sensor array may therefore be less than 400 mm2, more preferably less than 200 mm2, most preferably less than or around 100 mm2.
In one embodiment of the presently disclosed optical sensor, the sensor array is glued to the microlens structure. In order to further improve the optical properties of the presently disclosed optical sensor the sensor array may be spaced from the back side of the microlens structure, as also exemplified in many of the drawings. This spacing may be provided by means of glue. This attachment between microlens structure and sensor array may be provided such that the interface between microlens structure and sensor array is air or it may be a transparent glue. For example the sensor array is mounted with a predefined distance to the back side of the microlens structure, for example a predefined distance of between 5 and 30 μm, preferably between 10 and 15 μm. This distance typically corresponds to the back focal length of the focusing elements. This spacing ensures that part of undesired light which is transmitted through the transparent aperture, e.g. incoming light with an incident angle which is slightly higher than the predefined angle, does not hit the corresponding pixel.
The total height of the presently disclosed optical sensor may consequently be less than 500 μm, more preferably less than 300 μm, more preferably less than 200 μm, even more preferably less than 150 μm, most preferably less than 100 μm.
The optical sensor may substantially square or rectangular. However, a substantially elongated embodiment is also an option such that the sensor becomes a line scanner.
One embodiment relates to an optical sensor (system) for acquiring images comprising a microlens structure having a front side with an array of light focusing elements and a light blocking layer with an array of optically transparent apertures aligned with the focusing elements, and a sensor array of optical detectors disposed under the light blocking layer, wherein the microlens structure is configured to converge an optical signal from above the microlens structure to the apertures, the optical signal being transmitted to the sensor array via the apertures. The focus points of said microlens structure are preferably located within said apertures. The apertures may advantageously be cylindrical. Sizewise the number of microlenses in the microlens structure is preferably not less than 121.
Thickness of Aperture Array
In an additional embodiment of the present disclosure the apertures have a significant thickness along an axis perpendicular to the major plane of the apertures, such as at least 3 μm, more preferably at least 6 μm, even more preferably at least 9 μm, yet even more preferably at least 12 μm, most preferably at least 15 μm, in order to form elongated, e.g. cylindrical, apertures. The thickness of the elongated apertures of the microlens structure may have a significant impact on the ability of the apertures to filter out undesired light with large incident angles. The non light transmissive parts of the backside of the microlens structure, acting to form the apertures, may have a similar thickness as the light transmissive/optically transparent apertures. Alternatively, the opaque, non light transmissive, parts may be applied in a substantially three-dimensional configuration for formation of elongated apertures having a substantial thickness along an axis perpendicular to the sensor array, such as at least 3 μm, more preferably at least 6 μm, even more preferably at least 9 μm, yet even more preferably at least 12 μm, most preferably at least 15 μm. A larger thickness of the elongated apertures may decrease the incident angle at which light can pass the aperture without being blocked/absorbed by the non light transmissive parts, e.g. opaque paint. Having a significant thickness of the elongated apertures, such as at least 3 μm, more preferably at least 6 μm, even more preferably at least 9 μm, yet even more preferably at least 12 μm, most preferably at least 15 μm, may lead to the negating of the need for a space between the apertures and the sensor array. Such that fingerprint light with a large incident angle may be blocked or absorbed by the aperture. Elongated apertures are exemplified in
Spacing Between Microlenses, Apertures and Sensor Array
In an additional embodiment of the present disclosure means for electrically insulating the sensor array from the aperture array are provided. Insulating means may comprise the use of a layer between the sensor array and the aperture array, wherein the layer may consist of a gap, such as an air gap, or by a material which is substantially an insulator. By the incorporation of an insulating layer, the aperture array of the microlens structure may be fabricated in a conductive material facing the sensor array containing the photoelectric pixels, without risking that the arrangement leads to a distorted output signal of the sensor array, such as comprising an increase in noise, or even short-circuit of the assembly. Preferably, the apertures comprise one optical filter, or multiple optical filters, such as one for each microlens, that is configured to filter out light of a predefined wavelength range, such as undesired background light. The filter may also be configured such that only the wavelength range of the light source is allowed to pass. The filter may be provided in the same layer as the apertures of the microlens structure. The filter layer may further comprise a single filter for each microlens, such that each filter is surrounded by the non light transmissive paint. In this way, the light filter may constitute, or form part of, the aperture. For example, each aperture of the microlens structure may comprise a filter.
In an additional embodiment, the aperture array may be in contact with the sensor array, but may in another embodiment be positioned adjacent, with a gap, to the sensor array. The absence of space between parts of the sensor arrangement may aid in the mass production of the device.
In an additional embodiment of the present disclose, the apertures are in contact with the microlens layer. Alternatively, the apertures may not be in contact with the microlens layer, such that there is a gap between the microlens array and the apertures.
Fabrication of Apertures Aligned with the Microlenses
In an additional embodiment of the present disclosure, a method for fabrication of a microlens structure having aligned apertures is provided. Preferably, the fabrication method relies on the use of a photosensitive material which is applied to the back side of the microlens structure. The photosensitive material may be any material which changes its properties upon receiving light, such that the end result following fabrication of the microlens structure is that areas of the photosensitive material which have received light and areas which have not received light have a different transmissivity of the incident light. As such, the photosensitive material may be a photopolymer, for example a positive photopolymer wherein the solubility in a suitable developer is altered by the application of light, such as UV light. The method for fabrication preferably relies on light being received and reflected by the microlens structure, wherein the light received by each microlens or the microlens array is focused to a single point on the photosensitive material on the back side of said microlens structure. The light irradiating the photosensitive material is preferably sufficient in the focal point of the microlenses to induce said material changes, wherein if a photopolymer is used, transparent apertures may be formed which are precisely aligned with the microlenses of the microlens structure. A person skilled in the art recognizes that many combinations of photopolymers, wavelengths and dose requirements are possible in order to achieve a microlens structure having aligned transparent apertures.
In a preferred embodiment the photopolymer is non transmissive (e.g. opaque) to the reflected light from an object. In another embodiment the photopolymer may be used as a sacrificial layer following coating the back side of the microlens structure with a secondary material, such as a metal. The light used for fabrication of the apertures may be, but not necessarily, collimated light and/or coherent light, and may further consist of substantially a single wavelength or may consist of a broad spectrum of wavelength. In a preferred embodiment of the fabrication process substantially collimated light is used, leading to incident light passing through the microlenses of the microlens structure being focused into narrower spots. As the thickness of the applied photosensitive material, such as a photopolymer, is reflected after fabrication in the length of the aperture, along an axis substantially perpendicular to the backside of the microlens structure. Preferably, without being limiting, the fabrication process is carried out without the need of a photomask. By having the front of the microlens structure, where the fingerprint light is received, entirely consisting of microlenses, such the surface for example consists entirely of multiple convex structures, the entire microlens structure may be irradiated simultaneously, as all incident light can be focused into a focal point of one of the lenses. In another embodiment the collimated light may have a non-zero incident angle for being able to adjust the size and shape of the final apertures. Furthermore the collimated light may be in the form of a line or a surface. In another embodiment there is a layer of air, polymer, glass or other insulating materials between the microlens array and the light sensitive material. At least one light source is used during the fabrication, multiple light sources may be used, and they may further have the same or different wavelengths.
In another embodiment the fabrication method relies on the application of a material which is sensitive to laser ablation to the backside of the microlens structure; the material preferably being non-transmissive to the light returned from the object. Laser light may, following application of the material, thereafter be shined on the front side of the microlens structure such that the microlenses of the microlens structure focus the laser light onto the non-transmissive material, acting to form apertures within the material. A person skilled in the art recognizes that many types of lasers sources and photosensitive materials may be combined in order to form apertures by laser ablation.
Lens Properties
As used herein, a lens (e.g. a microlens) include, but are not limited to elements with a cross-sectional structure that is hemispherical, aspherical, conical, triangular, rectangular, polygonal, or a combination thereof along a plane perpendicular to the microlens structure of the lens through the centre of the lens.
The lens may have optical properties such that it is substantially transparent to at least the light returned from the object. Further, the lens may have a refractive index above 1, preferably at least 1.1, more preferable at least 1.2, even more preferable at least 1.25, most preferable at least above 1.25. Preferably collimated incident light is focused by the microlens into a single point located in the focal plane of the microlens.
In an additional embodiment of the present disclosure the lenses are lenticular lenses, such as linear lens arrays and/or two-dimensional lens arrays such as close-packed hexagonal or any other two-dimensional array. The apertures of a microlens structure employing lenticular lenses may be, but are not limited to, the use of slits instead of pinhole apertures. In further embodiments of the present disclosure, the apertures have other shapes such as rectangular, such as a square, oval or polygonal.
The size of the area sensitive to fingerprints depends on the practical necessity. In order to provide a 10 mm×10 mm area which is sensitive to fingerprint, then a 417×417 array of microlenses and pixels as illustrated in
In another example the front side of the microlens is spherical with radius of curvature of 50 microns, while the back side is a plane. The length of the microlens is 100 microns, width and height are both 50 microns. Back focal length is 20 microns. The transparent aperture in the center of the back side, i.e. co-axial, is circular with a diameter of 20 microns. The size of the corresponding pixel is 15×15 microns. The microlens is designed to be exposed to air
The present disclosure will in the following be described with in further details with reference to the numbered items.
Number | Date | Country | Kind |
---|---|---|---|
18170996 | May 2018 | EP | regional |
18184693 | Jul 2018 | EP | regional |
This application is a continuation of International Application No. PCT/EP2019/061738, which designated the United States and was filed on May 7, 2019, published in English, which claims priority to European Patent Application no. 18170996.5, filed May 7, 2018, and European Patent Application no. 18184693.2, filed Jul. 20, 2018. The entire teachings of the above application(s) are incorporated herein by reference. The present disclosure relates to an optical sensor for use in an image recognition device, e.g. a biometric recognition system, such as a fingerprint detector. The presently disclosed optical sensor has improved light transmittance in a compact and cost-efficient structure. In particular the presently disclosed optical sensor can be placed under a display panel of an electronic device, such as a smartphone.
Number | Name | Date | Kind |
---|---|---|---|
6057540 | Gordon | May 2000 | A |
8408775 | Coleman | Apr 2013 | B1 |
10438044 | Wu et al. | Oct 2019 | B2 |
20070041005 | Song et al. | Feb 2007 | A1 |
20070109438 | Duparre et al. | May 2007 | A1 |
20090017914 | Velu | Jan 2009 | A1 |
20110013074 | Ichimura | Jan 2011 | A1 |
20120169669 | Lee | Jul 2012 | A1 |
20150187980 | Yamamoto | Jul 2015 | A1 |
20160092717 | Ling | Mar 2016 | A1 |
20170161543 | Smith et al. | Jun 2017 | A1 |
20170161544 | Fomani et al. | Jun 2017 | A1 |
20170220840 | Wickboldt | Aug 2017 | A1 |
20170220844 | Jones | Aug 2017 | A1 |
20170270342 | He | Sep 2017 | A1 |
20170286743 | Lee | Oct 2017 | A1 |
20170357840 | Chen | Dec 2017 | A1 |
20180005005 | He et al. | Jan 2018 | A1 |
20180012069 | Chung et al. | Jan 2018 | A1 |
20180260605 | Wu et al. | Sep 2018 | A1 |
20180276444 | Sun et al. | Sep 2018 | A1 |
20190171861 | Zhang | Jun 2019 | A1 |
20190214420 | Kim et al. | Jul 2019 | A1 |
20190228204 | Park | Jul 2019 | A1 |
20190286869 | Ling | Sep 2019 | A1 |
Number | Date | Country |
---|---|---|
107437047 | Dec 2017 | CN |
108960208 | Dec 2018 | CN |
208848221 | May 2019 | CN |
3467705 | Apr 2019 | EP |
2005060362 | Jul 2005 | WO |
2014143234 | Sep 2014 | WO |
2014184055 | Nov 2014 | WO |
2017211152 | Dec 2017 | WO |
2019125271 | Jun 2019 | WO |
Entry |
---|
Notification of Transmittal of the International Preliminary Report on Patentability dated May 14, 2020 in PCT/EP2019/061738, “Compact Optical Sensor for Fingerprint Detection,” (19 pages). |
Search Report and Written Opinion dated Aug. 28, 2019 in PCT/EP2019/061738, “Compact Optical Sensor for Fingerprint Detection,” (10 pages). |
K. Hamanaka, et al., “An Artificial Compound Eye Using a Microlens Array and Its Application to Scale-Invariant Processing,” vol. 3, Optical Review, 1996. |
J. Duparré, “Microoptical artificial compound eyes,” Ph.D. thesis, Friedrich-Schiller-Universität Jena (2005). |
A. Brückner, “Microoptical multi aperture imaging system,” Ph.D. thesis 2011. |
Number | Date | Country | |
---|---|---|---|
20200285345 A1 | Sep 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/EP2019/061738 | May 2019 | US |
Child | 16883878 | US |