Embodiments described herein relate to electronic device displays and, in particular, to display stack constructions facilitating through-display shortwave infrared biometric imaging.
An electronic device display (a “display”) is typically formed from a stack of functional and structural layers (a “display stack”) that is attached to, or otherwise disposed below, a protective cover. In many conventional implementations, the protective cover defines an exterior surface of a housing of the electronic device that incorporates the display. For increased contrast, a conventional display stack is intentionally designed to be opaque.
An electronic device can also include an optical imaging system, such as a camera or an ambient light sensor. Typically, an optical imaging system is positioned below the protective cover, adjacent to, and separated from, the display stack. As a result, a conventional electronic device incorporating both a display stack and an optical imaging system typically requires a large-area protective cover that extends beyond a periphery of the display stack in order to reserve space to accommodate the optical imaging system. This conventional construction undesirably increases the apparent size of a bezel region circumscribing the display, while also undesirably increasing the size and volume of the housing of the electronic device.
Some embodiments described reference an electronic device including a protective outer cover. The protective outer cover defines an interface surface to receive a touch input from a finger. The device also includes a display positioned below the protective outer cover and an optical imaging system positioned below the display. The optical imaging system includes a light emitting element configured to emit shortwave infrared light through the display and a photosensitive element optically isolated from the light emitting element and configured to receive (through the display) a reflection from the interface surface corresponding to a portion of an image of the finger.
Some embodiments described herein reference a method of operating an optical imaging system positioned below a display of an electronic device to capture an image, the method including the operations of: detecting a contact area of a touch input provided to the display by the display; illuminating the contact area with shortwave infrared light by a light emitting element of the optical imaging system; receiving one or more surface reflections of shortwave infrared light from the contact area; and assembling an image from the one or more surface reflections.
Some embodiments described herein reference a method of imaging an input surface defined by a glass substrate, the method including the operations of: illuminating the input surface with shortwave infrared light emitted from one or more light emitting elements; receiving, at an array of photosensitive elements, one or more surface shortwave infrared light reflections from the input surface at an array of photosensitive elements after filtering the one or more surface shortwave infrared light reflections with a narrow field of view filter; and assembling an image of the input surface based on the received one or more surface shortwave infrared light reflections.
Reference will now be made to representative embodiments illustrated in the accompanying figures. It should be understood that the following descriptions are not intended to limit this disclosure to one included embodiment. To the contrary, the disclosure provided herein is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the described embodiments, and as defined by the appended claims.
The use of the same or similar reference numerals in different figures indicates similar, related, or identical items.
The use of cross-hatching or shading in the accompanying figures is generally provided to clarify the boundaries between adjacent elements and also to facilitate legibility of the figures. Accordingly, neither the presence nor the absence of cross-hatching or shading conveys or indicates any preference or requirement for particular materials, material properties, element proportions, element dimensions, commonalities of similarly illustrated elements, or any other characteristic, attribute, or property for any element illustrated in the accompanying figures.
Similarly, certain accompanying figures include vectors, rays, traces and/or other visual representations of one or more example paths—which may include reflections, refractions, diffractions, and so on, through one or more mediums—that may be taken by one or more photons originating from one or more light sources shown or, in some cases, omitted from, the accompanying figures. It is understood that these simplified visual representations of light are provided merely to facilitate an understanding of the various embodiments described herein and, accordingly, may not necessarily be presented or illustrated to scale or with angular precision or accuracy, and, as such, are not intended to indicate any preference or requirement for an illustrated embodiment to receive, emit, reflect, refract, focus, and/or diffract light at any particular illustrated angle, orientation, polarization, color, or direction, to the exclusion of other embodiments described or referenced herein.
Additionally, it should be understood that the proportions and dimensions (either relative or absolute) of the various features and elements (and collections and groupings thereof) and the boundaries, separations, and positional relationships presented therebetween, are provided in the accompanying figures merely to facilitate an understanding of the various embodiments described herein and, accordingly, may not necessarily be presented or illustrated to scale, and are not intended to indicate any preference or requirement for an illustrated embodiment to the exclusion of embodiments described with reference thereto.
Embodiments described herein reference an electronic device that includes a display and an optical imaging system.
In certain embodiments, the optical imaging system is configured to operate in at least the shortwave infrared band and is positioned behind, and/or integrated within, the display of the electronic device. More specifically, the optical imaging system, when in operation, is configured to produce a flood illumination of an object or part of an object in contact with an input surface of the display in the shortwave infrared band. In addition, the optical imaging system is configured to receive and quantify surface and/or subsurface reflections—if any—that result from the flood illumination in the shortwave infrared band.
As used herein, the phrase “surface reflection” refers a change in polarity of at least one direction of propagation of an optical wavefront (e.g., a ray of light) as a result of interaction with an interface between two different media having differing refractive indices. A surface reflection can include both specular reflection components (e.g., components reflected at the same angle relative to a surface normal to the interface) and diffuse reflection components (e.g., components reflected at a different angle relative to the surface normal to the interface).
As used herein, the phrase “subsurface reflection” refers to one or more scattered or refracted components of an optical wavefront (e.g., a ray of light) passing through, or within, a non-transparent or translucent medium. A subsurface reflection, as described herein, includes predominantly diffuse reflection components.
As a result, when a user of the electronic device touches the input surface of the display (for example to interact with content shown on the display), the optical imaging system can obtain an image and/or otherwise determine one or more properties of that user's finger. For example, the optical imaging system can be configured to, without limitation: obtain an image of the user's fingerprint; determine a vein pattern of the user; determine blood oxygenation of the user; determine the user's pulse; determine whether the user is wearing a glove; determine whether the user's finger is wet or dry; and so on.
The optical imaging system can be any suitable optical imaging system, including both single-element sensors (e.g., photodiodes, phototransistors, photosensitive elements, and so on) and multi-element sensors (e.g., complementary metal oxide semiconductor arrays, photodiode arrays, and so on).
As noted above, in many embodiments, an optical imaging system, such as described herein, is configured to operate (e.g., to receive and/or emit light) in at least the shortwave infrared band. As used herein, the phrases “shortwave infrared band” and “shortwave infrared light” and similar phrases refer, generally, to the band of infrared light including wavelengths between and including approximately 1,100 nm (1.1 μm) to 3,000 nm (3.0 μm).
For example, in some embodiments, an optical imaging system can be configured to emit and/or receive light having wavelengths of approximately 1450 nm±50 nm. In other embodiments, an optical imaging system is configured to emit and/or receive light having wavelengths of approximately 1950 nm±50 nm. In still other embodiments, an optical imaging system is configured to emit and/or receive light having wavelengths of approximately 1200 nm±50 nm.
For simplicity of description, unless otherwise specified, it may be understood that an optical imaging system described herein is configured to emit and/or receive light having wavelengths of approximately 1450 nm±50 nm. It is appreciated, however, that this is merely one example and other wavelength bands—or multiple wavelength bands or different band widths—can be suitable in other implementations of the embodiments described herein, or equivalents thereof.
As noted above, an optical imaging system can be positioned behind a display of an electronic device defining an input surface. In these examples, the optical imaging system can be oriented to emit and receive light at least partially through the display toward and from the input surface. For example, in one embodiment, the optical imaging system is positioned below an organic light emitting diode display. In this example, the optical imaging system can emit and receive shortwave infrared light through inter-pixel regions of the organic light emitting diode display.
In another embodiment, a micro light emitting diode display can include an array of pixels defining an active display area below an input surface. An array of flood illumination pixels, each configured to emit light in at least the shortwave infrared band, can be dispersed among the pixels defining the active display area. In addition, an array of photosensitive elements, each responsive to light in at least the shortwave infrared band, can be dispersed among the pixels defining the active display area. In these embodiments, the array of flood illumination pixels can be used to illuminate an object in contact with the input surface and the array of photosensitive elements can be used to receive reflections from that object that result from the flood illumination.
In yet another embodiment, an organic light emitting diode display can include an array of pixels defining an active display area below an input surface. A backlight layer (which can be back-illuminated or side-illuminated), configured to emit light at least in the shortwave infrared band, can be positioned behind the active display area; light emitted from the backlight layer passes through inter-pixel regions of the organic light emitting diode display. In addition, an array of photosensitive elements, each responsive to light in at least the shortwave infrared band, can be formed onto the backlight, and separated from the backlight by an opaque masking layer. In these embodiments, the backlight can be used to illuminate an object in contact with the input surface and the array of photosensitive elements can be used to receive reflections from that object that result from the flood illumination.
In some embodiments, an optical imaging system such as described herein can be used by an electronic device for any suitable imaging, sensing, or data aggregation purpose without contributing to the size of a bezel region that may surround the display. Example uses include, but are not limited to: ambient light sensing; proximity sensing; depth sensing; receiving structured light; optical communication; proximity sensing; position-finding; biometric imaging (e.g., fingerprint imaging, iris imaging, facial recognition, vein imaging, and so on); determining optical, physical, or biometric properties (e.g., reflection spectrum, absorption spectrum, and so on); and the like.
In some embodiments, multiple discrete optical imaging systems can be associated with different regions of the same display. For example, a first optical imaging system can be disposed behind a lower portion of a display and a second optical imaging system can be disposed behind an upper portion of the same display. The first and second optical imaging systems can be configured to receive and/or emit light in the same or overlapping bands of shortwave infrared or traditionally visible light or, in other embodiments, in non-overlapping bands of shortwave infrared or traditionally visible light.
More generally, it may be appreciated that different discrete optical imaging systems associated with the same display can be configured for different purposes or in different ways. Similarly, a single optical imaging system can be configured to emit and/or receive light in multiple bands of light, either simultaneously, selectively, or in a particular sequence or pattern.
As such, for simplicity of description, many embodiments that follow reference an example construction in which a single optical imaging system is positioned at least partially behind an active display area of a display of an electronic device. It may be appreciated, however, that these embodiments described herein—together with equivalents thereof—may be altered or adjusted to incorporate discreet optical imaging systems in a variety of locations relative to a display or non-display surface of an electronic device and configured for the same or different imaging, sensing, or data aggregation purposes. For example, a first optical imaging system positioned relative to a first region of an active display area of a display of an electronic device may be configured to illuminate and obtain an image of a fingerprint of a user of that electronic device whereas a second optical imaging system positioned relative to a second region of the active display area may be configured to illuminate and obtain an image of a vein pattern of the user.
These foregoing and other embodiments are discussed below with reference to
For simplicity of description, the embodiments that follow reference an organic light emitting diode display stack including, among other layers: a reflective backing layer; a thin-film transistor layer; an encapsulation layer; and an emitting layer. It is appreciated, however, that this is merely one illustrative example implementation and that other displays and display stacks can be implemented with other display technologies, or combinations thereof.
The display stack also typically includes an input sensor (such as a force input sensor and/or a touch input sensor) to detect one or more characteristics of a user's physical interaction with an active display area 104 of the display of the electronic device 100. The active display area 104 is typically characterized by an arrangement of individually-controllable, physically-separated, and addressable pixels or subpixels distributed at one or more pixel densities and in one or more pixel or subpixel distribution patterns.
Example input characteristics that can be detected by an input sensor of the electronic device 100 include, but are not limited to: touch location; force input location; touch gesture path, length, duration, and/or shape; force gesture path, length, duration, and/or shape; magnitude of force input; number of simultaneous force inputs; number of simultaneous touch inputs; and so on.
As a result of these constructions, a user 106 of the electronic device 100 may be encouraged to interact with content shown in the active display area 104 of the display by physically touching and/or applying a force with the user's finger to the input surface above an arbitrary or specific region of the active display area 104.
In these embodiments, as with other embodiments described herein, the display stack is additionally configured to facilitate through-display imaging of the user's fingerprint when the user 106 touches the display to interact with content shown in the active display area 104.
More specifically, in one example, the display stack defines an imaging aperture (not shown) through a backing layer of the display stack, thereby permitting light to travel through the display stack between two or more organic light emitting diode subpixels or pixels (herein, “inter-pixel” regions). In some cases, the imaging aperture takes a rectangular shape and is disposed on a lower region of the active display area 104, but this may not be required. In other cases, the imaging aperture takes a circular or oval shape and is disposed in a central region of the active display area 104. Typically, the imaging aperture is larger than the fingerprint of the user 106, but this may not be required and smaller apertures may be suitable. For example, in some embodiments, the backing layer may be omitted entirely; the imaging aperture may take the same size and shape as the active display area 104.
As noted with respect to other embodiments described herein, the electronic device 100 also includes an optical imaging system (not shown). The optical imaging system is positioned at least partially below the imaging aperture in order to collect and quantify light directed through the inter-pixel regions of the display stack. As a result of this construction, the electronic device 100 can obtain an image of the fingerprint of the user 106; this operation is referred to herein as a “fingerprint imaging operation.”
In some embodiments, the optical imaging system of the electronic device 100 illuminates the finger of the user 106 during a fingerprint imaging operation with light in the shortwave infrared band at approximately 1450 nm±50 nm. Light in the shortwave infrared band may be selected to maximize absorption of light within the finger of the user 106, thereby minimizing or eliminating remittance reflections (e.g., light at least partially reflected and diffused by the subsurface layers of the user's skin) that may otherwise be received by the optical imaging system as noise. For example, it may be appreciated that water content in the skin of the user 106 may absorb a greater quantity of light at wavelengths approximately equal to 1200 nm, 1450 nm, and 1950 nm than other traditionally visible or traditionally non-visible frequencies. Accordingly, in many embodiments, while performing a fingerprint imaging operation, the optical imaging system of the electronic device 100 may be configured to operate at 1200 nm, 1450 nm, and/or 1950 nm.
In some embodiments, the optical imaging system of the electronic device 100 illuminates a region of the display below the finger of the user 106, as detected by the input sensor of the electronic device 100, with shortwave infrared light. In other examples, the optical imaging system illuminates a perimeter of the user's finger with shortwave infrared light. In some examples, the optical imaging system of the electronic device 100 illuminates discrete portions of the finger of the user 106 in sequence or in a particular pattern with shortwave infrared light at one or multiple frequencies or discrete bands.
In view of the preceding examples, it may be appreciated that illumination of the finger of the user 106 with shortwave infrared light during a fingerprint imaging operation can occur in a number of suitable ways. For example, in some cases, the optical imaging system of the electronic device 100 illuminates the user's finger with pulsed (continuous or discrete) or steady light in the shortwave infrared band. In other examples, the optical imaging system of the electronic device 100 illuminates the finger of the user 106 with shortwave infrared light emitted with a particular modulation pattern or frequency.
In further examples, the optical imaging system of the electronic device 100 illuminates the finger of the user 106 by alternating between frequencies or bands of light within the shortwave infrared band at a particular frequency, modulation, pulse pattern, waveform and so on.
In still other examples, the optical imaging system of the electronic device 100 illuminates the finger of the user 106 while the active display area 104 of the display of the electronic device 100 also renders a visible-light image. In other words, from the perspective of the user 106, the portion(s) of the display below the fingerprint may not be specially or differently illuminated from other portions of the display; the display can continue to render whichever static or animated image or series of images appeared on the display prior to the user touching the display. In still further examples, while the optical imaging system is performing a fingerprint imaging operation, the display of the electronic device 100 can locally increase or decrease brightness below the user's finger, can locally increase or decrease contrast below the user's finger, can locally increase or decrease saturation below the user's finger, and so on.
In other examples, the optical imaging system of the electronic device 100 need not illuminate the finger of the user 106 with only shortwave infrared light. For example, the optical imaging system may also be configured to illuminate the finger of the user 106 with green and/or blue visible light in order to detect or otherwise determine the user's pulse or blood oxygen content. In some cases, the optical imaging system is configured to perform a fingerprint imaging operation substantially simultaneously with an operation to detect the pulse of the user 106 to increase confidence that the fingerprint image obtained by the fingerprint imaging operation corresponds to a biological fingerprint.
It may be appreciated that the foregoing description of
In particular, the electronic device 100 includes a protective outer cover 108. The protective outer cover 108 defines an input surface for the user 106 and, additionally, protects and encloses various components of the electronic device 100, including the optical imaging system, introduced and described in greater detail below. The protective outer cover 108 can be a single or multi-layer substrate made from any number of suitable materials, whether transparent, translucent, or opaque, including, but not limited to, glass, plastic, acrylic, polymer materials, organic materials, and so on. In many embodiments, the protective outer cover 108 is formed from a material transparent to shortwave infrared light, such as glass.
The electronic device 100 also includes an input sensor 110 disposed at least partially below the protective outer cover 108. The input sensor 110 can be any suitable input sensor including, but not limited to: a capacitive input sensor; a resistive input sensor; an inductive input sensor; an optical input sensor; and so on. The input sensor 110 can be configured to detect any suitable user input or combination of user inputs including, but not limited to: touch gestures; touch inputs; multi-touch inputs; force inputs; force gestures; multi-force inputs; pressure inputs; thermal inputs; acoustic inputs; and so on. In typical embodiments, the input sensor 110 is substantially transparent (e.g., exhibiting a transmittance of light greater than 80%), but this may not be required of all embodiments.
The electronic device 100 also includes a display stack 112 which can be disposed below the input sensor 110. The display stack 112 can be formed from a number of independent layers of material or materials that cooperate to define the display and the active display area 104 (see, e.g.,
As noted with respect to other embodiments described herein, the display stack 112 can define an array of discrete pixels that are independently addressable and controllable. The pixels of the display stack 112 can be disposed at a constant pitch or a variable pitch to define a single pixel density or one or more pixel densities.
As noted with respect to other embodiments described herein, the active display area 104 of the display stack 112 is positioned at least partially above the optical imaging system, identified in the figure as the optical imaging system 114. As a result of this construction, the optical imaging system 114 can receive light transmitted through the inter-pixel regions of the active display area 104 of the display stack 112.
The optical imaging system 114 can include a number of light emitting and light detecting elements including one or more photosensitive elements arranged in any suitable pattern. In many examples, the optical imaging system 114 is a low fill-factor array of phototransistor or photodiode elements, disposed above or below or coplanar with the active display area 104 of the display, but this may not be required of all embodiments.
The optical imaging system 114, the display stack 112, and the input sensor 110—among other elements, modules, or components of the electronic device 100—are communicably coupled to a processor 116. The processor 116 can be any suitable processor or circuitry capable of performing, monitoring, or coordinating one or more processes or operations of the electronic device 100. The processor 116 can be any suitable single-core or multi-core processor capable to execute instructions stored in a memory (not shown) to instantiate one or more classes or objects configured to interface with an input or output of one or more of the optical imaging system 114, the display stack 112, and/or the input sensor 110. In some examples, the processor 116 may be a dedicated processor associated with one or more of the optical imaging system 114, the display stack 112, and/or the input sensor 110. In other cases, the processor 116 may be a general purpose processor.
In still other embodiments, the electronic device 100 can include one or more optional optical components 118. The optional optical components 118 are typically positioned between the optical imaging system 114 and the display stack 112 and can include, but may not be limited to: one or more lenses, filters, mirrors, actuators, apertures, irises, flash elements, narrow field of view filters, collimators, flood illuminators, or other accessory optical elements, or combinations thereof.
As noted above, the electronic device 100 can also include an imaging aperture 120 defined into or through one or more opaque or substantially opaque layers of the display stack 112. The imaging aperture 120 is typically aligned with the optical imaging system 114. As noted with respect to other embodiments described herein, the imaging aperture 120 can take any suitable size or shape.
Accordingly, generally and broadly in view of
Further it is appreciated that beyond the components depicted in
Further, although the electronic device 100 includes only a single rectangular display, it may be appreciated that this example is not exhaustive. In other embodiments, an electronic device can include, or may be communicably coupled to, multiple displays, one or more of which may be suitable for through-display imaging. Such accessory/auxiliary displays can include, but may not be limited to: secondary monitors; function row or keyboard key displays; wearable electronic device displays; peripheral input devices (e.g., trackpads, mice, keyboards, and so on) incorporating displays; digital wallet screens; and so on. Similarly, a rectangular display may not be required; other embodiments are implemented with displays taking other shapes, including three-dimensional shapes (e.g., curved displays).
Similarly, although the display described in reference to the electronic device 100 is a primary display of an electronic device, it is appreciated that this example is not exhaustive. In some embodiments, a display stack can define a low-resolution auxiliary display, such as a monochromatic display or a greyscale display. In other cases, a display stack can define a single-image display, such as a glyph or icon. In one specific example, a power button for an electronic device can include a button cap incorporating a display such as described herein. The display can be configured to selectively display a power icon and/or a limited set of icons or glyphs associated with one or more functions the button may be configured to perform, or one or more configurable options the button is associated with (e.g., power options, standby options, volume options, authentication options, digital purchase options, user authentication options, and so on). In these examples, a limited-purpose, auxiliary, or secondary display can be configured to have partial transparency or translucency, such as described herein, to facilitate through-display imaging.
Thus, it is understood that the foregoing descriptions of specific embodiments are presented for the purposes of illustration and description. These descriptions are not exhaustive nor intended to limit the disclosure to the precise forms recited herein. To the contrary, it will be apparent to one of ordinary skill in the art that many modifications and variations are possible in view of the above teachings. Particularly, it is understood that a display stack suitable for through-display imaging can be constructed and/or assembled in many suitable ways. For example, many embodiments described herein reference methods, constructions, and architectures that promote increased optical transmissivity through the display stack above an imaging aperture.
Certain example implementations of an optical imaging system positioned below an input surface of a display stack of an electronic device are depicted in
More specifically,
For simplicity of illustration and description, the display stack 202 in the illustrated embodiment is simplified to a single layer, but it may be appreciated that the display stack 202 can include multiple discrete single or multi-function layers that can include, without limitation or specific requirement: a protective outer cover; an emitting layer (also referred to as a pixel layer); an opaque or reflective backing layer; a thin-film transistor layer; a capacitive touch sensing layer; a force sensing layer; a backlight layer; a polarizer layer; and so on.
A protective outer cover that may be included in the display stack 202 is typically formed from an optically transparent substrate material such as glass, acrylic, plastic, or the like. In many examples, a protective outer cover defines an input surface that can be touched by the user 204. In many examples, the protective outer cover defines at least a portion of an exterior surface of a housing of an electronic device, such as the housing 102 of the electronic device 100 depicted in
The optical imaging system 200 also includes one or more optical transducer modules, typically positioned at least partially below the display stack 202. The optical transducer modules may be configured to (1) emit light and (2) to receive light and can include one or more components such as, but not limited to: photodiodes; laser diodes; light emitting diodes; phototransistors; and so on. In the illustrated example, two optical transducer modules are shown and identified as the optical transducer module 206 and the optical transducer module 208.
The optical transducer modules 206, 208 of the optical imaging system 200 can be communicably coupled to a processor or a processing circuitry (not shown) via a circuit board. The circuit board can be formed from a rigid or flexible substrate. The processor or processing circuitry can be a general purpose processor or circuitry or an application-specific processor or circuitry configured for, in many examples, encrypted or otherwise secure data processing and/or storage.
As a result of the depicted construction, an image of the fingerprint of the user 204—and in particular, an image that distinguishes between ridge and valley features of the fingerprint—can be obtained by the optical imaging system 200 through the display stack 202. In the illustrated embodiment, a valley feature of the fingerprint of the user 204 is shown and identified as the valley feature 204a. Similarly, a ridge feature of the fingerprint of the user 204 is shown and identified as the ridge feature 204b. An air gap 204c separates the valley feature 204a from the display stack 202. It may be appreciated that the air gap 204c can also be occupied, in part or entirely by, without limitation, detritus, oils, gasses, liquids, and so on. For simplicity of illustration and description, the air gap 204c is depicted without such elements.
During a fingerprint imaging operation, the optical transducer modules 206, 208 can be separately, sequentially, or simultaneously illuminated (e.g., in response to a signal sent by a processor or processing circuitry) in a band outside the shortwave infrared wavelength band (with any suitable modulation, amplitude, color or spectrum, and so on) when the user 204 touches the protective outer cover.
Light emitted from the optical transducer modules 206, 208 is directed toward the fingerprint of the user 204 and, in turn, is reflected back into the display stack 202 by the various features of the user's fingerprint in contact with the outer layer (e.g., the input surface) of the display stack 202.
More particularly, in the illustrated example, light is emitted from the optical transducer module 208 into the display stack 202, at a selected frequency (more generally, in a narrow band of frequencies, represented in the figure with a normal distribution), and generally directed toward the valley feature 204a of the fingerprint of the user 204. The path of the light emitted from the optical transducer module 208 as it passes through the display stack 202 is represented by the ray u1.
After passing through the display stack 202, the ray u1 reaches an optical interface defined between the outer layer of the display stack 202 and the air gap 204c. As may be appreciated, the refractive indices of the display stack 202 (identified in
After passing through the air gap 204c, the ray u2 reaches an optical interface defined between a portion of an outer layer of the valley feature 204a of the fingerprint of the user 204 and the air gap 204c. As may be appreciated, the refractive indices of the outer layer of the valley feature 204a (identified in
After passing into the valley feature 204a of the fingerprint of the user 204, the ray u2 may be diffused throughout the various layers of the skin of the user 204. This light is represented in the figure by the ray u3′. In typical configurations and implementations, it may be appreciated that the ray u3′ is primarily a subsurface reflection.
After diffusing and reflecting through various features within the valley feature 204a of the fingerprint of the user 204, a portion of the ray u3′ can return to the optical interface defined between the outer layer of the valley feature 204a of the fingerprint of the user 204 and the air gap 204c. As noted above, because the refractive indices of the outer layer of the valley feature 204a (identified in
After passing through the air gap 204c, the ray u4 returns to the optical interface defined between the outer layer of the display stack 202 and the air gap 204c. Once again, as noted above, because the refractive indices of the display stack 202 (identified in
In addition, in the illustrated embodiment, light is emitted from the optical transducer module 206 into the display stack 202, at a selected frequency, and generally directed toward the ridge feature 204b of the fingerprint of the user 204. In this example, the path of the light emitted from the optical transducer module 206 as it passes through the display stack 202 is represented by the ray v1.
After passing through the display stack 202, the ray v1 reaches an optical interface defined between the outer layer of the display stack 202 and the ridge feature 204b of the fingerprint of the user 204. As may be appreciated, the refractive indices of the display stack 202 (identified in
After passing into the ridge feature 204b of the fingerprint of the user 204, the ray v2 may be diffused throughout the various layers of the skin of the user 204. This light is represented in the figure as the ray v2′. As may be appreciated, some of the light corresponding to ray v2′ may exit the ridge feature 204b of the fingerprint of the user 204 and return to the display stack 202. This light is represented in the figure by the ray v3. As with the ray u5, in typical configurations and implementations, it may be appreciated that the ray v3 includes primarily subsurface reflection components.
In this manner, when the optical transducer modules 206, 208 emit light toward the fingerprint of the user 204, both surface and subsurface reflections are reflected back which reduces the detectable contrast between the ridge and valley features of the fingerprint of the user 204. In particular, it may be appreciated that contrast is reduced in part because subsurface reflections and surface reflections often exhibit opposite polarity.
More specifically, as shown in
Accordingly, many embodiments described herein operate an optical imaging system in the shortwave infrared band which, as noted above, includes wavelengths absorbed to a high degree by the water present in a user's finger. For example,
In contrast to the embodiment depicted in
In this example, light emitted from the optical transducer modules is directed toward the fingerprint of the user 204 which, in turn, is reflected back into the display stack 202 by the various features of the user's fingerprint in contact with the outer layer (e.g., the input surface) of the display stack 202. However, because of the selected wavelength of light, any light that traverses an optical interface boundary will be absorbed by the water in the finger of the user 204, effectively reducing and/or eliminating subsurface reflections.
More particularly, in the illustrated example, light is emitted from the optical transducer module 208 into the display stack 202, at a selected frequency, and generally directed toward the valley feature 204a of the fingerprint of the user 204. As with the embodiment depicted in
After passing through the display stack 202, the ray u1 reaches an optical interface defined between the outer layer of the display stack 202 and the air gap 204c. As the refractive indices of the display stack 202 (n1) and the air gap 204c (n3) may be mismatched, the ray u1 may partially reflect from the interface and may partially traverse the interface. As with the embodiment depicted in
After passing through the air gap 204c, the ray u2 reaches the optical interface defined between the outer layer of the valley feature 204a of the fingerprint of the user 204 and the air gap 204c. Because the refractive indices of the outer layer of the valley feature 204a (n2) and the air gap 204c (n3) can be mismatched, the ray u2 may partially reflect from the interface and may partially traverse the interface. As with the embodiment depicted in
In contrast to the embodiment described in reference to
As with the embodiment described in reference to
As with previously described embodiments, after passing through the display stack 202, the ray v1 reaches the optical interface defined between the outer layer of the display stack 202 and the ridge feature 204b of the fingerprint of the user 204. As noted above, the refractive indices of the display stack 202 (n1) and the ridge feature 204b (n2) may be mismatched and, as such, the ray v1 may partially reflect from the interface and may partially traverse the interface. As with other embodiments described herein, reflection(s) from this interface are collectively represented in the figure by the ray v1′ whereas portions of the ray v1 that traverse the interface are collectively represented in the figure by the ray v2. As noted above, the ray v1′ is primarily a surface reflection.
After passing into the ridge feature 204b of the fingerprint of the user 204, the ray v2 may be absorbed by the water within the various layers of the skin of the user 204.
In this manner, when the optical transducer modules 206, 208 emit shortwave infrared light toward the fingerprint of the user 204, substantially only surface reflections are reflected back which substantially increases the detectable contrast between the ridge and valley features of the fingerprint of the user 204. For example, as shown in the chart depicted in
It may be appreciated that the foregoing description of
Thus, it is understood that the foregoing descriptions of specific embodiments are presented for the purposes of illustration and description. These descriptions are not exhaustive nor intended to limit the disclosure to the precise forms recited herein. To the contrary, it will be apparent to one of ordinary skill in the art that many modifications and variations are possible in view of the above teachings. Particularly, it is understood that an optical imaging system can be formed in a display stack in a number of suitable ways.
For example,
It may be appreciated that the display stack 300 is presented in
The pixel layer 304 can be any suitable pixel layer including, but not limited to: an organic light emitting diode emitter layer; a micro light emitting diode layer; and so on. As with other embodiments described herein, the outer protective layer 302 not only protects the pixel layer 304 (and/or other layers within and/or required by a display stack) but the outer protective layer 302 may also define an input surface that may be touched by a user, such as the user 306.
In this embodiment, an optical imaging system can be partially integrated into the pixel layer 304 of the display stack 300. More particularly, an array of flood illumination pixels—one of which is identified as the flood illumination pixel 308—can be dispersed among the pixels of the pixel layer 304. Each flood illumination pixel 308 of the array of flood illumination pixels can be configured to emit light in one or more bands of light within the shortwave infrared band. For example, in one embodiment, a first subset of the array of flood illumination pixels may be configured to emit light at 1450 nm whereas a second subset of the array of flood illumination pixels may be configured to emit light at 1950 nm. In other cases, some of the flood illumination pixels of the array of flood illumination pixels can be configured to emit light in the near-infrared band or the visible band of light, but this may not be required of all embodiments.
In typical examples, the flood illumination pixels of the array of flood illumination pixels are simultaneously illuminated during a fingerprint imaging operation, but this may not be required. For example, in some cases, each flood illumination pixel may be individually addressable and/or controllable. In these and related examples, the array of flood illumination pixels can be coupled to a display controller (not shown) that is also configured to drive the various pixels of the pixel layer 304. In other cases, the array of flood illumination pixels can be coupled to a dedicated controller, separate from the display controller.
The array of flood illumination pixels can be dispersed in any suitable pattern or configuration among the pixels of the pixel layer 304. For example,
Although the array of flood illumination pixels, including the flood illumination pixel 308, generally take the shape of a square in the illustrated embodiment, it may be appreciated that this is merely one example embodiment. Other shapes, layouts, and configurations are possible.
In this example embodiment, the optical imaging system can be positioned behind the pixel layer 404 of the display stack 400. As illustrated, the optical imaging system includes a narrow field of view filter 408, a photodetector stack 410, a thin-film transistor layer 412, a floodlight waveguide 414, a light emitting element 416, and a floodlight aperture 418.
As with other embodiments described herein, the optical imaging system depicted in
More specifically, in order to emit light, the optical imaging system of this embodiment includes a floodlight waveguide 414 positioned behind a floodlight aperture 418 that, in turn, is generally vertically aligned with at least one inter-pixel region of the pixel layer 404 of the display stack 400. A light emitting element 416 is optically coupled to the floodlight waveguide 414, and may be physically positioned along a periphery of the floodlight waveguide 414 (e.g., a side-firing configuration). As a result of this construction, light emitted from the light emitting element 416 can be guided toward, and emitted from, the floodlight aperture 418 by the floodlight waveguide 414. Further, due to the relative positioning of the floodlight aperture 418 and the at least one inter-pixel region of the pixel layer 404 of the display stack 400, light emitted through the floodlight aperture 418 can be transmitted through the pixel layer 404, and, thereafter, through the protective outer cover 402. In this manner, the optical imaging system is configured to emit light toward the user 406 to illuminate the fingerprint of the user 406.
In addition, in order to detect light, the optical imaging system includes a photodetector stack 410 positioned below the narrow field of view filter 408 and disposed on a thin-film transistor layer 412 that is, in turn, coupled to and positioned above the floodlight waveguide 414. As used herein, the phrase “narrow field of view” refers to an optical filter or element configured to transmit light directed on a path substantially normal to (e.g., within 20-30 degrees, in some examples, of normal) the optical filter and configured to reject light (e.g., block light) directed on other paths.
The photodetector stack 410 includes a photosensitive element 410a and an opaque mask layer 410b. The opaque mask layer 410b is formed from an optically opaque material so as to optically isolate the photosensitive element 410a from the floodlight waveguide 414. In many cases, the opaque mask layer 410b is formed or otherwise disposed onto the thin-film transistor layer 412 and/or the floodlight waveguide 414.
As a result of this construction, in order to perform a fingerprint imaging operation, the optical imaging system drives the light emitting element 416 in order to generate a flood illumination, through the pixel layer 404 and the protective outer cover 402, of the fingerprint of the user 406 with shortwave infrared light. As described above in reference to
It may be appreciated that the foregoing description of
Thus, it is understood that the foregoing descriptions of specific embodiments are presented for the purposes of illustration and description. These descriptions are not exhaustive nor intended to limit the disclosure to the precise forms recited herein. To the contrary, it will be apparent to one of ordinary skill in the art that many modifications and variations are possible in view of the above teachings. Particularly, it is understood that an optical imaging system can be formed in a display stack in a number of suitable ways.
For example, it may be appreciated that the examples shown in
Further, it may be appreciated that an optical imaging system such as described herein may typically dispose light emitting and/or light detecting elements or pixels in a rectangular and/or array pattern, although this is not required of all embodiments. For example, in some cases, a circular deposition or distribution of light emitting and/or light detecting elements of an optical imaging system such as described herein may be more suitable.
Generally and broadly,
The method 500 includes operation 502 in which a touch to a display of an electronic device is detected. The initial touch can be detected using any suitable sensor or combination of sensors including but not limited to touch sensors and force sensors. Example touch sensors include, but are not limited to: capacitive touch sensors; optical touch sensors; resistive touch sensors; acoustic touch sensors; and so on. Example force sensors include, but are not limited to: capacitive force sensors; resistive force sensors; piezoelectric force sensors; strain-based force sensors; inductive force sensors; and so on.
Once a touch is detected at operation 502, the method 500 continues to operation 504, in which a contact area of the detected touch is illuminated with shortwave infrared light. As noted with respect to other embodiments described herein, the illumination of the contact centroid and/or contact area can be performed in any suitable manner including, but not limited to: a specific/selected modulation of light; a specific/selected pattern (e.g., linear sweep, radial sweep, radial expansion, and so on); and so on or any combination thereof.
The method 500 also includes operation 506 in which a fingerprint image is captured by the optical imaging system of the electronic device. As noted with respect to other embodiments described herein, the operation of capturing an image of a fingerprint (or, more generally, an image of an object in contact with the display at operation 502) can include one or more filtering operations such as: spatial filtering (e.g., point-source filtering, beam-forming, and so on); thresholding; deskewing; rotating; and so on.
One may appreciate that although many embodiments are disclosed above, that the operations and steps presented with respect to methods and techniques described herein are meant as exemplary and accordingly are not exhaustive. One may further appreciate that alternate step order or, fewer or additional operations, may be required or desired for particular embodiments.
Although the disclosure above is described in terms of various exemplary embodiments and implementations, it should be understood that the various features, aspects and functionality described in one or more of the individual embodiments are not limited in their applicability to the particular embodiment with which they are described, but instead can be applied, alone or in various combinations, to one or more of the some embodiments of the invention, whether or not such embodiments are described and whether or not such features are presented as being a part of a described embodiment. Thus, the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments but is instead defined by the claims herein presented.
Further, the present disclosure recognizes that personal information data, including biometric data, in the present technology, can be used to the benefit of users. For example, the use of biometric authentication data can be used for convenient access to device features without the use of passwords. In other examples, user biometric data is collected for providing users with feedback about their health or fitness levels. Further, other uses for personal information data, including biometric data, that benefit the user are also contemplated by the present disclosure.
The present disclosure further contemplates that the entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal information data will comply with well-established privacy policies and/or privacy practices. In particular, such entities should implement and consistently use privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining personal information data private and secure, including the use of data encryption and security methods that meets or exceeds industry or government standards. For example, personal information from users should be collected for legitimate and reasonable uses of the entity and not shared or sold outside of those legitimate uses. Further, such collection should occur only after receiving the informed consent of the users. Additionally, such entities would take any needed steps for safeguarding and securing access to such personal information data and ensuring that others with access to the personal information data adhere to their privacy policies and procedures. Further, such entities can subject themselves to evaluation by third parties to certify their adherence to widely accepted privacy policies and practices.
Despite the foregoing, the present disclosure also contemplates embodiments in which users selectively block the use of, or access to, personal information data, including biometric data. That is, the present disclosure contemplates that hardware and/or software elements can be provided to prevent or block access to such personal information data. For example, in the case of biometric authentication methods, the present technology can be configured to allow users to optionally bypass biometric authentication steps by providing secure information such as passwords, personal identification numbers, touch gestures, or other authentication methods, alone or in combination, known to those of skill in the art. In another example, users can select to remove, disable, or restrict access to certain health-related applications collecting users' personal health or fitness data.
This application is a continuation of U.S. patent application Ser. No. 17/031,466, filed Sep. 24, 2020, which is a continuation of U.S. patent application Ser. No. 16/143,390, filed Sep. 26, 2018, now U.S. Pat. No. 10,824,837, the contents of which are incorporated herein by reference as if fully disclosed herein.
Number | Date | Country | |
---|---|---|---|
Parent | 17031466 | Sep 2020 | US |
Child | 17688799 | US | |
Parent | 16143390 | Sep 2018 | US |
Child | 17031466 | US |