Patent Application
20230304862
A multispectral sensor device may be utilized to capture information. For example, the multispectral sensor device may capture information relating to a set of electromagnetic frequencies. The multispectral sensor device may include a set of sensor elements (e.g., optical sensors, spectral sensors, and/or image sensors) that capture the information. For example, an array of sensor elements may be utilized to capture information relating to multiple frequencies.
According to some implementations, an optical device comprises an array of sensor elements that includes a plurality of pixels and a multispectral filter disposed on the array of sensor elements, configured to pass a first transmission percentage of light of a particular spectral range to a first set of pixels of the plurality of pixels and pass a second transmission percentage of light of the particular spectral range to a second set of pixels of the plurality of pixels.
According to some implementations, a system comprises an array of sensor elements and a multispectral filter comprising a plurality of optical channels that is disposed on at least a portion of the array of sensor elements, the multispectral filter configured to pass a first transmission percentage of bandpass filtered light associated with a particular spectral range to the array of sensor elements and pass a second transmission percentage of bandpass filtered light associated with the particular spectral range to the array of sensor elements.
According to some implementations, a multispectral filter comprises a plurality of optical channels, wherein one or more optical channels, of the plurality of optical channels, are configured to pass a first transmission percentage of light associated with a particular spectral range to a first set of pixels of a multispectral sensor device and pass a second transmission percentage of light associated with the particular spectral range to a second set of pixels of a multispectral sensor device.
The following detailed description of example implementations refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements.
An optical filter (e.g., a multispectral filter) may include a set of optical channels designed to transmit light in different spectral ranges (e.g., wavelength ranges). For example, the set of optical channels may include discrete gratings or bandpass filters, each of which may be designed to pass light in a respective spectral range. The optical filter may be included in an optical device, such as a multispectral sensor device, that includes a set of sensor elements (e.g., optical sensors) to capture spectral data relating to different wavelengths of light (based on wavelengths of light passed by the optical filter) related to a target object (e.g., that emits and/or reflects light to the optical device).
In many cases, each optical channel of the set of optical channels of the optical filter may be configured to pass bandpass filtered light (e.g., light of a particular spectral range, such as light that may have a spectral width of 10-100 nanometers) to a respective set of pixels associated with the set of sensor elements of the multispectral sensor device. However, the set of sensor elements may be more sensitive to some spectral ranges than others, more light associated with one spectral range may pass to the set of sensor elements than light associated with another spectral range, and/or the like, which may cause the set of sensor elements to obtain too much data relating to some spectral ranges (e.g., be overexposed to light) and not enough data related to other spectral ranges (e.g., be underexposed to light) during a particular integration time.
In some cases, the set of sensor elements may be configured to capture multiple “frames” that are respectively associated with different integration times, so that an optimal amount of data may be obtained for each spectral range associated with the set of optical channels. The multiple frames can be processed (e.g., using complex mathematical algorithms) to create a single frame with a high dynamic range (HDR) that indicates representative data associated with each spectral range. However, this may involve a use of computing resources (e.g., processing resources, memory resources, power resources, and/or the like) of a device to create the HDR frame. Moreover, taking additional time to capture multiple frames and/or to combine the multiple frames may cause an inaccurate and/or outdated HDR frame to be created.
Some implementations described herein provide an optical filter (e.g., a multispectral filter) that can pass different transmission percentages of light associated with different spectral ranges to an array of sensor elements. For example, in some implementations, a first optical channel of the optical filter may pass a first transmission percentage (e.g., 100% or near 100%) of light associated with a particular spectral range to the array of sensor elements, and a second optical channel of the optical filter may pass a second transmission percentage (e.g., 65%) of light associated with the particular spectral range (e.g., the same particular spectral range associated with the first optical channel) to the array of sensor elements. As another example, in some implementations, a first optical channel section of an optical channel of the optical filter may pass a first transmission percentage (e.g., 15%) of light associated with a particular spectral range to the array of sensor elements, and a second optical channel section of the optical channel of the optical filter may pass a second transmission percentage (e.g., 57%) of light associated with the particular spectral range (e.g., the same particular spectral range associated with the first optical channel section) to the array of sensor elements.
In this way, some implementations described herein allow different amounts of light associated with one or more respective spectral ranges to pass to the multispectral sensor, increasing a likelihood that the multispectral sensor can capture an optimal amount of light for each spectral range in a single frame (e.g., during a particular integration time). This single frame may have as much or more information as an HDR frame composed of multiple frames described above. Accordingly, computing resources do not need to be used to obtain the single frame that would otherwise be used to create the HDR frame. Moreover, the single frame may be more accurate than an HDR frame because the single frame is associated with light captured during a single integration time, rather than multiple integration times. This may also enable the optical filter to support time-sensitive applications.
In some implementations, optical filter 130 may be a multispectral filter (e.g., that includes an array of optical channels), such as a multispectral filter coupled to a multispectral sensor (e.g., the array of sensor elements 140). The optical filter 130 may be coextensive with the array of sensor elements 140 (e.g., a face of the optical filter 130 may be aligned with a face of the array of sensor elements 140) or may be coextensive with a portion of the array of sensor elements 140 (e.g., a face of the optical filter 130 may be aligned with a portion of the array of sensor elements 140). In some implementations, the array of sensor elements 140 may include a plurality of pixels (e.g., a particular number of pixels may be included in each sensor element of the array of sensor elements).
Sensor system 110 may include an optical transmitter 150 (e.g., a light source) that transmits an optical signal toward a target 160 (e.g., a person, a finger of the person, an object, and/or the like). The optical signal may include broadband light emitted by the optical transmitter 150 and/or ambient light from the environment in which sensor system 110 is being utilized. In some implementations, sensor system 110 may perform sensing without using an optical transmitter 150 to transmit an optical signal toward a target 160. As shown by reference number 170, the optical signal is directed toward the optical filter structure 120. For example, optical transmitter 150 may direct an optical signal that comprises multiple wavelength ranges of visible light, near-infrared light, mid-infrared light, ultraviolet light, and/or the like toward an object (e.g., the target 160) and the optical signal may be reflected off the object toward the optical filter structure 120 to permit at least one sensor element of the array of sensor elements 140 to perform a measurement of light associated with a particular spectral range of the optical signal. Additionally, or alternatively, the optical signal may include light emitted by the object or other light from the environment. In some implementations, at least a portion of the optical signal is passed by the optical filter 130 to the array of sensor elements 140.
As further shown in
As indicated above,
The multispectral filter 210 may be disposed on an array of sensor elements (e.g., the array of sensor elements 140). For example, a face of the multispectral filter 210 may be attached to a face of the array of sensor elements such that the multispectral filter 210 and the array of sensor elements are coextensive. Additionally, or alternatively, the multispectral filter 210 may be disposed on the array of sensor elements such that the one or more optical channels 230 respectively correspond to one or more sets of pixels, of a plurality of pixels, included in the array of sensor elements.
In some implementations, each optical channel of a filter section may be configured to pass light of a particular spectral range to a corresponding set of pixels of the array of sensor elements. For example, each optical channel may include a bandpass filter associated with a particular spectral range to pass bandpass filtered light associated with the particular spectral range to a corresponding set of pixels of the array of sensor elements.
In some implementations, a respective optical channel of each filter section, of the plurality of filter sections 220, may be configured to pass light of the same particular spectral range. For example, as shown in
In some implementations, each filter section, of the plurality of filter sections 220, may be associated with a particular transmission percentage of light (e.g., a percentage amount of light that passes through an optical channel of the filter section). For example, as indicated by the different amounts of shading in
In some implementations, an optical density coating (e.g., comprising one or more optical thin films) associated with a transmission percentage may be formed, applied, and/or the like to a face of a filter section to ensure that each optical channel of the filter section is configured to pass the transmission percentage of light. For example, an optical density coating associated with a high transmission percentage may be disposed on filter section 220-1 (e.g., disposed on all of filter section 220-1 or at least a portion of filter section 220-1 that includes the optical channels 230-1); an optical density coating associated with a moderately high transmission percentage may be disposed on filter section 220-2 (e.g., disposed on all of filter section 220-2 or at least a portion of filter section 220-2 that includes the optical channels 230-2); an optical density coating associated with a moderately low transmission percentage may be disposed on filter section 220-3 (e.g., disposed on all of filter section 220-3 or at least a portion of filter section 220-3 that includes the optical channels 230-3); and/or an optical density coating associated with a low transmission percentage may be disposed on filter section 220-4 (e.g., disposed on all of filter section 220-4 or at least a portion of filter section 220-4 that includes the optical channels 230-4).
Additionally, or alternatively, each optical channel of a filter section may include the same optical density coating associated with a transmission percentage to ensure that each optical channel of the filter section is configured to pass the transmission percentage of light. For example, each optical channel, of the optical channels 230-1, may include an optical density coating associated with a high transmission percentage; each optical channel, of the optical channels 230-2, may include an optical density coating associated with a moderately high transmission percentage; each optical channel, of the optical channels 230-3, may include an optical density coating associated with a moderately low transmission percentage; and/or each optical channel, of the optical channels 230-4, may include an optical density coating associated with a low transmission percentage.
Accordingly, each optical channel of the optical channels 230-1 of filter section 220-1 may be configured to pass a high transmission percentage of light; each optical channel of the optical channels 230-2 of filter section 220-2 may be configured to pass a moderately high transmission percentage of light; each optical channel of the optical channels 230-3 of filter section 220-3 may be configured to pass a moderately low transmission percentage of light; and/or each optical channel of the optical channels 230-4 of filter section 220-4 may be configured to pass a low transmission percentage of light.
In an additional example, as shown in
As indicated above,
In some implementations, the multispectral filter 310 may be disposed on an array of sensor elements (e.g., the array of sensor elements 140). For example, a face of the multispectral filter 310 may be attached to a face of the array of sensor elements such that the multispectral filter 310 and the array of sensor elements are coextensive. Additionally, or alternatively, the multispectral filter 310 may be disposed on the array of sensor elements such that the one or more optical channels 320 and/or the plurality of optical channel sections 330 respectively correspond to one or more sets of pixels of the array of sensor elements.
In some implementations, each optical channel, of the one or more optical channels 320, may be configured to pass light of a particular spectral range to a corresponding set of pixels of the array of sensor elements. For example, each optical channel may include a bandpass filter associated with a particular spectral range to pass bandpass filtered light associated with the particular spectral range to a corresponding set of pixels of the array of sensor elements.
In some implementations, each optical channel section, of the plurality of optical channel sections 330 of an optical channel, may be associated with a particular transmission percentage (e.g., a percentage amount of light that passes through an optical channel section of the optical channel). For example, as indicated by the amount of shading in
As another example, as shown in
As indicated above,
In some implementations, the multispectral filter 410 may be disposed on a portion of an array of sensor elements (e.g., the array of sensor elements 140). For example, a face of the multispectral filter 410 may be attached to a face of the array of sensor elements such that the multispectral filter 410 covers a portion of the array of sensor elements. Additionally, or alternatively, the multispectral filter 410 may be disposed on the array of sensor elements such that the one or more optical channels 420 respectively correspond to one or more sets of pixels of the array of sensor elements and/or that the plurality of optical channel sections 430 respectively correspond to a plurality of subsets of pixels of the array of sensor elements. In some implementations, the multispectral filter 410 may be disposed on a portion of the array of sensor elements such that one or more other optical filters (e.g., that are similar to the multispectral filter 410) may also be disposed on the array of sensor elements. For example, four multispectral filters 410 may be disposed on the array of sensor elements, such that each multispectral filter 410 acts similar to a filter section as described herein in relation to
In some implementations, each optical channel, of the one or more optical channels 420, may be configured to pass light of a particular spectral range to a corresponding set of pixels of the array of sensor elements. For example, each optical channel may include a bandpass filter associated with a particular spectral range to pass bandpass filtered light associated with the particular spectral range to a corresponding set of pixels of the array of sensor elements.
In some implementations, each optical channel section, of the plurality of optical channel sections 430 of an optical channel, may be associated with a particular transmission percentage (e.g., a percentage amount of light that passes through an optical channel section of the optical channel). For example, as indicated by the shading in
As another example, as shown in
As indicated above,
The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit the implementations to the precise forms disclosed. Modifications and variations may be made in light of the above disclosure or may be acquired from practice of the implementations.
Even though particular combinations of features are recited in the claims and/or disclosed in the specification, these combinations are not intended to limit the disclosure of various implementations. In fact, many of these features may be combined in ways not specifically recited in the claims and/or disclosed in the specification. Although each dependent claim listed below may directly depend on only one claim, the disclosure of various implementations includes each dependent claim in combination with every other claim in the claim set.
No element, act, or instruction used herein should be construed as critical or essential unless explicitly described as such. Also, as used herein, the articles “a” and “an” are intended to include one or more items, and may be used interchangeably with “one or more.” Further, as used herein, the article “the” is intended to include one or more items referenced in connection with the article “the” and may be used interchangeably with “the one or more.” Furthermore, as used herein, the term “set” is intended to include one or more items (e.g., related items, unrelated items, a combination of related and unrelated items, etc.), and may be used interchangeably with “one or more.” Where only one item is intended, the phrase “only one” or similar language is used. Also, as used herein, the terms “has,” “have,” “having,” or the like are intended to be open-ended terms. Further, the phrase “based on” is intended to mean “based, at least in part, on” unless explicitly stated otherwise. Also, as used herein, the term “or” is intended to be inclusive when used in a series and may be used interchangeably with “and/or,” unless explicitly stated otherwise (e.g., if used in combination with “either” or “only one of”).
This application is a continuation of U.S. patent application Ser. No. 17/457,068, filed Dec. 1, 2021, which is a continuation of U.S. patent application Ser. No. 16/822,929, filed Mar. 18, 2020 (now U.S. Pat. No. 11,209,311), the contents of which are incorporated herein by reference in their entireties.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17457068 | Dec 2021 | US |
| Child | 18323463 | US | |
| Parent | 16822929 | Mar 2020 | US |
| Child | 17457068 | US |
