Patent Grant
11353363
Embodiments of the present invention are related to spectrometer sensors and, in particular, to a monolithic spectrometer.
Spectrometers can be introduced to mobile devices for a variety of uses involving analysis and identification of target substances. In general, a spectrometer refers to a device that discriminates the relative amounts of different frequency or wavelengths in a light source. Spectrometers are often used in conjunction with a reference light source which is directed off or through a target in order to determine the target's spectral characteristics. The light provided by the light source can be any frequency or range of frequencies and can be continuous during the time the spectrometer is active or may be pulsed. These parameters depend on the particular application. One particular application, for example, uses a light source that produces infrared or near-infrared radiation.
When illuminated by the reference light source, the target substance absorbs at least a part of the incident radiation emitted by the light source and radiates a characteristic spectrum of light that, when properly analyzed, can be used to identify constituent components of the substance. The light received from the target substance is spectrally analyzed by the spectrometer and the spectral composition of the received light is indicative of the chemical composition of the substance, or a relevant physical property.
Determining the chemical composition of a substance has a number of practical applications. For example, the spectral scan of fruits and vegetables can help determine the ripeness or nutritional value provided. Safety of food or drinks can also be determined real-time by spectral scanning. Spectroscopic scans can also be used to monitor health issues, for example the oxygen or sugar content of blood without actually taking blood samples. Furthermore, spectroscopic scanning can be used to monitor atmospheric conditions such as the constituents of the gas.
Also, spectral scans of ambient light (in the absence of light from a light source) can be used to adjust light level sensitivities for a camera for adjusting color balance and exposure. Such a method can help achieve more accurate photographs on a mobile device.
Spectrometers typically use dispersive elements such as gratings to separate light into spectral bands. The bands can be detected by rotating the grating across a detector, or by placing a multi-element detector such that each element detects a portion of the spectrum. These have a known tradeoff of resolution and compactness. To make a more compact solution, spectrometers based on arrays of filters have been developed. In one example, a variety of filters is patterned or aligned over an image sensor array. The intensity of light received on each channel is determined by the passband of the filter over that respective pixel. The received pattern of light may be transformed to a wavelength basis representation of the light intensity by a linear transformation. For spectrometers formed as filter arrays on top of image sensors, the light ray angle distribution may be set with an input aperture a fixed distance from the array. In some cases, a lens can be used to collimate the light that has passed through the aperture. However, the additional size and complexity required for collimation may not be desirable for compact, low cost applications. The farther the aperture is from the filter array, the more like a point source it becomes and the smaller the angle to the edge and corners. Limited angles and light ray angle spread is generally beneficial for spectral discrimination. However, alignment of optical elements above the image sensor array requires precision assembly steps.
Therefore, there is a need to develop better, more robust and manufacturable spectrometers that provide a simpler assembly at the wafer scale.
In some embodiments, a spectrometer is presented. In accordance with some embodiments, the spectrometer includes an optical sensor array, the optical sensor array including a substrate and an array of pixels formed on the substrate; a spectral filter array formed over the pixels of the optical sensor array, the spectral filter array filtering incident light such that each pixel receives light of a spectral transmission profile associated with the pixel; a transparent spacer formed over the spectral filter array; and an opaque mask having input apertures allowing light through the transparent spacer and onto a portion of the spectral filter array.
A method of forming a spectrometer according to some embodiments includes depositing an opaque material over an optical sensor array; forming output apertures over pixels in the optical sensor array; depositing a dielectric focal layer over the opaque material and the output apertures; forming a spectral filter array over the dielectric focal layer, the spectral filter array including a spectral filter over each pixel of the optical sensor array, the spectral filter array having subwavelength structures that focus light of particular wavelengths on each pixels of the optical sensor array; attaching a transparent spacer over the spectral filter array; forming an opaque layer with input apertures on the transparent spacer; and singulating to form individual spectrometers.
These and other embodiments are discussed below with respect to the following figures.
These and other aspects of embodiments of the present invention are further discussed below.
In the following description, specific details are set forth describing some embodiments of the present invention. It will be apparent, however, to one skilled in the art that some embodiments may be practiced without some or all of these specific details. The specific embodiments disclosed herein are meant to be illustrative but not limiting. One skilled in the art may realize other elements that, although not specifically described here, are within the scope and the spirit of this disclosure.
This description illustrates inventive aspects and embodiments should not be taken as limiting—the claims define the protected invention. Various changes may be made without departing from the spirit and scope of this description and the claims. In some instances, well-known structures and techniques have not been shown or described in detail in order not to obscure the invention.
Embodiments of the present invention include a monolithic spectrometer with one or more input apertures that results in simple, low cost and robust assembly. The spectrometer can include a light sensor array of pixels, such as a CMOS, CCD or IR-ROIC used for imaging. However, the light sensor array is not used for imaging. Each pixel of the light sensor array shares a similar field of view because light either comes from a strong diffuser or diffuse source/target. The pixels have spectral filters positioned over them. The spectral filters can be based on a dispersive lens and aperture combination. The focal length of the dispersive lens varies with different wavelengths of light. The output aperture can be a spatial filter and functions as a spectral bandpass filter. The spectral filters may have a spectral width such that each pixel receives a spectral transmission profile that is unique to the pixel. The signal from each of the pixels can then be analyzed given the spectral transmission profiles of the various pixels to determine the spectrum of the incident light.
In spectrometers according to some embodiments of the present invention all the optics may be formed monolithically on top of the image sensor array. In accordance with some embodiments, the formation of the optics on top of the image sensor array is accomplished via wafer-scale processes. There may be one or more input apertures above the sensor image array. When multiple smaller apertures are used to illuminate respective portion of the sensor arrays, a much smaller overall height can be achieved, enabling diverse space-constrained applications and potentially reduced costs.
As discussed above, the spectroscopic data can be used to adjust the color of photographs taken by camera 102 and may further be used to determine the chemical composition of target substances. From the spectroscopic data, the quality and ripeness of fruits and vegetables can be determined, along with the composition of other substances. Furthermore, the target may be biological, and the spectroscopic data used to measure various health conditions. Consequently, having a handheld accurate spectrometer, such as that built into mobile device 100, can be a very valuable tool not just for scientific purposes, but also for more utilitarian purposes such as health monitoring, environmental monitoring, counterfeit detection and authenticity confirmation, product ID, color search and color matching, and other uses.
Sensor array 204 can be a sensor array according to some embodiments capable of measuring a spectral range of light that is appropriate to the purpose of spectrometer 104. For example, sensor array 204 can include a CMOS device having an array of individual pixels or other array of light sensitive areas that produce electrical signals that can be further processed. In some embodiments, sensor array 204 detects wavelengths in the visible range, near IR, or UV. In some embodiments, sensor array 204 detects wavelengths less than about 1100 nanometers. In some embodiments, sensor array 204 detects wavelengths less than about 2.5 microns. Processing circuitry 206 can include pixel reading circuitry and pixel driving circuitry as well as controllers or processors, including microprocessors and microcomputers, for receiving data from sensor array 204, processing that data, and providing the data to the microprocessors in mobile device 100 for further analysis and display to the user.
Processing circuitry 206 may also control the intensity and duration of light produced by light source 202, which may be pulsed or continuous, and may gate sensor array 204 accordingly. In some embodiments, a pulse of light of a particular duration may be produced by light source 202 followed by a data acquisition period where sensor array 204 receives the incoming light and accumulates a charge or voltage related to the intensity of light received. Processing circuitry 206, after some acquisition period, then reads integrated values of light received by the pixel array in sensor array 204. In some embodiments, a decay process may be monitored by periodically sampling the integrated values to determine the light received as a function of time. In some embodiments, light source 202 may be a camera flash, which can then be controlled by processing circuitry either directly or through microprocessors or microcomputers in the host device such as mobile device 100.
As is further illustrated in
As is further illustrated in
In some embodiments, controller 256 can interface with an external programmable device such as a microcontroller (MCU) or application processor (AP). In addition, controller 256 may interface with processors of mobile device 100, and therefore is controlled by instructions stored in mobile device 100. Consequently, processing circuitry 206, which includes controller 256, receives data from sensor array 204, provides processing, and outputs data to an external programmable device.
As illustrated in
Light source driver 254 is coupled to drive light source 202 at the direction of MCU 256. Sensor driver 252 is coupled to drive light sensor elements of sensor array 204, in particular to provide power and control signals to sensor array 204. MCU 256 is also coupled to readout 250, which is coupled to receive signals from each of the active areas (pixels) of sensor array 204. Readout 250 can include analog filtering, amplification, integration, and digitization of signals received from light sensor elements of sensor array 204. In some embodiments, readout 250 may include analog integrators that integrate over time periods set by programming in microprocessor 256 the current signals received from sensor array 204. In embodiments where light source 202 is the flash from a camera, light source driver 254 can provide a signal to a supporting device that drives the camera flash accordingly.
An output aperture array 314 is formed over pixels 316 such that each of pixels 316 receives light through one of output apertures 322 of output aperture array 314. Spectral filtering microlenses 310 are formed over each of pixels 316 and separated from pixels 316 and corresponding apertures of aperture array 314 by a focal distance spacer layer 312. Each spectral filtering microlens 310 focuses a spectral transmission profile that is unique to each pixel onto the corresponding pixel 316 such that the spectral transmission profile varies across the array. Air-gap input apertures 304 are formed in an opaque material 306 formed over spectral filters 310. Apertures 304 are spaced from microlenses 310 by a spacer 308, which may be a glass wafer spacer or other transparent material. A diffuser 302 may be formed over opaque material 306 and input aperture 304.
As discussed above, spectrometer 300 according to some embodiments is based on an array of pixels 324 where each pixel 316 shares a similar field of view because light either enters from a strong diffuser 302 or from a diffuse source/target.
Pixels 316 can be electronically coupled to processing circuitry formed in substrate 318, which is coupled to electrical contacts 320. As discussed above, the processing circuitry may be processing circuitry 206 as illustrated in
As discussed above, electrical contacts 320 include through silicon vias in silicon substrate 318 as well as ball connectors that interface spectrometer 300 to other components on a printed circuit board. Electrical contacts 320 are formed substrate 318 of image sensor 326. There are a variety of techniques for forming electrical contacts 320, including through silicon vias (TSV). Typically, this involves thinning substrate 318 substantially, however at this point transparent spacer 308, which may be a glass handling wafer, provides most of the mechanical strength to spectrometer 300.
As discussed above, then, spectrometer 300 includes an optical sensor array 324 that includes a substrate 318 with a lateral dimension, a bottom side, and a top side that receives light into pixels 316. Further, an array of spectral filters 310 is formed over optical sensor array 324. As discussed above, spectral filters 310 can be formed of microlenses having subwavelength features 330 which are systematically varied across the array of spectral filters 310 to obtain varied spectral transmissions through to pixels 316 in optical sensor array 324. In some embodiments, each filter 310 in the array of spectral filters is arranged to focus light of a particular wavelength range determined by the subwavelength features 330 through apertures 322 and provides a spectral transmission profile on a corresponding pixel 316. As illustrated in
Output apertures 322 can also be open areas or can be formed from a transparent dielectric. The focus of light from spectral filter microlenses 310 provides an area of focus on output aperture 322. In some embodiments, the open areas of output apertures 322 can be less than 10% of the focal area created by spectrally filtering microlenses 310 and spacer 312. Output apertures 322 can be formed in a layer of absorptive material.
Spectrometer 300 includes a transparent spacer 308 attached above spectral filters 310. Transparent spacer 308 has a thickness that is less than the lateral dimension of optical sensor array 324. Transparent spacer 308 can be any transparent material, including a glass spacer or other dielectric material. Opaque mask 306, where input apertures 304 are formed where light can pass, is formed on transparent spacer 308. Opaque mask 306 can be formed of a material that strongly absorbs light incident on spectrometer 300. In some embodiments, there may be four or more spectral filters 310 below each of input apertures 304. Considering the transverse direction traversed by light rays traveling at a maximum angle refracted in transparent spacer 308, input apertures 304 are spaced by a separation that keeps light entering from each of the input apertures 304 from overlapping on spectral filters 310. In some embodiments, the minimum separation between input apertures 304 is twice the maximum transverse direction determined by the maximum angle, the thickness of transparent spacer 308, and the index of transparent spacer 308.
As shown in
The optics can be formed monolithically on top of the image sensor array of pixels 316. With multiple smaller apertures 322 to illuminate respective portions of sensor array of pixels 316, a much smaller overall height can be achieved. This enables diverse space-constrained applications and potentially reduced costs. In some embodiments, transparent spacer 308 can have a thickness of about 0.2 to 1.0 mm. Input apertures 304 can be spaced than the thickness of transparent spacer 308. The diameter or width of input aperture 304 can be, for example, less than half the thickness of transparent spacer 308.
Spectrometer 300 illustrated in
Light from diffuser 302 entering glass spacer 308 through input aperture 304 refracts to less than about 45 degrees, or 42 degrees for the most common glasses. With adjacent input apertures 304 being separated sufficiently, light from adjacent apertures 304 can be limited to be incident on a selected region of image sensor array 324. Whereas, if diffuser 302 is formed in the handle wafer glass 308, for instance by sand blasting or grinding the glass, light may be scattered into very high angles and pixels may receive light from more than one aperture 304 and from high angles, which is less desirable. Thus, an air gap (or low index material) that forms input aperture 304 that is present between diffuser 302 and the handle wafer glass spacer 308 is useful for the invention. Consequently, diffuser 302 may be, for example, patterned (engineered diffuser) in glass or plastic, ground glass, Teflon, or any other suitable diffusing medium and attached onto opaque material 306 in which input apertures 304 are formed.
In some embodiments, output apertures 322, dielectric focal layer and spectral filters 310 are formed on the transparent spacer layer 308. The transparent spacer layer 308 can then be assembled with the optical sensor array.
Electrical contacts 320 are formed substrate 318 of image sensor 326. There are a variety of techniques for forming electrical contacts 320, including through silicon vias (TSV). Typically, this involves thinning substrate 318 substantially, however at this point handle wafer glass spacer 308 provides most of the mechanical strength to spectrometer 300.
Individual spectrometers 300 can be singulated from the wafer using a cutting process such as a dicing saw, laser cutting, scribe and cleave, or other methods. This results in planar sidewalls shared by substrate 318 and glass spacer and handle wafer 308. Diffusers 302 can be assembled on diced spectrometers. The order of assembly of optional diffusers 302 above input apertures 304 can be accomplished prior to or after being separated into separate spectrometers on the wafer.
In some embodiments, spectrometer 300 is formed with high-temperature compatible materials. Such construction is useful for a spectrometer module that can be attached to a printed circuit board using a solder reflow process at temperatures that are typically around 135-300° C., usually peaking at about 250° C.
In one example, the thickness of glass separator 308 can be about 650 um. An input aperture diameter of about 150 um can also be used. With those parameters, the air-equivalent angular subtense is about 20°. Since wafer level processes are used to form spectrometer 300, the alignment of input aperture 304 to array 324 can be very precise. For example, lithographically-defined features typically have alignment tolerances in the micron range, whereas die assembly processes are in the tens of microns range. In an example with an 8×8 sensor array with 50 um pitch, the angle to edge or corner can be 17 or 23°, or air equivalent of 25 or 33°.
To accommodate more pixels 316 without increasing the height of spectrometer 300, more input apertures 304 can be used. A glancing incidence light ray 402 (
M=asin(n1/n2),
where n1 is the index of refraction of the material above glass spacer 308 (e.g. 1 for the air gap in input aperture 304) and n2 is the index of refraction of the glass in glass spacer 308. In an example where the thickness T of glass spacer 308 is 500 um, the maximum distance L a ray can traverse laterally is given by
L=T*tan(M).
Accordingly, the distance between input apertures 304 should greater than 2L so that each set of pixels 316 receives light through a single one of input apertures 304. For glass with index n2=1.45, L˜950 um. For input apertures 304 with a diameter of 100 um, another 100 um should be added, so the aperture spacing should be greater than about 1.05 mm.
With a 100 um diameter input aperture 304, the angular subtense at sensor array 324 is about 0.2 radians, or about 11.5° (or the air equivalent of 16-17°). If filter microlens array 310 has a pitch of 50 um and a 4×4 array of pixels 316 is placed under each microlens of microlens array 310, then the chief ray angle from the center of the input aperture to the edge of each lens array is 11°. The angle to corner is 16°. For small angles, the equivalent angles in air can be determined by scaling the angle in glass by the index of refraction n2.
Spectral microlens filter array 310, which uses microlenses and pinholes, is selective for light within a limited input angle range. High angle rays focus off-axis, and away from the output aperture (pinhole) 322. Out of band light is not strongly focused and may contribute some amount of crosstalk if present. If this is tolerable, spectrometer 300 can be calibrated as such. In this case, the spacing between the apertures can be reduced to less than the minimum specified by the maximum refracted light ray angle, for example 600 um.
Consequently, as discussed above embodiments according to the present invention include a monolithic spectrometer with one or more input apertures for simple, low cost and robust assembly. The spectrometer is based on a light sensor array 324 of pixels 316, which may be a CMOS, CCD or IR-ROIC that are commonly used for imaging. As discussed above, sensor array 324 is not used for imaging. Each pixel 316 shares a similar a field of view because light either comes from a strong diffuser 302 or diffuse source/target. The pixels 316 are each covered with a spectral filter 310. Spectral filters 310 are described can be based on a dispersive lens and aperture combination. The focal length of the dispersive lens varies with different wavelengths of light. The output aperture 322, placed over each pixel 316, operates as a spatial filter and functions as a spectral bandpass filter.
The monolithically structure formed on sensor array 324 can be formed with wafer-scale processes as described above. There may be one or more input apertures 304 formed above sensor array 324. When multiple smaller input apertures 304 are used to illuminate respective portion of sensor array 324, a much smaller overall height can be achieved enabling diverse space-constrained applications and potentially reducing costs.
The above detailed description is provided to illustrate specific embodiments of the present invention and is not intended to be limiting. Numerous variations and modifications within the scope of the present invention are possible. The present invention is set forth in the following claims.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6171885 | Fan | Jan 2001 | B1 |
| 6395576 | Chang | May 2002 | B1 |
| 6495813 | Fan | Dec 2002 | B1 |
| 20020036828 | Wong | Mar 2002 | A1 |
| 20070029277 | Jacobowitz | Feb 2007 | A1 |
| 20080048102 | Kurtz | Feb 2008 | A1 |
| 20110211185 | Jak | Sep 2011 | A1 |
| 20190237500 | Enichlmair | Aug 2019 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20210096025 A1 | Apr 2021 | US |
