Patent Application
20210257398
This application claims priority to the European Patent Application EPC, No. 20157949.7, filed on Feb. 18, 2020, which is incorporated herein by reference.
The present invention relates to spectral sensors and an image sensor comprising a plurality of spectral sensors.
There are many applications in which it is desirable to acquire spectral images of an object. In this type of imaging, spectral information of an object is detected in multiple narrow ranges of wavelengths. Two such techniques are called multispectral imaging and hyperspectral imaging, and while no definitions have been established, multispectral imaging typically refers to spectral imaging using a plurality of discrete wavelength bands, whereas hyperspectral imaging refers to imaging narrow spectral wavelength bands over a continuous spectral range. Hyperspectral imaging may also often use a larger number of spectral bands than what is used in multispectral imaging.
With advances to semiconductor fabrication, it is now possible to produce image sensors based on complementary metal-oxide-semiconductor (CMOS) technology, wherein a substrate comprising an array of light detecting elements is integrated with filters for selectively transmitting light to the light detecting element
The integrated filters may define different spectral bands associated with different light detecting elements. For instance, spectral bands may be associated with different rows of light detecting elements, such that when a line scan is performed, an image of high spectral and spatial resolution may be acquired. Alternatively, a mosaic configuration of spectral bands may be arranged on the array of light detecting elements, such that a set of light detecting elements is associated with a plurality of filters and may together acquire spectral information of a portion of an object. An image sensor having a mosaic configuration of filters may be used for acquiring an image with a spectral resolution in a single exposure.
The spectral range of these integrated filters, implemented by stacking alternating layers of low and high refractive index, depends heavily on the contrast in the refractive index of the materials. However, due to their spectral selectivity, the filters inherently reduce the amount of light reaching the light detecting elements, which in turn reduces the sensitivity. In other words, in order to achieve the spectral selectivity, the sensitivity is reduced.
According to a first aspect a spectral sensor is provided. The spectral sensor comprising: a light detecting element; a microlens; and an interference filter arranged between the light detecting element and the microlens, and configured to transmit light in one or more spectral bands; wherein the microlens has an effective focal length exceeding a distance between the microlens and the light detecting element.
Within the context of this disclosure, “light detecting element” is to be construed as a structure sensitive to light, e.g. a photo-diode of a pixel of an image sensor. In any case, “light detecting element” may comprise a light sensitive volume (e.g. a depletion zone of a PN-junction).
Within the context of this disclosure, the term “microlens” may for example be construed as a lens having a diameter in a range from 1 μm to 15 μm. The microlens may be a positive lens, i.e. collimated light incident on the microlens is converging subsequent to being refracted by the microlens. Such a lens may also be called a converging lens. The microlens may, e.g., be a plano-convex lens, a graded index (GRIN) lens, a Fresnel lens etc. Generally, the diameter of a microlens may relate to the pixel pitch, wherein a typical pixel pitch includes sizes in a range from 1 μm to and 15 μm.
Within the context of this disclosure, “interference filter” is to be construed as a structure having at least two or, preferably, multiple layers, and that allows transmission of certain wavelengths by utilizing interference effects for light propagating through the interference filter. Due to the construction of interference filters, which wavelengths that are transmitted through it are usually highly dependent on the angle (commonly referred to as the angle of incidence) with which light is incident on the interference filter. Interference filters are typically designed to transmit wavelengths within one or more spectral bands for light having a design angle of incidence (e.g. normal incidence) on the interference filter. However, for light incident on the interference filter with angles different from the design angle of incidence, the one or more spectral bands for light transmitted through the interference filter may be shifted in wavelength.
Within the context of this disclosure, “effective focal length” is to be construed as a distance from the microlens to a position at which collimated light incident on, and refracted by, the microlens converges. This position may within the art be referred to as the principal focus. At this position, the light refracted by the microlens, if allowed to freely propagate after the microlens, reaches a smallest light spot size. For an ideal lens, the smallest spot size may correspond to the diffraction-limited spot size. Further, converging and diverging light incident on the microlens reaches a smallest spot size at distances different from the effective focal length. As is generally known within the art, the effective focal length may be different for different wavelengths of light.
The inventors have realized that a spectral sensor having an enhanced sensitivity and spectral selectivity is possible by configuring the microlens such that the smallest light spot size is positioned behind the light detecting element associated with the microlens. In a conventional configuration, microlenses may be used to increase the amount of light reaching light detecting elements of an image sensor such that the smallest light spot size coincides with the light detecting element (e.g. the sensor plane) in order to increase the light intensity incident on the light detecting element. However, as the inventors have realized, using the conventional configuration of the microlens in the spectral sensor may shift a peak transmission wavelength for light transmitted through the interference filter and may increase a full width at half maximum (FWHM) of the transmission peak of light transmitted through the interference filter. This is an effect of converging light propagating through the interference filter, since the wavelength of light that is transmitted through the interference filter depends on the angle (relative to, e.g., the normal of the interference filter) with which the light propagates through the interference filter. Hence, in case the angular range with which light propagates through the interference filter is increased (e.g., through focusing by the microlens), so may the range of wavelengths that are transmitted through the interference filter. This means that the spectral selectivity of the spectral sensor may be reduced when using a conventional configuration of the microlens in the spectral sensor. By means of the present inventive concept, light strikes the interference filter with smaller variation of angles relative to the design angle of incidence (e.g. normal incidence) of the interference filter than for the conventional configuration of the microlens. In other words, a larger fraction of the light strikes the interference filter at more similar angles. In this way, the fraction of light within the one or more spectral bands transmitted through the interference filter may be increased. Thus, the sensitivity and the spectral selectivity of the spectral sensor may be enhanced compared to a spectral sensor having a conventional configuration of the microlens.
The microlens may be configured to direct light in the one or more spectral bands towards the light detecting element and through the interference filter.
The interference filter may comprise a first multilayer and a second multilayer separated by an intermediate layer.
The first multilayer and/or the second multilayer may comprise alternating layers of different materials having different refractive indices and/or thicknesses.
The microlens may be configured such that light refracted by the microlens, to be transmitted through the interference filter, converges towards a position behind the light detecting element, e.g. a position behind a light sensitive volume of the light detecting element.
The effective focal length of the microlens may exceed the distance between the microlens and the light detecting element, at least for light having a wavelength within the one or more spectral bands.
According to a second aspect a spectral sensor is provided. The spectral sensor comprising: a light detecting element; a microlens; and an interference filter arranged between the light detecting element and the microlens, and configured to transmit light in one or more spectral bands (e.g. within a wavelength range); wherein the microlens is configured such that light (e.g. within the wavelength range) refracted by the microlens, to be transmitted through the interference filter, converges towards a position behind the light detecting element.
“Behind the light detecting element” should here be understood as seen in a direction of the light incident on the light detecting element. The microlens may be configured such that light (e.g. in the one or more spectral bands within the wavelength range) refracted by the microlens, to be transmitted through the interference filter, converges towards a position behind a light sensitive volume of the light detecting element.
The above-mentioned features of the first aspect, when applicable, apply to this second aspect as well. In order to avoid undue repetition, reference is made to the above.
The interference filter may comprise a first multilayer and a second multilayer separated by an intermediate layer.
The first multilayer and/or the second multilayer may comprise alternating layers of different materials having different refractive indices and/or thicknesses.
An effective focal length of the microlens may exceed a distance between the microlens and the light detecting element, at least for light having a wavelength within the one or more spectral bands.
According to a third aspect an image sensor is provided. The image sensor comprising: a plurality of spectral sensors according to any preceding aspect; and wherein the interference filters of at least two of the spectral sensors are configured to transmit light in different spectral bands.
In view of the above discussion in connection with the first aspect, it may be appreciated that an advantage of the third aspect is that an image sensor capable of spectral imaging having an enhanced sensitivity and spectral selectivity is allowed. The above-mentioned features of the first aspect and the second aspect, when applicable, apply to this third aspect as well. In order to avoid undue repetition, reference is made to the above.
The light detecting element(s) (of any of the first through third aspects) may be formed as active pixels in a complementary metal-oxide-semiconductor (CMOS) substrate, and wherein the interference filter(s) and/or the microlense(s) are monolithically integrated with the CMOS substrate.
A further scope of applicability of the present disclosure will become apparent from the detailed description given below. However, it should be understood that the detailed description and specific examples, while indicating preferred variants of the present inventive concept, are given by way of illustration only, since various changes and modifications within the scope of the inventive concept will become apparent to those skilled in the art from this detailed description.
Hence, it is to be understood that this inventive concept is not limited to the particular component parts of the spectral sensors and image sensor described as such may vary. It is also to be understood that the terminology used herein is for purpose of describing particular embodiments only and is not intended to be limiting. It must be noted that, as used in the specification and the appended claim, the articles “a”, “an”, “the”, and “said” are intended to mean that there are one or more of the elements unless the context clearly dictates otherwise. Furthermore, the words “comprising”, “including”, “containing” and similar wordings do not exclude other elements or steps.
The above and other aspects of the present inventive concept will now be described in more detail, with reference to appended drawings showing variants of the invention. The figures should not be considered limiting the invention to the specific variant; instead they are used for explaining and understanding the inventive concept.
As illustrated in the figures, the sizes of layers and regions are exaggerated for illustrative purposes and, thus, are provided to illustrate the general structures of variants of the present inventive concept. Like reference numerals refer to like elements throughout.
The present inventive concept will now be described with reference to the accompanying drawings, in which currently preferred variants of the inventive concept are shown. This inventive concept may, however, be implemented in many different forms and should not be construed as limited to the variants set forth herein.
The light detecting element 110 may, e.g., be a semiconductor photo-diode such as of a complementary metal-oxide semiconductor (CMOS) or a charge-coupled device (CCD) image sensor, or an organic photo-diode (OPD). In any case, the light detecting element 110 may comprise a light sensitive volume, e.g. of a PN-junction or PIN-junction formed in a substrate of the spectral sensor 10.
The interference filter 130 is arranged between the light detecting element 110 and the microlens 120. The microlens 120 may be configured to direct light towards the light detecting element 110 through the interference filter 130.
The interference filter 130 is configured to transmit light in one or more spectral bands. Which spectral bands that the interference filter 130 transmits light within depends on the angle with which the light strikes the interference filter 130. Typically, the one or more spectral bands are defined for light striking the interference filter 130 within a narrow range of angles relative to the normal of the interference filter 130. Thus, the fraction of light within the one or more spectral bands transmitted through the interference filter 130 and reaching the light detecting element 110 depends on the angles with which the light strikes the interference filter 130. Typically, increasing the range of angles changes the characteristics of a response of the interference filter 130. For example, increasing the range of angles may increase the FWHM of the transmission peak of light transmitted through the interference filter 130.
The interference filter 130 may comprise a first multilayer 132 and a second multilayer 134 separated by an intermediate layer 136. The first multilayer 132, the second multilayer 134 and the intermediate layer 136 may be configured such that the interference filter 130 provides constructive interference for light in the one or more spectral bands. In other words, light in the one or more spectral bands is allowed to propagate through the interference filter 130, while light not in the one or more spectral bands is reflected by the interference filter 130.
The first multilayer 132 and the second multilayer 134 may comprise alternating layers of different materials having different refractive indices as is shown in the example of
The spectral sensor 10 may be configured to sense light having wavelengths in the ultraviolet (UV) range, visible range, infrared (IR) range, far IR range, etc. It is to be understood that the light detecting element 110, the microlens 120, and the interference filter 130 may be chosen depending on the wavelength range the spectral sensor 10 is designed to sense.
As is seen in
This configuration may hereinafter be referenced to as the defocused configuration. The effective focal length F of the microlens may exceed the distance D between the microlens and the light detecting element, at least for light having a wavelength within the one or more spectral bands.
Using the defocused configuration, light strikes the interference filter 130 with smaller angles relative to the normal of the interference filter 130 than fora conventional configuration of the microlens 120. In a conventional configuration of the microlens 120 is typically configured such that light converges towards a position P2 coinciding with the light detecting element 110 in order to increase the light intensity on the light detecting element 110.
In
As is understood from
According to some non-limiting examples, a distance (e.g. a Snell distance) between a microlens (e.g. 120) and a position (e.g. P1) towards which light refracted by the microlens to be transmitted through the interference filter (e.g. 130) converges, may be at least twice (i.e. a factor of or greater than) a distance (e.g. a Snell distance) between the microlens and the light detecting element (e.g. the light sensitive volume of the light detecting element 110). “Snell distance” (or “refractive height”) of a layer with index of refraction n and thickness d is hereby defined as d/n, in order to represent the change in tilt angles in a medium with index of refraction n due to Snell's law.
The image sensor 20 may be comprised in a camera (not shown). The camera may further comprise an imaging system (not shown). The imaging system may be a camera objective (not shown). It is to be understood that the configuration of the microlens 120 may be adapted to the imaging system, since the light collected by the imaging system may be converging as it reaches the microlens 120. In other words, the configuration of the microlens 120 may be adapted to the imaging system such that light collected by the imaging system and directed towards the microlens 120 converges towards the position P1 behind the light detecting element 110 of the spectral sensor 10.
It is to be understood that interference filters of neighboring spectral sensors may be configured to transmit light in identical or similar spectral bands, even though the first and second spectral sensor 10a, 10b are illustrated as being neighboring spectral sensors in
The person skilled in the art realizes that the present inventive concept by no means is limited to the preferred variants described above. On the contrary, many modifications and variations are possible within the scope of the appended claims.
For example, the microlens 120 is shown in
Additionally, variations to the disclosed variants can be understood and effected by the skilled person in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 20157949.7 | Feb 2020 | EP | regional |
