The present disclosure relates to the field of optics and photonics, and more specifically to optical devices used in image sensors.
This section is intended to introduce the reader to various aspects of art, which may be related to various aspects of the present invention that are described and/or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present invention. Accordingly, it should be understood that these statements are to be read in this light, and not as admissions of prior art.
In order to acquire color components during the acquisition of an image, usually an image sensor can either use a Bayer filter (which is a way of discretizing the color space, that requires the execution of a kind of interpolation later for generating a color image), or a Fovea sensor (being able to record three color components per pixel via a stack of color sensors, i.e. the color sensors are piled up on each other's).
In order to provide alternatives to the known techniques, it is proposed in the following a specific structure/architecture for achieving the color splitting functionality within image sensors.
References in the specification to “one embodiment”, “an embodiment”, “an example embodiment”, indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to affect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
In one aspect, it is proposed an image sensor comprising pixels for acquiring color information from incoming visible light, wherein said image sensor being associated with a three-dimensional cartesian coordinate system defined by axis x, y and z, wherein the z-axis being normal to said image sensor, said image sensor comprising at least two pixels being partially covered by a color splitter structure comprising a first part and a second part, that are positioned side by side along said x-axis, and each of said first and second parts being adjacent to a dielectric part along said x-axis, each of said dielectric part having a first refractive index n1, said first part having a second refractive index n2, and said second part having a third refractive index n3, wherein n1<n3<n2, and wherein according to a cross section with a plane xz, the first part of said color splitter structure has a first width W1 along the x-axis, a height H along the z-axis and the second part of said color splitter structure has a second width W2 along the x-axis, and the same height H along the z-axis , and wherein said color splitter structure further comprises, according to said cross-section:
where ΘB1 and ΘB3 are respectively radiation angles of said first and said third beams, and wherein light associated with a first wavelength λ1 is recorded by one of said at least two pixels and the other components of light by the other of said at least two pixels, wherein said first wavelength λ1 belongs to one of ranges [390 nm, 450 nm] and [620 nm, 700 nm] of visible light.
With the invention, color components (such as the blue, green and red components) of the light are deviated in different directions that can be later recorded by different photodiodes or pixels of the image sensor.
Indeed, lengths of the NJ beams generated by the edges of the color splitter structure, at the interface between two different materials, are directly proportional to the incident wavelength. These NJs will interfere and the result will determine which direction is the overall splitting direction for the color splitter element. The design rule H=HB gives a simple recipe for the case where these two directions are easily distinguishable and so the color splitting is pronounced.
In a variant, the image sensor has parameters with n3>√{square root over (n1n2)} and a width W of said color splitter structure, equal to W1+W2 , is greater than 390 nm, and said one of said at least two pixels that records light associated with said first wavelength λ1 is located at the normal of said first part of said color splitter structure, in the case said first wavelength λ1 belongs to the range [620 nm, 700 nm] of visible light.
In a variant, the image sensor has parameters with n3>√{square root over (n1n2)} and a width W of said color splitter structure, equal to W1+W2 , is greater than 390 nm, and said one of said at least two pixels that records light associated with said first wavelength λ1 is located at the normal of said second part of said color splitter structure, in the case said first wavelength λ1 belongs to the range [390 nm, 450 nm] of visible light.
In a variant, the image sensor has parameters with n3<√{square root over (n1n2)} and a width W of said color splitter structure, equal to W1+W2, is greater than 390 nm, and said one of said at least two pixels that records light associated with said first wavelength λ1 is located at the normal of said second part of said color splitter structure, in the case said first wavelength λ1 belongs to the range [620 nm, 700 nm] of visible light.
In a variant, the image sensor has parameters with n3<√{square root over (n1n2)} and a width W of said color splitter structure, equal to W1+W2, is greater than 390 nm, and said one of said at least two pixels that records light associated with said first wavelength λ1 is located at the normal of said first part of said color splitter structure, in the case said first wavelength λ1 belongs to the range [390 nm, 450 nm] of visible light.
In a variant, said visible light comprises electromagnetic waves having wavelengths that go from 390 nm to 700 nm.
In a variant, said first width W1 and said second width W2 are equal to each other.
In a variant, each pair of pixels is partially covered by a structure identical to said color splitter structure.
In a variant, each pair of pixels is partially covered by a structure that is alternatively either a structure identical to said color splitter structure, or a structure comprising first and second parts which are inverted compared to said color splitter structure.
In a variant, each successive structure is separated by an identical dielectric part having a width, along the x-axis, equal to W3, and wherein the value of W3 is comprised between 250 nm and 600 nm.
In a variant, each first and second part, and said dielectric part are made of a material that belongs to the group comprising:
In a variant, at least one pixel of said at least two pixels further comprises conventional color filter positioned between said color splitter structure and photosensitive materials associated with each of said at least two pixels.
In a variant, said height H is around ±5% of the value HB.
In a variant, said radiation angles of said first and said third beams ΘB1 and ΘB3 are equal to
where angles αj, with j equals to 1 or 3, are the base angles for said first and third edges, and ΘTIBj, with j equals to 1 or 3, are critical angles of refraction associated with respectively said first and third edges.
In a variant, the image sensor is remarkable in that said one of said at least two pixels that records light associated with said first wavelength λ1, further receives light associated with said first wavelength from another neighbor color splitter structure.
In a variant, the image sensor is remarkable in that said other of said at least two pixels further receives light, having a spectrum in which no or few electromagnetic waves having a wavelength equal to λ1 are present, from another neighbor color splitter structure.
The present disclosure can be better understood with reference to the following description and drawings, given by way of example and not limiting the scope of protection, and in which:
The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention.
The present disclosure relates to a technique for splitting color-bands of an incident visible light by combining two or more dielectric materials with different refractive indexes (the refractive indexes of constitutive parts are higher than the surrounding material) in such a way that all the nanojets (NJ) beams, originating from different edges (associated with different blocks/layers) of the microstructure, recombine and contribute to the formation of a spectral-dependent NJ beam deflection.
For reminders, the generation of NJ beams is described in document EP 3 223 063. Numerical simulations demonstrate that proposed principle of color splitting based on the NJ beam deflection can generate focused color images. The characteristics of the generated NJ beams are controlled by the parameters of the corresponding blocks, i.e. refractive index ratios between the blocks, dimensions of the blocks and angle of wave incidence.
In the following an element or structure that can perform such color splitting or deviating structure is a specific configuration of a more general design of a NJ beam forming element (also called hereafter a double-material structure) which is a combination of at least two dielectric materials with different refractive indexes having a nonsymmetrical or a symmetrical system in a vertical cross-section. Hereafter, structures having such a topology are referred to as structures based on a combination of different materials.
Such a double-material structure 10, in cross-section view, corresponds to a combination of two different blocks of materials, referenced 12 and 13. Such blocks 12, 13 may have a shape of cuboid, for example in the 3D XYZ space, or a shape of semi-circular ring. Their cross-section is rectangular (as illustrated in
Blocks referenced 12 and 13 respectively have refractive indexes n2 and n3 (n2>n3) embedded in a homogeneous dielectric host medium 11 with a refractive index n1<n3. For simplicity, we assume that all the materials are lossless and non-dispersive.
Blocks 12 and 13 could also be placed on a dielectric substrate (not illustrated) acting as a support layer. Block 12 has a width W1 and a height H, while block 13 has a width W2 and the same height H.
Hereafter, we consider that blocks 12, 13 have vertical edges parallel to z-axis and top/bottom surfaces parallel to xy-plane, which corresponds to a base angle α=90°. However, some prismatic structures (with arbitrary base angles) can also be used. Variation of the base angle value provides additional degree of freedom in the control of the NJ beam radiation.
The double-material structure 10, once it receives an incident light or electromagnetic wave 14, generates several nanojets beams (the three nanojets beams NJ1, NJ2 and NJ3 generated respectively by edges of the double-material structure 10) that can intersect in different hot spots or focused points or locations referenced as points A, B and C.
According to the present disclosure, the materials and size of the constitutive parts 11, 12 and 13 can be optimized in order to manage the position of NJ hot spots, intensity, direction and angle of deviation of NJ beams.
In this Section, we present a set of equations to estimate the optimal combinations of materials and dimensions of the blocks 12, 13 for NJ beam shift and deviation. The hot spot position and direction of beam deviation are sensitive to the sizes (W1, W2, H) of constitutive parts. For structures 10 with dimensions larger than a few wavelengths the Fresnel diffraction phenomenon will have a huge impact.
As demonstrated in patent document EP 3 223 063 in the name of the same Applicant, the beam-forming phenomenon appears on an edge between two materials of different refractive indexes, and is associated solely with this edge. The ratio of refractive indexes between both materials contributes to controlling an elevation angle of the generated nanojet beam, which is an angular position of a projection of the NJ beam in the vertical xz plane. Actually, the NJ beam radiation angle is defined by the Snell's law and can be determined using the approximate formula:
where
is the critical angle of refraction, n1 is the refractive index of the host medium 11, and n2 is the refractive index of a part of the double-material structure. The point of intersection of two equal NJ beams radiated from the opposite sides of the element determines the focal length of the NJ structure. In a first approximation, in the case of a single material element the focal length of the NJ structure can be characterized as the function of the size (width) and index ratio of the media inside and outside the structure. The total radiated NJ beam will be directed along the symmetry axis of the system.
As illustrated in
where
The NJ beam radiation angle at the third edge, between block 13 and host medium 11, corresponds to:
Let us note that the length and intensity of these three NJs, generated by the three edges between the materials 11, 12 and 13 with different refractive indexes, will be different. The maximal intensity and minimal length correspond to the beam with highest ratio between the refractive indexes. In the exemplary case illustrated in
The three nanojet beams generated at the boundaries between the materials of different refractive indexes of optical device 10 may partially or totally combine, to produce a total focused beam, which corresponds to the interference pattern caused by the three primary nanojet beams associated with the three edges of device 10.
To explain the behavior of total NJs radiated by the double-material structure 10, we should determine the points of intersection (denoted A, B and C on
The point A of first (NJ1) and second (NJ2) NJs' intersection has the coordinates (WA,HA), where:
First (NJ1) and third (NJ3) NJs will intersect at a point B with the coordinates (WB,HB), where:
It is necessary to note, that second (NJ2) and third (NJ3) nanojets will intersect only if n3≥√{square root over (n1n2)}. In this case, the coordinates of the point C will be determined as:
Our numerical simulations presented below have demonstrated that spectral-dependent NJ beam deflection for 3 different wavelengths (λ1<λ2<λ3) is observed for W≅λ2 and H≅HB. For such parameters of the system, the direction of NJ deviation depends on the wavelength of incident wave. Particularly, we have observed that for n3>√{square root over (n1n2)} (
Here, we discuss the influence of the angle of plane wave incidence (θi,
To obtain the value of the height HB, we should substitute these angles into eq.(5).
Based on the identified properties of the structure depicted in the
Indeed, in one embodiment of the disclosure, it is possible to deviate color components (such as the blue, green and red components) of the light in different directions that can be later recorded by photodiodes in an image sensor.
The
Hence,
It is possible to see 2 Nis (one NJ is the combination of NJ1 and NJ2) of different length situated above the constitutive parts of the structure. The length of these NJs is different (longest NJ is situated above the part with higher refractive index n2). By selecting the height of the structure up to or around H≅HB we can observe redistribution of the power density between two generated NJs situated above the constitutive parts of the structure. As the result, we obtain that for λ=450 nm right NJ will be longer than left. So, at some distance from the top surface of the element, we will observe that the spot for a blue color will be situated above the part with lower refractive index and the spots for green and red colors will be above the part with higher refractive index. Hence, the spectral-dependent NJ beam deflection takes place if H≅HB and focal point B for the NJs related to the external boundaries of the structure (NJ1 and NJ3) is close to the surface of structure or within the structure. Playing with the materials of the layers, we can change power density distribution for different colors.
To study the mutual influence of the neighbouring NJs on the power density redistribution, we consider two different arrays of double-material structures. The investigated topologies are presented in
More precisely,
Hence, with the configuration described in
Let us note that for double-material dielectric structure with n3>√{square root over (n1n2)} the spots corresponding to the green and red colors are quite close. As it was mentioned before, changing the materials of the layers we can manage the position of the spots.
Indeed,
The neighbouring Nis more affect each other if we reduce the width W3 (
Indeed,
To analyze the influence of the distance between the elements in the array on the color splitting phenomenon, we consider the dependence of peak power density and x-coordinate of the NJ hot spot on W3 (
Indeed,
NJ field distribution dramatically changes with the angle of wave incidence. Let us consider the possibility to use double material dielectric structures for color splitting in the case of oblique incidence. It was observed that for oblique incidence, we have additional deviation of the NJs related to the edges of the system. So, the position of point B will be changed. The dispersion of NJ response and mutual influence of the neighbouring NJs will lead to the shift of the spots corresponding to the different colors and totally new redistribution of the power density.
Increasing the angle of electromagnetic wave incidence (
5.2.5 2D Arrangement of the Color Splitters
In this section, we propose one embodiment that uses the designs in the previous section (5.2.4) to realize a full 2D arrangement of the color splitter elements on top of the image sensor pixels.
This embodiment uses the two types of color splitter structures shown
It is possible to design a color splitter structure that can “deviate” electromagnetic waves with a specific wavelength λ1and that can deviate in another direction light having a spectrum in which no or few electromagnetic waves having a wavelength equal to λ1 are present. Hence, each pixel (between pixel 1 and pixel 2) record a different value, for different colors. In a variant, a conventional color filter is added at the top of the photosensitive material in order to filter residual electromagnetic waves.
5.2.6 Modification of the Base Angle of the Structure with Dual Materials
In this subsection, we consider the structures with nonvertical edges and top/bottom surface parallel to xy-plane. Let us assume that αi (with i equals to 1, 2 or 3) are the base angles for a double-material system. The general topology of the double-material NJ structure is illustrated in
For the structure with the base angles αi (with i equals to 1, 2 or 3) the NJ beam radiation angle ΘBj can be determined using the approximate formula (08):
Here Θ′TIRj are the critical angles of refraction from the nonvertical edges. To get the approximate formula for Θ′TIRj we should just take into account the changing of the position of the edge. As the result, the NJ beam radiation angle can be estimated as:
To explain the behavior of total NJs radiated by the double-material structure 10 we should substitute these expressions for NJ radiation angles into the formulas (04)-(07).
In the case of the system with nonvertical edges the main performance characteristics of the double-material system discussed before are preserved.
The change of the base angle will change the direction of the NJs and so it affects the crossing points of the nanojet and the color splitting effect. The design rule for a color splitter with non-vertical base angle is to calculate the new NJ deviation angles, and the calculate the height HB in which the crossing of the Nis happen and then choose H equal to HB to acheive the color splitting effect.
More precisely, to explain the behavior of total NJs radiated by the double-material structure we should substitute new expressions for NJ radiation angles into the formulas (4)-(7). This will give us the coordinates of the cross sections of the NJ beams (points A, B and C in
Number | Date | Country | Kind |
---|---|---|---|
18305265.3 | Mar 2018 | EP | regional |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2019/055905 | 3/8/2019 | WO | 00 |