The present invention relates to an optical element, an imaging element, and an imaging device.
A general imaging device uses a lens optical system and a two-dimensional imaging element such as a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor to acquire a two-dimensional image including intensity information and color information of light from an imaging target.
An imaging element of a conventional color sensor generally has a configuration in which incident light transmitted through an imaging lens is condensed by a microlens, and a color filter for each color is arranged on each pixel to cause a photoelectric conversion element to receive only light having a specific wavelength.
However, since the incident angle of the incident light passing through the imaging lens is different between a central portion and a peripheral portion of the sensor, the mode of light condensation by the microlens is also different between the central portion and the peripheral portion, and there is a problem that the light receiving sensitivity is deteriorated in the peripheral portion of the sensor.
The present invention has been made in view of the above, and an object thereof is to provide an optical element, an imaging element, and an imaging device capable of improving light receiving sensitivity in a sensor peripheral portion.
In order to solve the above-described problem and achieve the object, an optical element according to the present invention includes a transparent layer for covering a plurality of pixels each including a photoelectric conversion element, and a plurality of structure bodies arranged on the transparent layer or in the transparent layer in a plane direction of the transparent layer, in which the plurality of structure bodies is arranged in such a manner that, among incident light, light of a first color is condensed on a first pixel located immediately below, and light of a second color is condensed on a second pixel located immediately below according to an incident angle of incident light of each of the structure bodies.
Further, an imaging element according to the present invention includes the above-described optical element, and the plurality of pixels covered with the transparent layer.
Further, an imaging device according to the present invention includes the imaging element described above, and a signal processing unit that processes an electric signal output from the image element and generates an image.
According to the present invention, light receiving sensitivity in a sensor peripheral portion can be improved.
Hereinafter, best modes for carrying out the present invention will be described in detail with reference to the drawings. Note that, in the following description, each drawing merely schematically illustrates a shape, a size, and a positional relationship to such an extent that the contents of the present invention can be understood, and therefore the present invention is not limited only to the shape, the size, and the positional relationship exemplified in the drawings. Further, in the description of the drawings, the same portions are denoted by the same reference signs.
First, an imaging device according to a first embodiment of the present invention will be described.
As illustrated in
The object 1 is irradiated with light such as natural light or illumination light, and light transmitted/reflected/scattered by the object 1 or light emitted from the object 1 forms an optical image on the imaging element 12 by the lens optical system 11. In general, the lens optical system 11 includes a lens group including a plurality of lenses arranged along an optical axis in order to correct various optical aberrations, but in
Note that the imaging device 10 may include known components such as an infrared cut optical filter, an electronic shutter, a viewfinder, a power supply (battery), and a flash light, but the description thereof is not particularly necessary for understanding the present invention and thus will be omitted. Further, the above configuration is merely an example, and in the embodiment, known elements can be appropriately combined and used as components excluding the lens optical system 11, the imaging element 12, and the signal processing unit 13.
Next, an outline of the imaging element 12 according to the first embodiment will be described.
As illustrated in
The pixel array 110 includes a wiring layer 180 and a plurality of pixels 130 arranged in the xy plane direction. Each pixel 130 includes a photoelectric conversion element. An example of the photoelectric conversion element is a photodiode (PD). Each pixel corresponds to red (R), green (G), and blue (B). An example of the wavelength band of red light is 600 nm<λ0 when the wavelength is λ0. An example of the wavelength band of green light is 500 nm<λ0≤600 nm. An example of the wavelength band of blue light is λ0≤500 nm. Hereinafter, each pixel is referred to as a pixel R, a pixel G, and a pixel B (not illustrated) so as to be distinguishable. The pixel R, the two pixels G, and the pixel B are arranged in a Bayer array to constitute one pixel unit as described later.
The optical element array 120 is provided so as to cover the pixel array 110. An example of the optical element array 120 is a meta-surface. The meta-surface includes a plurality of fine structure bodies (corresponding to the structure body 160) having a width equal to or less than a wavelength of light. The meta-surface may have either a two-dimensional structure or a three-dimensional structure. The optical element array 120 can control the phase and the light intensity according to light characteristics (wavelength, polarization, and incident angle) only by changing parameters of the structure body 160. In a case of the three-dimensional structure, the degree of freedom in design is improved as compared with the two-dimensional structure.
The optical element array 120 has two functions of a wavelength separation function and a lens function. The wavelength separation function is a function of separating incident light into light of each wavelength band. The lens function is a function of condensing light of each wavelength to a corresponding pixel. In this example, the incident light is separated into R light, G light, and B light by the wavelength separation function of the optical element array 120. By the lens function, the R light is condensed on the pixel R located immediately below, the G light is condensed on the pixel G located immediately below, and the B light is condensed on the pixel B located immediately below.
The optical element array 120 includes a transparent layer 150 and a plurality of columnar structure bodies 160. The transparent layer 150 is provided on the pixel array 110 so as to cover the pixel array 110. The transparent layer 150 has a refractive index lower than the refractive index of the structure bodies 160. An example of the material of the transparent layer 150 is SiO2 or the like. The transparent layer 150 may be a void, and in this case, the refractive index of the transparent layer 150 may be equal to the refractive index of air. The material of the transparent layer 150 may be a single material or a plurality of layered materials.
The plurality of structure bodies 160 is arranged on the transparent layer 150 or in the transparent layer 150 in a plane direction (xy plane direction) of the transparent layer 150, for example, periodically (with a periodic structure). In this example, the structure bodies 160 are provided on the transparent layer 150 on the side (z-axis positive direction side) opposite to the pixel array 110 across the transparent layer 150. The plurality of structure bodies 160 may be arranged at equal intervals or may be arranged at unequal intervals for ease of design or the like. Each structure body 160 is a nano-ordered size fine structure having a dimension equal to or smaller than the wavelength of the incident light. The plurality of structure bodies 160 has the same height in side view.
The structure bodies 160 guide the incident light to the photoelectric conversion element of the corresponding pixel 130 immediately below in a state of being separated into colors. For example, in the first embodiment, a case where wavelength regions separated by the structure bodies 160 are R, G, and B will be described. The plurality of structure bodies 160 is arranged in such a manner that, among the incident light, the R color light is condensed on the pixel R located immediately below, the G light is condensed on the pixel G located immediately below, and the B light is condensed on the pixel B located immediately below according to the incident angle of the incident light of each structure body.
The structure bodies 160 are formed using a material having a refractive index higher than the refractive index of surrounding materials (transparent layer 150 and air). Thus, the structure body 160 strongly confines light inside the columnar structure body and prevents optical coupling with the adjacent columnar structure body. The structure bodies 160 are formed using, for example, SiN (refractive index n=2.05) or TiO2 (refractive index n=2.40).
The structure bodies 160 are formed in shapes having phase characteristics for guiding the incident light to the photoelectric conversion elements of the corresponding pixels R, G, and B immediately below in a state of being color-separated into R, G, and B according to the incident angle of the incident light of respective columnar structure bodies in plan view. Each of the structure bodies 160 gives an optical phase delay amount according to the shape of this structure body 160 in plan view to the incident light. A cross-sectional shape of each of the structure bodies 160 is different between the central portion and the outer peripheral portion of the optical element array.
In order to achieve the structure bodies 160 having different condensing positions depending on the wavelength region of the incident light, it is necessary to achieve a structure that gives a different optical wavefront for each wavelength region. In the first embodiment, both the wavelength separation function and the light condensing function are achieved by using a wavelength dispersion characteristic of a phase delay amount given to the incident light by fine columnar structure bodies 160.
The structure bodies 160 are formed by a material such as SiN or TiO2 having a refractive index n 1 higher than a refractive index no of the transparent layer 150 or air around the structure, and heights (lengths in the z-axis direction) h of the structure bodies 160 in side view are constant. The structure bodies 160 can be considered as an optical waveguide that confines and propagates light in the structure from a refractive index difference with the transparent layer.
Therefore, when light is incident from the lens optical system 11 side, the light propagates while being strongly confined in the structure, receives a phase delay effect determined by an effective refractive index neff of the optical waveguide, and is output from the pixel array 110 side.
Specifically, when the phase of light propagated through the transparent layer by a length corresponding to a thickness of the structure is used as a reference, a phase delay amount φ by the structure bodies 160 is expressed by Expression (1) when the wavelength of the light in vacuum is λ.
[Math. 1]
φ=(neff−n0)×2πh/λ (1)
Since the phase delay amount φ ID varies depending on the wavelength λ, of light, it is possible to give different phase delay amounts depending on the wavelength region of light in the same structure body.
Furthermore, it is known that the effective refractive index neff of the optical waveguide greatly depends on the cross-sectional shape of the structure body 160, and takes a value of n0<neff<n1. Further, the effective refractive index neff of the optical waveguide also varies depending on the wavelength λ, of light, and the degree of the refractive index neff greatly depends on the cross-sectional shape of the structure body 160.
Therefore, as illustrated in
The structure body 160 is a columnar structure body extending in the z-axis direction, and is formed on the transparent layer 150 (for example, SiO2 substrate (refractive index 1.45)). An example of a material of the structure body 160 is SiN (refractive index 2.05). A side and an upper side of the structure body 160 are air (Air (refractive index: 1.0)).
An arrangement period of each structure body 160 is P. The arrangement period P is desirably set as in Expression (2) so that diffracted light does not occur on the transmission side.
[Math. 2]
P≤λ
min
/n
2 (2)
λmin is the shortest wavelength in the wavelength band of the light receiving target, and is, for example, 410 nm. n2 is a refractive index of the transparent layer 150, and in a case where the transparent layer 150 is SiO2, n2=1.45. The arrangement period P of the structure body 160 is, for example, 280 nm.
In
[Math. 3]
h≥Δ
r/(n1−n0) (3)
The wavelength λr is a desired center wavelength in a wavelength band on the longest wavelength side among wavelength bands of light to be subjected to wavelength separation. n1 is a refractive index of the structure body 160. In a case where the structure body 160 is SiN, n1=refractive index 2.05, and the height h is, for example, 1600 nm. Further, the structure body 160 may be formed by TiO2 (refractive index 2.40). In this case, n1=2.40, and the height h of the structure body 160 is, for example, 1250 nm.
By designing (including dimensional design) the cross-sectional shape of the structure body 160, various combinations capable of giving different optical phase delay amounts to light of each wavelength can be achieved. By diversifying the cross-sectional shapes, the number of combinations is increased, and the degree of freedom in design is further improved.
For example, the structure body 160 has a square shape, a cross shape, or a circular shape in plan view. Each of the square-shaped, cross-shaped, and circular-shaped structure bodies 160 has the same basic shape and different dimensions (length, width, and the like). The shapes of the structure bodies 160 in plan view may be four-fold rotationally symmetrical shapes. Such a shape may include, for example, at least one of a square shape, a cross shape, or a circular shape. Each structure body 160 has a four-fold rotationally symmetrical shape in plan view, so that it has a characteristic independent of polarization.
As described above, it is also possible to apply a square shape, an X shape obtained by rotating a cross shape in plane by 45°, and a hollow rhombus shape as the shape of the structure body 160 in plan view. Note that, the hollow rhombus shape is an example of a shape including a square shape, and is a shape obtained by rotating the hollow square shape in plane by 45°.
Note that, when a shape rotated in plane by 45° such as an X shape or a rhombus is employed, optical coupling between adjacent structure bodies is weakened, so that optical characteristics of each structure are easily maintained without being affected by adjacent structure bodies. Consequently, an ideal phase delay amount distribution described later can be easily reproduced.
A square plot indicates an optical phase delay amount when dimensions of the cross-sectional shapes of the structure bodies 160 having square cross-sectional shapes are variously set. An X-shaped plot indicates an optical phase delay amount when dimensions of the cross-sectional shapes are variously set in the structure bodies 160 having X-shaped cross-sectional shapes. A rhombus plot illustrates an optical phase delay amount when dimensions of the cross-sectional shapes are variously set in the structure bodies 160 having hollow rhombic cross-sectional shapes. In all cases, the height h is constant. A black circle plot is an ideal optical phase delay amount in a lens design to be described later.
On the basis of the above principle, a lens function having a condensing point different for each wavelength can be achieved by the designs of the cross-sectional shapes and arrangement of the structure bodies 160 arranged in the plane direction of the transparent layer 150. Note that the lens design is possible not only in a case where the number of wavelengths is three but also in a case where the number of wavelengths is two or four or more.
Furthermore, in the present embodiment, the phase distribution of the lens is designed so that light is condensed at the center of the photoelectric conversion element below the lens corresponding to the incident light of the light incident on the structure bodies 160, and the lens is designed with reference to the phase characteristics illustrated in
Now, an example of a lens design will be described.
An optical phase delay amount distribution φ of the lens that condenses at a point (center point of any pixel) zf away immediately below the lens with respect to light of a certain incident angle (θ, φ) is expressed by the following Expression (4).
In the above Expression (4), is a center wavelength (design wavelength). xf, yf, and zf are condensing positions. nin is a refractive index of a material on the incident side. nout is a refractive index of a material on the emission side. C is an arbitrary constant. In a case of the configurations of
The ideal optical phase delay amount distribution is a phase distribution that gives the following condensing positions to each of the pixel B, the pixels G1 and G2, and the pixel R. Note that the center positions of the four pixels (pixel units) correspond to x=0 and y=0.
Pixel B: xf=+0.84 μm, yf=−0.84 μm, and zf=4.2 μm
Pixel G1: xf=+0.84 μm, yf=+0.84 μm, and zf=4.2 μm
Pixel G2: xf=−0.84 μm, yf=−0.84 μm, and zf=4.2 μm
Pixel R: xf=−0.84 μm, yf=+0.84 μm, and zf=4.2 μm
φ is converted so as to fall within the range of 0 to 2 π. For example, −0.5 π and 2.5 π are converted into 1.5 π and 0.5 π, respectively. A boundary region of the optical phase delay amount distribution is set so that the center of the optical phase delay amount distribution of the lens at each design wavelength is at the condensing position (together with the adjacent lens). The constant C may be optimized so that the error (difference from the ideal value) of the optical phase delay amount distribution is minimized at each wavelength. From the optical phase delay amount at each wavelength, a structure most suitable for the optical phase delay amount distribution at each of the center wavelengths of the three wavelengths (structure with the smallest error) is arranged at a corresponding position.
As illustrated in
As described above, a plurality of pixel units including the pixel R, the pixel G1, the pixel G2, and the pixel B is arranged in the pixel array 110 as illustrated in
Further,
As illustrated in
As described above, in the first embodiment, in the imaging element 100, since the optical element array 120 achieves both the color separation function and the lens function, the total amount of received light can also be increased as compared with a conventional imaging element that performs color separation using a color filter.
Then, in the imaging element 100, angle resistance corresponding to the main incident angle is imparted to the lens (structure bodies 160) of the optical element array 120 while having a color separation function. According to the first embodiment, by changing the pattern of the structure bodies 160 according to the pixel position in the imaging element 100, it is possible to achieve color separation microlenses respectively corresponding to different main incident angles at the central portion and the peripheral portion of the imaging element 100. Therefore, according to the first embodiment, it is possible to achieve a light condensing function corresponding to various incident angles determined at positions in the imaging element 100 for each pixel, and in particular, it is possible to improve the light receiving sensitivity in the peripheral portion of the imaging element 100. Therefore, according to the first embodiment, it is possible to generate an image signal having uniform luminance over the entire imaging element 100 and few color errors.
In addition, some conventional technologies have a microlens provided (integrated) on the side opposite to the pixel across the filter in order to increase the amount of received light (improve sensitivity) by improving an aperture ratio, reducing light incident angle dependency, and the like. In this case, since a two-layer structure of at least a filter and a microlens is formed, the structure becomes complicated and the manufacturing cost also increases. With the optical element array 120 according to the embodiment, since the wavelength separation function and the lens function can be achieved only by the optical element array 120, the structure can be simplified and the manufacturing cost can be reduced. Further, since the plurality of structure bodies 160 can be arranged without gaps within a plane (in the xy plane), the aperture ratio increases as compared with the microlens.
Note that, since resistance to the incident angle mainly depends on a focal length of a color separation lens, if a lens (structure bodies 160) having a shorter focal length is designed, the allowable angle also increases.
Further, the signal processing unit 13 illustrated in
Further, the optical element array 120 is not limited to the above configuration, and can take various forms in the number, interval, structural shape, and arrangement pattern of the structure bodies 160. In addition, the structure bodies 160 may be connected to each other or may be embedded in a transparent material.
Further, in
As illustrated in an imaging element 100A of
Further, in the above description, an example in which four pixels are located immediately below one optical element unit has been described, but the present invention is not limited thereto.
Further, the cross-sectional shapes of the structure bodies 160 are not limited to the shape illustrated in
In a second embodiment, a configuration in which an imaging element includes a filter will be described.
The imaging element 200 illustrated in
The filter layer 170 includes a filter 170R that is provided so as to cover the pixels R and transmits red light, a filter 170G that is provided so as to cover the pixels G and transmits green light, and a filter 170B that is provided so as to cover the pixels B and transmits blue light. An example of the material of the filter layer 170 is an organic material such as resin.
The light color-separated by the optical element array 120 further passes through the filter layer 170 and then reaches the pixel array 110. By the wavelength separation of both the optical element array 120 and the filter layer 170, the crosstalk of the spectrum is suppressed (most of unnecessary other wavelength components are removed) and color reproducibility is improved as compared with a case where the wavelength separation is performed only on one side. Further, since the incident light passes through the filter layer 170 after being separated by the optical element array 120, the amount of light is not greatly reduced. Therefore, the light receiving efficiency of the pixel is improved as compared with a case where the optical element array 120 is not provided and only the filter layer 170 is provided.
As illustrated in
Reference Document 1: Kudo, T.; Nanjo, Y.; et al., “Pigmented Photoresists for Color Filters”. J. Photopolym. Sci. Technol. 1996, 9, 109-120.
Further, as illustrated in
As described above, with the imaging element 200 further including the filter layer 170, the light receiving efficiency can be improved, and the color reproducibility can be further improved.
Note that, in the first and second embodiments, when the pixel arrangement of the pixel array 110 is described, the pixel unit in which the pixel B, the pixels G1 and G2, and the pixel R are one set has been described as an example, but the present invention is not limited thereto.
Further, in the first and second embodiments, SiN or TiO2 has been described as an example of the material of the structure body 160. However, the material of the structure bodies 160 is not limited thereto. For example, for light having a wavelength of 380 nm to 1000 nm (visible light to near-infrared light), SiC, TiO2, GaN, or the like may be used as the material of the structure bodies 6 in addition to SiN. This is suitable because the refractive index is high and the absorption loss is small. In the case of using light having a wavelength of 800 to 1000 nm (near-infrared light), Si, SiC, SiN, TiO2, GaAs, GaN, or the like may be used as the material of the structure bodies 6. It is suitable because of its low loss. For light in a near-infrared region in a long wavelength band (such as 1.3 μm or 1.55 μm as a communication wavelength), InP or the like can be used as the material of the structure bodies 160 in addition to the above-described materials.
Further, in a case where the structure bodies 160 are formed by bonding, coating, or the like, polyimide such as fluorinated polyimide, BCB (benzocyclobutene), a photocurable resin, a UV epoxy resin, an acrylic resin such as PMMA, and polymers such as resists in general may be mentioned as materials.
Further, in the first and second embodiments, the example in which SiO2 and an air layer are assumed as the material of the transparent layer 150 has been described, but the material is not limited thereto. Any material may be used as long as it has a refractive index lower than the refractive index of the material of the structure bodies 160 and has a low loss with respect to the wavelength of incident light, including a general glass material and the like. The transparent layer 150 only needs to have a sufficiently low loss with respect to the wavelength of light to reach the corresponding pixel, and thus may include a material similar to that of the color filter, and may include an organic material such as resin, for example. In this case, the transparent layer 150 may not only include a material similar to that of the color filter, but may also have a structure similar to that of the color filter and may be designed to have absorption characteristics according to the wavelength of light to be guided to the corresponding pixel.
In addition, in the first and second embodiments, the three primary colors of RGB and the near-infrared light have been described as examples of the corresponding color of the pixel, but the pixel may also correspond to light of wavelengths other than the near-infrared light and the three primary colors (for example, infrared light, ultraviolet light, and the like).
Further, in the first and second embodiments, the example has been described in which the structure bodies having three different cross-sectional shapes of a square shape, a x shape, and a hollow rhombus is used as the shapes of the structure bodies 160. This shape is an example, and two types of structure bodies (for example, only a square shape or a cross shape is used) may be used, or four or more types of structure bodies may be used.
Although the present invention has been described above on the basis of specific embodiments, the present invention is not limited to the above-described embodiments, and it goes without saying that various modifications can be made without departing from the gist of the present invention.
The technology described above is specified as follows, for example. As described with reference to
The optical element array 120 has angle resistance corresponding to the main incident angle while having a color separation function. The optical element array 120 can achieve a light condensing function corresponding to various incident angles determined at positions in the imaging element 100 for each pixel, and can improve light receiving sensitivity particularly in a sensor peripheral portion. In the optical element array 120, since the plurality of structure bodies 160 can be arranged without gaps within a plane, the aperture ratio also increases as compared with the microlens. The color separation function and the lens function may correspond to three colors, and may further correspond to separation of near-infrared light.
As described with reference to
As described with reference to
As described with reference to
The imaging element 100 described with reference to
As described with reference to
The imaging device 10 described with reference to
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2020/044530 | 11/30/2020 | WO |