The present invention relates to an imaging element and an imaging device.
General imaging devices acquire two-dimensional images composed of light intensity information and color information from an imaged target using lens optical systems and two-dimensional image sensors such as charge coupled device (CCD) sensors or complementary metal oxide semiconductor (CMOS) sensors.
Here, an incident angle of light incident on an imaging sensor from a lens optical system is different between a central portion and an outer circumferential portion. However, since it is difficult to manufacture a lens optimized for oblique incident light required in a circumferential portion of a sensor, there is a problem that light receiving efficiency is limited.
As a lens in which such a problem is solved, a micro-structured lens using effective medium approximation is proposed (for example, refer to NPL 1). NPL 1 describes an approximation in which an effective refractive index of a micro-structured lens can be expressed by an approximately average value between a refractive index of a lens and a refractive index of a surrounding material when the micro-structured lens is very small compared to a wavelength.
However, in a micro-structured lens using effective medium approximation, light is confined inside the structure and excites an optical waveguide mode and a resonance mode when a large difference occurs between a refractive index of the lens and a refractive index of the surroundings and a size of the lens is of about a sub-wavelength. Thus, this approximation is no longer applicable. Therefore, the micro-structured lens described in NPL 1 is limited to a combination of materials having a small difference in refractive index, in which a material is SiO2 and the surrounding material is air or the like. Thus, there is a problem that an aspect ratio of a fine structure lens becomes large and there is a polarization dependence. Furthermore, the micro-structured lens described in NPL 1 has a problem that it is difficult to manufacture because of the structure having curves and steps.
The present invention was made in view of the above description, and an object of the present invention is to provide an imaging element and an imaging device having a low aspect ratio and a simple configuration and capable of realizing lens characteristics corresponding to a main incident angle for each pixel.
In order to solve the above-described problems and achieve the purpose, an imaging element according to the present invention includes: a pixel array in which a plurality of pixels including photoelectric conversion elements are arranged in a two-dimensional array; and an optical element array in which optical elements composed of a plurality of columnar structure bodies arranged opposite to a pixel array and guiding incident light to a corresponding photoelectric conversion element are arranged in a two-dimensional array, in which the plurality of columnar structure bodies are formed in a width having a phase characteristic for guiding light to a photoelectric conversion element directly below a columnar structure body in accordance with an incident angle of the incident light of each columnar structure body when viewed in a plan view and are formed at a same height when viewed in a side view.
Also, an imaging element according to the present invention includes: a pixel array in which a plurality of pixels including photoelectric conversion elements are arranged in a two-dimensional array; and an optical element array in which optical elements composed of a plurality of columnar structure bodies arranged opposite to a pixel array and guiding incident light to a corresponding photoelectric conversion element are arranged in a two-dimensional array, in which the plurality of columnar structure bodies have a refractive index so that they have a phase characteristic for guiding light to the photoelectric conversion element directly below a columnar structure body in accordance with an incident angle of the incident light of each columnar structure body and are formed at a same height when viewed in a side view.
Furthermore, an imaging device according to the present invention includes: the above-described imaging element and a signal processing unit configured to process an electric signal output using the imaging element and generate an image.
According to the present invention, it is possible to provide an imaging element and an imaging device including an optical element having a lower aspect ratio and a simpler configuration than in the related art and capable of realizing lens characteristics corresponding to a main incident angle for each pixel.
The best mode for carrying out the present invention will be described in detail below with reference to the drawings. Note that, in the following description, each drawing merely schematically shows shapes, sizes, and positional relationships to the extent that the content of the present invention can be understood. Therefore, the present invention is not limited to the shapes, sizes, and positional relationships exemplified in each drawing. Furthermore, in the description provided with reference to the drawings, the same constituent elements are denoted by the same reference numerals.
[Embodiment] [Imaging Device] First, an imaging device according to an embodiment of the present invention will be described
An imaging device 10 according to the embodiment includes a lens optical system 11, an imaging element 12, and a signal processing unit 13 as shown in
Light such as natural light or illumination light is applied to an object 1 and light transmitted/reflected/scattered by the object 1 or light emitted from the object 1 forms an optical image on the imaging element 12 using the lens optical system 11. Generally, although the lens optical system 11 is composed of a lens group composed of a plurality of lenses arranged along an optical axis to correct various optical aberrations, in
Note that, although the imaging device 10 may include known constituent elements such as an infrared light-cutting optical filter, an electronic shutter, a viewfinder, a power supply (battery), and a flashlight, the explanations thereof are omitted because they are not particularly necessary for understanding the present invention. Furthermore, the above configuration is merely an example, and in the embodiment, known elements can be appropriately combined and used as the constituent elements excluding the lens optical system 11, the imaging element 12, and the signal processing unit 13.
[Imaging Element] An outline of the imaging element 12 according to the embodiment will be described below.
As shown in
The pixel array 110 has a wiring layer 180 and pixels 130 including photoelectric conversion elements arranged in a two-dimensional array. For example, the pixels 130 of a pixel unit 140L receive G light and the pixels 130 of a pixel unit 140R receive R light.
In the optical element array 120, optical elements composed of a plurality of columnar structure bodies 160 in which incident light is guided to the photoelectric conversion element of the corresponding pixel 130 directly below the columnar structure body are arranged in a two-dimensional array. For example,
The plurality of columnar structure bodies 160 are formed by using a material having a refractive index higher than that of the surrounding material (transparent layer 150, air). Thus, the columnar structure body 160 strongly traps light inside the columnar structure body and prevents optical coupling with the adjacent columnar structure body. The columnar structure body 160 is formed by using, for example, SiN (refractive index n=2.05) and TiO2 (refractive index n=2.4).
As shown in
The plurality of columnar structure bodies 160 are each formed in a width w having a phase characteristic for guiding incident light to the photoelectric conversion element of the corresponding pixel 130 directly below the columnar structure body in accordance with the incident angle of the incident light of each columnar structure body when viewed in a plan view. Each of the plurality of columnar structure bodies 160 provides an amount of optical phase delay according to the width of the columnar structure body 160 to the incident light when viewed in a plan view.
In the optical element units 120R, 120G, and 120B, each of the plurality of columnar structure bodies 160 constituting the optical element unit 120R, 120G, and 120B has a width in which an optical phase delay amount distribution for guiding incident light to each photoelectric conversion element of the corresponding R pixel unit, G pixel unit, and B pixel unit is provided. In the optical element units 120R, 120G, and 120B, a width of each of the plurality of columnar structure bodies 160 forming the optical element units 120R, 120G, and 120B when viewed in a plan view is set to a width in which an optical phase delay amount distribution for guiding incident light to the photoelectric conversion element directly below the optical element units 120R, 120G, and 120B in accordance with the incident angle of the incident light is provided. Note that the optical phase delay amount distribution is an optical phase delay amount for condensing light.
The imaging element 100 realizes a lens function by forming a columnar structure body 160 having the same height and gradually changing the width on the entire surface of the optical element array 120. Since each columnar structure body 160 behaves like a columnar optical waveguide, in the imaging element 100, the effective refractive index of the columnar structure body 160 can be changed by changing the width of the columnar structure body 160 and a phase of the transmitted light can be freely controlled.
In other words, each columnar structure body 160 behaves as an optical waveguide of a sub-wavelength size and there is almost no optical coupling with an adjacent columnar structure body 160 due to light confinement. Thus, it is possible to provide different optical characteristics (for example, phase delay characteristics) to each of the plurality of columnar structure bodies 160 by designing a width w of the columnar structure body 160 in a plan view for each columnar structure body 160. The lens function can be imparted to the columnar structure body 160 by making the spatial distribution of the phase delay amount equivalent to that of a (Fresnel) lens.
Here, NPL 1 describes that a structure body made of a low refraction material such as SiO2 is made to function as a lens.
NPL 1 describes an approximation in which, when the structure body is very small compared to the wavelength, the effective refractive index of the structure body can be expressed by an approximately average value between the refractive index of the structural lens and the refractive index of the surrounding material. However, when a large difference between a refractive index of the structure body and a refractive index of the surroundings is provided and a size of the structure body is about the sub-wavelength, light is confined inside the structure and excites an optical waveguide mode and a resonance mode. Thus, this approximation is no longer applicable. Therefore, the structure body described in NPL 1 is limited to a combination of materials having a small difference in refractive index, in which the material is SiO2 and the surrounding material is air or the like. Thus, an aspect ratio of the structure body increases.
On the other hand, in the imaging element 100, each columnar structure body 160 is formed by using a high refractive index material such as SiN or TiO2. Therefore, a height of the minimum columnar structure body 160 required for realizing a phase change amount of 0 to 2n is lower than that of the structure body made of a low refraction material such as SiO2 (refer to NPL 1). Therefore, the imaging element 100 can realize a lens function with the columnar structure body 160 having a low aspect ratio, which has a relatively small minimum structure height required for phase control of 0 to 2π and is easy to manufacture.
Also, the plurality of columnar structure bodies 160 are prisms having a square bottom surface. As described above, in the imaging element 100, each columnar structure body 160 has a four-fold rotationally symmetric structure such as a square when viewed in a plan view so that the characteristics are independent of polarization. Note that it is clear that the structure body described in NPL 1 has a polarization dependence on the effective refractive index based on a theoretical expression.
Furthermore, NPL 1 describes a structure body having a curved surface and a step. On the other hand, each columnar structure body 160 in the embodiment is a square columnar binary pattern without a step. Therefore, the imaging element 100 can exclude a curved surface and a step from the cross section of the columnar structure body. Thus, the columnar structure body 160 is relatively easy to prepare compared with the structure body described in NPL 1.
Furthermore, the imaging element 100 realizes a lens function by forming a plurality of columnar structure bodies 160 on the entire surface of the optical element array 120. Thus, all incident light can be received and a lens aperture can be maximized.
Furthermore, each columnar structure body 160 is formed in a width w having a phase characteristic which leads light to a photoelectric conversion element of the pixel 130 directly below the columnar structure body 160 in accordance with the incident angle of the incident light of each columnar structure body 160 when viewed in a plan view. That is to say, it is possible to optimize a structural pattern of the columnar structure body 160 for each pixel to improve the light receiving efficiency in accordance with the main incident angle in the imaging element 100. In other words, the shape pattern of the columnar structure body 160 when viewed in a plan view is optimized in accordance with the incident angle θ of the light incident on each columnar structure body 160 in the imaging element 100.
Thus, in the imaging element 100, the columnar structure body 160 can be focused on the photoelectric conversion element of the pixel 130 directly below the columnar structure body also in both the outer circumferential portion on which light is incident at a large incident angle θ (refer to
[Height of Columnar Structure Body] The height of the columnar structure body 160 when viewed in a side view will be described below. Hereinafter, the height of the columnar structure body 160 when viewed in a side view is referred to as the height of the columnar structure body 160. Also, the width of the columnar structure body 160 when viewed in a plan view is referred to as the width of the columnar structure body 160. Here, a minimum height of the columnar structure body 160 required for phase control of 0 to 2π will be described.
The phase delay amount φ due to the columnar structure body 160 is represented by Expression (1), assuming that the wavelength of light in a vacuum is λ, the height of the columnar structure body 160 is h, the effective refractive index of the columnar structure body 160 is neff, and the refractive index of the surrounding material is n0.
[Math. 1]
φ=(neff−n0)×2πh/λ (1)
Expression (1) is applied to both the columnar structure body 160 in the imaging element 100 and the structure body described in NPL 1 (hereinafter referred to as an effective medium approximate structure body).
In the case of the effective medium approximation structure body, it is known that the effective refractive index neff is determined by an area ratio between the structure body and the surrounding material. In the case of the effective medium approximation structure, a value of neff also fluctuates depending on the polarization. In the case of the columnar structure body 160, the optical waveguide mode largely depends on the width of the columnar structure body 160. Thus, it is known that the effective refractive index neff is expressed by a function of the width w of the columnar structure body 160. In either case of the effective medium approximation structure body or the columnar structure body 160, a value of n0<neff<n1 is taken. Note that n1 is the refractive index of the material constituting the structure body.
Therefore, in order to control an amount of phase change between 0 and 2π, the height of the structure body needs to be set to Expression (2).
[Math. 2]
h≥λ
0/(n1−n0) (2)
In order to apply the effective medium approximation, it is necessary to reduce n1−n0. Therefore, in the case of an effective medium approximation structure body, the required height of the structure body is necessarily as high as 1411 nm as shown in
On the other hand, in the case of the columnar structure body 160, the larger n1 is preferable from the viewpoint of light confinement so that the value of n1−n0 is larger than that of the effective medium approximation structure body. For example, the materials forming the columnar structure body 160 are SiN (n=2.05) and TiO2 (n=2.4), and n1−n0≥0.7.
As a result, in the columnar structure body 160, the required structural height is relatively lower than that of the effective medium approximation structure body, and as shown in
[Structure of Columnar Structure Body] An example of the structure of the columnar structure body 160 will be described.
As shown in
[Design of Lens] In the imaging element 100 according to the embodiment, the phase distribution of the columnar structure body 160 which functions as a lens is designed to focus on the central portion of the pixel 130 below the optical element array 120 in correspondence with the incident angle.
Furthermore, the imaging element 100 realizes an ideal phase distribution of a design target by setting the width w of the columnar structure body 160 for each columnar structure body 160 with reference to the phase characteristic of
For example, parameters of a design example are shown below:
Size of one photoelectric conversion element=lens area: 3.2 μm×3.2 μm
Focal length: 3.2 μm
Design wavelength: 520 nm.
In Expression (3), Δd is a design wavelength, f is a focal length, nin is a refractive index of a material on an incident side, nout is a refractive index of a material on an exit side, and C is an arbitrary constant.
For example, f=3.2 μm, nin=1.0 (air), nout=1.445 (quartz glass). φ is converted so that it falls within the range of 0 to 2π. For example, when φ is −0.5π, it is converted to 1.5π, and when φ is 2.5π, it is converted to 0.5. In this setting, the phase distribution of the design target of the lens when light is incident at an arbitrary incident angle and the lens (columnar structure body 160) pattern capable of realizing the phase distribution will be described with reference to
As shown in (2) of
For example, an optical element unit 120-1 shown in (2) of
[Wavelength Dependence of Light-Collection Intensity] In the embodiment, the pattern of each columnar structure body 160 of the optical element units 120R, 120G, and 120B is designed in correspondence with the design wavelength of the photoelectric conversion element of the corresponding pixel unit directly below the columnar structure body, as in the optical element units 120R, 120G, and 120B shown in
(1) of
It can be seen that 96% or more of the light can pass through the structure and be received by the pixel 130 in all of the optical element units 120-4, 120-5, 120-6, as shown in (3) of
Therefore, in the imaging element 100, It is possible to design the light collection according to each design wavelength by simply changing the pattern of the columnar structure body 160 such as in the optical element units 120-4, 120-5, and 120-6 to correspond to each color band (transmission band of the color filter of R, G, and B). In the imaging element 100, the design wavelength of each pixel 130 may be determined in accordance with the color filter on the pixel 130 and the optical element units 120-4, 120-5, and 120-6 may be integrated in accordance with the design wavelength of the pixel 130 immediately below the optical element unit.
[Design Example of Optical Element Unit Corresponding To Incident Angle] In the embodiment, the pattern of each columnar structure body 160 of the optical element unit is designed in accordance with the incident angle of the incident light. In the optical element unit, the width w of each of the plurality of columnar structure bodies 160 forming the optical element unit when viewed in a plan view is set to have a width in which an optical phase delay amount distribution for guiding the incident light to the photoelectric conversion element directly below the optical element unit in accordance with the incident angle of the incident light is provided. Therefore, a design example of the optical element unit corresponding to the incident angle of the incident light on the optical element array 120 will be described.
A maximum light collection intensity is shown around the design incident angle in all of the optical element units 120-7, 120-8, and 120-9, as shown in (3) of
(2) of
A maximum focusing intensity is shown around the design incident angle in all of the optical element units 120-10, 120-11, and 120-12, as shown in (3) of
In the imaging element 100, it is possible to collect light with high intensity on the photoelectric conversion element of the pixel 130 directly below the optical element unit by arranging the above-described optical element units 120-7 to 120-12 in accordance with the incident angle (θ, φ) of the incident light.
[Effects of Embodiment] Thus, the lens function is realized by forming a plurality of columnar structure bodies 160 on the entire surface of the optical element array 120 at intervals shorter than the wavelength of the incident light in the imaging element 100 according to the embodiment. Thus, all incident light can be received and the light receiving efficiency can be improved.
Furthermore, in the imaging element 100, the plurality of columnar structure bodies are formed in a width in which a phase characteristic for guiding light to the photoelectric conversion element directly below the columnar structure body in accordance with the incident angle of the incident light of each columnar structure body when viewed in a plan view is provided and are formed at the same height when viewed in a side view. The imaging element 100 can generate an image signal having uniform brightness in the entire imaging element 100 because the plurality of columnar structure bodies 160 can realize the lens characteristics corresponding to the incident angle for each pixel 130.
Furthermore, the plurality of columnar structure bodies 160 having a square columnar binary pattern made of a material having a refractive index higher than that of the surrounding material are used as a lens in the imaging element 100. Therefore, the plurality of columnar structure bodies 160 used by the imaging element 100 as lenses have a lower aspect ratio and a simpler configuration than the structure body described in NPL 1 and thus are easily created.
Note that the optical element unit is not limited to the above configuration and may take various forms in terms of number, spacing, structural shape, and arrangement pattern. Furthermore, the columnar structure bodies 160 may be connected to each other or may be embedded in a transparent material.
Furthermore, although the optical element array 120 is formed on an upper surface of the transparent layer 150 in
Furthermore, although an example in which four pixels are located directly below one optical element unit has been described in the above description, the present invention is not limited thereto.
Furthermore, although an example in which SiN and TiO2 are used as the material of the columnar structure body 160 is shown in the embodiment, the present invention is not limited thereto. For example, when the imaging elements 100 and 100A are used in the visible light to near infrared light region in which the wavelength of light is in the range of 380 nm to 1000 nm, materials such as SiN, SiC, TiO2, and GaN are suitable as the material of the columnar structure body 160 because they have a high refractive index and a small absorption loss. Also, materials such as Si, SiC, SiN, TiO2, GaAs, and GaN are suitable as the material of the columnar structure body 160 having low loss with respect to these light when the imaging element 100 or 100A is used in the near-infrared light region having a wavelength in the range of 800 to 1000 nm.
Furthermore, in the near infrared region (communication wavelength of 1.3 μm, 1.55 μm, or the like) in the long wavelength band, InP or the like can be used as the material of the columnar structure body 160 in addition to the above-described materials.
Also, polyimides such as fluorinated polyimides, benzocyclobutene (BCB), photocurable resins, UV epoxy resins, acrylic resins such as PMMA, and polymers such as resists in general can be exemplified as a material when the micro-spectral element of the columnar structure body 160 is formed through pasting and coating.
Similarly, although an example in which SiO2 and an air layer are assumed as the materials of the transparent layers 150 and 150A is shown in the embodiment, the present invention is not limited thereto. The material of the transparent layers 150 and 150A may have a refractive index lower than that of the material of the columnar structure body 160 such as a general glass material, SiO2, and an air layer and may only have to have a low loss with respect to the wavelength of incident light. Furthermore, the transparent layers 150 and 150A may be transparent layers having a laminated structure made of a plurality of materials.
Although a case in which the light in the wavelength range corresponding to the columnar structure body 160 is the light of the three primary colors R, G, and B has been described as an example in the embodiment, at least one of the three wavelength regions may be light having a wavelength other than the three primary colors (for example, infrared light or ultraviolet light).
Furthermore, in the optical element arrays 120 and 120A, the width of at least a part of the plurality of columnar structure bodies 160 when viewed in a plan view is set to have a width in which an optical phase delay amount distribution for guiding incident light to the corresponding photoelectric conversion element directly below the columnar structure body is provided on the basis of the relationship between the width of the columnar structure body 160 illustrated in
Furthermore, the optical element arrays 120 and 120A in the embodiment are, for example, metasurfaces. As described above, the metasurface is an element composed of a plurality of fine structures having a width equal to or less than the wavelength of light and may be a two-dimensional structure or a three-dimensional structure. It is possible to control the phase and light intensity in accordance with the characteristics of light (wavelength, polarization, incident angle) by simply changing the parameters of the microstructure by using a metasurface for the optical element. Furthermore, the above-described degree of freedom in design increases when the metasurface has a three-dimensional structure.
Although the present invention has been described above based on a specific embodiment, it is needless to say that the present invention is not limited to the above-described embodiment and can be variously modified without departing from the gist thereof.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2020/038500 | 10/12/2020 | WO |