Camera modules in commercial products such as stand-alone digital cameras, mobile devices, automotive components, and medical devices include an image sensor having a pixel array. The pixel array includes a plurality of pixels arranged as a two-dimensional periodic array with a pixel pitch that is between two and three times the wavelength of light incident thereon. Many image sensors include a microlens array, formed of a plurality of microlenses each aligned to a respective pixel, that has two-dimensionally periodic surface height above the pixel array. The periodicity of the image sensor's pixel array and microlens array thereon result in the image sensor resembling a reflective two-dimensional diffraction grating. Part of light incident on the image sensor is diffracted toward the camera's imaging lens. Different elements of the camera, e.g., a cover glass, an IR-cut filter, a surface of the imaging lens, reflect this diffracted light back toward the image sensor, which produces an image artifact known as petal flare.
Embodiments disclosed herein reduce petal flare. In a first aspect, a flare-suppressing image sensor includes a first pixel formed in a substrate and a refractive element located above the first pixel. The refractive element has, with respect to a top surface of the substrate, a height profile having at least two one-dimensional local maxima in each of a first cross-sectional plane and a second cross-sectional plane perpendicular to the first cross-sectional plane. Each of the first and second cross-sectional planes is perpendicular to the top surface and intersects the first pixel.
Image sensor 200 includes a plurality of large pixels 214 formed in a semiconductor substrate 210. Semiconductor substrate 210 has a top surface 219 parallel to the x-y plane. The plurality of large pixels 214 form a pixel array 214A that has a pixel pitch Px and Py in respective orthogonal directions x and y. Pixel 214(1) is one of the plurality of large pixels 214. An angle between directions 298D and direction 298X equals arctan(Py/Px). In embodiments, at least one of pitch Px and Py is less than or equal to 2.9 μm.
Image sensor 200 includes a refractive element 260(1) above pixel 214(1). Refractive element 260(1) may be center-aligned with pixel 214(1) in at least one of the x-y plane, the x-y plane, the d-z plane, and the d′-z plane. In embodiments, refractive element 260(1) adjoins top surface 219. In embodiments, image sensor 200 includes an intermediate layer 305 between top surface 219 and refractive element 260. Intermediate layer 305 may include one or more layers, examples of which include a spectral filter array, a passivation layer, and an oxide layer.
In each of cross-sectional planes 3 and 3′, refractive element 260(1) has a height profile having at least two one-dimensional local maxima 262. In the example illustrated in
One aspect of the present embodiments includes the realization that a primary source of petal flare is light incident on, and focused, by a microlens of an adjacent pixel. The present embodiments reduce petal flare by shaping each refractive element 260 such that it has more than one local maximum 262, such that refractive element 260 effectively includes multiple microlenses each transmitting a portion of light incident on refractive element 260.
In embodiments, each local maximum 262 is a one-dimensional local maximum, such that the derivative of the height profile is zero in at least one plane, e.g., one of the x-z plane, the y-z plane, the d-z plane, and the d′-z plane. In embodiments, each local maximum 262 is a multi-dimensional local maximum, such that the derivative of the height profile is zero in at least two dimensions, e.g., at least two of the x-z plane, the y-z plane, the d-z plane, and the d′-z plane.
In embodiments, refractive element 260(1) includes an N-by-N array of microlenses 264, N is a positive integer greater than one and each of local maxima 262(1-4) is a maximum height of microlenses 264(1-4), respectively. In the example of
Refractive element 260 has a bottom surface 261. Each microlens 264 has a peak height 363 beneath its respective local maxima 262. In embodiments, peak height 363 is determined such that each microlens 264 has a back focal length equal to a distance between bottom surface 261 and top substrate surface 219. Refractive element 260 has a width 368, which is in a range between Pmin and √{square root over (Px2+Py2)}. When Px=Py are equal, Pmin=Px; otherwise Pmin is the smaller of Px and Py. To achieve such a focal length, each of peak height 363 and the radius of curvature of microlens 264 is between Pmin/(2N) and √{square root over (Px2+Py2)}/(2N).
In each of cross-sectional planes 3 and 3′, refractive element 260 has a local minimum 366 between local maxima 262. In embodiments, local minimum 366 is at least one of (i) equidistant from local maxima 262(1) and 262(2) in cross-sectional plane 3, and (ii) equidistant from local maxima 262(2) and 262(4) in cross-sectional plane 3′.
In embodiments, image sensor 200 includes a plurality of refractive elements 260 each directly above and aligned to a respective large pixel 214. Each refractive element 260 has the properties ascribed to refractive element 260(1) herein. Each refractive element 260 may be directly above a respective large pixel 214. A refractive element 260 is directly above a pixel 214 when a plane normal to top surface 219 and intersecting the pixel 214 also intersects the refractive element 260.
In direction 298D, a center-to-center separation between small pixels 612(1) and 612(2) equals to √{square root over (Px2+Py2)} in cross-sectional plane 7. In directions 298D and 298D′, each of pixels 612(1,2) have a small-pixel width W that is less than both pixel pitch Px and Py. Pixel 614(1) is between and collinear with small pixels 612(1) and 612(2). A pixel 614 may differ from pixel 214 in terms of features that accommodate one or more small pixels 612 corner-adjacent to the pixel 214. For example, pixel 614 may have an octagonal or hexagonal cross-section in a transverse plane.
In embodiments, small pixels 612(1-4) are part of a plurality of small pixels 612 that form a pixel array 612A. Pixel array 612A has a pixel pitch Px and Py in respective directions x and y. Pixel array 612A is offset from pixel array 614A by ½Px and ½Py in respective directions x and y.
In embodiments, image sensor 600 includes microlenses 770(1,2) aligned with small pixels 612(1) and 612(2), respectively. In embodiments, image sensor 600 includes a plurality of microlenses 770 each aligned to a respective small pixel 612, where the plurality of microlenses 770 includes microlenses 770(1,2).
Image sensor 600 includes a refractive element 760(1) aligned with pixel 614(1). Refractive element 760(1) is an example of microlens 260(1). Refractive element 760(1) has a width 668 that is smaller than √{square root over (Px2+Py2)} due to the presence of pixels 612 and/or microlenses 770. In embodiments, width 668 is less than or equal to √{square root over (Px2+Py2)}−W. Refractive element 760(1) has local maxima 762, and, in embodiments, includes an array of microlenses 764 each having an optical axis 765, and a local minimum 766. Local maxima 762, microlenses 764, optical axis 765, and local minimum 766 are examples of local maxima 262, microlenses 264, optical axis 265, and local minimum 366.
In embodiments, image sensor 600 includes a first opaque annulus 652(1) center-aligned with microlens 770(1) and located between the microlens 770(1) and top surface 219. In such embodiments, image sensor 600 also includes an opaque extension 640. A technical benefit of opaque extension 640 is to prevent the aforementioned petal flare caused by stray light reflected by image sensor 600. Opaque extension 640 extends, in direction 298D, an extension length 642 from boundary 213 toward second small pixel 612(2). Extension length 642 is less than L1=½(√{square root over (Px2+Py2)}−W) such that opaque extension 640 does not extend to a midpoint 215 between small pixels 612(1) and 612(2).
In direction 298Z, opaque element 640 has a thickness 646 which, in embodiments, exceeds an intensity penetration depth δ of opaque element 240 at free-space electromagnetic wavelength λ0, δ=λ0/(πκ), where κ is the imaginary part of opaque element 640's refractive index at wavelength λ0. In embodiments, thickness 646 is between 75 and 125 nanometers.
Opaque element 640 reduces petal flare by blocking diffracted illumination. However, opaque element 640 also blocks image illumination propagating directly to large pixel 614(1) from camera 190's imaging lens. Opaque element 640 has a width 644 in a direction perpendicular to length 642. In an embodiment, width 644 of opaque element 640 is less than or equal to small-pixel width W, such that opaque element 640 blocks diffracted light (resulting in petal flare) while the amount of non-stray light it blocks is reduced. In embodiments, width 644 exceeds intensity penetration depth δ and is less than small-pixel width W. Width 644 may be between 80 nanometers and 120 nanometers. In an embodiment, small-pixel width W exceeds width 644 by a factor between eight and twelve.
In embodiments, each pixel 614 has a respective refractive element 760 aligned thereto, and each pixel 612 has a respective microlens 770 aligned thereto. Refractive element 760 has a thickness 763 at local maxima 762. Microlenses 770 have a maximum thickness 773. In such embodiments, thickness 763 may equal thickness 773, which enables refractive elements 760 and microlenses 770 to be formed in parallel, e.g., via one or more masking and lithographic steps, and hence decreases fabrication costs of image sensor 600. In embodiments, microlenses 764 and microlenses 770 are identically shaped, e.g., microlenses 764 and 770 have the same radius of curvature and thickness 763 equals thickness 773.
In embodiments, image sensor 600 includes a spectral filter 754(1) that is located between microlenses 770 and top surface 219, aligned to small pixel 612(1), and surrounded by opaque annulus 652(1). Spectral filter 754(1) may be an absorptive filter, a dichroic filter, a plasmonic filter, or a combination thereof In embodiments, opaque annulus 652(1) adjoins spectral filter 754(1).
In embodiments, image sensor 600 includes a spectral filter array 754A that includes an array of spectral filters 754, of which spectral filter 754(1) is one. Each spectral filter 754 is between microlenses 770 and top surface 219, is similar to spectral filter 754(1), and is aligned to a respective pixel 612. For example, spectral filters 754 include a spectral filter 754(2) that is aligned to small pixel 612(2).
In embodiments, image sensor 600 also includes a plurality of opaque annuli 652 each aligned with a respective pixel 612. Opaque annulus 652(1) is one of opaque annuli 652.
In embodiments, image sensor 600 also includes a plurality of opaque elements 640, each of which is monolithically formed with and extending from a respective one of the plurality of opaque annuli 652 in one of direction 298D and direction 298D′. Each opaque extension 640 is an example of, and similar to, opaque extension 640(1).
Each opaque annulus 652 may include more than one opaque element 640 extending therefrom. In embodiments, image sensor 600 includes an opaque annulus 662, which is an example of opaque annulus 652 that includes four opaque extensions 640. In embodiments, opaque extensions 640 are monolithically formed with opaque annulus 652. Each opaque annulus 662 includes (a) two opaque extensions 640 extending away from a center of the opaque annulus 662 along direction 298D, and (b) two opaque extensions 660 extending away from a center of the opaque annulus 652 along direction 298D′.
Plot 1100 includes quantum efficiencies 1142, 1152, and 1162, which correspond to large pixel 614 with conventional plano-convex microlens 1030 thereon above a blue color filter, a green color filter, and a red color filter, respectively in intermediate layer 305. Plot 1000 also includes quantum efficiencies 1144, 1154, and 1164, which correspond to large pixel 614 with refractive element 1060 thereon, and with blue color filter, a green color filter, and a red color filter, respectively in intermediate layer 305. Inspection of plots 1000 and 1100 shoes that refractive element 1060 significantly decreases cross-talk while maintaining comparable quantum efficiencies.
Plot 1200 includes cross-talk 1032 introduced in
When width 1468 exceeds two times with 1412, opposing top surfaces 1419 are separated by a hole diameter 1464, which is a diameter of an aperture of annular lens 1400. In embodiments, hole diameter 1464 divided by width 1468 is between zero and 0.2. For example, when width 1468 equals 2.8 μm, hole diameter 1464 may range from zero to 500 nanometers. We found that the spectral response of a 2.8-μm pixel (Px=Py=2.8 μm) with annular lens 1400 thereon varied little as a function of hole diameter 1464 between zero to 500 nanometers.
Lobe 410 has a height 1414 and a lobe radius 1416. In embodiments, a maximum value of lobe radius 1416 is (Px,y−dhole)/4, where Px,y is one of pixel pitch Px and Py, and dhole equals hole diameter 1464. Annular lens 1400 is rotationally symmetric about an axis parallel to the z axis.
Plot 1500 includes cross-talk 1510, 1520, and 1530. Cross-talk 1510 is from large pixel 614 with a conventional plano-convex microlens thereon and opaque extensions 640. Cross-talk 1520 is from a large pixel 614 with an annular microlens 960 thereon and no opaque extensions. Cross-talk 1530 is from a large pixel 614 with both opaque extensions 640 and an annular microlens 960 thereon. Comparison of cross-talk 1510, 1520, and 1530 reveals that the combination of annular microlens 960 and opaque extensions 640 (cross-talk 1530) best reduces cross-talk.
Features described above as well as those claimed below may be combined in various ways without departing from the scope hereof. The following enumerated examples illustrate some possible, non-limiting combinations.
(A1) A flare-suppressing image sensor includes a first pixel formed in a substrate and a refractive element located above the first pixel. The refractive element has, with respect to a top surface of the substrate, a height profile having at least two one-dimensional local maxima in each of a first cross-sectional plane and a second cross-sectional plane perpendicular to the first cross-sectional plane. Each of the first and second cross-sectional planes is perpendicular to the top surface and intersects the first pixel.
(A2) In the image sensor (A1), the refractive element may include an N-by-N array of microlenses, N being an integer greater than one. Each of the plurality of microlenses has a respective optical axis that intersects the first pixel.
(A3) In the image sensor (A1), each respective optical axis may be perpendicular to the top surface.
(A4) In any of image sensors (A1)-(A3), N may equal two.
(A5) In any of image sensors (A1)-(A4), the refractive element may be rotationally symmetric about an axis perpendicular to the top surface, the height profile having exactly two local maxima in each of the first and second cross-sectional planes.
(A6) In any image sensor (A5), the height profile may include a local minimum equidistant from each of the local maxima.
(A7) Any of image sensors (A1)-(A6) may further include a plurality of large pixels in the semiconductor substrate, a first small pixel, and a second small pixel. The plurality of large pixels forms a pixel array that has a pixel pitch Px and Py in respective orthogonal directions x and y each parallel to the top surface. The first pixel is one of the plurality of large pixels. Each of the first and a second small pixel have (a) a center-to-center separation equal to √{square root over (Px2+Py2)} in a first direction and (b) in the first direction, a small-pixel width W less than both pixel pitch Px and Py. The first pixel is between the first and second small pixels.
(A8) In any image sensor (A7), an angle between the first direction and direction x may equal arctan(Py/Px).
(A9) Any of image sensors (A7) and (A8) may further include a first microlens aligned to the first small pixel and a second microlens aligned to the second small pixel.
(A10) Any image sensor (A9) may further include a first opaque annulus and a first opaque element. The first opaque annulus is center-aligned with the first microlens and located between the first microlens and the top surface. The first opaque element extends a length L1 from the first opaque annulus in the first direction. Length L1 is less than ½(√{square root over (Px2+Py2)}−W) from a boundary between the first small pixel and the first pixel and toward the second small pixel. In a second direction perpendicular to the first direction, the first opaque element has a first width less than or equal to small-pixel width W.
(A11) Any image sensor (A10) may further include a spectral filter located between the first microlens and the top surface, aligned to the first small pixel, and surrounded by the first opaque annulus.
(A12) Any image sensors (A10) and (A11) may further include a second opaque annulus and a second opaque element. The second opaque annulus is center-aligned with the second microlens and located between the second microlens and the top surface. The second opaque element extends a length L2 from the first opaque annulus opposite the first direction. Length L2 is less than ½(√{square root over (Px2+Py2)}−W) from a boundary between the second small pixel and the first pixel and toward the first small pixel. The second opaque element has, in the second direction, a second width less than or equal to small-pixel width W.
(A13) Any image sensor (A12) may further include a second spectral filter located between the second microlens and the top surface, aligned to the second small pixel, and surrounded by the second opaque annulus.
(A14) Any of image sensors (A7)-(A13) may further include a third and a fourth small pixel having a center-to-center separation equal to √{square root over (Px2+Py2)} in the second direction and each having small-pixel width W in the first direction. The first pixel is between the third and fourth small pixels. The first and third small pixels have a center-to-center separation equal to Px; the second and fourth small pixels have a center-to-center separation equal to Py.
(A15) In any of image sensors (A1)-(A14) the refractive element may be formed of a glass having a transition temperature between 140° C. and 180° C.
Changes may be made in the above methods and systems without departing from the scope of the present embodiments. It should thus be noted that the matter contained in the above description or shown in the accompanying drawings should be interpreted as illustrative and not in a limiting sense. Herein, and unless otherwise indicated the phrase “in embodiments” is equivalent to the phrase “in certain embodiments,” and does not refer to all embodiments. The following claims are intended to cover all generic and specific features described herein, as well as all statements of the scope of the present method and system, which, as a matter of language, might be said to fall therebetween.
Number | Name | Date | Kind |
---|---|---|---|
4348254 | Lindmayer | Sep 1982 | A |
7973380 | Hsu et al. | Jul 2011 | B2 |
8530266 | Chen et al. | Sep 2013 | B1 |
8716594 | Dutta | May 2014 | B2 |
9030550 | Georgiev | May 2015 | B2 |
9780131 | Woo et al. | Oct 2017 | B1 |
9954020 | Lu et al. | Apr 2018 | B1 |
10811453 | Mun | Oct 2020 | B1 |
20040100570 | Shizukuishi | May 2004 | A1 |
20080018765 | Choi | Jan 2008 | A1 |
20080142686 | Konno et al. | Jun 2008 | A1 |
20110298074 | Funao | Dec 2011 | A1 |
20120086094 | Watanabe | Apr 2012 | A1 |
20120217602 | Enomoto | Aug 2012 | A1 |
20130050526 | Keelan | Feb 2013 | A1 |
20130200251 | Velichko | Aug 2013 | A1 |
20130270665 | Sasaki | Oct 2013 | A1 |
20140267848 | Wu | Sep 2014 | A1 |
20140346628 | Okazaki | Nov 2014 | A1 |
20150001660 | Fukumizu | Jan 2015 | A1 |
20150091122 | Okazaki | Apr 2015 | A1 |
20150097213 | Chen | Apr 2015 | A1 |
20150162365 | Chang | Jun 2015 | A1 |
20150206921 | Imoto | Jul 2015 | A1 |
20150236066 | Tayanaka | Aug 2015 | A1 |
20160035770 | Ahn et al. | Feb 2016 | A1 |
20160049430 | Nomura | Feb 2016 | A1 |
20160064430 | Lee | Mar 2016 | A1 |
20170338265 | Yoshiba | Nov 2017 | A1 |
20170352771 | Gu et al. | Dec 2017 | A1 |
20180084185 | Lu et al. | Mar 2018 | A1 |
20180160058 | Nakata | Jun 2018 | A1 |
20180277580 | Chiang | Sep 2018 | A1 |
20180308883 | Yanagita | Oct 2018 | A1 |
20190035838 | Byun | Jan 2019 | A1 |
20190067346 | Borthakur | Feb 2019 | A1 |
20190096945 | Lu | Mar 2019 | A1 |
20190103430 | Tayanaka | Apr 2019 | A1 |
20190131328 | Kim | May 2019 | A1 |
20190148448 | Lee | May 2019 | A1 |
20200013808 | Kumagai | Jan 2020 | A1 |
20200348455 | Summa | Nov 2020 | A1 |
20210074751 | Bonakdar | Mar 2021 | A1 |
20210151482 | Phan | May 2021 | A1 |
20210183924 | Manda et al. | Jun 2021 | A1 |
20210193727 | Asatsuma | Jun 2021 | A1 |
20210202546 | Liu | Jul 2021 | A1 |
20210242259 | Bonakdar | Aug 2021 | A1 |
20210242262 | Bonakdar | Aug 2021 | A1 |
Number | Date | Country |
---|---|---|
103399368 | Nov 2013 | CN |
203365711 | Dec 2013 | CN |
102019003217 | Nov 2019 | DE |
H05129569 | May 1993 | JP |
Entry |
---|
U.S. Appl. No. 16/777,193, Office Action dated Sep. 15, 2021, 10 pages. |
Chang, et al. “Shape-controlled, high fill-factor microlens arrays fabricated by a 3D diffuser lithography and plastic replication method.” Optics Express 12.25 (2004): 6366-6371. |
Kim, Y. et al., “High-Sensitivity Pixels with a Quad-WRGB Color Filter and Spatial Deep-Trench Isolation” Sensors 2019, 10 pages. |
U.S. Appl. No. 16/777,060, Non-Final Office Action dated Oct. 27, 2021, 14 pages. |
U.S. Appl. No. 16/777,027, Non-Final Office Action dated Jan. 18, 2022, 16 pages. |
Number | Date | Country | |
---|---|---|---|
20210242262 A1 | Aug 2021 | US |