This relates generally to image sensors and, more particularly, to image sensors having lenses to focus light.
Image sensors are commonly used in electronic devices such as cellular telephones, cameras, and computers to capture images. In a typical arrangement, an electronic device is provided with an array of image pixels arranged in pixel rows and pixel columns. Each image pixel in the array includes a photodiode that is coupled to a floating diffusion region via a transfer gate. Each pixel receives incident photons (light) and converts the photons into electrical signals. Column circuitry is coupled to each pixel column for reading out pixel signals from the image pixels. Image sensors are sometimes designed to provide images to electronic devices using a Joint Photographic Experts Group (JPEG) format.
Conventional image sensors sometimes include a color filter element and a microlens above each pixel. The microlenses of conventional image sensors typically have curved surfaces and use refraction to focus light on an underlying photodiode. However, these types of microlenses may allow peripheral light to pass through the microlenses without being focused, leading to optical cross-talk.
It would therefore be desirable to provide improved lenses for image sensors.
Embodiments of the present invention relate to image sensors with pixels that include diffractive lenses. An electronic device with a digital camera module is shown in
Still and video image data from image sensor 16 may be provided to image processing and data formatting circuitry 14 via path 27. Image processing and data formatting circuitry 14 may be used to perform image processing functions such as automatic focusing functions, depth sensing, data formatting, adjusting white balance and exposure, implementing video image stabilization, face detection, etc. For example, during automatic focusing operations, image processing and data formatting circuitry 14 may process data gathered by phase detection pixels in image sensor 16 to determine the magnitude and direction of lens movement (e.g., movement of lens 29) needed to bring an object of interest into focus.
Image processing and data formatting circuitry 14 may also be used to compress raw camera image files if desired (e.g., to Joint Photographic Experts Group or JPEG format). In a typical arrangement, which is sometimes referred to as a system on chip (SOC) arrangement, camera sensor 16 and image processing and data formatting circuitry 14 are implemented on a common integrated circuit. The use of a single integrated circuit to implement camera sensor 16 and image processing and data formatting circuitry 14 can help to reduce costs. This is, however, merely illustrative. If desired, camera sensor 14 and image processing and data formatting circuitry 14 may be implemented using separate integrated circuits. If desired, camera sensor 16 and image processing circuitry 14 may be formed on separate semiconductor substrates. For example, camera sensor 16 and image processing circuitry 14 may be formed on separate substrates that have been stacked.
Camera module 12 may convey acquired image data to host subsystems 19 over path 18 (e.g., image processing and data formatting circuitry 14 may convey image data to subsystems 19). Electronic device 10 typically provides a user with numerous high-level functions. In a computer or advanced cellular telephone, for example, a user may be provided with the ability to run user applications. To implement these functions, host subsystem 19 of electronic device 10 may include storage and processing circuitry 17 and input-output devices 21 such as keypads, input-output ports, joysticks, and displays. Storage and processing circuitry 17 may include volatile and nonvolatile memory (e.g., random-access memory, flash memory, hard drives, solid state drives, etc.). Storage and processing circuitry 17 may also include microprocessors, microcontrollers, digital signal processors, application specific integrated circuits, or other processing circuits.
As shown in
Row control circuitry 26 may receive row addresses from control circuitry 24 and supply corresponding row control signals such as reset, row-select, charge transfer, dual conversion gain, and readout control signals to pixels 22 over row control paths 30. One or more conductive lines such as column lines 32 may be coupled to each column of pixels 22 in array 20. Column lines 32 may be used for reading out image signals from pixels 22 and for supplying bias signals (e.g., bias currents or bias voltages) to pixels 22. If desired, during pixel readout operations, a pixel row in array 20 may be selected using row control circuitry 26 and image signals generated by image pixels 22 in that pixel row can be read out along column lines 32.
Image readout circuitry 28 may receive image signals (e.g., analog pixel values generated by pixels 22) over column lines 32. Image readout circuitry 28 may include sample-and-hold circuitry for sampling and temporarily storing image signals read out from array 20, amplifier circuitry, analog-to-digital conversion (ADC) circuitry, bias circuitry, column memory, latch circuitry for selectively enabling or disabling the column circuitry, or other circuitry that is coupled to one or more columns of pixels in array 20 for operating pixels 22 and for reading out image signals from pixels 22. ADC circuitry in readout circuitry 28 may convert analog pixel values received from array 20 into corresponding digital pixel values (sometimes referred to as digital image data or digital pixel data). Image readout circuitry 28 may supply digital pixel data to control and processing circuitry 24 over path 25 for pixels in one or more pixel columns.
Lens 42 may be transparent to incident light. Therefore, some light may pass through the lens without being focused. For example, incident light 46-1 may pass through the center of diffractive lens 42. The corresponding light 46-2 on the other side of the diffractive lens may travel in the same direction as incident light 46-1. In contrast, incident light at the edge of diffractive lens 42 may be redirected due to diffraction. For example, incident light 46-3 may pass by the edge of diffractive lens 42. The light may be redirected such that the output light 46-4 travels at an angle 48 relative to the incident light 46-3. In other words, the diffractive lens redirects the light at the edge of the lens using diffraction.
Diffraction occurs when a wave (such as light) encounters an obstacle. When light passes around the edge of an object, it will be bent or redirected such that the direction of the original incident light changes. The amount and direction of bending depends on numerous factors. In an imaging sensor, diffraction of light can be used (with diffractive lenses) to redirect incident light in desired ways (i.e., focusing incident light on photodiodes to mitigate optical cross-talk).
In the example of
As shown in
Lens 50 may be transparent to incident light. Therefore, some light may pass through the lens without being focused. For example, incident light 46-1 may pass through the center of diffractive lens 50. The corresponding light 46-2 on the other side of the diffractive lens may travel in the same direction as incident light 46-1. In contrast, incident light at the edge of diffractive lens 50 may be redirected due to diffraction. For example, incident light 46-3 may pass by the edge of diffractive lens 50. The light may be redirected such that the output light 46-4 travels at an angle 54 relative to the incident light 46-3. In other words, the diffractive lens redirects the light at the edge of the lens using diffraction.
In addition to the refractive indexes of the diffractive lens and the surrounding material, the thickness of the diffractive lens may also affect the response of incident light to the diffractive lens.
In particular, incident light 46-3 may pass by the edge of diffractive lens 42. The light may be redirected such that the output light 46-4 travels at an angle 48-1 relative to the incident light 46-3. This angle may be dependent upon the thickness 56 of diffractive lens 42. In the example of
In contrast, diffractive lens 42 in
Diffractive lenses 42 in
This shows how diffractive lenses may be used to redirect incident light in desired ways. The refractive indexes of the lens and surrounding material may be altered to customize the response of incident light. Additionally, the thickness, length, and width, of the diffractive lens may be altered to customize the response of incident light.
Color filters such as color filter elements 66 may be interposed between diffractive lenses 64 and substrate 60. Color filter elements 66 may filter incident light by only allowing predetermined wavelengths to pass through color filter elements 66 (e.g., color filter 66 may only be transparent to the certain ranges of wavelengths). Color filter elements 66 may be part of a color filter array formed on the back surface of substrate 60. A respective diffractive lens 64 may cover each color filter element 66 in the color filter array. Light can enter from the back side of the image pixels through diffractive lenses 64. While in
Color filters 66 may include green filters, red filters, blue filters, yellow filters, cyan filters, magenta filters, clear filters, infrared filters, or other types of filters. As an example, a green filter passes green light (e.g., light with wavelengths from 495 nm to 570 nm) and reflects and/or absorbs light out of that range (e.g., the green filter reflects red light and blue light). An example of a color filter array pattern that may be used is the GRBG (green-red-blue-green) Bayer pattern. In this type of configuration, the color filter array is arranged into groups of four color filters. In each group, two of the four color filters are green filters, one of the four color filters is a red filter, and the remaining color filter is a blue filter. If desired, other color filter array patterns may be used.
A layer (sometimes referred to as a planarization layer, passivation layer, dielectric layer, film, planar film, or planarization film) may be interposed between color filter elements 66 and diffractive lenses 64. Planarization layer 68 may be formed across the entire array of imaging pixels in image sensor 16. Cladding 70 may cover diffractive lenses 64 on the other side of planarization layer 68. In other words, diffractive lenses 64 may have first and second opposing sides with planarization layer 68 formed on the first side and cladding 70 formed on the second side.
Diffractive lenses 64 may be formed from any desired material. It may be desirable for diffractive lenses 64 to be transparent and formed from a material with a higher refractive index than the surrounding materials. Diffractive lenses 64 may sometimes be formed from silicon nitride (with a refractive index of approximately 1.9). In general, diffractive lenses 64 may have any desired index of refraction (e.g., between 1.8 and 2.0, between 1.6 and 2.2, between 1.5 and 2.5, between 1.5 and 2.0, more than 1.3, more than 1.6, more than 1.8, more than 2.0, less than 2.0, less than 1.8, etc.). Planarization layer 68 may also be transparent and formed from a material with any desired refractive index (e.g., a lower refractive index than diffractive lenses 64). Planar layer 68 may be formed from a material with a refractive index between 1.3 and 1.5, between 1.2 and 1.8, greater than 1.3, or any other desired refractive index. Cladding 70 may be formed from any desired material (i.e., air, the same material as planar film 68, etc.). Cladding 70 may also have a different (e.g., lower) refractive index than diffractive lenses 64.
Diffractive lenses 64 may have a higher index of refraction than the surrounding materials (cladding 70 and planar film 68). Accordingly, light passing by the edge of diffractive lenses may be focused towards the photodiodes of the pixels.
As previously discussed, the refractive indexes of the diffractive lenses and surrounding materials, as well as the dimensions of the diffractive lenses, may be altered to customize the response to incident light. Additionally, the distance 72 between each diffractive lens may be altered to change the response of incident light.
In some embodiments, the diffractive lens over each pixel in the pixel array may be the same. However, in other embodiments different pixels may have unique diffractive lenses to further customize the response to incident light.
In
As previously mentioned, each diffractive lens 64 may have any desired shape.
In the embodiments of
As shown in
In yet another arrangement shown in
In the embodiments of
In various embodiments, an image sensor may have a plurality of imaging pixels that each includes a photodiode, a color filter element formed over the photodiode, and a diffractive lens formed over the color filter element. The diffractive lens of each imaging pixel may have a planar upper surface and a planar lower surface. No microlens with a curved surface may be formed over the diffractive lens of each pixel. The diffractive lens may include silicon nitride. The image sensor may also include a planarization layer that is formed over the plurality of imaging pixels. Each diffractive lens may be formed on an upper surface of the planarization layer. Each diffractive lens may be embedded within the planarization layer. The planarization layer may have a first index of refraction, the diffractive lens for each imaging pixel may have a second index of refraction, and the second index of refraction may be greater than the first index of refraction. There may be a gap between each diffractive lens and respective adjacent diffractive lenses.
In various embodiments, an imaging pixel may include a photosensitive area, a color filter element formed over the photosensitive area, a planarization layer formed over the color filter element, and a diffractive lens formed over the color filter element. The diffractive lens may be transparent, the diffractive lens may have first and second opposing surfaces, the first and second surfaces of the diffractive lens may be planar, the diffractive lens may have a first index of refraction, and the planarization layer may have a second index of refraction that is lower than the first index of refraction.
The planarization layer may have first and second opposing surfaces and the first and second surfaces of the planarization layer may be parallel to the first and second surfaces of the diffractive lens. The diffractive lens may be formed on an upper (or lower) surface of the planarization layer. The diffractive lens may be embedded within the planarization layer. Light incident on a central portion of the imaging pixel may pass through the diffractive lens without being redirected and light incident on an edge portion of the imaging pixel may be redirected by the diffractive lens towards the photosensitive area. The imaging pixel may also include an additional diffractive lens formed over (or under) the diffractive lens. The additional diffractive lens may have a third index of refraction. The second index of refraction may be greater than the third index of refraction. The second index of refraction may be less than the third index of refraction.
In various embodiments, an image sensor may include a plurality of imaging pixels that each includes a photosensitive area and a planar diffractive lens formed over the photosensitive area that focuses incident light onto the photosensitive area. The planar diffractive lens of each imaging pixel may be surrounded by at least one layer and the planar diffractive lens of each imaging pixel may have a greater index of refraction than the at least one layer. The planar diffractive lens may include silicon nitride.
The foregoing is merely illustrative of the principles of this invention and various modifications can be made by those skilled in the art without departing from the scope and spirit of the invention.
Number | Name | Date | Kind |
---|---|---|---|
4878735 | Vilums | Nov 1989 | A |
5734155 | Rostoker | Mar 1998 | A |
9099580 | Hirigoyen et al. | Aug 2015 | B2 |
20050110104 | Boettiger et al. | May 2005 | A1 |
20050242271 | Weng et al. | Nov 2005 | A1 |
20060145056 | Jung | Jul 2006 | A1 |
20060177959 | Boettiger | Aug 2006 | A1 |
20060292735 | Boettiger et al. | Dec 2006 | A1 |
20070001252 | Noda et al. | Jan 2007 | A1 |
20070127125 | Sasaki | Jun 2007 | A1 |
20070278604 | Minixhofer | Dec 2007 | A1 |
20090090937 | Park | Apr 2009 | A1 |
20090127440 | Nakai | May 2009 | A1 |
20090160965 | Sorek et al. | Jun 2009 | A1 |
20100091168 | Igarashi | Apr 2010 | A1 |
20110096210 | Koshino | Apr 2011 | A1 |
20110234830 | Kiyota et al. | Sep 2011 | A1 |
20130015545 | Toumiya et al. | Jan 2013 | A1 |
20130240962 | Wang et al. | Sep 2013 | A1 |
20140091205 | Takamiya | Apr 2014 | A1 |
20140197301 | Velichko et al. | Jul 2014 | A1 |
20140313379 | Mackey | Oct 2014 | A1 |
20150109501 | Sekine | Apr 2015 | A1 |
20160111461 | Ahn et al. | Apr 2016 | A1 |
20160211306 | Choi et al. | Jul 2016 | A1 |
20160351610 | Chen | Dec 2016 | A1 |
20160377871 | Kress et al. | Dec 2016 | A1 |
20170133420 | Silsby | May 2017 | A1 |
20170141145 | Yamashita et al. | May 2017 | A1 |
20170176787 | Jia et al. | Jun 2017 | A1 |
20180026065 | Hsieh et al. | Jan 2018 | A1 |
20180145103 | Hirigoyen | May 2018 | A1 |
Number | Date | Country | |
---|---|---|---|
20190096942 A1 | Mar 2019 | US |