The subject matter disclosed herein relates to image sensors. More particular, the subject matter disclosed herein relates to a progressive metalens may have different focal lengths and FOVs at different areas of the metalens.
A greater number of details are usually recognized at the center of the field of view (FOV) of the human vision system, while at the periphery of the FOV only moving objects may be usually monitored. This ability corresponds to a higher-angular resolution at the center of the FOV of human vision and a lower-angular resolution at the periphery. In contrast, image sensors and cameras typically have a constant spatial/angular resolution for the entire FOV of the device. If the resolution of an image sensor or camera is high, the power consumed by reading out sensed image data and by processing the image data may be higher than necessary. A camera having a fisheye lens has very wide FOV; however, the spatial resolution at the center of the fisheye lens is low, which reduces the accuracy of object detection. Consequently, a very wide FOV for an image sensor or camera may not be the best overall solution.
An example embodiment provides a metalens that may include a first region of nanostructures and a second region of nanostructures. The first region of nanostructures may direct a FOV of light incident on the first region of nanostructures to a first region of an image plane. The second region of nanostructures may direct a second FOV of light incident on the second region of nanostructures to a second region of the image plane in which the second FOV may be different from the first FOV, and in which the second region of the image plane may be different from the first region of the image plane. In one embodiment, the metalens may further include a third region of nanostructures that may direct a third FOV of light incident on the third region of nanostructures to a third region of the image plane in which the third FOV may be different from the first FOV and the second FOV, and in which the third region of the image plane may be different from the first region and the second region of the image plane. In one embodiment, the first region of nanostructures may be arranged to surround the second region of nanostructures and the second region of nanostructures may be arranged to surround the third region of nanostructures. In another embodiment, the first region of nanostructures may be arranged to be adjacent to the second region of nanostructures, and the third region of nanostructures may be arranged to be adjacent to the second region of nanostructures.
An example embodiment provides a metalens that may include a first region of nanostructures and a second region of nanostructures. The first region of nanostructures may directs a first FOV of light incident on the first region of nanostructures to a first region of an image plane, and in which nanostructures of the first region of nanostructures may include at least one layer of nanostructures formed on a substrate. The second region of nanostructures may direct a second FOV of light incident on the second region of nanostructures to a second region of the image plane in which the second FOV may be different from the first FOV, the second region of the image plane may be different from the first region of the image plane, and nanostructures of the second region of nanostructures may include at least one layer of nanostructures formed on the substrate. In one embodiment, nanostructures of the first region of nanostructures may be formed on a first surface of the substrate, and nanostructures of the second region of nanostructures may be formed on the first surface and a second surface of the substrate in which the second surface is opposite the first surface. The substrate may be one of a planar surface and a curved surface.
An example embodiment provides a metalens that may include a first region of nanostructures and a second region of nanostructures. The first region of nanostructures may directs a first FOV of light incident on the first region of nanostructures to a first region of an image plane in which the image plane may substantially coincide with a surface of an image sensor array. The second region of nanostructures may direct a second FOV of light incident on the second region of nanostructures to a second region of the image plane in which the second FOV may be different from the first FOV and the second region of the image plane may be different from the first region of the image plane. In one embodiment, the metalens may further include a third region of nanostructures that may direct a third FOV of light incident on the third region of nanostructures to a third region of the image plane in which the third FOV may be different from the first FOV and the second FOV, and the third region of the image plane may be different from the first region and the second region of the image plane.
In the following section, the aspects of the subject matter disclosed herein will be described with reference to exemplary embodiments illustrated in the figure, in which:
In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the disclosure. It will be understood, however, by those skilled in the art that the disclosed aspects may be practiced without these specific details. In other instances, well-known methods, procedures, components and circuits have not been described in detail not to obscure the subject matter disclosed herein.
Reference throughout this specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment disclosed herein. Thus, the appearances of the phrases “in one embodiment” or “in an embodiment” or “according to one embodiment” (or other phrases having similar import) in various places throughout this specification may not be necessarily all referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments. In this regard, as used herein, the word “exemplary” means “serving as an example, instance, or illustration.” Any embodiment described herein as “exemplary” is not to be construed as necessarily preferred or advantageous over other embodiments. Additionally, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Also, depending on the context of discussion herein, a singular term may include the corresponding plural forms and a plural term may include the corresponding singular form. Similarly, a hyphenated term (e.g., “two-dimensional,” “pre-determined,” “pixel-specific,” etc.) may be occasionally interchangeably used with a corresponding non-hyphenated version (e.g., “two dimensional,” “predetermined,” “pixel specific,” etc.), and a capitalized entry (e.g., “Counter Clock,” “Row Select,” “PIXOUT,” etc.) may be interchangeably used with a corresponding non-capitalized version (e.g., “counter clock,” “row select,” “pixout,” etc.). Such occasional interchangeable uses shall not be considered inconsistent with each other.
Also, depending on the context of discussion herein, a singular term may include the corresponding plural forms and a plural term may include the corresponding singular form. It is further noted that various figures (including component diagrams) shown and discussed herein are for illustrative purpose only, and are not drawn to scale. Similarly, various waveforms and timing diagrams are shown for illustrative purpose only. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, if considered appropriate, reference numerals have been repeated among the figures to indicate corresponding and/or analogous elements.
The terminology used herein is for the purpose of describing some example embodiments only and is not intended to be limiting of the claimed subject matter. As used herein, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. The terms “first,” “second,” etc., as used herein, are used as labels for nouns that they precede, and do not imply any type of ordering (e.g., spatial, temporal, logical, etc.) unless explicitly defined as such. Furthermore, the same reference numerals may be used across two or more figures to refer to parts, components, blocks, circuits, units, or modules having the same or similar functionality. Such usage is, however, for simplicity of illustration and ease of discussion only; it does not imply that the construction or architectural details of such components or units are the same across all embodiments or such commonly-referenced parts/modules are the only way to implement some of the example embodiments disclosed herein.
It will be understood that when an element or layer is referred to as being on, “connected to” or “coupled to” another element or layer, it can be directly on, connected or coupled to the other element or layer or intervening elements or layers may be present. In contrast, when an element is referred to as being “directly on,” “directly connected to” or “directly coupled to” another element or layer, there are no intervening elements or layers present. Like numerals refer to like elements throughout. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
The terms “first,” “second,” etc., as used herein, are used as labels for nouns that they precede, and do not imply any type of ordering (e.g., spatial, temporal, logical, etc.) unless explicitly defined as such. Furthermore, the same reference numerals may be used across two or more figures to refer to parts, components, blocks, circuits, units, or modules having the same or similar functionality. Such usage is, however, for simplicity of illustration and ease of discussion only; it does not imply that the construction or architectural details of such components or units are the same across all embodiments or such commonly-referenced parts/modules are the only way to implement some of the example embodiments disclosed herein.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this subject matter belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As used herein, the term “module” refers to any combination of software, firmware and/or hardware configured to provide the functionality described herein in connection with a module. For example, software may be embodied as a software package, code and/or instruction set or instructions, and the term “hardware,” as used in any implementation described herein, may include, for example, singly or in any combination, an assembly, hardwired circuitry, programmable circuitry, state machine circuitry, and/or firmware that stores instructions executed by programmable circuitry. The modules may, collectively or individually, be embodied as circuitry that forms part of a larger system, for example, but not limited to, an integrated circuit (IC), system on-chip (SoC), an assembly, and so forth.
The subject matter disclosed herein provides a progressive metalens for an imaging or a camera system. In one embodiment, a progressive metalens may have different focal lengths and FOVs at different areas of the metalens. For example, the angular resolution at the sides, or periphery, of the metalens may be compressed while the center of the metalens has a high resolution. That is, the center portion of the progressive metalens may have a relatively longer focal length and narrower FOV, while side portions may have shorter focal length and wider FOV.
In one embodiment, the progressive metalens disclosed herein may provide a near-field FOV having a relatively enlarged FOV with lower spatial resolution, while also providing a far-field FOV having a higher spatial resolution and lower FOV. The progressive lens disclosed herein may allow a larger FOV to be monitored for object detection, while also allowing a lower sensor-spatial resolution having a reduced processing power.
The progressive metalens disclosed herein may provide an improved object detection for a far-field FOV while still being able to monitor a wider range of a near-field FOV. The progressive metalens disclosed herein may be used in Advanced Driver Assist Systems (ADASs), a smartphone, a camera, a mobile telephone, industrial applications, robotic applications, etc., and may cover a combined large FOV so that many objects in a scene may be tracked.
The progressive metalens disclosed herein may be flexibly designed for different applications. The progressive metalens may include a single, a dual or more layers of nanostructures or a set of repeating nanostructures to vary the FOV spatially along the metalens. In one embodiment, the progressive metalens disclosed herein may include discrete steps for different focal lengths, while in another embodiment, the progressive metalens may include a generally continuously changed focal length. In one embodiment, the progressive lens disclosed herein may be implemented using a nanophotonic fabrication technique on a flat or a curved substrate surface.
At bottom left of
The metalens 300 may diffract and/or focus incident light 304 onto a pixel array 305 on the sensor chip 303. In one embodiment, the pixel array 305 may include an optional microlens 306. The pixel array 305 may be a single pixel array or multiple pixel arrays arranged to receive light diffracted and/or focused by the metalens 300. In one embodiment, the pixel array 305 may be one or more individual 2D and 3D pixel arrays. In another embodiment, the pixel array 305 may be one or more hybrid 2D and 3D pixel arrays. Peripheral components 307 that support the pixel arrays may also be formed on the sensor chip 303.
In the embodiment depicted in
Electronic device 900 and the various system components of electronic device 900 may include the image processing unit 960. In one embodiment, the image processing unit may be part of an imaging system that includes a progressive metalens may have different focal lengths and FOVs at different areas of the metalens according to the subject matter disclosed herein. The interface 940 may be configured to include a wireless interface that is configured to transmit data to or receive data from a wireless communication network using a RF signal. The wireless interface 940 may include, for example, an antenna, a wireless transceiver and so on. The electronic system 900 also may be used in a communication interface protocol of a communication system, such as, but not limited to, Code Division Multiple Access (CDMA), Global System for Mobile Communications (GSM), North American Digital Communications (NADC), Extended Time Division Multiple Access (E-TDMA), Wideband CDMA (WCDMA), CDMA2000, Wi-Fi, Municipal Wi-Fi (Muni Wi-Fi), Bluetooth, Digital Enhanced Cordless Telecommunications (DECT), Wireless Universal Serial Bus (Wireless USB), Fast low-latency access with seamless handoff Orthogonal Frequency Division Multiplexing (Flash-OFDM), IEEE 802.20, General Packet Radio Service (GPRS), iBurst, Wireless Broadband (WiBro), WiMAX, WiMAX-Advanced, Universal Mobile Telecommunication Service - Time Division Duplex (UMTS-TDD), High Speed Packet Access (HSPA), Evolution Data Optimized (EVDO), Long Term Evolution - Advanced (LTE-Advanced), Multichannel Multipoint Distribution Service (MMDS), and so forth.
Embodiments of the subject matter and the operations described in this specification may be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Embodiments of the subject matter described in this specification may be implemented as one or more computer programs, i.e., one or more modules of computer-program instructions, encoded on computer-storage medium for execution by, or to control the operation of, data-processing apparatus. Alternatively or in addition, the program instructions can be encoded on an artificially-generated propagated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus. A computer-storage medium can be, or be included in, a computer-readable storage device, a computer-readable storage substrate, a random or serial-access memory array or device, or a combination thereof. Moreover, while a computer-storage medium is not a propagated signal, a computer-storage medium may be a source or destination of computer-program instructions encoded in an artificially-generated propagated signal. The computer-storage medium can also be, or be included in, one or more separate physical components or media (e.g., multiple CDs, disks, or other storage devices). Additionally, the operations described in this specification may be implemented as operations performed by a data-processing apparatus on data stored on one or more computer-readable storage devices or received from other sources.
While this specification may contain many specific implementation details, the implementation details should not be construed as limitations on the scope of any claimed subject matter, but rather be construed as descriptions of features specific to particular embodiments. Certain features that are described in this specification in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may also be implemented in multiple embodiments separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination may in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of various system components in the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
Thus, particular embodiments of the subject matter have been described herein. Other embodiments are within the scope of the following claims. In some cases, the actions set forth in the claims may be performed in a different order and still achieve desirable results. Additionally, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing may be advantageous.
As will be recognized by those skilled in the art, the innovative concepts described herein may be modified and varied over a wide range of applications. Accordingly, the scope of claimed subject matter should not be limited to any of the specific exemplary teachings discussed above, but is instead defined by the following claims.
This application is a continuation of U.S. Pat. Application Serial No. 16/999,059, filed on Aug. 20, 2020, which claims the priority benefit under 35 U.S.C. § 119(e) of U.S. Provisional Application Serial No. 63/038,116, filed on Jun. 11, 2020, the disclosures of which are incorporated herein by reference in their entirety.
Number | Date | Country | |
---|---|---|---|
63038116 | Jun 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16999059 | Aug 2020 | US |
Child | 18125108 | US |