The present disclosure relates generally to apparatuses, non-transitory machine-readable media, and methods for stacked polarizer imaging.
Images can be captured by an imaging system that can include light capturing devices such as lenses and the imaging system converts the light to electrical signals that is stored and viewed on computing devices as an image. A computing device is a mechanical or electrical device that transmits or modifies energy to perform or assist in the performance of human tasks. Examples include thin clients, personal computers, printing devices, laptops, mobile devices (e.g., e-readers, tablets, smartphones, etc.), internet-of-things (IoT) enabled devices, and gaming consoles, among others. An IoT enabled device can refer to a device embedded with electronics, software, sensors, actuators, and/or network connectivity which enable such devices to connect to a network and/or exchange data. Examples of IoT enabled devices include mobile phones, smartphones, tablets, phablets, computing devices, implantable devices, vehicles, home appliances, smart home devices, monitoring devices, wearable devices, devices enabling intelligent shopping systems, among other cyber-physical systems.
A computing device can include sensors, such as an image sensor, to capture image data and a display used to view images and/or text. The display can be a touchscreen display that serves as an input device. When a touchscreen display is touched by a finger, digital pen (e.g., stylus), or other input mechanism, associated data can be received by the computing device.
Embodiments of the present disclosure include apparatuses and methods for stacked polarizer imaging. In a number of embodiments, a method can include activating a first polarization layer of a plurality of polarization layers, detecting a first image with an array of pixels from a light source input that is polarized when passed through the first polarization layer, and determining, via a controller coupled to the array of pixels, whether a quality of the first image that was polarized by the first polarization layer meets a threshold. A stacked polarizer can include a plurality of polarizers that are stacked upon each other such that a light source input can be pass through the stack of polarizers and be detected by a pixel of an image sensor cell. Each of the polarizers in the stack of polarizers can be individually activated and deactivated. For example, in an array of image sensor cells a first polarizer of each image sensor cell can be activated and the other polarizers can be deactivated such that a light source input can pass through the stack of polarizers and be polarized by the first polarizer and image sensor cells can capture an image that is polarized with the first polarizer. This process can continue by activating a second polarizer of each image sensor cell and deactivating the other polarizers, such that an image that is polarized with the second polarizer can be captured.
A stacked polarizer can be used to capture images with different polarizations, while not increasing the footprint of an image sensor. The stacked polarizer can be positioned in front of a pixel of an image sensor cell and have a footprint that is no larger than the pixel.
As used herein, designators such as “N,” “M,” etc., particularly with respect to reference numerals in the drawings, indicate that a number of the particular feature so designation can be included. It is also to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used herein, the singular forms “a,” “an,” and “the” can include both singular and plural referents, unless the context clearly dictates otherwise. In addition, “a number of,” “at least one,” and “one or more” (e.g., a number of memory devices) can refer to one or more memory devices, whereas a “plurality of” is intended to refer to more than one of such things. Furthermore, the words “can” and “may” are used throughout this application in a permissive sense (i.e., having the potential to, being able to), not in a mandatory sense (i.e., must). The term “include,” and derivations thereof, means “including, but not limited to.” The terms “coupled,” and “coupling” mean to be directly or indirectly connected physically or for access to and movement (transmission) of commands and/or data, as appropriate to the context. The terms “data” and “data values” are used interchangeably herein and can have the same meaning, as appropriate to the context.
The figures herein follow a numbering convention in which the first digit or digits correspond to the figure number and the remaining digits identify an element or component in the figure. Similar elements or components between different figures can be identified by the use of similar digits. For example, 120 can reference element “20” in
The apparatus 100 can be a computing device and, for instance, the display 102 may be a touchscreen display of a mobile device such as a smartphone. The controller 110 can be communicatively coupled to the memory device 104, image sensor 120, and/or the display 102. As used herein, “communicatively coupled” can include coupled via various wired and/or wireless connections between devices such that data can be transferred in various directions between the devices. The coupling need not be a direct connection, and in some examples, can be an indirect connection.
The memory device 104 can include non-volatile or volatile memory. For example, non-volatile memory can provide persistent data by retaining written data when not powered, and non-volatile memory types can include NAND flash memory, NOR flash memory, read only memory (ROM), Electrically Erasable Programmable ROM (EEPROM), Erasable Programmable ROM (EPROM), and Storage Class Memory (SCM) that can include resistance variable memory, such as phase change random access memory (PCRAM), three-dimensional cross-point memory (e.g., 3D XPoint™), resistive random access memory (RRAM), ferroelectric random access memory (FeRAM), magnetoresistive random access memory (MRAM), and programmable conductive memory, among other types of memory. Volatile memory can require power to maintain its data and can include random-access memory (RAM), dynamic random-access memory (DRAM), and static random access memory (SRAM), among others. Memory device 104 can include an array of memory cells 106 configured to store bits of data and control circuitry 108 configured to perform operations on the memory device 104 (e.g., read, write, erase bits of data in the array of memory cells 106).
Apparatus 100 can include an image sensor 120. For example, image sensor 120 can be part of a camera of a mobile device. The image sensor 120 can generate images (video, text, etc.) which can be visible on the display 102. Image sensor 120 can include a stack polarizer that includes a number of polarizers that can be used individually or in combination to polarize a light source input for the image sensor to capture polarized image data. Additionally, the image sensor 120 can capture and/or receive input from objects, people, items, etc. and transmit that input to the controller 110 to be analyzed. In some examples, the images sensor 120 can be part of a camera and can provide input to the controller 110, such as facial recognition input. For example, the display 102 can be a portion of a mobile device including a camera (e.g., a smartphone).
In a number of embodiments, the array of first, second, third, and fourth polarizer layers can each include a plurality (e.g., N×M) of polarizers that are associated with image sensor cells, such that each image sensor cell can include a first polarizer, a second polarizer, a third polarizer, and a fourth polarizer that can each be individually activated and deactivated.
The array of pixels can be configured to capture image data in a red green blue (RBG) format. For example, every other pixel in each row can be configured to capture green image data and alternating rows can be configured to capture red image data and blue image data between the pixels configured to capture green image data. The red image data, blue image data, and green image data can be the image data (e.g., a number of bits of data) to represent an image in RGB format.
In a number of embodiments, controller 310 can send a signal or signals to individually activate and/or deactivate the first, second, third, and fourth polarizers. For example, the first polarizer 324-1 can be activated and the second, third, and fourth polarizer 324-2, 324-3, and 324-4 can be deactivated. A light source can pass through the activated first polarizer 324-1 and deactivated second, third, and fourth polarizers 324-2, 324-3, and 324-4 and the first polarizer 324-1 can polarize the light source and the pixel 326 can detect the light source and generate image data representing the light source. The image data representing the light source can be sent to the controller 310 for further processing, such as analyzing the quality of the image data, and then can be sent to a memory device (e.g., memory 104 in
Once a determination regarding pixel quality is made for image data polarized with the first polarizer 524-1, second polarizer 524-2 can be activated to polarize the light source input and the image sensor cell can generate image data that represents a portion of an image based on the light source input. The image data can be sent to a controller (e.g. controller 110 in
Once a determination regarding pixel quality is made for image data polarized with the second polarizer 524-2, third polarizer 524-3 can be activated to polarize the light source input and the image sensor cell can generate image data that represents a portion of an image based on the light source input. The image data can be sent to a controller (e.g. controller 110 in
Once a determination regarding pixel quality is made for image data polarized with the third polarizer 524-3, fourth polarizer 524-4 can be activated to polarize the light source input and the image sensor cell can generate image data that represents a portion of an image based on the light source input. The image data can be sent to a controller (e.g. controller 110 in
At step 652, the method can include detecting a first image with an array of pixels from a light source input that is polarized when passed through the first polarization layer.
At step 654, the method can include determining, via a controller coupled to the array of pixels, whether a quality of the first image that was polarized by the first polarization layer meets a threshold. The controller can be configured to analyze the quality of the first image to determine whether or not to save the image in a memory device. If the first image meets a threshold, the first image can be saved in a memory device. If the first image does not meet a threshold, the first image will be discarded (e.g., not be stored on the memory device). The quality analysis by the controller can also be done on the pixel level, where the quality of each pixel in an array of image sensor cells is analyzed and the pixels the meet the threshold are saved to represent an image, while the pixels that do not meet the threshold are discarded. The discarded pixels can be replaced with pixel data that is interpolated by nearby pixels of the image.
The method can continue for the second polarization layer and can also include activating a second polarization layer of a plurality of polarization layers. The second polarization layer can be activated by a number of signals from a controller, while the other polarization layers are deactivated. The method can include detecting a second image with an array of pixels from a light source input that is polarized when passed through the second polarization layer. The method can include determining, via a controller coupled to the array of pixels, whether a quality of the second image that was polarized by the second polarization layer meets a threshold. The controller can be configured to analyze the quality of the second image to determine whether or not to save the image in a memory device. If the second image meets a threshold, the second image can be saved in a memory device. If the second image does not meet a threshold, the second image can be discarded.
The method can continue for third polarization layer and can also include activating a third polarization layer of a plurality of polarization layers. The third polarization layer can be activated by a number of signals from a controller, while the other polarization layers are deactivated. The method can include detecting a third image with an array of pixels from a light source input that is polarized when passed through the third polarization layer. The method can include determining, via a controller coupled to the array of pixels, whether a quality of the third image that was polarized by the third polarization layer meets a threshold. The controller can be configured to analyze the quality of the third image to determine whether or not to save the image in a memory device. If the third image meets a threshold, the third image can be saved in a memory device. If the third image does not meet a threshold, the third image can be discarded.
The method can continue for fourth polarization layer and can also include activating a fourth polarization layer of a plurality of polarization layers. The fourth polarization layer can be activated by a number of signals from a controller, while the other polarization layers are deactivated. The method can include detecting a fourth image with an array of pixels from a light source input that is polarized when passed through the fourth polarization layer. The method can include determining, via a controller coupled to the array of pixels, whether a quality of the fourth image that was polarized by the fourth polarization layer meets a threshold. The controller can be configured to analyze the quality of the fourth image to determine whether or not to save the image in a memory device. If the fourth image meets a threshold, the fourth image can be saved in a memory device. If the fourth image does not meet a threshold, the fourth image can be discarded.
Although specific embodiments have been illustrated and described herein, those of ordinary skill in the art will appreciate that an arrangement calculated to achieve the same results can be substituted for the specific embodiments shown. This disclosure is intended to cover adaptations or variations of one or more embodiments of the present disclosure. It is to be understood that the above description has been made in an illustrative fashion, and not a restrictive one. Combination of the above embodiments, and other embodiments not specifically described herein will be apparent to those of skill in the art upon reviewing the above description. The scope of the one or more embodiments of the present disclosure includes other applications in which the above structures and processes are used. Therefore, the scope of one or more embodiments of the present disclosure should be determined with reference to the appended claims, along with the full range of equivalents to which such claims are entitled.
In the foregoing Detailed Description, some features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the disclosed embodiments of the present disclosure have to use more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment.
Number | Name | Date | Kind |
---|---|---|---|
20090179143 | Murooka et al. | Jul 2009 | A1 |
20100045847 | Ryu | Feb 2010 | A1 |
20160345888 | Wu | Dec 2016 | A1 |
20180205928 | Conway, Sr. et al. | Jul 2018 | A1 |
20190170925 | Nichol | Jun 2019 | A1 |
20200013819 | Toda | Jan 2020 | A1 |
20200243735 | Lee et al. | Jul 2020 | A1 |
20200251049 | Morris et al. | Aug 2020 | A1 |
20200251460 | Iguchi | Aug 2020 | A1 |
20200258869 | Wu et al. | Aug 2020 | A1 |
20200271932 | Tuomisto et al. | Aug 2020 | A1 |
20200279881 | Jin et al. | Sep 2020 | A1 |
20210084284 | McEldowney | Mar 2021 | A1 |
Number | Date | Country |
---|---|---|
10-2010-0023211 | Mar 2010 | KR |
Entry |
---|
International Search Report and Written Opinion from related international application No. PCT/US2021/050191, dated Dec. 28, 2021, 9 pages. |
Number | Date | Country | |
---|---|---|---|
20220082441 A1 | Mar 2022 | US |