The present invention relates to an electrokinetic device, and more particularly relates to an electrokinetic (EK) device configured as a dynamic lens cover and/or a dynamic infrared (IR) filter for an imaging system.
In a conventional single-lens reflex (SLR) camera, a lens cover is commonly used to protect the lens of the camera from being scratched or damaged. However, lens covers are in most cases not available for miniature cameras integrated with mobile phones, or other electronic devices (e.g., laptops, touchpads, monitors, etc.). Due to the geometric profile of such miniature cameras, there is no simple way to attach a removable lens cover to the lens, and even if a lens cover could be attached, such a lens cover would be easily lost due to its small size. As a result, miniature cameras are typically covered with a permanent and clear protective cover that cannot be removed or “closed.” Described herein is a dynamic lens cover for imaging systems, and more generally, applications of an electrokinetic device for imaging systems.
In the following detailed description of the preferred embodiments, reference is made to the accompanying drawings that form a part hereof, and in which are shown by way of illustration specific embodiments in which the invention may be practiced. It is understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention. Descriptions associated with any one of the figures may be applied to different figures containing like or similar components/steps. While the sequence diagrams each present a series of steps in a certain order, the order of some of the steps may be changed.
Dynamic lens cover 106 may provide several benefits. One, it may provide an added sense of privacy to people in the surrounding environment of electronic device 10. Nowadays, it is difficult for people in the surrounding environment of an electronic device to ascertain whether an imaging device (e.g., camera) of the electronic device is actively recording images, or whether it is merely in an idle state. With the lens of the imaging device covered up, these people in the surrounding environment of an electronic device can confidently know that they are not being recorded (and/or spied upon). When used to provide an increased sense of privacy, the dynamic lens cover, when operating in its opaque state, is preferably easily visible to a user. For example, if the material surrounding lens 102 appears black (as in
In a surveillance application, dynamic lens cover 106 may camouflage the lens of the imaging assembly (e.g., security camera) when the imaging assembly is not recording images. Often times, a person notices the presence of a security camera (or other camera) by recognizing the appearance of the lens of the security camera. By matching the color of the dynamic lens cover (when in its opaque state) to the color of the surrounding area outside of the lens, the lens of the imaging assembly may be camouflaged, making it less likely for a person to notice the presence of a security camera. Of course, the lens can only be camouflaged when the imaging assembly is not in use, and the lens will still be visible when the camera is in use. However, the ability to camouflage the lens when the camera is not in use still increases the likelihood for the camera to not be noticed by a person.
Dynamic lens cover 106 can also increase the aesthetic appeal of an electronic device. For instance, many users place their mobile phones within phone cases so as to protect the phones in the event that the phones are accidentally dropped. The color of the dynamic lens cover, when operating in the opaque state, can be matched to the color of the phone case, so that the color of the imaging assembly (e.g., camera) more closely matches the color of the phone case. More generally, the color of the dynamic lens cover, when operating in the opaque state, can be matched to the color of an electronic device case that contains an electronic device (such as a smart phone or laptop computer) with an imaging assembly.
As mentioned above, dynamic lens cover 106 may have other operating states, in addition to clear and opaque. In such cases, it may be more appropriate to more generally refer to the dynamic lens cover as an electrokinetic device, as it may provide functions other than a dynamic lens cover. For instance, in a state between a clear and opaque state, the electrokinetic device may function as a dynamic filter (i.e., a filter that can be turned on or off). For example, in a bright outdoor environment, the electrokinetic device may filter out a portion of the visible light to prevent saturation in the captured image.
The electrokinetic device may also dynamically filter specific wavelengths of light, one interesting example being the dynamic filtering of infrared (IR) light. In a conventional mobile phone camera, a static infrared light filter typically is integrated into the camera, preventing IR light from reaching the image sensor of the camera. In many cases, a static IR light filter is desirable, as IR light is not visible to the human eye. However, there may be instances in which the capturing of IR light is desirable, for example, when one seeks to image heat sources (which emit IR light), such as wildlife in the forest at night. To provide such functionality, the static infrared light filter of conventional mobile phone cameras can be replaced with an electrokinetic device which functions as a dynamic IR filter (alone or in addition to a dynamic lens cover). When capturing images in a default mode, the IR filter can be enabled, so that only visible light is captured by the image sensor. When capturing images in an IR-enabled mode, the IR filter can be disabled, allowing IR light (and possibly visible light) to be captured by the image sensor.
The control of the dynamic lens cover/electrokinetic device may be effected in several ways. In an automated control for two modes of operation (i.e., clear and opaque), the dynamic lens cover may be set to the clear state whenever the camera is recording images, and set to the opaque state under all other circumstances. In an automated control for three modes of operation (i.e., IR filter enabled, IR filter disabled and opaque), the electrokinetic device may be set to the IR-filter-enabled mode whenever the camera is recording images under daylight conditions, set to the IR-filter-disabled mode whenever the camera is recording images under night time (or low light) conditions, and set to the opaque mode under all other circumstances.
In a manual control for two modes of operation (i.e., clear and opaque), a user interface may display a radio button (or other user interface element used to select between two states) for the user to enable/disable the dynamic lens cover. In a manual control for three modes of operation (i.e., IR filter enabled, IR filter disabled and opaque), the user interface may display two radio buttons. One radio button may allow the user to enable/disable the dynamic lens cover, and another radio button may allow the user to enable/disable the dynamic IR filter.
Technical constraints for the dynamic lens cover include the requirements to block (e.g., by absorbing, scattering or reflecting) 90% or more of the visible light from reaching the lens of the imaging device in the opaque state, and allow 85% or more of the visible light to reach the lens of the imaging device in the clear state. Further technical constraints include a 100-1000 millisecond switching time from the clear state to the opaque state and similarly a 100-1000 millisecond switching time from the opaque state back to the clear state. Further technical constraints include the ability to block light for lens sizes with a 0.01 to 10 mm diameter. The structure of various embodiments of the dynamic lens cover (and more generally the electrokinetic device) for satisfying these technical constraints are described in the figures and its associated description below.
In the top view of
First electrode 112 (and second electrode 118) may be disposed adjacent to first substrate 104 (and second substrate 120), respectively. First electrode 112 and second electrode 118 may also be transparent to electromagnetic radiation (e.g., constructed from Indium Tin Oxide, Fluorine doped Tin Oxide, etc.). In the embodiment depicted in
Dielectric layer 116 may be disposed adjacent to second electrode 118 and may be formed of a transparent organic or inorganic dielectric material. Dielectric layer 116 may be a patterned layer, and may include compaction trench 110 that is formed by patterning a portion of dielectric layer 116.
Wall 122 may be disposed between first substrate 104 and dielectric layer 116 and may form a cavity that is filled with carrier fluid 114. Additional details regarding carrier fluid 114 may be found in U.S. Pat. No. 8,183,757.
In the depicted embodiment, compaction trench 110 is patterned completely through dielectric layer 116 so that second electrode 118 is exposed to carrier fluid 114. However, in another embodiment (not depicted), a compaction trench may be formed in dielectric layer 116 without etching through dielectric layer 116 so that second electrode 118 is not exposed to carrier fluid 114.
Applying a suitable bias across the first electrode 112 and second electrode 118 may cause charged pigments 128 to be attracted towards second electrode 118, and collected in compaction trench 110. In the transparent mode of operation, most of pigments 128 (e.g., more than 99%) are located in compaction trench 110 instead of in the region between dielectric 116 and first electrode 112. In a filtering mode of operation, a first portion of pigments 128 may be located in compaction trench 110 and a second portion of pigments 128 may be located in the region between dielectric 116 and first electrode 112.
Numerous types of pigments may be used in the present invention. Some types of pigments include, but not limited to, carbon and carbon-based pigments, metal, metalloid and non-metal oxides, azo pigments, lake pigments, phthalocyanine pigments, quinacridone pigments, and IR reflective pigments. Examples include, but not limited to: Carbon Black (1333-86-4), TPX 1409 (Cabot Corporation, Billerica, Mass.), Titanium dioxide (CAS 13463-67-7), Silicon dioxide (CAS 7631-86-9), Pigment Yellow 14 (CAS 5468-75-7), Pigment Yellow 83 (CAS 5567-15-7), Pigment Yellow 17 (CAS 4531-49-1), Pigment Yellow 65 (CAS 6528-34-3), Pigment Yellow 3 (CAS 6486-23-3), Pigment Red 53:1 CAS (5160-02-1), Pigment Red 122 (CAS 980-26-7), Quinacridone (CAS 1047-16-1), Pigment Red 49:1 CAS (1103-38-4), Pigment Red 4 (CAS 2814-77-9), Pigment Blue 29 (CAS 57455-37-5), Pigment Blue 1 (CAS 1325-87-7), and (29H,31H-phthalocyaninato(2-)-N29,N30,N31,N32) copper (CAS 147-14-8). Specific examples of infrared reflective pigments include PY 182 (CAS 67906-31-4), PY 195, Blue 385 (CAS 1345-16-0), Blue 217, Green 179 (CAS 68187-49-5). Mica-coated pigments are a general class of infrared reflective pigments.
Imaging assembly 101 may include lens 102 that is configured to direct electromagnetic radiation towards image sensor 108. One or more filters may be disposed between lens 102 and image sensor 108 so as to selectively pass electromagnetic radiation to image sensor 108. Color filter 126 may include a two-dimensional array of cells, each cell selectively passing red, green or blue light to image sensor 108. In one embodiment, IR filter 124 may be a static IR filter that (always) blocks IR light from being transmitted to image sensor 108. In another embodiment, IR filter 124 may be a dynamic IR filter that blocks IR light when the dynamic IR filter is enabled and passes IR light when the dynamic IR filter is disabled. The dynamic IR filter may be an electrokinetic device similar to construction as electrokinetic device 100, expect for certain distinctions. For example, compaction trench of the dynamic IR filter may be square or rectangular shaped to match the square or rectangular outline of image sensor 108.
In the transparent mode of operation, electromagnetic radiation 111 is transmitted through electrokinetic device 100 to lens 102, and then selectively transmitted to image sensor 108 from lens 102 based on the operation and/or configuration of IR filter 124 and color filter 126. More specifically, electromagnetic radiation is transmitted in an optical path through electrokinetic device 100. The optical path through electrokinetic device 100 may be formed by at least a portion of first substrate 104, at least a portion of first electrode 112, at least a portion of carrier fluid 114, at least a portion of dielectric layer 116, at least a portion of the second electrode 118 and at least a portion of second substrate 120.
The use of two pigments that are oppositely charged may allow the two pigments to be separately controlled by patterned second electrode 118A/B. For example, an outer annular portion of second electrode 118A may be used to attract pigments A (128A) in outer compaction trench 110A, and an inner central portion of second electrode 118B may be used to attract pigments B (128B) in inner compaction trench 110B. Further, dielectric ring 117 may be present between portion 118A and portion 118B of the second electrode so as to electrically isolate these regions from one another.
When operating in a completely transparent mode with the IR filter disabled, pigments A and B may be collected in compaction trenches 110A and 110B, respectively, as shown in
When operating in an IR-filter-enabled mode, pigment A may be collected in compaction trench 110A, while pigment B may be dispersed in carrier fluid 114 so as to block the transmission of IR radiation, as shown in
When operating in an IR only mode (or opaque mode), pigment B may be collected in compaction trench 110B while pigment A is dispersed in carrier fluid 114 so as to block the transmission of electromagnetic radiation in the visible range, as shown in
When operating in an opaque mode, pigments A and B may both be dispersed in carrier fluid 114 so as to block the transmission of electromagnetic radiation in both the IR and visible ranges, as shown in
In
To facilitate the lateral motion of the pigments, electrical waveforms may be applied to each of the central electrode 112a and the concentric annular rings 112b-f. More specifically, a controller (elt. 208 in
Initially, at time t0, zero potential may be present on all annular rings and the central electrode both with respect to one another and with respect to the second electrode (not depicted) adjacent to second substrate 120. At time t1, storage ring 112g may be made positive to attract the negatively charged pigment. Also, at time t1, central electrode 112a may be made negative, which repels the negatively charged pigment from the center, and adjacent annular ring 112b may be made positive, to attract the pigment leaving the central electrode 112a. The next step at time t2 continues to repel the pigment from the center, but “slides over” the pigment (formerly attracted to annular ring 112b) to annular ring 112c, by now making annular ring 112c positive and annular ring 112b negative. Next at time t3, the pigment continues to radially move outwards in the lateral direction, while the central electrode 112a is set to zero potential. As zero is more positive than the negative potential on annular ring 112b, some remaining pigment not transported in the outward pulse presently at annular ring 112d will collect at the central electrode 112a. At time t4, this leftover pigment is once again repelled by a negative potential on the central electrode 112a and collects at annular ring 112b, which once again has a positive potential, starting a second pulse which will follow the first outward pulse toward storage ring 112g. By time t13, all three pulses have rippled outward, to be followed by the zero potential of the EK device's idle state, and finally at time t14, only storage ring 112g is energized, and it holds substantially all the pigment, formerly in the central area, in a compressed ring-shaped region directly adjacent to the storage ring 112g.
As is apparent from the foregoing discussion, aspects of the present invention involve the use of various computer systems and computer readable storage media having computer-readable instructions stored thereon.
System 300 includes a bus 302 or other communication mechanism for communicating information, and a processor 304 coupled with the bus 302 for processing information. Computer system 300 also includes a main memory 306, such as a random access memory (RAM) or other dynamic storage device, coupled to the bus 302 for storing information and instructions to be executed by processor 304. Main memory 306 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 304. Computer system 300 further includes a read only memory (ROM) 308 or other static storage device coupled to the bus 302 for storing static information and instructions for the processor 304. A storage device 310, for example a hard disk, flash memory-based storage medium, or other storage medium from which processor 304 can read, is provided and coupled to the bus 302 for storing information and instructions (e.g., operating systems, applications programs and the like).
Computer system 300 may be coupled via the bus 302 to a display 312, such as a flat panel display, for displaying information to a computer user. An input device 314, such as a keyboard including alphanumeric and other keys, may be coupled to the bus 302 for communicating information and command selections to the processor 304. Another type of user input device is cursor control device 316, such as a mouse, a trackpad, or similar input device for communicating direction information and command selections to processor 304 and for controlling cursor movement on the display 312. Other user interface devices, such as microphones, speakers, etc. are not shown in detail but may be involved with the receipt of user input and/or presentation of output.
The processes referred to herein may be implemented by processor 304 executing appropriate sequences of computer-readable instructions contained in main memory 306. Such instructions may be read into main memory 306 from another computer-readable medium, such as storage device 310, and execution of the sequences of instructions contained in the main memory 306 causes the processor 304 to perform the associated actions. In alternative embodiments, hard-wired circuitry or firmware-controlled processing units may be used in place of or in combination with processor 304 and its associated computer software instructions to implement the invention. The computer-readable instructions may be rendered in any computer language.
In general, all of the above process descriptions are meant to encompass any series of logical steps performed in a sequence to accomplish a given purpose, which is the hallmark of any computer-executable application. Unless specifically stated otherwise, it should be appreciated that throughout the description of the present invention, use of terms such as “processing”, “computing”, “calculating”, “determining”, “displaying”, “receiving”, “transmitting” or the like, refer to the action and processes of an appropriately programmed computer system, such as computer system 300 or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within its registers and memories into other data similarly represented as physical quantities within its memories or registers or other such information storage, transmission or display devices.
Computer system 300 also includes a communication interface 318 coupled to the bus 302. Communication interface 318 may provide a two-way data communication channel with a computer network, which provides connectivity to and among the various computer systems discussed above. For example, communication interface 318 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN, which itself is communicatively coupled to the Internet through one or more Internet service provider networks. The precise details of such communication paths are not critical to the present invention. What is important is that computer system 300 can send and receive messages and data through the communication interface 318 and in that way communicate with hosts accessible via the Internet. It is noted that the components of system 300 may be located in a single device or located in a plurality of physically and/or geographically distributed devices.
Thus, applications of an electrokinetic device for an imaging system have been described. It is to be understood that the above-description is intended to be illustrative, and not restrictive. Many other embodiments will be apparent to those of skill in the art upon reviewing the above description. The scope of the invention should, therefore, be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
This is a NONPROVISIONAL of, claims priority to, and incorporates by reference U.S. Provisional Application 62/793,250, filed Jan. 16, 2019.
Number | Name | Date | Kind |
---|---|---|---|
8183757 | Mabeck et al. | May 2012 | B2 |
8827512 | Beadle | Sep 2014 | B1 |
9977308 | Lenssen et al. | May 2018 | B2 |
20100060628 | Lenssen et al. | Mar 2010 | A1 |
20100134872 | Johnson et al. | Jun 2010 | A1 |
20120001842 | Stellbrink | Jan 2012 | A1 |
20120007487 | Mabeck et al. | Jan 2012 | A1 |
20120235266 | Ootsuka | Sep 2012 | A1 |
20160193604 | McFarland | Jul 2016 | A1 |
20170263662 | Hsieh et al. | Sep 2017 | A1 |
20180179306 | Tone et al. | Jun 2018 | A1 |
20190060907 | Bao | Feb 2019 | A1 |
Number | Date | Country |
---|---|---|
20100136925 | Dec 2010 | WO |
Entry |
---|
International Preliminary Report on Patentability dated Jun. 16, 2021, from The International Bureau of WIPO, for International Patent Application No. PCT/US2020/013396 (filed Jan. 13, 2020), 7 pgs. |
International Search Report and Written Opinion dated May 15, 2020, from the ISA/US, for International Patent Application No. PCT/US20/13396 (filed Jan. 13, 2020), 10 pages. |
Number | Date | Country | |
---|---|---|---|
20200225552 A1 | Jul 2020 | US |
Number | Date | Country | |
---|---|---|---|
62793250 | Jan 2019 | US |