Embodiments disclosed herein relate in general to digital cameras and in particular to thin folded optics cameras.
In recent years, mobile devices such as cell-phones (and in particular smart-phones), tablets and laptops have become ubiquitous. Many of these devices include one or two compact cameras including, for example, a main rear-facing camera (i.e. a camera on the back side of the device, facing away from the user and often used for casual photography) and a secondary front-facing camera (i.e. a camera located on the front side of the device and often used for video conferencing).
Although relatively compact in nature, the design of most of these cameras is similar to the traditional structure of a digital still camera, i.e. it comprises a lens assembly (or a train of several optical elements) placed on top of an image sensor. The lens assembly (also referred to as “lens module” or simply “lens”) refracts the incoming light rays and bends them to create an image of a scene on the sensor. The dimensions of these cameras are largely determined by the size of the sensor and by the height of the optics. These are usually tied together through the focal length (“f”) of the lens and its field of view (FOV)—a lens that has to image a certain FOV on a sensor of a certain size has a specific focal length. Keeping the FOV constant, the larger the sensor dimensions the larger the focal length and the optics height.
The assembly process of a traditional camera may include handling of a few sub-assemblies: a lens, a sensor board sub-assembly and an actuator. The lens may include a lens barrel made for example of plastic or metal and includes a few (3-7) lens elements which may be made of plastic or glass. The sensor board sub-assembly may include the image sensor, a printed circuit board (PCB) and electronics needed for the operation of the camera, as known in the art. The actuator is used to move the lens for optical needs (for example for focusing (and in particular auto focusing (AF)) and/or optical image stabilization (OIS)) and for mechanical protection of the other parts of the camera. In known art, the lens is inserted and attached (e.g. glued) to the actuator from one side, along the lens optical axis, whereas the sensor board is attached (e.g. glued) to the actuator from the opposite side along the optical axis.
“Folded camera modules” (or simply “folded cameras”) are known and have been suggested for incorporation in various “host” devices (e.g. smart-phones, tablets, laptops, smart TVs, etc.). In a folded camera, an optical path folding element (OPFE) e.g. a prism or a mirror (otherwise referred to herein collectively as “reflecting element”) tilts light arriving in a first optical path or direction (e.g. perpendicular to a back surface of a smart-phone) to a second optical path or direction (e.g. parallel to the smart-phone back surface). If the folded camera is part of a dual-aperture camera, this provides a folded optical path through one lens assembly (e.g. a Tele lens). Such a camera is referred to herein as “folded-lens dual-aperture camera” or “dual-aperture camera with a folded lens”. In general, the folded camera may be included in a multi-aperture camera, for example together with two “non-folded” (upright) camera modules in a triple-aperture camera, or in multi-aperture cameras with more than 3 cameras.
Actuators used for AF and OIS in smart-phone cameras are known. A commonly used actuator is based on voice coil motor (VCM) technology. In VCM technology, a permanent (or “fixed”) magnet and a coil are used to create actuation force. The coil is positioned in the vicinity of the magnetic field of the fixed magnet. Upon driving current in the coil, a Lorentz force is created on the coil, an in return an equal counter-force is applied on the magnet. The magnet or the coil is rigidly attached to an optical element to construct an actuating assembly. The actuating assembly is then moved by the magnetic Lorenz force. A VCM may also be referred to as “VCM engine” and an actuator including such a VCM (or VCM engine) may be referred to as to as “VCM actuator” or simply “actuator”. An actuator may be partially or fully surrounded by an envelope (sometimes also referred to as “shield”) having an envelope thickness.
In a folded camera with a moving lens mechanism (actuated by an actuator/VCM), at least one air gap is needed to allow movement. The envelope and other optional top and bottom elements or parts (e.g. a plate) added to protect the mechanism increase the total height of the actuator. A small height of a folded camera is important to allow a host device that includes it to be as thin as possible. The height of the camera is limited many times by the industrial design. In contrast, increasing the available height for the lens, sensor and OPFE may improve optical properties.
Envelope and other optional top and/or bottom parts add to the folded camera height. The height thus has a “penalty” that needs to be reduced.
In VCMs, in addition to the magnetic force, a mechanical rail is known to set the course of motion for the optical element. The mechanical rail keeps the motion of the lens in a desired path, as required by optical needs. One example of mechanical rail is known in the art as “spring-guided rail”, in which a spring or set of springs is used to set the motion direction. A VCM that includes a spring-guided rail is referred to as a “spring-guided VCM”. For example, U.S. patent application Ser. No. 20110235196 discloses a lens element shifted in a linear spring rail to create focus. For example, international patent application PCT/IB2016/052179 discloses the incorporation and use of a spring guided VCM in a folded camera. The disclosure teaches a lens element shifted to create focus and OIS and an optical path folding element (OPFE) shifted in a rotational manner to create OIS. Also, PCT/IB2016/052179 teaches AF+OIS in a folded actuator where the actuator does not add to the folded camera height.
Another example mechanical rail is known in the art a “ball-guided rail”, see e.g. U.S. Pat. No. 8,810,714. With a ball-guided rail, the lens is bound to move in the desired direction by set of balls confined in a groove (also referred to as “slit”). A VCM that includes a ball-guided rail is referred to as a “ball-guided VCM”. A ball-guided VCM has several advantages over a spring-guided VCM. These include: (1) lower power consumption, because in a spring-guided VCM the magnetic force has to oppose a spring mechanical force, which does not exist in a ball-guided VCM, and (2) higher reliability in drops that may occur during the life cycle of a camera that includes the VCM. The actuation method in U.S. Pat. No. 8,810,714 is designed for an exemplary non-folded lens, where the lens optical axis is directly pointed at the object to be photographed and cannot be used in a folded camera.
There is a need for, and it would be advantageous to reduce height and length penalties in folded cameras both with respect to structures and to the design of a linear ball guided VCM.
Embodiments disclosed herein relate to reduced height lens actuators (e.g. of VCM design) and folded cameras having such actuators. The term “lens” may refer to a lens assembly, comprising a train of several optical elements and a lens housing the lens elements. A lens is characterized by a fixed effective focal length (EFL), a clear aperture (CA), both of which are defined in international patent application PCT/IB2018/050988, which is incorporated herein by reference in its entirety, and a height, which is the distance along topmost and bottommost points on the lens. Lens elements may be made from plastic, glass and other materials known in the art.
The height of actuators and folded cameras is determined mainly by the lens diameter (height) and a “penalty”. In this description, any height that is additional to the lens diameter is considered herein to be a “penalty”. More specifically, a penalty is the sum of an upper (or top) height penalty and a lower (or bottom) height penalty, with the “upper”, “lower” and “penalty” terms described in detail below.
In various embodiments, a reduced height lens actuator disclosed herein may have an envelope with a bottom opening, a top opening or both bottom and top openings. A folded camera including such as actuator has a “reduced height penalty”, the reduction in height penalty brought about by the bottom opening, top opening or both bottom and top openings which allow to reduce the distance between the lens and outmost (e.g. top or bottom) surfaces of the envelope. The envelope may surround the lens actuator (e.g. be made of a sheet folded or bent around the lens actuator, or made of a few parts soldered or glued together. As mentioned, the envelope has an envelope thickness. The term “envelope thickness” refers to the thickness of the material forming the envelope (e.g. stainless steel, plastic, copper, etc.). If the envelope is made of different parts, the term “envelope thickness” refers to the thickness of each part.
In this description, an optical path-folding element (OPFE) is an optical element comprising a reflective plane, the OPFE, capable of folding the light from one axis to a second axis, the two optical axes being substantially perpendicular to one another, with the reflective plane being tilted by 45 degrees relative to both optical axes.
In various embodiments, there are provided folded cameras, comprising: a movable lens positioned in an optical path between an OPFE and an image sensor, wherein the OPFE folds light from a first direction to a second direction and wherein the lens includes a lens optical axis parallel to the second direction, a lens height substantially aligned with the first direction, a first lens surface and a second lens surface diametrically opposed to the first surface, the first and second lens surfaces being in planes perpendicular to the first direction; and an envelope surrounding the lens in at least some sections and including, along the first direction, a first envelope section with a first opening positioned on a first side of the lens and a second envelope section without an opening positioned on a second, diametrically opposed side of the lens, wherein the first lens surface is distanced along the first direction from an external surface of the first envelope section by a first air gap, wherein the second lens surface is distanced along the first direction from an internal surface of the second envelope section by a second air gap, wherein the second envelope section has a second envelope section thickness and wherein the folded camera has a camera height substantially aligned with the first direction and substantially equal to a sum of the lens height, the first air gap, the second air gap and the second envelope section thickness.
In various embodiments, there are provided folded cameras, comprising: a movable lens positioned in an optical path between an optical path folding element (OPFE) and an image sensor, wherein the OPFE folds light from a first direction to a second direction and wherein the lens includes a lens optical axis parallel to the second direction, a lens height substantially aligned with the first direction, a first lens surface and a second lens surface diametrically opposed to the first surface, the first and second lens surfaces being in planes perpendicular to the first direction; and an envelope surrounding the lens and including, along the first direction, a first envelope section with a first opening positioned on a first side of the lens and a second envelope section with a second opening positioned on a second, diametrically opposed side of the lens, wherein the first lens surface is distanced along the first direction from an external surface of the first envelope section by a first air gap, wherein the second lens surface is distanced along the first direction from an external surface of the second envelope section by a second air gap, and wherein the folded camera has a camera height substantially aligned with the first direction and substantially equal to a sum of the lens height, the first air gap and the second air gap.
In some exemplary embodiments of a folded camera as above or below, each of the first and second air gaps may be in the range of 10-50 μm. In some exemplary embodiments, each of the first and second air gaps may be in the range of 10-100 μm. In some exemplary embodiments, each of the first and second air gaps may be in the range of 10-150 μm.
In some exemplary embodiments, the lens may be movable for focusing.
In some exemplary embodiments, the lens may be movable for optical image stabilization.
In some exemplary embodiments, the lens may be movable in two directions in a single plane for focusing and optical image stabilization, the single plane being perpendicular to the first direction.
In some exemplary embodiments, a folded camera as above has a height that does not exceed the lens height by more than about 600 μm. In some embodiments, the folded camera height does not exceed the lens height by more than 400 μm. In some embodiments, the folded camera height does not exceed the lens height by more than 300 μm.
In some exemplary embodiments, a folded camera as above may be included together with an upright camera in a dual-camera.
In an embodiment there is provided a folded camera, comprising: a lens actuator for moving a lens in at least one direction and including an envelope surrounding the lens in at least some sections and having an envelope thickness, the lens having a lens height and being positioned in an optical path between an optical path folding element and an image sensor and movable in the at least one direction, wherein the folded camera has a height smaller than the sum of the lens height, the size of a first air gap from the lens to the envelope, the size of a second air gap from the lens to the envelope and twice the envelope thickness.
In an embodiment there is provided a folded camera, a lens actuator for moving a lens in at least one direction and including an envelope surrounding the lens in at least some sections and having an envelope thickness, the lens having a lens height and being positioned in an optical path between an optical path folding element and an image sensor and movable in the at least one direction, wherein the folded camera has a height smaller than the sum of the lens height, the size of a first air gap from the lens to an external surface of the envelope, the size of a second air gap from the lens to the envelope and the envelope thickness.
In various embodiments, there are provided lens actuators for moving a lens, the lens having a lens optical axis parallel to a second direction and a lens height substantially aligned with a first direction that is substantially perpendicular to the second direction, the actuators comprising: an envelope surrounding the lens in at least some sections and including, along the first direction, a first envelope section with a first opening positioned on a first side of the lens and a second envelope section without an opening positioned on a second, diametrically opposed side of the lens, wherein the first lens surface is distanced along the first direction from an external surface of the first envelope section by a first air gap, wherein the second lens surface is distanced along the first direction from an internal surface of the second envelope section by a second air gap, wherein the second envelope section has a second envelope section thickness and wherein the folded camera has a camera height substantially aligned with the first direction and substantially equal to a sum of the lens height, the first air gap, the second air gap and the second envelope section thickness.
In various embodiments, there are provided lens actuators for moving a lens, the lens having a lens optical axis parallel to a second direction and a lens height substantially aligned with a first direction that is substantially perpendicular to the second direction, the actuators comprising: an envelope surrounding the lens in at least some sections and including, along the first direction, a first envelope section with a first opening positioned on a first side of the lens and a second envelope section with a second opening positioned on a second, diametrically opposed side of the lens, wherein the first lens surface is distanced along the first direction from an external surface of the first envelope section by a first air gap, wherein the second lens surface is distanced along the first direction from an external surface of the second envelope section by a second air gap, and wherein the folded camera has a camera height substantially aligned with the first direction and substantially equal to a sum of the lens height, the first air gap and the second air gap.
In some exemplary embodiments of an actuator as above or below, each of the first and second air gaps may be in the range of 10-50 μm. In some exemplary embodiments, each of the first and second air gaps may be in the range of 10-100 μm. In some exemplary embodiments, each of the first and second air gaps may be in the range of 10-150 μm.
In some exemplary embodiments, the lens may be movable for focusing.
In some exemplary embodiments, the lens may be movable for optical image stabilization.
In some exemplary embodiments, the lens may be movable in two directions in a single plane for focusing and optical image stabilization, the single plane being perpendicular to the first direction.
In some exemplary embodiments, an actuator as above or below has a height that does not exceed the lens height by more than about 600 μm. In some embodiments, the actuator height does not exceed the lens height by more than 400 μm. In some embodiments, the actuator height does not exceed the lens height by more than 300 μm.
In various embodiments, there are provided folded cameras comprising: a lens positioned in an optical path between an optical path folding element and an image sensor, the lens having a lens height and an optical axis, wherein the folded camera has a height not exceeding the lens height by more than 500 μm.
In an exemplary embodiment, the folded camera above may have a height not exceeding the lens height by more than 400 μm.
In an exemplary embodiment, the folded camera above may have a height not exceeding the lens height by more than 250 μm.
In an exemplary embodiment, the folded camera above may be included together with an upright camera in a dual-camera.
In an embodiment there is provided an actuator for actuating a lens having a lens optical axis for AF and optical image stabilization OIS, the actuator comprising: a stationary sub-assembly that includes an OIS coil having an OIS coil plane and an AF coil having an AF coil plane; and a lens actuating sub-assembly movable relative to the stationary sub-assembly and including a lens holder holding the lens, wherein the OIS coil plane is perpendicular to AF coil plane and wherein the lens optical axis lies between the OIS coil plane and the AF coil plane.
In an exemplary embodiment, the stationary sub-assembly further includes a plurality of upper stepping yokes, wherein the lens actuating sub-assembly further includes a plurality of stepping magnets coupled to the plurality of upper stepping yokes, and wherein the plurality of stepping yokes and the plurality of stepping magnets are operable to create stepping forces in a direction perpendicular to the lens optical axis for stepping.
In some exemplary embodiments, an actuator as above or below further comprises a middle actuating sub-assembly for AF and OIS positioned between the stationary sub-assembly and the lens top actuating sub-assembly.
In some exemplary embodiments, the stationary sub-assembly further includes an OIS Hall sensor bar used in conjunction with one of the stepping magnets to perform position sensing.
In some exemplary embodiments, some yokes of the plurality of stepping yokes are positioned on a first surface, wherein other yokes of the plurality of stepping yokes are positioned on a second surface, and wherein the first and second surfaces are parallel.
In some exemplary embodiments, an actuator as above may be included in a folded camera.
In various embodiments, there are provided folded cameras comprising: a lens having a lens optical axis, an optical path folding elelement for folding light from a first direction to a second direction, the second direction being essentially aligned with the lens optical axis, an image sensor and an actuator for actuating the lens for AF and OIS, the actuator comprising an AF VCM that includes an AF coil positioned in an AF plane and is operable to move the lens in an AF direction, and an OIS VCM that includes an OIS coil positioned in an OIS plane and is operable to move the lens in an OIS direction, wherein the AF plane and the OIS plane are perpendicular to each other, and wherein the two VCMs are located on opposite sides of a plane defined by the first and second directions.
Non-limiting examples of embodiments disclosed herein are described below with reference to figures attached hereto that are listed following this paragraph. Identical structures, elements or parts that appear in more than one figure are generally labeled with a same numeral in all the figures in which they appear. The drawings and descriptions are meant to illuminate and clarify embodiments disclosed herein and should not be considered limiting in any way. In the drawings:
Actuator height HA 102 is a sum of a lens height HL of lens 104, an upper height penalty 134 and a lower height penalty 136. Upper height penalty 134 is defined as the distance between a topmost surface 138 of the lens and external top surface 140. Lower height penalty 136 is defined as the distance between a lowest (bottom) surface 124 of the lens and external bottom surface 128. In other words, upper height penalty 134 is the sum of the thickness of upper envelope section 126 and the size of an upper air gap 142 required between lens 104 and upper envelope section 126 (e.g. to allow actuation and movement of the lens for AF and/or OIS). Lower height penalty 136 is the sum of the thickness of lower envelope section 130 and the size of a lower air gap 144 needed between lens 104 and lower envelope section 130 e.g. to allow actuation and movement of the lens for AF and/or OIS). In turn, height HA 102 is the sum of the largest dimension of the lens in the Y direction (i.e. HL) plus necessary air gaps 142 and 144 plus the thicknesses of the upper and lower envelope sections 126 and 130. In other words, lens actuator height HA 102 is the largest dimension of actuator 120 along the Y direction.
OPFE 206 folds light arriving from an object or scene 210 along a first direction (entrance optical axis) 212 parallel to the Y direction, to a second direction (lens optical axis) 214 parallel to the Z direction toward image sensor 208.
Alternatively, for a given folded camera height, a higher lens (i.e. a lens with large HL) with better optical properties can be used in a design with an opening, relative to a design with no opening. Evidently, the design of camera 250 has an advantage over the design of camera 150 by either having a lower camera height for the same optics, or by having better optics for the same camera height.
In the example of
In an embodiment, AF coil 1038 faces AF magnet 1026. The AF magnet is a fixed (i.e. permenant) magnet. AF magnet 1026 may be fabricated (e.g. sintered, cut) such that it has a changing magnetic field polarity: on its positive Z size, AF magnet 1026 has a magnetic field facing the negative X direction, while on its negative Z side OIS magnet 1022 has a magnetic field facing the positive X direction. Upon driving of current in AF coil 1038, a Lorenz force is created by the magnetic filed of AF magnet 1026 on AF coil 1038 in the negative or positive Z direction. Consequently, an equal force is applied on AF magnet 1026 in the Z direction. Having AF coil 1038 in YZ plane has the advantage in that, while in actuation, the AF magnet is kept at a constant distance from OIS coil 1040. That is, the Lorentz force for AF is uniform for different OIS positions, and the AF position reading is linear for AF motion and uniform for different OIS positions.
In VCM actuator 1100, each of the four rails 1052 faces one respective rail of rails 1054, while one ball of lower balls 1030 is between the rails. The rails and ball structure confines the motion of top actuating sub-assembly 1110 relative to AF stationary sub-assembly 1120 in a direction parallel to optical axis 1012. In addition, top actuating sub-assembly 1110 is pulled to AF stationary sub-assembly 1120 in the Y direction due to the magnetic force of magnets 1020 and upper stepping yokes 1034 (see below), while balls 1030 keep the distance between top actuating sub-assembly 1110 and AF stationary sub-assembly 1120 constant in the Y direction. In this description, the term “constant distance” with respect to moving parts refers to a distance between the parts in a direction perpendicular to the motion direction that is constant with a tolerance of ±10 μm, ±30 μm, ±50 μm, or even ±100 μm.
In some embodiments, the lens actuating sub-assembly is pulled toward the stationary sub-assembly, with the middle actuating sub-assembly positioned therebetween.
In use of actuator 1100 for AF, an electrical current in AF coil 1038 creates force on AF magnet 1026, driving middle chassis 1028 in directions parallel to lens optical axis 1012, for example along the positive or negative Z direction. Middle chassis 1028 holds lens actuating sub-assembly 1210 and while moving in the AF direction it carries lens actuating sub-assembly 1210 along, such that lens 1016 is operative to focus on image sensor 1006, as required by optical demands The AF movement is directed by the rolling and/or sliding of the four lower balls 1030 inside the four respective rails 1052 located in middle chassis 1028 and inside four compatible rails 1054 located in base 1032.
In use of actuator 1200 for OIS, electrical current in OIS coil 1040 creates force on OIS magnet 1022, driving lens carrier 1018 in directions perpendicular to the lens optical axis 1012 and parallel to the X axis (shown in the exemplary coordinate system XYZ). During this movement, lens carrier 1018 (which holds lens 1016) moves together with the lens in any OIS direction. The movement for OIS is directed by the rolling and/or sliding of four upper balls 1024 inside four rails 1056 located on lens carrier 1018 and inside another four compatible rails 1058 located on the middle chassis 1028.
The four stepping magnets 1020a, 1020b, 1020c and 1020d located on the lens carrier 1018 are associated with four stepping yokes 1034a, 1034b, 1034c and 1034d located on AF stationary sub-assembly 1120, creating a stepping force indicated by arrows in a direction perpendicular to optical axis 1012. Stepping magnets 1020a-d and stepping yokes 1034a-d are seen in
In contrast, in the embodiment of
While this disclosure describes a limited number of embodiments, it will be appreciated that many variations, modifications and other applications of such embodiments may be made. In general, the disclosure is to be understood as not limited by the specific embodiments described herein, but only by the scope of the appended claims.
All references mentioned in this specification are herein incorporated in their entirety by reference into the specification, to the same extent as if each individual reference was specifically and individually indicated to be incorporated herein by reference. In addition, citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the present application.
This application is a 371 application from international patent application No. PCT/IB2018/060203, which claims priority to U.S. provisional patent applications Nos. 62/626,306 filed Feb. 5, 2018, 62/658,819 filed Apr. 17, 2018, 62/672,754 filed May 17, 2018 and 62/677,012 filed May 27, 2018, the content of which applications is incorporated herein by reference in their entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2018/060203 | 12/17/2018 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2019/150188 | 8/8/2019 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
4199785 | McCullough et al. | Apr 1980 | A |
5005083 | Grage et al. | Apr 1991 | A |
5032917 | Aschwanden | Jul 1991 | A |
5041852 | Misawa et al. | Aug 1991 | A |
5051830 | von Hoessle | Sep 1991 | A |
5099263 | Matsumoto et al. | Mar 1992 | A |
5248971 | Mandl | Sep 1993 | A |
5287093 | Amano et al. | Feb 1994 | A |
5394520 | Hall | Feb 1995 | A |
5436660 | Sakamoto | Jul 1995 | A |
5444478 | Lelong et al. | Aug 1995 | A |
5459520 | Sasaki | Oct 1995 | A |
5657402 | Bender et al. | Aug 1997 | A |
5682198 | Katayama et al. | Oct 1997 | A |
5768443 | Michael et al. | Jun 1998 | A |
5926190 | Turkowski et al. | Jul 1999 | A |
5940641 | McIntyre et al. | Aug 1999 | A |
5982951 | Katayama et al. | Nov 1999 | A |
6101334 | Fantone | Aug 2000 | A |
6128416 | Oura | Oct 2000 | A |
6148120 | Sussman | Nov 2000 | A |
6208765 | Bergen | Mar 2001 | B1 |
6268611 | Pettersson et al. | Jul 2001 | B1 |
6549215 | Jouppi | Apr 2003 | B2 |
6611289 | Yu et al. | Aug 2003 | B1 |
6643416 | Daniels et al. | Nov 2003 | B1 |
6650368 | Doron | Nov 2003 | B1 |
6680748 | Monti | Jan 2004 | B1 |
6714665 | Hanna et al. | Mar 2004 | B1 |
6724421 | Glatt | Apr 2004 | B1 |
6738073 | Park et al. | May 2004 | B2 |
6741250 | Furlan et al. | May 2004 | B1 |
6750903 | Miyatake et al. | Jun 2004 | B1 |
6778207 | Lee et al. | Aug 2004 | B1 |
7002583 | Rabb, III | Feb 2006 | B2 |
7015954 | Foote et al. | Mar 2006 | B1 |
7038716 | Klein et al. | May 2006 | B2 |
7199348 | Olsen et al. | Apr 2007 | B2 |
7206136 | Labaziewicz et al. | Apr 2007 | B2 |
7248294 | Slatter | Jul 2007 | B2 |
7256944 | Labaziewicz et al. | Aug 2007 | B2 |
7305180 | Labaziewicz et al. | Dec 2007 | B2 |
7339621 | Fortier | Mar 2008 | B2 |
7346217 | Gold, Jr. | Mar 2008 | B1 |
7365793 | Cheatle et al. | Apr 2008 | B2 |
7411610 | Doyle | Aug 2008 | B2 |
7424218 | Baudisch et al. | Sep 2008 | B2 |
7509041 | Hosono | Mar 2009 | B2 |
7533819 | Barkan et al. | May 2009 | B2 |
7619683 | Davis | Nov 2009 | B2 |
7738016 | Toyofuku | Jun 2010 | B2 |
7773121 | Huntsberger et al. | Aug 2010 | B1 |
7880776 | LeGall et al. | Feb 2011 | B2 |
7918398 | Li et al. | Apr 2011 | B2 |
7964835 | Olsen et al. | Jun 2011 | B2 |
7978239 | Deever et al. | Jul 2011 | B2 |
8115825 | Culbert et al. | Feb 2012 | B2 |
8149327 | Lin et al. | Apr 2012 | B2 |
8154610 | Jo et al. | Apr 2012 | B2 |
8238695 | Davey et al. | Aug 2012 | B1 |
8274552 | Dahi et al. | Sep 2012 | B2 |
8390729 | Long et al. | Mar 2013 | B2 |
8391697 | Cho et al. | Mar 2013 | B2 |
8400555 | Georgiev et al. | Mar 2013 | B1 |
8439265 | Ferren et al. | May 2013 | B2 |
8446484 | Muukki et al. | May 2013 | B2 |
8483452 | Ueda et al. | Jul 2013 | B2 |
8514491 | Duparre | Aug 2013 | B2 |
8547389 | Hoppe et al. | Oct 2013 | B2 |
8553106 | Scarff | Oct 2013 | B2 |
8587691 | Takane | Nov 2013 | B2 |
8619148 | Watts et al. | Dec 2013 | B1 |
8803990 | Smith | Aug 2014 | B2 |
8896655 | Mauchly et al. | Nov 2014 | B2 |
8976255 | Matsuoto et al. | Mar 2015 | B2 |
9019387 | Nakano | Apr 2015 | B2 |
9025073 | Attar et al. | May 2015 | B2 |
9025077 | Attar et al. | May 2015 | B2 |
9041835 | Honda | May 2015 | B2 |
9137447 | Shibuno | Sep 2015 | B2 |
9185291 | Shabtay et al. | Nov 2015 | B1 |
9215377 | Sokeila et al. | Dec 2015 | B2 |
9215385 | Luo | Dec 2015 | B2 |
9270875 | Brisedoux et al. | Feb 2016 | B2 |
9286680 | Jiang et al. | Mar 2016 | B1 |
9344626 | Silverstein et al. | May 2016 | B2 |
9360671 | Zhou | Jun 2016 | B1 |
9369621 | Malone et al. | Jun 2016 | B2 |
9413930 | Geerds | Aug 2016 | B2 |
9413984 | Attar et al. | Aug 2016 | B2 |
9420180 | Jin | Aug 2016 | B2 |
9438792 | Nakada et al. | Sep 2016 | B2 |
9485432 | Medasani et al. | Nov 2016 | B1 |
9578257 | Attar et al. | Feb 2017 | B2 |
9618748 | Munger et al. | Apr 2017 | B2 |
9681057 | Attar et al. | Jun 2017 | B2 |
9723220 | Sugie | Aug 2017 | B2 |
9736365 | Laroia | Aug 2017 | B2 |
9736391 | Du et al. | Aug 2017 | B2 |
9768310 | Ahn et al. | Sep 2017 | B2 |
9800798 | Ravirala et al. | Oct 2017 | B2 |
9851803 | Fisher et al. | Dec 2017 | B2 |
9894287 | Qian et al. | Feb 2018 | B2 |
9900522 | Lu | Feb 2018 | B2 |
9927600 | Goldenberg et al. | Mar 2018 | B2 |
20020005902 | Yuen | Jan 2002 | A1 |
20020030163 | Zhang | Mar 2002 | A1 |
20020063711 | Park et al. | May 2002 | A1 |
20020075258 | Park et al. | Jun 2002 | A1 |
20020122113 | Foote | Sep 2002 | A1 |
20020167741 | Koiwai et al. | Nov 2002 | A1 |
20030030729 | Prentice et al. | Feb 2003 | A1 |
20030093805 | Gin | May 2003 | A1 |
20030160886 | Misawa et al. | Aug 2003 | A1 |
20030202113 | Yoshikawa | Oct 2003 | A1 |
20040008773 | Itokawa | Jan 2004 | A1 |
20040012683 | Yamasaki et al. | Jan 2004 | A1 |
20040017386 | Liu et al. | Jan 2004 | A1 |
20040027367 | Pilu | Feb 2004 | A1 |
20040061788 | Bateman | Apr 2004 | A1 |
20040141065 | Hara et al. | Jul 2004 | A1 |
20040141086 | Mihara | Jul 2004 | A1 |
20040240052 | Minefuji et al. | Dec 2004 | A1 |
20050013509 | Samadani | Jan 2005 | A1 |
20050046740 | Davis | Mar 2005 | A1 |
20050157184 | Nakanishi et al. | Jul 2005 | A1 |
20050168834 | Matsumoto et al. | Aug 2005 | A1 |
20050185049 | Iwai et al. | Aug 2005 | A1 |
20050200718 | Lee | Sep 2005 | A1 |
20060054782 | Olsen et al. | Mar 2006 | A1 |
20060056056 | Ahiska et al. | Mar 2006 | A1 |
20060067672 | Washisu et al. | Mar 2006 | A1 |
20060102907 | Lee et al. | May 2006 | A1 |
20060125937 | LeGall et al. | Jun 2006 | A1 |
20060170793 | Pasquarette et al. | Aug 2006 | A1 |
20060175549 | Miller et al. | Aug 2006 | A1 |
20060187310 | Janson et al. | Aug 2006 | A1 |
20060187322 | Janson et al. | Aug 2006 | A1 |
20060187338 | May et al. | Aug 2006 | A1 |
20060227236 | Pak | Oct 2006 | A1 |
20070024737 | Nakamura et al. | Feb 2007 | A1 |
20070177025 | Kopet et al. | Aug 2007 | A1 |
20070188653 | Pollock et al. | Aug 2007 | A1 |
20070189386 | Imagawa et al. | Aug 2007 | A1 |
20070257184 | Olsen et al. | Nov 2007 | A1 |
20070285550 | Son | Dec 2007 | A1 |
20080017557 | Witdouck | Jan 2008 | A1 |
20080024614 | Li et al. | Jan 2008 | A1 |
20080025634 | Border et al. | Jan 2008 | A1 |
20080030592 | Border et al. | Feb 2008 | A1 |
20080030611 | Jenkins | Feb 2008 | A1 |
20080084484 | Ochi et al. | Apr 2008 | A1 |
20080106629 | Kurtz et al. | May 2008 | A1 |
20080117316 | Orimoto | May 2008 | A1 |
20080129831 | Cho et al. | Jun 2008 | A1 |
20080218611 | Parulski et al. | Sep 2008 | A1 |
20080218612 | Border et al. | Sep 2008 | A1 |
20080218613 | Janson et al. | Sep 2008 | A1 |
20080219654 | Border et al. | Sep 2008 | A1 |
20090086074 | Li et al. | Apr 2009 | A1 |
20090109556 | Shimizu et al. | Apr 2009 | A1 |
20090122195 | Van Baar et al. | May 2009 | A1 |
20090122406 | Rouvinen et al. | May 2009 | A1 |
20090128644 | Camp et al. | May 2009 | A1 |
20090219547 | Kauhanen et al. | Sep 2009 | A1 |
20090252484 | Hasuda et al. | Oct 2009 | A1 |
20090295949 | Ojala | Dec 2009 | A1 |
20090324135 | Kondo et al. | Dec 2009 | A1 |
20100013906 | Border et al. | Jan 2010 | A1 |
20100020221 | Tupman et al. | Jan 2010 | A1 |
20100060746 | Olsen et al. | Mar 2010 | A9 |
20100097444 | Lablans | Apr 2010 | A1 |
20100103194 | Chen et al. | Apr 2010 | A1 |
20100165131 | Makimoto et al. | Jul 2010 | A1 |
20100196001 | Ryynänen et al. | Aug 2010 | A1 |
20100238327 | Griffith et al. | Sep 2010 | A1 |
20100259836 | Kang et al. | Oct 2010 | A1 |
20100283842 | Guissin et al. | Nov 2010 | A1 |
20110058320 | Kim et al. | Mar 2011 | A1 |
20110063417 | Peters et al. | Mar 2011 | A1 |
20110063446 | McMordie et al. | Mar 2011 | A1 |
20110064327 | Dagher et al. | Mar 2011 | A1 |
20110080487 | Venkataraman et al. | Apr 2011 | A1 |
20110128288 | Petrou et al. | Jun 2011 | A1 |
20110164172 | Shintani et al. | Jul 2011 | A1 |
20110229054 | Weston et al. | Sep 2011 | A1 |
20110234798 | Chou | Sep 2011 | A1 |
20110234853 | Hayashi et al. | Sep 2011 | A1 |
20110234881 | Wakabayashi et al. | Sep 2011 | A1 |
20110242286 | Pace et al. | Oct 2011 | A1 |
20110242355 | Goma et al. | Oct 2011 | A1 |
20110298966 | Kirschstein et al. | Dec 2011 | A1 |
20120026366 | Golan et al. | Feb 2012 | A1 |
20120044372 | Cote et al. | Feb 2012 | A1 |
20120062780 | Morihisa | Mar 2012 | A1 |
20120069235 | Imai | Mar 2012 | A1 |
20120075489 | Nishihara | Mar 2012 | A1 |
20120105579 | Jeon et al. | May 2012 | A1 |
20120124525 | Kang | May 2012 | A1 |
20120154547 | Aizawa | Jun 2012 | A1 |
20120154614 | Moriya et al. | Jun 2012 | A1 |
20120196648 | Havens et al. | Aug 2012 | A1 |
20120229663 | Nelson et al. | Sep 2012 | A1 |
20120249815 | Bohn et al. | Oct 2012 | A1 |
20120287315 | Huang et al. | Nov 2012 | A1 |
20120320467 | Baik et al. | Dec 2012 | A1 |
20130002928 | Imai | Jan 2013 | A1 |
20130016427 | Sugawara | Jan 2013 | A1 |
20130063629 | Webster et al. | Mar 2013 | A1 |
20130076922 | Shihoh et al. | Mar 2013 | A1 |
20130093842 | Yahata | Apr 2013 | A1 |
20130094126 | Rappoport et al. | Apr 2013 | A1 |
20130113894 | Mirlay | May 2013 | A1 |
20130135445 | Dahi et al. | May 2013 | A1 |
20130155176 | Paripally et al. | Jun 2013 | A1 |
20130182150 | Asakura | Jul 2013 | A1 |
20130201360 | Song | Aug 2013 | A1 |
20130202273 | Ouedraogo et al. | Aug 2013 | A1 |
20130235224 | Park et al. | Sep 2013 | A1 |
20130250150 | Malone et al. | Sep 2013 | A1 |
20130258044 | Betts-LaCroix | Oct 2013 | A1 |
20130270419 | Singh et al. | Oct 2013 | A1 |
20130278785 | Nomura et al. | Oct 2013 | A1 |
20130321668 | Kamath | Dec 2013 | A1 |
20140009631 | Topliss | Jan 2014 | A1 |
20140049615 | Uwagawa | Feb 2014 | A1 |
20140118584 | Lee et al. | May 2014 | A1 |
20140192238 | Attar et al. | Jul 2014 | A1 |
20140192253 | Laroia | Jul 2014 | A1 |
20140218587 | Shah | Aug 2014 | A1 |
20140313316 | Olsson et al. | Oct 2014 | A1 |
20140362242 | Takizawa | Dec 2014 | A1 |
20150002683 | Hu et al. | Jan 2015 | A1 |
20150042870 | Chan et al. | Feb 2015 | A1 |
20150070781 | Cheng et al. | Mar 2015 | A1 |
20150092066 | Geiss et al. | Apr 2015 | A1 |
20150103147 | Ho et al. | Apr 2015 | A1 |
20150138381 | Ahn | May 2015 | A1 |
20150154776 | Zhang et al. | Jun 2015 | A1 |
20150162048 | Hirata et al. | Jun 2015 | A1 |
20150195458 | Nakayama et al. | Jul 2015 | A1 |
20150215516 | Dolgin | Jul 2015 | A1 |
20150237280 | Choi et al. | Aug 2015 | A1 |
20150242994 | Shen | Aug 2015 | A1 |
20150244906 | Wu et al. | Aug 2015 | A1 |
20150253543 | Mercado | Sep 2015 | A1 |
20150253647 | Mercado | Sep 2015 | A1 |
20150261299 | Wajs | Sep 2015 | A1 |
20150271471 | Hsieh et al. | Sep 2015 | A1 |
20150281678 | Park et al. | Oct 2015 | A1 |
20150316744 | Chen | Nov 2015 | A1 |
20150334309 | Peng et al. | Nov 2015 | A1 |
20160044250 | Shabtay et al. | Feb 2016 | A1 |
20160070088 | Koguchi | Mar 2016 | A1 |
20160154202 | Wippermann et al. | Jun 2016 | A1 |
20160154204 | Lim et al. | Jun 2016 | A1 |
20160212358 | Shikata | Jul 2016 | A1 |
20160212418 | Demirdjian et al. | Jul 2016 | A1 |
20160241751 | Park | Aug 2016 | A1 |
20160291295 | Shabtay et al. | Oct 2016 | A1 |
20160295112 | Georgiev et al. | Oct 2016 | A1 |
20160301840 | Du et al. | Oct 2016 | A1 |
20160353008 | Osborne | Dec 2016 | A1 |
20160353012 | Kao et al. | Dec 2016 | A1 |
20170019616 | Zhu et al. | Jan 2017 | A1 |
20170070731 | Darling et al. | Mar 2017 | A1 |
20170187962 | Lee | Jun 2017 | A1 |
20170214846 | Du et al. | Jul 2017 | A1 |
20170214866 | Zhu et al. | Jul 2017 | A1 |
20170242225 | Fiske | Aug 2017 | A1 |
20170289458 | Song et al. | Oct 2017 | A1 |
20180013944 | Evans et al. | Jan 2018 | A1 |
20180017844 | Yu et al. | Jan 2018 | A1 |
20180059379 | Chou | Mar 2018 | A1 |
20180120674 | Avivi et al. | May 2018 | A1 |
20180150973 | Tang et al. | May 2018 | A1 |
20180176426 | Wei et al. | Jun 2018 | A1 |
20180198897 | Tang et al. | Jul 2018 | A1 |
20180241922 | Baldwin et al. | Aug 2018 | A1 |
20180295292 | Lee et al. | Oct 2018 | A1 |
20180300901 | Wakai et al. | Oct 2018 | A1 |
20190121103 | Bachar et al. | Apr 2019 | A1 |
Number | Date | Country |
---|---|---|
101276415 | Oct 2008 | CN |
201514511 | Jun 2010 | CN |
102739949 | Oct 2012 | CN |
103024272 | Apr 2013 | CN |
103841404 | Jun 2014 | CN |
1536633 | Jun 2005 | EP |
1780567 | May 2007 | EP |
2523450 | Nov 2012 | EP |
S59191146 | Oct 1984 | JP |
04211230 | Aug 1992 | JP |
H07318864 | Dec 1995 | JP |
08271976 | Oct 1996 | JP |
2002010276 | Jan 2002 | JP |
2003298920 | Oct 2003 | JP |
2004133054 | Apr 2004 | JP |
2004245982 | Sep 2004 | JP |
2005099265 | Apr 2005 | JP |
2006238325 | Sep 2006 | JP |
2007228006 | Sep 2007 | JP |
2007306282 | Nov 2007 | JP |
2008076485 | Apr 2008 | JP |
2010204341 | Sep 2010 | JP |
2011085666 | Apr 2011 | JP |
2013106289 | May 2013 | JP |
20070005946 | Jan 2007 | KR |
20090058229 | Jun 2009 | KR |
20100008936 | Jan 2010 | KR |
20140014787 | Feb 2014 | KR |
101477178 | Dec 2014 | KR |
20140144126 | Dec 2014 | KR |
20150118012 | Oct 2015 | KR |
2000027131 | May 2000 | WO |
2004084542 | Sep 2004 | WO |
2006008805 | Jan 2006 | WO |
2010122841 | Oct 2010 | WO |
2014072818 | May 2014 | WO |
2017025822 | Feb 2017 | WO |
2017037688 | Mar 2017 | WO |
2018130898 | Jul 2018 | WO |
Entry |
---|
European Search Report in related EP application 18897859.7, 4 pages. |
Statistical Modeling and Performance Characterization of a Real-Time Dual Camera Surveillance System, Greienhagen et al., Publisher: IEEE, 2000, 8 pages. |
A 3MPixel Multi-Aperture Image Sensor with 0.7μm Pixels in 0.11μm CMOS, Fife et al., Stanford University, 2008, 3 pages. |
Dual camera intelligent sensor for high definition 360 degrees surveillance, Scotti et al., Publisher: IET, May 9, 2000, 8 pages. |
Dual-sensor foveated imaging system, Hua et al., Publisher: Optical Society of America, Jan. 14, 2008, 11 pages. |
Defocus Video Matting, McGuire et al., Publisher: ACM SIGGRAPH, Jul. 31, 2005, 11 pages. |
Compact multi-aperture imaging with high angular resolution, Santacana et al., Publisher: Optical Society of America, 2015, 10 pages. |
Multi-Aperture Photography, Green et al., Publisher: Mitsubishi Electric Research Laboratories, Inc., Jul. 2007, 10 pages. |
Multispectral Bilateral Video Fusion, Bennett et al., Publisher: IEEE, May 2007, 10 pages. |
Super-resolution imaging using a camera array, Santacana et al., Publisher: Optical Society of America, 2014, 6 pages. |
Optical Splitting Trees for High-Precision Monocular Imaging, McGuire et al., Publisher: IEEE, 2007, 11 pages. |
High Performance Imaging Using Large Camera Arrays, Wilburn et al., Publisher: Association for Computing Machinery, Inc., 2005, 12 pages. |
Real-time Edge-Aware Image Processing with the Bilateral Grid, Chen et al., Publisher: ACM SIGGRAPH, 2007, 9 pages. |
Superimposed multi-resolution imaging, Carles et al., Publisher: Optical Society of America, 2017, 13 pages. |
Viewfinder Alignment, Adams et al., Publisher: EUROGRAPHICS, 2008, 10 pages. |
Dual-Camera System for Multi-Level Activity Recognition, Bodor et al., Publisher: IEEE, Oct. 2014, 6 pages. |
Engineered to the task: Why camera-phone cameras are different, Giles Humpston, Publisher: Solid State Technology, Jun. 2009, 3 pages. |
International Search Report and Written Opinion in related PCT application PCT/IB2018/060203, dated Jun. 3, 2019. |
Office Action in related KR patent application No. 2020-7007209, dated Jun. 15, 2020. 4 pages. |
Number | Date | Country | |
---|---|---|---|
20200371374 A1 | Nov 2020 | US |
Number | Date | Country | |
---|---|---|---|
62677012 | May 2018 | US | |
62672754 | May 2018 | US | |
62658819 | Apr 2018 | US | |
62626306 | Feb 2018 | US |