Reduced height penalty for folded camera

Information

  • Patent Grant
  • 12007582
  • Patent Number
    12,007,582
  • Date Filed
    Tuesday, May 16, 2023
    a year ago
  • Date Issued
    Tuesday, June 11, 2024
    17 days ago
Abstract
Actuators for actuating a lens in a folded camera, folded cameras including such actuators and dual-cameras including such folded cameras. The actuators actuate a lens having a lens optical axis for auto-focus (AF) and optical image stabilization (OIS) and comprise a stationary sub-assembly that includes an OIS coil having an OIS coil plane and an AF coil having an AF coil plane, and a lens actuating sub-assembly movable relative to the stationary sub-assembly with a lens holder holding the lens, wherein the OIS coil plane is perpendicular to the AF coil plane and wherein the lens optical axis lies between the OIS coil plane and the AF coil plane. Some actuators have a design using VCM actuation and a reduced height due to top and/or bottom openings in actuator envelopes.
Description
FIELD

Embodiments disclosed herein relate in general to digital cameras and in particular to thin folded optics cameras.


BACKGROUND

In recent years, mobile devices such as cell-phones (and in particular smart-phones), tablets and laptops have become ubiquitous. Many of these devices include one or two compact cameras including, for example, a main rear-facing camera (i.e. a camera on the back side of the device, facing away from the user and often used for casual photography) and a secondary front-facing camera (i.e. a camera located on the front side of the device and often used for video conferencing).


Although relatively compact in nature, the design of most of these cameras is similar to the traditional structure of a digital still camera, i.e. it comprises a lens assembly (or a train of several optical elements) placed on top of an image sensor. The lens assembly (also referred to as “lens module” or simply “lens”) refracts the incoming light rays and bends them to create an image of a scene on the sensor. The dimensions of these cameras are largely determined by the size of the sensor and by the height of the optics. These are usually tied together through the focal length (“f”) of the lens and its field of view (FOV)—a lens that has to image a certain FOV on a sensor of a certain size has a specific focal length. Keeping the FOV constant, the larger the sensor dimensions the larger the focal length and the optics height.


The assembly process of a traditional camera may include handling of a few sub-assemblies: a lens, a sensor board sub-assembly and an actuator. The lens may include a lens barrel made for example of plastic or metal and includes a few (3-7) lens elements which may be made of plastic or glass. The sensor board sub-assembly may include the image sensor, a printed circuit board (PCB) and electronics needed for the operation of the camera, as known in the art. The actuator is used to move the lens for optical needs (for example for focusing (and in particular auto focusing (AF)) and/or optical image stabilization (OIS)) and for mechanical protection of the other parts of the camera. In known art, the lens is inserted and attached (e.g. glued) to the actuator from one side, along the lens optical axis, whereas the sensor board is attached (e.g. glued) to the actuator from the opposite side along the optical axis.


“Folded camera modules” (or simply “folded cameras”) are known and have been suggested for incorporation in various “host” devices (e.g. smart-phones, tablets, laptops, smart TVs, etc.). In a folded camera, an optical path folding element (OPFE) e.g. a prism or a mirror (otherwise referred to herein collectively as “reflecting element”) tilts light arriving in a first optical path or direction (e.g. perpendicular to a back surface of a smart-phone) to a second optical path or direction (e.g. parallel to the smart-phone back surface). If the folded camera is part of a dual-aperture camera, this provides a folded optical path through one lens assembly (e.g. a Tele lens). Such a camera is referred to herein as “folded-lens dual-aperture camera” or “dual-aperture camera with a folded lens”. In general, the folded camera may be included in a multi-aperture camera, for example together with two “non-folded” (upright) camera modules in a triple-aperture camera, or in multi-aperture cameras with more than 3 cameras.


Actuators used for AF and OIS in smart-phone cameras are known. A commonly used actuator is based on voice coil motor (VCM) technology. In VCM technology, a permanent (or “fixed”) magnet and a coil are used to create actuation force. The coil is positioned in the vicinity of the magnetic field of the fixed magnet. Upon driving current in the coil, a Lorentz force is created on the coil, an in return an equal counter-force is applied on the magnet. The magnet or the coil is rigidly attached to an optical element to construct an actuating assembly. The actuating assembly is then moved by the magnetic Lorenz force. A VCM may also be referred to as “VCM engine” and an actuator including such a VCM (or VCM engine) may be referred to as to as “VCM actuator” or simply “actuator”. An actuator may be partially or fully surrounded by an envelope (sometimes also referred to as “shield”) having an envelope thickness.


In a folded camera with a moving lens mechanism (actuated by an actuator/VCM), at least one air gap is needed to allow movement. The envelope and other optional top and bottom elements or parts (e.g. a plate) added to protect the mechanism increase the total height of the actuator. A small height of a folded camera is important to allow a host device that includes it to be as thin as possible. The height of the camera is limited many times by the industrial design. In contrast, increasing the available height for the lens, sensor and OPFE may improve optical properties.


Envelope and other optional top and/or bottom parts add to the folded camera height. The height thus has a “penalty” that needs to be reduced.


In VCMs, in addition to the magnetic force, a mechanical rail is known to set the course of motion for the optical element. The mechanical rail keeps the motion of the lens in a desired path, as required by optical needs. One example of mechanical rail is known in the art as “spring-guided rail”, in which a spring or set of springs is used to set the motion direction. A VCM that includes a spring-guided rail is referred to as a “spring-guided VCM”. For example, US patent application No. 20110235196 discloses a lens element shifted in a linear spring rail to create focus. For example, international patent application PCT/IB2016/052179 discloses the incorporation and use of a spring guided VCM in a folded camera. The disclosure teaches a lens element shifted to create focus and OIS and an optical path folding element (OPFE) shifted in a rotational manner to create OIS. Also, PCT/IB2016/052179 teaches AF+OIS in a folded actuator where the actuator does not add to the folded camera height.


Another example mechanical rail is known in the art a “ball-guided rail”, see e.g. U.S. Pat. No. 8,810,714. With a ball-guided rail, the lens is bound to move in the desired direction by set of balls confined in a groove (also referred to as “slit”). A VCM that includes a ball-guided rail is referred to as a “ball-guided VCM”. A ball-guided VCM has several advantages over a spring-guided VCM. These include: (1) lower power consumption, because in a spring-guided VCM the magnetic force has to oppose a spring mechanical force, which does not exist in a ball-guided VCM, and (2) higher reliability in drops that may occur during the life cycle of a camera that includes the VCM. The actuation method in U.S. Pat. No. 8,810,714 is designed for an exemplary non-folded lens, where the lens optical axis is directly pointed at the object to be photographed and cannot be used in a folded camera.


There is a need for, and it would be advantageous to reduce height and length penalties in folded cameras both with respect to structures and to the design of a linear ball guided VCM.


SUMMARY

Embodiments disclosed herein relate to reduced height lens actuators (e.g. of VCM design) and folded cameras having such actuators. The term “lens” may refer to a lens assembly, comprising a train of several optical elements and a lens housing the lens elements. A lens is characterized by a fixed effective focal length (EFL), a clear aperture (CA), both of which are defined in international patent application PCT/IB2018/050988, which is incorporated herein by reference in its entirety, and a height, which is the distance along topmost and bottommost points on the lens. Lens elements may be made from plastic, glass and other materials known in the art.


The height of actuators and folded cameras is determined mainly by the lens diameter (height) and a “penalty”. In this description, any height that is additional to the lens diameter is considered herein to be a “penalty”. More specifically, a penalty is the sum of an upper (or top) height penalty and a lower (or bottom) height penalty, with the “upper”, “lower” and “penalty” terms described in detail below.


In various embodiments, a reduced height lens actuator disclosed herein may have an envelope with a bottom opening, a top opening or both bottom and top openings. A folded camera including such as actuator has a “reduced height penalty”, the reduction in height penalty brought about by the bottom opening, top opening or both bottom and top openings which allow to reduce the distance between the lens and outmost (e.g. top or bottom) surfaces of the envelope. The envelope may surround the lens actuator (e.g. be made of a sheet folded or bent around the lens actuator, or made of a few parts soldered or glued together. As mentioned, the envelope has an envelope thickness. The term “envelope thickness” refers to the thickness of the material forming the envelope (e.g. stainless steel, plastic, copper, etc.). If the envelope is made of different parts, the term “envelope thickness” refers to the thickness of each part.


In this description, an optical path-folding element (OPFE) is an optical element comprising a reflective plane, the OPFE capable of folding the light from one axis to a second axis, the two optical axes being substantially perpendicular to one another, with the reflective plane being tilted by 45 degrees relative to both optical axes.


In various embodiments, there are provided folded cameras, comprising: a movable lens positioned in an optical path between an OPFE and an image sensor, wherein the OPFE folds light from a first direction to a second direction and wherein the lens includes a lens optical axis parallel to the second direction, a lens height substantially aligned with the first direction, a first lens surface and a second lens surface diametrically opposed to the first surface, the first and second lens surfaces being in planes perpendicular to the first direction; and an envelope surrounding the lens in at least some sections and including, along the first direction, a first envelope section with a first opening positioned on a first side of the lens and a second envelope section without an opening positioned on a second, diametrically opposed side of the lens, wherein the first lens surface is distanced along the first direction from an external surface of the first envelope section by a first air gap, wherein the second lens surface is distanced along the first direction from an internal surface of the second envelope section by a second air gap, wherein the second envelope section has a second envelope section thickness and wherein the folded camera has a camera height substantially aligned with the first direction and substantially equal to a sum of the lens height, the first air gap, the second air gap and the second envelope section thickness.


In various embodiments, there are provided folded cameras, comprising: a movable lens positioned in an optical path between an optical path folding element (OPFE) and an image sensor, wherein the OPFE folds light from a first direction to a second direction and wherein the lens includes a lens optical axis parallel to the second direction, a lens height substantially aligned with the first direction, a first lens surface and a second lens surface diametrically opposed to the first surface, the first and second lens surfaces being in planes perpendicular to the first direction; and an envelope surrounding the lens and including, along the first direction, a first envelope section with a first opening positioned on a first side of the lens and a second envelope section with a second opening positioned on a second, diametrically opposed side of the lens, wherein the first lens surface is distanced along the first direction from an external surface of the first envelope section by a first air gap, wherein the second lens surface is distanced along the first direction from an external surface of the second envelope section by a second air gap, and wherein the folded camera has a camera height substantially aligned with the first direction and substantially equal to a sum of the lens height, the first air gap and the second air gap.


In some exemplary embodiments of a folded camera as above or below, each of the first and second air gaps may be in the range of 10-50 μm. In some exemplary embodiments, each of the first and second air gaps may be in the range of 10-100 μm. In some exemplary embodiments, each of the first and second air gaps may be in the range of 10-150 μm.


In some exemplary embodiments, the lens may be movable for focusing.


In some exemplary embodiments, the lens may be movable for optical image stabilization.


In some exemplary embodiments, the lens may be movable in two directions in a single plane for focusing and optical image stabilization, the single plane being perpendicular to the first direction.


In some exemplary embodiments, a folded camera as above has a height that does not exceed the lens height by more than about 600 μm. In some embodiments, the folded camera height does not exceed the lens height by more than 400 μm. In some embodiments, the folded camera height does not exceed the lens height by more than 300 μm.


In some exemplary embodiments, a folded camera as above may be included together with an upright camera in a dual-camera.


In an embodiment there is provided a folded camera, comprising: a lens actuator for moving a lens in at least one direction and including an envelope surrounding the lens in at least some sections and having an envelope thickness, the lens having a lens height and being positioned in an optical path between an optical path folding element and an image sensor and movable in the at least one direction, wherein the folded camera has a height smaller than the sum of the lens height, the size of a first air gap from the lens to the envelope, the size of a second air gap from the lens to the envelope and twice the envelope thickness.


In an embodiment there is provided a folded camera, comprising: a lens actuator for moving a lens in at least one direction and including an envelope surrounding the lens in at least some sections and having an envelope thickness, the lens having a lens height and being positioned in an optical path between an optical path folding element and an image sensor and movable in the at least one direction, wherein the folded camera has a height smaller than the sum of the lens height, the size of a first air gap from the lens to an external surface of the envelope, the size of a second air gap from the lens to the envelope and the envelope thickness.


In various embodiments, there are provided lens actuators for moving a lens, the lens having a lens optical axis parallel to a second direction and a lens height substantially aligned with a first direction that is substantially perpendicular to the second direction, the actuators comprising: an envelope surrounding the lens in at least some sections and including, along the first direction, a first envelope section with a first opening positioned on a first side of the lens and a second envelope section without an opening positioned on a second, diametrically opposed side of the lens, wherein the first lens surface is distanced along the first direction from an external surface of the first envelope section by a first air gap, wherein the second lens surface is distanced along the first direction from an internal surface of the second envelope section by a second air gap, wherein the second envelope section has a second envelope section thickness and wherein the folded camera has a camera height substantially aligned with the first direction and substantially equal to a sum of the lens height, the first air gap, the second air gap and the second envelope section thickness.


In various embodiments, there are provided lens actuators for moving a lens, the lens having a lens optical axis parallel to a second direction and a lens height substantially aligned with a first direction that is substantially perpendicular to the second direction, the actuators comprising: an envelope surrounding the lens in at least some sections and including, along the first direction, a first envelope section with a first opening positioned on a first side of the lens and a second envelope section with a second opening positioned on a second, diametrically opposed side of the lens, wherein the first lens surface is distanced along the first direction from an external surface of the first envelope section by a first air gap, wherein the second lens surface is distanced along the first direction from an external surface of the second envelope section by a second air gap, and wherein the folded camera has a camera height substantially aligned with the first direction and substantially equal to a sum of the lens height, the first air gap and the second air gap.


In some exemplary embodiments of an actuator as above or below, each of the first and second air gaps may be in the range of 10-50 μm. In some exemplary embodiments, each of the first and second air gaps may be in the range of 10-100 μm. In some exemplary embodiments, each of the first and second air gaps may be in the range of 10-150 μm.


In some exemplary embodiments, the lens may be movable for focusing.


In some exemplary embodiments, the lens may be movable for optical image stabilization.


In some exemplary embodiments, the lens may be movable in two directions in a single plane for focusing and optical image stabilization, the single plane being perpendicular to the first direction.


In some exemplary embodiments, an actuator as above or below has a height that does not exceed the lens height by more than about 600 μm. In some embodiments, the actuator height does not exceed the lens height by more than 400 μm. In some embodiments, the actuator height does not exceed the lens height by more than 300 μm.


In various embodiments, there are provided folded cameras comprising: a lens positioned in an optical path between an optical path folding element and an image sensor, the lens having a lens height and an optical axis, wherein the folded camera has a height not exceeding the lens height by more than 500 μm.


In an exemplary embodiment, the folded camera above may have a height not exceeding the lens height by more than 400 μm.


In an exemplary embodiment, the folded camera above may have a height not exceeding the lens height by more than 250 μm.


In an exemplary embodiment, the folded camera above may be included together with an upright camera in a dual-camera.


In an embodiment there is provided an actuator for actuating a lens having a lens optical axis for AF and optical image stabilization OIS, the actuator comprising: a stationary sub-assembly that includes an OIS coil having an OIS coil plane and an AF coil having an AF coil plane; and a lens actuating sub-assembly movable relative to the stationary sub-assembly and including a lens holder holding the lens, wherein the OIS coil plane is perpendicular to AF coil plane and wherein the lens optical axis lies between the OIS coil plane and the AF coil plane.


In an exemplary embodiment, the stationary sub-assembly further includes a plurality of upper stepping yokes, wherein the lens actuating sub-assembly further includes a plurality of stepping magnets coupled to the plurality of upper stepping yokes, and wherein the plurality of stepping yokes and the plurality of stepping magnets are operable to create stepping forces in a direction perpendicular to the lens optical axis for stepping.


In some exemplary embodiments, an actuator as above or below further comprises a middle actuating sub-assembly for AF and OIS positioned between the stationary sub-assembly and the lens top actuating sub-assembly.


In some exemplary embodiments, the stationary sub-assembly further includes an OIS Hall sensor bar used in conjunction with one of the stepping magnets to perform position sensing.


In some exemplary embodiments, some yokes of the plurality of stepping yokes are positioned on a first surface, wherein other yokes of the plurality of stepping yokes are positioned on a second surface, and wherein the first and second surfaces are parallel.


In some exemplary embodiments, an actuator as above may be included in a folded camera.


In various embodiments, there are provided folded cameras comprising: a lens having a lens optical axis, an optical path folding element for folding light from a first direction to a second direction, the second direction being essentially aligned with the lens optical axis, an image sensor and an actuator for actuating the lens for AF and OIS, the actuator comprising an AF VCM that includes an AF coil positioned in an AF plane and is operable to move the lens in an AF direction, and an OIS VCM that includes an OIS coil positioned in an OIS plane and is operable to move the lens in an OIS direction, wherein the AF plane and the OIS plane are perpendicular to each other, and wherein the two VCMs are located on opposite sides of a plane defined by the first and second directions.





BRIEF DESCRIPTION OF THE DRAWINGS

Non-limiting examples of embodiments disclosed herein are described below with reference to FIGURES attached hereto that are listed following this paragraph. Identical structures, elements or parts that appear in more than one FIGURE are generally labeled with a same numeral in all the FIGURES in which they appear. The drawings and descriptions are meant to illuminate and clarify embodiments disclosed herein and should not be considered limiting in any way. In the drawings:



FIG. 1A shows an embodiment of a folded camera disclosed herein;



FIG. 1B shows a cross section along cuts A-A and B-B of the folded camera of FIG. 1A;



FIG. 1C shows another folded camera disclosed herein;



FIG. 1D shows a side cut along a line B′-B′ of the folded camera in FIG. 1C;



FIG. 2A shows schematically the elements of a folded camera disclosed herein;



FIG. 2B shows an embodiment of a reduced height folded lens actuator with a bottom opening disclosed herein in a top perspective view;



FIG. 2C shows the actuator embodiment of FIG. 2B without an upper envelope from a top perspective view;



FIG. 2D shows the actuator embodiment of FIG. 2B from a bottom perspective view;



FIG. 2E shows the actuator embodiment of FIG. 2B in a front section view along sections between sections C-C and D-D;



FIG. 2F shows an embodiment of a reduced height folded camera that includes a lens actuator as in FIGS. 2B-2E;



FIG. 2G shows a side cut along a cut D′-D′ of the folded camera embodiment of FIG. 2F;



FIG. 3A shows an embodiment of a reduced height folded lens actuator with a top opening disclosed herein in a top perspective view;



FIG. 3B shows the actuator embodiment of FIG. 3A without an upper envelope from a top perspective view;



FIG. 3C shows the actuator embodiment of FIG. 3A from a bottom perspective view;



FIG. 3D shows the actuator embodiment of FIG. 3B from a bottom perspective view;



FIG. 3E shows the actuator embodiment of FIGS. 3A-3D in a front section view along sections between sections A-A and B-B in FIG. 3A;



FIG. 4A shows an embodiment of a reduced height folded lens actuator with a top opening and a bottom opening disclosed herein in a top perspective view;



FIG. 4B shows the actuator embodiment of FIG. 4A with a separated upper envelope from a bottom perspective view;



FIG. 4C shows the actuator embodiment of FIG. 4A in a section view between sections H-H and G-G in FIG. 4A;



FIG. 5A shows an exploded view of the reduced height folded lens actuator of FIGS. 4A-C;



FIG. 5B shows another exploded view of the reduced height folded lens actuator of FIGS. 4A-C;



FIG. 6 shows an exploded view of an electronic sub-assembly in a reduced height folded lens actuator disclosed herein;



FIG. 7 shows an exploded view of a base sub-assembly in a reduced height folded lens actuator disclosed herein;



FIG. 8 shows an exploded view of a lens sub-assembly in a reduced height folded lens actuator disclosed herein;



FIG. 9 shows an exploded view of an OIS/AF plate sub-assembly in a reduced height lens actuator disclosed herein;



FIG. 10A shows an exploded view of an embodiment and various parts of a folded camera lens sub-assembly according to some aspects of presently disclosed subject matter;



FIG. 10B shows the positioning of the AF and OIS coils relative to the lens optical axis from one view;



FIG. 10C shows the positioning of the AF and OIS coils relative to the lens optical axis from another view;



FIG. 10D shows a envelope in the lens sub-assembly of FIG. 10A with an added top opening;



FIG. 10E shows a lower plate in the lens sub-assembly of FIG. 10A with an added bottom opening;



FIGS. 11A and 11B show exploded views from two perspectives of a first VCM actuator in the lens sub-assembly;



FIGS. 11C and 11D show respectively rails in the middle chassis and rails in the base;



FIGS. 12A and 12B show exploded views from two perspectives of a second VCM actuator in the lens sub-assembly;



FIGS. 12C and 12D show respectively rails in the middle chassis and rails in the base;



FIGS. 13A and 13B show parts of the lens sub-assembly related to the actuation;



FIGS. 14A and 14B show the top actuating sub-assembly in respectively, an exploded perspective view and an assembled view;



FIGS. 14C and 14D show two different embodiments in cross section along the optical axis of the top actuating sub-assembly of FIGS. 14A, 14B and a prism;



FIG. 15 shows an embodiment of a dual camera comprising an upright camera and a folded camera with an actuator disclosed above or below.





DETAILED DESCRIPTION


FIG. 1A shows an embodiment of a folded camera numbered 100. Folded camera 100 comprises a lens actuator 102 carrying a lens 104, an OPFE (e.g. a prism, a mirror, etc.) 106 and an image sensor 108. Camera 100 may be used to image a photographed object or a scene 110. In an example, light coming from the direction of object or scene 110 along a first direction (also referred to as “entrance optical axis”) 112 enters OPFE 106, is folded to a second direction (also referred to as “lens optical axis”) 114, enters lens actuator 102 and then arrives at image sensor 108. Lens 104 may comprise several lens elements, which may be held in one lens barrel or in a plurality of lens barrels. Lens 104 may have a fixed focal length or a changing (variable) focal length (“zoom lens”). Lens 104 may be shifted (actuated) for example for the purposes of focus (or auto focus—AF) or optical image stabilization (OIS). The actuation of lens 104 dictates that an air gap should be kept between the lens and other stationary parts such as an envelope 122 (see FIG. 1B). Folded camera 100 may include other parts such as an actuation mechanism for OPFE 106 (as in PCT/IB2017/052383), a housing (not shown for simplicity) for image sensor 108 to prevent stray light and mechanical damages, and other components known in the art, not shown for simplicity. More details on the operation of such a folded camera may be found in co-owned patent applications PCT/IB2015/056004, PCT/IB2016/052179 and PCT/IB2017/058403, which are all incorporated herein by reference.



FIG. 1B shows a cross section of lens actuator 102 along a cut A-A to B-B seen in FIG. 1A. Lens actuator 102 has an actuator height HA 102 between an external surface 140 of a top (upper) section (or “side”) 126 of envelope 122 and an external surface 128 of a bottom (lower) section 130 of envelope 122. The top and bottom envelope sections may be planar members with surfaces perpendicular to first direction 112 (i.e. with a plane normal aligned with first direction 112). As used herein, the terms “top” or “upper” refer to a side of the lens actuator (and of the folded camera) that is closer to and facing object or scene 110 along Y, while “bottom”, “below” or “lower” refers to a side of the lens actuator (and of the folded camera) that is farthest and facing away from the imaged object or scene along Y. Height HA 102 is measured along the Y axis, or parallel to the first optical axis 112, as described below. As used herein, “height”, “part height”, “module height”, “actuator height” or “camera height”, refer to a dimension of the respective object along the Y axis, namely along an axis perpendicular to lens optical axis 114 and parallel to entrance optical axis 112 facing the object.


Actuator height HA 102 is a sum of a lens height HL of lens 104, an upper height penalty 134 and a lower height penalty 136. Upper height penalty 134 is defined as the distance between a topmost surface 138 of the lens and external top surface 140. Lower height penalty 136 is defined as the distance between a lowest (bottom) surface 124 of the lens and external bottom surface 128. In other words, upper height penalty 134 is the sum of the thickness of upper envelope section 126 and the size of an upper air gap 142 required between lens 104 and upper envelope section 126 (e.g. to allow actuation and movement of the lens for AF and/or OIS). Lower height penalty 136 is the sum of the thickness of lower envelope section 130 and the size of a lower air gap 144 needed between lens 104 and lower envelope section 130 e.g. to allow actuation and movement of the lens for AF and/or OIS). In turn, height HA 102 is the sum of the largest dimension of the lens in the Y direction (i.e. HL) plus necessary air gaps 142 and 144 plus the thicknesses of the upper and lower envelope sections 126 and 130. In other words, lens actuator height HA 102 is the largest dimension of actuator 120 along the Y direction.



FIG. 1C shows another folded camera 150, similar to camera 100. Camera 150 includes a lens actuator section with lens actuator 102 holding the lens, an image sensor holder section 152 that includes the image sensor and has a height HS, and a prism holder section 154 that includes OPFE 106 and has a height HP. Additionally, an infra-red (IR) filter 156 may be positioned between lens 104 and image sensor 108, FIG. 1D. FIG. 1D shows a side cut of camera 150 along a line B′-B′ seen in FIG. 1C. In camera 150, a folded camera height HFC is limited by the maximum value of HP, HS and HA 102. Thus HFC may be limited by lens actuator height HA 102, and a reduction in HA 102 may lead to a reduction of HFC. In other words, the folded camera height may be determined by (and may be equal to) the lens actuator height.



FIG. 2A shows schematically the elements of a folded camera disclosed herein and numbered 200 in an exemplary coordinate system XYZ. Folded camera 200 includes a reduced height lens actuator 202 having a top opening 203, a lens 204, an OPFE 206 and an image sensor 208, see also FIGS. 2-9.


OPFE 206 folds light arriving from an object or scene 210 along a first direction (entrance optical axis) 212 parallel to the Y direction, to a second direction (lens optical axis) 214 parallel to the Z direction toward image sensor 208.



FIGS. 2B-2E provide various views of lens actuator 202. FIG. 2B shows lens actuator 202 in a top perspective view, FIG. 2C shows lens actuator 202 without an upper envelope section 216 from a top perspective view. FIG. 2D shows lens actuator 202 with a separated upper envelope section 216 from a bottom perspective view. Arrow 260 shows the direction from which upper envelope section 216 is installed. FIG. 2E shows lens actuator 202 in a section view between sections C-C and D-D in FIG. 2A. Top opening 203 allows for an upper height penalty 234 smaller than upper height penalty 134 in lens actuator 102. Upper height penalty (air-gap) 234 is measured between lens top surface 238 and an external top surface 224 of the upper envelope section 216. Upper height penalty (air-gap) 234 is equal to the size of the air-gap between lens top surface 238 and an external top surface 224 measured along the first direction (Y axis). A second air gap 232 is positioned on the diametrically opposed side of lens 204 relative to air gap 234. Air gap 232 is between lens 204 and an internal surface 236 of bottom envelope section 220, and allows the motion of lens 204 relative to bottom envelope section 220. In some examples, HA 202 is equal to the lens height HL plus the size of two air-gaps 234 and 232 plus the thickness of a bottom envelope section 220. Exemplarily, the size of air-gap 234 and/or 232 can be 50-150 μm, the thickness of bottom envelope section 220 is 100-150 μm, and lens actuator height HA 202 can be equal to HL plus 250 μm-500 μm. All other dimensions being equal, a lens actuator height HA 202 in folded camera 200 will be smaller than lens actuator height HA 102 in folded camera 100.



FIG. 2F shows another embodiment of a folded camera disclosed herein and numbered 250, similar to folded camera 200. Camera 250 includes lens actuator 202 with lens actuator height HA 202 and carrying lens 204. Image sensor 208 is held in an image sensor holder 252. An OPFE 206 is held in a prism holder 254. Additionally, in some embodiments, an IR filter 256 is optionally positioned between lens 204 and image sensor 208. FIG. 2G shows a side cut of camera 250 along a line D′-D′ seen in FIG. 2F. In camera 250, folded camera height HFC is limited by the maximum of HA 202, HP and HS. Thus, a reduction HA 202 may lead to a reduction of HFC.


Alternatively, for a given folded camera height, a higher lens (i.e. a lens with large HL) with better optical properties can be used in a design with an opening, relative to a design with no opening. Evidently, the design of camera 250 has an advantage over the design of camera 150 by either having a lower camera height for the same optics, or by having better optics for the same camera height.



FIGS. 3A-3E provide various views of a second embodiment of a lens actuator numbered 302, in which the lens actuator envelope 314 has a bottom opening 304 in a bottom lid 306. Lens actuator 302 is similar to lens actuator 202 and can be installed in a folded camera such as folded camera 200 in a similar manner. FIG. 3A shows lens actuator 302 actuating lens 310 in a top perspective view, FIG. 3B shows lens actuator 302 without an upper envelope section from a top perspective view. FIG. 3C shows lens actuator 302 from a bottom perspective view. FIG. 3D shows lens actuator 302 without an upper envelope section from a bottom perspective view, and FIG. 3E shows lens actuator 302 in a section view between sections E-E and F-F in FIG. 3A. Bottom opening 304 allows for a lower height penalty (air-gap) 336 and equal to the air-gap between a bottom surface 324 of the lens and an external bottom surface 328 of a bottom envelope section 306 measured along the first direction (Y axis). That is, lower height penalty 336 is smaller than lower height penalty 136 in FIG. 1. A second air gap 332 is positioned on the diametrically opposed side of lens 310 relative to air gap 336. An air gap 232 is between lens 310 and the internal surface 362 of upper envelope section 360, and allows the motion of lens 310 relative to upper envelope section 360. In some examples, HA 302 is equal to HL plus the size of the two air-gaps 332 and 336, plus the thickness of upper envelope section 360. Exemplarily, the height of each of air-gaps 332 and 336 can be 50-150 μm, the thickness of upper envelope section 360 can be 100-150 μm, and HA 302 can be equal to the lens height HL plus 250 μm-500 μm. All other dimensions being equal, a lens actuator height HA 302 of camera 300 will be smaller than lens actuator height HA 102 in camera 100. Like lens actuator 202, lens actuator 302 may be combined in a folded camera between an OPFE and an image sensor, such that the height of the folded camera HFC may be equal to the height of the lens actuator HA 302.



FIGS. 4A-4C provide various views of a third embodiment of a folded lens actuator numbered 402 actuating a lens 410, in which a lens actuator envelope 414 has both a bottom opening and a top opening. FIG. 4A shows lens actuator 402 in a top perspective view, FIG. 4B shows lens actuator 402 with a separated upper envelope section 416 from a bottom perspective view, and FIG. 4C shows lens actuator 402 in a section view between sections G-G and H-H in FIG. 4A. Arrow 460 shows the direction from which upper envelope section 216 is installed. Lens actuator 402 includes upper envelope section 416 with an opening 403 like opening 203 in lens actuator 202 and a bottom envelope section 406 with an opening 404 like opening 304 in lens actuator 302. The two openings 403 and 404 are positioned on diametrically opposed sides of lens 410. Thus, lens actuator 402 combines the advantages provided by top opening 203 of lens actuator 202 and bottom opening 304 of lens actuator 302, with a final lens actuator height HA 402 smaller than the lens actuator heights in actuators 102, 202 and 302. In some examples, lens actuator height HA 402 is equal to the lens height plus the size of two air-gaps 418 and 432. Exemplarily, the size of each of the air-gaps 418 and 432 can be 50-150 μm and lens actuator height HA 402 can be equal to HL plus 100 μm or 250 μm or 300 μm. Like lens actuator 202, lens actuator 402 may be combined in a folded camera between an OPFE and an image sensor, such that the height of the folded camera HFC may be equal to the height of the lens actuator HA, 402.



FIGS. 5A, 5B, 6, 7, 8 and 9 show one exemplary lens actuator design using VCM actuation. Such a design may be used in conjunction with envelope designs of lens actuators 202, 302 and 402.



FIG. 5A and FIG. 5B show, respectively, exploded bottom and top perspective views of a VCM 502. VCM 502 comprises an envelope 506, an OIS/AF plate sub-assembly 508, four upper balls 510, a lens carrier sub-assembly 512, lens 514, four lower balls 516, an electronic sub-assembly 530, a base sub-assembly 540 and a lower plate 522. VCM 502 is capable of actuating any of the lenses above in two orthogonal directions, for example for focusing and optical image stabilization.



FIG. 6 shows an exploded view of electronic sub-assembly 530. Electronic sub-assembly 530 comprises an OIS Hall bar sensor 602, an OIS coil 604, an AF Hall bar sensor 606, a first rigid printed board circuit (PCB) 608, a second rigid PCB 610 and a flex PCB 612. The control of the motion of any of the lenses above or below can be done in close loop mode using the position sensing allowed by Hall bar sensors 602 and 606.



FIG. 7 shows an exploded view of base sub-assembly 540. Base sub-assembly 540 comprises an AF VCM 704, an AF stepping yoke 702 and a base 706.



FIG. 8 shows an exploded view of lens carrier sub-assembly 512. Lens carrier sub-assembly 512 comprises an OIS VCM magnet 804, an OIS sensing magnet 802 and a lens carrier 806.



FIG. 9 shows an exploded view of OIS/AF plate sub-assembly 508. OIS/AF plate sub-assembly 408 comprises an AF motor magnet 902, an OIS stepping yoke 904 and an OIS/AF plate 906.



FIGS. 10-14 show another exemplary lens actuator design using VCM actuation. FIG. 10A shows an exploded view of a lens actuator 1004 using VCM actuation according to some aspects of presently disclosed subject matter, lens actuator 1004 comprises an envelope 1014 serving as protection for the lens and other mechanical parts, a lens 1016 with a lens optical axis 1012, a lens carrier (holder) 1018, a plurality (e.g. four) of stepping magnets 1020a, b, c and d, an OIS magnet 1022, four upper balls 1024, an AF magnet 1026, a middle chassis 1028, four lower balls 1030, a base 1032, a plurality (e.g. four) of upper stepping yokes 1034a, b, c and d, an AF Hall sensor bar 1036, an AF coil 1038, an OIS coil 1040, a PCB 1042 serving as platform for placement of electrical components and electrical linkage between these electrical components, and OIS Hall sensor bar 1044 and a lower plate 1048 serving as bottom mechanical protection for the camera. In some embodiments, some of the stepping yokes may positioned on a first surface, and other stepping yokes may be positioned on a second surface, wherein the first and second surfaces are parallel.



FIGS. 10B and 10C show the positioning of AF coil 1038 and OIS coil 1040 relative to the lens optical axis 1012 from two different views. Each coil has a stadium shape, such that it has two long dimensions (typically 1-5 mm long) and one short dimension (typically 0.1-0.5 mm thick). Each coil typically has a few tens of windings (for example, in a non-limiting range of 50-250), with an exemplary resistance of 10-30 ohm. The plane in which the long dimensions of the coil reside will be considered henceforth to be the respective “coil plane”. In the example shown, an “OIS coil plane” of OIS coil 1040 is parallel to the XZ plane, namely its two long dimensions are in XZ plane while its short dimension is along the Y axis. In the example shown, an “AF coil plane” of AF coil 1038 is parallel to the YZ plane, namely its two long dimensions are in the YZ plane while its short dimension is along the X axis. Thus, in this example the OIS coil plane is perpendicular to the AF coil plane. In an embodiment, OIS coil 1040 faces OIS magnet 1022 (FIG. 10A). The OIS magnet is a fixed (i.e. permanent) magnet. Magnet 1022 may be fabricated (e.g. sintered, cut) such that it has a changing magnetic field polarity: on its positive X size, OIS magnet 1022 has a magnetic field facing the negative Y direction, while on its negative X side, OIS magnet 1022 has a magnetic field facing the positive Y direction. Upon driving of current in OIS coil 1040, a Lorenz force is created by the magnetic filed of OIS magnet 1022 on OIS coil 1040 in the negative or positive Y direction. Consequently, an equal force is applied on OIS magnet 1022 in the Y direction. Having OIS coil 1040 in XZ plane has the advantage in that, while in actuation, OIS magnet is kept at a constant distance from OIS coil 1022. That is, Lorentz force for OIS is uniform for different AF positions, and the OIS position reading is linear for OIS motion and uniform for different AF positions.


In the example of FIG. 10B, lens optical axis 1012 is in the Z direction. Each of the OIS and AF planes is parallel to lens optical axis 1012. In addition, relative to a plane defined by the first optical axis 1010 and the second (lens) optical axis 1012, the OIS coil and the AF coil are on opposite sides of this plane. This feature has an advantage in that it reduces magnetic interference of the two VCMs.


In an embodiment, AF coil 1038 faces AF magnet 1026. The AF magnet is a fixed (i.e. permanent) magnet. AF magnet 1026 may be fabricated (e.g. sintered, cut) such that it has a changing magnetic field polarity: on its positive Z size, AF magnet 1026 has a magnetic field facing the negative X direction, while on its negative Z side OIS magnet 1022 has a magnetic field facing the positive X direction. Upon driving of current in AF coil 1038, a Lorenz force is created by the magnetic filed of AF magnet 1026 on AF coil 1038 in the negative or positive Z direction. Consequently, an equal force is applied on AF magnet 1026 in the Z direction. Having AF coil 1038 in YZ plane has the advantage in that, while in actuation, the AF magnet is kept at a constant distance from OIS coil 1040. That is, the Lorentz force for AF is uniform for different OIS positions, and the AF position reading is linear for AF motion and uniform for different OIS positions.



FIG. 10D shows an envelope 1014′ which is similar to envelope 1014 in VCM 1004, with an added top opening 1062. FIG. 10E shows a lower plate 1048′ similar to lower plate 1048 in VCM 1004, with an added bottom opening 1064. Openings 1062 and 1064 allow reducing the height of VCM 1004, in a manner similar to openings 203 and 304 described above. All descriptions of embodiments 202, 302, 402, with regard to benefits of top and bottom openings are applicable to the description of VCM 1004 and may be used in VCM 1004.



FIGS. 11A and 11B show exploded views from two perspectives of a first VCM actuator numbered 1100 included in lens actuator 1004. In an example, VCM actuator 1100 may be used for AF. In another example, VCM actuator 1100 may be used for OIS. In VCM actuator 1100, a top actuating sub-assembly 1110 is movable relative to an AF stationary sub-assembly 1120 in a direction parallel to optical axis 1012. Top actuating sub-assembly 1110 comprises lens 1016, lens holder 1018, middle chassis 1028, AF magnet 1026 and the four stepping magnets 1020a, b, c and d, OIS magnet 1022, and four upper balls 1024. Middle chassis 1028 and AF magnet 1026 form a middle actuating sub-assembly 1130. AF stationary sub-assembly 1120 comprises a lower stepping yoke 1050, OIS Hall sensor bar 1044, printed circuit board 1042, OIS coil 1040, AF coil 1038, AF Hall sensor bar 1036, four upper stepping yokes 1034a, b, c and d and base 1032 (only some of which are seen in these FIGURES). Middle actuating sub-assembly 1130 is movable relative to an AF stationary sub-assembly 1120 in a direction parallel to optical axis 1012 and movable relative to lens actuating sub-assembly 1210 in a direction perpendicular to optical axis 1012.



FIGS. 11C and 11D show respectively four rails 1052 in middle chassis 1028 and four rails 1054 in base 1032. While one of rails 1054 is hidden in FIG. 11D, it is understood by a person skilled in the art that its location is symmetric with other visible rails.


In VCM actuator 1100, each of the four rails 1052 faces one respective rail of rails 1054, while one ball of lower balls 1030 is between the rails. The rails and ball structure confines the motion of top actuating sub-assembly 1110 relative to AF stationary sub-assembly 1120 in a direction parallel to optical axis 1012. In addition, top actuating sub-assembly 1110 is pulled to AF stationary sub-assembly 1120 in the Y direction due to the magnetic force of magnets 1020 and upper stepping yokes 1034 (see below), while balls 1030 keep the distance between top actuating sub-assembly 1110 and AF stationary sub-assembly 1120 constant in the Y direction. In this description, the term “constant distance” with respect to moving parts refers to a distance between the parts in a direction perpendicular to the motion direction that is constant with a tolerance of ±10 μm, ±30 μm, ±50 μm, or even ±100 μm.



FIGS. 12A and 12B show exploded top and bottom perspective views of a second VCM actuator in lens sub-assembly 1004, numbered 1200. VCM actuator 1200 includes a lens actuating sub-assembly 1210 movable relative to an OIS stationary sub-assembly 1220. VCM actuator 1200 may be used for OIS. Lens actuating sub-assembly 1210 comprises lens 1016, lens holder 1018, four stepping magnets 1020 and OIS magnet 1022 (which is also part of top actuating sub-assembly 1110). OIS stationary sub-assembly 1220 comprises lens holder 1018, middle chassis 1028, AF magnet 1026, AF stationary sub-assembly 1120 and the four lower balls 1030.



FIGS. 12C and 12D show respectively four rails 1056 in lens carrier 1018 and four rails 1058 in middle chassis 1028. In VCM actuator 1200, each of the four rails 1056 faces one respective rail of rails 1058, while one ball of upper balls 1024 is between the rails. The rails and ball structure confine the motion of lens actuating sub-assembly 1210 relative to OIS stationary actuating sub-assembly 1220 in a direction perpendicular to optical axis 1012. In addition, lens actuating sub-assembly 1210 is pulled to OIS stationary sub-assembly 1220 in the Y direction due to the magnetic force of magnets 1020a,b, c and d and stepping yokes 1034a,b, c and d (see below), while upper balls 1024 keep the distance between lens actuating sub-assembly 1210 and OIS stationary sub-assembly 1220 constant in the Y direction.


In some embodiments, the lens actuating sub-assembly is pulled toward the stationary sub-assembly, with the middle actuating sub-assembly positioned therebetween.


In use of actuator 1100 for AF, an electrical current in AF coil 1038 creates force on AF magnet 1026, driving middle chassis 1028 in directions parallel to lens optical axis 1012, for example along the positive or negative Z direction. Middle chassis 1028 holds lens actuating sub-assembly 1210 and while moving in the AF direction it carries lens actuating sub-assembly 1210 along, such that lens 1016 is operative to focus on image sensor 1006, as required by optical demands. The AF movement is directed by the rolling and/or sliding of the four lower balls 1030 inside the four respective rails 1052 located in middle chassis 1028 and inside four compatible rails 1054 located in base 1032.


In use of actuator 1200 for OIS, electrical current in OIS coil 1040 creates force on OIS magnet 1022, driving lens carrier 1018 in directions perpendicular to the lens optical axis 1012 and parallel to the X axis (shown in the exemplary coordinate system XYZ). During this movement, lens carrier 1018 (which holds lens 1016) moves together with the lens in any OIS direction. The movement for OIS is directed by the rolling and/or sliding of four upper balls 1024 inside four rails 1056 located on lens carrier 1018 and inside another four compatible rails 1058 located on the middle chassis 1028.


The four stepping magnets 1020a, 1020b, 1020c and 1020d located on the lens carrier 1018 are associated with four stepping yokes 1034a, 1034b, 1034c and 1034d located on AF stationary sub-assembly 1120, creating a stepping force indicated by arrows in a direction perpendicular to optical axis 1012. Stepping magnets 1020a-d and stepping yokes 1034a-d are seen in FIG. 13A, which shows an exploded view of VCM 1100, and in FIG. 13B which shows only the magnets and yokes along with the force direction, which is directed in the negative Y direction. In an embodiment, lens actuating sub-assembly 1210 is pulled toward AF stationary sub-assembly 1120, while OIS stationary sub-assembly 1220 is positioned therebetween. Upper balls 1024 located between lens actuating sub-assembly 1210 and OIS stationary sub-assembly 1220 prevent contact between the two sub-assemblies. Similarly, lower balls 1030 located between OIS stationary sub-assembly 1220 and AF stationary sub-assembly 1120 prevent contact between the two sub-assemblies. At the same time, the pull force created between four stepping magnets 1020 and four stepping yokes 1034 hold actuator 1100 as one unit and prevent all moving parts from coming apart. In some examples, the three stepping magnets are used only for stepping, while the fourth magnet is used for stepping and sensing.



FIGS. 14A and 14B show top actuating sub-assembly 1110 in, respectively, an exploded perspective view and an assembled view. In some embodiments, lens carrier 1018 has an opening 1402 which allows light to pass from an OPFE to lens 1016. Opening 1402 is surrounded by walls 1404a, b, c and d. In an embodiment, middle chassis 1028 comprises walls 1406a, b, c and d. Wall 1406b can be used to add mechanical strength and connect between the rails. FIGS. 14C and 14D show two different embodiments in cross section along the optical axis of top actuating sub-assembly 1110 and a prism 1410. The embodiments shown in FIGS. 14C and 14D describe two relative positions of walls 1406b and 1404b. In the embodiment of FIG. 14C, wall 1406b is located below wall 1404b (in the −Y direction).


In contrast, in the embodiment of FIG. 14D wall 1406b′ replaces wall 1406b and is located beside wall 1404b (in the −Z direction). A distance 1408 denotes the minimal distance of top actuating sub-assembly 1110 from prism 1410. Distance 1408 is determined by a stroke for AF of top actuating sub-assembly 1110, as required by optical needs and assembly tolerances, as required by mechanical needs. Distance 1408 is constant in both configurations (FIGS. 14C and 14D). Thus, the configuration in FIG. 14C has an advantage, since it allows a shorter actuator along the optical axis direction (−Z direction), namely a reduction in the length of folded camera 1000 (FIG. 10A).



FIG. 15 shows a dual camera 1500 comprising an upright camera 1502 and a folded camera 1504. Folded camera 1504 may include a lens actuator like any actuator/VCM disclosed above, for example actuators/VCMs 102, 202, 302, 402, 502 or 1004.


While this disclosure describes a limited number of embodiments, it will be appreciated that many variations, modifications and other applications of such embodiments may be made. In general, the disclosure is to be understood as not limited by the specific embodiments described herein, but only by the scope of the appended claims.


All references mentioned in this specification are herein incorporated in their entirety by reference into the specification, to the same extent as if each individual reference was specifically and individually indicated to be incorporated herein by reference. In addition, citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the present application.

Claims
  • 1. An actuator suitable to be used in a folded camera and configured to actuate a lens having a lens optical axis for auto-focus (AF) and optical image stabilization (OIS), the actuator comprising: a) a stationary sub-assembly that includes an OIS coil having an OIS coil plane and an AF coil having an AF coil plane; andb) a lens actuating sub-assembly movable relative to the stationary sub-assembly and including a lens holder holding the lens, wherein the OIS coil plane is perpendicular to AF coil plane and wherein the lens optical axis lies between the OIS coil plane and the AF coil plane, andwherein the OIS coil and the AF coil are on opposite sides of a plane defined by the lens optical axis and an entrance optical axis in the folded camera.
  • 2. The actuator of claim 1, wherein the stationary sub-assembly further includes a plurality of upper stepping yokes, wherein the lens actuating sub-assembly further includes a plurality of stepping magnets coupled to the plurality of upper stepping yokes, and wherein the plurality of stepping yokes and the plurality of stepping magnets are operable to create stepping forces in a direction perpendicular to the lens optical axis for stepping.
  • 3. The actuator of claim 2, wherein the stationary sub-assembly further includes an OIS Hall sensor bar used in conjunction with one of the stepping magnets to perform position sensing.
  • 4. The actuator of claim 2, wherein some yokes of the plurality of upper stepping yokes are positioned on a first surface, wherein other yokes of the plurality of upper stepping yokes are positioned on a second surface, and wherein the first and second surfaces are parallel.
  • 5. The actuator of claim 1, further comprising a middle actuating sub-assembly for AF and OIS positioned between the stationary sub-assembly and the lens actuating sub-assembly.
  • 6. The actuator of claim 1, wherein the OIS coil is a single OIS coil and wherein the AF coil is a single AF coil.
  • 7. The actuator of claim 6, wherein the single OIS coil is mounted on a bottom of the stationary sub-assembly and wherein the single AF coil is mounted on a side of the stationary sub-assembly.
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 17/187,810 filed Feb. 28, 2021 (now allowed) which was a continuation of U.S. patent application Ser. No. 16/475,267 filed Jul. 1, 2019 (issued as U.S. Pat. No. 10,976,567), which was a 371 application from international patent application No. PCT/IB2018/060203, which claims priority to U.S. provisional patent applications Nos. 62/626,306 filed Feb. 5, 2018, 62/658,819 filed Apr. 17, 2018, 62/672,754 filed May 17, 2018 and 62/677,012 filed May 27, 2018, the content of which applications is incorporated herein by reference in their entirety.

US Referenced Citations (372)
Number Name Date Kind
3085354 Rasmussen et al. Apr 1963 A
3584513 Gates Jun 1971 A
3941001 LaSarge Mar 1976 A
4199785 McCullough et al. Apr 1980 A
4792822 Akiyama et al. Dec 1988 A
5005083 Grage et al. Apr 1991 A
5032917 Aschwanden Jul 1991 A
5041852 Misawa et al. Aug 1991 A
5051830 von Hoessle Sep 1991 A
5099263 Matsumoto et al. Mar 1992 A
5248971 Mandl Sep 1993 A
5287093 Amano et al. Feb 1994 A
5331465 Miyano Jul 1994 A
5394520 Hall Feb 1995 A
5436660 Sakamoto Jul 1995 A
5444478 Lelong et al. Aug 1995 A
5459520 Sasaki Oct 1995 A
5502537 Utagawa Mar 1996 A
5657402 Bender et al. Aug 1997 A
5682198 Katayama et al. Oct 1997 A
5768443 Michael et al. Jun 1998 A
5892855 Kakinami et al. Apr 1999 A
5926190 Turkowski et al. Jul 1999 A
5940641 McIntyre et al. Aug 1999 A
5982951 Katayama et al. Nov 1999 A
6101334 Fantone Aug 2000 A
6128416 Oura Oct 2000 A
6148120 Sussman Nov 2000 A
6201533 Rosenberg et al. Mar 2001 B1
6208765 Bergen Mar 2001 B1
6211668 Duesler et al. Apr 2001 B1
6215299 Reynolds et al. Apr 2001 B1
6222359 Duesler et al. Apr 2001 B1
6268611 Pettersson et al. Jul 2001 B1
6549215 Jouppi Apr 2003 B2
6611289 Yu et al. Aug 2003 B1
6643416 Daniels et al. Nov 2003 B1
6650368 Doron Nov 2003 B1
6680748 Monti Jan 2004 B1
6714665 Hanna et al. Mar 2004 B1
6724421 Glatt Apr 2004 B1
6738073 Park et al. May 2004 B2
6741250 Furlan et al. May 2004 B1
6750903 Miyatake et al. Jun 2004 B1
6778207 Lee et al. Aug 2004 B1
7002583 Rabb, III Feb 2006 B2
7015954 Foote et al. Mar 2006 B1
7038716 Klein et al. May 2006 B2
7199348 Olsen et al. Apr 2007 B2
7206136 Labaziewicz et al. Apr 2007 B2
7248294 Slatter Jul 2007 B2
7256944 Labaziewicz et al. Aug 2007 B2
7305180 Labaziewicz et al. Dec 2007 B2
7339621 Fortier Mar 2008 B2
7346217 Gold, Jr. Mar 2008 B1
7365793 Cheatle et al. Apr 2008 B2
7411610 Doyle Aug 2008 B2
7424218 Baudisch et al. Sep 2008 B2
7509041 Hosono Mar 2009 B2
7533819 Barkan et al. May 2009 B2
7619683 Davis Nov 2009 B2
7738016 Toyofuku Jun 2010 B2
7773121 Huntsberger et al. Aug 2010 B1
7809256 Kuroda et al. Oct 2010 B2
7880776 LeGall et al. Feb 2011 B2
7918398 Li et al. Apr 2011 B2
7964835 Olsen et al. Jun 2011 B2
7978239 Deever et al. Jul 2011 B2
8115825 Culbert et al. Feb 2012 B2
8149327 Lin et al. Apr 2012 B2
8154610 Jo et al. Apr 2012 B2
8238695 Davey et al. Aug 2012 B1
8274552 Dahi et al. Sep 2012 B2
8390729 Long et al. Mar 2013 B2
8391697 Cho et al. Mar 2013 B2
8400555 Georgiev et al. Mar 2013 B1
8439265 Ferren et al. May 2013 B2
8446484 Muukki et al. May 2013 B2
8483452 Jeda et al. Jul 2013 B2
8514491 Duparre Aug 2013 B2
8547389 Hoppe et al. Oct 2013 B2
8553106 Scarff Oct 2013 B2
8587691 Takane Nov 2013 B2
8619148 Watts et al. Dec 2013 B1
8752969 Kane et al. Jun 2014 B1
8803990 Smith Aug 2014 B2
8896655 Mauchly et al. Nov 2014 B2
8976255 Matsuoto et al. Mar 2015 B2
9019387 Nakano Apr 2015 B2
9025073 Attar et al. May 2015 B2
9025077 Attar et al. May 2015 B2
9041835 Honda May 2015 B2
9137447 Shibuno Sep 2015 B2
9185291 Shabtay et al. Nov 2015 B1
9215377 Sokeila et al. Dec 2015 B2
9215385 Luo Dec 2015 B2
9270875 Brisedoux et al. Feb 2016 B2
9286680 Jiang et al. Mar 2016 B1
9344626 Silverstein et al. May 2016 B2
9360671 Zhou Jun 2016 B1
9369621 Malone et al. Jun 2016 B2
9413930 Geerds Aug 2016 B2
9413984 Attar et al. Aug 2016 B2
9420180 Jin Aug 2016 B2
9438792 Nakada et al. Sep 2016 B2
9485432 Medasani et al. Nov 2016 B1
9578257 Attar et al. Feb 2017 B2
9618748 Munger et al. Apr 2017 B2
9681057 Attar et al. Jun 2017 B2
9723220 Sugie Aug 2017 B2
9736365 Laroia Aug 2017 B2
9736391 Du et al. Aug 2017 B2
9768310 Ahn et al. Sep 2017 B2
9800798 Ravirala et al. Oct 2017 B2
9851803 Fisher et al. Dec 2017 B2
9894287 Qian et al. Feb 2018 B2
9900522 Lu Feb 2018 B2
9927600 Goldenberg et al. Mar 2018 B2
20020005902 Yuen Jan 2002 A1
20020030163 Zhang Mar 2002 A1
20020054214 Yoshikawa May 2002 A1
20020063711 Park et al. May 2002 A1
20020075258 Park et al. Jun 2002 A1
20020122113 Foote Sep 2002 A1
20020167741 Koiwai et al. Nov 2002 A1
20030030729 Prentice et al. Feb 2003 A1
20030093805 Gin May 2003 A1
20030156751 Lee et al. Aug 2003 A1
20030160886 Misawa et al. Aug 2003 A1
20030202113 Yoshikawa Oct 2003 A1
20040008773 Itokawa Jan 2004 A1
20040012683 Yamasaki et al. Jan 2004 A1
20040017386 Liu et al. Jan 2004 A1
20040027367 Pilu Feb 2004 A1
20040061788 Bateman Apr 2004 A1
20040141065 Hara et al. Jul 2004 A1
20040141086 Mihara Jul 2004 A1
20040239313 Godkin Dec 2004 A1
20040240052 Minefuji et al. Dec 2004 A1
20050013509 Samadani Jan 2005 A1
20050046740 Davis Mar 2005 A1
20050134697 Mikkonen et al. Jun 2005 A1
20050141390 Lee et al. Jun 2005 A1
20050157184 Nakanishi et al. Jul 2005 A1
20050168834 Matsumoto et al. Aug 2005 A1
20050185049 Iwai et al. Aug 2005 A1
20050200718 Lee Sep 2005 A1
20050248667 Schweng et al. Nov 2005 A1
20060054782 Olsen et al. Mar 2006 A1
20060056056 Ahiska et al. Mar 2006 A1
20060067672 Washisu et al. Mar 2006 A1
20060102907 Lee et al. May 2006 A1
20060125937 LeGall et al. Jun 2006 A1
20060126737 Boice et al. Jun 2006 A1
20060170793 Pasquarette et al. Aug 2006 A1
20060175549 Miller et al. Aug 2006 A1
20060181619 Liow et al. Aug 2006 A1
20060187310 Janson et al. Aug 2006 A1
20060187322 Janson et al. Aug 2006 A1
20060187338 May et al. Aug 2006 A1
20060227236 Pak Oct 2006 A1
20070024737 Nakamura et al. Feb 2007 A1
20070126911 Nanjo Jun 2007 A1
20070127040 Davidovici Jun 2007 A1
20070159344 Kisacanin Jul 2007 A1
20070177025 Kopet et al. Aug 2007 A1
20070188653 Pollock et al. Aug 2007 A1
20070189386 Magawa et al. Aug 2007 A1
20070257184 Olsen et al. Nov 2007 A1
20070285550 Son Dec 2007 A1
20080017557 Witdouck Jan 2008 A1
20080024614 Li et al. Jan 2008 A1
20080025634 Border et al. Jan 2008 A1
20080030592 Border et al. Feb 2008 A1
20080030611 Jenkins Feb 2008 A1
20080084484 Ochi et al. Apr 2008 A1
20080088942 Seo Apr 2008 A1
20080106629 Kurtz et al. May 2008 A1
20080117316 Orimoto May 2008 A1
20080129831 Cho et al. Jun 2008 A1
20080218611 Parulski et al. Sep 2008 A1
20080218612 Border et al. Sep 2008 A1
20080218613 Janson et al. Sep 2008 A1
20080219654 Border et al. Sep 2008 A1
20090086074 Li et al. Apr 2009 A1
20090102948 Scherling Apr 2009 A1
20090109556 Shimizu et al. Apr 2009 A1
20090122195 Van Baar et al. May 2009 A1
20090122406 Rouvinen et al. May 2009 A1
20090128644 Camp et al. May 2009 A1
20090168135 Yu et al. Jul 2009 A1
20090200451 Conners Aug 2009 A1
20090219547 Kauhanen et al. Sep 2009 A1
20090234542 Orlewski Sep 2009 A1
20090252484 Hasuda et al. Oct 2009 A1
20090295949 Ojala Dec 2009 A1
20090324135 Kondo et al. Dec 2009 A1
20100013906 Border et al. Jan 2010 A1
20100020221 Tupman et al. Jan 2010 A1
20100060746 Olsen et al. Mar 2010 A9
20100097444 Lablans Apr 2010 A1
20100103194 Chen et al. Apr 2010 A1
20100134621 Namkoong et al. Jun 2010 A1
20100165131 Makimoto et al. Jul 2010 A1
20100196001 Ryynänen et al. Aug 2010 A1
20100202068 Ito Aug 2010 A1
20100238327 Griffith et al. Sep 2010 A1
20100246024 Aoki et al. Sep 2010 A1
20100259836 Kang et al. Oct 2010 A1
20100265331 Tanaka Oct 2010 A1
20100283842 Guissin et al. Nov 2010 A1
20100321494 Peterson et al. Dec 2010 A1
20110058320 Kim et al. Mar 2011 A1
20110063417 Peters et al. Mar 2011 A1
20110063446 McMordie et al. Mar 2011 A1
20110064327 Dagher et al. Mar 2011 A1
20110080487 Venkataraman et al. Apr 2011 A1
20110121666 Park et al. May 2011 A1
20110128288 Petrou et al. Jun 2011 A1
20110164172 Shintani et al. Jul 2011 A1
20110221599 Högasten Sep 2011 A1
20110229054 Weston et al. Sep 2011 A1
20110234798 Chou Sep 2011 A1
20110234853 Hayashi et al. Sep 2011 A1
20110234881 Wakabayashi et al. Sep 2011 A1
20110242286 Pace et al. Oct 2011 A1
20110242355 Goma et al. Oct 2011 A1
20110285714 Swic et al. Nov 2011 A1
20110298966 Kirschstein et al. Dec 2011 A1
20120014682 David et al. Jan 2012 A1
20120026366 Golan et al. Feb 2012 A1
20120044372 Cote et al. Feb 2012 A1
20120062780 Morihisa Mar 2012 A1
20120069235 Imai Mar 2012 A1
20120075489 Nishihara Mar 2012 A1
20120105579 Jeon et al. May 2012 A1
20120124525 Kang May 2012 A1
20120154547 Aizawa Jun 2012 A1
20120154614 Moriya et al. Jun 2012 A1
20120196648 Havens et al. Aug 2012 A1
20120229663 Nelson et al. Sep 2012 A1
20120249815 Bohn et al. Oct 2012 A1
20120287315 Huang et al. Nov 2012 A1
20120320467 Baik et al. Dec 2012 A1
20130002928 Imai Jan 2013 A1
20130016427 Sugawara Jan 2013 A1
20130063629 Webster et al. Mar 2013 A1
20130076922 Shihoh et al. Mar 2013 A1
20130093842 Yahata Apr 2013 A1
20130094126 Rappoport et al. Apr 2013 A1
20130113894 Mirlay May 2013 A1
20130135445 Dahi et al. May 2013 A1
20130148215 Mori et al. Jun 2013 A1
20130148854 Wang et al. Jun 2013 A1
20130155176 Paripally et al. Jun 2013 A1
20130163085 Lim et al. Jun 2013 A1
20130182150 Asakura Jul 2013 A1
20130201360 Song Aug 2013 A1
20130202273 Ouedraogo et al. Aug 2013 A1
20130229544 Bando Sep 2013 A1
20130235224 Park et al. Sep 2013 A1
20130250150 Malone et al. Sep 2013 A1
20130258044 Betts-LaCroix Oct 2013 A1
20130258048 Wang et al. Oct 2013 A1
20130270419 Singh et al. Oct 2013 A1
20130278785 Nomura et al. Oct 2013 A1
20130286221 Shechtman et al. Oct 2013 A1
20130321668 Kamath Dec 2013 A1
20140009631 Topliss Jan 2014 A1
20140049615 Uwagawa Feb 2014 A1
20140118584 Lee et al. May 2014 A1
20140160311 Hwang et al. Jun 2014 A1
20140192224 Laroia Jul 2014 A1
20140192238 Attar et al. Jul 2014 A1
20140192253 Laroia Jul 2014 A1
20140218587 Shah Aug 2014 A1
20140313316 Olsson et al. Oct 2014 A1
20140362242 Takizawa Dec 2014 A1
20140376090 Terajima Dec 2014 A1
20140379103 Ishikawa et al. Dec 2014 A1
20150002683 Hu et al. Jan 2015 A1
20150002684 Kuchiki Jan 2015 A1
20150042870 Chan et al. Feb 2015 A1
20150070781 Cheng et al. Mar 2015 A1
20150092066 Geiss et al. Apr 2015 A1
20150103147 Ho et al. Apr 2015 A1
20150110345 Weichselbaum Apr 2015 A1
20150124059 Georgiev et al. May 2015 A1
20150138381 Ahn May 2015 A1
20150145965 Livyatan et al. May 2015 A1
20150154776 Zhang et al. Jun 2015 A1
20150162048 Hirata et al. Jun 2015 A1
20150195458 Nakayama et al. Jul 2015 A1
20150198464 El Alami Jul 2015 A1
20150215516 Dolgin Jul 2015 A1
20150237280 Choi et al. Aug 2015 A1
20150242994 Shen Aug 2015 A1
20150244906 Wu et al. Aug 2015 A1
20150253543 Mercado Sep 2015 A1
20150253647 Mercado Sep 2015 A1
20150261299 Wajs Sep 2015 A1
20150271471 Hsieh et al. Sep 2015 A1
20150281678 Park et al. Oct 2015 A1
20150286033 Osborne Oct 2015 A1
20150288865 Osborne Oct 2015 A1
20150296112 Park et al. Oct 2015 A1
20150316744 Chen Nov 2015 A1
20150334309 Peng et al. Nov 2015 A1
20160044250 Shabtay et al. Feb 2016 A1
20160070088 Koguchi Mar 2016 A1
20160154066 Hioka et al. Jun 2016 A1
20160154202 Wippermann et al. Jun 2016 A1
20160154204 Lim et al. Jun 2016 A1
20160212358 Shikata Jul 2016 A1
20160212418 Demirdjian et al. Jul 2016 A1
20160238834 Erlich et al. Aug 2016 A1
20160241751 Park Aug 2016 A1
20160291295 Shabtay et al. Oct 2016 A1
20160295112 Georgiev et al. Oct 2016 A1
20160301840 Du et al. Oct 2016 A1
20160301868 Acharya et al. Oct 2016 A1
20160342095 Bieling et al. Nov 2016 A1
20160353008 Osborne Dec 2016 A1
20160353012 Kao et al. Dec 2016 A1
20160381289 Kim et al. Dec 2016 A1
20170001577 Seagraves et al. Jan 2017 A1
20170019616 Zhu et al. Jan 2017 A1
20170070731 Darling et al. Mar 2017 A1
20170094187 Sharma et al. Mar 2017 A1
20170124987 Kim et al. May 2017 A1
20170150061 Shabtay et al. May 2017 A1
20170187962 Lee et al. Jun 2017 A1
20170214846 Du et al. Jul 2017 A1
20170214866 Zhu et al. Jul 2017 A1
20170219749 Hou et al. Aug 2017 A1
20170242225 Fiske Aug 2017 A1
20170276954 Bajorins et al. Sep 2017 A1
20170289458 Song et al. Oct 2017 A1
20180013944 Evans, V et al. Jan 2018 A1
20180017844 Yu et al. Jan 2018 A1
20180024329 Goldenberg et al. Jan 2018 A1
20180059379 Chou Mar 2018 A1
20180109660 Yoon et al. Apr 2018 A1
20180109710 Lee et al. Apr 2018 A1
20180120674 Avivi et al. May 2018 A1
20180150973 Tang et al. May 2018 A1
20180176426 Wei et al. Jun 2018 A1
20180184010 Cohen et al. Jun 2018 A1
20180198897 Tang et al. Jul 2018 A1
20180241922 Baldwin et al. Aug 2018 A1
20180295292 Lee et al. Oct 2018 A1
20180300901 Wakai et al. Oct 2018 A1
20180329281 Ye Nov 2018 A1
20180368656 Austin et al. Dec 2018 A1
20190100156 Chung et al. Apr 2019 A1
20190121103 Bachar et al. Apr 2019 A1
20190121216 Shabtay et al. Apr 2019 A1
20190130822 Jung et al. May 2019 A1
20190213712 Ashdan et al. Jul 2019 A1
20190215440 Rivard et al. Jul 2019 A1
20190222758 Goldenberg et al. Jul 2019 A1
20190228562 Song Jul 2019 A1
20190297238 Klosterman Sep 2019 A1
20200103726 Shabtay et al. Apr 2020 A1
20200104034 Lee et al. Apr 2020 A1
20200134848 El-Khamy et al. Apr 2020 A1
20200221026 Fridman et al. Jul 2020 A1
20200264403 Bachar et al. Aug 2020 A1
20200389580 Kodama et al. Dec 2020 A1
20210180989 Fukumura et al. Jun 2021 A1
20210333521 Yedid et al. Oct 2021 A9
20220252963 Shabtay et al. Aug 2022 A1
Foreign Referenced Citations (70)
Number Date Country
101276415 Oct 2008 CN
201514511 Jun 2010 CN
102215373 Oct 2011 CN
102739949 Oct 2012 CN
102982518 Mar 2013 CN
103024272 Apr 2013 CN
203406908 Jan 2014 CN
103841404 Jun 2014 CN
205301703 Jun 2016 CN
105827903 Aug 2016 CN
105847662 Aug 2016 CN
107608052 Jan 2018 CN
107682489 Feb 2018 CN
109729266 May 2019 CN
1536633 Jun 2005 EP
1780567 May 2007 EP
2523450 Nov 2012 EP
S59191146 Oct 1984 JP
04211230 Aug 1992 JP
H07318864 Dec 1995 JP
08271976 Oct 1996 JP
2002010276 Jan 2002 JP
2003298920 Oct 2003 JP
2003304024 Oct 2003 JP
2004056779 Feb 2004 JP
2004133054 Apr 2004 JP
2004245982 Sep 2004 JP
2005099265 Apr 2005 JP
2005122084 May 2005 JP
2005321592 Nov 2005 JP
2006237914 Sep 2006 JP
2006238325 Sep 2006 JP
2007228006 Sep 2007 JP
2007306282 Nov 2007 JP
2008076485 Apr 2008 JP
2008271026 Nov 2008 JP
2010204341 Sep 2010 JP
2011055246 Mar 2011 JP
2011085666 Apr 2011 JP
2011138407 Jul 2011 JP
2011203283 Oct 2011 JP
2012132739 Jul 2012 JP
2013101213 May 2013 JP
2013106289 May 2013 JP
2016105577 Jun 2016 JP
2017146440 Aug 2017 JP
20070005946 Jan 2007 KR
20090058229 Jun 2009 KR
20100008936 Jan 2010 KR
20110080590 Jul 2011 KR
20130104764 Sep 2013 KR
1020130135805 Nov 2013 KR
20140014787 Feb 2014 KR
101428042 Aug 2014 KR
101477178 Dec 2014 KR
20140144126 Dec 2014 KR
20140144126 Dec 2014 KR
20150118012 Oct 2015 KR
20170105236 Sep 2017 KR
20180120894 Nov 2018 KR
20130085116 Jun 2019 KR
2000027131 May 2000 WO
2004084542 Sep 2004 WO
2006008805 Jan 2006 WO
2010122841 Oct 2010 WO
2014072818 May 2014 WO
WO-2016207754 Dec 2016 WO
2017025822 Feb 2017 WO
2017037688 Mar 2017 WO
2018130898 Jul 2018 WO
Non-Patent Literature Citations (17)
Entry
Statistical Modeling and Performance Characterization of a Real-Time Dual Camera Surveillance System, Greienhagen et al., Publisher: IEEE, 2000, 8 pages.
A 3MPixel Multi-Aperture Image Sensor with 0.7μm Pixels in 0.11μm CMOS, Fife et al., Stanford University, 2008, 3 pages.
Dual camera intelligent sensor for high definition 360 degrees surveillance, Scotti et al., Publisher: IET, May 9, 2000, 8 pages.
Dual-sensor foveated imaging system, Hua et al., Publisher: Optical Society of America, Jan. 14, 2008, 11 pages.
Defocus Video Matting, McGuire et al., Publisher: ACM SIGGRAPH, Jul. 31, 2005, 11 pages.
Compact multi-aperture imaging with high angular resolution, Santacana et al., Publisher: Optical Society of America, 2015, 10 pages.
Multi-Aperture Photography, Green et al., Publisher: Mitsubishi Electric Research Laboratories, Inc., Jul. 2007, 10 pages.
Multispectral Bilateral Video Fusion, Bennett et al., Publisher: IEEE, May 2007, 10 pages.
Super-resolution imaging using a camera array, Santacana et al., Publisher: Optical Society of America, 2014, 6 pages.
Optical Splitting Trees for High-Precision Monocular Imaging, McGuire et al., Publisher: IEEE, 2007, 11 pages.
High Performance Imaging Using Large Camera Arrays, Wilburn et al., Publisher: Association for Computing Machinery, Inc., 2005, 12 pages.
Real-time Edge-Aware Image Processing with the Bilateral Grid, Chen et al., Publisher: ACM SIGGAPH, 2007, 9 pages.
Superimposed multi-resolution imaging, Carles et al., Publisher: Optical Society of America, 2017, 13 pages.
Viewfinder Alignment, Adams et al., Publisher: EUROGRAPHICS, 2008, 10 pages.
Dual-Camera System for Multi-Level Activity Recognition, Bodor et al., Publisher: IEEE, Oct. 2014, 6 pages.
Engineered to the task: Why camera-phone cameras are different, Giles Humpston, Publisher: Solid State Technology, Jun. 2009, 3 pages.
Office Action in related CN patent application 202210343497.1, dated Sep. 26, 2023.
Related Publications (1)
Number Date Country
20230280597 A1 Sep 2023 US
Provisional Applications (4)
Number Date Country
62677012 May 2018 US
62672754 May 2018 US
62658819 Apr 2018 US
62626306 Feb 2018 US
Continuations (2)
Number Date Country
Parent 17187810 Feb 2021 US
Child 18317992 US
Parent 16475267 US
Child 17187810 US