Folded camera structure with an extended light-folding-element scanning range

Information

  • Patent Grant
  • 11531209
  • Patent Number
    11,531,209
  • Date Filed
    Wednesday, December 6, 2017
    6 years ago
  • Date Issued
    Tuesday, December 20, 2022
    a year ago
Abstract
Voice coil motor (VCM) actuators for rotating an optical path folding element (OPFE) over an extended scanning range relative to a scanning/rotation range needed for optical image stabilization (OIS).
Description
FIELD

Embodiments disclosed herein relate in general to digital cameras and in particular to thin multi-aperture zoom digital cameras.


BACKGROUND

Personal electronic devices such as smartphones having two back cameras (also referred to as “dual-cameras” or “dual-aperture cameras”) are known and available commercially. The two back cameras have respective lenses with different fixed focal lengths and respective image sensors (or simply “sensors”) operated to capture image data (or “image”). Even though each lens/sensor combination is aligned to look in the same direction, each will capture an image of the same scene with a different field of view (FOV).


A Tele camera with adjustable FOVT for maximizing zooming capabilities is disclosed for example in commonly owned and invented PCT patent application PCT/IB2016/057366 titled “Dual-aperture zoom digital camera with automatic adjustable tele field of view”. The adjustable FOV involves scanning enabled by a step motor. Recently, step motors have been replaced by voice coil motor (VCM) technology. VCM actuation is used for autofocus (AF) and\or optical image stabilization (OIS). However, known VCM actuator technology, in particular as used in folded cameras, may have a limited scanning range and a given VCM actuator may perform only OIS, which requires motion compensation in a very limited range.


Systems that rotate an OPFE for OIS are described for example in co-assigned international patent application PCT/IB2016/052179, titled “Auto focus and optical image stabilization in a compact folded camera”.


Therefore, there is a need for, and it would be advantageous to have a VCM actuation mechanism for adjustable FOVT with extended scanning range. In addition, it would be advantageous to have a VCM actuation mechanism for adjustable FOVT with extended scanning range that can simultaneously support scanning in an extended range and OIS.


SUMMARY

Embodiments disclosed herein relate to VCM actuators for Tele folded cameras with adjustable FOVT, such as the camera described in PCT/IB2016/057366. The disclosed actuators are designed to maximize zooming and scanning capabilities. Some exemplary disclosed embodiments also allow OIS in parallel with image scanning.


In an exemplary embodiment, there is provided an actuator for rotating an OPFE over a scanning range in which OPFE position is controlled by a non-accurate position sensing mechanism that determines an allowable jitter limit, the actuator comprising: an actuated sub-assembly rigidly coupled to the OPFE and having two hinges that define a rotation axis, and a stationary sub-assembly having two housings, wherein each housing is nested in a respective hinge of the stationary sub-assembly to form a housing-hinge pair, wherein a center-of-mass of the actuated sub-assembly is positioned to coincide with the rotation axis to limit jitter arising from the OPFE being rotated to and stopped at a given OPFE position to be no larger than an allowable limit.


In an embodiment, each housing-hinge pair has a degree of friction designed to assist in limiting the jitter arising from the OPFE being rotated to and stopped at a given OPFE position to be no larger than the allowable limit.


In an embodiment, the stationary sub-assembly includes a position sensor for sensing the given OPFE position.


In an embodiment, the position sensor includes a Hall bar sensing element.


In an embodiment, the scanning range is larger than ±1.5 degrees around a rest position of the OPFE.


In an embodiment, the scanning range is at least ±5 degrees around the rest position of the OPFE.


In an embodiment, the scanning range is up to ±20 degrees around the rest position of the OPFE.





BRIEF DESCRIPTION OF THE DRAWINGS

Non-limiting examples of embodiments disclosed herein are described below with reference to figures attached hereto that are listed following this paragraph. Identical structures, elements or parts that appear in more than one figure are generally labeled with a same numeral in all the figures in which they appear. The drawings and descriptions are meant to illuminate and clarify embodiments disclosed herein, and should not be considered limiting in any way.



FIG. 1A shows an actuator capable of extended scan in an isomeric view according to an exemplary embodiment;



FIG. 1B shows the actuator of FIG. 1A in a backside view;



FIG. 1C shows the actuator of FIG. 1A in an exploded view;



FIG. 2 shows the actuator of FIGS. 1A-C in a folded camera with lens and sensor;



FIG. 3 shows the folded camera and actuator of FIG. 2 in a dual-camera;



FIG. 4 shows a simulation of the effect of a magnetic field in the X direction on a sensing element as function of actuated sub-assembly 116 and magnet 110) rotating around axis 104;



FIG. 5 shows schematically a sensing circuit for the actuator of FIGS. 1A-C;



FIG. 6A shows an actuator capable of extended scan+OIS in an isomeric view according to another exemplary embodiment;



FIG. 6B shows the actuator of FIG. 6 in an exploded view;



FIG. 7 shows the actuator of FIGS. 6A-C in a folded camera with lens and sensor;



FIG. 8 shows the folded camera and actuator of FIG. 7 in a dual-camera;



FIG. 9 shows schematically a sensing circuit for the actuator of FIGS. 6A-C.





DETAILED DESCRIPTION


FIGS. 1A-D illustrate in various views an actuator 100 of a rotational voice coil motor (VCM), according to an example of the presently disclosed subject matter. Actuator 100 enables an extended OPFE scanning range relative to the needs of other systems that rotate an OPFE for OIS (where the rotation is typically of ±1 degree, as e.g. the system described in co-assigned PCT patent application PCT/IB2016/052179) and enables as well adjustment of FOVT. FIG. 1A shows actuator 100 in an isometric view, FIG. 1B shows actuator 100 from a back view, and FIG. 1C shows actuator 100 in an exploded view. Actuator 100 enables rotation (in an angle referred to as “φ”) of an OPFE 102 (for example a prism or mirror) around a single axis 104 (i.e. around for example the X axis in the coordinate system shown and used in all figures), as described below. Axis 104 may also be referred to as “rotation axis”. In various embodiments, the extended range of φ may be for example in the range of 10 degrees to 40 degrees (or ±5 degrees to ±20 degrees around an initial “rest” position). In an exemplary embodiment, φ=20 degrees or ±10 degrees around the rest position In comparison, known designs in which the OPFE is rotated (tilted) for OIS purposes only enable a limited rotation range of 0.5 to 3 degrees or ±0.25 to ±1.5 degrees around the rest position.


In actuator 100, OPFE 102 is held in an optical element holder (or simply “holder”) 106, which may be made, for example by plastic molding, fit to the shape of OPFE 102. An actuation magnet 108 is fixedly attached (e.g. glued) to optical element holder 106 from below (negative Z direction in FIG. 1B). A sensing magnet 110 is fixedly attached (e.g. glued) to holder 106 on one side of the holder in a groove 112. Two hinges 114a and 114b are fixedly attached (e.g. glued) to holder 106 on two sides. Hinges 114a and 114b are made for example of a hard metal, e.g. stainless steel. The assembly of OPFE 102, optical element holder 106, actuation magnet 108, sensing magnet 110, and hinges 114a and 114b will be referred to henceforth as “actuated sub-assembly” 116.


Actuator 100 further includes a base 118, made for example of plastic, and two housings 120a and 120b also made for example of plastic, housings 120a and 120b fixedly attached (e.g. glued) to base 118. Is some embodiments, base 118 and either one or both of housings 120a and 120b may be molded as a single part. In some embodiments, housing 120a and\or housing 120b may include several parts which are assembled and e.g. glued only during the actuator assembly process. Base 118 and housings 120a and 120b form a “stationary sub-assembly” 122. Stationary sub-assembly 122 further includes a Hall bar sensing element 126 and a coil 124, both described below.


Actuated sub-assembly 116 is positioned inside stationary sub-assembly 122 such that hinges 114a and 114b are positioned inside housings 120a and 120b respectively. Hinges 114a and 114b are concentric and lie on axis 104 (parallel to the X axis in the figures). The mechanical structure described allows the rotation of actuated sub-assembly 116 and of OPFE 102 around axis 104. The plastic moldings of base 118 and/or optical element holder 106 may be used as a mechanical stopper for actuated sub-assembly 116 to prevent motion beyond φ degrees.


In some embodiments, axis 104 is positioned through the center-of-mass of actuated sub-assembly 116. The “mass” includes elements 102, 106, 108, 110, 114a and 114b. In such embodiments, an external rotation of actuator 100 (caused e.g. by a user rotating a device including the actuator) will not cause a relative rotation between actuated sub-assembly 116 and stationary sub-assembly 122.


Actuator 100 further includes a wound coil 124, for example of a stadium shape, typically with a few tens of windings (e.g. in a not limiting range of 50-250) and with a typical resistance of 10-30 ohm. Coil 124 is located below magnet 108 such that nominally their centers overlap when the actuated sub-assembly is at rest. Magnet 108 can be for example a permanent magnet, made from a neodymium alloy (e.g. Nd2Fe14B) or a samarium-cobalt alloy (e.g. SmCo5). Magnet 108 can be fabricated (e.g. sintered) such that it changes the magnetic poles direction: on the positive Y side, the North magnetic pole faces the negative Z direction, while on the negative Y side, the North magnetic pole faces the positive Z direction. Coil 124 is connected to external current driving circuit (not shown), the driving circuit capable of sending input currents to coil 124. Current in coil 124 creates a Lorentz force due to the magnetic field of magnet 108: for example, a current in a clockwise direction will create a force in the positive Y direction, while a current in counterclockwise direction will create a force in the negative Y direction. The full magnetic scheme (i.e. the full magnetic simulation of the magnetic field caused by magnet 108) is known in the art, and described, for example, in detail in patent application PCT/IB2016/052179.


When the magnetic force applied by coil 124 is in the positive and negative Y directions, the hinge mechanical structure confines actuated sub-assembly 116 to rotate around axis 104. A Hall bar element 126 can sense the intensity and direction of the magnetic field of sensing magnet 110. Sensing magnet 110 can be for example a permanent magnet, made from a neodymium alloy (e.g. Nd2Fe14B) or a samarium-cobalt alloy (e.g. SmCo5). Magnet 110 can be fabricated (e.g. sintered), such that its North pole is to the Z direction when actuator 100 is at rest. Upon actuation, the relative position of actuated sub-assembly 116 and Hall bar element 126 is changed. The intensity and direction of the magnetic field senses by Hall bar element 126 changes as well, and thus the position of actuated sub-assembly 116 can be determined. A closed loop control circuit (not shown) is used to control the position of the actuated sub-assembly and set to the position required by optical demands. The closed loop control circuit has a single input—the signal of Hall bar element 126, and a single output—the amount of current applied in coil 124. The closed loop control circuit may be implemented in an integrated circuit (IC) (not shown). Operation of a closed loop control system with single input and single output (SISO) system is known in the art. Such a closed loop control circuit may, for example, be a linear “proportional-integral-differential” (PID) control. In some embodiments, the single IC may be implemented in a controller inside Hall bar element 126. In other embodiments, the IC may be a separate chip, which can be located externally to the camera.


The step resolution and jitter (noise) of actuator 100, as described below, may be limited by a “non-accurate” sensing mechanism circuitry to 1/1000 of φ. For usage requirements, a 1/80 of φ step resolution may be acceptable, as described in PCT patent application PCT/IB2016/057366. However, after actuator 100 has positioned the OPFE in a specific position, considerations of prevention of image blur require a jitter of no more than 1/200 degree. In system 100 and for example, 1/200 degree is equal to 1/4000 of φ, which is smaller than the 1/1000 φ jitter limit allowed by the sensing circuitry. To address this problem, a friction-based mechanism is provided to limit jitter to a level that does not exceed the allowable limit ( 1/200 degree, which in the example is 1/4000 of φ). For example, in some cases, significant friction may be designed and introduced between hinges 114a and 114b and housings 120a and 120b. After a control command moves (through a driving current, see below) actuated sub-assembly 116 to a desired position, as required by optical demands and as sensed by a sensing mechanism described below, the driving current may be turned off to reduce jitter caused by a non-accurate sensing mechanism. The significant friction and the positioning of axis 104 through the center-of-mass of actuated sub-assembly 116 will ensure that external torques and forces (caused for example by user hand shake) will maintain actuated sub-assembly 116 fixed relative to stationary sub-assembly 122. The power turn-off also helps reduce the system power consumption.


For example, assume actuated sub-assembly with a mass of 500 mg and a moment of inertia around axis 104 of 1000 mg-mm2. Assume a friction coefficient of 0.7 between stainless steel hinges 114a-b and plastic housings 120a-b. Axis 104 with a diameter of 0.7 mm is nominally designed to pass through the center-of-mass of actuated sub-assembly 106. However due to mechanical tolerances during assembly, axis 104 may shift by up to 20 micrometers (μm), which will cause a gravity torque of up to 0.0001 N-mm. Typical handshakes are up to 2 Hz and 0.1 degrees, causing angular accelerations of up to 0.3 rad/sec2, and moment of inertia-provided torques are typically limited to 0.0003 N-mm. Thus, both gravity and handshake torques will not overcome a friction torque (mass×friction coefficient×hinge radius) of 0.001225 N-mm after current turn off.



FIG. 2 shows actuator 100 as part of folded camera structure (FCS) or simply “folded camera” 200. In folded camera 200, actuator 100 is used to rotate OPFE (e.g. prism) 102. The operation (actuation) of actuator 100 in folded camera 200 creates an extended tele field of view (FOVT), of the type described for example in U.S. provisional patent applications 62/272,367 and 62/361,150. A typical rotational actuation stroke of actuator 100 in this case may be in the range of ±5 to ±20 degrees of the original position of OPFE 102, with resolution of at least 8 and up to 100 distinguishable steps (possible OPFE positions). Camera 200 further includes a lens element 202, and an image sensor 204. Camera 200 may further include an actuation mechanism for focusing and\or auto-focus (AF) of lens element 202. This actuation mechanism is not shown in FIG. 2, but may be for example as described in U.S. Pat. No. 9,392,188.



FIG. 3 shows folded camera 200 a part of a dual-camera (or “dual-aperture camera”) 300. Dual-camera 300 also includes a standard “upright” camera 302. Camera 302 has a standard camera structure, known in the art, and includes a lens 304 and an image sensor 306. Camera 302 may also include other parts such as actuation mechanism for the lens, a mechanical shield, a chassis and other parts, all known in the art and not shown in FIG. 3. Dual-aperture cameras such as camera 300 and their operation and use are described in detail in, for example, international patent application PCT/IB2016/056060.


Magnetic sensing element 126 is for example (as mentioned above) a Hall bar element, capable of measuring magnetic field in the X direction indicated in FIG. 1. In actuator 100, magnet 110 is rigidly coupled to (or is part of) actuated sub-assembly 116, while sensing element 126 is rigidly coupled to (or is part of) stationary sub-assembly 122. Magnet 110 has for example a magnetic field direction along the Z axis, such that the North magnetic pole is on the positive Z direction and the South magnetic pole is in the negative Z direction.



FIG. 4 shows a simulation of the effect of the magnetic field in the X direction on sensing element 126 as function of actuated sub-assembly 116 (and magnet 110) rotating around axis 104. It is apparent that the magnetic field changes monotonically from a negative value of about −0.2 T at one end of the movement range to +0.2 T at the other end of the movement (rotation) range.



FIG. 5 shows a known art electrical circuit 500 which allows reading of the magnetic field by a Hall bar element 126. Hall bar element 126 has 4 connectors marked as Iin, Gnd, V+ and V−. A current typically in the range of 1-20 mA is driven in Iin and flows through Hall bar element 126 to the ground (GND). Hall bar element 126 has a typical resistance in the range of 200-3000 kΩ. In this example, consider a sensing element with resistance 1200 ohm and current Iin=2.5 mA, such that the voltage drop between Iin and Gnd is 3V and is marked as Vin=3V. For the case of 0 (zero) magnetic field B in the X direction Vp=Vm=Vin/2=1.5V. If a magnetic field exists in Hall bar element 126, a voltage drop will be created between Vp and Vm, marked as Vout=Vp−Vm, such that Vp=(Vin+Vout)/2 and Vm=(Vin−Vout)/2. The size of Vout is proportional to the magnetic field B on the sensing element, i.e. Vout=αB. For a constant current Iin=2.5 mA, α has a typical value in the range of 0.2-2 mV/mT. In this example, consider α=0.5 mV/mT, such that for the graph seen in FIG. 4B, Vout is in the range of −100 mV to 100 mV in the movement range.


Amplifier 502 is an operational amplifier (op-amp) with a 3V driving voltage. The details of operation of op-amp 502 are known in the art and described here briefly. Op-amp 502 has an amplification factor β in the range of 5-200. In this example, assume an amplification factor of β=15. The inputs of op-amp 502 are Vp and Vm. The output of op-amp 502 is Vp+β(Vp−Vm). Hence, the voltage output of op-amp 502 (Vamp) in this example is in the range of 0-3V. Vamp is sampled by an analog-to-digital converter (ADC) 504, with resolution in the range of 8-14 bits, in this example 12 bits. Namely, the range 0 to 3V is divided to 4096 levels. Thus, circuit 500 allows the measurement of the motion range of actuator 100 with 12 bit maximal resolution (or 8-16 bits in other cases). For a 20 degree scanning range, this allows approximately 0.005 degree resolution. This resolution is worse than required.



FIG. 6A illustrates in an isomeric view, and FIG. 6B illustrates in an exploded view an actuator 600 of a rotational VCM according to another exemplary embodiment disclosed herein. Actuator 600 allows an extended OPFE scanning range plus OIS abilities. Compared to actuator 100, actuator 600 has an accurate position sensing mechanism that allows accuracy of 1/200 degrees, as described below. Thus, the control circuitry of actuator 600 can remain operative while the OPFE is rotated to a desired portion without reducing image optical quality.


Actuator 600 is similar mechanically to actuator 100 and includes all elements as actuator 100 (which consequently are numbered with identical numbers). The difference between actuator 600 and actuator 100 is that actuator 600 further includes two ball bearings 602a and 602b, typically made of stainless steel. Ball bearings 602a and 602b are fixedly attached (e.g. glued) inside housings 120a and 120b respectively. Actuated sub-assembly 116 is positioned inside stationary sub-assembly 122 such that hinges 114a and 114b are positioned inside ball bearings 602a and 602b respectively. Hinges 114a and 114b and bearings 602a and 602b are all concentric and lie on axis 104. The mechanical structure described allows the rotation of actuated sub-assembly 116 and light-folding-element 102 around the X axis with very low friction. A typical low friction coefficient of ball bearing 602a and 602b may be in the range of 0.001-0.005.



FIG. 7 shows actuator 600 as part of a folded camera 700. In folded camera 700, actuator 600 is used to rotate a light folding element as described above with reference to camera 200. The actuation creates an extended zoom field of view (FOV) as mentioned above and in addition provides OIS as described for example in PCT/IB2016/052179. As also indicated above, the typical rotational actuation stroke of actuator 600 should be in the range of ±8 to ±18 degrees of the original position of the light folding element, with resolution of at least 0.002 degrees. Camera 700 may further include elements described with reference to camera 200 above.



FIG. 8 shows camera 700 a part of a dual-camera 800. The description and use of dual-camera 800 are similar to those in camera 300 and are therefore not repeated.


In actuator 600, the actuation mechanism is responsible for both an extended scanning range and OIS. Thus, a higher scanning resolution is required, relative to that in actuator 100. FIG. 9 shows an electrical circuit 900 which allows reading of the magnetic field by Hall bar sensing element 126 for the extended scanning, according to an exemplary embodiment disclosed herein. Circuit 900 extends circuit 500 by including, in addition to the elements of circuit 500, a digital-to-analog converter (DAC) 902 with resolution in the range of 8-14 bits, and in this example 12 bits. Namely, the range 0 to 3V is divided to 4096 levels, or less than 1 mV. DAC 902 provides a reference voltage for a second amplification step, as explained next. The analog output of DAC 902 is marked as Vdac. Circuit 900 further includes op-amp 904, operating under voltage of 3V and amplification γ in the range of 100-4000. Exemplary, op-amp 904 demonstrates amplification of γ=500. The inputs of op-amp 904 are Vamp and Vdac. The output of op-amp 904 is Vdac+γ (Vdac−Vamp). Vdac is set in the following manner: the tilt (rotation) target of actuator 600 is known (decided by the user). The target range φ is divided into S steps, S is an integer, S>γ, in this example S=3000 (0.2 degrees in this example). For a given tilt target, a value “s” marks the closest integer step in the range. For example, if the target is −5 degrees than s=750. The DAC output is set to Vin/2−Vrange/2+Vrange*s/S. This setting of DAC output can assure that when the position of the actuator is closer to the target than (p/S the output of op-amp 502, Vamp2 is in the range of 0-3V. Vamp2 is sampled by an ADC 906, with resolution in the range of 8-14 bits, and in this example 12 bits. Namely, the range 0 to 3V is divided to 4096 levels. Thus, circuit 900 allows the measurement of the motion range of actuator 100 with γ times precision more than circuit 500. For 20 degrees scanning range, with γ=500, this allows approximately 0.00001 degree (10 micro-degree) resolution.


All publications, patents and patent applications mentioned in this specification are herein incorporated in their entirety by reference into the specification, to the same extent as if each individual publication, patent or patent application was specifically and individually indicated to be incorporated herein by reference. In addition, citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the present disclosure.


While this disclosure has been described in terms of certain embodiments and generally associated methods, alterations and permutations of the embodiments and methods will be apparent to those skilled in the art. The disclosure is to be understood as not limited by the specific embodiments described herein, but only by the scope of the appended claims.

Claims
  • 1. An actuator for rotating an optical path folding element (OPFE) over a scanning range in which an OPFE position is controlled by a position sensing mechanism with a resolution that exceeds an allowable jitter limit, the actuator comprising: a) an actuated sub-assembly rigidly coupled to the OPFE and having two hinges that define a rotation axis; andb) a stationary sub-assembly having two housings, wherein each hinge is nested in a respective housing of the stationary sub-assembly to form a housing-hinge pair, wherein a center-of-mass of the actuated sub-assembly is positioned to coincide with the rotation axis and wherein each housing-hinge pair has a degree of friction designed such that a passive friction torque is greater than gravity or handshake torques to limit jitter arising from the OPFE being rotated to and stopped at a given OPFE position to be no larger than the allowable jitter limit,and wherein the actuator enables rotation of the OPFE around a single axis.
  • 2. The actuator of claim 1, wherein the stationary sub-assembly includes a position sensor for sensing the given OPFE position.
  • 3. The actuator of claim 2, wherein the position sensor includes a Hall bar sensing element.
  • 4. The actuator of claim 1, wherein the scanning range is larger than ±1.5 degrees around a rest position of the OPFE.
  • 5. The actuator of claim 4, wherein the scanning range is at least ±5 degrees around the rest position of the OPFE.
  • 6. The actuator of claim 4, wherein the scanning range is up to ±20 degrees around the rest position of the OPFE.
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a 371 of international application PCT/IB2017/057706 filed Dec. 6, 2017, and is related to and claims priority from U.S. Provisional Patent Application No. 62/439,518 filed Dec. 28, 2016, which is incorporated herein by reference in its entirety.

PCT Information
Filing Document Filing Date Country Kind
PCT/IB2017/057706 12/6/2017 WO
Publishing Document Publishing Date Country Kind
WO2018/122650 7/5/2018 WO A
US Referenced Citations (294)
Number Name Date Kind
4199785 McCullough et al. Apr 1980 A
5005083 Grage et al. Apr 1991 A
5032917 Aschwanden Jul 1991 A
5041852 Misawa et al. Aug 1991 A
5051830 von Hoessle Sep 1991 A
5099263 Matsumoto et al. Mar 1992 A
5248971 Mandl Sep 1993 A
5287093 Amano et al. Feb 1994 A
5436660 Sakamoto Jul 1995 A
5444478 Lelong et al. Aug 1995 A
5459520 Sasaki Oct 1995 A
5657402 Bender et al. Aug 1997 A
5682198 Katayama et al. Oct 1997 A
5717512 Chmielewski, Jr. Feb 1998 A
5758203 Konno May 1998 A
5768443 Michael et al. Jun 1998 A
5805325 Clune Sep 1998 A
5926190 Turkowski et al. Jul 1999 A
5940641 McIntyre et al. Aug 1999 A
5982951 Katayama et al. Nov 1999 A
6101334 Fantone Aug 2000 A
6128416 Oura Oct 2000 A
6148120 Sussman Nov 2000 A
6208765 Bergen Mar 2001 B1
6268611 Pettersson et al. Jul 2001 B1
6549215 Jouppi Apr 2003 B2
6611289 Yu et al. Aug 2003 B1
6643416 Daniels et al. Nov 2003 B1
6650368 Doron Nov 2003 B1
6680748 Monti Jan 2004 B1
6714665 Hanna et al. Mar 2004 B1
6724421 Glatt Apr 2004 B1
6738073 Park et al. May 2004 B2
6741250 Furlan et al. May 2004 B1
6750903 Miyatake et al. Jun 2004 B1
6778207 Lee et al. Aug 2004 B1
7002583 Rabb, III Feb 2006 B2
7015954 Foote et al. Mar 2006 B1
7038716 Klein et al. May 2006 B2
7199348 Olsen et al. Apr 2007 B2
7206136 Labaziewicz et al. Apr 2007 B2
7248294 Slatter Jul 2007 B2
7256944 Labaziewicz et al. Aug 2007 B2
7305180 Labaziewicz et al. Dec 2007 B2
7339621 Fortier Mar 2008 B2
7346217 Gold, Jr. Mar 2008 B1
7365793 Cheatle et al. Apr 2008 B2
7411610 Doyle Aug 2008 B2
7424218 Baudisch et al. Sep 2008 B2
7509041 Hosono Mar 2009 B2
7533819 Barkan et al. May 2009 B2
7619683 Davis Nov 2009 B2
7738016 Toyofuku Jun 2010 B2
7773121 Huntsberger et al. Aug 2010 B1
7809256 Kuroda et al. Oct 2010 B2
7880776 LeGall et al. Feb 2011 B2
7918398 Li et al. Apr 2011 B2
7964835 Olsen et al. Jun 2011 B2
7978239 Deever et al. Jul 2011 B2
8115825 Culbert et al. Feb 2012 B2
8149327 Lin et al. Apr 2012 B2
8154610 Jo et al. Apr 2012 B2
8238695 Davey et al. Aug 2012 B1
8274552 Dahi et al. Sep 2012 B2
8390729 Long et al. Mar 2013 B2
8391697 Cho et al. Mar 2013 B2
8400555 Georgiev et al. Mar 2013 B1
8439265 Ferren et al. May 2013 B2
8446484 Muukki et al. May 2013 B2
8483452 Ueda et al. Jul 2013 B2
8514491 Duparre Aug 2013 B2
8547389 Hoppe et al. Oct 2013 B2
8553106 Scarff Oct 2013 B2
8587691 Takane Nov 2013 B2
8619148 Watts et al. Dec 2013 B1
8752969 Kane et al. Jun 2014 B1
8803990 Smith Aug 2014 B2
8896655 Mauchly Nov 2014 B2
8976255 Matsuoto et al. Mar 2015 B2
9019387 Nakano Apr 2015 B2
9025073 Attar et al. May 2015 B2
9025077 Attar et al. May 2015 B2
9041835 Honda May 2015 B2
9137447 Shibuno Sep 2015 B2
9185291 Shabtay et al. Nov 2015 B1
9215377 Sokeila et al. Dec 2015 B2
9215385 Luo Dec 2015 B2
9270875 Brisedoux et al. Feb 2016 B2
9286680 Jiang et al. Mar 2016 B1
9344626 Silverstein et al. May 2016 B2
9360671 Zhou Jun 2016 B1
9369621 Malone et al. Jun 2016 B2
9413930 Geerds Aug 2016 B2
9413984 Attar et al. Aug 2016 B2
9420180 Jin Aug 2016 B2
9438792 Nakada et al. Sep 2016 B2
9485432 Medasani et al. Nov 2016 B1
9578257 Attar et al. Feb 2017 B2
9618748 Munger et al. Apr 2017 B2
9681057 Attar et al. Jun 2017 B2
9723220 Sugie Aug 2017 B2
9736365 Laroia Aug 2017 B2
9736391 Du et al. Aug 2017 B2
9768310 Ahn et al. Sep 2017 B2
9800798 Ravirala et al. Oct 2017 B2
9851803 Fisher et al. Dec 2017 B2
9894287 Qian et al. Feb 2018 B2
9900522 Lu Feb 2018 B2
9927600 Goldenberg et al. Mar 2018 B2
20020005902 Yuen Jan 2002 A1
20020030163 Zhang Mar 2002 A1
20020063711 Park et al. May 2002 A1
20020075258 Park et al. Jun 2002 A1
20020122113 Foote Sep 2002 A1
20020167741 Koiwai et al. Nov 2002 A1
20030030729 Prentice et al. Feb 2003 A1
20030093805 Gin May 2003 A1
20030160886 Misawa et al. Aug 2003 A1
20030202113 Yoshikawa Oct 2003 A1
20040008773 Itokawa Jan 2004 A1
20040012683 Yamasaki et al. Jan 2004 A1
20040017386 Liu et al. Jan 2004 A1
20040027367 Pilu Feb 2004 A1
20040061788 Bateman Apr 2004 A1
20040141065 Hara et al. Jul 2004 A1
20040141086 Mihara Jul 2004 A1
20040240052 Minefuji et al. Dec 2004 A1
20050013509 Samadani Jan 2005 A1
20050046740 Davis Mar 2005 A1
20050157184 Nakanishi et al. Jul 2005 A1
20050168834 Matsumoto et al. Aug 2005 A1
20050185049 Iwai et al. Aug 2005 A1
20050200718 Lee Sep 2005 A1
20060054782 Olsen et al. Mar 2006 A1
20060056056 Ahiska et al. Mar 2006 A1
20060067672 Washisu et al. Mar 2006 A1
20060102907 Lee et al. May 2006 A1
20060125937 LeGall et al. Jun 2006 A1
20060170793 Pasquarette et al. Aug 2006 A1
20060175549 Miller et al. Aug 2006 A1
20060187310 Janson et al. Aug 2006 A1
20060187322 Janson et al. Aug 2006 A1
20060187338 May et al. Aug 2006 A1
20060227236 Pak Oct 2006 A1
20060268431 Jin Nov 2006 A1
20070024737 Nakamura et al. Feb 2007 A1
20070126911 Nanjo Jun 2007 A1
20070177025 Kopet et al. Aug 2007 A1
20070188653 Pollock et al. Aug 2007 A1
20070189386 Imagawa et al. Aug 2007 A1
20070257184 Olsen et al. Nov 2007 A1
20070285550 Son Dec 2007 A1
20080017557 Witdouck Jan 2008 A1
20080024614 Li et al. Jan 2008 A1
20080025634 Border et al. Jan 2008 A1
20080030592 Border et al. Feb 2008 A1
20080030611 Jenkins Feb 2008 A1
20080084484 Ochi et al. Apr 2008 A1
20080106629 Kurtz et al. May 2008 A1
20080117316 Orimoto May 2008 A1
20080129831 Cho et al. Jun 2008 A1
20080218611 Parulski et al. Sep 2008 A1
20080218612 Border et al. Sep 2008 A1
20080218613 Janson et al. Sep 2008 A1
20080219654 Border et al. Sep 2008 A1
20090086074 Li et al. Apr 2009 A1
20090109556 Shimizu et al. Apr 2009 A1
20090122195 Van Baar et al. May 2009 A1
20090122406 Rouvinen et al. May 2009 A1
20090128644 Camp et al. May 2009 A1
20090168135 Yu et al. Jul 2009 A1
20090219547 Kauhanen et al. Sep 2009 A1
20090252484 Hasuda et al. Oct 2009 A1
20090295949 Ojala Dec 2009 A1
20090324135 Kondo et al. Dec 2009 A1
20100013906 Border et al. Jan 2010 A1
20100020221 Tupman et al. Jan 2010 A1
20100060746 Olsen et al. Mar 2010 A9
20100097444 Lablans Apr 2010 A1
20100103194 Chen et al. Apr 2010 A1
20100165131 Makimoto et al. Jul 2010 A1
20100196001 Ryynänen et al. Aug 2010 A1
20100238327 Griffith et al. Sep 2010 A1
20100259836 Kang et al. Oct 2010 A1
20100283842 Guissin et al. Nov 2010 A1
20100321494 Peterson et al. Dec 2010 A1
20110058320 Kim et al. Mar 2011 A1
20110063417 Peters et al. Mar 2011 A1
20110063446 McMordie et al. Mar 2011 A1
20110064327 Dagher et al. Mar 2011 A1
20110080487 Venkataraman et al. Apr 2011 A1
20110128288 Petrou et al. Jun 2011 A1
20110164172 Shintani et al. Jul 2011 A1
20110229054 Weston et al. Sep 2011 A1
20110234798 Chou Sep 2011 A1
20110234853 Hayashi et al. Sep 2011 A1
20110234881 Wakabayashi et al. Sep 2011 A1
20110242286 Pace et al. Oct 2011 A1
20110242355 Goma et al. Oct 2011 A1
20110298966 Kirschstein et al. Dec 2011 A1
20120026366 Golan et al. Feb 2012 A1
20120044372 Cote et al. Feb 2012 A1
20120062780 Morihisa Mar 2012 A1
20120069235 Imai Mar 2012 A1
20120075489 Nishihara Mar 2012 A1
20120105579 Jeon et al. May 2012 A1
20120124525 Kang May 2012 A1
20120154547 Aizawa Jun 2012 A1
20120154614 Moriya et al. Jun 2012 A1
20120196648 Havens et al. Aug 2012 A1
20120229663 Nelson et al. Sep 2012 A1
20120249815 Bohn et al. Oct 2012 A1
20120287315 Huang et al. Nov 2012 A1
20120320467 Baik et al. Dec 2012 A1
20130002928 Imai Jan 2013 A1
20130016427 Sugawara Jan 2013 A1
20130063629 Webster et al. Mar 2013 A1
20130076922 Shihoh et al. Mar 2013 A1
20130093842 Yahata Apr 2013 A1
20130094126 Rappoport et al. Apr 2013 A1
20130113894 Mirlay May 2013 A1
20130135445 Dahi et al. May 2013 A1
20130155176 Paripally et al. Jun 2013 A1
20130182150 Asakura Jul 2013 A1
20130201360 Song Aug 2013 A1
20130202273 Ouedraogo et al. Aug 2013 A1
20130235224 Park et al. Sep 2013 A1
20130250150 Malone et al. Sep 2013 A1
20130258044 Betts-LaCroix Oct 2013 A1
20130270419 Singh et al. Oct 2013 A1
20130278785 Nomura et al. Oct 2013 A1
20130321668 Kamath Dec 2013 A1
20140009631 Topliss Jan 2014 A1
20140049615 Uwagawa Feb 2014 A1
20140118584 Lee et al. May 2014 A1
20140192238 Attar et al. Jul 2014 A1
20140192253 Laroia Jul 2014 A1
20140218587 Shah Aug 2014 A1
20140313316 Olsson et al. Oct 2014 A1
20140362242 Takizawa Dec 2014 A1
20150002683 Hu et al. Jan 2015 A1
20150042870 Chan et al. Feb 2015 A1
20150070781 Cheng et al. Mar 2015 A1
20150092066 Geiss et al. Apr 2015 A1
20150103147 Ho et al. Apr 2015 A1
20150138381 Ahn May 2015 A1
20150154776 Zhang et al. Jun 2015 A1
20150162048 Hirata et al. Jun 2015 A1
20150195458 Nakayama et al. Jul 2015 A1
20150215516 Dolgin Jul 2015 A1
20150237280 Choi et al. Aug 2015 A1
20150242994 Shen Aug 2015 A1
20150244906 Wu et al. Aug 2015 A1
20150253543 Mercado Sep 2015 A1
20150253647 Mercado Sep 2015 A1
20150261299 Wajs Sep 2015 A1
20150271471 Hsieh et al. Sep 2015 A1
20150281678 Park et al. Oct 2015 A1
20150286033 Osborne Oct 2015 A1
20150316744 Chen Nov 2015 A1
20150334309 Peng et al. Nov 2015 A1
20160044250 Shabtay et al. Feb 2016 A1
20160070088 Koguchi Mar 2016 A1
20160154202 Wippermann et al. Jun 2016 A1
20160154204 Lim et al. Jun 2016 A1
20160212358 Shikata Jul 2016 A1
20160212418 Demirdjian et al. Jul 2016 A1
20160238834 Erlich et al. Aug 2016 A1
20160241751 Park Aug 2016 A1
20160291295 Shabtay et al. Oct 2016 A1
20160295112 Georgiev et al. Oct 2016 A1
20160301840 Du et al. Oct 2016 A1
20160353008 Osborne Dec 2016 A1
20160353012 Kao et al. Dec 2016 A1
20170019616 Zhu et al. Jan 2017 A1
20170070731 Darling et al. Mar 2017 A1
20170078535 Akiyama Mar 2017 A1
20170187962 Lee et al. Jun 2017 A1
20170214846 Du et al. Jul 2017 A1
20170214866 Zhu et al. Jul 2017 A1
20170242225 Fiske Aug 2017 A1
20170289458 Song et al. Oct 2017 A1
20180013944 Evans, V et al. Jan 2018 A1
20180017844 Yu et al. Jan 2018 A1
20180024329 Goldenberg Jan 2018 A1
20180059379 Chou Mar 2018 A1
20180120674 Avivi et al. May 2018 A1
20180150973 Tang et al. May 2018 A1
20180176426 Wei et al. Jun 2018 A1
20180198897 Tang et al. Jul 2018 A1
20180241922 Baldwin et al. Aug 2018 A1
20180295292 Lee et al. Oct 2018 A1
20180300901 Wakai et al. Oct 2018 A1
20190121103 Bachar et al. Apr 2019 A1
Foreign Referenced Citations (4)
Number Date Country
1780567 May 2007 EP
2004245982 Sep 2004 JP
2011085666 Apr 2011 JP
2010122841 Oct 2010 WO
Non-Patent Literature Citations (4)
Entry
Office Action in related Chinese patent application No. 201780081406.9, dated Nov. 19, 2020.
Statistical Modeling and Performance Characterization of a Real-Time Dual Camera Surveillance System, Greienhagen et al., Publisher: IEEE, 2000, 8 pages.
Super-resolution imaging using a camera array, Santacana et al., Publisher: Optical Society of America, 2014, 6 pages.
Real-time Edge-Aware Image Processing with the Bilateral Grid, Chen et al., Publisher: ACM SIGGRAPH, 9 pages.
Related Publications (1)
Number Date Country
20210208415 A1 Jul 2021 US
Provisional Applications (1)
Number Date Country
62439518 Dec 2016 US