Embodiments disclosed herein relate in general to cameras and in particular to cameras based on digital cameras with folded optics.
Compact digital cameras having folded optics, also referred to as “folded cameras” or “folded camera modules”, are known, see e.g. Applicant's co-owned international patent application PCT/IB2016/052179. Such folded cameras include a lens, an optical path folding element (OPFE)—normally a prism or mirror—and an image sensor. The OPFE folds a first optical path along a first axis from an object or scene to the OPFE, into a second optical path along a second axis substantially orthogonal to the first axis, the second axis being also an optical axis of the lens and of the folded camera. Some OPFEs are designed to tilt or rotate around the first axis or around a third axis orthogonal to both the first and second axes. There is no known folded camera in which the OPFE is known to rotate around the optical axis of the lens. There are also no known cameras based on folded digital cameras that are capable of 180 degrees or more panoramic scanning.
In various exemplary embodiments there are provided cameras based on folded digital cameras having a panoramic scanning range. In some embodiments, one or more cameras with panoramic scanning range as described in more detail below may be incorporated in a platform. As used herein, the term “platform” refers to an article of manufacture (also referred to as “system”). The platform may be a mobile device such as a smartphone or a tablet computer (or simply “tablet”), a flying drone, a television (TV) set or display, a personal electronic device (PED), a vehicular system (vehicle), etc. Each of the cameras with panoramic scanning range may provide panoramic views with up to 180 degrees or even up to 360 degrees. When incorporated in a smartphone or tablet, a folded camera with panoramic scanning range may be positioned at an edge of the smartphone or tablet and can be used as either a front camera or as a back camera of the smartphone or tablet.
In some embodiments, a camera with panoramic scanning range as above may be incorporated together with a non-folded camera in a dual-aperture (dual-camera) arrangement. The dual-aperture arrangement may be included in a mobile device such as a smartphone or a tablet, a flying drone, a television set, other PEDs and/or other devices/systems such as vehicular systems.
In exemplary embodiments, there are provided cameras comprising a folded digital camera that includes an image sensor having an image sensor area, a lens having a lens optical axis, and an OPFE that folds a first optical path from an object or scene to a second optical path, the second optical path being substantially parallel with the lens optical axis, the OPFE being rotatable around the lens optical axis relative to the image sensor. In some embodiments, the OPFE may be a prism. In other embodiments, the OPFE may be a mirror.
In an exemplary embodiment, the OPFE is rotatable in an angle of up to 180 degrees.
In an exemplary embodiment, the OPFE is rotatable in an angle of up to 360 degrees.
In an exemplary embodiment, the rotation of the OPFE around the lens optical axis provides a plurality of different images.
In an exemplary embodiment, the plurality of different images represents at least a section of a panoramic view.
In an exemplary embodiment, the lens has a lens image circle bound by the image sensor area.
In an exemplary embodiment, the OPFE has a plurality of positions and the camera has a field of view (FOV) bound by the lens image circle for each OPFE position.
In an exemplary embodiment, a camera is operative to record a video stream with a changing or adaptive field of view.
In some exemplary embodiments, a camera further comprises an actuator for rotating the OPFE around the lens optical axis. The actuator may be a step motor or a voice coil motor.
In some exemplary embodiments, the lens is a folded lens.
In some exemplary embodiments, the lens is fixedly attached to the OPFE and is rotatable together with the OPFE around the lens optical axis relative to the image sensor.
In some exemplary embodiments, the folded lens is fixedly attached to the OPFE and is rotatable together with the OPFE around the lens optical axis relative to the image sensor.
In exemplary embodiments there are provided platforms, comprising: a first folded digital camera with a first field of view (FOV), the first folded digital camera including a first lens having a first lens optical axis, a first image sensor and a first OPFE that folds a first optical path from an object or scene to a second optical path, the second optical path being substantially parallel with the lens optical axis, the first OPFE being rotatable around the first lens optical axis relative to the first image sensor.
In some exemplary embodiments, a platform further comprises a second folded digital camera with a second FOV larger than the first FOV. In some exemplary embodiments, the first folded digital camera is operational to change the first FOV autonomously.
In some exemplary embodiments, a platform further comprises a second folded digital camera that includes a second lens having a second lens optical axis and a second OPFE that folds the first optical path from an object or scene to the second optical path, the second OPFE being rotatable around the second lens optical axis. In an exemplary embodiment of such a platform, the first and second lens optical axes are parallel.
In some exemplary embodiments, the platform is a mobile device. In some such embodiments, the first folded digital camera is positioned on a side close to a mobile device edge and the first folded camera is operative to acquire a panoramic view of approximately 180 degrees. In some such embodiments, the first folded camera is operable as a front camera of the mobile device. In some such embodiments, the first folded camera is operable as a back camera of the mobile device. In some exemplary embodiments, the mobile device is a smartphone or a tablet.
In some exemplary embodiments, the platform is a mobile device, the first and second folded digital cameras are positioned on opposite sides close to respective mobile device edges, and each of the first and second folded cameras is operative to acquire a panoramic view of approximately 180 degrees. In some such embodiments, each of the first and second folded cameras is operable as a front camera or a back camera of the mobile device. In some such embodiments, each of the first and second folded cameras is operable as a back camera of the mobile device.
In some exemplary embodiments, the lens is fixedly attached to the OPFE and is rotatable together with the OPFE around the lens optical axis relative to the image sensor. In some exemplary embodiments, the lens is a folded lens.
In some exemplary embodiments, the platform is a flying drone. In some flying drone embodiments, at least one OPFE is operational to rotate at least 180 degrees.
In some exemplary embodiments, the platform is a television set.
In some exemplary embodiments, the platform is a personal electronic device.
In some exemplary embodiments, the platform is a vehicular system.
In some exemplary embodiments, there are provided methods comprising: providing a folded digital camera that includes an image sensor, a lens having a lens optical axis, and an OPFE that folds a first optical path from an object or scene to a second optical path, the second optical path being substantially parallel with the lens optical axis, the camera having an original orientation; rotating the OPFE around the lens optical axis relative to the image sensor in a first rotation direction to set the first optical path in a desired first direction; and taking an image.
In an exemplary method embodiment, a method further comprises digitally rotating the taken image back to the original orientation.
In some exemplary method embodiments, the rotating the OPFE around the lens optical axis in a first rotation direction to set the first optical path in a desired first direction includes rotating the OPFE to set the first optical path in a plurality of desired first directions in a first range of up to 180 degrees, and the taking an image includes taking an image at each direction of the plurality of desired first directions, thereby obtaining a matching first plurality of taken images. In one such method embodiment, the method further comprises constructing a first panoramic image from the first plurality of taken images.
In some exemplary method embodiments, a method further comprises rotating the OPFE around the lens optical axis in a second rotation direction opposite to the first rotation direction, to set the first optical path in a plurality of desired second directions in a second range of up to 180 degrees opposite to the first range, and the taking an image includes taking an image at each direction of the plurality of desired second directions, thereby obtaining a matching second plurality of taken images. In some such method embodiments, the method further comprises constructing a second panoramic image from the first plurality of taken images. In one such method embodiment, the method further comprises combining the first and second panoramic images into a combined panoramic image.
In some method embodiments, the lens is fixedly attached to the OPFE and the rotating the OPFE around the lens optical axis relative to the image sensor in a first rotation direction to set the first optical path in a desired first direction includes rotating the lens together with the OPFE.
In some method embodiments, the lens is a folded lens.
Non-limiting examples of embodiments disclosed herein are described below with reference to figures attached hereto that are listed following this paragraph. Identical structures, elements or parts that appear in more than one figure are generally labeled with a same numeral in all the figures in which they appear. The drawings and descriptions are meant to illuminate and clarify embodiments disclosed herein, and should not be considered limiting in any way.
In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding. However, it will be understood by those skilled in the art that the presently disclosed subject matter may be practiced without these specific details. In other instances, well-known methods have not been described in detail so as not to obscure the presently disclosed subject matter.
It is appreciated that certain features of the presently disclosed subject matter, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the presently disclosed subject matter, which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable sub-combination.
The term “processing unit” as disclosed herein should be broadly construed to include any kind of electronic device with data processing circuitry, which includes for example a computer processing device operatively connected to a computer memory (e.g. digital signal processor (DSP), a microcontroller, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc.) capable of executing various data processing operations.
Furthermore, for the sake of clarity the term “substantially” is used herein to imply the possibility of variations in values within an acceptable range. According to one example, the term “substantially” used herein should be interpreted to imply possible variation of up to 10% over or under any specified value. According to another example, the term “substantially” used herein should be interpreted to imply possible variation of up to 5% over or under any specified value. According to a further example, the term “substantially” used herein should be interpreted to imply possible variation of up to 2.5% over or under any specified value.
In the text below, “digital rotation” is used to describe an image rotation by software, to distinguish from just “rotation” used to describe physical rotation of an optical element.
In some embodiments, camera 100 may further include a focus or autofocus (AF) mechanism (not shown), allowing to move (or “shift” or “actuate”) lens 102 along axis 110, such that is can focus images from objects at various distances on image sensor 106. For simplicity, the description continues with reference only to AF, with the understanding that it also covers regular (manual) focus. The AF actuation mechanism is typically of a voice coil motor (VCM) type, i.e. a “VCM actuator”. Such actuation mechanisms are known in the art and disclosed for example in Applicant's co-owned international patent applications PCT/IB2015/056004 and PCT/IB2016/055308. This is however a non-limiting example, and the AF mechanism may be of other types, such as a stepper motor, a shape memory alloy (SMA) actuator, or other types known in the art. In some embodiments, camera 100 may include an optical image stabilization (OIS) actuation mechanism (not shown) in addition to, or instead of, the AF actuation mechanism. OIS may be achieved for example by shifting the lens in two directions in the X-Y plane, compensating for tilt of camera 100 around Z and X directions. A three degrees of freedom (DOF) OIS+focus actuation mechanism (which performs two movements for OIS and one for AF) is typically of VCM type and known in the art, for example as disclosed in international patent application PCT/US2013/076753 and in US patent application 2014/0327965. More information on auto-focus and OIS in a compact folded camera may be found in Applicant's co-owned international patent applications PCT/IB2016/052143, PCT/IB2016/052179 and PCT/IB2016/053335.
In contrast with known folded camera modules (see e.g. PCT/IB2016/052179) camera 100 is designed to rotate OPFE 104 around axis 110 (the Z axis) relative to the image sensor, i.e. in the X-Y plane in the coordinate system shown, a rotation indicated by an arrow 112. OPFE 104 can rotate in an angle range as required by optical requirements (see below), in some cases by up to 180 degrees and in other cases by up to 360 degrees.
In some embodiments, lens 102 may be optically axisymmetric. Therefore, any rotation of lens 102 around axis 102 does not change any optical property of the system and in particular the image. In such embodiments, lens 102 may rotate together with OPFE 104. In particular, as shown in an exemplary embodiment in
The rotation of OPFE 104 around axis 110 relative to the image sensor by “α” degrees will cause axis 108 (which, in its original state before rotation, is positioned perpendicular to the X axis in the coordinate system shown) to rotate in the X-Y plane and will result in two changes in the image on the image sensor: a) rotation of the center field-of-view (FOV) by α degrees and b) rotation of the image on image sensor (known in the art as “Roll” effect) by α degrees.
The rotation of the OPFE as described above and the consequent rotation of the first optical path allows photography of a panoramic view. Camera 100 has a panoramic scanning range. The panoramic view (and the scanning range) may be of up to 360 degrees. A plurality of photographs also referred to below as “sub-views”, “image sections” or “view sections”, each sub-view reflecting or related to a particular OPFE rotation positions, may be acquired and “stitched” into a “panoramic output image”.
An “image circle” of lens 102 (see also
In another embodiment, camera 100 may be used to a take video, or a preview of a video on an operating device screen (see below operating devices examples). The scanning capability allows selection of the video field of view. An example below (in
Several non-limiting examples (for example a smartphone and a flying drone) of platforms carrying or including a system such as camera 120 with camera 100 are presented in
In some embodiments, a folded camera with panoramic scanning range disclosed herein may be positioned together with a non-folded (“upright”) non-scanning camera in a dual-aperture (or “dual-camera”) camera arrangement. The non-folded camera may have a FOV smaller than, equal to or larger than the FOV of the folded camera. Dual-aperture cameras including a folded camera and a non-folded camera are described for example in PCT/IB2015/056004. The dual camera may be positioned in a smartphone or in other personal electronic devices. The upright camera may be either a front camera or a back camera of the smartphone.
In TV set 800, cameras 812 and 830 are located on a top left corner of TV set 800. In other exemplary embodiments, cameras 812 and 830 may be located in other positions, such as the top center, the left or right side, the bottom side or even beyond screen 802 described below. In another exemplary embodiment, cameras 812 and 830 may be located in a separate module (box) outside of the TV set, connected via cable or via cordless connection.
In an exemplary use embodiment, TV set 800 may be used for video-conferencing as follows: a first user (person) located in a first location may use TV set 800 to communicate with a second user (person) located in a second location. The second user may use any electronic device comprising a screen, for example a TV, a smartphone, a personal computer, a notebook or laptop computer, etc. In an exemplary embodiment, cameras 830 and 812 may be used to video record the first user, while the second user may see recordings from both cameras 830 and 812 on his screen.
TV set 800 may be used for automatic movement or “automatic adjustment” of FOVT for e.g. tracking a subject in an autonomous manner. A camera mode that performs automatic Tele FOV movement to track an object or subject of interest is referred to herein as autonomous Tele FOV tracking”. An exemplary autonomous tracking system and method applicable herein is described in PCT/IB2016/057366 for a smartphone system. The autonomous FOVT movement is in response to recognition (through e.g. camera 812) of the object or subject of interest, and the Tele image focuses on and displays the object or subject of interest. The object recognition may be performed using any of the methods known in the art.
An example of autonomous FOVT tracking scenario using TV set 800 is shown in
In the particular example shown, one sees side-by-side views of video streams from both cameras: column (a) shows a screen 900a with FOVW and FOVT seen by the first user, while column (b) shows on the right a screen 900b of the second user with FOVW and FOVT and on the left a magnified Tele view (image) of part of the face and body of first user 902 and part of the background. In general, the FOVT in (a) may show the first user (as shown), the second user or another feature from the scene. The FOVT in (a) showing the first user should therefore not be considered as limiting. In general, the second user (not shown) may see on his screen a video stream from either camera 812 or camera 830, or both cameras 812 and 830 simultaneously (e.g. side-by-side). In case the second user sees only one steam of video, switching between streams may be done using smooth transition techniques, as described for example in co-owned U.S. Pat. No. 9,185,291.
The decision to track the first user may be taken by the first user, the second user (e.g., by remote control usage) or automatically (e.g., using face detection). It is assumed that the Tele camera can change its FOV by rotating the prism to track the object of interest, as disclosed above. Ideally, the camera will track the object such that it is as close as possible to the center of the adjustable FOVT as seen in the left side of (b) in each figure.
Video streams from cameras 812 and/or camera 830 may be recorded for later usage, which may include additional processing such as image processing, video stream blending, etc.
While this disclosure has been described in terms of certain embodiments and generally associated methods, alterations and permutations of the embodiments and methods will be apparent to those skilled in the art. For example, while a camera and a folded camera with panoramic scanning range are described as exemplarily incorporated in smartphones, flying drones and television sets, such cameras and folded cameras may be also incorporated in other platforms such as vehicles, or incorporated in platforms other than smartphones, for example tablets, laptop computers, phablets, desktop computers, smart speakers, smart watches, electronic book readers, smart glasses, smart helmets, baby monitors, augmented reality systems, virtual reality systems, advanced driving assistance systems (ADAS), etc. The disclosure is to be understood as not limited by the specific embodiments described herein, but only by the scope of the appended claims.
Unless otherwise stated, the use of the expression “and/or” between the last two members of a list of options for selection indicates that a selection of one or more of the listed options is appropriate and may be made.
It should be understood that where the claims or specification refer to “a” or “an” element, such reference is not to be construed as there being only one of that element.
All references mentioned in this specification are herein incorporated in their entirety by reference into the specification, to the same extent as if each individual reference was specifically and individually indicated to be incorporated herein by reference. In addition, citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the present invention.
This application is a 371 application from international application PCT/IB2018/050885, and claims the benefit of U.S. Provisional patent applications No. 62/471,662 filed Mar. 15, 2017 and 62/560,684 filed Sep. 20, 2017, both of which are incorporated herein by reference in their entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2018/050885 | 2/13/2018 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2018/167581 | 9/20/2018 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
4199785 | McCullough et al. | Apr 1980 | A |
5005083 | Grage et al. | Apr 1991 | A |
5032917 | Aschwanden | Jul 1991 | A |
5051830 | von Hoessle | Sep 1991 | A |
5248971 | Mandl | Sep 1993 | A |
5287093 | Amano et al. | Feb 1994 | A |
5394520 | Hall | Feb 1995 | A |
5436660 | Sakamoto | Jul 1995 | A |
5444478 | Lelong et al. | Aug 1995 | A |
5459520 | Sasaki | Oct 1995 | A |
5657402 | Bender et al. | Aug 1997 | A |
5682198 | Katayama et al. | Oct 1997 | A |
5768443 | Michael et al. | Jun 1998 | A |
5926190 | Turkowski et al. | Jul 1999 | A |
5940641 | McIntyre et al. | Aug 1999 | A |
5982951 | Katayama et al. | Nov 1999 | A |
6101334 | Fantone | Aug 2000 | A |
6128416 | Oura | Oct 2000 | A |
6148120 | Sussman | Nov 2000 | A |
6208765 | Bergen | Mar 2001 | B1 |
6268611 | Pettersson et al. | Jul 2001 | B1 |
6549215 | Jouppi | Apr 2003 | B2 |
6611289 | Yu et al. | Aug 2003 | B1 |
6643416 | Daniels et al. | Nov 2003 | B1 |
6650368 | Doron | Nov 2003 | B1 |
6680748 | Monti | Jan 2004 | B1 |
6714665 | Hanna et al. | Mar 2004 | B1 |
6724421 | Glatt | Apr 2004 | B1 |
6738073 | Park et al. | May 2004 | B2 |
6741250 | Furlan et al. | May 2004 | B1 |
6750903 | Miyatake et al. | Jun 2004 | B1 |
6778207 | Lee et al. | Aug 2004 | B1 |
7002583 | Rabb, III | Feb 2006 | B2 |
7015954 | Foote et al. | Mar 2006 | B1 |
7038716 | Klein et al. | May 2006 | B2 |
7199348 | Olsen et al. | Apr 2007 | B2 |
7206136 | Labaziewicz et al. | Apr 2007 | B2 |
7248294 | Slatter | Jul 2007 | B2 |
7256944 | Labaziewicz et al. | Aug 2007 | B2 |
7305180 | Labaziewicz et al. | Dec 2007 | B2 |
7339621 | Fortier | Mar 2008 | B2 |
7346217 | Gold, Jr. | Mar 2008 | B1 |
7365793 | Cheatle et al. | Apr 2008 | B2 |
7411610 | Doyle | Aug 2008 | B2 |
7424218 | Baudisch et al. | Sep 2008 | B2 |
7509041 | Hosono | Mar 2009 | B2 |
7533819 | Barkan et al. | May 2009 | B2 |
7619683 | Davis | Nov 2009 | B2 |
7738016 | Toyofuku | Jun 2010 | B2 |
7773121 | Huntsberger et al. | Aug 2010 | B1 |
7809256 | Kuroda et al. | Oct 2010 | B2 |
7880776 | LeGall et al. | Feb 2011 | B2 |
7918398 | Li et al. | Apr 2011 | B2 |
7964835 | Olsen et al. | Jun 2011 | B2 |
7978239 | Deever et al. | Jul 2011 | B2 |
8115825 | Culbert et al. | Feb 2012 | B2 |
8149327 | Lin et al. | Apr 2012 | B2 |
8154610 | Jo et al. | Apr 2012 | B2 |
8238695 | Davey et al. | Aug 2012 | B1 |
8274552 | Dahi et al. | Sep 2012 | B2 |
8390729 | Long et al. | Mar 2013 | B2 |
8391697 | Cho et al. | Mar 2013 | B2 |
8400555 | Georgiev et al. | Mar 2013 | B1 |
8439265 | Ferren et al. | May 2013 | B2 |
8446484 | Muukki et al. | May 2013 | B2 |
8483452 | Ueda et al. | Jul 2013 | B2 |
8514491 | Duparre | Aug 2013 | B2 |
8547389 | Hoppe et al. | Oct 2013 | B2 |
8553106 | Scarff | Oct 2013 | B2 |
8587691 | Takane | Nov 2013 | B2 |
8619148 | Watts et al. | Dec 2013 | B1 |
8803990 | Smith | Aug 2014 | B2 |
8896655 | Mauchly et al. | Nov 2014 | B2 |
8976255 | Matsuoto et al. | Mar 2015 | B2 |
9019387 | Nakano | Apr 2015 | B2 |
9025073 | Attar et al. | May 2015 | B2 |
9025077 | Attar et al. | May 2015 | B2 |
9041835 | Honda | May 2015 | B2 |
9137447 | Shibuno | Sep 2015 | B2 |
9185291 | Shabtay et al. | Nov 2015 | B1 |
9215377 | Sokeila et al. | Dec 2015 | B2 |
9215385 | Luo | Dec 2015 | B2 |
9270875 | Brisedoux et al. | Feb 2016 | B2 |
9286680 | Jiang et al. | Mar 2016 | B1 |
9344626 | Silverstein et al. | May 2016 | B2 |
9360671 | Zhou | Jun 2016 | B1 |
9369621 | Malone et al. | Jun 2016 | B2 |
9413930 | Geerds | Aug 2016 | B2 |
9413984 | Attar et al. | Aug 2016 | B2 |
9420180 | Jin | Aug 2016 | B2 |
9438792 | Nakada et al. | Sep 2016 | B2 |
9485432 | Medasani et al. | Nov 2016 | B1 |
9578257 | Attar et al. | Feb 2017 | B2 |
9618748 | Munger et al. | Apr 2017 | B2 |
9681057 | Attar et al. | Jun 2017 | B2 |
9723220 | Sugie | Aug 2017 | B2 |
9736365 | Laroia | Aug 2017 | B2 |
9736391 | Du et al. | Aug 2017 | B2 |
9768310 | Ahn et al. | Sep 2017 | B2 |
9800798 | Ravirala et al. | Oct 2017 | B2 |
9851803 | Fisher et al. | Dec 2017 | B2 |
9894287 | Qian et al. | Feb 2018 | B2 |
9900522 | Lu | Feb 2018 | B2 |
9927600 | Goldenberg et al. | Mar 2018 | B2 |
20020005902 | Yuen | Jan 2002 | A1 |
20020030163 | Zhang | Mar 2002 | A1 |
20020063711 | Park et al. | May 2002 | A1 |
20020075258 | Park et al. | Jun 2002 | A1 |
20020122113 | Foote | Sep 2002 | A1 |
20020167741 | Koiwai et al. | Nov 2002 | A1 |
20030030729 | Prentice et al. | Feb 2003 | A1 |
20030093805 | Gin | May 2003 | A1 |
20030160886 | Misawa et al. | Aug 2003 | A1 |
20030202113 | Yoshikawa | Oct 2003 | A1 |
20040008773 | Itokawa | Jan 2004 | A1 |
20040012683 | Yamasaki et al. | Jan 2004 | A1 |
20040017386 | Liu et al. | Jan 2004 | A1 |
20040027367 | Pilu | Feb 2004 | A1 |
20040061788 | Bateman | Apr 2004 | A1 |
20040240052 | Minefuji et al. | Dec 2004 | A1 |
20050013509 | Samadani | Jan 2005 | A1 |
20050046740 | Davis | Mar 2005 | A1 |
20050157184 | Nakanishi et al. | Jul 2005 | A1 |
20050168834 | Matsumoto et al. | Aug 2005 | A1 |
20050200718 | Lee | Sep 2005 | A1 |
20060054782 | Olsen et al. | Mar 2006 | A1 |
20060056056 | Ahiska et al. | Mar 2006 | A1 |
20060125937 | LeGall et al. | Jun 2006 | A1 |
20060170793 | Pasquarette et al. | Aug 2006 | A1 |
20060175549 | Miller et al. | Aug 2006 | A1 |
20060187310 | Janson et al. | Aug 2006 | A1 |
20060187322 | Janson et al. | Aug 2006 | A1 |
20060187338 | May et al. | Aug 2006 | A1 |
20070024737 | Nakamura et al. | Feb 2007 | A1 |
20070126911 | Nanjo | Jun 2007 | A1 |
20070177025 | Kopet et al. | Aug 2007 | A1 |
20070188653 | Pollock et al. | Aug 2007 | A1 |
20070189386 | Imagawa et al. | Aug 2007 | A1 |
20070257184 | Olsen et al. | Nov 2007 | A1 |
20070285550 | Son | Dec 2007 | A1 |
20080017557 | Witdouck | Jan 2008 | A1 |
20080024614 | Li et al. | Jan 2008 | A1 |
20080025634 | Border et al. | Jan 2008 | A1 |
20080030592 | Border et al. | Feb 2008 | A1 |
20080030611 | Jenkins | Feb 2008 | A1 |
20080084484 | Ochi et al. | Apr 2008 | A1 |
20080117316 | Orimoto | May 2008 | A1 |
20080218611 | Parulski et al. | Sep 2008 | A1 |
20080218612 | Border et al. | Sep 2008 | A1 |
20080218613 | Janson et al. | Sep 2008 | A1 |
20080219654 | Border et al. | Sep 2008 | A1 |
20090086074 | Li et al. | Apr 2009 | A1 |
20090122195 | Van Baar et al. | May 2009 | A1 |
20090122406 | Rouvinen et al. | May 2009 | A1 |
20090128644 | Camp et al. | May 2009 | A1 |
20090219547 | Kauhanen et al. | Sep 2009 | A1 |
20090252484 | Hasuda et al. | Oct 2009 | A1 |
20090295949 | Ojala | Dec 2009 | A1 |
20090324135 | Kondo et al. | Dec 2009 | A1 |
20100013906 | Border et al. | Jan 2010 | A1 |
20100020221 | Tupman et al. | Jan 2010 | A1 |
20100060746 | Olsen et al. | Mar 2010 | A9 |
20100097444 | Lablans | Apr 2010 | A1 |
20100103194 | Chen et al. | Apr 2010 | A1 |
20100165131 | Makimoto et al. | Jul 2010 | A1 |
20100238327 | Griffith et al. | Sep 2010 | A1 |
20100283842 | Guissin et al. | Nov 2010 | A1 |
20100321494 | Peterson et al. | Dec 2010 | A1 |
20110058320 | Kim et al. | Mar 2011 | A1 |
20110064327 | Dagher et al. | Mar 2011 | A1 |
20110080487 | Venkataraman et al. | Apr 2011 | A1 |
20110128288 | Petrou et al. | Jun 2011 | A1 |
20110164172 | Shintani et al. | Jul 2011 | A1 |
20110229054 | Weston et al. | Sep 2011 | A1 |
20110234853 | Hayashi et al. | Sep 2011 | A1 |
20110234881 | Wakabayashi et al. | Sep 2011 | A1 |
20110242286 | Pace et al. | Oct 2011 | A1 |
20110242355 | Goma et al. | Oct 2011 | A1 |
20120026366 | Golan et al. | Feb 2012 | A1 |
20120062780 | Morihisa | Mar 2012 | A1 |
20120069235 | Imai | Mar 2012 | A1 |
20120075489 | Nishihara | Mar 2012 | A1 |
20120105579 | Jeon et al. | May 2012 | A1 |
20120154614 | Moriya et al. | Jun 2012 | A1 |
20120196648 | Havens et al. | Aug 2012 | A1 |
20120229663 | Nelson et al. | Sep 2012 | A1 |
20120249815 | Bohn et al. | Oct 2012 | A1 |
20120287315 | Huang et al. | Nov 2012 | A1 |
20120320467 | Baik et al. | Dec 2012 | A1 |
20130002928 | Imai | Jan 2013 | A1 |
20130016427 | Sugawara | Jan 2013 | A1 |
20130093842 | Yahata | Apr 2013 | A1 |
20130135445 | Dahl et al. | May 2013 | A1 |
20130182150 | Asakura | Jul 2013 | A1 |
20130201360 | Song | Aug 2013 | A1 |
20130202273 | Ouedraogo et al. | Aug 2013 | A1 |
20130235224 | Park et al. | Sep 2013 | A1 |
20130250150 | Malone et al. | Sep 2013 | A1 |
20130258044 | Betts-LaCroix | Oct 2013 | A1 |
20130270419 | Singh et al. | Oct 2013 | A1 |
20130321668 | Kamath | Dec 2013 | A1 |
20140009631 | Topliss | Jan 2014 | A1 |
20140049615 | Uwagawa | Feb 2014 | A1 |
20140118584 | Lee et al. | May 2014 | A1 |
20140192238 | Attar et al. | Jul 2014 | A1 |
20140192253 | Laroia | Jul 2014 | A1 |
20140218587 | Shah | Aug 2014 | A1 |
20140313316 | Olsson et al. | Oct 2014 | A1 |
20140362242 | Takizawa | Dec 2014 | A1 |
20150002683 | Hu et al. | Jan 2015 | A1 |
20150042870 | Chan et al. | Feb 2015 | A1 |
20150092066 | Geiss et al. | Apr 2015 | A1 |
20150154776 | Zhang et al. | Jun 2015 | A1 |
20150162048 | Hirata et al. | Jun 2015 | A1 |
20150195458 | Nakayama et al. | Jul 2015 | A1 |
20150215516 | Dolgin | Jul 2015 | A1 |
20150237280 | Choi et al. | Aug 2015 | A1 |
20150242994 | Shen | Aug 2015 | A1 |
20150271471 | Hsieh et al. | Sep 2015 | A1 |
20150286033 | Osborne | Oct 2015 | A1 |
20150316744 | Chen | Nov 2015 | A1 |
20150334309 | Peng et al. | Nov 2015 | A1 |
20160044250 | Shabtay et al. | Feb 2016 | A1 |
20160070088 | Koguchi | Mar 2016 | A1 |
20160154202 | Wippermann et al. | Jun 2016 | A1 |
20160154204 | Lim et al. | Jun 2016 | A1 |
20160212358 | Shikata | Jul 2016 | A1 |
20160241751 | Park | Aug 2016 | A1 |
20160291295 | Shabtay et al. | Oct 2016 | A1 |
20160295112 | Georgiev et al. | Oct 2016 | A1 |
20160301840 | Du et al. | Oct 2016 | A1 |
20160353008 | Osborne | Dec 2016 | A1 |
20160353012 | Kao et al. | Dec 2016 | A1 |
20170019616 | Zhu et al. | Jan 2017 | A1 |
20170214846 | Du et al. | Jul 2017 | A1 |
20170214866 | Zhu et al. | Jul 2017 | A1 |
20170242225 | Fiske | Aug 2017 | A1 |
20170264829 | Zhou | Sep 2017 | A1 |
20170289458 | Song et al. | Oct 2017 | A1 |
20180024329 | Goldenberg et al. | Jan 2018 | A1 |
20180120674 | Avivi et al. | May 2018 | A1 |
20180150973 | Tang et al. | May 2018 | A1 |
20180241922 | Baldwin | Aug 2018 | A1 |
20180295292 | Lee et al. | Oct 2018 | A1 |
Number | Date | Country |
---|---|---|
101276415 | Oct 2008 | CN |
102739949 | Oct 2012 | CN |
103024272 | Apr 2013 | CN |
103841404 | Jun 2014 | CN |
1536633 | Jun 2005 | EP |
2523450 | Nov 2012 | EP |
S59191146 | Oct 1984 | JP |
04211230 | Aug 1992 | JP |
H07318864 | Dec 1995 | JP |
08271976 | Oct 1996 | JP |
2003298920 | Oct 2003 | JP |
2004133054 | Apr 2004 | JP |
2005099265 | Apr 2005 | JP |
2006238325 | Sep 2006 | JP |
2007228006 | Sep 2007 | JP |
2007306282 | Nov 2007 | JP |
2008076485 | Apr 2008 | JP |
2013106289 | May 2013 | JP |
20090058229 | Jun 2009 | KR |
20100008936 | Jan 2010 | KR |
20140014787 | Feb 2014 | KR |
101477178 | Dec 2014 | KR |
20150118012 | Oct 2015 | KR |
2014072818 | May 2014 | WO |
2017025822 | Feb 2017 | WO |
2017037688 | Mar 2017 | WO |
2018130898 | Jul 2018 | WO |
Entry |
---|
Statistical Modeling and Performance Characterization of a Real-Time Dual Camera Surveillance System, Greienhagen et al., Publisher: IEEE, 2000, 8 pages. |
A 3MPixel Multi-Aperture Image Sensor with 0.7 μm Pixels in 0.11μm CMOS, Fife et al., Stanford University, 2008, 3 pages. |
Dual camera intelligent sensor for high definition 360 degrees surveillance, Scotti et al., Publisher: IET, May 9, 2000, 8 pages. |
Dual-sensor foveated imaging system, Hua et al., Publisher: Optical Society of America, Jan. 14, 2008, 11 pages. |
Defocus Video Matting, McGuire et al., Publisher: ACM SIGGRAPH, Jul. 31, 2005, 11 pages. |
Compact multi-aperture imaging with high angular resolution, Santacana et al., Publisher: Optical Society of America, 2015, 10 pages. |
Multi-Aperture Photography, Green et al., Publisher: Mitsubishi Electric Research Laboratories, Inc., Jul. 2007, 10 pages. |
Multispectral Bilateral Video Fusion, Bennett et al., Publisher: IEEE, May 2007, 10 pages. |
Super-resolution imaging using a camera array, Santacana et al., Publisher: Optical Society of America, 2014, 6 pages. |
Optical Splitting Trees for High-Precision Monocular Imaging, McGuire et al., Publisher: IEEE, 2007, 11 pages. |
High Performance Imaging Using Large Camera Arrays, Wilburn et al., Publisher: Association for Computing Machinery, Inc., 2005, 12 pages. |
Real-time Edge-Aware Image Processing with the Bilateral Grid, Chen et al., Publisher: ACM SIGGRAPH, 2007, 9 pages. |
Superimposed multi-resolution imaging, Carles et al., Publisher: Optical Society of America, 2017, 13 pages. |
Viewfinder Alignment, Adams et al., Publisher: Eurographics, 2008, 10 pages. |
Dual-Camera System for Multi-Level Activity Recognition, Bodor et al., Publisher: IEEE, Oct. 2014, 6 pages. |
Engineered to the task: Why camera-phone cameras are different, Giles Humpston, Publisher: Solid State Technology, Jun. 2009, 3 pages. |
Number | Date | Country | |
---|---|---|---|
20190394396 A1 | Dec 2019 | US |
Number | Date | Country | |
---|---|---|---|
62560684 | Sep 2017 | US | |
62471662 | Mar 2017 | US |