The embodiments disclosed herein relate to camera modules. Particularly, the embodiments disclosed herein relate to a continuous autofocus system within camera modules.
Camera modules are becoming increasingly popular within portable electronics. Not only are camera modules within stand-alone cameras, but they are in essentially all smartphones, tablets and PC computers. Camera modules include auto focus systems such that a particular camera module can focus on a specific object within a captured image.
Current autofocus systems require a time interval whereby the camera module is held stationary such that the camera can acquire an object and determine the correct focus configuration. This time interval is inefficient as current autofocus systems require 125 ms or more to find the best focus.
Autofocus system 100 includes an image generation portion 102 having a lens 104 for capturing, via image sensor 106, and an autofocus voice coil motor (AF VCM) 108 for translating lens 104 to a focus position along a focus translation stage (not shown). AF VCM 108 is controlled via driver circuit 110. Driver circuit 110 is configured by image signal processor (ISP) 112. ISP 112 receives data, via an inter-integrated circuit (I2C) Bus from image sensor 106 as described below with reference to
ISP 112 controls AF VCM 108, via driver circuit 110, such that lens 104 is sequentially set to various position values 202. A contrast value of the image (i.e. sensed by image sensor 106) is taken at each position value 202 and a curve fitting algorithm is applied (i.e. within ISP 112) to determine curve fitting line 204. Peak 206 of curve fitting line 204 is then selected for the best focus position, whereby Driver circuit 110 controls AF VCM 108 to set lens 104 to a particular position. The time required to translate lens 104 to a series of position values 202 is inefficient.
In a first aspect, a continuous autofocus system for generating an image is described including an image generation portion having a lens, an autofocus voice coil motor, and an image sensor for generating contrast image data of an image. The continuous autofocus system further includes a driver integrated circuit (IC) for controlling the autofocus voice coil motor, thereby translating the lens with respect to the image sensor; wherein the driver IC directly receives the contrast image data such that the driver IC continuously maintains the focus of the image.
In a second aspect, a method for continuous autofocus when generating an image is described including the steps of generating, via an image sensor, contrast image data of an image; transmitting the contrast image data directly to a driver IC circuit; generating, within the driver IC circuit, a control signal based on the contrast image data; and, translating a lens based on the control signal to alter the focus of the image.
Lens 304 images light reflected on a scene onto image sensor 306. Lens 304 may include a single lens, or a plurality of lenses, located on a translation stage (not shown) for varying the distance of lens 304 from image sensor 306, such that image focus can be altered.
Image sensor 306 is for example a complementary metal-oxide-semiconductor (CMOS) sensor, and/or any other imaging sensors known in the art capable of sensing image contrast data.
Image sensor 306 generates image data 307 from light imaged thereon by lens 304, and image data 307 is directly sent to a driver IC 310. For example, image data 307 includes contrast data of a sensed image and may be sent to driver circuit 310 via an I2C bus. Driver IC 310 controls AF VCM 308 to control the position of lens 304 relative to image sensor 306. Unlike the autofocus system in
By directly receiving image data 307 at driver IC 310, autofocus system 300 substantially reduces and/or eliminates the focusing time required to keep an image produced in focus. For example, driver IC 310 operates to automatically keep lens 304 in the best focus. By directly receiving image data 307 (i.e. image contrast data), driver IC 310 automatically controls AF VCM 308 such that the focus of an image produced by autofocus system 300 is above a focus threshold (e.g. is in best focus). Driver IC 310 does not need to sequentially set lens 304 at a plurality of focus positions and then determine the best focus position. To the contrary, driver IC 310 receives image data 307 and automatically controls AF VCM 308 until contrast image data 307 is above a particular focus threshold. Once the image data 307 is above a particular focus threshold, lens 304 is in an appropriate position such that the image is in focus.
Analog image data 407 is then compared to focus threshold 410, in real time, to generate control signal 412. For example, analog image data 407 is a voltage potential ranging from 0 V to 1 V, wherein 0V indicates worst contrast and 1V indicates best contrast. Focus threshold 410 is for example a voltage potential corresponding to a minimum acceptable focus level. For example, where image data 407 ranges from 0V to 1V, focus threshold 410 may have a value of 0.9V. The value of focus threshold 410 may be predetermined based on the application of the particular autofocus system, and/or may be variably set by a user of the autofocus system.
On receipt of control signal 412, control portion 404 automatically controls AF VCM 308 such that the image data 407 is increased/decreased above/below focus threshold 410. For example, if image data 407 has a voltage potential below focus threshold 410, lens 304 is translated, via control of AF VCM 308 by driver IC 310, away from sensor 306 in a first direction. If the image data 407 voltage potential then increases, driver IC 310 continues to translate in the same direction until the voltage potential is equal to or greater than focus threshold 410. If the image data 407 voltage potential decreases, lens 304 is translated in a second direction opposite from the first direction. As discussed above, by directly sending image data 307 to driver IC 310 and automatically determining the position of best focus, autofocus system 300 substantially reduces and/or eliminates the time required to focus an image.
In step 502, method 500 generates contrast image data of an image sensed by an image sensor. In one example of step 502, image sensor 306 senses an image and generates high speed contrast image data 307 of the image.
In step 504, the contrast image data generated in step 502 is sent directly to a driver IC circuit. In one example of step 504, image data 307 is sent directly to compare portion 402 of driver IC circuit 310.
In optional step 506, the image data of steps 502-504 is converted from digital to analog. For In one example of step 506, digital-to-analog converter 406 converts digital high speed contrast image data 307 into analog high speed contrast image data 407.
In step 508, a control signal is generated based upon the image data collected in steps 502-508 and a focus threshold value. In one example of step 508, compare portion 402 compares image data 407 to focus threshold value-410 to generate control signal 412.
In step 510, a lens is translated based on control signal from step 508 such that the image data is above the focus threshold value. In one example of step 510, control portion 404 controls AF VCM 308 such that image data 407 voltage potential is greater than the value of focus threshold 410.
Steps 502 through 510 are repeated continuously, as indicated by loop 512, such that an image generated by method 500 is continuously autofocused. It will be appreciated that method 500 may be implemented in any single snapshot cameras, video cameras or any other type of image generation device.
Changes may be made in the above methods and systems without departing from the scope hereof. It should thus be noted that the matter contained in the above description or shown in the accompanying drawings should be interpreted as illustrative and not in a limiting sense. The following claims are intended to cover all generic and specific features described herein, as well as all statements of the scope of the present method and system, which, as a matter of language, might be said to fall therebetween.
Number | Name | Date | Kind |
---|---|---|---|
5200828 | Jang et al. | Apr 1993 | A |
5298933 | Chigira | Mar 1994 | A |
5337084 | Nakamura | Aug 1994 | A |
5455649 | Yamada et al. | Oct 1995 | A |
5574502 | Haruki | Nov 1996 | A |
5604538 | Kaneda et al. | Feb 1997 | A |
5612740 | Lee et al. | Mar 1997 | A |
6094223 | Kobayashi | Jul 2000 | A |
6163340 | Yasuda | Dec 2000 | A |
20040012709 | Hirai | Jan 2004 | A1 |
20040036793 | Kanayama | Feb 2004 | A1 |
20040036794 | Kanayama et al. | Feb 2004 | A1 |
20040165276 | Yahagi et al. | Aug 2004 | A1 |
20060045509 | Sasaki | Mar 2006 | A1 |
20060171699 | Nakai et al. | Aug 2006 | A1 |
20070052836 | Yamada et al. | Mar 2007 | A1 |
20080018777 | Higashino | Jan 2008 | A1 |
20080031611 | Konishi | Feb 2008 | A1 |
20090175611 | Kiyamura et al. | Jul 2009 | A1 |
20090190910 | Yasuda et al. | Jul 2009 | A1 |
20100177236 | Suzuki et al. | Jul 2010 | A1 |
20100232775 | Okamoto et al. | Sep 2010 | A1 |
20110043678 | Ueda et al. | Feb 2011 | A1 |
20110158624 | Sasaki | Jun 2011 | A1 |
20120051727 | Tanaka | Mar 2012 | A1 |
20130021516 | Kikuchi | Jan 2013 | A1 |
20130250162 | Sasaki | Sep 2013 | A1 |
20130308039 | Uchiyama | Nov 2013 | A1 |
20140375869 | Hagiwara | Dec 2014 | A1 |
20150085177 | Okada | Mar 2015 | A1 |
20150130988 | Uenishi | May 2015 | A1 |
20150138429 | Ogura et al. | May 2015 | A1 |
20150163395 | Konishi et al. | Jun 2015 | A1 |
Number | Date | Country | |
---|---|---|---|
20150264247 A1 | Sep 2015 | US |