The present invention relates to an image capturing device and an exposure time exposure time adjusting method thereof; in particular, the present invention relates to an image capturing device and an exposure time exposure time adjusting method thereof enabling enhancements of image quality.
While user operating a digital camera to take pictures, the problem of blurred images due to vibrations in hand has been beleaguering numerous photographers all the time. Generally speaking, when holding a conventional digital camera by a user in hand for photographic operations, before a picture is taken, the lens may be swung or moved because of accidental carelessness or incorrect gesture in holding the digital camera. Additionally, as the size for the digital camera becomes slimmer, the occurrence of blurred images caused by hand shakes when pressing down the shutter button on a compact digital camera also gets more commonly seen. Consequently, hand shakes could adversely influence the quality of taken pictures to a certain extent; for minor cases, the scene angle in the picture may slant or deviate; under more serious condition, the entire image can be blurred and obscured.
Several traditional anti-shake approaches have been developed and comprehensively applied to address to such an issue, including: (1) elevation of sensitivity in the photo-sensor (e.g., Charge-Coupled Device, CCD or Complementary Metal-Oxide-Semiconductor, CMOS) so as to reduce the required exposure time thereby curtailing the possibility in occurrence of blurred images. (2) application of optical anti-shake technique to move in real-time the lens or sensor in order to compensate for the offset in optical axis generated by hand shakes. Each of the aforementioned approaches has respective advantages and drawbacks, but with regards to current consumption trend, the first solution gets more widely implemented; however, since a picture is taken through increased sensitivity, an image of high noise is very likely generated. Therefore, a technology of multi-exposure image integration has been applied in recent years for reduction of noise in output images.
So far, the application of multi-exposure method for reducing high noises needs to first capture a series of images at high sensitivity regarding to a specific scene, and select a reference image among them, and perform geometric movement estimations on the rest captured images based on the selected reference image thereby finding the geometric conversion parameters between the other images and the reference image. Each of the other images are converted in accordance with the estimated motion parameters so that each image can be integrated in a point-to-point fashion with the selected reference image, and some integration techniques are used to integrate relevant image points distributed across such images into an image of low noises.
However, by applying this method, effective integration of high quality image may not be successfully achieved due to erroneous estimations of geometric conversion parameters in certain images and much noise in each input image, thus resulting in images of even worse quality. Also, at present, this method essentially uses the same exposure approach to acquire each image: for example, first determining an exposure time for a certain scene, and then applying the minimum secure shutter time to equivalently decide the number of images to take; whereas, more images it captures, the longer time the system needs for required processes, thus less reliable in the quality of output images after integration. As such, regarding to the aforementioned issues, it now becomes an urgent subject for the market applications in terms of demand to design an image capturing device and an exposure time adjusting method thereof which can effectively increase the image quality.
With regards to the issues found in prior art as illustrated hereinbefore, the objective of the present invention is to provide an image capturing device and an exposure time adjusting method thereof thereby resolving the problems in required long processing time of multiple images for currently available image capturing devices as well as unsatisfactory effects in image integrations.
According to the objective of the present invention, an image capturing device is herein provided which comprises an image capturing module, a processing module and an image integrated module. The image capturing module is used to capture a plurality of temporary images. While the image capturing module captures the temporary images, the processing module dynamically adjusts the exposure time for each of the temporary images according to a predetermined file or a photographic condition. The image integrated module is controlled by the processing module thereby integrating the temporary images to generate a stored image.
According to the objective of the present invention, an exposure time adjusting method is provided which is applicable to an image capturing device. The exposure time adjusting method comprises the following steps. Pluralities of temporary images are captured by using an image capturing module. while the image capturing module capturing the temporary images, the exposure time for each of the temporary images are dynamically adjusted according to a predetermined file or a photographic condition by a processing module. The temporary images are integrated by an image integrated module to generate a stored image.
Preferably, the exposure time for each of the temporary images is the secure shutter time for each of the temporary images.
Preferably, the image capturing device can further comprise a storage module capable of storing the predetermined file which includes the stability parameter concerning the use of the image capturing device by a plurality of users.
Preferably, the image capturing device can further comprise an image analysis module capable of analyzing the clarity in each of the temporary images and correspondingly providing an image analysis result that indicates the photographic condition.
Preferably, the image capturing device can further comprise a vibration sensor module capable of sensing the vibration state in the image capturing device and correspondingly providing the vibration information that indicates the photographic condition.
Preferably, the vibration information can comprise vibration amplitude, vibration frequency and vibration duration.
Preferably, upon the vibration amplitude or the vibration frequency surpassing a threshold, the processing module controls the image capturing module to stop the exposure of the current temporary image and controls the image capturing module to perform the exposure of another temporary image.
Preferably, the processing module controls the image integrated module to integrate each pixel in the same image object among such temporary images to generate the stored image.
Preferably, when the image integrated module determines that the difference in similarity from pixels of an image object between a certain temporary image and other temporary images exceeds a threshold, the image integrated module stops integrating such a temporary image and completes the integration for each of the other temporary images.
According to the objective of the present invention, an image capturing device is herein further provided which comprises an image capturing module and a processing module. The image capturing module captures a corresponding image data based on a scene. The processing module controls the image capturing module to capture a plurality of transient, continuous images and the processing module dynamically divides the exposure time for each of the transient, continuous images captured by the image capturing module, and each of the transient, continuous images is a clear image; furthermore, the processing module comprises a control module to determine a compensation value for vibrations in the transient, continuous images and integrates the transient, continuous images based on the compensation value to generate a stored image.
Herein the exposure time for each of the transient, continuous images is the secure shutter time for each of the transient, continuous images.
As described in previous texts, the image capturing device and exposure time adjusting method thereof according to the present invention provides the following advantages:
The image capturing device and exposure time adjusting method thereof according to the present invention allows adaptively controlling the exposure time for each image based on various photographic conditions so as to reduce the processing time for multiple images in the image capturing device or portable electronic device with camera function and improve the quality of integrated images.
The exemplary embodiment(s) of the present invention will be understood more fully from the detailed description given below and from the accompanying drawings of various embodiments of the invention, which, however, should not be taken to limit the invention to the specific embodiments, but are for explanation and understanding only.
In the subsequent texts, references will be made to relevant drawings in order to describe the embodiments for the image capturing device and exposure time adjusting method thereof according to the present invention, and for better appreciations, the same components in the following embodiments will be marked with the identical symbols/numerals throughout the entire specification.
The digital capturing device set forth in the present invention may be a portable electronic device featuring camera function such as a digital camera, a camera phone, a personal digital assistant (PDA) or a digital video camera and the like; whereas to facilitate more thorough understanding of the present invention, hereunder a camera phone is taken as an illustrative embodiment, but the present invention is by no means limited thereto.
Refer to
The processing module 14 is electrically connected to the image capturing module 10, the vibration sensor module 11, the image analyzing module 12 and the storage module 13, which can be a central processing unit (CPU) or a micro-processing unit. The processing module 14 controls the image capturing module 10 to capture a plurality of temporary images of a scene, and during capturing such temporary images by the image capturing module 10, the processing module 14 can dynamically adjust the exposure time for each of the temporary images in accordance with a predetermined file or a photographic condition. After which, the processing module 14 controls the image integrated module 15 to integrate the plurality of temporary images and generate a stored image to be stored in the storage module 13.
Refer to
In case that the user intends to perform integration of multiple images so as to enhance the quality of integrated image, it is possible to get an appropriate initial exposure time in the stage S1. Upon entering into the stage S2, the image capturing device 1 takes pictures with the initial exposure time adjusted during the stage S1, and since the hand shake may be at its maximum when pressing down the shutter button by a general user in operation of the camera phone, the vibration sensor module 11 detects the vibration state of the image capturing device 1 within a preset range of time after pressing down the shutter button for the first time (e.g., within 1 second after pressing down the shutter button), correspondingly generates the vibration information 110 including the vibration amplitude, vibration frequency and vibration duration and transfers it to the processing module 14. Then the processing module 14 may immediately perform statistic analyses on the received vibration information 110. As continuing to take a second temporary image, in case the vibration state in the first temporary image is more stable than expected vibration state, it determines that sufficient stability exists in the user, thus allowable to capture the next temporary image at the same or slightly longer shutter time; on the contrary, suppose the vibration state in the first temporary image is less stable than expected vibration state, the image capturing device 1 can adaptively reduce the shutter time for the next temporary image so as to capture a lucid image. The expected vibration state can be determined, not limited, in the stage S1 or other manner described latter. In other word, such a mechanism of dynamic modification on exposure time determines the exposure time for the next temporary image based on the vibration information 110 detected by the vibration sensor module 11 such that, for a user enabling sufficient stability, it is possible to perform image integrations with less temporary images thereby successfully achieving the pre-determined integration brightness. However, for a less stable user, it needs to capture more temporary images to reach at the pre-determined integration brightness.
Besides, because of continuous detection by the vibration sensor module 11, the image capturing device 1 is capable of monitoring the output data from the vibration sensor module 11 during the image exposure. When the momentary variation in its output becomes exceedingly strong and beyond a generally acceptable range, it indicates that the image capturing device 1 is seriously swung and the captured image is definitely obscure, and the image capturing device 1 or user may stop the exposure right away in order to maintain the limpidity in the output image as much as possible, and then immediate recapture the next image with a reduced initial exposure time thereby ensuring the clarity in the captured image; consequently, through the vibration sensor module 11, the user can detect in real-time the degree of vibration in the image capturing device 1 rather than waiting till completion of photographic operation to find out.
Refer to
Refer to Table 1, wherein an example of record file for different users is shown. As shown in Table 1, the image capturing device 1 can respectively learn and record the habit or stability with respect to different users to store in the storage module 13. In the present embodiment, the record file for different users can be presented in a way of form (user 1 and user 2 as shown), which includes the hand shake condition of the user such as vibration amplitude, vibration frequency and vibration duration, as well as parameters for each image capturing mode given according to the habit of different users after analyses through the processing module 14. For example, to a sufficiently stable user, an exposure time longer than normally set can be granted at the initial point; but, for a user not able to demonstrate enough stability, an exposure time shorter than normally set can be given initially. After which, during the following photographic period of temporary images, the image capturing device 1 can dynamically adjust its shutter time in conjunction with the aforementioned analyses on vibration or image clarity. Also, such a user record file may be composed of include fixed contents or consistently modified according to actual operations. For brevity, only partial parameters for the image capturing mode are listed in present diagram, while those skilled ones in the art can conveniently add the remaining relevant parameters which are herein omitted.
It should be noted that, in addition to the above-said fashion, the user record file stored by the vibration sensor module 11, image analyzing module 12 and storage module 13 can also apply individual functions to dynamically adjust the exposure time for each of the temporary images. However, those skilled ones in the art can conveniently consider other conjunctive or combinatorial approaches thereby enabling dynamic adjustments on the exposure time for each of the temporary images, and the actions of such combinations are analogous to those as previously illustrated which will be herein omitted for brevity.
Refer subsequently to
It should be collaterally mentioned that, in integrating the temporary images, if it is found that a temporary image fails to correctly integrate with a reference temporary image; that is, in estimating geometric conversion parameters between the temporary image and the selected reference temporary image, effective integration can not be successfully completed due to excessive errors, or otherwise the integration fails because of overly large errors between the temporary image and the reference temporary image caused by dramatic variations of a local object in the temporary image, the image capturing device 1 can integrate those temporary image allowable for correct integrations and discard the temporary image unable to be integrated. Although the brightness in the stored image finally integrated may be less than expected, the user can compensate the brightness in the stored image by means of image processing techniques so as to achieve the desired goal. Besides, suppose the error among such temporary images originates from the variation of a local object, the user may decide whether to continue to take pictures according to the magnitude of the error; if such a local variation actually occupies just a relatively small area, then the user can continue the photographic operation and eliminate the local error through de-ghosting methods. In this way, integral output image quality can be still enhanced.
Refer to
Although the concept about the exposure time adjusting method for the image capturing device according to the present invention has been explained together with the descriptions on the operational processes of the image capturing device, to facilitate more thorough understanding, a flowchart thereof is additionally depicted hereunder for detailed illustrations.
Refer to
In step S61, a plurality of temporary images are captured by using an image capturing module;
In step S62, a photographic condition is acquired by sensing the vibration state of the image capturing device or using an image analyzing module to perform analyses on the clarity in each of the temporary images;
In step S63, while the image capturing module captures the temporary images, the exposure time is dynamically adjusted for each of the temporary images according to a user record file or the photographic condition with a processing module; and
In step S64, the temporary images are integrated by means of an image integrated module to generate a stored image.
The detailed descriptions and implementation approaches concerning the exposure time adjusting method for the image capturing device according to the present invention have been previously illustrated with regards to the image capturing device and electronic device of the present invention which will be herein omitted for brevity.
In summary, the image capturing device and exposure time adjusting method thereof provided by the present invention allows to adaptively control the exposure time for each image based on various photographic conditions so as to reduce the processing time for multiple images in the image capturing device or portable electronic device with camera function and improve the quality of integrated images.
The aforementioned descriptions are exemplary rather than being restrictive. All effectively equivalent changes, alternation or substitutions made thereto without departing from the spirit and scope of the present invention are deemed to be encompassed by the present invention as delineated in the following claims.
Number | Date | Country | Kind |
---|---|---|---|
99139353 A | Nov 2010 | TW | national |
Number | Name | Date | Kind |
---|---|---|---|
20070159658 | Kato | Jul 2007 | A1 |
20090091633 | Tamaru | Apr 2009 | A1 |
20090207279 | Ochi | Aug 2009 | A1 |
20100128146 | Nojima | May 2010 | A1 |
20100214426 | Kimura | Aug 2010 | A1 |
20110090372 | Doida | Apr 2011 | A1 |
20120007996 | Bilcu | Jan 2012 | A1 |
20120274795 | Tanaka | Nov 2012 | A1 |
20130120603 | Yamazaki | May 2013 | A1 |
20140055629 | Ochi | Feb 2014 | A1 |
Number | Date | Country | |
---|---|---|---|
20120120263 A1 | May 2012 | US |