1. Field of the Invention
The invention relates to an image capturing apparatus, and more particularly to an image capturing apparatus of a handheld electronic apparatus.
2. Description of Related Art
With advancement of electronic technologies, handheld electronic apparatuses have become an important tool in daily lives. A handheld electronic apparatus is usually disposed with an image capturing apparatus which is now a standard equipment for the handheld electronic apparatus.
Take a cell phone as an example, during an auto-focusing operation in conventional art, the image capturing apparatus (e.g., a camera) can scan an image by using an image sensor (e.g., a CMOS sensor) with movements of an actuator equipped therein, and record a contrast value of the image. The camera performs a focusing operation and performs an image capturing operation by selecting a proper moving distance for the actuator according to the contrast value of the image. Furthermore, in conventional art, the image capturing apparatus on the cell phone is restricted by a depth of field provided by a lens, such that a depth information of field of an image outside the depth of field can not be correctly obtained, thereby affecting a quality of the image being captured.
The invention is directed to a plurality of image capturing apparatuses and method for obtaining depth information of field thereof, which is capable effectively calculate the depth information of field of a target image.
An image capturing apparatus of the invention includes a first image capturer, a second image capturer and a controller. The first image capturer performs an image capturing operation according to a plurality of focal lengths to respectively obtain a plurality of zoom images. The second image capturer performs an image capturing operation according to one fixed focal length to obtain a fixed-focus image. The controller is coupled to the first and second image capturers, and the controller generates a plurality of depth information of field respectively corresponding to the focal lengths of the zoom images according to the fixed-focus image and the zoom image.
Another image capturing apparatus of the invention includes a first image capturer, a second image capturer and a controller. The first image capturer performs an image capturing operation according to a plurality of focal lengths to respectively obtain a plurality of first zoom images. The second image capturer performs an image capturing operation according to the focal lengths to respectively obtain a plurality of second zoom images. The controller is coupled to the first image capturer and the second image capturer, and configured to generate a plurality of depth information of field respectively corresponding to the zoom images according to the first zoom images and the second zoom images.
The invention provides a method for obtaining depth information of field, which includes: performing an image capturing operation according to a plurality of focal lengths by a first image capturer to respectively obtain a plurality of zoom images; performing an image capturing operation according to one fixed focal length by a second image capturer to obtain a fixed-focus image; and generating a plurality of depth information of field respectively corresponding to the focal lengths of the zoom images according to an image difference of the zoom images and the fixed-focus image.
The invention provides another method for obtaining depth information of field, which includes: performing an image capturing operation according to a plurality of focal lengths by a first image capturer and a second image capturer to respectively obtain a plurality of first zoom images and a plurality of second zoom images; and generating a plurality of depth information of field respectively corresponding to the focal lengths of the zoom images according to the first and the second zoom images.
based on above, the image capturing apparatus of the invention is capable of capturing different zoom images through the first image capturer according different focal lengths, capturing the fixed-focus image through the second image capturer according to one fixed focal length, and calculating the depth information of field according to the zoom images and the fixed-focus image. In addition, the image capturing apparatus of the invention is also capable of obtaining the first and the second zoom images respectively according to different focal lengths, and calculating the depth information of field according to the first and the second zoom images. In other words, the invention is capable of effectively obtaining more accurate depth information of field through the zoom images created by at least one image capturer with auto focusing capability, so as to be used as a basis for calculating the depth information of field.
To make the above features and advantages of the disclosure more comprehensible, several embodiments accompanied with drawings are described in detail as follows.
Referring to
Accordingly, the main image capturer 110 can directly move a lens according to the detection focusing distance, and perform the image capturing operation on the target object. In other words, the main image capturer 110 can perform the focusing operations without repeatedly moving the lens for finding an optimal focusing distance, such that a time taken by the main image capturer 110 for performing the focusing operation can be saved.
It should be noted that, the main image capturer 110 as disposed in the present embodiment is a high-resolution image capturer, whereas the auxiliary image capturer 120 is a low-resolution image capturer. In other word, a speed for obtaining the image contrast values corresponding the focusing distances by using the auxiliary image capturer 120, is a lot faster than a speed for obtaining the same by using the main image capturer 110. In the present embodiment, a speed for performing the focusing operations by the auxiliary image capturer 120 is at least 8 times a speed for performing the focusing operation by the main image capturer 110.
Referring to
On a basis that the disposing positions of the main image capturer 210 and the auxiliary image capturer 220 are sure to be different from one another, the controller 230 performs a conversion according to the detection focusing distance, and generates a main focusing distance accordingly. The main focusing distance can be directly provided for the main image capturer 210 to perform the focusing operations. Therein, the controller 230 can perform the conversion of the detection focusing distance and the main focusing distance by utilizing a relation between a distance from the main image capturer 210 to the target object and a distance from the auxiliary image capturer 220 to the target object. Above-mentioned relation between the distances can be obtained by a designer by performing practical measurements to the image capturing apparatus 200. Data content of the relation can be implemented into a lookup table and recorded in a memory.
In addition, the main image capturer 210 can include a main image sensing chip, and the auxiliary image capturer 220 can include an auxiliary image sensing chip. A size of the main image sensing chip 210 is greater than a size of the auxiliary image sensing chip 220.
Referring to
In view of
In addition, in
Referring to
In the present embodiment, the main actuator 411 and the auxiliary actuator 412 can be a voice coil motor (VCM), a stepping motor or motors in various types. The voice coil motor is an apparatus capable of converting an electrical energy into a mechanical energy while realizing a linear movement and a movement with limited swing angle. The voice coil motor generates a regular movement by utilizing a mutual effect of magnetic poles between a magnetic field from a permanent magnet steel and a magnetic field generated by conducting coil conductors. Since the voice coil motor is a non-commutated power apparatus, a positioning accuracy thereof is fully depended on a control system of the voice coil motor. The stepping motor is a motor having stators and rotors which are projected as wheels jointing each other, and gradually rotating in a specific angle by switching a current flowed into a stator coil. The stepping motor can switch triggering operations of the current through a pulse signal without performing a detecting operations on positions and speeds of the rotors. Thus, the stepping motor can rotate accurately and proportionally according to the pulse signal being received, so as to accurately control a position and a speed thereof, thereby providing a more preferable stability.
For an implementation of the lookup table 440, the lookup table 440 can be constructed by using a non-volatile memory module, so that the relation of the curves 310 and 320 depicted in
Besides being disposed outside the controller 430 as to be coupled to the controller 430, the lookup table 440 can also be embedded in the controller 430. In summary, a location of the lookup table 440 is not particularly limited.
Referring to
Referring to
In addition, for assigning a portion on the target object, a user can select the target object to the focused by using a touching method on a display frame displayed on the screen of the handheld electronic apparatus. Or, the handheld electronic apparatus can recognize a face portion of a person within the view range by using a facial recognition technology, so as to perform the focusing operation on the face portion of the person which is served as the target object. Of course, the handheld electronic apparatus can also select the target object suitable for the embodiments of the invention by using other methods.
Relevant implementation detail for the steps above has been described in the previous embodiments and implementations, thus it is omitted hereinafter.
Referring to
When the image capturer 710 performs the image capturing operation to the image 800, the focusing operation may performed to the objects B1 to B3 to generate a plurality of focal lengths, and a plurality of zoom images 821 to 823 may be captured according to those different focal lengths. The zoom image 821 is image data obtained by the image capturer 710 according the focal length being relatively farther, wherein the focal length is obtained by focusing on the object B3 served as the background including the mountain and the sun, and, the object B3 with the mountain and the sun is an object that is relatively clearer. The zoom image 822 is image data obtained by the image capturer 710 according the focal length being relatively closer, wherein the focal length is obtained by focusing on the object B2 with the human pattern, and, the object B2 with the human pattern is an object that is relatively clearer. The zoom image 823 is image data obtained by the image capturer 710 according the focal length being the closest, wherein the focal length is obtained by focusing on the object B1 with the little flower pattern, and, the object B1 with the human pattern is an object that is relatively clearer.
On the other hand, the image capturer 720 performs the image capturing operation to the image 800 according to one fixed focal length to obtain one fixed-focus image, and an image resolution of the image capturer 720 may be lower than an image resolution of the image capturer 710. And, the controller 730 receives the zoom images 821 to 823 obtained by the image capturer 710 and the fixed-focus image obtained by the image capturer 720, and then calculates a plurality of depth information of field of the image 800 according to the zoom images 821 to 823 and the fixed-focus image.
As implementation detail for obtaining the depth information of field, the controller 830 may perform an image processing to the zoom images 821 to 823, and respectively capture clear object images from the clear objects B3 to B1 therein. In an implementation of the present embodiment, the controller 830 may perform an image merging operation to the obtained clear object images, so as to generate a complete clear object image. Then, the controller 830 performs a calculation by using the complete clear object image together with the zoom images, so as to obtain the depth information of field of the image 800.
In another implementation of the present embodiment, the controller 830 may respectively perform the calculation for the depth information of field by using the zoom images 821 to 823 together with the fixed-focus image, so as to obtain the depth information of field of the image 800.
In other embodiments of the invention, the image capturers 710 and 720 may also be image capturers having similar resolutions. And, the image capturers 710 and 720 respectively perform the image capturing operations to the image 800 according to a plurality of focal lengths, so as obtain a plurality of zoom images, respectively. Referring to
In
Herein, the controller 730 may calculate a depth information of field for the clear object images 911 and 921, calculate another depth information of field for the clear object images 912 and 922, and calculate yet another depth information of field for the clear object images 913 and 923. Or, as another implementation, the controller 730 may also merge the clear object images 911 to 913 into one clear object image, and merge the clear object images 921 to 923 into another cleat object image. The controller 730 may then calculate the depth information of field according to said two clear image object images.
Referring to
It should be noted that, when the image capturing apparatus 1000 is adapted in the handheld electronic apparatus, the distance d between the image capturers 1011 and 1012 may be not greater than 7 cm.
Additionally, it should also be noted that, the image capturers 1011 and 1012 may be disposed in parallel on the image capturing apparatus 1000, and may perform the image capturing operation to the object OBJ respectively according to different focal lengths. Accordingly, images respectively captured by the image capturers 1011 and 1012 may be used as a stereopsis or video for the object OBJ, and said images may be merged by an image synchronizer in the image capturing apparatus 1000 to generate a merged image. The image capturing apparatus 1000 may also include an image adjuster to filter out an image attenuation in said merged image, so as to generate an adjusted image.
Referring to
The depth information of field calculator 1130 may receive the clear object images generated by the secondary image processing unit 1110 and the processed fixed-focus image generated by the primary image processing unit 1120, so as to calculate the depth information of field. Or, the depth information of field calculator 1130 may also receive the clear object images generated by the secondary and the primary image processing units 1110 and 1120, so as to calculate the depth information of field. The depth information of field calculated by the depth information of field calculator 1130 may be transmitted to the storage apparatus 1101 for storage. The depth of field map merging unit 1140 is coupled to the storage apparatus 1101, and configured to read the depth information of field from the storage apparatus 1101 to be merged for generating a depth of filed map DTH_MAP.
In another embodiment of the invention, the secondary image processing unit 1110 may perform an image capturing operation to a plurality of partial regions having an image clarity higher than a threshold in the zoom images, so as to obtain a plurality of partial region images. The primary image processing unit 1120 may process the fixed-focus image to generate the processed fixed-focus image. The depth information of field calculator 1130 may generate a plurality of depth information of field respectively corresponding to the partial region images according to the obtained partial region images and the fixed-focus image. Then, the depth of field map merging unit 1140 may generate the depth of field map DTH_MAP accordingly.
It should be noted that, the depth information of field calculator 1130 may generate a complete region image according to the partial region images, and generate the depth information of field according to an image difference of the complete region image and the processed fixed-focus image.
In yet another embodiment of the invention, in case the image capturers coupled to the secondary image processing unit 1110 and the primary image processing unit 1120 respectively perform the image capturing operation according to a plurality of focal lengths, and respectively obtains a plurality of first and second zoom images, the secondary image processing unit 1110 and the primary image processing unit 1110 are served as first and second image processing units, respectively. Therein, the first image processing unit captures a plurality of first partial region images having an image clarity higher than a threshold in the first zoom images, and the second image processing unit captures a plurality of second partial region images having an image clarity higher than a threshold in the second zoom images. The depth information of field calculator 1130 generates a first complete region image and a second complete region image according to the first and the second partial region images, and generates the depth information of field according to the first complete region image and the second complete region image.
Referring to
In above-said embodiment, an image resolution of the first image capturer is higher than an image resolution of the second image capturer, and a captured image resolution of the first image capturer is equal to a captured image resolution of the second image capturer.
In aforesaid steps, an order of step S1201 and step S1202 is not particularly limited as above, that is, the image capturing operations of the first and the second image capturers may be performed simultaneously or sequentially.
In view of
In addition, implementation detail of steps for obtaining the depth information of field in the
In summary, the invention is capable of capturing the zoom images by utilizing at least one image capturer, and calculating the depth information of field of the image according to the fixed-focus image obtained according to the fixed focal lengths or the additional zoom images. As a result, the depth information of field of the image may be effectively and accurately calculated and provided for subsequent image processing operations.
This application is a continuation-in-part application of and claims the priority benefit of a U.S. application Ser. No. 13/224,364, filed on Sep. 2, 2011 now pending. This application is also a continuation-in-part application of and claims the priority benefit of a U.S. application Ser. No. 13/937,223, filed on Jul. 9, 2013, now pending. The entirety of each of the above-mentioned patent applications is hereby incorporated by reference herein and made a part of this specification.
Number | Date | Country | |
---|---|---|---|
Parent | 13224364 | Sep 2011 | US |
Child | 14180372 | US | |
Parent | 13937223 | Jul 2013 | US |
Child | 13224364 | US |