Patent Application
20090201385
The present invention relates to an image capturing apparatus and an image capturing method, and specifically relates to such an image capturing apparatus that employs a plurality of imaging elements to capture a three dimensional image.
Conventionally, there has been well-known such a three-dimensional image capturing apparatus that captures images of a subject from different positions by employing a plurality of imaging elements, so as to measure a position (a distance) of the subject on the basis of a parallax between the images of the same subject by using parameters, such as positions of the imaging elements, a focal distance, etc. (refer to Patent Document 1-3).
In the three-dimensional image capturing apparatus abovementioned, the luminance signal Y derived from each of the wavelength signals (for instance, RGB signals, etc.) is employed for detecting the distance to the subject. Conventionally, the luminance signal Y has been found by mixing the wavelength signals, outputted form the imaging elements, at a fixed mixing ratio. For instance, with respect to the RGB signals, the luminance signal Y has been found by mixing the RGB signals according to the predetermined mixing ratio defined by the following Equation.
Y=0.3×R+0.6×G+0.3×B
Further, the three-dimensional image capturing apparatus, mentioned in the above, has been so designed that it is possible to focus the subject whose distance is in a range of several ten centimeters to infinitive, when a fixed focal lens is employed for measuring the distance to the subject. Still further, the three-dimensional image capturing apparatus has evaluated the MTF (Modulation Transfer Function) of the luminance signal Y, etc., to determine Whether or not the subject is currently in focus, and accordingly, the range finding accuracy of the subject has been depending on the abovementioned MTF. Since the luminance signal Y abovementioned includes a large amount of the G signal component, the MTF characteristic of the luminance signal Y is approximate to that of the G signal component.
Generally speaking, however, a focal point of the light reflected from the subject and penetrated through a pan-focus lens varies depending on the wavelength of the light concerned. For instance, as shown in
Accordingly, when the subject is positioned at such a close range that is equal to or shorter than several tens centimeters, the MTF characteristic of the luminance signal Y that includes a large amount of Green light signal as aforementioned is deteriorated and resulted in a blurred image, though the high MTF characteristic can be acquired with respect to the Blue light signal. Further, when the subject is a distant view, the MTF characteristic of the luminance signal Y that includes a large amount of Green light signal is deteriorated as well, though the high MTF characteristic can be acquired with respect to the Red light signal. As abovementioned, there has been a problem that, sometimes depending on the position of the subject, it is impossible to acquire a high accuracy of the range finding, when the luminance signal Y, generated by mixing the wavelength signals at a fixed mixing ratio, is employed.
The subject of the present invention is to provide an image capturing apparatus and an image capturing method, which makes it possible to conduct a high-accurate range finding operation irrespective of the position of the subject, when the image capturing apparatus and the image capturing method employs a plurality of imaging elements.
In order to solve the abovementioned subject, the invention recited in claim 1 of the “SCOPE OF CLAIMS” is characterized in that an image capturing apparatus comprises: a plurality of imaging elements to convert incident light to electric signals for every one of plural kinds of wavelengths; a luminance signal generating section that is equipped for every one of the plurality of imaging elements to mix a plurality of wavelength signals, outputted from the plurality of imaging elements, with each other at a predetermined mixture ratio, so as to generate luminance signals; a mixture ratio controlling section to change a mixture ratio of the plurality of wavelength signals in respect to every one of the plurality of imaging elements, corresponding to a positional relationship between each of the plurality of imaging elements and a subject; and a range detecting section to detect a distance to the subject, based on a correlation between the luminance signal acquired in respect to every one of the plurality of imaging elements.
According to the invention recited in claim 1 of the “SCOPE OF CLAIMS”, since the mixture ratio controlling section changes a mixture ratio of the plurality of wavelength signals, corresponding to a positional relationship between each of the plurality of imaging elements and a subject so as to utilize the light having an optimum wavelength more than ever, it becomes possible to conduct a high accurate range finding operation irrespective a current position of the subject, compared to such a case that the luminance signal, acquired by mixing the wavelength signals with each other at a fixed mixture ratio, is utilized.
The invention recited in claim 2 of the “SCOPE OF CLAIMS” is characterized in that the image capturing apparatus, recited in claim 1, further comprises: a position detecting section to detect a relative positional relationship between images of the subject, respectively focused on the plurality of imaging elements; wherein the mixture ratio controlling section changes the mixture ratio, corresponding to the positional relationship between each of the plurality of imaging elements and the subject, detected by the position detecting section.
According to the invention recited in claim 2 of the “SCOPE OF CLAIMS”, by using the relative positional relationship between images of the subject, respectively focused on the plurality of imaging elements, it becomes possible to change the mixture ratio of each of wavelength signals so as to increase the light having an optimum wavelength.
The invention recited in claim 3 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus, recited in claim 1 or 2, the mixture ratio controlling section changes the mixture ratio, by changing coefficients to be respectively multiplied to the plurality of wavelength signals.
According to the invention recited in claim 2 of the “SCOPE OF CLAIMS” by changing coefficients to be respectively multiplied to the plurality of wavelength signals, it becomes possible to change the mixture ratio of each of the wavelength signals.
The invention recited in claim 4 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus, recited in any one of claims 1-3, the mixture ratio controlling section changes the mixture ratio in such a manner that, when a distance between the subject and the imaging element is far, a ratio of longer-wavelength signals is increasing, while, when the distance between the subject and the imaging element is near, a ratio of shorter-wavelength signals is increasing.
According to the invention recited in claim 4 of the “SCOPE OF CLAIMS”, since the longer-wavelength light focuses on a subject located at a far position, while the shorter-wavelength light focuses on a subject located at a near position, by increasing the ratio of wavelength signals being in focus corresponding to a distance to the subject, it becomes possible to acquire the luminance signal having a high MTF characteristic.
The invention recited in claim 5 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus, recited in any one of claims 1-3, the mixture ratio controlling section changes the mixture ratio in such a manner that, when a distance between images of the subject, respectively focused on the imaging element, is relatively near from each other, a ratio of longer-wavelength signals is increasing, while, when the distance between the images of the subject, respectively focused on the imaging element, is relatively far from each other, a ratio of shorter-wavelength signals is increasing.
According to the invention recited in claim 5 of the “SCOPE OF CLAIMS”, since the farther the distance to the subject is, the narrower the distance between images of the subject, respectively focused on the imaging element, becomes, while the nearer the distance to the subject is, the wider the distance becomes, by increasing the ratio of wavelength signals being in focus corresponding to the distance between images of the subject, respectively focused on the imaging element, it becomes possible to acquire the luminance signal having a high MTF characteristic.
The invention recited in claim 6 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus, recited in any one of claims 1-5, the mixture ratio controlling section changes the mixture ratio for every one of plural subjects focused on a same imaging element.
According to the invention recited in claim 6 of the “SCOPE OF CLAIMS”, with respect to a plurality of subjects residing within the same frame, it becomes possible to optimize the mixture ratio of each of the wavelength signals.
The invention recited in claim 7 of the “SCOPE OF CLAIMS” is characterized in that an image capturing apparatus comprises: a plurality of imaging elements to convert incident light to electric signals for every one of plural kinds of wavelengths; a filter that is equipped for every one of the plurality of imaging elements to separate high frequency components and low frequency components from each of plural wavelength signals outputted by each of the plurality of imaging elements; a low-luminance signal generating section to mix the low frequency components of every one of the plural wavelength signals with each other at a predetermined mixture ratio so as to generate low-luminance signals; a luminance signal generating section to mix the high frequency components of every one of the plural wavelength signals with each other at a predetermined mixture ratio so as to generate high-luminance signals, and then, to add the high-luminance signals and the low-luminance signals to each other so as to generate luminance signals; and a range detecting section to detect a distance to the subject, based on a correlation between the luminance signal acquired in respect to every one of the plurality of imaging elements.
According to the invention recited in claim 7 of the “SCOPE OF CLAIMS”, since, with respect to the high frequency components, only the light being in focus of the subject remains among high frequency components of each wavelength, only by separating the high frequency components with the filter, it is possible to acquire the high-luminance signals of the mixture ratio in which the ratio of wavelength signals being in focus of the subject is increasing. Accordingly, it becomes possible to conduct a high accurate range finding operation by using the luminance signal having a high MTF characteristic.
Further, since the high frequency components and the low frequency components of each of the wavelength signals are separated from each other, and the low frequency components are mixed with each other at a fixed mixture ratio, it becomes possible to maintain a color reproduce-ability of an image to be displayed on the monitor, even when the luminance signal to be used for the positional detecting operation is also employed as the monitor-use signal.
The invention recited in claim 8 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus, recited in claim 7, the low-luminance signal generating section makes the low frequency components the mixture ratio by multiplying coefficients to the low frequency components of every one of the plural wavelength signals.
According to the invention recited in claim 8 of the “SCOPE OF CLAIMS”, by multiplying coefficients to the low frequency components of every one of the plural wavelength signals, it becomes possible to make the low frequency components a predetermined mixture ratio.
The invention recited in claim 9 of the “SCOPE OF CLAIMS” is characterized in that the image capturing apparatus, recited in claim 7 or 8, further comprises: a position detecting section to detect a relative positional relationship between images of the subject, respectively focused on the plurality of imaging elements; and a mixture ratio controlling section to change a mixture ratio of the high frequency components corresponding to a result detected by the position detecting section.
According to the invention recited in claim 9 of the “SCOPE OF CLAIMS”, by separating the high frequency components with filter, and by changing the mixture ratio of the high frequency components corresponding to the distance to the subject, it becomes possible not only to acquire the high-luminance signal having a higher MTF characteristic, but also to conduct a high accurate range finding operation.
Further, by using the relative positional relationship between images of the subject, respectively focused on the plurality of imaging elements, it also becomes possible to change the mixture ratio of each of the wavelength signals so as to increase the light having an optimum wavelength.
The invention recited in claim 10 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus, recited in claim 9, the mixture ratio controlling section changes the mixture ratio, by changing coefficients to be respectively multiplied to the high frequency components of every one of the plural wavelength signals.
According to the invention recited in claim 10 of the “SCOPE OF CLAIMS”, by changing the coefficients to be respectively multiplied to the high frequency components of every one of the plural wavelength signals, it becomes possible to change the mixture ratio of the high frequency components in the luminance signal.
The invention recited in claim 11 of the “SCOPE OF CLAIMS” is characterized in that an image capturing apparatus comprises: a plurality of imaging elements to convert incident light to electric signals for every one of plural kinds of wavelengths; a filter that is equipped for every one of the plurality of imaging elements to separate high frequency components from each of plural wavelength signals outputted by each of the plurality of imaging elements; and a range detecting section to detect a distance to the subject, based on a correlation of high-luminance signals acquired by mixing the high frequency components with each other for every imaging element.
According to the invention recited in claim 11 of the “SCOPE OF CLAIMS”, since, with respect to the high frequency components, only the light being in focus of the subject remains among high frequency components of each wavelength, only by separating the high frequency components with the filter, it is possible to acquire the high-luminance signals of the mixture ratio in which the ratio of wavelength signals being in focus of the subject is increasing. Accordingly, it becomes possible to conduct a high accurate range finding operation by using the luminance signal having a high MTF characteristic.
Further, since the high frequency components and the low frequency components of each of the wavelength signals are separated from each other, and the low frequency components are mixed with each other at a fixed mixture ratio, it becomes possible to maintain a color reproduce-ability of an image to be displayed on the monitor, even when the luminance signal to be used for the positional detecting operation is also employed as the monitor-use signal.
The invention recited in claim 12 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus recited in claim 11, a position detecting section to detect a relative positional relationship between images of the subject, respectively focused on the plurality of imaging elements; and a mixture ratio controlling section to change a mixture ratio of the high frequency components corresponding to a result of the high frequency components of every one of the plural wavelength signals detected by the position detecting section.
According to the invention recited in claim 12 of the “SCOPE OF CLAIMS”, by separating the high frequency components with the filter, and by changing the mixture ratio of the high frequency components corresponding to the distance to the subject, it becomes possible not only to acquire the high-luminance signal having a higher MTF characteristic, but also to conduct a high accurate range finding operation.
The invention recited in claim 13 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus, recited in any one of claims 9, 10 and 12, the mixture ratio controlling section changes the mixture ratio in such a manner that, when a distance between the subject and the imaging element is far, a ratio of high frequency components of longer-wavelength signals is increasing, while, when the distance between the subject and the imaging element is near, a ratio of high frequency components of shorter-wavelength signals is increasing.
According to the invention recited in claim 13 of the “SCOPE OF CLAIMS”, since the longer-wavelength light focuses on a subject located at a far position, while the shorter-wavelength light focuses on a subject located at a near position, by increasing the ratio of wavelength signals being in focus corresponding to a distance to the subject, it becomes possible to acquire the luminance signal having a high MTF characteristic.
The invention recited in claim 14 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus, recited in any one of claims 9, 10 and 12, the mixture ratio controlling section changes the mixture ratio in such a manner that, when a distance between images of the subject, respectively focused on the imaging element, is relatively near from each other, a ratio of high frequency components of longer-wavelength signals is increasing, while, when the distance between the images of the subject, respectively focused on the imaging element, is relatively far from each other, a ratio of high frequency components of shorter-wavelength signals is increasing.
According to the invention recited in claim 14 of the “SCOPE OF CLAIMS”, since the farther the distance to the subject is, the narrower the distance between images of the subject, respectively focused on the imaging element, becomes, while the nearer the distance to the subject is, the wider the distance becomes, by increasing the ratio of high frequency components of wavelength signals being in focus corresponding to the distance between images of the subject, respectively focused on the imaging element, it becomes possible to acquire the high range luminance signal having a high MTF characteristic.
The invention recited in claim 15 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus, recited in any one of claims 9, 10 and 12-14, the mixture ratio controlling section changes the mixture ratio for every one of plural subjects focused on a same imaging element.
According to the invention recited in claim 15 of the “SCOPE OF CLAIMS”, with respect to a plurality of subjects residing within the same frame, it becomes possible to optimize the mixture ratio of each of the wavelength signals.
The invention recited in claim 16 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing apparatus recited in any one of claims 1-15, the plural wavelength signals are a Red signal, a Green signal and a Blue signal.
According to the invention recited in claim 16 of the “SCOPE OF CLAIMS”, even when the plural wavelength signals are a Red signal, a Green signal and a Blue signal, it is possible to achieve the effects and actions mentioned in the foregoing.
The invention recited in claim 17 of the “SCOPE OF CLAIMS” is characterized in that an image capturing method comprises: a luminance signal generating process for generating luminance signals for every one of a plurality of imaging elements, by using the plurality of imaging elements to convert incident light to electric signals for every one of plural kinds of wavelengths, and by mixing a plurality of wavelength signals, outputted from the plurality of imaging elements, with each other at a predetermined mixture ratio; a mixture ratio controlling process for changing a mixture ratio of the plurality of wavelength signals in respect to every one of the plurality of imaging elements, corresponding to a positional relationship between each of the plurality of imaging elements and a subject; and a range detecting process for detecting a distance to the subject, based on a correlation between the luminance signal acquired in respect to every one of the plurality of imaging elements.
According to the invention recited in claim 17 of the “SCOPE OF CLAIMS”, since a mixture ratio of the plurality of wavelength signals is changed, corresponding to a positional relationship between each of the plurality of imaging elements and a subject so as to utilize the light having an optimum wavelength more than ever, it becomes possible to conduct a high accurate range finding operation irrespective a current position of the subject, compared to such a case that the luminance signal, acquired by mixing the wavelength signals with each other at a fixed mixture ratio, is utilized.
The invention recited in claim 18 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in claim 17, in the mixture ratio controlling process, by employing a position detecting section to detect a relative positional relationship between images of the subject, respectively focused on the plurality of imaging elements, the mixture ratio is changed, corresponding to the positional relationship between each of the plurality of imaging elements and the subject, detected by the position detecting section.
According to the invention recited in claim 18 of the “SCOPE OF CLAIMS”, by using the relative positional relationship between images of the subject, respectively focused on the plurality of imaging elements, it becomes possible to change the mixture ratio of each of wavelength signals so as to increase the light having an optimum wavelength.
The invention recited in claim 19 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in claim 17 or 18, in the mixture ratio controlling process, the mixture ratio is changed by changing the coefficients to be respectively multiplied to the plurality of wavelength signals.
According to the invention recited in claim 19 of the “SCOPE OF CLAIMS”, by changing the coefficients to be respectively multiplied to the plurality of wavelength signals, it becomes possible to change the mixture ratio of each of the wavelength signals.
The invention recited in claim 20 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in any one of claims 17-19, in the mixture ratio controlling process, the mixture ratio is changed in such a manner that, when a distance between the subject and the imaging element is far, a ratio of longer-wavelength signals is increasing, while, when the distance between the subject and the imaging element is near, a ratio of shorter-wavelength signals is increasing.
According to the invention recited in claim 20 of the “SCOPE OF CLAIMS”, since the longer-wavelength light focuses on a subject located at a far position, while the shorter-wavelength light focuses on a subject located at a near position, by increasing the ratio of wavelength signals being in focus corresponding to a distance to the subject, it becomes possible to acquire the luminance signal having a high MTF characteristic.
The invention recited in claim 21 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in any one of claims 17 -19, in the mixture ratio controlling process, the mixture ratio is changed in such a manner that, when a distance between images of the subject, respectively focused on the imaging element, is relatively near from each other, a ratio of longer-wavelength signals is increasing, while, when the distance between the images of the subject, respectively focused on the imaging element, is relatively far from each other, a ratio of shorter-wavelength signals is increasing.
According to the invention recited in claim 21 of the “SCOPE OF CLAIMS”, since the farther the distance to the subject is, the narrower the distance between images of the subject, respectively focused on the imaging element, becomes, while the nearer the distance to the subject is, the wider the distance becomes, by increasing the ratio of wavelength signals being in focus corresponding to the distance between images of the subject, respectively focused on the imaging element, it becomes possible to acquire the luminance signal having a high MTF characteristic.
The invention recited in claim 22 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in any one of claims 17 -21, in the mixture ratio controlling process, the mixture ratio is changed for every one of plural subjects focused on a same imaging element.
According to the invention recited in claim 22 of the “SCOPE OF CLAIMS”, with respect to a plurality of subjects residing within the same frame, it becomes possible to optimize the mixture ratio of each of the wavelength signals.
The invention recited in claim 23 of the “SCOPE OF CLAIMS” is characterized in that an image capturing method comprises: a plurality of imaging elements to convert incident light to electric signals for every one of plural kinds of wavelengths; a low-luminance signal generating process, by employing a filter for separating high frequency components and low frequency components from each of plural wavelength signals outputted by each of the plurality of imaging elements, for mixing the low frequency components of every one of the plural wavelength signals with each other at a predetermined mixture ratio so as to generate low-luminance signals; a luminance signal generating process for mixing the high frequency components of every one of the plural wavelength signals with each other at a predetermined mixture ratio so as to generate high-luminance signals, and then, for adding the high-luminance signals and the low-luminance signals to each other so as to generate luminance signals; and a range detecting process for detecting a distance to the subject, based on a correlation between the luminance signal acquired in respect to every one of the plurality of imaging elements.
According to the invention recited in claim 23 of the “SCOPE OF CLAIMS”, since, with respect to the high frequency components, only the light being in focus of the subject remains among high frequency components of each wavelength, only by separating the high frequency components with the filter, it is possible to acquire the high-luminance signals of the mixture ratio in which the ratio of wavelength signals being in focus of the subject is increasing. Accordingly, it becomes possible to conduct a high accurate range finding operation by using the luminance signal having a high MTF characteristic.
Further, since the high frequency components and the low frequency components of each of the wavelength signals are separated from each other, and the low frequency components are mixed with each other at a fixed mixture ratio, it becomes possible to maintain a color reproduce-ability of an image to be displayed on the monitor, even when the luminance signal to be used for the positional detecting operation is also employed as the monitor-use signal.
The invention recited in claim 24 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in claim 23, the low frequency components is made to be the mixture ratio by multiplying coefficients to the low frequency components of every one of the plural wavelength signals.
According to the invention recited in claim 24 of the “SCOPE OF CLAIMS”, by multiplying coefficients to the low frequency components of every one of the plural wavelength signals, it becomes possible to make the low frequency components a predetermined mixture ratio.
The invention recited in claim 25 of the “SCOPE OF CLAIMS” is characterized in that the image capturing method recited in claim 23 or 24, further comprises: a mixture ratio controlling process, by employing a position detecting section to detect a relative positional relationship between images of the subject respectively focused on the plurality of imaging elements, for changing a mixture ratio of the high frequency components corresponding to a result detected by the position detecting section.
According to the invention recited in claim 25 of the “SCOPE OF CLAIMS”, by separating the high frequency components with filter, and by changing the mixture ratio of the high frequency components corresponding to the distance to the subject, it becomes possible not only to acquire the high-luminance signal having a higher MTF characteristic, but also to conduct a high accurate range finding operation.
Further, by using the relative positional relationship between images of the subject, respectively focused on the plurality of imaging elements, it also becomes possible to change the mixture ratio of each of the wavelength signals so as to increase the light having an optimum wavelength.
The invention recited in claim 26 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in claim 25, in the mixture ratio controlling process, the mixture ratio is changed by changing coefficients to be respectively multiplied to the high frequency components of every one of the plural wavelength signals.
According to the invention recited in claim 26 of the “SCOPE OF CLAIMS”, by changing the coefficients to be respectively multiplied to the high frequency components of every one of the plural wavelength signals, it becomes possible to change the mixture ratio of the high frequency components in the luminance signal.
The invention recited in claim 27 of the “SCOPE OF CLAIMS” is characterized in that an image capturing method comprises: a plurality of imaging elements to convert incident light to electric signals for every one of plural kinds of wavelengths; and a range detecting process, by employing a filter for separating high frequency components from each of plural wavelength signals outputted by each of the plurality of imaging elements, for detecting a distance to the subject, based on a correlation of high-luminance signals acquired by mixing the high frequency components with each other for every imaging element.
According to the invention recited in claim 27 of the “SCOPE OF CLAIMS”, since, with respect to the high frequency components, only the light being in focus of the subject remains among high frequency components of each wavelength, only by separating the high frequency components with the filter, it is possible to acquire the high-luminance signals of the mixture ratio in which the ratio of wavelength signals being in focus of the subject is increasing. Accordingly, it becomes possible to conduct a high accurate range finding operation by using the luminance signal having a high MTF characteristic.
Further, since the high frequency components and the low frequency components of each of the wavelength signals are separated from each other, and the low frequency components are mixed with each other at a fixed mixture ratio, it becomes possible to maintain a color reproduce ability of an image to be displayed on the monitor, even when the luminance signal to be used for the positional detecting operation is also employed as the monitor-use signal.
The invention recited in claim 28 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in claim 27, a mixture ratio controlling process, by employing a position detecting section to detect a relative positional relationship between images of the subject respectively focused on the plurality of imaging elements, for changing a mixture ratio of the high frequency components corresponding to a result of the high frequency components of every one of the plural wavelength signals detected by the position detecting section.
According to the invention recited in claim 28 of the “SCOPE OF CLAIMS”, by separating the high frequency components with the filter, and by changing the mixture ratio of the high frequency components corresponding to the distance to the subject, it becomes possible not only to acquire the high-luminance signal having a higher MTF characteristic, but also to conduct a high accurate range finding operation.
The invention recited in claim 29 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in any one of claims 25, 26 and 28, in the mixture ratio controlling process, the mixture ratio is changed in such a manner that, when a distance between the subject and the imaging element is far, a ratio of longer-wavelength signals is increasing, while, when the distance between the subject and the imaging element is near, a ratio of shorter-wavelength signals is increasing.
According to the invention recited in claim 29 of the “SCOPE OF CLAIMS”, since the longer-wavelength light focuses on a subject located at a far position, while the shorter wavelength light focuses on a subject located at a near position, by increasing the ratio of wavelength signals being in focus corresponding to a distance to the subject, it becomes possible to acquire the luminance signal having a high MTF characteristic.
The invention recited in claim 30 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in any one of claims 25, 26 and 28, in the mixture ratio controlling process, the mixture ratio is changed in such a manner that, when a distance between images of the subject, respectively focused on the imaging element, is relatively near from each other, a ratio of high frequency components of longer-wavelength signals is increasing, while, when the distance between the images of the subject, respectively focused on the imaging element, is relatively far from each other, a ratio of high frequency components of shorter-wavelength signals is increasing.
According to the invention recited in claim 30 of the “SCOPE OF CLAIMS”, since the farther the distance to the subject is, the narrower the distance between images of the subject, respectively focused on the imaging element, becomes, while the nearer the distance to the subject is, the wider the distance becomes, by increasing the ratio of high frequency components of wavelength signals being in focus corresponding to the distance between images of the subject, respectively focused on the imaging element, it becomes possible to acquire the high range luminance signal having a high MTF characteristic.
The invention recited in claim 31 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in any one of claims 25, 26 and 28-30, in the mixture ratio controlling process, the mixture ratio is changed for every one of plural subjects focused on a same imaging element.
According to the invention recited in claim 31 of the “SCOPE OF CLAIMS”, with respect to a plurality of subjects residing within the same frame, it becomes possible to optimize the mixture ratio of each of the wavelength signals.
The invention recited in claim 32 of the “SCOPE OF CLAIMS” is characterized in that, in the image capturing method recited in any one of claims 17 -31, the plural wavelength signals are a Red signal, a Green signal and a Blue signal.
According to the invention recited in claim 32 of the “SCOPE OF CLAIMS”, even when the plural wavelength signals are a Red signal, a Green signal and a Blue signal, it is possible to achieve the effects and actions mentioned in the foregoing.
According to the invention recited in claim 1 or 17 of the “SCOPE OF CLAIMS”, it becomes possible to conduct a high accurate range finding operation irrespective a current position of the subject.
According to the invention recited in claim 2 or 18 of the “SCOPE OF CLAIMS”, it becomes possible to change the mixture ratio of each of wavelength signals so as to increase the light having an optimum wavelength.
According to the invention recited in claim 3 or 19 of the “SCOPE OF CLAIMS”, by changing coefficients to be respectively multiplied to the plurality of wavelength signals, it becomes possible to change the mixture ratio of each of wavelength signals.
According to the invention recited in claim 4 or 20 of the “SCOPE OF CLAIMS”, it becomes possible not only to acquire the high-luminance signal, in which the ratio of the high frequency components being suitable for the subject is increased and which has a higher MTF characteristic, but also to conduct a high accurate range finding operation.
According to the invention recited in claim 5 or 21 of the “SCOPE OF CLAIMS”, it becomes possible not only to acquire the high-luminance signal, in which the ratio of the high frequency components being suitable for the subject is increased and which has a higher MTF characteristic, but also to conduct a high accurate range finding operation.
According to the invention recited in claim 6 or 22 of the “SCOPE OF CLAIMS”, with respect to a plurality of subjects residing within the same frame, it becomes possible to optimize the mixture ratio of each of the wavelength signals.
According to the invention recited in claim 7 or 23 of the “SCOPE OF CLAIMS”, it becomes possible not only to acquire the high-luminance signal, in which the ratio of the high frequency components being suitable for the subject is increased and which has a higher MTF characteristic, but also to conduct a high accurate range finding operation.
Further, it becomes possible to maintain a color reproduce-ability of an image to be displayed on the monitor, even when the luminance signal to be used for the positional detecting operation is also employed as the monitor-use signal.
According to the invention recited in claim 8 or 24 of the “SCOPE OF CLAIMS”, it becomes possible to make the low frequency components a predetermined mixture ratio.
According to the invention recited in claim 9 or 25 of the “SCOPE OF CLAIMS”, it becomes possible not only to acquire the high-luminance signal having a higher MTF characteristic, but also to conduct a high accurate range finding operation. Further, it also becomes possible to change the mixture ratio of each of the wavelength signals so as to increase the light having an optimum wavelength.
According to the invention recited in claim 10 or 26 of the “SCOPE OF CLAIMS”, it becomes possible to change the mixture ratio of the high frequency components in the luminance signal.
According to the invention recited in claim 11 or 27 of the “SCOPE OF CLAIMS”, it becomes possible not only to acquire the high-luminance signal, in which the ratio of the high frequency components being suitable for the subject is increased and which has a higher MTF characteristic, but also to conduct a high accurate range finding operation.
Further, it becomes possible to maintain a color reproduce-ability of an image to be displayed on the monitor, even when the luminance signal to be used for the positional detecting operation is also employed as the monitor-use signal.
According to the invention recited in claim 12 or 28 of the “SCOPE OF CLAIMS”, it becomes possible not only to acquire the high-luminance signal having a higher MTF characteristics but also to conduct a high accurate range finding operation.
According to the invention recited in claim 13 or 29 of the “SCOPE OF CLAIMS”1 it becomes possible not only to acquire the high-luminance signal, in which the ratio of the high frequency components being suitable for the subject is increased and which has a higher MTF characteristic, but also to conduct a high accurate range finding operation.
According to the invention recited in claim 14 or 30 of the “SCOPE OF CLAIMS”, it becomes possible not only to acquire the high-luminance signal, it becomes possible not only to acquire the high-luminance signal, in which the ratio of the high frequency components being suitable for the subject is increased and which has a higher MTF characteristic, but also to conduct a high accurate range finding operation.
According to the invention recited in claim 15 or 31 of the “SCOPE OF CLAIMS”, with respect to a plurality of subjects residing within the same frame, it becomes possible to optimize the mixture ratio of each of the wavelength signals.
According to the invention recited in claim 16 or 32 of the “SCOPE OF CLAIMS”, even when the plural wavelength signals are a Red signal, a Green signal and a Blue signal, it is possible to achieve the effects and actions mentioned in the foregoing.
a),
a),
Referring to
As shown in
Further, lens units 3a and 3b, each of which is constituted by a plurality of lenses to focus the subject image onto a focal surface of either the imaging element 2a or 2b and an aperture section to adjust an amount of light condensed by the plurality of lenses, is provided in front of the imaging elements 2a and 2b, respectively.
Still further, each of imaging elements 2a and 2b converts the incident light to electric signals for every one of plural kinds of wavelengths of the incident light. In each of imaging elements 2a and 2b embodied in the present invention, pixels provided with color wavelength filters of R (Red), G (Green), B (Blue) are sequentially and repeatedly aligned in a horizontal direction, so as to output sequentially-repeated signals of the R (Red), G (Green), B (Blue) signals.
Still further, as shown in
As shown in
Further, with respect to the imaging elements 2a and 2b that constitutes the 3D camera, the larger the distance between each of the imaging elements 2a, 2b and the subject is, the narrower the positional interval, between positions at which the lights penetrated through the lens units 3a and 3b are in focus, becomes, while the shorter the distance between each of the imaging elements 2a, 2b and the subject is, the wider the positional interval, between positions at which the lights penetrated through the lens units 3a and 3b are in focus, becomes. The interval between imaging elements 2a and 2b is the minimum value of the mutual distance, and is equivalent to the distance between the focal surfaces of both of them when the subject is located at infinitive. In the present embodiment, the light receiving surface of each of the imaging elements 2a and 2b is divided into the areas corresponding to the mutual distance between the focal positions abovementioned. In addition, as aforementioned, each of the areas varies depending on the position of the subject.
As a result of the abovementioned, the R light is in focus most sharply at the R area whose mutual distance between the focal positions on the light receiving surfaces of the imaging elements 2a and 2b is the shortest, while, whose mutual distance between the focal positions is the longest, and the G light is in focus most sharply at the G area whose mutual distance between the focal positions is the intermediate length. In
Next, a functional configuration of the image capturing apparatus 1 embodied in the present invention will be detailed in the following. As shown in
A combination of the lenses included in each of the lens units 3a, 3b projects the light reflected from the subject onto the focal surface of corresponding one of the imaging elements 2a, 2b, and at the same time, the aperture section adjusts the amount of light to be Condensed onto the focal surface of corresponding one of the imaging elements 2a, 2b.
Further, the image capturing apparatus 1 is provided with a system controlling section 4. The system controlling section 4 is constituted by a CPU (Central Processing Unit), a RAM (Random Access Memory) provided with semiconductor rewritable memory devices and a ROM (Read Only Memory) provided with nonvolatile semiconductor memory devices.
Still further, various kinds of constituent sections included in the image capturing apparatus 1 are coupled to the system controlling section 4, so that the system controlling section 4 drives and/or controls the various kinds of constituent sections by developing various kinds of processing programs, stored in advance in the ROM, onto the RAM and making the CPU execute the processing programs developed on the RAM.
As shown in
Each of the aperture controlling sections 5a, 5b drives and controls the aperture section for adjusting the amount of light to be condensed by the corresponding one of the lens units 3a, 3b. Concretely speaking, based on a controlling value inputted from the system controlling section 4, each of the aperture controlling sections 5a, 5b opens the aperture section just before the image capturing operation of the corresponding one of the imaging elements 2a and 2b is commenced, and then, closes the aperture section when a predetermined time has elapsed, while, during the time of deactivating the image capturing operation, the aperture controlling sections 5a, 5b make the aperture section shut off the incident light coming into the each of the imaging elements 2a and 2b.
Each of the timing signal generating sections 6a, 6b generates predetermined timing pulses and outputs the generated timing pulses to the corresponding one of the imaging elements 2a, 2b, so as to control the image capturing operation (such as a charge accumulating operation based on the exposure, an operation for reading accumulated charges) to be conducted in the corresponding one of the imaging elements 2a, 2b.
Each of the color separation interpolating sections 7a, 7b separates each of the R (Red) signal, the G (Green) signal and the B (Blue) signal from the sequentially-repeated signals of the R, G, B signals, and applies the color interpolating operation to each of the wavelength signals (for instance, electric signal of each of B, G, R colors).
Each of the monitor-use signal generating sections 8a, 5b applies various kinds of image processing, such as a black reference correction processing for correcting a black level, serving as a minimum luminance level, to a reference level; an Automatic White Balance (AWB) adjustment processing for adjusting a white balance; a color correction processing for correcting a color component value; a color space conversion processing for converting the color space from the RGB space to the YUV space; etc., to each of the R signal, the G signal and the B signal, outputted from the corresponding one of the color separation interpolating sections 7a, 7b, so as to generate the monitor-use signal.
Each of the mixture ratio controlling sections 9a, 9b changes the mixture ratio of the plurality of wavelength signals with respect to the corresponding one of the imaging elements 2a, 2b, in response to the positional relationship between the subject and the corresponding one of the imaging elements 2a, 2b. Each of the mixture ratio controlling sections 9a, 9b of the present embodiment changes the mixture ratio in such a manner that, when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is great, the ratio of the longer-wavelength signals is increasing, while, when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is small, the ratio of the shorter-wavelength signals is increasing.
Concretely speaking, with reference to the luminance signal Y1 or Y2, each derived by mixing the R signal, the G signal and the B signal at the predetermined mixture ratio, and based on the detected result (the positional relationship between the subject and the imaging element) of the position detecting section 11, each of the mixture ratio controlling sections 9a, 9b makes the ratio of the R signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively far from each other, while, makes the ratio of the B signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively near from each other, and makes the ratio of the a signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is intermediate between far and near above-mentioned.
For this purpose, each of the mixture ratio controlling sections 9a, 9b changes the mixture ratio of the plural wavelength signals by changing the coefficients to be multiply to each of the plural wavelength signals. Concretely speaking, with reference to the luminance signal Y1 or Y2=0.3R1+0.59G1+0.11B1, each of the mixture ratio controlling sections 9a, 9b changes the mixture ratio by replacing the original terms in the above-Equation of the luminance signal Y1 or Y2 with new terms of R2, Ga2, B2, which are derived by multiplying the newly-changed coefficients to the original plural wavelength signals in a multiplying circuit (not shown in the drawings). In this connection, it is applicable that the ratio of any one of the R signal, the C signal and the B signal to be included in the luminance signal Y1 or Y2 is 100%.
Still further, it is also possible for each of the mixture ratio controlling sections 9a, 9b to change the mixture ratio in such a manner that, when the distance between images of the subject, respectively projected onto the imaging elements 2a and 2b, is relatively near from each other, the ratio of the longer-wavelength signals is increasing, while, when the distance between images of the subject, respectively projected onto the imaging elements 2a and 2b, is relatively far from each other, the ratio of the shorter-wavelength signals is increasing.
Namely, it is also possible for each of the mixture ratio controlling sections 9a, 9b to change the mixture ratio of the R signal, the G signal and the B signal, corresponding to a result of detecting on which area among the R area, the G area and the B area, included in the focal surface of the corresponding one of the imaging elements 2a and 2b, the light coming from the subject is in focus. Concretely speaking, when detecting that the image of the subject focuses on the R area, each of the mixture ratio controlling sections 9a, 9b determines that the distance to the subject is relatively far from the focal surface, and accordingly, makes the ratio of the R signal increase, while, when detecting that the image of the subject focuses on the B area, it determines that the distance to the subject is relatively near from the focal surface, and accordingly, makes the ratio of the B signal increase, and further, when detecting that the image of the subject focuses on the G area, it determines that the distance to the subject is intermediate between far and near abovementioned, and accordingly, makes the ratio of the G signal increase.
Further, when the differences between the coefficients of the R signal, the G signal and the B signal are great, each of the mixture ratio controlling sections 9a, 9b establishes switching areas in the vicinity of boundary regions between the areas of the corresponding one of the imaging elements 2a and 2b. It is desirable that each of the coefficients is established, so that the value of the concerned coefficient gradually changes within the boundary region. This makes it possible to suppress the error in the position detecting operation based on the luminance signal Y1 or Y2 acquired in the vicinity of the boundary region between the areas.
As abovementioned, by changing the mixture ratio of each wavelength light so as to make the ratio of the wavelength signal, currently focusing on the subject, increase, it becomes possible to acquire the luminance signal Y1 or Y2 having a high MTF characteristic Concretely speaking, by increasing the ratio of the R signal when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively far from each other, or by increasing the ratio of the B signal when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively near from each other, or by increasing the ratio of the G signal when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is intermediate between far and near abovementioned, it becomes possible to acquire the luminance signal Y1 or Y2 having a high MTF characteristic.
Further, it is also possible for each of the mixture ratio controlling sections 9a, 9b to change the mixture ratio of each wavelength signal for every one of plural subjects focused on the same imaging element. This makes it possible to optimize the mixture ratio of each wavelength signal with respect to the plural subjects residing within a range of the same frame.
Each of the luminance signal generating sections 10a, 10b generates the luminance signal by mixing the plural wavelength signals, outputted by the corresponding one of the imaging elements 2a and 2b, with the predetermined mixture ratio. Each of the luminance signal generating sections 10a, 10b, embodied in the present invention, generates the luminance signal Y1 or Y2, by mixing the R signal, the G signal and the B signal, according to the mixture ratio changed by the corresponding one of the mixture ratio controlling sections 9a, 9b.
The position detecting section 11 detects the positional relationship between the images of the subject, respectively focused on the imaging elements 2a and 2b. Concretely speaking, initially, each of mixture ratio controlling sections 9a, 9b changes the mixture ratio, based on the result detected by the position detecting section 11 (first detected result), and then, each of the luminance signal generating sections 10a, 10b mixes the wavelength signals with the above-changed mixture ratio so as to generate the luminance signals Y1 and 2z Successively, the position detecting section 11 detects a relative positional relationship (second detected result) between the images of the same subject, respectively focused on the imaging elements 2a and 2b, by finding the correlation between the luminance signals Y1 and Y2 acquired in the above.
The range detecting section 12 detects the distance to the subject, based on the correlation between the luminance signals Y1 and Y2 acquired for every one of the imaging elements 2a and 2b. Concretely speaking, the range detecting section 12 detects the distance to the subject by deriving from the relative positional relationship between the images of the same subject, respectively focused on the imaging elements 2a and 2b, and by employing various kinds of parameters, such as positions of the imaging elements, a focal length, etc.
Next, the image capturing method employing the image capturing apparatus 1, embodied in the present invention, will be detailed in the following.
When the light coming from the subject passes through the lens units 3a and 3b, and is projected onto the focal surfaces of the imaging elements 2a and 2b, each of the imaging elements 2a and 2b electro-photographically converts the incident light to the electric signals, so as to output the sequentially-repeated signals of R (Red), G (Green), B (Blue) signals.
Successively, each of the color separation interpolating sections 7a, 7b separates each of the R signal, the G signal and the B signal from the sequentially-repeated signals of R (Red), G (Green) B (Blue) signals outputted from the corresponding one of the imaging elements 2a and 2b, and at the same time, applies the color interpolation processing to each of the wavelength signals.
Still successively, each of the monitor-use signal generating sections 8a, 8b applies various kinds of image processing, such as the black reference correction processing, the Automatic White Balance (AWB) adjustment processing, the color correction processing, a color space conversion processing, etc., to each of the R signal, the G signal and the B signal, outputted from the corresponding one of the color separation interpolating sections 7a, 7b, so as to generate the monitor-use signal.
On the other hand, each of the mixture ratio controlling sections 9a, 9b changes the mixture ratio of the R signal, the G signal and the B signal, to be included in the luminance signal Y1 or Y2, corresponding to the distance to the subject.
Concretely speaking, with reference to the luminance signal Y1 or Y2=0.3R1+0.59G1+0.11B1, and based on the result (positional relationship between the imaging element and the subject) detected by the position detecting section 11 (first detected result), each of the mixture ratio controlling sections 9a, 9b changes the mixture ratio of the plural wavelength signals by changing the coefficients to be multiply to each of the plural wavelength signals, so as to make the ratio of the R signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively far from each other, or to make the ratio of the B signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively near from each other, or to make the ratio of the G signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is intermediate between far and near abovementioned.
Further, it is also possible for each of the mixture ratio controlling sections 9a, 9b to change the mixture ratio of the R signal, the G signal and the B signal, corresponding to a result of detecting on which area among the R area, the G area and the B area, included in the focal surface of the corresponding one of the imaging elements 2a and 2b, the light coming from the subject is in focus. In this connection, each of the areas moves in response to the current position of the subject. For instance, when the subject moves in a left-right direction, each of the R area, the C area and the B area also shifts in the left-right direction.
Still successively, each of the luminance signal generating sections 10a, 10b mixes the R signal, the G signal and the B signal with each other, according to the mixture ratio currently changed by the corresponding one of the mixture ratio controlling sections 9a, 9b, so as to generate the corresponding one of the luminance signals.
Still successively, the position detecting section 11 detects the relative positional relationship between the images of the same subject, respectively focused on the imaging elements 2a and 2b, by finding the correlation between the luminance signals Y1, Y2, acquired by the luminance signal generating sections 10a, 10b.
Yet successively, the range detecting section 12 derives the position of the subject (distance to the subject) from the relative positional relationship (second detected result detected by the position detecting section 11) between the images of the same subject respectively focused on the imaging elements 2a and 2b, by employing various kinds of parameters, such as positions of the imaging elements, a focal length, etc.
According to the present embodiment described in the foregoing, by changing the mixture ratio of each of the wavelength signals in response to the positional relationship between the subject and the corresponding one of the imaging elements 2a, 2b so as to utilize such a light that has an optimum wavelength, it becomes possible to perform a high-accurate range finding operation, compared to such a conventional method that employs the luminance signal derived by mixing the wavelength signals with each other merely at a fixed mixture ratio.
Further, by employing the relative positional relationship between the images of the same subject respectively focused on the imaging elements 2a and 2b, it becomes possible to change the mixture ratio of each of the wavelength signals so as to increase an amount of light having an optimum wavelength.
Still further, by changing each of the coefficients to be multiply to each of the plural wavelength signals, it becomes possible to change the mixture ratio of each of the wavelength signals.
Still further, since the light having a long wavelength focuses on the subject located at a distant position, while the light having a short wavelength focuses on the subject located at a near position, by increasing a ratio of the wavelength signal, which is currently in focus, according to the distance to the subject, it becomes possible to acquire the luminance signal having the high MTF characteristic.
Still further, the greater the distance between the subject and each of the imaging elements 2a and 2b is, the narrower the mutual distance between the images of the subject, respectively focused on the imaging elements 2a and 2b, becomes, while the smaller the distance is, the wider the mutual distance becomes. Accordingly, based on this fact, by increasing a ratio of the wavelength signal, which is currently in focus, according to the mutual distance between the images of the subject, it also becomes possible to acquire the luminance signal having the high MTF characteristic.
Still further, with respect to the plural subjects residing within the same frame, it becomes possible to optimize the mixture ratio of each of the wavelength signals.
Yet further, even when the abovementioned wavelength signals are the R signal, the G signal and the B signal, it is possible to achieve the abovementioned features.
Next, referring to
The image capturing apparatus 1, serving as the second embodiment of the present invention, is provided with not only high pass filters 13a, 13b, as a substitute for the mixture ratio controlling sections 9a, 9b, but also low-luminance signal generating sections 14a, 14b.
Since only high frequency components, included in each of the wavelength signals outputted from the color separation interpolating sections 7a, 7b, pass through the high pass filters 13a, 13b, the high frequency components RH, GH, BH and low frequency components RL, GL, BL both included in the wavelength signals, can be separated from each other. Then, the high frequency components RH, GH, DH are outputted to the luminance signal generating sections 10a, 10b, while the low frequency components RL, GL, BL are outputted to the low-luminance signal generating sections 14a, 14b.
Each of the low-luminance signal generating sections 14a, 14b mixes the low-luminance components of the wavelength signals with each other at a predetermined mixture ratio so as to generate the corresponding one of low-luminance signals YL1, YL2. In this connection, hereinafter, the predetermined mixture ratio abovementioned is defined as a predetermined and fixed mixture ratio. In the second embodiment of the present invention, the mixture ratio of the luminance signal Y1 or Y2=0.3R1+0.59G1+0.11B1, serving as the aforementioned reference, is established as the predetermined mixture ratio, and each of the low-luminance signals YL1, YL2 is generated by mixing the low frequency components with each other, each of which is derived by multiplying a predetermined coefficient in a multiplying circuit (not shown in the drawings). Then, each of the low-luminance signals YL1, YL2 is outputted to the corresponding one of the luminance signal generating sections 10a, 10b.
Further, each of the luminance signal generating sections 10a, 10b generates a corresponding one of high-luminance signals YH1, YH2 by mixing the high frequency components of the wavelength signals with each other, and adds the high-luminance signals YH1, YH2 to the low-luminance signals YL1, YL2 so as to generate the luminance signals Y1, Y2, respectively.
As abovementioned, each of the luminance signal generating sections 10a, 10b generates the corresponding one of the high-luminance signals YH1, YH2 by mixing the high frequency components of the wavelength signals with each other, as it is (alternatively, by mixing them at the predetermined mixture ratio). Accordingly, with respect to the high frequency components, since only the light, having the wavelength that makes the subject in focus, remains among the high frequency components included in each of the wavelength signals, it becomes possible to acquire the high-luminance signals YH1, YH2, in each of which the ratio of the wavelength signal that makes the subject in focus is increased, only by employing the high pass filters 13a, 13b for separating the high-luminance signals. Concretely speaking, the ratio of the R signal increases when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively far from each other, while the ratio of the B signal increases when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively near from each other, and the ratio of the G signal increases when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is intermediate between far and near abovementioned. This makes it possible to acquire the luminance signal Y1 or Y2 having the high MTF characteristic.
Further, since the high frequency components and the low frequency components are respectively separated from each of the wavelength signals, and then, the low frequency components are mixed with each other at a fixed mixture ratio irrespective of the distance to the subject, it becomes possible to maintain a color reproduce-ability of an image to be displayed on the monitor, even when the luminance signal to be used for the positional detecting operation is also employed as the monitor-use signal.
Next, the image capturing method of the present invention, employing the image capturing apparatus 1 embodied in the present invention, will be detailed in the following.
Since only high frequency components, included in each of the wavelength signals outputted from the color separation interpolating sections 7a, 7b, pass through the high pass filters 13a, 13b, the high frequency components and the low frequency components, both included in each of the wavelength signals, can be separated from each other. Then, the high frequency components are outputted to the luminance signal generating sections 10a, 10b, while the low frequency components are outputted to the low-luminance signal generating sections 14a, 14b.
Successively, each of the low-luminance signal generating sections 14a, 14b mixes the low-luminance components of the wavelength signals with each other at the predetermined mixture ratio so as to generate the corresponding one of the low-luminance signals YL1, YL2, and outputs the generated low-luminance signals YL1, YL2, to the luminance signal generating sections 10a, 10b, respectively.
Still successively, each of the luminance signal generating sections 10a, 10b generates a corresponding one of the high-luminance signals YH1, YH2 from the high frequency components of each of the wavelength signals, which are separated by the corresponding one of the high pass filters 13a, 13b, and adds the high-luminance signals YH1, YH2 to the low-luminance signals YL1, YL2 so as to generate the luminance signals Y1, Y2, respectively. At this time, each of the luminance signal generating sections 10a, 10b generates the corresponding one of the high-luminance signals YH1, YH2 by mixing the high frequency components of each of the wavelength signals with each other, as it is.
According to the embodiment of the present invention, described in the foregoing, with respect to the high frequency components, since only the light, having the wavelength that makes the subject in focus, remains among the high frequency components included in each of the wavelength signals, it becomes possible to acquire the high-luminance signals YH1, YH2, in each of which the ratio of the wavelength signal that makes the subject in focus is increased, only by employing the high pass filters 13a, 13b for separating the high-luminance signals. This makes it possible to achieve a highly accurate range finding operation, by employing the high-luminance signals YH1, YH2 having the high MTF characteristic.
Further, since the high frequency components and the low frequency components are respectively separated from each of the wavelength signals, and then, the low frequency components are mixed with each other at a fixed mixture ratio irrespective of the distance to the subject, it becomes possible to maintain a color reproduce-ability of an image to be displayed on the monitor, even when the luminance signal to be used for the positional detecting operation is also employed as the monitor-use signal.
Still further, by multiplying the coefficients to the low frequency components for every one of the plural wavelength signals, it becomes possible to mix the low frequency components with each other at a predetermined mixture ratio.
Next, referring to
The image capturing apparatus 1, embodied in the present invention as the third embodiment, is provided with mixture ratio controlling sections 15a, 15b, in addition to the high pass filters 13a, 13b and the low-luminance signal generating sections 14a, 14b.
Each of the mixture ratio controlling sections 15a, 15b changes the mixture ratio of the high frequency components of each of the wavelength signals in response to the distance to the subject. In the third embodiment, each of the mixture ratio controlling sections 15a, 15b changes the mixture ratio in such a manner that, when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is great, the ratio of the longer-wavelength signals is increasing, while, when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is small, the ratio of the shorter-wavelength signals is increasing.
Concretely speaking, with reference to the high-luminance signals, each derived by mixing the R signal, the G signal and the B signal at the predetermined mixture ratio, and based on the result detected by the position detecting section 11, each of the mixture ratio controlling sections 15a, 15b makes the ratio of the R signal increase when the distance between the subject and the corresponding one of the imaging elements 2a/2b is relatively far from each other, while, makes the ratio of the B signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively near from each other, and makes the ratio of the G signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is intermediate between far and near abovementioned.
Further, each of the mixture ratio controlling sections 15a, 15b changes the mixture ratio by changing the coefficients to be respectively multiply to the wavelength signals of the high-luminance signals in a multiplying circuit (not shown in the drawings).
Still further, it is also possible for each of the mixture ratio controlling sections 15a, 15b to change the mixture ratio in such a manner that, when the distance between images of the subject, respectively projected onto the imaging elements 2a and 2b, is relatively near from each other, the ratio of the longer-wavelength signals is increasing, while, when the distance between images of the subject, respectively projected onto the imaging elements 2a and 2b, is relatively far from each other, the ratio of the shorter-wavelength signals is increasing.
Namely, it is also possible for each of the mixture ratio controlling sections 15a, 15b to change the mixture ratio of the R signal, the G signal and the B signal, corresponding to a result of detecting on which area among the R area, the C area and the B area, included in the focal surface of the corresponding one of the imaging elements 2a and 2b, the light coming from the subject is in focus.
According to the abovementioned feature, only by separating the high frequency components with the high pass filters 13a, 13b, as aforementioned, it becomes possible to acquire the high-luminance signals YH1, YH2, in each of which the ratio of wavelength signals that focus the subject is increasing. Further, in addition to the above, by changing the mixture ratio of the light of each wavelength, it also becomes possible to acquire the high-luminance signals YH1, YH2, each having a high MTF characteristic higher than ever.
Yet further, each of the luminance signal generating sections 10a, 10b generates a corresponding one of the high-luminance signals YH1, YH2 by mixing the high frequency components of each of the wavelength signals, according to the mixture ratio changed by the corresponding one of the mixture ratio controlling sections 15a, 15b, and adds the high-luminance signals YH1, YH2 to the low-luminance signals YL1, YL2 so as to generate the luminance signals Y1, Y2, respectively.
Next, the image capturing method of the present invention, employing the image capturing apparatus 1 embodied in the present invention, will be detailed in the following.
After each of the high pass filters 13a, 13b separates the high frequency components and the low frequency components from each of the wavelength signals, each of the mixture ratio controlling sections 15a, 15b changes the mixture ratio of the high frequency components of each of the wavelength signals, corresponding to the distance to the subject. Based on the result detected by the position detecting section 11, each of the mixture ratio controlling sections 15a, 15b makes the ratio of the R signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively far from each other, while, makes the ratio of the B signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is relatively near from each other, and makes the ratio of the G signal increase when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is intermediate between far and near abovementioned.
On the other hand, each of the low-luminance signal generating sections 14a, 14b mixes the low-luminance components of the wavelength signals with each other at the predetermined mixture ratio so as to generate the corresponding one of the low-luminance signals YL1, YL2, and outputs the generated low-luminance signals YL1, YL2, to the luminance signal generating sections 10a, 10b, respectively.
Successively, each of the luminance signal generating sections 10a, 10b generates a corresponding one of the high-luminance signals YH1, Y2 by mixing the high frequency components of each of the wavelength signals, according to the mixture ratio changed by the corresponding one of the mixture ratio controlling sections 15a, 15b, and adds the high-luminance signals YH1, YH2 to the low-luminance signals YL1, YL2 so as to generate the luminance signals Y1, Y2, respectively.
According to the embodiment of the present invention, described in the foregoing, by employing the high pass filters 13a, 13b for separating the high frequency components from the wavelength signals, and by changing the mixture ratio of the high frequency components corresponding to the distance to the subject, it becomes possible to acquire the high-luminance signals YH1, YH2 having the high MTF characteristic so as to achieve a highly accurate range finding operation.
Further, by employing the relative positional relationship between the images of the subject, respectively projected onto each of the imaging elements 2a and 2b, it becomes possible to change the mixture ratio of each of the wavelength signals so as to increase an amount of the light having an optimum wavelength.
Still further, by changing the coefficients to be respectively multiply to the high frequency components of each of the plural wavelength signals, it becomes possible to change the mixture ratio of the high frequency components in the high-luminance signals.
Still further, since the light having a long wavelength focuses on the subject located at a distant position, while the light having a short wavelength focuses on the subject located at a near position, by increasing a ratio of the low frequency components included in the wavelength signal, which is currently in focus, according to the distance to the subject, it becomes possible to acquire the luminance signal having the high MTF characteristic.
Yet further, the greater the distance between the subject and each of the imaging elements 2a and 2b is, the narrower the mutual distance between the images of the subject, respectively focused on the imaging elements 2a and 2b, becomes, while the smaller the distance is, the wider the mutual distance becomes. Accordingly, by increasing a ratio of the wavelength signal, which is currently in focus, according to the mutual distance between the images of the subject, it also becomes possible to acquire the luminance signal having the high MTF characteristic.
Next, referring to
As well as the second embodiment, the image capturing apparatus 1, serving as the forth embodiment of the present invention, is provided with the high pass filters 13a, 13b, as a substitute for the mixture ratio controlling sections 9a, 9b. However, the image capturing apparatus 1 is not provided with the low-luminance signal generating sections 14a, 14b and the luminance signal generating sections 10a, 10b.
Each of the high pass filters 13a, 13b separates only the high frequency components, included in each of the wavelength signals outputted from the color separation interpolating sections 7a, 7b, and output the separated high frequency components to the position detecting section 11.
Accordingly, with respect to the high frequency components, since only the light, having the wavelength that makes the subject in focus, remains among the high frequency components included in each of the wavelength signals as abovementioned, it becomes possible to acquire the high-luminance signals YH1, YH2, each having the mixture ratio corresponding to the distance to the subject, only by employing the high pass filters 13a, 13b for separating the high-luminance signals.
Still successively, the position detecting section 11 detects the relative positional relationship between the images of the same subject, respectively focused on the imaging elements 2a and 2b, based on the correlation between the high-luminance signals YH1, YH2 each acquired by mixing the high frequency components in respect to the corresponding one of the imaging elements 2a and 2b.
Next, the image capturing method of the present invention, employing the image capturing apparatus 1 embodied in the present invention, will be detailed in the following.
After each of the high pass filters 13a, 13b separates only the high frequency components from each of the wavelength signals, the position detecting section 11 detects the relative positional relationship between the images of the same subject, respectively focused on the imaging elements 2a and 2b, by finding the correlation between the high-luminance signals Y1, YH2, each acquired by mixing the high frequency components in respect to the corresponding one of the imaging elements 2a and 2b.
According to the embodiment of the present invention, described in the foregoing, with respect to the high frequency components, since only the light, having the wavelength that makes the subject in focus, remains among the high frequency components included in each of the wavelength signals, it becomes possible to acquire the high-luminance signals, in each of which the ratio of the wavelength signal that makes the subject in focus is increased, only by employing the high pass filters 13a, 13b for separating only the high-luminance signals. This makes it possible to achieve a highly accurate range finding operation, by employing the high-luminance signals having the high MTF characteristic.
Further, since the high frequency components and the low frequency components are respectively separated from each of the wavelength signals, and then, the low frequency components are mixed with each other at a fixed mixture ratio irrespective of the distance to the subject, it becomes possible to maintain a color reproduce-ability of an image to be displayed on the monitor, even when the luminance signal to be used for the positional detecting operation is also employed as the monitor-use signal.
Next, referring to
The image capturing apparatus 1, embodied in the present invention as the fifth embodiment, is provided with the mixture ratio controlling sections 15a, 15b, in addition to the high pass filters 13a, 13b.
As well as the abovementioned third embodiment, each of the mixture ratio controlling sections 15a, 15b changes the mixture ratio of the high frequency components of each of the wavelength signals in response to the distance to the subject. In the fifth embodiment, each of the mixture ratio controlling sections 15a, 15b changes the mixture ratio in such a manner that, when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is great, the ratio of the longer-wavelength signals is increasing, while, when the distance between the subject and the corresponding one of the imaging elements 2a, 2b is small, the ratio of the shorter-wavelength signals is increasing.
Further, it is also possible for each of the mixture ratio controlling sections 15a, 15b to change the mixture ratio in such a manner that, when the distance between images of the subject, respectively projected onto the imaging elements 2a and 2b, is relatively near from each other, the ratio of the longer-wavelength signals is increasing, while, when the distance between images of the subject, respectively projected onto the imaging elements 2a and 2b, is relatively far from each other, the ratio of the shorter-wavelength signals is increasing.
According to the abovementioned feature, only by separating the high frequency components with the high pass filters 13a, 13b, as aforementioned, it becomes possible to acquire the high-luminance signals YH1, YH2, in each of which the ratio of wavelength signals that focus the subject is increasing. Further, in addition to the above, by changing the mixture ratio of the light of each wavelength, it also becomes possible to acquire the high-luminance signals YH1, YH2, each having a high MTF characteristic higher than ever.
Still further, the position detecting section 11 detects the relative positional relationship between the images of the same subject, respectively focused on the imaging elements 2a and 2b, based on the correlation between the high-luminance signals YH1, YH2, each acquired by mixing the high frequency components in respect to the corresponding one of the imaging elements 2a and 2b, according to the mixture ratio changed by the corresponding one of the mixture ratio controlling sections 15a, 15b.
Next, the image capturing method of the present invention, employing the image capturing apparatus 1 embodied in the present invention, will be detailed in the following.
After each of the high pass filters 13a, 13b separates only the high frequency components from each of the wavelength signals, each of the mixture ratio controlling sections 15a, 15b changes the mixture ratio of the high frequency components of each of the wavelength signals, corresponding to the distance to the subject.
Successively, the position detecting section 11 detects the relative positional relationship between the images of the same subject, respectively focused on the imaging elements 2a and 2b, based on the correlation between the high-luminance signals YH1, YH2, each acquired by mixing the high frequency components in respect to the corresponding one of the imaging elements 2a and 2b, according to the mixture ratio changed by the corresponding one of the mixture ratio controlling sections 15a, 15b.
According to the embodiment of the present invention, described in the foregoing, by employing the high pass filters 13a, 13b for separating the high frequency components from the wavelength signals, and by changing the mixture ratio of the high frequency components corresponding to the distance to the subject, it becomes possible to acquire the high-luminance signals YH1, YH2 having the high MTF characteristic so as to achieve a highly accurate range finding operation.
Further, since the light having a long wavelength focuses on the subject located at a distant position, while the light having a short wavelength focuses on the subject located at a near position, by increasing a ratio of the low frequency components included in the wavelength signal, which is currently in focus, according to the distance to the subject, it becomes possible to acquire the luminance signal having the high MTF characteristic.
Yet further, the greater the distance between the subject and each of the imaging elements 2a and 2b is, the narrower the mutual distance between the images of the subject, respectively focused on the imaging elements 2a and 2b, becomes, while the smaller the distance is, the wider the mutual distance becomes. Accordingly, by increasing a ratio of the wavelength signal, which is currently in focus, according to the mutual distance between the images of the subject, it also becomes possible to acquire the luminance signal having the high MTF characteristic.
As described in the foregoing, according to the image capturing apparatus and the image capturing method embodied in the present invention, in an image capturing apparatus and an image capturing method, both employing a plurality of imaging elements, it becomes possible to perform a highly accurate range finding operation irrespective a current position of the subject.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2006139172 | May 2006 | JP | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/JP2007/059851 | 5/14/2007 | WO | 00 | 11/14/2008 |
