Patent Application
20160029005
This disclosure relates to an image-capturing apparatus and an image-capturing method. More particularly, this disclosure relates to an image-capturing apparatus and an image-capturing method for capturing a subject as a three-dimensional image.
In the past, a system has been suggested, which causes two video cameras provided at the right and left to simultaneously capture images of a subject, and displays a three-dimensional image by simultaneously outputting the obtained two types of images (right eye image and left eye image). However, when the two video cameras are used, the size of the apparatus increases, which is not practical. A base line length between the two video cameras, i.e., a distance between both eyes as a three-dimensional camera, is often set at about 65 mm corresponding to the distance between both eyes of a person regardless of a zoom ratio of the lenses. In such case, in a zoomed-up image, parallax between both eyes increases, and this forces the optical system of an observer to perform information processing that is different from ordinary processing, and this becomes a cause of visual fatigue. When a moving subject is captured by two video cameras, it is necessary to perform precise synchronization control of the two video cameras, which is extremely difficult, and it is also extremely difficult to precisely control a convergence angle.
In order to facilitate adjustment of a lens system for three-dimensional shooting, a three-dimensional shooting apparatus has been suggested, which shares the same optical system by combining polarization filters for polarization in directions perpendicular to each other (for example, see Japanese Patent Application Publication No. H6-054991.
A method has been suggested, in which three-dimensional shooting is performed by an image-capturing apparatus including two lenses and image-capturing means (for example, see Japanese Patent Application Laid-Open No. 2004-309868). The image-capturing apparatus disclosed in this Japanese Patent Application Laid-Open includes: image-capturing means in which pixels corresponding to an integral multiple of a predetermined number of scan lines are provided on an image-capturing surface; a first horizontal component polarization means for passing a horizontal component of a first video light from a subject; and a first vertical component polarization means which is provided at a position away from the first horizontal component polarization means by a predetermined distance, and which passes only a vertical component of a second video light from the subject, wherein the horizontal component that is passed by the first horizontal component polarization means is condensed onto pixels of a predetermined range on the image-capturing surface, and the vertical component that is passed by the first vertical component polarization means is condensed onto pixels of in a remaining range except the predetermined range. More specifically, the horizontal component polarization filter and the vertical component polarization filter spaced apart with an interval corresponding to parallax of a person are provided with two lenses at positions away from each other by a predetermined distance from the image-capturing surface of the CCD.
Patent Document 1: Japanese Patent Application Publication No. H6-054991
By the way, in the technique disclosed in Japanese Patent Application Publication No. H6-054991, the optical path is made into one system by overlaying the outputs of the two polarization filters, whereby the same lens system is shared. However, in order to extract a right eye image and a left eye image in a later stage, polarization filters are required in addition, so that the optical path itself is divided again to allow the light to be incident upon separate polarization filters, and this causes loss of light in the lens system, and moreover, there is a problem in that it is difficult to reduce the size of the apparatus. In the technique disclosed in Japanese Patent Application Laid-Open No. 2004-309868, two combinations of lenses and polarization filters are required, and this inevitably results in a complicated and large apparatus. It is not practical to take not only a three-dimensional image but also ordinary two-dimensional image using the above image-capturing apparatuses, because the apparatuses are complicated.
Therefore, it is a first object of this disclosure to provide an image-capturing apparatus and an image-capturing method using the related image-capturing apparatus having a simple configuration and structure, wherein a subject can be captured by a single image-capturing apparatus as a three-dimensional image. A second object of this disclosure is to provide an image-capturing apparatus having a simple configuration and structure and capable of shooting an ordinary two-dimensional image.
In order to achieve the above first object, an image-capturing apparatus according to a first aspect of this disclosure includes: (A) first polarization means for polarizing light from a subject; (B) a lens system for condensing light from the first polarization means; and (C) an image-capturing device array in which image-capturing devices are arranged in a two-dimensional matrix form in a first direction and a second direction perpendicular to the first direction, wherein second polarization means is provided at a light incident side, and the image-capturing device array converts the light condensed by the lens system into an electric signal, wherein the first polarization means includes a first region and a second region arranged along the first direction, a polarization state of a first region transmission light having passed the first regions is different from a polarization state of a second region transmission light having passed the second regions, second polarization means includes a plurality of third regions and fourth regions arranged alternately along the second direction and extending in the first direction, a polarization state of a third region transmission light having passed the third regions is different from a polarization state of a fourth region transmission light having passed the fourth regions, the first region transmission light passes the third regions and reaches the image-capturing device, and the second region transmission light passes the fourth region and reaches the image-capturing device, and thus, an image is captured to obtain a three-dimensional image in which a distance between a barycenter of the first region and a barycenter of the second region is a base line length of parallax between both of the eyes.
In order to achieve the above first object, an image-capturing method according to this disclosure is an image-capturing method using the image-capturing apparatus according to the first aspect of this disclosure, wherein the image-capturing device generates an electric signal for obtaining a right eye image with the first region transmission light having passed the third region and having reached the image-capturing device, the image-capturing device generates an electric signal for obtaining a left eye image with the second region transmission light having passed the fourth region and having reached the image-capturing device, and these electric signal are output. These electric signals may be output at a time, or may be output alternately in time series.
In order to achieve the above object, an image-capturing apparatus according to a second aspect of this disclosure includes: (A) a quarter wavelength plate; (B) a lens system for condensing light from the quarter wavelength plate; and (C) an image-capturing device array in which image-capturing devices are arranged in a two-dimensional matrix form in a first direction and a second direction perpendicular to the first direction, wherein polarization means is provided at a light incident side, and the image-capturing device array converts the light condensed by the lens system into an electric signal, wherein the polarization means includes a plurality of first regions and second regions arranged alternately along the second direction and extending in the first direction, a polarization state of a first region transmission light having passed the first regions is different from a polarization state of a second region transmission light having passed the second regions, and a fast axis of the quarter wavelength plate is at a predetermined angle to the direction of the electric field of the first region transmission light.
It should be noted that the first region of the image-capturing apparatus according to the second aspect of this disclosure substantially corresponds to the third region of the image-capturing apparatus according to the first aspect of this disclosure, and the second region of the image-capturing apparatus according to the second aspect of this disclosure substantially corresponds to the fourth region of the image-capturing apparatus according to the first aspect of this disclosure. In this case, in order to avoid making confusion between the first region of the image-capturing apparatus according to the second aspect of this disclosure and the first of the image-capturing apparatus according to the first aspect of this disclosure, the first region of the image-capturing apparatus according to the second aspect of this disclosure is referred to as “fifth region” for the sake of convenience, and in order to avoid making confusion between the second region of the image-capturing apparatus according to the second aspect of this disclosure and the second region of the image-capturing apparatus according to the first aspect of this disclosure, the second region of the image-capturing apparatus according to the second aspect of this disclosure is referred to as “sixth region” for the sake of convenience. On the other hand, light having passed the fifth region is referred to as “fifth region transmission light”, and light having passed the sixth region is referred to as “sixth region transmission light”.
In the image-capturing apparatus or the image-capturing method according to the first aspect of this disclosure, the image-capturing apparatus is constituted by one set of first polarization means and second polarization means and one lens system, and therefore, a small monocular image-capturing apparatus having a simple configuration and structure can be provided. Since it is not necessary to have two sets of combinations of lenses and polarization filters, there would be not displacement or difference in zoom, diaphragm, focus, convergence angle, and the like. Moreover, a base line length of the parallax between both of the eyes is relatively short, and therefore, natural three-dimensional feeling can be obtained. In addition, by attaching and detaching the first polarization means, two-dimensional images and three-dimensional images can be easily obtained. With the image-capturing apparatus according to the second aspect of this disclosure, the image-capturing apparatus having a simple configuration and structure can capture an ordinary two-dimensional image, and in addition, the image-capturing apparatus according to the second aspect of this disclosure can be easily incorporated into the image-capturing apparatus according to the first aspect of this disclosure, and therefore, not only a three-dimensional image can be shot, but also an ordinary two-dimensional image can be shot easily with high quality.
Hereinafter, this disclosure will be explained on the basis of embodiments with reference to drawings. However, this disclosure is not limited to the embodiments. In the embodiments, various numerical values and materials are merely examples. Explanation will be made in the following order.
1. Overall explanation about image-capturing apparatuses and image-capturing methods according to the first and second aspects of this disclosure
2. First embodiment (image-capturing apparatus and image-capturing method according to first aspect of this disclosure)
3. Second embodiment (modification of first embodiment)
4. Third embodiment (another modification of first embodiment)
5. Fourth embodiment (another modification of first embodiment)
6. Fifth embodiment (another modification of first embodiment)
7. Sixth embodiment (another modification of first embodiment)
8. Seventh embodiment (another modification of first embodiment)
9. Eighth embodiment (another modification of first embodiment)
10. Ninth embodiment (image-capturing apparatus according to second aspect of this disclosure and another modification of first embodiment)
11. Tenth embodiment (modification of ninth embodiment), others
[Overall Explanation about Image-Capturing Apparatuses and Image-Capturing Methods According to the First and Second Aspects of this Disclosure]
In the image-capturing apparatus according to the first aspect of this disclosure or the image-capturing apparatus suitable for use with the image-capturing method of this disclosure, the first polarization means is preferably arranged in proximity to a diaphragm unit of the lens system. Alternatively, when light incident upon the lens system is once made into parallel light, and is ultimately condensed (forms an image) on the image-capturing device, the first polarization means is preferably arranged in a portion of the lens system in the parallel light state. In these modes, in general, it is not necessary to newly redesign the optical system of the lens system, and mechanical (physical) design change may be applied by fixing the first polarization means to the existing lens system or allowing it to be detachably attached thereto. In order to detachably attach the first polarization means to the lens system, for example, the first polarization means is made to have configuration and the structure similar to that of diaphragm blades of a lens, and may be arranged in the lens system. Alternatively, the configuration and the structure may be such that, in the lens system, a member having both the first polarization means and an aperture portion is attached to the rotation shaft so as to be rotatable about the rotation shaft in parallel to the optical axis of the lens system, and such member is rotated about the rotation shaft, so that light ray passing the lens system passes the aperture portion or passes the first polarization means. Alternatively, the configuration and the structure may be such that, in the lens system, for example, a member having both the first polarization means and an aperture portion is attached to the lens system in a slidable manner in a direction perpendicular to the optical axis of the lens system, and such member is caused to slide, so that light ray passing the lens system passes the aperture portion or the first polarization means.
In the image-capturing apparatus according to the first aspect of this disclosure or the image-capturing apparatus suitable for use with the image-capturing method of this disclosure including the above preferable modes, a central region may be provided between the first region and the second region in the first polarization means, and a polarization state of a central region transmission light having passed the central region does not change from that before incidence to the central region. That is, the central region is a transparent state in respect to the polarization. In the central region of the first polarization means, the light density is high, and the amount of parallax is small. Therefore, in this modes, while the light density received by the image-capturing device array is maintained at a high level, a sufficient base line length of the parallax between both of the eyes can be ensured. When the external shape of the first polarization means is a circular shape, the central region may be in a circular shape, and the first region and the second region may be in a shape of sector having a central angle of 180 degrees enclosing the central region, or the central region may be in a rhombic or square shape, and the first region and the second region may be in a shape similar to a sector having a central angle of 180 degrees enclosing the central region. Alternatively, the first region, the central region, and the second region are in a belt-like shape extending in the second direction.
In the image-capturing apparatus according to the first aspect of this disclosure or the image-capturing apparatus suitable for use with the image-capturing method of this disclosure including various kinds of preferred embodiments explained above (hereinafter, these image-capturing apparatuses may be referred to as “the image-capturing apparatus according to the first aspect of this disclosure and the like”), the first region and the second region may be formed of polarizers, and the direction of the electric field of the first region transmission light may be configured to be perpendicular to the direction of the electric field of the second region transmission light. Further, in the image-capturing apparatus according to the first aspect of this disclosure and the like including such configuration, the direction of the electric field of the first region transmission light may be configured to be parallel to the first direction, or the direction of the electric field of the first region transmission light may be configured to be at an angle of 45 degrees to the first direction. Further, in the image-capturing apparatus according to the first aspect of this disclosure and the like including any combination of these configurations, the direction of the electric field of the first region transmission light may be configured to be parallel to the direction of the electric field of the third region transmission light, and the direction of the electric field of the second region transmission light may be configured to be parallel to the direction of the electric field of the fourth region transmission light. Further, in the image-capturing apparatus according to the first aspect of this disclosure and the like including any combination of these configurations, the extinction ratio of the polarizer is 3 or more, and more preferably, it is 10 or more.
In this case, “polarizer” means one making linear polarization from natural light (non-polarization) and circular polarization, and the polarizer itself constituting the first region and the second region may be a polarizer (polarization plate) of a well-known configuration and structure. For example, the polarization component of one of the first region transmission light and the second region transmission light is configured to be mainly S wave (TE wave), and the polarization component of the other of the first region transmission light and the second region transmission light is configured to be mainly P wave (TM wave). The polarization state of the first region transmission light and the second region transmission light may be linear polarization or may be circular polarization (where rotation directions are opposite to each other). In general, transverse wave of which oscillation direction is only in a certain particular direction is referred to as polarized wave, and this oscillation direction is referred to as polarization direction or polarization axis. The direction of the electric field of light is the same as the polarization direction. When the direction of the electric field of the first region transmission light is configured to be parallel to the first direction, the extinction ratio in the first region means a ratio between a component of light included in the light passing the first region of which direction of the electric field is in the first direction and a component of light included in the light passing the first region of which direction of the electric field is in the second direction, and the extinction ratio in the second region means a ratio between a component of light included in the light passing the second region of which direction of the electric field is in the second direction and a component of light included in the light passing the second region of which direction of the electric field is in the first direction. When the direction of the electric field of the first region transmission light is configured to be at 45 degrees to the first direction, the extinction ratio in the first region means a ratio between a component of light included in the light passing the first region of which direction of the electric field is at 45 degrees to the first direction and a component of light included in the light passing the first region of which direction of the electric field is at 135 degrees to the first direction, and the extinction ratio in the second region means a ratio between a component of light included in the light passing the second region of which direction of the electric field is at 135 degrees to the first direction and a component of light included in the light passing the second region of which direction of the electric field is at 45 degrees to the first direction. Alternatively, for example, when the polarization component of the first region transmission light is mainly P wave, and the polarization component of the second region transmission light is mainly S wave, the extinction ratio in the first region may be a ratio between the P polarization component and the S polarization component included in the first region transmission light, and the extinction ratio in the second region may be a ratio between the S polarization component and the P polarization component included in the second region transmission light.
In the image-capturing apparatus according to the first aspect of this disclosure and the like including various kinds of preferred modes and configurations explained above, the image-capturing device may be formed of a photoelectric conversion device, and formed of a color filter, an on-chip lens, and a wire grid polarizer laminated thereon or thereabove, and the wire grid polarizer may constitute the third region or the fourth region. Alternatively, the image-capturing device may be formed of a photoelectric conversion device, and formed of a wire grid polarizer, a color filter, and, and an on-chip lens laminated thereon or thereabove, and the wire grid polarizer may constitute the third region or the fourth region. Alternatively, the image-capturing device may be formed of a photoelectric conversion device, and formed of an on-chip lens, a color filter, and, and a wire grid polarizer laminated thereon or thereabove, and the wire grid polarizer may constitute the third region or the fourth region. However, the order in which the on-chip lens, the color filter, and the wire grid polarizer are laminated may be changed as necessary. In these modes, when the direction of the electric field of the first region transmission light is configured to be parallel to the first direction, the direction in which multiple wires constituting the wire grid polarizer extend may be parallel to the first direction or the second direction. More specifically, in the wire grid polarizer constituting the third region, the direction in which the wires extend is parallel to the second direction, and in the wire grid polarizer constituting the fourth region, the direction in which the wires extend is parallel to the first direction. Alternatively, in these modes, when the direction of the electric field of the first region transmission light is configured to be at 45 degrees to the first direction, the direction in which multiple wires constituting the wire grid polarizer extend may be at 45 degrees to the first direction or the second direction. More specifically, in the wire grid polarizer constituting the third region, the direction in which the wires extend is at 135 degrees to the first direction, and in the wire grid polarizer constituting the fourth region, the direction in which the wires extend is at 45 degrees to the first direction. The direction in which the wire extends is the light absorbing axis of the wire grid polarizer, and the direction perpendicular to the direction in which the wire extends is the light transmitting axis of the wire grid polarizer. Basically, the above explanation can also be applied to the image-capturing apparatus according to the second aspect of this disclosure.
Further, in the image-capturing apparatus according to the first aspect of this disclosure and the like including various kinds of preferred modes and configurations explained above, a quarter wavelength plate (λ/4 wavelength plate) is preferably arranged at the light incident side of the first polarization means in order to avoid so-called binocular rivalry. The quarter wavelength plate may be provided at all times or may be provided as necessary. More specifically, the quarter wavelength plate may be detachably attached to the filter attachment unit provided in the lens system. In this case, for example, the binocular rivalry means a phenomenon in which, when an image of a subject that reflects P wave component but absorbs S wave component such as water surface or a window is captured, and the image obtained from the P wave component and the image obtained from the S wave component are presented to both eyes, fusion does not occur, and the images are seen alternately in such a manner that only one of the images is seen more strongly, and the images suppress each other in an overlapping region. The light that passed the quarter wavelength plate is in a state in which the polarization direction is the same, and great difference does not occur between images of a portion of a subject that reflects the P wave component but absorbs the S wave component which are between an image obtained when such light passes the first region and the third region and reaches the image-capturing device array and an image obtained when such light passes the second region and the fourth region and reaches the image-capturing device array, and therefore, the binocular rivalry can be avoided. It should be noted that the quarter wavelength plate fast axis is at an angle of 45 degrees or 45 degrees±10 degrees to the direction of the electric field of the first region transmission light.
Alternatively, as described above, in a configuration in which the first region and the second region are formed of polarizers, and a direction of an electric field of the first region transmission light is perpendicular to a direction of an electric field of the second region transmission light, and the direction of the electric field of the first region transmission light is parallel to the first direction, or in a configuration in which the direction of the electric field of the first region transmission light is at an angle of 45 degrees to the first direction, the quarter wavelength plate is arranged at the light incident side of the first polarization means, and the fast axis of the quarter wavelength plate is at a predetermined angle to the direction of the electric field of the first region transmission light, or the quarter wavelength plate may include a first quarter wavelength plate and a second quarter wavelength plate arranged in the second direction, a fast axis of the first quarter wavelength plate may be at a predetermined angle to the direction of the electric field of the first region transmission light, and a fast axis of the second quarter wavelength plate may be perpendicular to the fast axis of the first quarter wavelength plate (in other words, parallel to the slow axis of the first quarter wavelength plate), and in these modes, the predetermined angle may be 45 degrees or 45 degrees±10 degrees, and further, in these modes, the direction of the electric field of the first region transmission light may be parallel to the direction of the electric field of the third region transmission light, and the direction of the electric field of the second region transmission light may be parallel to the direction of the electric field of the fourth region transmission light. Further in these modes, the first polarization means may be detachably attached to the lens system, and the quarter wavelength plate is detachably attached to the lens system. Still further in these modes, the quarter wavelength plate may be provided adjacent to the first polarization means, for example, the quarter wavelength plate may be provided at the light incident side of the first polarization means.
In the image-capturing apparatus according to the second aspect of this disclosure, the quarter wavelength plate may include a first quarter wavelength plate and a second quarter wavelength plate arranged in the second direction, a fast axis of the first quarter wavelength plate is at a predetermined angle to the direction of the electric field of the fifth region transmission light, and a fast axis of the second quarter wavelength plate is perpendicular to the fast axis of the first quarter wavelength plate (in other words, parallel to the slow axis of the first quarter wavelength plate). In the image-capturing apparatus according to the second aspect of this disclosure including such modes, the predetermined angle may be 45 degrees or 45 degrees±10 degrees, and further, in the image-capturing apparatus according to the second aspect of this disclosure including such modes, the direction of the electric field of the fifth region transmission light may be perpendicular to the direction of the electric field of the sixth region transmission light, and in this case, the direction of the electric field of the fifth region transmission light may be parallel to the first direction, or the direction of the electric field of the fifth region transmission light is at an angle of 45 degrees to the first direction. Further, in the image-capturing apparatus according to the second aspect of this disclosure including these modes, the quarter wavelength plate may be detachably attached to the lens system.
In order to detachably attach the quarter wavelength plate to the lens system, for example, the quarter wavelength plate is made to have configuration and the structure similar to that of diaphragm blades of a lens, and may be arranged in the lens system. Alternatively, the configuration and the structure may be such that, in the lens system, a member having both the quarter wavelength plate and an aperture portion is attached to the rotation shaft so as to be rotatable about the rotation shaft in parallel to the optical axis of the lens system, and such member is rotated about the rotation shaft, so that light ray passing the lens system passes the aperture portion or passes the quarter wavelength plate. Alternatively, the configuration and the structure may be such that, in the lens system, for example, a member having both the quarter wavelength plate and an aperture portion is attached to the lens system in a slidable manner in a direction perpendicular to the optical axis of the lens system, and such member is caused to slide, so that light ray passing the lens system passes the aperture portion or the quarter wavelength plate. In this case, the following configuration may be employed: the quarter wavelength plate includes a plurality of members, and each member is configured to be slidable in the direction perpendicular to the optical axis of the lens system.
Alternatively, in the image-capturing apparatus according to the first aspect of this disclosure and the like, in order to avoid the so-called binocular rivalry, a polarization plate having a polarization axis of a degrees may be arranged at the light incident side of the first polarization means, the first region may include a first wavelength plate, and the second region may include a second wavelength plate, and the direction of the electric field of the first region transmission light may be perpendicular to the direction of the electric field of the second region transmission light. In this case, more specifically, the value of α may be 45 degrees, the first wavelength plate may include a half wavelength plate (+λ/2 wavelength plate), and the second wavelength plate may include a half wavelength plate (−λ/2 wavelength plate) of which phase difference is different from the half wavelength plate constituting the first wavelength plate. In this case, the polarization plate having the polarization axis of α degrees is fixed to the lens system.
In the image-capturing apparatus according to the first aspect of this disclosure and the like including various kinds of preferred modes and configurations explained above, the image-capturing device array may have Bayer arrangement, one pixel may include four image-capturing devices, and one third region and/or fourth region may be provided for one pixel. In the image-capturing apparatus according to the first aspect of this disclosure and the like including various kinds of preferred modes and configurations explained above including these modes, one third region and one fourth region may be arranged for N pixels along the second direction (where N is 2n, n being a natural number of 1 to 5). However, the arrangement of the image-capturing device array is not limited to Bayer arrangement. Other arrangements include interline arrangement, G stripe RB checkboard arrangement, G stripe RB complete checkboard arrangement, checkboard complementary color arrangement, stripe arrangement, diagonal stripe arrangement, primary color difference arrangement, field color difference successive arrangement, frame color difference successive arrangement, MOS-type arrangement, improved MOS-type arrangement, frame interleave arrangement, field interleave arrangement. Basically, the above explanation can also be applied to the image-capturing apparatus according to the second aspect of this disclosure.
In an image-capturing method of this disclosure using the image-capturing apparatus according to the first aspect of this disclosure and the like including various kinds of preferred modes and configurations explained above, one third region and one fourth region are arranged for N pixels along the second direction (where for example, N is 2n, n being a natural number of 1 to 5), and in this case, image data (right eye image data) for obtaining a right eye image and image data (left eye image data) for obtaining a left eye image may be obtained on the basis of depth map (depth information) generated from an electric signal obtained from first region transmission light that has passed the third region and an electric signal obtained from second region transmission light that has passed the fourth region and an electric signal from all the image-capturing devices constituting the image-capturing device array. Basically, the above explanation can also be applied to the image-capturing apparatus according to the second aspect of this disclosure.
Alternatively, when the arrangement of the image-capturing device array is Bayer arrangement, the third region and the fourth region may not be provided for a red image-capturing device receiving red light and a blue image-capturing device receiving blue light, and the third region may be provided for one of two green image-capturing devices receiving green light and the fourth region may be provided for the other of them. Alternatively, when the arrangement of the image-capturing device array is Bayer arrangement, the third region or the fourth region may be provided for two image-capturing device adjacent to each other in the first direction (for example, a red image-capturing device receiving red light and one of green image-capturing devices receiving green light) among one red image-capturing device receiving red light, one blue image-capturing device receiving blue light, and two green image-capturing devices receiving green light, and the fourth region or the third region may be arranged for the remaining two image-capturing devices (for example, a blue image-capturing device receiving blue light and the other of the green image-capturing devices receiving green light). Alternatively, when the arrangement of the image-capturing device array is Bayer arrangement, the third region or the fourth region may be provided for any one of image-capturing devices (for example, one red image-capturing device receiving red light or one blue image-capturing device receiving blue light) among one red image-capturing device receiving red light, one blue image-capturing device receiving blue light, and two green image-capturing devices receiving green light, and the fourth region or the third region may be provided for an image-capturing device adjacent to the image-capturing device in the second direction (for example, a green image-capturing device). Even in these cases, one third region and one fourth region may be configured to be arranged for N pixels along the second direction, and one third region or one fourth region may be configured to be arranged for M pixels along the first direction. Basically, the above explanation can also be applied to the image-capturing apparatus according to the second aspect of this disclosure.
In the image-capturing method according to this disclosure or the image-capturing apparatus according to the first to second aspects of this disclosure including various kinds of preferred modes and configurations explained above (hereinafter, they may be simply, collectively referred to as “this disclosure”), the first direction may be the horizontal direction, and the second direction may be the vertical direction. The unit length of the third region and the fourth region along the first direction (the image-capturing apparatus according to the first aspect of this disclosure and the like) or the fifth region and the sixth region (the image-capturing apparatus according to the second aspect of this disclosure) may be, for example, the same as the length along the first direction of the image-capturing device (when the direction of the electric field of the first region transmission light is parallel to the first direction), or may be the same as the length equivalent to one image-capturing device (when the direction of the electric field of the first region transmission light is at an angle of 45 degrees to the first direction). The lens system may be a fixed focal length lens, or may be so-called zoom lens, and the configuration and the structure of the lens and the lens system may be determined based on the specification required for the lens system. The image-capturing device may be a CCD sensor, a CMOS sensor, or a signal amplification type image sensor of CMD (Charge Modulation Device) type. The image-capturing apparatus may be a front side illumination type solid-state image-capturing apparatus, or may be a back side illumination type solid-state image-capturing apparatus. Further, for example, a digital still camera, a video camera, and a camcorder can be made with the image-capturing apparatus according to the first aspect to second aspect.
When the wire grid polarizer is formed of the third region and the fourth region (the image-capturing apparatus according to the first aspect of this disclosure and the like) or the fifth region and the sixth region (the image-capturing apparatus according to the second aspect of this disclosure), the wire constituting the wire grid polarizer is not limited, but is preferably formed of aluminum (Al) or aluminum alloy, a value of a ratio between the width of the wire and the pitch of the wire [(the width of the wire)/(the pitch of the wire)] is preferably 0.33 or more, the height of the wire is preferably equal to or more than 5×10−8 m, and 10 or more wires are preferably provided.
In the image-capturing apparatus according to the first aspect of this disclosure and the like, the barycenter of the first region means a barycenter obtained based on the external shape of the first region, and the barycenter of the second region means a barycenter obtained based on the external shape of the second region. When the external shape of the first polarization means is in a circular shape having a radius r, and each of the first region and the second region is in a crescentic shape occupying half of the first polarization means, the distance between the barycenter of the first region and the barycenter of the second region can be obtained with simple calculation [(8r)/(3π)].
The first embodiment relates to an image-capturing apparatus and an image-capturing method according to a first aspect of this disclosure. More particularly, the first embodiment relates to an image-capturing apparatus and an image-capturing method for capturing a subject as a three-dimensional image.
A conceptual diagram illustrating an image-capturing apparatus according to the first embodiment is shown in
An image-capturing apparatus according to the first embodiment or the second to the tenth embodiments explained later includes: (A) first polarization means 130, 230, 330, 430, 530, 930 for polarizing light from a subject; (B) a lens system 20 for condensing light from the first polarization means 130, 230, 330, 430, 530, 930, and (C) an image-capturing device array 40 in which image-capturing devices 41 are arranged in a two-dimensional matrix form in a first direction (horizontal direction, X axis direction) and a second direction perpendicular to the first direction (vertical direction, Y axis direction), wherein second polarization means 150, 250 are provided at a light incident side, and the image-capturing device array 40 converts the light condensed by the lens system 20 into an electric signal.
The image-capturing apparatus according to the first embodiment or the second to the tenth embodiments explained later is configured such that: the first polarization means 130, 230, 330, 430, 530, 930 includes first regions 131, 231, 331, 531, 931 and second regions 132, 232, 332, 532, 932 arranged along the first direction (horizontal direction, X axis direction), a polarization state of a first region transmission light L1 having passed the first regions 131, 231, 331, 531, 931 is different from a polarization state of a second region transmission light L2 having passed the second regions 132, 232, 332, 532, 932, second polarization means 150, 250 include multiple third regions 151, 251 and fourth regions 152, 252 arranged alternately along the second direction (vertical direction, Y axis direction) and extending in the first direction (horizontal direction, X axis direction), a polarization state of a third region transmission light L3 having passed the third regions 151, 251 is different from a polarization state of a fourth region transmission light L4 having passed the fourth regions 152, 252, the first region transmission light L1 passes the third regions 151, 251 and reaches the image-capturing device 41, and the second region transmission light L2 passes the fourth region 152, 252 and reaches the image-capturing device 41, and therefore, images are captured to obtain a three-dimensional image in which a distance between a barycenter BC1 of the first regions 131, 231, 331, 531, 931 and a barycenter BC2 of the second regions 132, 232, 332, 532, 932 is a base line length of the parallax between both of the eyes.
In this case, in the image-capturing apparatus according to the first embodiment or the second to the tenth embodiments explained later, a lens system 20 includes, for example, an image-capturing lens 21, a diaphragm unit 22, and an image forming lens 23, and functions as a zoom lens. The image-capturing lens 21 is a lens for condensing incident light from the subject. The image-capturing lens 21 includes a focus lens for focus, a zoom lens for enlarging the subject, and the like, and in general, the image-capturing lens 21 is achieved with a combination of multiple lenses for correcting chromatic aberration and the like. The diaphragm unit 22 has a function of reduction for adjusting the amount of condensed light, and in general, the diaphragm unit 22 is constituted by a combination of multiple plate-like blades. At least at the position of the diaphragm unit 22, the light from one point of the subject becomes parallel light. The image forming lens 23 forms an image on the image-capturing device array 40 with the light having passed the first polarization means 130, 230, 330, 430, 530, 930. The image-capturing device array 40 is arranged in a camera main body unit 11. In the above configuration, the entrance pupil is located at the camera main body unit with respect to the image forming lens 23. For example, a digital still camera, a video camera, and a camcorder are constituted by the image-capturing apparatus.
The camera main body unit 11 includes not only the image-capturing device array 40 but also, for example, image processing means 12 and an image storage unit 13. Then, on the basis of the electric signal converted by the image-capturing device array 40, right eye image data and left eye image data are formed. The image-capturing device array 40 is achieved with, for example, a CCD (Charge Coupled Devices), a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and the like. The image processing means 12 converts the electric signal which is output from the image-capturing device array 40 into the right eye image data and the left eye image data, and records the right eye image data and the left eye image data to the image storage unit 13.
The first polarization means 130, 230, 330, 430, 530, 930 are arranged in proximity to the diaphragm unit 22 of the lens system 20. More specifically, the first polarization means 130, 230, 330, 430, 530, 930 are arranged as close to the diaphragm unit 22 as possible as long as operation of the diaphragm unit 22 is not affected. As described above, the first polarization means 130, 230, 330, 430, 530, 930 are arranged at a portion of the lens system 20 which is in the state of parallel light when the light which is incident upon the lens system 20 is once made into parallel light and is ultimately condensed (made to form an image) on the image-capturing device 41.
In the image-capturing apparatus 110 according to the first embodiment, the first polarization means 130 includes a first region 131 and a second region 132. More specifically, the external shape of the first polarization means 130 is a circular shape, and each of the first region 131 and the second region 132 has a crescentic external shape occupying half of the first polarization means 130. A border line between the first region 131 and the second region 132 extends along the second direction. The first polarization means 130 including a combination of two polarization filters separates the incident light into two different polarization states. As described above, the first polarization means 130 includes polarizers symmetrical in the vertical direction, and generates polarizations in straight line directions perpendicular to each other or polarizations in rotation directions opposite to each other, at two positions at the right and left with respect to the upright state of the camera. The first region 131 is a filter for applying polarization to an image with which the subject is to be seen by the right eye (light which is to be received by the right eye). On the other hand, the second region 132 is a filter for applying polarization to an image with which the subject is to be seen by the left eye (light which is to be received by the left eye).
In this case, in the image-capturing apparatus 110 according to the first embodiment, the first region 131 and second region 132 are formed of polarizers. The direction of the electric field of the first region transmission light L1 (indicated by an outline arrow) is perpendicular to the direction of the electric field of the second region transmission light L2 (indicated by an outline arrow) (see
In the image-capturing apparatus 110 according to the first embodiment, the external shape of the first polarization means 130 is in a circular shape of which radius r is 10 mm. The first region 131 and the second region 132 are made as crescentic shapes each occupying half of the first polarization means 130. Therefore, the distance between the barycenter BC1 of the first region 131 and the barycenter BC2 of the second region 132 is [(8r)/(3π)]=8.5 mm.
A schematic partial cross sectional view is shown in
In the image-capturing method according to the first embodiment, the electric signal for obtaining the right eye image data is generated by the image-capturing device 41 with the first region transmission light L1 that has passed the third region 151 and that has reached the image-capturing device 41. On the other hand, the electric signal for obtaining the left eye image data is generated by the image-capturing device 41 with the second region transmission light L2 that has passed the fourth region 152 and that has reached the image-capturing device 41. Then, these electric signals are output at a time or alternately in time series. The image processing means 12 performs image processing on the output electric signals (the electric signals for obtaining the right eye image data and the left eye image data which are output by the image-capturing device array 40), and records them as the right eye image data and the left eye image data to the image storage unit 13.
As schematically shown in
As
As described above, the electric signals for the right eye image data and left eye image data are generated along the second direction in some kind of interlaced manner. Accordingly, the image processing means 12 applies demosaic processing on the electric signals in order to generate the right eye image data and the left eye image data, and for example, by performing interpolation processing based on super-resolution processing, the right eye image data and the left eye image data are ultimately generated and made. For example, the parallax may be emphasized and optimized by a parallax detection technique for generating a disparity map by stereo matching from the left eye image data and the right eye image data and a parallax control technique for controlling parallax based on the disparity map.
In Bayer arrangement, the red image-capturing device R is arranged at the position (4, 2). At this occasion, operation represented by the following expression is performed to generate a green image-capturing device signal value g′ corresponding to the position (4, 2).
g′
4,2=(g4,1+g4,3+g5,2+g1,2×W3)/(3.0+W3)
In this case, g′i,j at the left-hand side is a green image-capturing device signal value at the position (i, j). On the other hand, gi,j at the right-hand side is a value of an electric signal of the green image-capturing device at the position (i, j). Further, when a distance (W1) from the image-capturing device G4,2 in question to each of adjacent image-capturing devices G4,1, G4,3, G5,2 is “1.0”, a reciprocal number thereof is adopted as a weight, and “3.0” corresponds to a summation of the weights. Likewise, W3 is a weight for the value of the electric signal of the image-capturing device G1,2 which is away by 3 image-capturing devices, and in this case, W3 is “⅓”. When the above expression is generalized, the following expression is obtained.
when i is an even number (signal value of the green image-capturing device G corresponding to the position of the red image-capturing device R);
g′
i,j=(gi,j-1×W1+gi,j+1×W1+gi,j+1×W1+gi−3,j×W3)/(W1×3.0+W3)
when i is an odd number (signal value of the green image-capturing device G corresponding to the position of the blue image-capturing device B);
g′
i,j=(gi,j-1×W1+gi,j+1×W1+gi−1,j×W1+gi+3,j×W3)/(W1×3.0+W3)
In this case, W1 is 1.0, and W3 is ⅓.
With the red image-capturing device R and the blue image-capturing device B, the demosaic processing can be performed according to the same idea.
With the demosaic processing, the image-capturing device signal value at each image-capturing device position can be obtained. At this stage, as described above, this is in some kind of interlaced manner. For this reason, for a region that does not have any image-capturing device signal value, the image-capturing device signal value need to be generated by interpolation. Methods of interpolation include well-known methods such as a method using an arithmetic mean value of values in proximity. It should be noted that this interpolation processing may be performed in parallel with the demosaic processing. In the first direction, the image quality is maintained completely, and therefore, image quality deterioration such as reduction of the resolution of the entire image is less likely to occur.
In the first embodiment, the image-capturing apparatus 110 is constituted by a pair of first polarization means 130 and second polarization means 150 and one lens system 20. Therefore, for example, two different images separated to the right and the left can be generated at a time, and a small monocular image-capturing apparatus having a simple configuration and structure and having less number of components can be provided. Since it is not necessary to have two sets of combinations of lenses and polarization filters, there would be not displacement or difference in zoom, diaphragm, focus, convergence angle, and the like. Moreover, a base line length of the parallax between both of the eyes is relatively short, and therefore, natural three-dimensional feeling can be obtained. In addition, when the structure for attaching and detaching the first polarization means 130 is employed, two-dimensional images and three-dimensional images can be easily obtained.
The second embodiment is a modification of the first embodiment. In the first embodiment, the direction of the electric field of the first region transmission light L1 is parallel to the first direction. In contrast, in the second embodiment, the direction of the electric field of the first region transmission light L1 is at 45 degrees to the direction of the first direction. The states of polarization of first polarization means 230 and second polarization means 250 provided in an image-capturing apparatus according to the second embodiment are schematically shown in
A conceptual diagram illustrating the image-capturing device array 40 having Bayer arrangement is shown in
Except these features, the configuration and the structure of the image-capturing apparatus according to the second embodiment may be the same as the configuration and the structure of the image-capturing apparatus 110 explained in the first embodiment, and detailed description thereabout is omitted. The configuration and the structure of the image-capturing apparatus according to the second embodiment can be applied to the image-capturing apparatuses according to the third embodiment to the tenth embodiment explained later.
The third embodiment is also a modification of the first embodiment. In an image-capturing apparatus according to the third embodiment, first polarization means 330 is configured such that a central region 333 is provided between a first region 331 and a second region 332, and the polarization state of the central region transmission light that has passed the central region 333 does not change from the polarization state of the light before incidence to the central region 333. That is, the central region 333 is a transparent state in respect to the polarization.
By the way, when the incident light passes the first polarization means, the amount of light decreases in proportional to the spectral characteristics and the extinction ratio, and the light becomes darker. In this case, the extinction ratio is a ratio between the amount of light selected by a polarizer and allowed to pass upon being and the amount of leaking light reflected or absorbed which is not selected by the polarizer. More specifically, for example, when the polarizer has an extinction ratio of 10 and passes a P wave component, the polarizer passes light as follows. With respect to an intensity 100 of incident natural light having a ratio 50:50 of P wave component: S wave component, the polarizer passes the P wave component and the S wave component with a ratio 50:5. For example, when the polarizer has an extinction ratio of ∞ and passes a P wave component, the polarizer passes 100% of the P wave component, and totally reflects the S wave component or completely absorbs it, thus not passing the S wave component. Therefore, when average natural light is incident thereupon, the brightness becomes about ½. The amount of light passing the first polarization means 130 and the second polarization means 150 as shown in
In the central region 333 of the first polarization means 330, the light density is strong but the amount of parallax is small.
Therefore, when the first polarization means 330 according to the third embodiment is employed, a sufficiently long base line length of the parallax between both of the eyes can be ensured while increasing the light density received by the image-capturing device array 40. As shown in the schematic drawing of the first polarization means 330 in
Except these features, the configuration and the structure of the image-capturing apparatus according to the third embodiment may be the same as the configuration and the structure of the image-capturing apparatus 110 explained in the first embodiment, and detailed description thereabout is omitted. The configuration and the structure of the image-capturing apparatus according to the third embodiment can be applied to the image-capturing apparatuses according to the fourth embodiment to the tenth embodiment explained later.
The fourth embodiment is also a modification of the first embodiment. A conceptual diagram illustrating an image-capturing apparatus 410 according to the fourth embodiment is shown in
In the image-capturing apparatus 410 according to the fourth embodiment, a quarter wavelength plate (λ/4 wavelength plate) 433 is arranged at a light incident side of first polarization means 430, so that so-called binocular rivalry can be avoided. The quarter wavelength plate 433 may be detachably attached to a filter attachment unit provided in the lens system. The light that passed the quarter wavelength plate 433 is in a state in which the polarization direction is the same (the state of linear polarization). In an image obtained by such light having passed the first region 131 and the third region 151 and having reached the image-capturing device array 40 and an image obtained by such light having passed the second region 132 and the fourth region 152 and having reached the image-capturing device array 40, there is no great difference between the images in a portion of a subject in which the P wave component is reflected but the S wave component is absorbed, so that the binocular rivalry can be avoided.
It is understood that, when the left eye image and the right eye image of
On the other hand, it is understood that, when the left eye image and the right eye image of
The fifth embodiment is also a modification of the first embodiment. A conceptual diagram illustrating an image-capturing apparatus 510 according to the fifth embodiment is shown in
The sixth embodiment is also a modification of the first embodiment. In the sixth embodiment, relationship between the extinction ratio and the parallax is studied. That is, when images separated into the right and the left are mixed, composite image simulation is performed by changing the extinction ratio from 00 (state in which there is 0% crosstalk, and the left eye image and the right eye image are completely separated) to 1 (state in which there is 50% crosstalk, and the left eye image and the right eye image are completely mixed, i.e., the left eye image and the right eye image are completely the same) to find what level of mixing eliminates parallax, i.e., what level of mixing disables three-dimensional view. A portion of the result is shown in
In this case,
The seventh embodiment is also a modification of the first embodiment. In the seventh embodiment, relationship between the specification of the wire grid polarizer and the extinction ratio is obtained by calculation. More specifically, relationship of an extinction ratio and a wavelength (λ) of incident light and a pitch of a wire constituting a wire grid polarizer is shown in
As can be seen from
A relationship between the extinction ratio and the wavelength (λ) of the incident light and the lengths of the two wires is shown in
The eighth embodiment is also a modification of the first embodiment. As shown in
Alternatively, a conceptual diagram illustrating an image-capturing device array having Bayer arrangement according to the first modification of the image-capturing apparatus according to the eighth embodiment is shown in
Alternatively, a conceptual diagram illustrating an image-capturing device array having Bayer arrangement according to the second modification of the image-capturing apparatus according to the eighth embodiment is shown in
The ninth embodiment relates to an image-capturing apparatus according to the second aspect of this disclosure, and is a modification of the first embodiment to the third embodiment and the fifth embodiment to the eighth embodiment. A conceptual diagram illustrating an image-capturing apparatus according to the ninth embodiment is shown in
When an image-capturing apparatus 910 according to the ninth embodiment is expressed in accordance with the image-capturing apparatus according to the second aspect of this disclosure, the image-capturing apparatus 910 includes: (A) a quarter wavelength plate 933; (B) a lens system 20 for condensing light from the quarter wavelength plate 933; and (C) an image-capturing device array 40 in which image-capturing devices 41 are arranged in a two-dimensional matrix form in a first direction (horizontal direction, X axis direction) and a second direction perpendicular to the first direction (vertical direction, Y axis direction), wherein polarization means 150, 250 are provided at a light incident side, and the image-capturing device array 40 converts the light condensed by the lens system 20 into an electric signal.
The polarization means 150, 250 are arranged alternately along the second direction (vertical direction, Y axis direction), and include multiple fifth regions 151, 251 and sixth regions 152, 252 extending in the first direction (horizontal direction, X axis direction), a polarization state of a fifth region transmission light having passed the fifth regions 151, 251 is different from a polarization state of a sixth region transmission light having passed the sixth regions 152, 252, and a fast axis of the quarter wavelength plate 933 (indicated by black arrows in
Alternatively, when the image-capturing apparatus 910 according to the ninth embodiment is expressed in accordance with the image-capturing apparatus according to the first aspect of this disclosure, the quarter wavelength plate 933 is arranged at the light incident side of the first polarization means 930, and the fast axis of the quarter wavelength plate 933 is at a predetermined angle to the direction of the electric field of the first region transmission light L1. It should be noted that the direction of the electric field of the first region transmission light L1 is parallel to the direction of the electric field of the third region transmission light L3, and the direction of the electric field of the second region transmission light L2 is parallel to the direction of the electric field of the fourth region transmission light L4.
The first polarization means 930 is detachably attached to the lens system 20, and the quarter wavelength plate 933 is also detachably attached to the lens system 20. The quarter wavelength plate 933 is arranged adjacent to the first polarization means 930.
When the first polarization means 930 is detached from the lens system 20 to try normal image-capturing of a two-dimensional image, and if light incident upon the image-capturing apparatus includes linear polarization, the strength of light having passed the third regions (fifth regions) 151, 251 becomes different from the strength of light having passed the fourth regions (sixth regions) 152, 252, and this may cause stripe-like difference of brightness in the obtained two-dimensional image. In the image-capturing apparatus according to the ninth embodiment, the quarter wavelength plate 933 of which fast axis is at the predetermined angle (more specifically, 45 degrees or 45 degrees±10 degrees) to the direction of the electric field of the fifth region transmission light is incorporated, and therefore, the light of the linear polarization incident upon the quarter wavelength plate 933 is emitted from the quarter wavelength plate 933 as the light in the circular polarization state. Therefore, it is less likely that difference is caused between the strength of the light having passed the third regions (fifth regions) 151, 251 and the strength of the light having passed the fourth regions (sixth regions) 152, 252, and the stripe-like difference of brightness would not occur in the obtained two-dimensional image.
The tenth embodiment is a modification of the ninth embodiment. As shown in
Hereinabove, this disclosure has been explained on the basis of the preferred embodiments, but this disclosure is not limited to the embodiments. The configuration and the structure of the image-capturing apparatus and the image-capturing device explained in the embodiments are examples, and can be changed as necessary. For example, as
A three-dimensional image is displayed on the basis of the right eye image data and the left eye image data, and examples of such display methods include a method for attaching circular polarization or linear polarization filters to two projectors to display right and left eye images and allow a viewer to observe an image using circular polarization or linear polarization glasses corresponding to the display, a lenticular lens method, and a parallax barrier method. When an image is observed without using circular polarization or linear polarization glasses, an ordinary two-dimensional (flat) image can be observed. The processing procedure explained above may be understood as a method having the above series of procedures, or may be understood as a program for causing a computer to execute the series of procedures or a recording medium for recording the program. Examples of recording media include a CD (Compact Disc), an MD (MiniDisc), a DVD (Digital Versatile Disk), a memory card, and a Blu-ray Disc (registered trademark).
110, 410, 510, 910 . . . image-capturing apparatus, 11 . . . camera main body unit, 12 . . . image processing means, 13 . . . image storage unit, 20 . . . lens system, 21 . . . image-capturing lens, 22 . . . diaphragm unit, 23 . . . image forming lens, 130, 230, 330, 430, 530, 930 . . . first polarization means, 131, 231, 331, 531, 931 . . . first region, 132, 232, 332, 532, 932 . . . second region, 333 . . . central region, 433, 933 . . . quarter wavelength plate (λ/4 wavelength plate), 933A . . . first quarter wavelength plate (λ/4 wavelength plate), 933B . . . second quarter wavelength plate (λ/4 wavelength plate), 534 . . . polarization plate, 40 . . . image-capturing device array, 41 . . . image-capturing device, 150, 250 . . . second polarization means (polarization means), 151, 251 . . . third region (fifth region), 152, 252 . . . fourth region (sixth region), 60 . . . silicon semiconductor substrate, 61 . . . photoelectric conversion device, 62 . . . first planarized film, 63 . . . color filter, 64 . . . on-chip lens, 65 . . . second planarized film, 66 . . . inorganic insulating ground layer, 67, 67A, 67B . . . wire grid polarizer, 68, 68A, 68B . . . wire
| Number | Date | Country | Kind |
|---|---|---|---|
| 2010-122820 | May 2010 | JP | national |
This is a Continuation of application Ser. No. 13/697,175, filed on Nov. 9, 2012, now U.S. Pat. No. 9,077,978, issuing on Jul. 7, 2015, which is a National Stage of PCT/JP2011/061521, filed on May 19, 2011, which contains subject matter related to Japanese Patent Applications JP 2010-122820, filed on May 28, 2010 in the Japanese Patent Office, the entire contents of which are incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 13697175 | Nov 2012 | US |
| Child | 14750605 | US |
