The present application claims priority from Japanese Patent Application No. 2020-180063 filed on Oct. 28, 2020, the content of which is hereby incorporated by reference into this application.
The present invention relates to an imaging optical system, an imaging apparatus and a focal-depth extension system.
A Japanese Patent Application Laid-Open Publication No. 2018-101065 (Patent Document 1) discloses a technique of extending a focal depth of a captured image by arranging an annular phase plate at an aperture stop position of an imaging optical system to perform an imaging process to the captured image. Specifically, the Patent Document 1 describes that, in each annular pattern, an area of an inner-circumferential region of normalized radius coordinates having the maximum annular pattern height value and an area of an outer-circumferential region of the same are made equal to each other, and a slope of a tangent line of an inner-circumferential end of the annular pattern and a slope of a tangent line of an outer-circumferential end of the annular pattern are made equal to each other. The Patent Document 1 describes that this technique makes a defocus range that provides an allowable-ranged imaging property to be equal between both sides of a focal point.
A Japanese Patent Application Laid-Open Publication No. 2015-4883 (Patent Document 2) discloses a technique of extending a focal depth of a captured image by performing an imaging process to the captured image in an optical system having spherical aberration.
However, in the Patent Document 1, the slope of the tangent line discontinuously changes at a boundary between the annular patterns, and therefore, an edge of a ridge line is sharpened. Thus, image capturing under circumstances with a bright optical source generates scattered stray light noises such as flare. Also, even when the defocus range providing the allowable image-formation property can be made equal between the both sides of the focal point, an evaluation indicator value (such as a PSNR: Peak Signal to Noise Ratio (SN ratio)) for the image-formation property is asymmetric between positions in front and back of the focal point in some cases.
In the Patent Document 2, a focal depth is extended by a restoring process to an image having a blur point spread on a focal plane due to spherical aberration. However, by such a method, the focal depth cannot be sufficiently extended.
Accordingly, a purpose of the present invention is to achieve a focal-depth extended image being clear and having a large focal depth in a uniform image quality in a wide defocus range in front and back of a focal point.
The summary of the typical aspects of the inventions disclosed in the present application will be briefly described as follows.
An imaging optical system according to a typical embodiment of the present invention includes an optical component having a plurality of annular grooves formed to provide a predetermined phase to optical ray propagating an effective pupil. The plurality of annular grooves are sequentially formed from an inner circumferential side to an outer circumferential side. In each of the annular grooves, a value of longitudinal aberration of the optical ray between an inner circumferential end of the annular grooves and an outer circumferential end of the annular grooves continuously changes between a first value and a second value, a sign of which is inverted from that of the first value. The value of the longitudinal aberration between the plurality of annular grooves alternates between the first value and the second value plural times to zigzag. The longitudinal aberration continues at a boundary between the annular grooves that are adjacent to each other. In each of the annular grooves, an area of an inner circumferential plane of the optical component and an area of an outer circumferential plane of the optical component are almost equal to each other at a zero cross point at which the longitudinal aberration is zero.
The effects obtained by the typical aspects of the present invention disclosed in the present application will be briefly described below.
In other words, the typical embodiment of the present invention can improve a focal-depth extended image being clear and having a large focal depth in a uniform image quality in a wide defocus range in front and back of a focal point.
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. Each embodiment described below is only one example for achieving the present invention, and does not limit the technical scope of the present invention. In examples, note that components having the same function are denoted by the same reference symbols, and the repetitive description thereof will be omitted unless otherwise particularly required.
As shown in
The imaging apparatus 100 includes an imaging optical system 110 and a housing 130 that houses an imaging sensor 131. The imaging optical system 110 includes single or a plurality of optical lenses. In the example of
The housing 130 is connected to the imaging processor 150. A method for connection between the housing 130 and the imaging processor 150 may be a wired connection or a wireless connection. The housing 130 and the imaging processor 150 are connected to each other through a network.
Each pixel of the imaging sensor 131 produces a pixel data in accordance with the incident light. Pieces of the image data of the respective pixels are collected into one image data to produce the captured image. The captured image is output to the imaging processor 150, and is subjected to an imaging process for blur removal in the imaging processor 150. The captured image done with the imaging process is displayed on the display apparatus 170. And, the captured image done with the imaging process is stored in a storage apparatus not illustrated.
As shown in
The imaging processor 150 performs an imaging process for removal of the blur or others to the captured image produced by the imaging apparatus 100, and displays the captured image done with the imaging process onto the display apparatus 170 or others. The resultant captured image done with the imaging process is an image having the defocus but the large focal depth without the blur.
<Imaging Optical System>
The imaging optical system will be explained in detail here. First, a relation between wavefront aberration and ray aberration in the phase plate will be explained.
The exit pupil 202 is an image of an aperture produced by an optical lens (rear-lens optical system) arranged to be closer to the imaging sensor than the aperture, and is a virtual aperture plane on the exit side that allows a lens optical system in a combination of a plurality of optical lenses to be regarded as a virtual thin lens.
A wave front of the light output from the exist pupil 202 and collected onto the focal point 203 to be without the aberration is a reference wave front 204. An optical path difference between the reference wave front 204 and an aberration wave front 205 practically having the aberration in an optical-ray direction is wavefront aberration 206. The wavefront aberration 206 is expressed by a function of a radius “r” crossing the exit pupil 202.
Meanwhile, a height of a point at which the optical ray with the aberration 207 crosses a focal point plane 208 from an optical axis 201, in other words, a distance between the focal point plane 208 and a point at which the optical ray 208 crosses the optical axis 201 is lateral aberration Δy. A distance between the focal point plane 208 and a point at which the optical ray 208 crosses the optical axis 201 is longitudinal aberration Δz.
The wavefront aberration 206 is expressed by a function W(r) of a radius r of an exit pupil plane, and is approximated in an assumption that an effective radius (effective pupil) 211 of the exit pupil 202 is smaller than a focal distance f (the approximation is so-called paraxial approximation). Since the optical ray travels in vertical to the wave front, the lateral aberration Δy is expressed by the following equation (1).
Δy=f·(dW/dr) (1)
Meanwhile, the longitudinal aberration Δz is expressed by the following equation (2).
In the equation, a term “ρ” is a radius obtained by normalization of the radius r of the exit pupil plane by the effective radius R, and is expressed by the following equation (3). A term “NA” is a numerical aperture expressed by the following equation (4).
ρ=r/R (3)
NA=R/f (4)
If the longitudinal aberration Δz is generated by the phase plate, the longitudinal aberration Δz is equivalent to an amount of the defocus between the optical ray penetrating the optical axis 201 and the optical ray penetrating a predetermined pupil radius position. Therefore, the wavefront aberration 206 of the phase plate is designed so that this longitudinal aberration Δz is uniformly distributed in a predetermined focal-depth extension range.
On the other hand, a plane of the annular groove at other portions than the bottom of the annular groove 310, in other words, at portions at which the normal line slopes with respect to the optical axis, acts as a concave lens. Therefore, the penetrating optical ray at the portions at which the normal line slopes with respect to the optical axis travels to shift to positions in front and back of the focal point 303 as shown with a broken line of
In each annular groove 310, in order to uniform the point image intensities in the focal-depth extension range at the positions in front and back of the focal point 303 as much as possible, an area of a plane in an outer region (close to the outer circumference) of the circular grove 310 and an area of a plane in an inner region (close to the inner circumference) of the circular grove 310 to be equally split at the bottom of the annular groove 310 are almost equal to each other. In other words, in an assumption that a normalized radius of the bottom of the annular groove 310 with respect to the optical axis is “ρ0”, a normalized radius of an inner circumferential end of the annular groove 310 is “ρ1”, and a normalized radius of an outer circumferential end of the annular groove 310 is “ρ2”, the following equations (5) and (6) are provided.
ρ22−ρ02=ρ02−ρ12 (5)
ρ02=(ρ12+ρ22)/2 (6)
However, since the bottom of the annular groove 310 at which the longitudinal aberration Δz is “0” is not the middle point between the inner circumferential end and the outer circumferential end of the annular groove as shown in the equation (6), the function of the longitudinal aberration in
Δz(φ=aρ2+bρ+c (7)
Since this quadratic function satisfies the relation shown in
−Δz=aρ12+bρ1+c (8)
0=aρ02+bρ0+c (9)
+Δz=aρ22+bρ2+c (10)
By solution for the equations (8) to (10), the following equations (11) to (13) are provided.
a=Δz/(ρ02−ρ12) (11)
b=0 (12)
c=−(Δz·ρ02)/(ρ02−ρ12) (13)
Meanwhile, in accordance with the equation (2), the wavefront aberration W(r) satisfying such longitudinal aberration satisfies a relation of the following equation (14).
dW/dρ=(Δz/(ρ02−ρ12))NA2(ρ3−ρ02ρ) (14)
When the equation (14) is integrated under a condition of “W(ρ1)=0”, the wavefront aberration W(r) is expressed by a quartic function shown in the following equation (15).
W(φ=(Δz·NA2/(4(ρ02−ρ12)))×(ρ4−2ρ02ρ2−ρ14+2ρ12ρ02) (15)
When the wavefront aberration expressed by the equation (15) is achieved by a parallel-plate transparent optical element, a relation of the following equation (16) is satisfied under conditions in which a sag amount is Z(ρ) while a refractive index of an optical material at a wave length “A” is “n”. Therefore, the sag amount Z(ρ) is expressed by the following equation (17).
W(ρ)=Z(ρ)×(n−1) (16)
Z(ρ)=(1/(n−1))W(ρ) (17)
The contents explained here support the single annular groove. The wavefront aberration is also designed for another annular grooves so that the longitudinal aberration satisfies the relation of
The longitudinal aberration Δz is expressed by differential of the wavefront aberration as shown in the equation (2). Therefore, even when the longitudinal aberration Δz zigzags as shown in
As shown in
At the boundary between the concave portion and the convex portion, a second-order differential value of the sag amount expressed by the equation (17) is almost discontinuous. A width of each annular groove 116 is not particularly limited. However, as a result of simulation making difference in the width of the annular groove 116 of the phase plate 115 according to the present embodiment, it is found that the focal-depth extension performance is higher in a case in which the widths of the annular grooves 116 on the inner circumferential end and the outer circumferential end are equal to each other than a case in which the width of the annular groove 116 on the outer circumferential end of the phase plate 115 is narrower than the width of the annular groove 116 on the inner circumferential end.
<Main Effect According to Present Embodiment>
According to the present embodiment, the value of the longitudinal aberration Δz between the plurality of annular grooves 116 zigzags plural times between the first value and the second value. The longitudinal aberration Δz continues at the boundary between the adjacent annular grooves 116. In each of the annular grooves 116, an area of an inner circumferential plane of the phase plate (optical component) 115 and an area of an outer circumferential plane of the phase plate 115 are almost equal to each other at a zero cross point at which the longitudinal aberration Δz is zero.
This configuration equalizes a light quantity of a region where the longitudinal aberration Δz is on a positive side and a light quantity of a region where the longitudinal aberration Δz is on a negative side at the zero cross point. And, the optical ray in the positive and negative regions of the defocus uniformly distributes within the focal-depth extension range, and the uniform point spread is provided. Then, the imaging process for the removal of the blur is performed to the captured image produced from such an imaging optical system. This manner can achieve a focal-depth extended image being clear and having a large focal depth in a uniform image quality in a wide defocus range in front and back of the focal point.
According to the present embodiment, a change range of the longitudinal aberration Δz in each annular groove 116 is almost equal among the plurality of annular grooves 116. According to this configuration, the light quantity of the region where the longitudinal aberration Δz is on the positive side and the light quantity of the region where the longitudinal aberration Δz is on the negative side in each annular groove are equal among the plurality of annular grooves 116.
According to the present embodiment, at the boundary between the concave portion and the convex portion, the second-order differential value of the sag amount is almost discontinuous. This configuration continuously connects the concave portion and the convex portion, and can suppress the generation of the scattered light.
According to the present embodiment, in the concave portion, the area of the inner circumferential plane of the phase plate 115 and the area of the outer circumferential plane of the phase plate 115 are almost equal to each other at the point at which the plane of the concave portion has the extremum. In the convex portion, the area of the inner circumferential plane of the phase plate 115 and the area of the outer circumferential plane of the phase plate 115 are almost equal to each other at the point at which the plane of the convex portion has the extremum.
This configuration equalizes the light quantity of the region where the longitudinal aberration Δz is on the positive side and the light quantity of the region where the longitudinal aberration Δz is on eth negative side at the zero cross point. And, the optical ray in the positive and negative regions of the defocus uniformly distributes within the focal-depth extension range, and the uniform point spread is provided. Then, the imaging process for the removal of the blur is performed to the captured image produced by such an imaging optical system. This manner can achieve a focal-depth extended image being clear and having a large focal depth in a uniform image quality in a wide defocus range in front and back of the focal point.
According to the present embodiment, the widths of the plurality of annular grooves 116 are almost equal to one another. This configuration can more improve the evaluation indicator value of the captured image done with the imaging process for the defocus than that in a case of making difference in the width for each annular groove 116. In other words, the present embodiment can improve the image quality of the captured image done with the imaging process.
According to the present embodiment, a sag shape of the concave portion along the radius direction of the phase plate 115 is expressed by a quartic or high-order function. This configuration can more improve the optical property since the shapes of the concave and the convex portions can be designed in detail.
Next, a first example according to the present embodiment will be explained. Each condition of the first example is as follows. An “F” value of the imaging optical system 110 is 2.19, a focal distance of the imaging optical system 110 is 45 mm, a pixel pitch of the imaging sensor 131 is 3.27 μm, the number of pixels of the imaging sensor 131 is 1024×1024, a distance from the imaging apparatus 100 to an image-capturing target object is 18.7 m, the number of annular grooves 116 is three, and the widths of the respective annular grooves 116 are equal to one another.
As shown in the equation (15), the function of the wavefront aberration is set for each annular groove 116. However, in the phase plate 115 of the present embodiment, the phase distribution is smoothly connected at the boundary between the adjacent annular grooves 116 as shown in
An optical plane shape of the phase plate 115 providing such a property is a shape in proportional to the curve representing the phase property. Therefore, the phase plate 115 has no-step shape at the boundary between the adjacent annular grooves 116 (see, for example,
On the other hand, as the related-art example,
As shown in
The zero cross point at which the longitudinal aberration Δz is zero and crosses the vertical axis is at a position equally splitting the inner region and the outer region of each annular groove 116 to have the same area. In other words, in each annular groove 116, the area of the inner circumferential plane of the phase plate 115 and the area of the outer circumferential plane of the phase plate 115 are almost equal to each other at the zero cross point at which the longitudinal aberration Δz is zero.
Therefore, at the zero cross point, the light quantity of the region where the longitudinal aberration Δz is on the positive side and the light quantity of the region where the longitudinal aberration Δz is on the negative side are equal to each other.
This configuration improves the symmetric property of the longitudinal aberration Δz between the positive side and the negative side of the zero cross point, and improves the symmetric property of the image quality change with respect to the defocus.
On the other hand, in the related-art example, the longitudinal aberration at the boundary between the annular grooves is discontinuous as shown in
The zero cross point at which the longitudinal aberration crosses the vertical axis is the radius position equally splitting the annular groove, which is almost the same position as that of the first example, and has the symmetric property of the light quantity based on the defocus but has the worse symmetric property of the image quality change based on the defocus than that of the first example because of not having the symmetric property of the longitudinal aberration.
The PSNR on the vertical axis is expressed in a unit of dB (decibel), and shows that the larger the evaluation indicator value is, the smaller a difference between an original test image and the captured image done with the imaging process is.
As shown in
On the other hand, in the related-art example, when the defocus is zero, the value of the PSNR is smaller than 35 dB and is smaller than the value of the first example. And, in the related-art example, the values of the PSNR in the positive region and the negative region of the defocus are not symmetric to each other. Accordingly, the configuration of the first example can improve the image quality of the captured image done with the imaging process in the region where the defocus is zero. Also, the configuration of the first example can improve the symmetric property of the values of the PSNR in the positive region and the negative region of the defocus, and can almost equalize the deterioration of the image quality in these regions.
Note that the “general” example shows quality deterioration of an image not done with the imaging process. As shown in
The focal-depth extension optical system SYS produces the captured image blurred by the optical system in order to reduce dependency of the image quality on the defocus, and restores the original image by removing the blur through the imaging process. Therefore, the frequency property of the deconvolution filter is exemplified as a high pass filter that restores a high frequency component having been decreased by the imaging optical system, through the imaging process.
In this case, such a high-pass process as exceeding an S/N ratio of the original captured image cannot restore the reproduced image (the image done with the imaging process) since the reproduced image is buried under noises. Therefore, the amplification gain is better to be as small as possible. In
Next, the second example will be explained. As similar to the first example, the second example will be explained with reference to
First,
Next,
Next,
Next,
[Others]
In addition, the present inventors have studied a configuration or others making the inner region area of the annular grooves and the outer region area of the annular grooves to be equal to each other regardless of which annular groove is taken, by decreasing the width of the annular groove to be narrower when getting closer to the outer circumferential side. The performance of the PSNR is more excellent in the case in which the widths of the annular grooves on the inner circumferential side and the outer circumferential side are equal to each other.
Note that the present invention is not limited to the above-described embodiments, and includes various modification examples. Also, a part of the structure of one embodiment can be replaced with the structure of another embodiment, and besides, the structure of another embodiment can be added to the structure of one embodiment. Further, another structure can be added to/eliminated from/replaced with a part of the structure of each embodiment. Note that each member and a relative size shown in the drawings are simplified and idealized for easily understanding the present invention, and have complicated shapes in practice in some cases.
Number | Date | Country | Kind |
---|---|---|---|
2020-180063 | Oct 2020 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
7660225 | Kimura et al. | Feb 2010 | B2 |
7957249 | Kimura et al. | Jun 2011 | B2 |
10571710 | Oota et al. | Feb 2020 | B2 |
20100322059 | Yasui | Dec 2010 | A1 |
20160057337 | Shimano et al. | Feb 2016 | A1 |
20180173005 | Oota et al. | Jun 2018 | A1 |
Number | Date | Country |
---|---|---|
101191842 | Jun 2008 | CN |
101789243 | Jul 2010 | CN |
108227062 | Jun 2018 | CN |
2015-4883 | Jan 2015 | JP |
2015-102767 | Jun 2015 | JP |
2018-101065 | Jun 2018 | JP |
WO 2012132685 | Oct 2012 | WO |
WO 2013122175 | Aug 2013 | WO |
WO 2015155842 | Oct 2015 | WO |
Entry |
---|
Chinese-language Office Action issued in Chinese Application No. 202111180392.0 dated Apr. 14, 2023 (six (6) pages). |
Number | Date | Country | |
---|---|---|---|
20220128739 A1 | Apr 2022 | US |