This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2014-051713 filed in Japan on Mar. 14, 2014; the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally a camera module.
A small camera module mounted on mobile phones or the like, for example, may include a solid state imaging device and a lens holder. The lens holder includes a lens arranged inside the lens holder and configured to cover the solid state imaging device. Such a camera module can focus light reflected from an object onto a solid state imaging device using a lens to form an image of the object.
Because of aberration of the lens, the image formed by the lens includes blurs and distortions. The image formed by focusing light on the solid state imaging device, therefore, includes blurs and distortions, causing deterioration in quality of the image output from the camera module. To improve the quality of the output image, it is necessary to suppress the aberration of the lens as much as possible. To suppress the aberration of the lens, a group of lenses formed by a combination of lenses needs to be applied to the camera module. However, the necessary number of lenses increases as the aberration is further suppressed. Suppressing the aberration of the lens, therefore, leads to a problem that the size of the camera module is enlarged when the quality of the output image output from the camera module is further improved.
Certain embodiments provide a camera module including a blur correcting lens, a lens holder, a solid state imaging chip, and a distortion correction processing chip. The lens holder is arranged on a mounting substrate and includes the blur correcting lens inside the lens holder. The solid state imaging chip is arranged on the mounting substrate so as to be covered by the lens holder, and includes a logic circuit and a pixel unit having a plurality of pixels. The distortion correction processing chip is arranged on the mounting substrate inside the lens holder, and corrects an image signal output from the solid state imaging chip to correct distortion of the image formed by the image signal.
A camera module according to embodiments will be described in detail below.
The solid state imaging device 1 of the camera module 10 includes a solid state imaging chip 12 and a distortion correction processing chip 26 on a substrate 13. The substrate 13 is a mounting substrate which is, for example, a printed substrate.
The solid state imaging chip 12 includes a semiconductor substrate 15 that is, for example, a CMOS sensor unit made of silicon or the like, a pixel unit 16 provided on a part of the surface of the semiconductor substrate 15, and a logic circuit 17.
The pixel unit 16 is, for example, a CMOS sensor formed by a plurality of pixels arranged two dimensionally in a grid-like manner.
The correction processing circuit of pixel characteristics variation corrects an image signal obtained from the pixel unit 16 so as to suppress variation in characteristics of each pixel provided in the pixel unit 16. Specifically, the correction processing circuit performs various types of processing including correction of defective pixels to supply desired luminance to a defective pixel, black level correction to remove noise according to dark current of each pixel, shading correction to suppress variation of luminance of a plurality of pixels, noise reduction, and so on.
The blur correction processing circuit corrects occurrence of blurs in the image formed by an image signal output from the pixel unit 16 of the solid state imaging chip 12 due to the aberration of the collecting lens 11. Specifically, the correction processing circuit restores resolution by, for example, correcting spherical aberration, coma aberration, astigmatism, and field curvature of the lens 11.
The spherical aberration, the coma aberration, the astigmatism, and the field curvature may also be corrected by applying a blur correcting lens 11′ for correcting such aberration while collecting light as a lens. When the blur correcting lens 11′ is used, the blur correction processing circuit may not be necessary, but is preferably provided. When one of the spherical aberration, the coma aberration, the astigmatism, and the field curvature is corrected by the blur correction lens 11′, the blur correction processing circuit may correct aberration that has not been corrected by the lens 11′ among the spherical aberration, the coma aberration, the astigmatism, and the field curvature.
Referring to
A lens holder 19 made of, for example, a light shielding resin is arranged on the surface of the substrate 13 where the solid state imaging chip 12 is arranged. The lens holder 19 is in tubular shape and arranged on the surface of the substrate 13 so as to cover the solid state imaging chip 12.
An infrared ray blocking filter 20 is arranged at a part of the inner side of the lens holder 19 to block an infrared component of light, which has been incident on the camera module 10, and allow transmission of light components other than the infrared component
A lens barrel 21 made of, for example, a light shielding resin is arranged above the infrared ray blocking filter 20 on the inner side of such a lens holder 19. The lens barrel 21 is in tubular shape and arranged inside the lens holder 19, while being supported by an elastic body, such as a spring 22.
A lens 11 is arranged in the lens barrel 21 to focus light onto the pixel unit 16 of the above-mentioned solid state imaging chip 12. The blur correcting lens 11′ may be provided in the lens barrel 21 to focus light and correct four types of aberration including the spherical aberration, the coma aberration, the astigmatism, and the field curvature among Zeidel's five types of aberration, while focusing light. Thus, the lens 11 or 11′ alone is applied as a lens to be arranged in the lens barrel 21. In the lens barrel 21, there is no lens for correcting the distortion aberration and the magnification chromatic aberration. The lens 11 (11′), therefore, includes the distortion aberration and the magnification chromatic aberration as the distortion characteristics causing distortion in the image formed according to the image signal output at least from the solid state imaging chip 12.
A lens driving unit formed by, for example, a coil 23 that moves the lens 11 in upward and downward directions is provided on the outer periphery of the lens barrel 21. Meanwhile, a yoke 24 that generates a magnetic field in a predetermined direction is provided on the inner periphery of the lens holder 19. Lorentz force is generated in the coil 23 by the magnetic field generated by the yoke 24 and an electric current flowing through the coil 23. By means of the Lorentz force, the lens barrel 21 including the coil 23 can move in a direction opposite to the elastic force of the spring 22.
As illustrated in
In such a camera module 10, the solid state imaging device 1 includes the distortion correction processing chip 26 arranged on the surface of the substrate 13 surrounded by the lens holder 19 (
As illustrated in
When the pixel unit 16 is irradiated with the incident light, each pixel arranged in the pixel unit 16 generates a pixel signal according to the received incident light. The image signal generated in the pixel unit 16 is input to the logic circuit 17 that includes the correction processing circuit of pixel characteristics variation and the blur correction processing circuit.
Upon input of the image signal into the correction processing circuit of pixel characteristics variation of the logic circuit 17, the correction processing is performed on the image signal so as to suppress the variation of characteristics of each pixel arranged in the pixel unit 16.
Upon input of the image signal into the blur correction processing circuit of the logic circuit 17, the correction processing is performed on the image signal so as to correct blurs of the image formed according to the image signal output from the pixel unit 16.
Subsequent to such correction processing in the logic circuit 17, the image signal is input to the distortion correction processing chip 26.
Upon input of the image signal into the distortion correction processing chip 26, the correction processing is performed on the image signal so as to correct distortion (the distortion aberration and the magnification chromatic aberration) of the image formed according to the image signal output from the pixel unit 16.
The distortion aberration and the correction of the distortion aberration will be described by referring to
When the distortion aberration occurs in the image according to the image signal output from the pixel unit 16, the image is distorted in barrel shape, as indicated by a solid line D of
The image indicated by the solid line D in
To correct such distortion aberration, the distortion correction processing chip 26 may decrease the aberration quantity p included in the image signal V (r), which has been obtained from the pixel provided at the position corresponding to the image height r, to bring the aberration quantity p to be close to zero, as illustrated in
As a result of such correction processing, the distortion aberration is corrected and an image T that approximates an ideal image T′ can be obtained, as illustrated in
The image including the barrel-shaped distortion aberration is illustrated in
Next, magnification chromatic aberration and correction of the magnification chromatic aberration will be described by referring to
When the magnification chromatic aberration occurs in the image according to the image signal output from the pixel unit 16, the image is multiplexed, as indicated by a dotted line DG, a solid line DB, and a dashed line DR of
Such an image is formed as a result of the image signal, as illustrated in
To correct such magnification chromatic aberration, the distortion correction processing chip 26 may bring the difference in aberration quantity, which is included in the image signal for each color, to be close to zero, as illustrated in
As a result of the correction processing, the magnification chromatic aberration is corrected and the image T with the multiplication suppressed can be obtained, as illustrated in
The distortion correction processing chip 26 thus corrects the distortion aberration and the magnification chromatic aberration as described above. The distortion correction processing chip 26 may correct both types of aberration one by one in this order. In the camera module 10, however, according to the present embodiment, the distortion correction processing chip 26 simultaneously corrects both the distortion aberration and the magnification chromatic aberration. The correction will be described below.
When the distortion aberration and the magnification chromatic aberration occur in the image according to the image signal output from the pixel unit 16 of the solid state imaging device 1, the image is multiplexed and distorted in barrel shape, as indicated by the dashed line DR, the two-dotted line DG, and the solid line DB of
Such an image is formed as a result of the image signal, which has been obtained for each color from the pixel provided at a position corresponding to the distance (image height) r from the center of the pixel unit 16, including aberration of the aberration quantity p that is different for each color, as illustrated in
To correct such distortion aberration and magnification chromatic aberration, the distortion correction processing chip 26 may decrease the aberration quantities pR, pG, pB included in the image signals obtained from the pixels at positions corresponding to the distance (image height) rR, rG, rB from the center of the pixel unit 16, as illustrated in
As a result of the correction processing, the distortion aberration and the magnification chromatic aberration are corrected simultaneously, and the image T that approximates the ideal image T′ can be obtained, as illustrated in
Specific structure of the distortion correction processing chip 26 will be described later.
Referring to
In the camera module 10 according to the present embodiment, the image signal output from the solid state imaging device 1 is sent to a controller 31, such as a central processing unit (CPU), installed in an electric device of a mobile phone or the like in which the camera module 10 is mounted.
The controller 31 determines if there is a blur in the image formed according to the image signal output from the solid state imaging device 1.
If no blur has been generated, the image having been formed according to the image signal output from the solid state imaging device 1 is provided as an output image of the camera module 10.
While the blur has been generated, the AF driver 25 is driven according to the blur quantity to flow a predetermined amount of electric current to the coil 23 that acts as the lens driving unit. The lens 11 is then moved to a position where the blur in the image is suppressed. As a result, the image in which the blur has been suppressed can be provided as an output image of the camera module 10.
Next, the distortion correction processing chip will be described.
The distortion correction processing chip 26 includes a position calculating unit 28 configured to calculate a position of the pixel from which the image signal has been obtained, and a position correcting unit 29 configured to calculate the position of the obtained image signal after the correction has been performed.
The position calculating unit 28 calculates, for example, a distance r between the center of the pixel unit 16 and the pixel position where the image signal has been obtained.
The position correcting unit 29 performs correction to decrease the aberration quantity p included in the image signal obtained in the pixel provided at the distance r from the center, and brings the actually obtained position of the image signal close to an ideal position where the image signal is to be obtained. That is, the position correcting unit performs correction to bring a curve representing the aberration quantity as indicated by
The position correcting unit 29 calculates the distance r′ representing the post-correction position using the distance r representing a pre-correction position according to, for example, a polynominal equation below.
r′=A×r
9
+B×r
7
+C×r
5
+D×r
3
+E×r
The distortion correction processing chip 26 includes a correction coefficient storage unit 30 that stores coefficients A, B, C, D, E of the above polynominal equation. Upon receipt of the distance r calculated by the position calculating unit 28, the position correcting unit 29 reads coefficients A, B, C, D, E of the polynominal equation from the correction coefficient storage unit 30. The position correcting unit 29 then sets the distance r and the coefficients A, B, C, D, E in the polynominal equation to calculate the post-correction position of the image signal as the distance r′ from the center of the pixel unit 16.
The distortion correction processing chip 26 thus corrects the position of the image signal. As a result, the distortion of the image formed according to the image signal output from the distortion correction processing chip 26 is corrected.
As illustrated in
Since, however, the actual difference of the aberration quantity between colors is small, the distance r′ may be calculated using the same coefficients A, B, C, D, E. Accordingly, the storage area of the correction coefficient storage unit 30 can be saved.
As described above, in the camera module 10 of the present embodiment, the solid state imaging device 1 includes the distortion correction processing chip 26 to correct the distortion aberration and the magnification chromatic aberration of the image output from the camera module 10. In the camera module 10 to which the solid state imaging device 1 mentioned above has been applied, there is no need to provide a lens for correcting the aberration. As a result, the number of lenses provided in the lens barrel 21 can be reduced, to thereby decrease the size of the camera module 10. The distortion correction processing chip 26 is arranged in an unused area on the surface of the substrate 13 around the solid state imaging chip 12. Enlargement of the size of the camera module 10 due to providing the distortion correction processing chip 26 can, therefore, be suppressed.
Meanwhile, the camera module 10 according to the first embodiment can also be used as a camera module for taking motion pictures, because it is not necessary to execute signal processing of correcting the lens aberration externally, for example, on software outside the module 10.
In the camera module 40 according to the second embodiment, the solid state imaging device 1 also includes the distortion correction processing chip 41. The lens for correcting the distortion aberration and the magnification chromatic aberration is not necessary. As a result, the number of lenses arranged in the lens barrel 21 can be reduced, to thereby decrease the size of the camera module 40. The distortion correction processing chip 41 is arranged between the solid state imaging chip 12 and the substrate 13. Enlargement of the size of the camera module 40 due to providing the distortion correction processing chip 41 can be suppressed.
Further, in the camera module 40 according to the second embodiment, the distortion correction processing chip 41 is arranged between the solid state imaging chip 12 and the substrate 13, instead of being arranged on the surface of the substrate 13 around the solid state imaging chip 12. It is possible, therefore, to eliminate space to arrange the distortion correction processing circuit 41, when compared to the camera module 10 of the first embodiment, to thereby decrease the size of the camera module 40.
Meanwhile, the camera module 40 according to the second embodiment can also be used as a camera module for taking motion pictures, because it is not necessary to execute signal processing of correcting the lens aberration externally, for example, on software outside the module 40.
In the camera module 10 of the first embodiment and the camera module 40 of the second embodiment, both the distortion correction processing chips 26, correct the distortion aberration and the magnification chromatic aberration. Alternatively, the distortion correction processing chip may correct one of the distortion aberration and the magnification chromatic aberration, and the other aberration is corrected by a lens. Such embodiments will be described below.
In such a camera module 50 according to the third embodiment, the solid state imaging device 1 also includes the distortion correction processing unit 52 that corrects the distortion aberration. The lens for correcting the distortion aberration is not necessary. As a result, the number of lenses provided in the lens barrel 21 can be reduced, when compared to the camera module in the past, to thereby decrease the size of the camera module 50. The distortion correction processing chip 52 is arranged in an unused area on the surface of the substrate 13 around the solid state imaging chip 12. Enlargement of the size of the camera module 50 due to providing the distortion correction processing chip 52 can be suppressed.
Meanwhile, the camera module 50 according to the third embodiment can also be used as a camera module for taking motion pictures, because it is not necessary to execute signal processing of correcting the lens aberration externally, for example, on software outside the module 50.
In such a camera module 60 according to the fourth embodiment, a distortion correction processing chip 62 that corrects the magnification chromatic aberration is also included in the solid state imaging device 1. The lens for correcting the magnification chromatic aberration is not necessary. As a result, the number of lenses provided in the lens barrel 21 can be reduced, when compared to the camera module in the past, to thereby decrease the size of the camera module 60. The distortion correction processing chip 62 is arranged in an unused area on the surface of the substrate 13 around the solid state imaging chip 12. Enlargement of the size of the camera module 60 due to providing the distortion correction processing chip 62 can be suppressed.
Meanwhile, the camera module 60 according to the fourth embodiment can also be used as a camera module for taking motion pictures, because it is not necessary to execute signal processing of correcting the lens aberration externally, for example, on software outside the module 60.
In the camera module 50 according to the third embodiment and the camera module 60 according to the fourth embodiment, the distortion correction processing chips 52, 62 may be arranged between the solid state imaging chip 12 and the substrate 13, as in the camera module 40 according to the second embodiment.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
In the embodiments described above, the distortion correction processing circuits 26, 41, 52, 62 have been applied to the camera modules 10, 40, 50, 60. However, the distortion correction processing chips 26, 41, 52, 62 can also be similarly applied to other imaging modules including the lens 11.
Number | Date | Country | Kind |
---|---|---|---|
2014-051713 | Mar 2014 | JP | national |