This application claims the priority of Japanese Patent Application No. 2014-016352, filed on Jan. 31, 2014, which is incorporated herein by reference in its entirety.
1. Field of the Invention
The present invention relates to an imaging apparatus. 2. Description of the Related Art
As the related art of a field of the present technology, JP-2003-169255-A has been known. In JP-2003-169255-A, it is described that “in a field of a digital camera using a CCD solid-state imaging element or a CMOS sensor for public welfare, because a restriction is large in terms of a cost, a shading correction method capable of ensuring some correction precision at some cost is preferable. However, a preferable method is not suggested for the shading correction method. Therefore, an object of the present invention is to provide a shading correction method and a shading correction apparatus that can perform optimal shading correction at a limited cost (gate number) in a camera system for public welfare”.
In JP-2003-169255-A, a difference of shading by a state of a diaphragm of a lens is not considered and there is room for improvement in realizing appropriate shading correction having considered visibility.
An aspect of the present invention provides an imaging apparatus including an imaging unit that outputs an optical image received by an optical unit as an electric signal, according to set imaging parameters; a shading correcting unit that outputs an electric signal obtained by performing shading correction according to the imaging parameters on the electric signal output by the imaging unit; an output unit that outputs the electric signal output from the shading correcting unit; a detecting unit that detects the electric signal output from the shading correcting unit and output brightness information; and a control unit that sets the imaging parameters of the imaging unit and strength of the shading correction by the shading correcting unit, on the basis of the brightness information output by the detecting unit.
The present invention can provide an imaging apparatus that can perform appropriate shading correction and enable visibility to be superior to a peripheral portion of an image.
Hereinafter, embodiments of the present invention will be described using the drawings. Like elements are denoted with like reference numerals and overlapped description is omitted.
In this embodiment, an example of an imaging apparatus that changes shading correction strength according to a diaphragm of a lens will be described.
The imaging unit 101 includes a lens group including an imaging lens, a zoom lens, and a focus lens, a diaphragm, a shutter, an image sensor configured by an imaging element such as a CCD and a CMOS, an amplifier, and an AD converter. The imaging unit 101 executes photoelectric conversion on an optical image received by the image sensor and outputs the optical image as an electric signal.
The shading correcting unit 102 is a block that corrects a signal level decreasing when a peripheral light amount due to the imaging unit 101 decreases. The shading correcting unit 102 includes correction tables in which correction data corresponding to some setting values of a diaphragm to be factors of shading of the imaging unit 101 is stored and an operation processing unit that calculates a correction coefficient of each pixel from correction parameters set by the control unit 106 to be described below and the correction data of the correction tables and executes an operation process of the calculated correction coefficient with an input pixel. The shading correcting unit 102 executes an operation process on the electrical signal from the imaging unit 101 and outputs an electric signal after a shading correction process.
The detecting unit 105 is a block that detects brightness information such as a signal level of video obtained by imaging to acquire determination elements to perform exposure control of the imaging unit 101. As a method of detecting the brightness information, a detection result to be information such as brightness is output from an average value of a signal level of each pixel of an input signal of a region designated from the control unit 106.
The detection method is not limited to the above method and a method capable of determining a level of brightness, such as a method of acquiring a histogram of a signal level and acquiring a level of brightness from a result thereof, a method of acquiring an average value of pixels other than pixels having saturated signal levels and increasing precision of a detection result, and a method of determining a level of brightness according to the number of pixels having saturated signal levels, may be used.
The signal processing unit 103 executes a separation process or a demosaicking process on a signal output by the shading correcting unit 102 and generates a video signal. In addition, the signal processing unit 103 adjusts brightness, contrast, and a color tone of the generated video signal and removes noise, if necessary.
The image output unit 104 converts the received signal into a signal, which can be received by an apparatus to which a signal is output from the imaging apparatus 100, for example, a display device such as a liquid crystal display and a recording device including a storage unit such as a hard disk, and outputs the signal. In addition, when the image output unit 104 is connected by a network, the image output unit 104 converts a format of the signal into a format of a signal corresponding to a transmission method of a moving image, which can be received by the display device, and outputs the signal.
The control unit 106 controls the imaging unit 101 and the shading correcting unit 102, on the basis of the brightness information output by the detecting unit 105. For example, the control unit 106 compares brightness information of a previously set target and the brightness information acquired from the detecting unit 105. If the brightness is insufficient, the control unit 106 determines a diaphragm value, a shutter speed, and a value of gain of the amplifier of the imaging unit 101 such that the brightness approximates to a target value, and sets the determined values to the imaging unit 101.
Here, when the setting values of the imaging unit 101 change a state of shading, for example, change the diaphragm value, the control unit 106 sets correction parameters of the shading correcting unit 102 such that appropriate shading correction is performed. The correction parameters will be described in detail below. If some correction tables corresponding to the diaphragm exist in the shading correcting unit 102, the correction parameters include selection IDs of two correction tables corresponding to diaphragm values with the diaphragm value set to the imaging unit 101 therebetween, an interpolation coefficient to calculate correction data corresponding to the set diaphragm value from correction data of the selected correction tables, and correction strength to determine strength of the shading correction to designate a ratio of an influence on an input pixel by the calculated correction data.
Here, the correction strength is calculated from a maximum correction amount in the set diaphragm value and an allowable maximum correction amount. The allowable maximum correction amount is determined from image quality of an output image of the imaging apparatus 100 for a portion in which a correction amount is large, for example, brightness, a color tone, noise, and resolution and is previously set.
For example, when the maximum value of the correction amount is not more than the previously set maximum value, if a subject has uniform illuminance, the control unit 106 increases the correction strength such that an output signal level of the shading correction becomes uniform and when the maximum value of the shading correction amount is more than the previously set maximum value, the control unit 106 decreases the correction strength. Thereby, the control unit 106 prevents visibility from being deteriorated.
In an imaging apparatus of a monitoring camera, exposure control is performed such that video having superior visibility can be obtained at all times, even though an external light amount greatly changes from the night to the daytime. In the exposure control of the imaging apparatus, exposure conditions such as the diaphragm or the shutter speed of the optical lens and the gain are controlled. For the monitoring camera, it is necessary to image a moving subject at low illuminance and a light amount is maximally obtained. For this reason, the monitoring camera is generally used in a state in which the diaphragm of the lens is close to an open end.
If the diaphragm of the lens comes close to the open end, an amount of shading of an imaging image occurring when a light amount of a peripheral portion is smaller than a light amount of a center portion increases. In an expensive lens, a mechanism for preventing the shading from occurring is provided. However, in an imaging apparatus manufactured at a limited cost, the expensive lens cannot be used and large shading often occurs. In addition, in the lens for the monitoring camera, a zoom lens having high magnification and a wide-angle lens are often used, which results in causing the large shading. For this reason, if the shading correction is performed perfectly on an output image, visibility may be deteriorated, for example, brightness of a peripheral portion or gradation of a color may decrease, resolution may decrease, or a noise amount may increase.
As described above, in the imaging apparatus 100 according to the present invention, the control unit 106 determines the diaphragm value of the imaging unit from the output information of the detecting unit 105 and the appropriate shading correction is enabled according to the set diaphragm value. Therefore, an imaging apparatus that can obtain superior visibility even when shading occurs in an imaging unit can be provided.
Hereinafter, an example of each portion configuring the imaging unit 101 will be described in detail using the drawings.
The light incident on the imaging unit 101 is incident on the image sensor unit 203 through the optical unit 200. In the image sensor unit 203, the control unit 106 executes photoelectric conversion and outputs a signal corresponding to an amount of light received by the image sensor unit 203. The amplifying unit 204 amplifies the signal output from the image sensor unit. The AD converting unit 205 converts an analog signal amplified by the amplifying unit 204 into a digital signal.
A level of the signal output from the imaging unit 101 is controlled by adjusting the diaphragm 202 of the optical unit 200, the exposure time of the image sensor unit 203, and the gain of the amplifying unit 204, for example. For the monitoring camera imaging a dark subject at the night, because the exposure time of the image sensor unit 203 is shorter than a frame rate of an image in a moving image, imaging is performed generally after the diaphragm of the optical unit 200 is opened and the gain of the amplifying unit 204 is increased.
If the diaphragm of the optical unit is opened, aberration in which a variation is generated in a level of a signal output from the imaging unit or brightness irregularities such as shading to be reduction of a light amount of a peripheral portion for a light amount of a center portion occur even though the imaging unit images a subject of which an entire surface is uniformly illuminated with light. In the monitoring camera, the brightness irregularities occur easily due to adoption of a zoom lens having high magnification, a wide-angle lens to image a wide range, or an inexpensive lens.
An example of the shading correcting unit 102 will be described in detail below using the drawings.
For example, the shading correcting unit 102 includes a correction data table 301 to perform correction according to a screen position and a diaphragm value, a correction coefficient calculating unit 302 to calculate a correction coefficient of each pixel from a correction table, and a correction processing unit 303 to multiply the correction coefficient and input pixel data.
The correction data table 301 stores a plurality of correction tables. In each correction table, a shading correction amount is set as correction data, according to shading occurred by the screen position or the diaphragm of the lens. The correction data that is stored in the correction data table 301 does not need to be correction data corresponding to all pixels. For example, a screen is divided into blocks, correction data of pixels corresponding to vertexes of each block is stored, an interpolation process using the correction data of the vertexes of each block is executed according to a position of each pixel, and correction data of each pixel is calculated.
Here, when the calculated pixel is at an equal distance from all coordinates of the coordinate positions 500, 510, 511, and 512, an average value of the correction data of the coordinate position 500, the correction data of the coordinate position 510, the correction data of the coordinate position 511, and the correction data of the coordinate position 512 becomes correction data of the calculated pixel.
The block example of the screen has been described. However, the block division numbers in the horizontal direction and the vertical direction are exemplary and the present invention is not limited thereto. The width and the height of each block do not need to be the same width and the same height. The horizontal coordinates and the vertical coordinates of each block may be stored at the same time and the widths or the heights of one or more blocks from the upper, lower, left, and right ends in which the correction data greatly changes may be set to small values and the widths or the heights of the other blocks in which the correction data does not greatly change may be set to large values. Alternatively, the widths may be increased in order from the blocks of the left and right ends to the blocks of the center portion and the heights may be increased in order from the blocks of the upper and lower ends to the blocks of the center portion. Thereby, interpolation can be performed with high precision. In the example of
In the correction data table 301, correction tables corresponding to all diaphragm values are not provided. For example, interpolation can be performed from correction tables corresponding to different diaphragm values.
In
For the correction table ID, when the setting value of the diaphragm 202 set to the imaging unit 101 by the control unit 106 is between the diaphragm setting value B and the diaphragm setting value C, the control unit 106 selects a correction table ID of the diaphragm setting value B and a correction table ID of the diaphragm setting value C. For the weight coefficient, the control unit 106 determines the weight coefficient from a ratio of a difference of the setting value of the diaphragm 202 and the diaphragm setting value B and a difference of the setting value of the diaphragm 202 and the diaphragm setting value C. For example, in the case of the coordinate position 500 of the calculated pixel, the interpolation correction data 530 is calculated by multiplying the correction data 522 of the correction table of the diaphragm setting value B and the correction data 523 of the correction table of the diaphragm setting value C with the weight coefficient set by the control unit 106 and adding values. In addition, when the calculated pixel is the pixel other than the pixel of the vertex of the block described in
Similar to the interpolation correction data 530 described above, interpolation correction data is acquired for each pixel in the correction coefficient calculating unit 302 and the interpolation correction data is multiplied with the input signal in the correction processing unit 303 using the interpolation correction data as the correction coefficient. As a result, ideal shading correction to make an entire screen have the same brightness is enabled when a subject having uniform illuminance is imaged.
The example of the case in which the correction table is provided for each of the three diaphragm setting values has been described. However, the number and the interval are exemplary and the present invention is not limited to the number.
The correction coefficient calculating unit 302 of the shading correcting unit 102 sets the correction strength to the calculated correction data and performs appropriate shading correction even when the signal level of the peripheral portion greatly decreases. Hereinafter, a setting example of the correction strength will be described.
The maximum value 335 of the set shading correction amount is different according to the imaging unit 101 to be actually used. A maximum allowance value is determined from image quality of an output image of the imaging apparatus 100 for a portion in which a correction amount is large, for example, brightness, a color tone, noise, and resolution and is previously set. In the case in which the correction amount 334 when ideal shading correction to make brightness of an entire screen uniform is performed becomes larger than the maximum value 335 of the set shading correction amount, if the shading correction of the correction amount 334 is performed, it is anticipated that the image quality is deteriorated in the peripheral portion. For this reason, the control unit 106 determines the correction strength such that the maximum value of the correction amount 334 becomes the maximum value of the set shading correction and sets the correction strength to the shading correcting unit 102. In the correction coefficient calculating unit 302 of the shading correcting unit 102, the correction amount 334 and the correction strength are multiplied and the correction amount 336 is acquired. In the correction processing unit 303, the correction amount 336 is multiplied with an input signal using the correction amount 336 as the correction coefficient. The shading correction having considered the image quality of the peripheral portion is enabled by the shading correcting unit described above.
In the above description, the correction method in which the uniform strength is set to the entire surface is described. However, in the portion of the correction amount 334 more than the maximum value 335 of the set shading correction amount, the correction amount may be set to the maximum value 335 of the set shading correction amount and only the peripheral portion may be restricted. In this case, a step of the brightness may occur on the screen. However, a process may be simplified.
Because the appropriate shading correction is enabled by the shading correcting unit 102 described above, an imaging apparatus in which visibility is superior even though shading occurs in an imaging unit can be provided.
A process flow of the control unit 106 of the imaging apparatus 100 described above will be described hereinafter.
In step S1003, the control unit 106 determines the diaphragm value, the shutter speed, and the gain value of the amplifier to be the imaging conditions of the imaging unit 101, from a deviation amount from the exposure target value. For example, when the control unit 106 determines that the brightness is larger than the exposure target value, from the detection result of the detecting unit 105, the control unit 106 decreases the diaphragm value, increases the shutter speed, or decreases the gain value, according to the difference of the brightness. When the control unit 106 determines that the brightness is smaller than the exposure target value, from the detection result, the control unit 106 increases the diaphragm value, decreases the shutter speed, or increases the gain value, according to the difference of the brightness.
Here, when the diaphragm value is not changed, in step S1004, the control unit 106 determines that the shading amount is not changed and ends the process. In addition, when the diaphragm value is changed, the shading amount is also changed. Therefore, the process proceeds to step S1005. In step S1005, the control unit 106 determines the parameters set to the shading correcting unit 102, sets the parameters to the shading correcting unit, and ends the process.
The above process is executed repetitively during imaging and the exposure control of the imaging unit 101 or the correction control of the shading correcting unit 102 is controlled appropriately by the illuminance of the subject.
In addition, when the change speed of the diaphragm of the imaging unit 101 is slow or the change speed of the diaphragm value is slow for oscillation prevention of the exposure control, the control unit 106 performs the determination and the setting of the correction parameters of the shading correcting unit 102, such that the correction amount of the shading correcting unit 102 becomes a ratio corresponding to the diaphragm of the imaging unit.
As described above, in the imaging apparatus 100 according to the present invention, the control unit 106 determines the diaphragm value of the imaging unit from the output information of the detecting unit 105 and the shading correction corresponding to the set diaphragm value is enabled. Therefore, an imaging apparatus in which the shading correction corresponding to the exposure control is enabled can be provided.
In the above description, the correction of the brightness of the shading correcting unit 102 is described. However, a shading characteristic may be different for each color, according to characteristics of the lens and the sensor. In this case, in the shading correcting unit 102, the correction table data is prepared for each color of an electric signal output from the imaging unit 101, for example, each color of red, blue, and green, the correction table data to calculate the correction coefficient is switched for each pixel, and the appropriate shading correction can be performed for each color. As a result, the aberration of the colors or the color irregularities can be improved. Second embodiment
In this embodiment, an imaging apparatus that determines correction strength of a shading correcting unit 102 according to gain of an amplifying unit of an imaging unit 101 will be described.
Control of the shading correcting unit 102 when gain of an amplifier of the imaging unit 101 is changed by exposure control will be described.
400 of (1) shows a light quantity ratio of the center portion pixel and 401 shows a light quantity ratio of the certain peripheral portion pixel. In the light quantity ratio 401 of the peripheral portion pixel, light amounts of the center portion and the peripheral portion are almost equal to each other, in a place where the illuminance is high. If the illuminance decreases and a diaphragm is opened by exposure adjustment, a difference increases for the light quantity ratio 400 of the center portion pixel and a light amount difference is maximized when the diaphragm is positioned at an open end. If the illuminance decreases, the gain of the amplifying unit increases in the imaging unit 101. In the gain of the amplifying unit, because there is no difference in the center portion pixel and the peripheral portion pixel, the light quantity ratio becomes constant. Meanwhile, if the gain of the amplifying unit increases, the noise increases.
402 of (2) shows noise amounts of the peripheral portion pixel and the center portion pixel. Because the noise amount is not changed even though the diaphragm is changed, the noise amount is constant in the illuminance controlled in the diaphragm. However, if the gain of the amplifier increases, the noise increases. Here, in the case in which the noise amount increases, if the signal level of the peripheral portion is amplified by the shading correcting unit 102, the noise is further amplified, the distribution difference of the noise is more than a shading correction effect, and the noise is more visible than the shading. Therefore, the correction strength of the shading correcting unit 102 is decreased according to the noise amount.
410 of (3) shows a signal level of the center portion pixel, 411 shows a signal level of the peripheral portion pixel input to the shading correcting unit 102, and 412 shows a signal level of the peripheral portion pixel output from the shading correcting unit 102. In the signal level 412 of the peripheral portion pixel, when the gain of the amplifier decreases, the strength of the shading correcting unit is increased, the correction is performed such that the signal level of the peripheral portion pixel is almost equal to the signal level of the center portion pixel, the shading is corrected almost perfectly, the correction strength of the shading correcting unit 102 is decreased according to the gain increase, and the amplification of the noise is prevented.
By the control of the shading correcting unit 102 described above, in the image in which it is anticipated that the noise increases, the shading correction strength is decreased, the amplification of the noise is suppressed, and an image having superior visibility can be obtained.
In the control example of the shading correcting unit 102, when the exposure control is in a range controlled in the diaphragm, the strength of the shading correcting unit 102 is made to be constant. However, when it is anticipated that the noise of the peripheral portion is increased by the correction of the shading correcting unit 102 and the visibility is deteriorated, as described in the first embodiment, the control to decrease the correction strength of the shading correcting unit 102 may be performed before the diaphragm is positioned at the open end.
A process flow of the control unit 106 of the imaging apparatus 100 described above will be described hereinafter.
After the process of step S1004 or S1005, in step S1006, the control unit 106 determines whether the gain of the amplifier of the imaging unit 101 is changed. When the gain is not changed, the control unit 106 ends the process and when the gain is changed, the process proceeds to step S1007. In step S1007, the control unit 106 determines the appropriate strength set to the shading correcting unit 102, from the gain of the amplifier of the imaging unit 101, sets the appropriate strength to the shading correcting unit 102, and ends the process.
As described above, in the imaging apparatus 100 according to the present invention, the control unit 106 determines the diaphragm value of the imaging unit from the output information of the detecting unit 105 and the shading correction corresponding to the set diaphragm value is enabled. Therefore, an imaging apparatus in which the shading correction corresponding to the exposure control is enabled can be provided.
In this embodiment, an imaging apparatus that corrects a detection result of a detecting unit according to strength of shading correction will be described.
601 shows a detection correcting unit. When a correction amount of a shading correcting unit 102 is insufficient for a shading amount of an imaging unit 101, the detection correcting unit 601 complements an insufficient amount in a signal level of a signal output from the shading correcting unit and outputs the signal to the detecting unit 105. The correction amount of the detection correcting unit 601 will be described using
For example, in the case in which ideal shading correction to make the entire screen have the uniform brightness is performed, if a control unit 106 is set such that exposure adjustment of the imaging unit 101 by the control unit 106 is stabilized, when a signal on which shading correction is performed to have the signal level 632 is input to the control unit 106 through the detecting unit 105, feedback control of exposure adjustment by the control unit 106 and shading correction by the shading correcting unit 102 are changed and become unstable.
Therefore, the detection correcting unit 601 performs correction such that the signal level 632 output by the shading correcting unit 102 described above becomes the signal level 631 and outputs the signal level to the detecting unit 105. The signal level input to the detecting unit 105 becomes equal to brightness information in a state in which the ideal shading correction to make the entire screen have the uniform brightness is performed at all times.
A configuration of the detection correcting unit 601 is the same as the configuration of the shading correcting unit 102 and the same correction parameters as those in the shading correcting unit 102 are set from the control unit 106. In the detection correcting unit 601, a detection correction coefficient to complement an insufficient amount of a correction amount is calculated from the correction strength of the correction parameters set to the control unit 106 and the detection correction coefficient is used, instead of the correction strength. By the detection correcting unit 601 described above, the signal level 632 can be changed to the signal level 631 obtained by performing the ideal shading correction to make the entire screen have the uniform brightness on the output of the detection correcting unit 601. The calculation of the correction strength of the detection correcting unit 601 is not limited to the calculation by the process in the detection correcting unit and may be executed by the control unit 106. In addition, a correction data table 301 of the shading correcting unit 102 can be shared with other blocks. In the detection correcting unit 601, the correction table of the shading correcting unit 102 may be used.
In addition, in the detection correcting unit 601 that does not affect visibility, correction does not need to be performed with the same resolution as that in the shading correcting unit 102 and the number of blocks dividing the screen may be smaller than that in the shading correcting unit 102. Instead of a correction coefficient of a unit of a pixel, a correction coefficient of a unit of a block may be calculated and may be used as a uniform correction coefficient in the block. As such, the number of blocks is decreased, so that a correction data amount and an operation amount can be decreased.
As described above, in the present invention, because the signal when the ideal shading correction to make the entire screen have the uniform brightness is performed at all times is input to the detecting unit, stabilized exposure control is enabled, regardless of the strength of the shading correction. Fourth embodiment
In this embodiment, an imaging apparatus that performs appropriate shading correction when there are factors causing a plurality of shading corrections will be descried.
The correction parameters set by the control unit 106 include an ID of a correction table selected from the correction data table 301 of the diaphragm, according to a setting value of the imaging unit 101, an interpolation coefficient for the diaphragm to calculate correction data corresponding to a diaphragm value set from correction data of the selected correction table, a correction table ID selected from the correction table 1201 of the zoom, an interpolation coefficient for the zoom to calculate correction data corresponding to a zoom value set from correction data of the selected correction table, and correction strength. The correction coefficient calculating unit 1202 calculates the correction data of the diaphragm from the correction table and the interpolation coefficient of the diaphragm, calculates the correction data of the zoom from the correction table and the interpolation coefficient of the zoom, and calculates the correction coefficient from the correction data of the diaphragm, the correction data of the zoom, and the correction strength.
By the shading correcting unit 1102 described above, an imaging apparatus that can perform appropriate shading correction in shading correction in which there are a plurality of factors can be provided.
In the above description, the two factors of the diaphragm and the zoom are described. However, even when factors causing the shading or the brightness irregularities, such as sensitivity irregularities of a focus lens or a sensor increase, correspondence is enabled by increasing correction tables and performing the same control.
Number | Date | Country | Kind |
---|---|---|---|
2014-016352 | Jan 2014 | JP | national |