Patent Grant
9531950
The present application claims priority under 35 U.S.C. §119 to Japanese Patent Application No. 2014-050526, filed on Mar. 13, 2014. Each of the above application(s) is hereby expressly incorporated by reference, in its entirety, into the present application.
1. Field of the Invention
The present invention relates to an imaging system and an imaging method for imaging a transparent document, such as a film, or a sample with a shade.
2. Description of the Related Art
A document reader that reads a transparent document, such as a film, using a transmission light source is known. In addition, as an apparatus having the same function, there is an imaging system that images a sample with a shade (for example, an electrophoretic gel). Such an imaging system is indispensable when identifying and quantifying biomolecules, especially, proteins or nucleic acids by image analysis.
In a known imaging system using such a transmission light source, there is a problem of ambient light caused by diffusion of illumination light, irregular reflection in the apparatus, and the like. For example, JP1997-44636A (JP-H09-44636A) discloses a correction method for eliminating the influence of light leakage from measurement data by covering a part of an imaging device (CCD) with a light shielding plate and subtracting the signal value detected in pixels (correction pixels) in the covered region from the signal value detected in imaging pixels. In addition, JP1998-142053A (JP-H10-142053) discloses a spectral reflectance measurement apparatus in which the spectral reflectance obtained by measuring a color chart is corrected with the use of the flare spread function.
in the method disclosed in JP1997-44636A (JP-H09-44636), however, the number of imaging pixels is reduced since some pixels of the imaging device are used as correction pixels. For this reason, there is a problem that the imaging region of the imaging device is reduced.
The invention has been made in view of the above problem, and it is an object of the invention to provide an imaging system and an imaging method capable of suppressing the influence of ambient light without reducing the imaging region of an imaging device in an imaging system using a transmission light source.
In order to solve the above-described problem, a first imaging system according to an aspect of the claimed the invention is an imaging system that images a subject by irradiating the subject with light and detecting light transmitted through the subject, and includes: a light source unit; a sensor unit configured to detect light emitted from the light source unit; a storage unit configured to store first correction data calculated based on a difference between first reference data and second reference data, the first reference data being detected by emitting the light with a light shielding plate having an opening placed between the light source unit and the sensor unit and being detected in an opening corresponding region, which is a region of a detection surface of the sensor unit corresponding to the opening of shielding plate, the second reference data being detected in the opening corresponding region by emitting the light without placing the light shielding plate; and a signal processing unit configured to perform first correction of eliminating an influence of ambient light for measurement data, which is obtained by measurement using the subject, based on the first correction data.
On the other hand, a second imaging system according to an aspect of the claimed invention is an imaging system that images a subject by irradiating the subject with light and detecting light transmitted through the subject, and includes: a light source unit; a sensor unit configured to detect light emitted from the light source unit; a storage unit configured to store third reference data as first correction data, the third reference data being detected by emitting the light with the light shielding plate for shielding a part of a detection surface of the sensor unit placed between the light source unit and the sensor unit and being detected in a shielding corresponding region, which is a region in the detection surface corresponding to the light shielding plate; and a signal processing unit configured to perform first correction of eliminating an influence of ambient light for measurement data, which is obtained by measurement using the subject, based on the first correction data.
In the imaging system according to the aspect of the claimed invention, the storage unit may store a plurality of pieces of the first correction data corresponding to divided regions of a plate on which the subject is placed, and the signal processing unit may perform the first correction for each piece of the measurement data obtained in the divided regions.
In the imaging system of the according to the aspect of claimed invention, the storage unit may further store second correction data for correcting light intensity distribution according to an irradiation position of the light, and the signal processing unit may perform second correction of eliminating an influence of the light intensity distribution for the measurement data based on the second correction data before the first correction.
In addition, the first imaging system according to the aspect of the invention may further include the light shielding plate. In this case, the light shielding plate may have a plurality of openings.
In the imaging system according to the aspect of the claimed invention, the light source unit may include a light source that emits the light sideways with respect to a direction of the detection surface, a reflective diffusion plate that reflects and diffuses the light emitted from the light source toward the sensor unit, and a transmissive diffusion plate disposed between the reflective diffusion plate and the sensor unit.
In the imaging system according to the aspect of the claimed invention, the light source unit may include a light source that emits the light toward the detection surface and a transmissive diffusion plate provided between the light source and the sensor unit. In this case, the light source may be an ultraviolet light source, and the light source unit may include a conversion plate that converts ultraviolet light into visible light, the conversion plate being provided between the light source and the transmissive diffusion plate.
In the imaging system according to the aspect of the claimed invention, the signal processing unit may calculate an optical density of the subject based on measurement data for which the first correction has been performed.
In the imaging system according to the aspect of the claimed invention, the light source unit may emit three or more kinds of the light having different wavelengths, and the signal processing unit may generate color data or a color image of the subject by combining measurement data obtained using the respective light beams.
A first imaging method of according to still another aspect of the invention is an imaging method for imaging a subject by irradiating the subject with light and detecting light transmitted through the subject, and includes performing first correction of eliminating an influence of ambient light for measurement data, which is obtained by measurement using the subject, based on first correction data calculated based on a difference between first reference data and second reference data, the first reference data being detected by emitting light form the light source with a light shielding plate having an opening placed between the light source unit and the sensor unit and being detected in an opening corresponding region, which is a region in a detection surface of the sensor unit corresponding to the opening of the shielding plate, the second reference data being detected in the opening corresponding region by emitting the light without placing the light shielding plate.
On the other hand, a second imaging method according to still another aspect of the invention is an imaging method for imaging a subject by irradiating the subject with light and detecting light transmitted through the subject, and includes performing first correction of eliminating an influence of ambient light for measurement data, which is obtained by measurement using the subject, based on first correction data that is third reference data detected by emitting the light from a light source unit with the light shielding plate for shielding a part of a detection surface of a sensor unit placed between the light source unit and the sensor unit and being detected in a shielding corresponding region, which is a region in the detection surface corresponding to the light shielding plate.
The imaging method according to the aspect of the invention may further include calculating the first correction data. In this case, a plurality of pieces of the first correction data may be calculated corresponding to divided regions of a plate on which the subject is placed, and the first correction may be performed for each piece of the measurement data obtained in the divided regions.
In the imaging method according to the aspect of the invention, when acquiring the first and second reference data, a semi-light shielding plate having a known optical density may be provided at a position corresponding to the opening corresponding region.
In the imaging method according to the aspect of the invention, second correction of eliminating an influence of light intensity distribution may be performed on the measurement data based on second correction data for correcting the light intensity distribution according to an irradiation position of the light, and the first correction may be performed on the measurement data for which the second correction has been performed.
In the imaging system and the imaging method according to the aspects of the claimed invention, correction for eliminating the influence of ambient light is performed on measurement data based on correction data calculated before the imaging of the subject. Therefore, some pixels of the imaging device do not need to be used as correction pixels. As a result, in the imaging system using the transmission light source, it is possible to suppress the influence of ambient light without reducing the imaging area on the imaging device.
Hereinafter, embodiments of the invention will be described with reference to the accompanying diagrams. However, the invention is not limited to these. In addition, the scale of each component is appropriately adjusted in order to have a recognizable size in the diagrams described below.
An imaging system and an imaging method according to a first embodiment of the invention will be described.
As shown in
The housing 12 has a hollow portion 18 formed in an approximately rectangular parallelepiped shape, and has the stage 16 on which the subject S is placed. The lid 14 shown in
The imaging unit 20 is fixed to the upper surface of the housing 12, and includes an imaging device, for example, a charge coupled device (CCD). The imaging unit 20 detects light in the housing 12 and generates an electric signal. The generated electric signal is transmitted to a signal processing unit 108 after amplification processing, for example. The imaging unit 20 corresponds to a sensor unit in the invention. The imaging unit 20 includes a cooling device. By cooling the imaging device, a situation where noise components due to a dark current are contained in the captured signal information is prevented. The lens unit 22 is attached to the imaging unit 20.
The lens unit 22 includes a plurality of lenses, for example. In order to focus on the subject S, each lens is provided so as to be movable in a direction of arrow Z. The lens unit 22 also includes optical elements, such as a diaphragm and an excitation light cut filter, and adjusts the amount of detected light or the wavelength of detected light.
The transmission light source unit 26 includes, for example, an excitation light source for fluorescence imaging (ultraviolet light source) and a white light source, and is configured to perform light source switching under the control of the imaging control device 100 when necessary. That is, in the present embodiment, the imaging system 1 has a configuration that can also be applied to fluorescence imaging. For example, when performing imaging for detecting fluorescence from a fluorescently labeled subject, excitation light from the transmission light source unit 26 is emitted to the subject S. Alternatively, when performing imaging for detecting transmissive light that has been transmitted through the subject, white light from the transmission light source unit 26 is emitted to the subject S.
The subject observation monitor 50 displays a state on the stage 16 imaged by a compact camera (not shown) provided in the upper portion of the housing 12. Therefore, it is possible to check the position of the subject S placed on the stage 16 or the height of the stage 16 and to adjust the position of the subject or the height of the stage so that the arrangement of the subject S is suitable for imaging.
The control device body 102 includes the signal processing unit 108, a storage unit 110, and a control unit 112, for example. The signal processing unit 108 generates image data based on the electric signal generated by the imaging unit 20, and performs signal processing (for example, noise removal processing or sharpness processing) required for the image data. The storage unit 110 stores information required for imaging. In particular, in the present embodiment, the storage unit 110 stores correction data that is used for the correction of measurement data. Details of the correction data will be described later. The control unit 112 is, for example, a computer including a CPU, a ROM, and the like. The imaging unit 20, the transmission light source unit 26, the signal processing unit 108, the storage unit 110, the operation unit 104, and the display unit 106 are connected to the control unit 112, and the control unit 112 performs overall control of each unit.
The display unit 106 is a display device, such as a CRT or a liquid crystal display, and displays image data generated by the signal processing unit 108. The display unit 106 also displays a setting screen for performing various kinds of setting for the imaging apparatus 10 or giving an instruction to the imaging apparatus 10.
The operation unit 104 is configured to include a user interface, such as a mouse or a keyboard. The user operates the operation unit 104 to perform various kinds of setting for the imaging apparatus 10 or give an instruction to the imaging apparatus 10. For example, the user sets information regarding imaging, such as the type of a subject and the type of an imaging method, in the imaging system through the operation unit 104. The input information is stored in the storage unit 110, for example.
Correction data stored in the storage unit 110 will be described. There are two types of correction data. One is correction data (first correction data) used for first correction (ambient light removal correction) to eliminate the influence of ambient light from measurement data, and the other one is correction data (second correction data) used for second correction (flat frame correction) to eliminate the influence of light intensity distribution according to the irradiation position of illumination light.
The first correction data is data indicating the amount of a signal originated from ambient light included in a detection signal or data indicating how many of the signals originated from ambient light is included, for example. Such correction data can be obtained as follows, for example. First, as shown in
Therefore, assuming that the signal strength of the first reference data is I1 and the signal strength of the second reference data is I2, it is possible to obtain the amount of a signal originated from ambient light included in measurement data, which is obtained by imaging the subject with the same amount of illumination light, by setting the value of the first correction data to I2−I1. In addition, by setting the value of the first correction data to (I2−I1)/I2, it is possible to obtain the ratio of the amount of a signal originated from ambient light included in measurement data obtained by imaging the subject. For example, when the detection signal value at the time of imaging (main imaging) of the subject is I, if the first correction data Ia is given by Ia=I2−I1, the actual signal value Ir after eliminating the influence of ambient light can be calculated by Ir=I−Ia. If the first correction data Ra is given by Ra=(I2−I1)/I2, the actual signal value Ir after eliminating the influence of ambient light can be calculated by Ir=I(1−Ra). As the reference data or the first correction data, for example, an average value in a pixel group belonging to the opening corresponding region may be adopted, or a mode in such a pixel group may be adopted.
In practice, light (that is, ambient light, such as diffused light or irregularly reflected light) other than the simply transmitted light is detected by the imaging unit 20. Accordingly, since the higher signal value than the original value is estimated, an error occurs. For example,
In the first correction data, a value acquired in a region (or a pixel) where there is an imaging device can also be used in other regions (or other pixels). However, the magnitude of the influence of ambient light has a location dependency on the stage 16. Therefore, it is preferable that the area on the stage 16 is divided into several regions and the storage unit 110 has first correction data for each of the divided regions. For example,
The light shielding plate used when acquiring the first reference data is not particularly limited as long as the light shielding plate is a light shielding member having an opening corresponding to a region for which ambient light removal correction is performed. As the size and shape of the opening, a rectangular shape of tens of mm×tens of mm (length of one side is 10 to 30 mm) or a circular shape with a diameter of tens of mm (for example, 10 to 30 mm) is a measure. However, the size and shape of the opening may be changed from the above range according to the imaging conditions or when necessary.
Second correction data is a flat frame indicating what kind of distribution the light intensity of illumination light has on the stage 16, for example. It is possible to perform flat frame correction by dividing the first and second reference data, or the first correction data, or the measurement data of main imaging using the flat frame. As such a foot frame, it is possible to use image data obtained by imaging in a state where nothing is placed on the stage 16.
Next, the procedure of the imaging method according to the present embodiment will be described. First, the user checks whether or not there is suitable correction data for the imaging conditions, the type of a subject, or the like. When there is suitable correction data, the correction data is used. On the other hand, when there is no correction data, the user starts an operation of creating correction data.
When creating correction data, first, the user turns on the transmission light source unit 26 in a state where nothing is placed on the stage 16, performs imaging by applying illumination light, and acquires the light intensity I0 of the illumination light itself as image data. The image data is used when calculating the optical density later, and can also be used as a flat frame. Then, the user places, for example, the light shielding plate 30 on the stage and applies illumination light in a state where a light shielding film is disposed so as to fit the opening of the light shielding plate 30, thereby acquiring first reference data I1. In this case, flat frame correction is performed for the first reference data. Then, the user removes the light shielding plate 30, and acquires second reference data I2 by applying illumination light in a state where the position of the light shielding film is maintained as it is. Also for the second reference data, flat frame correction is performed in the same manner as described above. Then, Ia=I2−I1 is stored in the storage unit 110 as the first correction data.
Then, the process proceeds to main imaging. The user places a subject on the stage 16, applies illumination light to acquire measurement data I, and performs flat frame correction for the measurement data similarly. Then, measurement data Ir after ambient light removal correction is obtained from I−Ia. In addition, the optical density D is obtained by D=−log(Ir/I0).
As described above, according to the imaging system and the imaging method of the present embodiment, correction for eliminating the influence of ambient light is performed on measurement data based on correction data calculated before the imaging of the subject. Therefore, some pixels of the imaging device do not need to be used as correction pixels. As a result, in the imaging system using the transmission light source, it is possible to suppress the influence of ambient light without reducing the imaging area on the imaging device.
Next, a second embodiment will be described. In the imaging system and the imaging method according to the first embodiment, the opening of the light shielding plate is disposed in a region for which the first correction data is created. On the other hand, the imaging system and the imaging method according to the present embodiment are different from those of the first embodiment mainly in that the light shielding plate is disposed in a region for which the first correction data is created. Accordingly, detailed explanations of the same components as in the first embodiment will be omitted as long as there is no particular need.
As in the first embodiment, the imaging system of the present embodiment is configured to include the imaging apparatus 10 and the imaging control device 100.
As in the first embodiment, the storage unit 110 has first correction data and second correction data. However, the first correction data of the present embodiment is created by the following procedure. As shown in
The procedure after creating the first correction data in the imaging method of the present embodiment is the same as that of the first embodiment.
As described above, according to the imaging system and the imaging method of the present embodiment, correction for eliminating the influence of ambient light is performed on measurement data based on correction data calculated before the imaging of the subject. Therefore, the same effect as in the first embodiment is achieved.
In an imaging system according to another embodiment of the present invention, for example, a transmission light source unit 27 shown in
The ultraviolet light transmission light source 35 is an excitation light source at the time of fluorescence observation, and it is possible to use a commercially available light source without being limited in particular. The reflective diffusion plate 36 is fixed to the upper surface of the ultraviolet light transmission light source 35 by a guide 36a. The reflective diffusion plate 36 transmits ultraviolet light, and reflects white light. A surface of the reflective diffusion plate 36 on the imaging unit side is roughened, so that light from the LED light source unit 40 that propagates almost in parallel to the surface is reflected and diffused.
The LED light source unit 40 is configured to include a light sleeve 41, a white LED 42, a sleeve cover 43, and a light shielding member 44. The LED light source unit 40 is disposed at both ends of the reflective diffusion plate 36 so that the optical axis of the white LED 42 is almost parallel to the surface of the reflective diffusion plate 36. For example, three white LEDs 42 are disposed on each of the left and right sides, and are arranged at equal distances (for example, 110 mm) in a direction perpendicular to the plane of
In order to secure the space through which light L from the LED light source propagates, the white transmissive diffusion plate 37 is provided so as to be separated from the reflective diffusion plate 36. The light L from the LED light source repeats reflection and diffusion while propagating through the gap (for example, 20 mm) between the reflective diffusion plate 36 and the white transmissive diffusion plate 37, and is used as illumination light. In consideration of the ease of cleaning and the chemical resistance, a white vinyl chloride plate is preferably used, and the surface is preferably subjected to matte finish.
By using the transmission light source unit 27 having such a configuration, excitation light for fluorescence observation and white light can be used as illumination light through appropriately switching therebetween.
As a wavelength switchable light source, for example, a light source unit including a conversion plate capable of converting ultraviolet light into visible light can be provided between the ultraviolet light source and the stage 16, in addition to the configuration of the transmission light source unit 26. If the conversion plate is made movable so that the conversion plate is located between the ultraviolet light source and the stage 16 when necessary, switching between ultraviolet light and visible light can be realized.
In the imaging system of the invention, it is preferable that the light source unit emits three or more kinds of light (for example, R, G, and B) having different wavelengths. In this case, it is possible to generate color data or a color image of the subject by combining measurement data obtained using the respective light components. For example, in the transmission light source unit 27 described above, it is preferable to use LEDs of R, G, and B instead of the white LED 42. In this case, it is preferable to display a monochrome image and a color image on the display unit 106 simultaneously or alternately.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2014-050526 | Mar 2014 | JP | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 4656650 | Kikuchi | Apr 1987 | A |
| 4741009 | Yamagata | Apr 1988 | A |
| 20050052651 | Kim | Mar 2005 | A1 |
| 20110249939 | Schmidt | Oct 2011 | A1 |
| Number | Date | Country |
|---|---|---|
| 0 218 923 | Apr 1987 | EP |
| 9-44636 | Feb 1997 | JP |
| 09044636 | Feb 1997 | JP |
| 10-142053 | May 1998 | JP |
| Entry |
|---|
| Extended European Search Report, dated Jul. 27, 2015, for European Application No. 15155343.5. |
| Yaeli, “Stray Light Measurement for Imaging Systems,” Optical Engineering, Jan. 1988, vol. 27, No. 1, pp. 86-87. |
| Number | Date | Country | |
|---|---|---|---|
| 20150264257 A1 | Sep 2015 | US |
