Patent Grant
11460617
The present invention relates to an imaging apparatus that acquires an image at a specific wavelength and an image processing apparatus that measures a subject on the basis of the acquired image.
In the field of imaging apparatuses, a technique of acquiring an image at a specific wavelength is known. In such an imaging apparatus, an optical filter that transmits a specific wavelength is used to acquire a desired image. However, in a case where such an optical filter is used, the incident angle of the ray greatly differs in accordance with the region of the optical filter (for example, the center and the periphery of the angle of view). As a result, the transmission wavelength may be shifted. For this reason, a technique of suppressing a shift in transmission wavelength due to a difference in incident angle is known. For example, JP2006-254135A is to suppress a change in transmission characteristics in accordance with a region by using an optical filter that is curved such that an incident angle of light is smaller than that in a case of a flat surface.
However, in JP2006-254135A described above, since the optical filter is curved, the processing therefor is troublesome. In particular, this problem becomes remarkable in a case of acquiring images at a plurality of wavelengths. Specifically, in the technique of JP2006-254135A, it is necessary to provide a plurality of optical filters having different degrees of curvature corresponding to the respective wavelengths, which gives trouble in the processing and complicates the configuration of the optical system.
As described above, in the related art, it is difficult to acquire an image at a plurality of wavelengths (particularly, a plurality of narrow-band wavelengths) and to measure a subject on the basis of the acquired image.
The present invention has been made in view of such circumstances, and its object is to provide an imaging apparatus capable of acquiring an image having a small transmission wavelength shift at a plurality of wavelengths and an image processing apparatus capable of accurately measuring a subject on the basis of an image which has a small transmission wavelength shift and which is acquired at a plurality of wavelengths.
In order to achieve the above-mentioned object, an imaging apparatus according to a first aspect of the present invention comprises: an imaging optical system in which a first optical system, an optical filter composed of a first optical filter and a second optical filter where the first optical filter transmits light in a first wavelength band and the second optical filter transmits light in a second wavelength band different from the first wavelength band, and a second optical system are arranged in order from the subject side; a directional sensor that has a plurality of pixels composed of two-dimensionally arranged photoelectric conversion elements, where the directional sensor pupil-divides each of rays incident through the optical filter and receives the rays selectively; and an image acquisition unit that acquires, from the directional sensor, each of a first image received through the first optical filter and a second image received through the second optical filter. The first optical filter and the second optical filter are arranged in different regions in a plane perpendicular to an optical axis of the imaging optical system at a position of an entrance pupil of the imaging optical system, respectively. The first optical system causes high image height rays imaged at a position at which an image height is high on an imaging surface of the directional sensor to be incident into the first optical filter and the second optical filter in a state where an upper ray and a lower ray of the high image height rays are parallel.
The high image height rays imaged at a position of which the image height is high is incident at a large angle with respect to the optical axis. Therefore, the transmission wavelength shift increases. However, in the imaging apparatus according to the first aspect, the first optical system causes the high image height ray to be incident into the first optical filter and the second optical filter in a state where the upper ray and the lower ray are parallel. Therefore, in the first and second optical filters, the transmission wavelength shift due to the difference in incident angle of the high image height ray is suppressed. Thus, an image with a small transmission wavelength shift can be acquired at a plurality of wavelengths. Further, in the first aspect, the transmitted light of the optical filters having different transmission wavelength bands is pupil-divided and received by the directional sensor. Therefore, a plurality of images having different wavelengths can be acquired at the same time.
In the first embodiment, the upper ray and the lower ray are parallel. The term “parallel” does not necessarily mean completely parallel, and there may be a difference in angle within a range where the effect of the shift of the transmission wavelength is allowable. The term “position of which the image height is high” may be, for example, a position where the image height is 70%, but may be defined by another image height (80%, 100%, or the like).
In the imaging apparatus according to a second aspect, in the first aspect, the first optical filter is disposed in a first region centered on the optical axis, the second optical filter is disposed in a second region outside the first region, and the first optical system causes the high image height rays to be incident into the second optical filter in a state where the upper ray and the lower ray of the high image height rays are parallel. In a case where the first optical filter is disposed in a region centered on the optical axis and the second optical filter is disposed in a region outside the first optical filter, an effect (the amount and difference of the transmission wavelength shift) due to the difference in incident angle between the upper ray and the lower ray of the high image height rays incident into the second optical filter increases. Therefore, as in the second aspect, the first optical system causes the high image height rays to be incident into the second optical filter in a state where the upper ray and the lower ray of the high image height rays are parallel. This configuration is effective for suppressing the wavelength shift.
In the imaging apparatus according to a third aspect, in the second aspect, the first optical system causes the high image height rays and central rays imaged at a center of the imaging surface to be incident into the second optical filter in a state where an angle formed between the upper ray of the high image height rays and the upper ray of the central rays is equal to or less than a first threshold value and an angle formed between the lower ray of the high image height rays and a lower ray of the central rays is equal to or less than a second threshold value. As described above with respect to the second aspect, the effect (the amount and difference of the transmission wavelength shift) due to the difference in incident angle between the upper ray and the lower ray of the high image height rays incident into the second optical filter increases. For this reason, in the third aspect, the effect of the difference in incident angle is suppressed by defining the angle formed between the rays incident into the second optical filter. It should be noted that the first and second threshold values can be set in accordance with the allowable transmission wavelength shift.
In the imaging apparatus according to a fourth aspect, in the second or third aspect, the first optical system causes the high image height rays and central rays imaged at a center of the imaging surface to be incident into the first optical filter in a state where an angle formed between the upper ray of the high image height rays and an upper ray of the central rays is equal to or less than a third threshold value and an angle formed between the lower ray of the high image height rays and a lower ray of the central rays is equal to or less than a fourth threshold value. According to the fourth aspect, by defining the angle formed between the rays incident into the first optical filter, it is possible to suppress the effect of the difference in incident angle. It should be noted that the third and fourth threshold values can be set in accordance with the allowable transmission wavelength shift.
In the imaging apparatus according to a fifth aspect, in any one of the first to fourth aspects, the first optical system constitutes an afocal optical system. The afocal optical system is a non-focal optical system in which parallel rays are incident into a lens and the parallel rays are emitted in a similar manner. In the fifth aspect, the first optical system disposed to be closer to the subject side than the optical filter is an afocal optical system. Therefore, parallel rays are emitted from the first optical system, and the upper ray, and the lower ray of the high image height rays are incident into the optical filter in parallel. Thus, the difference in transmission wavelength shift is reduced. In the fifth aspect, the configuration of the first optical system may be different from that of the afocal optical system within the range in which the effect of the transmission angle and the transmission wavelength shift caused by the transmission angle is allowable.
In the imaging apparatus according to a sixth aspect, in the fifth aspect, an afocal magnification of the afocal optical system is less than 1. The afocal magnification is a numerical value that is represented by a ratio of pupil diameters of parallel rays incident into the afocal optical system and parallel rays emitted therefrom. In the sixth aspect, since the afocal magnification is less than 1, the diameter of the emitted rays is greater than the diameter of the incident rays.
In the imaging apparatus according to the seventh aspect, in any one of the first to sixth aspects, the directional sensor has a light blocking mask or a micro lens array that functions as a pupil division unit. The seventh aspect shows one aspect of a specific configuration for selective light reception.
In the imaging apparatus according to an eighth aspect, in any one of the first to seventh aspects, the first optical filter and the second optical filter transmit light having wavelength bands, which do not overlap each other in a wavelength band of 650 nm or more and 740 nm or less, as light having the first wavelength band and light having the second wavelength band, respectively. According to the eighth aspect, an image can be acquired at two wavelengths in the visible red wavelength band.
In order to achieve the above object, an image processing apparatus according to a ninth aspect of the present invention comprises: the imaging apparatus according to any one of the first to eighth aspects; and a measurement unit that measures a subject from the first image and. the second image. According to the ninth aspect, the first and second images acquired by the imaging apparatus according to any one of the first to ninth aspects are used. Therefore, on the basis of an image which has a small transmission wavelength shift and which is acquired at a plurality of wavelengths, measurement of the subject can be accurately performed.
As described above, according to the imaging apparatus of the present invention, an image having a small transmission wavelength shift can be acquired at a plurality of wavelengths. According to the image processing apparatus of the present invention, on the basis of an image which is acquired at a plurality of wavelengths and has a small transmission wavelength shift, measurement of the subject can be accurately performed.
Hereinafter, embodiments of an imaging apparatus and an image processing apparatus according to the present invention will be described in detail with reference to the accompanying drawings.
<Overall Configuration of Image Processing Apparatus>
<Configuration of Imaging Apparatus>
The imaging apparatus 20 comprises an imaging optical system 50 (imaging optical system), a light receiving unit 22. (directional sensor), an image acquisition unit 24 (image acquisition unit), and an image recording unit 26, and has a function of receiving light having different wavelengths and capturing a plurality of images. In
<Configuration of Imaging Optical System>
In the imaging optical system 50, a first optical system 51, an optical filter 53, and a second optical system 52 are arranged around a common optical axis AX1 as a center in order from the subject side. Thus, the optical filter 53 (optical filter) provides a different transmission wavelength characteristic for each light transmitting region.
<Configuration of First Optical System>
In the imaging apparatus 20 according to the first embodiment, the optical filter 53 is disposed at the position of the entrance pupil of the imaging optical system 50, and light transmitted through the first optical system 51 is incident into the optical filter 53. In order to suppress the transmission wavelength shift in the optical filter 53, in a case of considering the infinity magnification of the image capturing, it is desirable that, first, on-axis rays in the stop space, that is, at the position of the entrance pupil where the optical filter 53 is disposed, are as parallel to the optical axis as possible. Therefore, it is desirable that the first optical system 51 forms an afocal optical system (the fidelity with respect to the afocal optical system may be considered in the allowable range of the angle between the optical axis and the ray). Further, it is desirable that the off-axis rays are as parallel to the optical axis as possible.
That is, it is desirable that the off-axis rays have an angle that is considerably smaller than the incident angle in the stop space (at the position of the entrance pupil) of the imaging optical system 50. Therefore, under the premise that the afocal optical system is established, it is necessary that the afocal magnification Y<1. Y is a value obtained by dividing the thickness of the incident rays in the afocal optical system by the thickness of the emitted rays, and is also an angular magnification and a difference between the angles at the time of incidence and the time of emission of afocal off-axis light. As shown in
Therefore, in a case where an optical filter is disposed in the stop space (at the position of the entrance pupil) of the imaging optical system 50, in order to widen the imaging angle of view, it is necessary that an afocal system (or an optical system functioning as an afocal system within a range where the transmission angle and/or the transmission wavelength shift is allowable) of which an afocal magnification (angular magnification) is less than 1 is configured as an optical system ahead of the stop (entrance pupil).
<Configuration of Optical Filter>
The optical filter 53 is composed of a first optical filter 53A (first optical filter) and a second optical filter 53B (second optical filter). The optical filters are respectively disposed in different regions in the plane (the front surface of the flat plate 54) which is perpendicular to the optical axis AX1 at the pupil position of the imaging optical system 50 (refer to
Through such an optical filter 53, in the subject light passing through the imaging optical system 50, light passing through the first optical filter 53A (first pupil region) becomes light having a first wavelength band, and light passing through the second optical filter 53B (second pupil region) becomes light having a second wavelength band. Specific values of the transmission wavelengths of the first optical filter 53A and the second optical filter 53B will be described with reference to examples described later.
<Configuration of Light Receiving Unit>
The subject light passing through the imaging optical system 50 is incident into the light receiving unit 22. The light receiving unit 22 has a plurality of pixels composed of photoelectric conversion elements two-dimensionally arranged, and selectively receives light by respectively pupil-dividing rays incident through the first optical filter 53A and the second optical filter 53B. Further, one micro lens 152 is provided for one light-receiving element. The micro lenses 152 are regularly arranged in a plane perpendicular to the optical axis AX1, and a light-receiving element 162 is disposed on each micro lens 152. As the light-receiving element 162, a metal oxide semiconductor (MOS) or a complementary metal oxide semiconductor (CMOS) imaging element is used. As the light-receiving element 162, in addition, a solid-state imaging element such as a charge coupled device (CCD) type imaging element may be used.
<Configuration of Image Acquisition Unit and Image Recording Unit>
The image acquisition unit 24 acquires an image i1 (first image) received through the first optical filter 53A and an image i2 (second image) received through the second optical filter 53B. That is, the image acquisition unit 24 acquires two images having different wavelengths from the image signal. The image recording unit 26 records the images i1 and i2 acquired by the image acquisition unit 24. The image recording unit 26 may record an image in a nonvolatile memory. The image recording unit 26 may have a nonvolatile memory. Further, the nonvolatile memory may be an external memory detachably provided in the imaging apparatus 20. The image recording unit 26 is able to output an image to the outside of the imaging apparatus 20 (for example, the analysis device 30).
<Configuration of Analysis Device>
The analysis device 30 comprises a processing unit 100 (measurement unit), a storage unit 200, a display unit 300, and an operation unit 400, and the units are connected to each other so as to transmit and receive necessary information. These components can be arranged in various forms. Each component may be disposed at one place (in one housing, in one room, or the like), or may be disposed at a separated place and may be connected through a network.
<Configuration of Processing Unit>
The processing unit 100 comprises an image input unit 110 and a measurement unit 120 (measurement unit). The image input unit 110 is composed of a recording medium interface which is not shown, a control circuit thereof, a communication control unit that controls communication (wireless or wired) with the imaging apparatus 20, and the like, and inputs an image, which is acquired by the imaging apparatus 20, thereto. The measurement unit 120 measures the subject on the basis of the image which is input by the image input unit 110 (described later).
The functions of the control circuit, the communication control unit, and the measurement unit 120 described above can be implemented using various processors. The various processors include, for example, a central processing unit (CPU) which is a general-purpose processor that executes software (program) to implement various functions. Further, the above-mentioned various processors also include a programmable logic device (PLD) which is a processor, such as a field programmable gate array (FPGA), whose circuit configuration can be changed after manufacturing. Furthermore, the above-mentioned various processors also include a dedicated electric circuit which is a processor, such as an application specific integrated circuit (ASIC), having a circuit configuration designed specifically for executing specific processing.
The function of each unit may be implemented by one processor, or may be implemented by combining a plurality of processors. Further, a plurality of functions may be implemented by one processor. In an example in which a plurality of functions are configured by one processor, first, as represented by a computer such as a client or a server, one processor is configured by a combination of one or more CPUs and software, and this processor is implemented as a plurality of functions. Second, as represented by a system-on-chip (SoC), there is a form in which a processor that implements the functions of the whole system by one integrated circuit (IC) chip is used. As described above, various functions are configured using one or more of the above-mentioned various processors as a hardware structure. Further, the hardware structure of these various processors is more specifically an electric circuit (circuitry) in which circuit elements such as semiconductor elements are combined.
In a case where the processor or the electric circuit executes the software (program), the processor (computer) readable code of the software to be executed is stored in a non-transitory recording medium such as a read only memory (ROM), and the processor refers to the software. The software stored in the non-transitory recording medium includes a program for executing image input and subject measurement. The code may be recorded on a non-temporary recording medium such as a magneto-optical recording device or a semiconductor memory instead of the ROM. In a case of processing using software, for example, a random access memory (RAM) is used as a temporary storage region. For example, it may be possible to refer to data stored in an electronically erasable and programmable read only memory (EEPROM) which is not shown.
<Configuration of Storage Unit>
The storage unit 200 is composed of a non-temporary recording medium such as a magneto-optical disk and a semiconductor memory and a control unit thereof, and stores an input image, a measurement result, and the like in an associated manner.
<Configuration of Display Unit and Operation Unit>
The display' unit 300 comprises a monitor 310 (display device), and is able to display input images, images and information stored in the storage unit 200, results of processing performed by the processing unit 100, and the like. The operation unit 400 includes a keyboard 410 and a mouse 420 as an input device and/or a pointing device, and a user is able to perform an operation necessary for measurement of a subject through these devices and a screen of the monitor 310.
<Example of Transmission Wavelength Shift (Case 1)>
An example of the transmission wavelength shift in the imaging apparatus 20 having the above-mentioned configuration will be described with reference to a comparative example.
<Configuration of Example>
In this example, the first optical filter 53A and the second optical filter 53B respectively transmit light of two wavelengths that does not overlap in the visible red wavelength band. Specifically, wavelength bands that do not overlap each other in the wavelength band of 650 nm to 740 nm are defined as a first wavelength band (transmission wavelength of the first optical filter 53A at the time of vertical incidence: 670 nm) and a second wavelength band (the transmission wavelength of the second optical filter 53A at the time of vertical incidence: 710 nm).
The refractive index of the flat plate 54 (substrate) in the example is 1.5, and the effective refractive indices of the first optical filter 53A and the second optical filter 53B are 1.83 and 2.04, respectively.
<Configuration of Comparative Example>
In the comparative example, the imaging optical system 60 is a double Gaussian optical system, and is composed of a first optical system 61 and a second optical system 62 as shown in
Also in the comparative example, in a similar manner to the example, the first optical filter 63A transmits light having a wavelength of 670 nm, and the second optical filter 63B transmits light having a wavelength of 710 nm.
Also in the comparative example, the refractive index of the substrate on which the optical filter 63 is disposed is 1.5, and the effective refractive indices of the first optical filter 63A and the second optical filter 63B are 1.83 and 2.04, respectively.
<Transmission Angle and Transmission Wavelength of Ray in Examples and Comparative Examples>
In the examples and comparative examples of the above-mentioned configuration,
Assuming that the transmission center wavelength at vertical incidence is λ0, the refractive index of the substrate is Ne, and the effective refractive index of the optical filter is N*, the transmission wavelength λθ of the optical filter (the transmission center wavelength at the incident angle θ) is represented by Expression (1).
λ0=λ0×[1−(Ne/N*)2× sin2θ]1/2 (1)
<Evaluation of Comparative Example>
As can be seen from
<Evaluation of Example>
In contrast to the comparative example described above, in the example, the difference in transmission angle between the upper ray and the lower ray of the high image height rays passing through the second optical filter 53B is 1.58 deg (the rays are substantially parallel). Thereby, the difference in transmission wavelength is as small as 2.1 nm. Therefore, this example is suitable for measurement using a narrow band wavelength. The reason why the difference in transmission wavelength is small is that the first optical system 51, which is an afocal optical system, causes the high image height rays and the central rays to be incident into the second optical filter 53B in a substantially parallel state.
In this example, the difference in transmission angle between the high image height rays and the central rays passing through the first optical filter 53A is 11.04 deg, which is smaller than that in the comparative example, and the obtained image has a small difference in transmission wavelength (8.2 nm) between the periphery and the center. Therefore, this example is suitable for measurement using a wavelength in a narrow band (for example, 10 nm or less). The reason why the difference in transmission wavelength is small is that the first optical system 51, which is an afocal optical system, causes the high image height rays and the central rays to be incident into not only the second optical filter 53B but also the first optical filter 53A in a substantially parallel state.
<Threshold Value for Incident Angle>
According to the results of the example, in order to suppress the shift of the transmission wavelength and acquire an image suitable for the narrow band wavelength, the difference in angle formed between the upper ray of the high image height rays and the lower ray of the high image height rays incident into the second optical filter 53B is preferably equal to or less than 5 deg (equal to or less than a first threshold value), and more preferably equal to or less than 2 deg. Further, the difference in angle formed between the lower ray of the high image height rays incident into the second optical filter 53B and the lower ray of the central rays is preferably equal to or less than 15 deg (equal to or less than a second threshold value), and is more preferably equal to or less than 10 deg.
Further, the difference in angle formed between the upper ray of the high image height rays incident into the first optical filter 53A and the upper ray of the central rays is preferably equal to or less than 15 deg (equal to or less than a third threshold value). In a similar manner, the difference in angle formed between the lower ray of the high image height rays incident into the first optical filter 53A and the lower ray of the central rays is preferably equal to or less than 15 deg (equal to or less than a fourth threshold value).
The above-mentioned first to fourth threshold values can be set such that the difference in transmission wavelength between the rays is equal to or less than a threshold value (for example, 10 nm, 5 nm, or the like).
<Example of Transmission Wavelength Shift (Case 2)>
The above-mentioned example has described the case where the first optical filter 53A and the second optical filter 53B respectively transmit light having wavelengths of 610 nm and 710 nm (red in the visible region). However, optical filters, which transmit light having wavelengths different therefrom, may be used. For example, a first optical filter disposed in a circular region centered on the optical axis may transmit light of 1696 nm, and a second optical filter disposed in an annular region around the first optical filter may transmit light of 1426 nm.
As can be seen from
The incident angle to the optical filter in Case 2 is the same as that in Case 1. However, since the transmission wavelength of the optical filter is different from that in Case 1, the amount of wavelength shift is different even in a case where the difference in incident angle is the same. Therefore, in Case 2, the threshold value of the incident angle may be changed from that in Case 1, or a threshold value for the wavelength shift may be set. For example, the threshold value of the difference in transmission wavelength between the upper ray and the lower ray of the high image height rays for the second optical filter is set to 10 nm (preferably 5 nm). The threshold value of the difference in transmission wavelength between the lower ray of the high image height rays and the lower ray of the central rays for the second optical filter can be set to 20 nm.
<Effects of First Embodiment>
As described above, in the imaging apparatus 20 according to the first embodiment, the first optical system 51, which is an afocal optical system, causes the high image height rays and the central rays to be incident into the second optical filter 53B in a substantially parallel state, and causes the high image height rays and the central rays to be incident into the first optical filter 53A in a substantially parallel state. Thereby, it is possible to suppress the difference in transmission angle and the wavelength shift, and it is possible to obtain an image suitable for measurement using a narrow band wavelength or measurement using a specific wavelength at a plurality of wavelengths.
<Other Examples of Arrangement of Optical Filter>
In the imaging apparatus according to the present invention, as shown in
Further, in the imaging apparatus according to the present invention, as shown in
It should be noted that the optical filters 56 and 57 described above are also arranged at the position of the entrance pupil of the imaging optical system 50, in a similar manner to the optical filter 53 in the first embodiment. Further, in a case where the optical filters 56 and 57 are used, a light blocking mask having arrangement corresponding to the arrangement of the optical filters is provided on the light receiving surface of the light-receiving element 162 so as to separate respective rays transmitted through the first and second optical filters and receive the rays.
The above-mentioned example has described the case where a single optical filter (optical filter 53, 56, or 57) is used. However, a plurality of optical filters having different transmission wavelength characteristics may be switched and used. For example, a plurality of optical filters may be provided on a rotating member such as a turret, and a desired filter may be inserted into the optical path (at the position of the entrance pupil) of the imaging optical system. Alternatively, a plurality of optical filters may be provided on the plate member, and the desired optical filter may be inserted into the optical path (position of the entrance pupil) of the imaging optical system by translating the plate member.
<Pupil Division by Micro Lens>
In the image processing apparatus 10 according to the first embodiment, the light blocking masks 162A and 162B functioning as pupil division units are provided on the light-receiving element 162. However, a micro lens array may be used as the pupil division unit. Specifically, one micro lens is provided for a plurality of (for example, two) light-receiving elements separated from each other, and each light-receiving element may receive light passing through a different pupil region (an optical filter having a different transmission wavelength).
<Measurement by Image Processing Apparatus>
In the image processing apparatus 10 according to the first embodiment, an image acquired by the imaging apparatus 20 can be input to the analysis device 30 (image input unit 110), and the measurement unit 120 is able to measure a subject. An example of such measurement will be described.
<Application to Water Quality Inspection>
In general, inspection of the water quality of oceans and lakes using remote sensing is performed by estimating the concentration of chlorophyll-a (Chl.a), dissolved organic matter (DOM), or suspended solids (SS) in water. As the dissolved organic matter, for example, a colored dissolved organic matter (CDOM) is used. The estimation of the concentration of these substances in water is performed by measuring the spectral reflectance on the surface of the water to be inspected. Depending on the substance whose concentration is to be estimated, the concentration of the estimated substance, and the place (open sea, coast, lake, or estuary) to be subjected to the water quality inspection, a wavelength band for measuring the optimal spectral reflectance changes. Hereinafter, a typical substance detected in a case of performing the water quality inspection and the wavelength band used for the detection will be described.
[Chlorophyll-a]
Chlorophyll-a is one of the representative substances whose concentration in water is estimated in the water quality inspection.
The characteristic of the spectral reflectance of typical eutrophic water has a maximum value at a wavelength around 570 nm. Further, the minimum at a wavelength of about 670 nm is caused by light absorption by chlorophyll-a. Particularly, in water quality inspection of eutrophic water in lake and coast, it is known that the ratio or difference between the minimum value and the maximum value of the reflectance at wavelengths from 650 nm to 720 nm has a high correlation with the concentration of chlorophyll-a in water. Therefore, the concentration of chlorophyll-a is estimated using the minimum value and the maximum value of the reflectance in this wavelength band. It is known that the maximum value shifts to the higher wavelength side as the concentration of chlorophyll-a increases. However, by changing the wavelength band in which the first optical filter and the second optical filter in the imaging apparatus 20 transmits light, it is possible to cope with this shift to the higher wavelength side.
Assuming that “Chia” is the concentration of chlorophyll-a and R(λ) is the reflectance at wavelength λ, as a basic model for estimating chlorophyll-a, a model using a band ratio of two wavelengths represented by Expression (2) is known.
Chl.a∝R(λi)/R(λj) (2)
It is known that the two wavelengths used in the above estimation model differ depending on the water region. Therefore, in the case of performing a water quality inspection on the basis of the concentration of chlorophyll-a by using the image processing apparatus 10, for example, an optical filter is used. In the optical filter, the first optical filter and the second optical filter described above respectively transmit light in the first wavelength band and light in the second wavelength band that do not overlap each other in a wavelength band of 650 nm or more and 740 nm or less. For example, as in the example of Case 1, an optical filter, which transmits light of 670 nm (first wavelength band), is used as the first optical filter, and an optical filter, which transmits light of 710 nm (second wavelength band) is used as the second optical filter. Thus, an image having a small wavelength shift can be acquired by the imaging apparatus 20 according to the first embodiment, and the concentration of chlorophyll-a can be accurately measured by the analysis device 30 (the measurement unit 120).
<Application to Soil Inspection>
In the measurement using two wavelengths, it is known to use a normalization index for extracting various properties of a target object. The normalization index is defined by [R(λ1)−R(λ2 )]/[R(λ1)+R(λ2)], where the reflectances at two wavelengths λ1 and λ2 is set as R(λ1) and R(λ2). For example, this expression can be applied to estimation of a soil moisture ratio (moisture weight included in a unit weight of dryness). A desirable approximation of a normalization index NDSMI (Normalized Difference Soil Moisture Index) defined by [R(1696 nm)−R(1426 nm)]/[R(1696 nm)+R(1426 nm)] can be obtained in a case where the soil moisture ratio is in the range of 0% to 60%. That is, λ1=1696 nm and λ2=1426 nm. As described above for Case 2, an image with a small wavelength shift is acquired by the imaging apparatus 20 according to the first embodiment, and the analysis device 30 (the measurement unit 120) is able to accurately measure the soil moisture ratio.
<Other Measurement Examples>
In the image processing apparatus 10 (measurement unit 120) according to the present invention, an index other than the above-mentioned index can be calculated by using optical filters having different transmission wavelengths. For example, it is possible to detect human skin with λ1=1070 nm and λ2=1550 nm, and to detect oak withering with λ1=1460 am and λ2=1280 nm. Further, the measurement is not limited to the above-mentioned index, and another measurement can be performed,
Although the embodiments of the present invention have been described above, the present invention is not limited to the above-mentioned aspects, and various modifications can be made without departing from the spirit of the present invention.
10: image processing apparatus
20: imaging apparatus
22: light receiving unit
22A: imaging surface
24: image acquisition unit
26: image recording unit
30: analysis device
50: imaging optical system
51: first optical system
52: second optical system
53: optical filter
53A: first optical filter
53B: second optical filter
54: flat plate
56: optical filter
56A: first optical filter
56B: second optical filter
57: optical filter
57A: first optical filter
57B: second optical filter
60: imaging optical system
61: first optical System
62: second optical system
63: optical filter
63A: first optical filter
63B: second optical filter
100: processing unit
110: image input unit
120: measurement unit
122A: ray
122B: ray
152: micro lens
162: light-receiving element
162A: light blocking mask
162B: light blocking mask
200: storage unit
300: display unit
310: monitor
400: operation unit
410: keyboard
420: mouse
AX1: optical axis
AX2: optical axis
L1: lens
L2: lens
L3: lens
L4: lens
L5: lens
L6: lens
L7: lens
L8: lens
i1: image
i2: image
| Number | Date | Country | Kind |
|---|---|---|---|
| JP2017-197860 | Oct 2017 | JP | national |
The present application is a Continuation of PCT International Application No. PCT/JP2018/037052 filed on Oct. 3, 2018 claiming priority under 35 U.S.C § 119(a) to Japanese Patent Application No. 2017-197860 filed on Oct. 11 2017. Each of the above applications is hereby expressly incorporated by reference, in its entirety, into the present application.
| Number | Name | Date | Kind |
|---|---|---|---|
| 7030991 | Kampe | Apr 2006 | B1 |
| 8823858 | Ono | Sep 2014 | B2 |
| 20090080090 | Maruyama | Mar 2009 | A1 |
| 20140168498 | Ono | Jun 2014 | A1 |
| 20150219494 | Hruska et al. | Aug 2015 | A1 |
| 20150281535 | Korenaga | Oct 2015 | A1 |
| 20160094822 | Imade | Mar 2016 | A1 |
| 20160255294 | Hiasa | Sep 2016 | A1 |
| 20210019899 | Ono | Jan 2021 | A1 |
| 20220078319 | Okada | Mar 2022 | A1 |
| Number | Date | Country |
|---|---|---|
| 103782586 | May 2014 | CN |
| 2750374 | Jul 2014 | EP |
| H07191310 | Jul 1995 | JP |
| 2004163573 | Jun 2004 | JP |
| 2006254135 | Sep 2006 | JP |
| 2014206494 | Oct 2014 | JP |
| 2015200640 | Nov 2015 | JP |
| Entry |
|---|
| “Search Report of Europe Counterpart Application”, dated Aug. 3, 2020, p. 1-p. 7, (Search report for EP 18865407.3). |
| “International Search Report (Form PCT/ISA/210)” of PCT/JP2018/037052, dated Dec. 18, 2018, with English translation thereof, pp. 1-3. |
| “Written Opinion of the International Searching Authority (Form PCT/ISA/237)” of PCT/JP2018/037052, dated Dec. 18, 2018, with English translation thereof, pp. 1-7. |
| “Office Action of China Counterpart Application”, dated Jan. 15, 2021, with English translation thereof, p. 1-p. 11, (Office action for Chinese Application No. 201880062838.X). |
| Number | Date | Country | |
|---|---|---|---|
| 20200233127 A1 | Jul 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2018/037052 | Oct 2018 | US |
| Child | 16840444 | US |
