Patent Application
20230168197
The present application is based on Japanese Patent Application No. 2020-046932, filed on Mar. 17, 2020, the entire content of which is incorporated herein by reference.
The present invention relates to a state determination device, a state determination method, and a state determination program.
Conventionally, there are cases where a substance constituting an object to be inspected is determined by using light. For example, there are used absorption spectroscopy, in which an absorption spectrum is measured by irradiating an object to be inspected with light and a substance constituting the object to be inspected is thereby determined, and laser-induced breakdown spectroscopy, in which plasma light is measured by ionizing an object to be inspected with a laser and a substance constituting the object to be inspected is thereby determined. In addition, there are cases where an object to be inspected is irradiated with excitation light for a relatively long time period (several tens of seconds), and a spectrum of generated delayed fluorescence and the physical property value of a fluorescence lifetime or the like are measured.
With regard to the laser-induced breakdown spectroscopy, for example, Patent Document 1 shown below describes a substance determination system in which scattered light is measured by emitting laser fight from a first laser unit, an area in which a substance is present is extracted from a measurement result, and a spectrum of plasma light is measured by emitting laser light from a second laser unit which is different from the first laser unit.
In addition, with regard to the measurement of the fluorescence lifetime, for example, Patent Document 2 shown below describes a fluorescence lifetime measurement device in which a phosphor serving as a measurement target is placed on a stage and is moved at constant speed, the phosphor is irradiated with excitation light, elapsed time and afterglow intensity are detected by using an image in which the afterglow of fluorescence generated by the excitation light is imaged, and the fluorescence lifetime is calculated.
Further, with regard to the use of the delayed fluorescence, for example, Patent Document 3 shown below describes an ornamental plant keeping quality determination device in which an ornamental plant is irradiated with excitation light, chlorophyll fluorescence and delayed fluorescence generated by the irradiation are imaged, and the keeping quality of the ornamental plant is determined based on a correlation between a ratio between the light amount of the delayed fluorescence and the light amount of the chlorophyll fluorescence, and the keeping quality of the ornamental plant.
However, in the conventional art, determination of a state of an object to be inspected by using light is not examined.
To cope with this, the present invention provides a state determination device, a state determination method, and a state determination program capable of determining the state of the object to be inspected by using light.
A state determination device according to an aspect of the present invention includes: an irradiation unit which irradiates an object to be inspected with excitation light under a predetermined irradiation condition; a measurement unit which measures light emission data of light emission from the object to be inspected, which is generated with a delay with respect to the irradiation with the excitation light: and a determination unit which determines a state of the object to be inspected by checking the light emission data against light emission data of light emission from the object to be inspected, which is measured in a case where the excitation light is emitted under an irradiation condition common to the light emission data for each state of a substance constituting the object to be inspected.
According to this aspect, the object to be inspected is irradiated with the excitation light under the predetermined irradiation condition and, based on the light emission data of the light emission from the object to be inspected which is generated with a delay with respect to the irradiation with the excitation light, it is possible to determine the state of the object to be inspected.
In the above aspect, the light emission data of the light emission from the object to be inspected is light emission data of delayed fluorescence and/or phosphorescence from the object to be inspected, which is generated according to the irradiation with the excitation light.
According to this aspect, the object to be inspected is irradiated with the excitation light under the predetermined irradiation condition and, based on the light emission data of the delayed fluorescence and or the phosphorescence from the object to be inspected which is generated according to the irradiation with the excitation light, it is possible to determine the state of the object to be inspected.
In the above aspect, the measurement unit may include a high speed camera which photographs the light emission at a frame rate of not less than 100 fps.
According to this aspect, by applying the high speed camera to an attenuation characteristic in which light emission intensity of light emission immediately after the irradiation with the excitation light is sharply attenuated, for the first time, it is possible to acquire a time-resolved image and time-resolved data (time dependence data) of the light emission intensity at high speed with high accuracy, and it is possible to measure light emission data of light emission unique to the state of the object to be inspected with high accuracy.
In the above aspect, the determination unit may read reference light emission data of the object to be inspected, which is stored in advance in a storage unit, and determine the state of the object to be inspected by using the reference light emission data that has been read and the light emission data measured by the measurement unit.
According to this aspect, the object to be inspected is irradiated with the excitation light, under the predetermined irradiation condition and, by using the light emission data of the light emission from the object to be inspected which is generated according to the irradiation with the excitation light and the reference light emission data of the object to be inspected which is stored in advance in the storage unit, it is possible to determine the state of the object to be inspected.
A state determination device according to an aspect of the present invention includes: an irradiation unit which irradiates an object to be inspected with excitation light under a predetermined irradiation condition; a measurement unit which measures first light emission data as light emission data of light emission from the object to be inspected, which is generated according to the irradiation with the excitation light, and measures second light emission data as light emission data of light emission from the object to be inspected, which is generated according to the irradiation with the excitation light after an external factor of the object to be inspected is changed; and a determination unit which determines a state of the object to be inspected based on the change of the external factor of the object to be inspected on a basis of a change degree of the second light emission data relative to the first light emission data.
According to this aspect, each of the object to be inspected before processing and the object to be inspected after the processing is irradiated with the excitation light under the predetermined irradiation condition and, based on a change amount of light emission data of the object to be inspected after the processing with respect to light emission data of the object to be inspected before the processing, it is possible to determine the state of the object to be inspected.
In the above aspect, the determination unit may determine, as the state of the object to be inspected, a degree of deterioration of the object to be inspected by checking light emission data of each deterioration degree of the object to be inspected, which is stored in advance in a storage unit, against the light emission data measured by the measurement unit.
According to this aspect, the object to be inspected is irradiated with the excitation light under the predetermined irradiation condition and, based on the light emission data of the light emission from the object to be inspected which is generated with a delay with respect to the irradiation with the excitation light, it is possible to determine the degree of the deterioration of the object to be inspected.
In the above aspect, a wavelength of the excitation light may be not less than 10 nm.
According to this aspect, by using the excitation light having a wavelength of not less than 10 nm, as compared with the case where the excitation light having a wavelength of less than 10 nm is used, it is possible to simplify not only management of safety in the case where the object to be inspected is irradiated with the excitation light but also management of power supply control, and it is possible to suppress operation cost of the state determination device to a low level.
In the above aspect, the light emission data may include light emission data of delayed fluorescence and or phosphorescence, which is generated after the irradiation with the excitation light is stopped.
According to this aspect, by measuring the light emission data of the delayed fluorescence and or the phosphorescence unique to the state of the object to be inspected, it is possible to determine the state of the object to be inspected.
A state determination method according to an aspect of the present invention includes: an irradiation step of irradiating an object to be inspected with excitation light under a predetermined irradiation condition; a measurement step of measuring light emission data of light emission from the object to be inspected, which is generated with a delay with respect to the irradiation with the excitation light; and a determination step of determining a state of the object to be inspected by checking the light emission data against light emission data of light emission from the object to be inspected which is measured in a case where the excitation light is emitted under an irradiation condition common to the light emission data for each state of a substance constituting the object to be inspected.
According to this aspect, the object to be inspected is irradiated with the excitation light under the predetermined irradiation condition and, based on the light emission data of the light emission from the object to be inspected which is generated with a delay with respect to the irradiation with the excitation light it is possible to determine the state of the object to be inspected.
In the above aspect, in the determination step, reference light emission data of the object to be inspected, which is stored in advance in a storage unit may be read, and the state of the object to be inspected may be determined by using the reference light emission data that has been read and the light emission data that has been measured.
According to this aspect, the object to be inspected is irradiated with the excitation light under the predetermined irradiation condition and, by using the light emission data of the light emission from the object to be inspected which is generated according to the irradiation with the excitation light and the reference light emission data of the object to be inspected which is stored in advance in the storage unit, it is possible to determine the state of the object to be inspected.
A state determination program according to an aspect of the present invention causes a computer to execute: processing of irradiating an object to be inspected with excitation light under a predetermined irradiation condition; processing of measuring light emission data of light emission from the object to be inspected, which is generated with a delay with respect to the irradiation with the excitation light; and processing of determining a state of the object to be inspected by checking the light emission data against light emission data of light emission from the object to be inspected, which is measured in a case where the excitation light is emitted under an irradiation condition common to the light emission data for each state of a substance constituting the object to be inspected.
According to this aspect, the object to be inspected is irradiated with the excitation light under the predetermined irradiation condition and, based on the light emission data of the light emission from the object to be inspected which is generated with a delay with respect to the irradiation with the excitation light, it is possible to determine the state of the object to be inspected.
A state determination device according to an aspect of the present invention includes: an irradiation unit which irradiates an object to be inspected with excitation light under a predetermined irradiation condition; a measurement unit which measures light emission data related to light emission of the object to be inspected, which is generated with a delay with respect to the irradiation with the excitation light, and a determination unit which determines a state of the object to be inspected based on the light emission data and light emission data related to light emission, which is generated with a delay in a case where the excitation light is emitted under the predetermined irradiation condition for each state of a substance constituting the object to be inspected.
According to this aspect, the object to be inspected is irradiated with the excitation light under the predetermined irradiation condition and, based on the light emission data related to the light emission which is generated with a delay with respect to the irradiation with the excitation light, it is possible to determine the state of the object to be inspected.
According to the present invention, it is possible to determine the state of the object to be inspected by using light.
Hereinbelow, a first embodiment according to an aspect of the present invention will be described based on the drawings. Note that, in the individual drawings, elements designated by the same reference numerals have the same or similar configurations.
The object to be inspected 100 may be an object constituted by any substance. The object to be inspected 100 may be a gas, a liquid or a solid, may be an inorganic or organic substance, and may include, e.g., paper, concrete, powder, resin, or a plant. Examples of the state of the object to be inspected 100 changed by addition of the external factor include a state in which water serving is added to the object to be inspected 100, a state in which a pH (acidity, basicity (alkaline)) is different, a state in which an electromagnetic wave is applied to the object to be inspected 100, a state in which the object to be inspected 100 is heated, a state in which the object to be inspected 100 is exposed to air and various gases, and a state in which mechanical stress is applied to the object to be inspected 100. In addition, combinations of the above external factors are common in a natural environment, and hence these external factors may be combined. The state determination device 10 can determine the state of the object to be inspected 100 in noncontact, nondestructive, and noninvasive manners based on light emission data which is measured in advance for each state of the substance constituting the object to be inspected 100.
The setting unit 11 sets an irradiation condition of excitation light. The irradiation condition of the excitation light includes at least any of the wavelength of the excitation light, the intensity of the excitation light, and irradiation time of the excitation light. For example, the wavelength of the excitation light may be from 200 nm to 400 nm in an ultraviolet range, but may also be not more than 200 nm in a far ultraviolet range and may be not less than 400 nm in a visible light range. In addition, as the wavelength of the excitation light is shorter (i.e., energy intensity is higher), the light emission lifetime of delayed fluorescence and f or phosphorescence tends to be longer, and hence, in the case where the light emission lifetime is used in the determination of the state of the substance, the wavelength of the excitation light may be set to be relatively short. In addition, as the intensity of the excitation light is higher, the light emission lifetime of the delayed fluorescence and/or the phosphorescence tends to be longer, and hence, in the case where the light emission lifetime is used in the determination of the state of the substance, the intensity of the excitation light may be set to be relatively high. Further, as the irradiation time of the excitation light is longer, the light emission lifetime of the delayed fluorescence and/or the phosphorescence tends to be longer, and hence, in the case where the light emission lifetime is used in the determination of the state of the substance, the irradiation time of the excitation light may be set to be relatively long. Note that there are cases where the light emission lifetime of the delayed fluorescence and/or the phosphorescence does not change even when the irradiation time of the excitation light is set to be equal to or longer than a predetermined time period, and hence the irradiation time of the excitation light may be set to, among time periods with which the light emission lifetime of the delayed fluorescence and/or the phosphorescence has a value close to the maximum value, the shortest time period. By setting the irradiation condition including at least any of the wavelength of the excitation light, the intensity of the excitation light, and the irradiation time of the excitation light, it is possible to measure the light emission data of the delayed fluorescence and/or the phosphorescence by emitting the excitation light under various conditions, and it is possible to measure the light emission data unique to the state of the substance and determine the state of the substance with high accuracy.
The irradiation unit 12 irradiates the object to be inspected 100 with the excitation light under the irradiation condition set by the setting unit 11. The irradiation unit 12 may be constituted by, e.g., an ultraviolet laser or an ultraviolet LED (Light Emitting Diode). In addition, the wavelength of the excitation light emitted by the irradiation unit 12 may be not less than 10 nm. By using the excitation light having a wavelength of not less than 10 nm, as compared with the case where the excitation light having a wavelength of less than 10 nm is used, it is possible to simplify not only management of safety in the case where the object to be inspected 100 is irradiated with the excitation light but also management of power supply control, and it is possible to suppress operation cost of the state determination device 10 to a low level.
The measurement unit 13 measures light emission data related to light emission of the object to be inspected 100 which is generated with a delay with respect to the irradiation with the excitation light. More specifically, the measurement unit 13 measures the light emission data of the delayed fluorescence and or the phosphorescence from the object to be inspected 100 which is generated according to the irradiation with the excitation light. Note that the light emission of the object to be inspected 100 which is generated with a delay with respect to the irradiation with the excitation light is not limited to the delayed fluorescence and/or the phosphorescence, and may include another delayed light emission, afterglow, or luminescence. Note that, in the present description, the delayed fluorescence includes a short phenomenon in which the lifetime of light emission having started immediately after stopping of the irradiation with the excitation light is about several nanoseconds, as well as a phenomenon in which the light emission having started immediately after stopping of the irradiation with the excitation light continues for a long time period. In addition, the phosphorescence is a phenomenon in which light emission having started immediately after stopping of the irradiation with the excitation light continues for a predetermined time period, and includes light emission having the lifetime of the light emission of about 10−3 to 10 seconds. The measurement unit 13 includes a camera 13a and an analysis unit 13b. The camera 13a photographs the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 which is generated according to the irradiation with the excitation light. The camera 13a may be a high speed camera which photographs the delayed fluorescence and/or the phosphorescence at a frame rate of not less than 100 fps. The frame rate of the high speed camera may also be 1000 fps or not less than 10000 fps. With the use of the high speed camera, by applying the high speed camera to a phenomenon in which the light emission intensity of the delayed fluorescence and/or the phosphorescence immediately after the irradiation with the excitation light is sharply attenuated, for the first time, it is possible to acquire a time-resolved image and time dependence data of the light emission intensity at high speed with high accuracy, and it is possible to measure the light emission data of the delayed fluorescence and/or the phosphorescence unique to the substance with high accuracy. In the case where the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 is photographed with the high speed camera, an image in which light is multiplied by an image intensifier may be photographed. In addition, adjacent pixels may be treated as one pixel by a binning function, and an image of the delayed fluorescence and/or the phosphorescence may be photographed with improved sensitivity. Further, exposure time may be changed dynamically according to the light intensity of the object to be inspected 100. In this case, by setting the exposure time of the camera 13a to a long time period, it is possible to detect the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 having lower light emission intensity. Note that, in order to secure the function of high-speed imaging of the camera 13a, the upper limit (e.g., 10 ms) may be set for the exposure time of the camera 13a. In addition, an image having an improved S/N ratio ay be generated by performing contraction processing or expansion processing on a photographed image. Note that, in the case where the delayed fluorescence and or the phosphorescence from the object to be inspected 100 is photographed with the high speed camera, the intensity of the excitation light may be increased according to the frame rate. Further, by using the camera 13a, it becomes possible to measure the delayed fluorescence and or the phosphorescence from the object to be inspected 100 on two-dimensional or three-dimensional coordinates, With this, it is possible to determine a coordinate position with high resolution based on a pixel array, and determine the state of the substance constituting the object to be inspected 100 according to each coordinate position. Accordingly, as compared with conventional fluorescence lifetime measurement, high-speed measurement is made possible. Thus, the device of the present invention has an advantage that it is possible to measure time dependence data of the delayed fluorescence or phosphorescence intensity with high time resolution (e.g., every 0.01 milliseconds to 10 milliseconds) by the irradiation with the excitation light to the object to be inspected 100 for a short time period (e.g., 0.01 milliseconds to 500 milliseconds). In addition, in the device of the present invention, the delayed fluorescence and/or the phosphorescence is photographed with exposure for a short time period, and hence the device of the present invention has a feature in which the device of the present invention can be used in a situation in which the object to be inspected 100 moves between imaging frames or a situation in which a motion blur occurs with the exposure for a long time period.
Note that, in the case where aging deterioration of a sensor of the camera 13a or the substance serving as a measurement target has occurred, it is considered that it becomes difficult to determine the state of the substance at the time of the aging deterioration unless a factor for the aging deterioration is eliminated. To cope with this, it is preferable to perform, in advance, calibration which allows conversion between the luminance value of the camera 13a and a physical quantity (e.g., illumination or the like) in order to handle the luminance value of an image obtained by the camera 13a as an absolute value (physical quantity). For example, the calibration may be performed after a correction parameter in which an influence of the aging deterioration is considered is set by combining, e.g., a calibrated illuminometer or luminance meter and a calibration board of paper which is not subjected to the aging deterioration, and the luminance value of the camera 13a is corrected by using the set correction parameter.
The analysis unit 13b analyzes the light emission data of the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 based on the image photographed by the camera 13a. Herein, the light emission data may include light emission data of the delayed fluorescence and or the phosphorescence which is generated after the irradiation with the excitation light is stopped. Note that the light emission data may also include light emission data of the delayed fluorescence and/or the phosphorescence which is generated during the irradiation with the excitation light. It is possible to determine the state of the substance by using only the light emission data of the delayed fluorescence and or the phosphorescence which is generated after the irradiation with the excitation light is stopped without using the light emission data of the delayed fluorescence and or the phosphorescence which is generated during the irradiation with the excitation light.
In addition, the light emission data may include at least any of time dependence data of the light emission intensity and a time-attenuation curve of the light emission intensity which are determined from the luminance distribution of the image photographed by the camera 13a. Examples of the time dependence data of the light emission intensity and the time-attenuation curve of the light emission intensity will be described in detail by using
In addition, the measurement unit 13 may measure light emission data including data related to the fluorescence of the object to be inspected 100 which is generated during the irradiation with the excitation light. That is, the measurement unit 13 may measure not only the light emission data of the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 but also data related to usual fluorescence. In this case, the light emission data includes data related to the fluorescence and data related to the delayed fluorescence and or the phosphorescence. Thus, by measuring the light emission data including the data related to not only the delayed fluorescence and or the phosphorescence but also the fluorescence, it is possible to determine the state of the substance.
The storage unit 14 stores light emission data 14a of the delayed fluorescence and or the phosphorescence which is measured in the case where the object to be inspected 100 is irradiated with the excitation light under a given irradiation condition, and light emission data 14b of the delayed fluorescence and/or the phosphorescence which is measured for each of various states of various substances in the case where known substances are irradiated with the excitation light under one or a plurality of irradiation conditions. The light emission data 14a and the light emission data 14b may be acquired from a new or unprocessed object to be inspected 100, or may also be acquired from the object to be inspected 100 to which an external factor is applied. For example, in the case where the light emission data 14a is data acquired from the new or unprocessed object to be inspected 100, data acquired from the object to be inspected 100 to which the external factor is applied is used as the light emission data 14b, In this case, examples of the case include a food manufacturing process and a component manufacturing process. In addition, in the case where the light emission data 14a is data acquired from the object to be inspected 100 to which the external factor is applied, data acquired from the new or unprocessed object to be inspected 100 is used as the light emission data 14b. In this case, an example of the case includes inspection of a tunnel or a bridge. Further, in the case where the state of the object to be inspected 100 to which the external factor is being applied is determined in real time, data acquired from the object to be inspected 100 to which the external factor is being applied is used as the light emission data 14a, and data acquired from the new or unprocessed object to be inspected 100, or data which is acquired previously from the object to be inspected 100 to which the external factor is applied is used as the light emission data 14b. In this case, examples of the case include the food manufacturing process, the component manufacturing process, and a mixing process of liquid or power.
The determination unit 15 determines the state of the substance constituting the object to be inspected 100 based on the light emission data 14a which is measured in the case where the object to be inspected 100 is irradiated with the excitation light under a given irradiation condition, and the light emission data 14b of the delayed fluorescence and/or the phosphorescence which is measured in the case where the known substance is irradiated with the excitation light under the same irradiation condition. More specifically, after the type of the object to be inspected 100 is specified first, the light emission data 14a which is measured in the case where the object to be inspected 100 is irradiated with the excitation light under a given irradiation condition is checked against the light emission data 14b of the delayed fluorescence and or the phosphorescence which is measured in the case where the substance of the specified type is irradiated with the excitation light for each state of the substance under the same irradiation condition, and the state of the substance constituting the object to be inspected 100 is determined. Note that the type denotes labels with which substances constituting the object to be inspected 100 are roughly classified such as, e.g., papers (Type 1), resin (Type 2), and concrete (Type 3). The determination unit 15 determines the irradiation condition set by the setting unit 11, and determines the light emission data 14b of the known substance which is measured under an irradiation condition identical or closest to the determined irradiation condition. Subsequently, the determination unit 15 checks the light emission data 14a of the object to be inspected 100 against the light emission data 14b of the determined known substance, and determines the state of the substance constituting the object to be inspected 100 based on similarity of the light emission data.
For example, in the case where the substance is determined by using a light emission spectrum of the delayed fluorescence and/or the phosphorescence, by calculating a ratio between a width (which is, e.g., a half width) of a peak and a width (which is a width outside, e.g., the half width of the peak and is a width when 0.1% of peak intensity is reached) of a tail of a spectrum measured for the object to be inspected 100, and comparing the ratio therebetween with a ratio between the width of a peak and the width of a tail of a spectrum of the known substance, it is possible to perform checking having high robustness by using normalized light emission data.
The determination unit 15 may calculate an attenuation curve which approximates the time-attenuation curve of the light emission intensity based on the time-attenuation curve of the light emission intensity of the delayed fluorescence or the phosphorescence which is obtained by irradiating the object to be inspected 100 with the excitation light having a predetermined wavelength. For example, the determination unit 15 may approximate the time-attenuation curve of the light emission intensity as a function represented by I(t)=I0 exp (−t/τ), and determine I0 and τ which are coefficients of the function by, e.g., the least squares method. Note that I0 is a coefficient representing the light emission intensity when excitation is stopped, and τ is a coefficient representing the light emission lifetime of the delayed fluorescence or the phosphorescence. The determination unit 15 may determine the state of the substance constituting the object to be inspected 100 by using, e.g., the light emission lifetime calculated from the time-attenuation curve of the light emission intensity. In addition, the determination unit 15 may determine the state of the substance constituting the object to be inspected 100 by, e.g., comparing a half decay period τ/2 of the light emission related to the object to be inspected 100 with the half decay period of the light emission related to the known substance. Note that, in general, the determination unit 15 may approximate the time-attenuation curve of the light emission intensity as a function represented by [(t)=Σj u 1N]exp (−t/τj) and determine Ij and τj which are coefficients of the function by, e.g., the least squares method. Herein, N is an integer of not less than 1. Thus, by approximating the time-attenuation curve of the light emission intensity by using a plurality of exponential functions, it is possible to approximate the time-attenuation curve with high accuracy.
The determination unit 15 may determine the state of the substance constituting the object to be inspected 100 by calculating, for the light emission spectrum of the delayed fluorescence or the phosphorescence obtained by irradiating the object to be inspected 100 with the excitation light having a single wavelength, a ratio between the light emission intensities of the delayed fluorescence or the phosphorescence at different wavelengths. That is, the determination unit 15 may determine the state of the substance constituting the object to be inspected 100 by utilizing relative values of the light emission intensity of the delayed fluorescence or the phosphorescence at different wavelengths. For example, the determination unit 15 may determine the state of the substance constituting the object to be inspected 100 by comparing a ratio I (λ1)/I (λ2) between a light emission intensity I (λ1) at a first wavelength λ1 and a light emission intensity I (λ2) at a second wavelength λ2 which are measured for the object to be inspected 100 with a ratio I (λ1)/I(λ2) between light emission intensities measured for the known substance. Examples of a method for acquiring the ratio between the light emission intensities of the delayed fluorescence or the phosphorescence at different wavelengths include a method in which RGB pixel values acquired by a color camera are used as parameters obtained through color filters, a method in which a pixel value obtained by attaching a bandpass filter to a monochrome camera is used, and a method in which a hyperspectral camera is used. In addition, the determination unit 15 may determine the state of the substance constituting the object to be inspected 100 by calculating a difference in the peak wavelength and a peak intensity ratio of the light emission spectrums obtained by emitting the excitation lights having different wavelengths, and comparing the difference in the peak wavelength and the peak intensity ratio with the difference in the peak wavelength and the peak intensity ratio of the light emission spectrums of the known substance. Further, in the case where the determination unit 15 determines the state of the substance by using the light emission lifetime of the delayed fluorescence and/or the phosphorescence, it is possible to perform checking having high robustness by determining the intensity of the excitation light at which the light emission lifetime is saturated for the object to be inspected 100, and comparing the intensity of the excitation light with the intensity of the excitation light at which the light emission lifetime is saturated for the known substance.
The determination unit 15 may input the light emission data 14a which is measured in the case where the object to be inspected 100 is irradiated with the excitation light under a given condition into a learning model such as a neural network, and may determine which one of pieces of the light emission data 14b in different states in the known substance the light emission data 14a is similar to with the learning model. In this case, the learning model may be generated by supervised learning which uses various pieces of light emission data as learning data, or may also be generated by unsupervised learning such as clustering. Herein, the learning model, the learning data, the light emission data 14a, and the light emission data 14b of the known substance only need to be accessible via a communication network, and do not necessarily need to be stored in the storage unit of the state determination device 10.
Thus, according to the state determination device 10 according to the first embodiment, it is possible to determine the state of the substance based on the light emission data of the delayed fluorescence and or the phosphorescence which is generated according to the irradiation of the object to be inspected 100 with the excitation Tight under any irradiation condition which is performed after the type of the object to be inspected 100 is specified in advance, and the light emission data of the delayed fluorescence and/or the phosphorescence which is measured under the same irradiation condition for the substance of the type specified in advance.
For example, it is assumed that the object to be inspected 100 has a uniform appearance with visible light. Under such a condition, when the determination of the state of the substance constituting the object to be inspected 100 is performed with fluorescence, visible light, and infrared light, there are cases where it is not possible to determine the state of the substance. On the other hand, when it is assumed that the object to be inspected 100 has a characteristic which differs from one state to another, and has the light emission spectrum or the light emission lifetime of the delayed fluorescence and/or the phosphorescence which differs from one state to another in the light emission phenomenon of the delayed fluorescence and/or the phosphorescence, it becomes possible to determine the state of the substance by using the information. For example, in the case where water is added to the substance, there are cases where the light emission spectrum and the light emission lifetime of the delayed fluorescence and/or the phosphorescence become different from those before water is added to the substance. In addition, in the case where the substance is heated, there are cases where the light emission spectrum and the light emission lifetime of the delayed fluorescence and/or the phosphorescence become different from those before the substance is heated. In addition, in the case where properties of the substance deteriorate, there are cases where the light emission spectrum and the light emission lifetime of the delayed fluorescence and/or the phosphorescence become different from those before the properties of the substance deteriorate. Incidentally, when heated papers are analyzed with FT-IR, an absorption peak is seen in the vicinity of 1730 cm−1 derived from CO═O bond (C═O stretching), and hence it is suggested that cellulose skeletons of papers are oxidized and are caused to deteriorate. In addition, depending on the substance constituting the object to be inspected 100, it is known that, in deterioration by hydrolysis, absorption derived from a specific functional group such as, e.g., —OH bond is observed, and it is known that, particularly in resins, absorption derived from —NH2 bond or —COOH bond is observed. Accordingly, the deterioration of the substance may be examined by focusing attention on these bond formations and a phenomenon in which the bond formation is increased. Note that the deterioration of the substance denotes that properties of the substance change non-continuously with continuation of addition of an external factor to the substance. In general, the deterioration of the substance denotes that properties of the substance change irreversibly, but may include reversible change of properties of the substance.
In addition, according to the state determination device 10 according to the first embodiment, by irradiating the object to be inspected 100 with the excitation light, it is possible to determine the state of the object to be inspected 100 in noncontact, nondestructive, and noninvasive manners. Accordingly, for example, the state determination device 10 can detect a product which has contained water by mistake when products having the same characteristics are conveyed by a belt conveyer as a product having an abnormality. In addition, for example, when products having the same characteristics are heated in an oven, in the case where variations have occurred in the transmission of heat inside the oven, the state determination device 10 can detect a product affected by variations in heating as a product having an abnormality.
Further, according to the state determination device 10 according to the first embodiment, even in a situation in which the object to be inspected 100 is moving, it is possible to detect the state of the object to be inspected 100. Accordingly, for example, during running of a vehicle on which the state determination device 10 is mounted, the state determination device 10 can detect an abnormality of a tunnel or a bridge and perform inspection. Further, the state determination device 10 has high-speed image processing capability and robustness. Accordingly, the state determination device 10 can also estimate the number of years of durability (life) of a structure by attaching a telephoto lens or a wide-angle lens to the camera 13a and performing fixed point observation or moving observation of a light emission image of a structure with a distant dam, bridge, breakwater or high building serving as a target.
The CPU 10a is a control unit which performs control related to execution of a program stored in the RAM 10b or the ROM 10c, and arithmetic calculation and processing of data. The CPU 10a is an arithmetic calculation unit which executes a program (state determination program) which determines the substance based on the light emission data. The CPU 10a receives various pieces of data from the input unit 10e and the communication unit 10d, and displays the arithmetic calculation result of the data in the display unit 10f or stores the arithmetic calculation result of the data in the RAM 10b or the ROM 10c.
The RAM 10b is one of the storage units which is capable of rewriting of data, and may be constituted by, e.g., a semiconductor storage element. The RAM 10b may store the state determination program executed by the CPU 10a, and the light emission data of the delayed fluorescence and/or the phosphorescence related to a plurality of substances. Note that these are only examples, and data other than the above data may be stored in the RAM 10b and part of the above data does not need to be stored in the RAM 10b.
The ROM 10c is one of the storage units which is capable of reading of data, and may be constituted by, e.g., a semiconductor storage element. The ROM 10c may store, e.g., the state determination program, and data which is not rewritten.
The communication unit 10d is an interface which connects the state determination device 10 to other equipment. The communication unit 10d may be connected to a communication network such as the Internet.
The input unit 10e receives input of data from, and may include, e.g., a keyboard and a touch panel.
The display unit 10f displays the arithmetic calculation result by the CPU 10a visually, and may be constituted by, e.g., an LCD (Liquid Crystal Display). The display unit 10f nay display a result of determination of the substance, and measured light emission data.
The state determination program may be provided after being stored in a computer-readable storage medium such as the RAM 10b or the ROM 10c, or may also be provided via a communication network connected by the communication unit 10d, in the state determination device 10, the CPU 10a executes the state determination program, and various operations described by using
According to the light emission data. L, it can be seen that, immediately after the start of the irradiation with the excitation light, the pixel value reaches the maximum value (255), the pixel value is kept at the maximum value during the irradiation, the delayed fluorescence and/or the phosphorescence is emitted after the irradiation with the excitation light is ended, and the pixel value is gradually attenuated from the maximum value to the minimum value. In the following description, each of a first section A which represents the change of the pixel value before and after the start of the irradiation with the excitation light and a second section 6 which represents the change of the pixel value before and after the end of the irradiation with the excitation light will be described in detail.
According to the first section A of the light emission data L, the pixel value reaches the maximum value in about 1 frame (4 ms) from the start of the irradiation with the excitation light, and the pixel value becomes constant thereafter.
The second section B of the light emission data L includes an exponential attenuation section B1 and a moderate attenuation section B2. When the irradiation with the excitation light is ended, the exponential attenuation section B1 starts immediately, and the pixel value is attenuated exponentially. In the case of the present example, the exponential attenuation section B1 continues for about 5 frames (20 ms) after the end of the irradiation with the excitation light and, during that time period, the pixel value is attenuated by about 70% from the maximum value.
Subsequently to the exponential attenuation section B1, the moderate attenuation section B2 continues for about 24 frames (96 ms) and, during that time period, the pixel value is attenuated to the minimum value.
In the present example, an image after the excitation light is emitted is photographed at 250 fps by one camera 13a, but the measurement unit 13 may include a camera which photographs the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 at a frame rate of less than 100 fps, and a high speed camera, and the measurement unit 13 may photograph the delayed fluorescence and/or the phosphorescence during a time period in which temporal change is relatively fast with the high speed camera, and photograph the delayed fluorescence and/or the phosphorescence during a time period in which the temporal change is relatively slow with the camera. Herein, the time period in which the temporal change is relatively fast is, e.g., the exponential attenuation section B1, and the time period in which the temporal change is relatively slow is, e.g., the attenuation section B2. In this case, the high speed camera may be a camera which can image change of brightness of the order of 10 nsec, i.e., photograph an image at about 108 fps. Thus, by using two cameras including the high speed camera and the relatively low speed camera, it is possible to photograph consecutive images with adequate time resolution in each of the time period in which the temporal change of the delayed fluorescence and/or the phosphorescence is relatively fast and the time period in which the temporal change thereof is relatively slow.
Note that, in the present example, the irradiation time of the excitation light is 500 ms, but this value can be set to any value. In the case where the object to be inspected 100 is plain paper, when the irradiation time of the excitation light is set to about 200 ms or longer, the lifetime of the delayed fluorescence and/or the phosphorescence tends to be saturated. Thus, the irradiation time of the excitation light applied to the object to be inspected 100 may be appropriately set so as to be not less than the irradiation time with which the lifetime of the delayed fluorescence and/or the phosphorescence is saturated.
The determination unit 15 determines the state of the substance constituting the object to be inspected 100 by using, e.g., the shape of the time dependence data of the light emission intensity. In the case of the present example, in the case where water is added to the papers, the light emission intensity is lowered as compared with the light emission intensity before water is added to the papers. In addition, in the case of the present example, even when the papers are air-dried after water is added to the papers, the light emission intensity of the delayed fluorescence and/or the phosphorescence does not return to a level before water is added to the papers. The determination unit 15 determines whether or not water is added to the substance constituting the object to be inspected 100 by extracting characteristics of the shape of the time dependence data of the light emission intensity and comparing the extracted characteristics with characteristics of the shape of the time dependence data of the light emission intensity of the known substance.
The determination unit 15 determines the state of the substance constituting the object to be inspected 100 by using, e.g., the shape of the time dependence data of the light emission intensity. In the case of the present example, in the case where each of the two types of papers is heated, the light emission intensity is increased as compared with the light emission intensity before each of the two types of papers is heated. In addition, in the case of the present example, as the heating time period for each of the two types of papers becomes longer, the light emission intensity becomes higher. The determination unit 15 determines whether or not the substance constituting the object to be inspected 100 is heated by extracting characteristics of the shape of the time dependence data of the light emission intensity and comparing the extracted characteristics with characteristics of the shape of the time dependence data of the light emission intensity of the known substance.
The determination unit 15 determines the state of the substance constituting the object to be inspected 100 by using, e.g., the shape of the time dependence data of the light emission intensity. In the case of the present example, in the case where the papers are heated, the light emission intensity is increased as compared with the light emission intensity before the papers are heated. In addition, in the case of the present example, when the papers are air-dried for the predetermined time period after being heated, the light emission intensity is lowered to a level before the papers are heated. The determination unit 15 determines whether or not the substance constituting the object to be inspected 100 is heated and is in a state immediately after the substance is heated by extracting characteristics of the shape of the time dependence data of the light emission intensity and comparing the extracted characteristics with characteristics of the shape of the time dependence data of the light emission intensity of the known substance.
The state determination device 10 photographs the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 which is generated according to the irradiation with the excitation light with the camera 13a (S13). Subsequently, the state determination device 10 analyzes the light emission data of the delayed fluorescence and/or the phosphorescence based on the photographed image (S14). Herein, the light emission data may include the time dependence data of the light emission intensity and the time-attenuation curve of the light emission intensity.
The state determination device 10 checks the obtained light emission data against the light emission data of the delayed fluorescence and/or the phosphorescence which is measured in the case where the substance of the type specified in advance is irradiated with the excitation light under the same condition (S15), Subsequently, the state determination device 10 determines the state of the substance constituting the object to be inspected 100 based on the similarity of the light emission data (S16). With the foregoing arrangement, the state determination processing is ended.
Hereinbelow, a second embodiment according to an aspect of the present invention will be described based on the drawings. The second embodiment is different from the first embodiment in the method for determining the state of the object to be inspected. Accordingly, in the following description, a configuration different from that in the first embodiment will be mainly described, and the duplicate description of a configuration identical or equivalent to that in the first embodiment will be omitted.
The determination unit 15 according to the second embodiment determines the state of the object to be inspected 100 by irradiating the object to be inspected 100 before an external factor is changed and the object to be inspected 100 after the external factor is changed with the excitation light under a predetermined irradiation condition, and comparing the light emission data of the object to be inspected 100 which is generated according to the irradiation with the excitation light before processing with the light emission data thereof after the processing. The external factor includes, e.g., predetermined processing performed on the object to be inspected 100. The predetermined processing includes, e.g., addition of water to and heating of the object to be inspected 100. The determination unit 15 determines the state of the object to be inspected 100 based on a change amount of the light emission data of the object to be inspected 100 after the processing with respect to the object to be inspected 100 before the processing. The object to be inspected 100 before the processing may be the unprocessed object to be inspected 100 and may also be the object to be inspected 100 on which the predetermined processing has been performed previously. For example, the determination unit 15 determines the state of the object to be inspected 100 based on the change amount of the light emission data of the object to be inspected 100 before and after the processing on the assumption that the type of the object to be inspected 100, and the tendency of the change of the light emission data of the object to be inspected 100 before and after the processing are acquired in advance. For example, in the case where the light emission data tends to be increased by heating of the object to be inspected 100, the determination unit 15 determines the state of the object to be inspected 100 based on an increase amount of the light emission data of the object to be inspected 100 before and after the processing. For example, in the case where the increase amount of the light emission data of the object to be inspected 100 before and after the processing is not less than a predetermined threshold value, the determination unit 15 determines that the object to be inspected 100 is caused to deteriorate by heating. The determination unit 15 may evaluate the degree of the deterioration of the object to be inspected 100 by heating quantitatively based on, e.g., the increase amount of the light emission data of the object to be inspected 100 before and after the processing.
The determination unit 15 determines the state of the object to be inspected 100 based on the change amount of the light emission continuation time of the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 before and after heating. For example, the determination unit 15 specifies the type of the object to be inspected 100 from “Substance 1” to “Substance 7” In addition, for the object to be inspected 100 of the specified type, the determination unit 15 determines the state of the object to be inspected 100 based on the change amount of the light emission continuation time of the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 before and after heating. For example, the determination unit 15 determines the state of the object to be inspected 100 by comparing the change amount of the light emission continuation time of the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 in the case where the object to be inspected 100 is heated under a predetermined heating condition with the change amount of the light emission continuation time of the delayed fluorescence and/or the phosphorescence in the case where the substance of the specified type is heated under the same heating condition. For example, the determination unit 15 compares the change amount of the light emission continuation time of the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 in the case where the object to be inspected 100 is heated under a predetermined heating condition with a threshold value corresponding to the specified type and, in the case where the change amount of the light emission continuation time of the delayed fluorescence and/or the phosphorescence is not less than the threshold value, the determination unit 15 determines that the object to be inspected 100 is caused to deteriorate by heating.
Hereinbelow, a third embodiment according to an aspect of the present Invention will be described based on the drawings. The third embodiment is different from the first embodiment in the method for determining the state of the object to be inspected. Accordingly, in the following description, a configuration different from that in the first embodiment will be mainly described, and the duplicate description of a configuration identical or equivalent to that in the first embodiment will be omitted.
In
The first storage unit 14A stores light emission data 14Aa of the delayed fluorescence and/the phosphorescence which is measured in the case where the object to be inspected 100 is irradiated with the excitation light under a given irradiation condition, and light emission data 14Ab of the delayed fluorescence and/or the phosphorescence which is measured for each of various states of various substances in the case where the known substance is irradiated with the excitation light under one or a plurality of irradiation conditions.
The second storage unit 146 stores absorption spectrum data 14Ba which is measured in the case where the known substance is irradiated with the excitation light under one or a plurality of irradiation conditions, and deterioration degree data 146b indicative of a degree of deterioration of the known substance which is measured in the case where the known substance is irradiated with the excitation light under one or a plurality of irradiation conditions. The absorption spectrum data 14Ba and the deterioration degree data 148b are associated with each combination of the type of the known substance and the irradiation condition of the excitation light as a known database. Note that examples of the absorption spectrum include an infrared absorption spectrum and a Raman spectrum.
The determination unit 15 checks the absorption spectrum data 14Ba of each degree of deterioration of the substance of the type specified in advance against the absorption spectrum data of the object to be inspected 100 measured by the measurement unit 13, and determines the degree of the deterioration of the object to be inspected 100. For example, the determination unit 15 calculates the absorption spectrum data of the object to be inspected 100 based on the light emission data 14Aa measured by the measurement unit 13, and checks the calculated absorption spectrum data against the absorption spectrum data 14Ba of each type of the known substance which is stored in advance in the second storage unit 14B. Subsequently, the determination unit 15 determines the degree of the deterioration of the object to be inspected 100 based on the deterioration degree data 14Bb associated with the checked absorption spectrum data 14Ba.
Next, a description will be given of processing of determining the degree of the deterioration of the object to be inspected 100.
The state determination device 10 photographs the delayed fluorescence and/or the phosphorescence from the object to be inspected 100 which is generated according to the irradiation with the excitation light with the camera 13a (S33). Subsequently, the state determination device 10 analyzes the light emission data of the delayed fluorescence and/or the phosphorescence based on the photographed image (S34). Herein, the light emission data may include the time dependence data of the light emission intensity and the time-attenuation curve of the light emission intensity.
The state determination device 10 checks the obtained light emission data against the light emission data of the delayed fluorescence and/or the phosphorescence which is measured in the case where the substance of the type specified in advance is irradiated with the excitation light under the same irradiation condition (S35).
The state determination device 10 checks the presence or absence of formation of a specific binding molecule and the magnitude thereof based on measurement data of the absorption spectrum of the substance of the type specified in advance or data of the absorption spectrum read from a known database (S36). The specific binding molecule includes a specific functional group generated by the deterioration of the object to be inspected 100 such as, e.g., C═O bond, —OH bond, —NH2 bond, and —COOH bond.
Subsequently, the state determination device 10 determines the degree of the deterioration (deterioration degree) of the substance constituting the object to be inspected 100 based on the presence or absence of the formation of the specific binding molecule and the magnitude thereof checked in Step S36 mentioned above (S37). With the foregoing arrangement, the state determination processing is ended.
The embodiments described thus far are simply for facilitating the understanding of the present invention and are not in any way to be construed as limiting the present invention. Individual elements of the embodiments and the arrangement thereof, materials, conditions, shapes, and sizes are not intended to be limited to those shown as examples, and can be appropriately changed. In addition, the configurations described in different embodiments can be partially replaced or combined.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2020-046932 | Mar 2020 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2021/010886 | 3/17/2021 | WO |
