This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2023-127744, filed on Aug. 4, 2023, the entire contents of which are incorporated herein by reference.
The present disclosure relates to an observation apparatus and an observation method.
One of techniques used for observing an observation object is phase contrast imaging. In the phase contrast imaging, a phase contrast image can be acquired by irradiating the observation object with light output from a light source, and receiving the light which is passed through the observation object by an imaging unit. Further, a thickness distribution image (phase image) of the observation object can be generated based on the above phase contrast image.
The light source used in the above configuration is a point light source (or a light source which can be considered substantially the point light source). Further, the observation object is made of a material capable of transmitting at least a part of the light output from the light source. In general, the observation object is made of a known single material. The phase contrast image which is acquired by the imaging unit is an image representing spatial change of a transmitted light intensity of the observation object, and further, is a two-dimensional image (edge enhanced image) having a high intensity at a boundary (edge) on which a thickness of the observation object is changed.
As a method for generating the thickness distribution image from the phase contrast image, a method described in Non Patent Document 1 is known. In the above method, the case in which the light output from the light source is light having a single wavelength with a narrow wavelength band (the case of monochromatic light) is assumed. In the following description, the method described above is referred to as a “monochromatic Paganin method”.
The phase contrast imaging can be applied not only to the case in which the light output from the light source is the light having the single wavelength with the narrow wavelength band (the case of the monochromatic light), but also to the case in which the light output from the light source is light having a certain band (wavelength band) (the case of polychromatic light), and for example, can be applied to the case in which an X-ray tube is used as the light source.
Further, even in the case in which the phase contrast imaging is performed by using a light source which outputs not only X-rays but also light having a certain wavelength band (polychromatic light), the phase contrast image can be acquired, and further, the thickness distribution image can be generated based on the phase contrast image.
In the above case, as a method for generating the thickness distribution image from the phase contrast image, a method described in Non Patent Document 2 is known. The method described in Non Patent Document 2 is a method obtained by extending the monochromatic Paganin method described in Non Patent Document 1 to the case of the polychromatic light. In the following description, the above method extended to the case of the polychromatic light is referred to as a “polychromatic Paganin method”. Further, in addition to the method described in Non Patent Document 2, several methods have been proposed as the polychromatic Paganin method.
The phase contrast imaging is considered to be more sensitive and resistant to noise than absorption imaging. However, in the case in which the phase contrast imaging is performed by using the light source which outputs the light having the wavelength band (the polychromatic light), the thickness distribution image generated based on the phase contrast image has low quantitativeness.
An object of the present invention is to provide an observation apparatus and an observation method capable of generating a thickness distribution image with excellent quantitativeness when phase contrast imaging is performed using a light source which outputs light having a wavelength band.
An embodiment of the present invention is an observation apparatus. The observation apparatus includes (1) a light source for outputting light having a wavelength band, and irradiating an observation object with the light; (2) an imaging unit for receiving light output from the light source and passed through the observation object, and acquiring a phase contrast image of the observation object; (3) a thickness distribution image generation unit for generating a thickness distribution image of the observation object based on the phase contrast image; and (4) a thickness distribution image correction unit for correcting the thickness distribution image based on a spectrum of the light output from the light source, and (5) the thickness distribution image correction unit sets the thickness distribution image generated by the thickness distribution image generation unit as an initial image, and repeatedly performs calculation of an intensity distribution of the light after being passed through the observation object based on the spectrum and the thickness distribution image, calculation of an update amount based on the calculated intensity distribution and the phase contrast image, and update of the thickness distribution image based on the calculated update amount.
An embodiment of the present invention is an observation method. The observation method includes (1) an imaging step of irradiating an observation object with light having a wavelength band output from a light source, receiving light passed through the observation object by an imaging unit, and acquiring a phase contrast image of the observation object; (2) a thickness distribution image generation step of generating a thickness distribution image of the observation object based on the phase contrast image; and (3) a thickness distribution image correction step of correcting the thickness distribution image based on a spectrum of the light output from the light source, and (4) in the thickness distribution image correction step, the thickness distribution image generated in the thickness distribution image generation step is set as an initial image, and calculation of an intensity distribution of the light after being passed through the observation object based on the spectrum and the thickness distribution image, calculation of an update amount based on the calculated intensity distribution and the phase contrast image, and update of the thickness distribution image based on the calculated update amount are repeatedly performed.
According to the embodiments of the present invention, it is possible to generate a thickness distribution image with excellent quantitativeness in the case in which phase contrast imaging is performed using a light source which outputs light having a wavelength band.
The present invention will be more fully understood from the detailed description given hereinbelow and the accompanying drawings, which are given by way of illustration only and are not to be considered as limiting the present invention.
Further scope of applicability of the present invention will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will be apparent to those skilled in the art from this detailed description.
Hereinafter, embodiments of an observation apparatus and an observation method will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same elements will be denoted by the same reference signs, and redundant description will be omitted. The present invention is not limited to these examples.
The observation apparatus 1 and the observation method described above can acquire a phase contrast image of an observation object 20 which is disposed between the light source 10 and the imaging unit 12, and further, can generate a thickness distribution image (phase image) of the observation object 20 based on the above phase contrast image. The observation object 20 is, for example, an object made of a known single material capable of transmitting at least a part of the light output from the light source 10.
The light source 10 is a point light source (or a light source which can be considered substantially the point light source). The light source 10 may be a microfocus X-ray source. In the following description, the configuration in the case in which the light source 10 is set to the microfocus X-ray source is described. In this case, the light output from the light source 10 and with which the observation object 20 is irradiated is X-rays. In the case in which the phase contrast imaging is performed, the light source 10 outputs the X-rays as diverging light, and the observation object 20 is irradiated with the X-rays. Further, in the case in which the spectrum measurement is performed, the light source 10 causes the X-rays to be incident on the spectrum measurement unit 11 without passing through the observation object 20.
The spectrum measurement unit 11 measures an energy spectrum (wavelength spectrum) of the X-rays output from the light source 10 (the spectrum measurement step S1). The X-ray spectrum measured by the spectrum measurement unit 11 is used at the time of the correction of the thickness distribution image performed by the thickness distribution image correction unit 14. Further, the X-ray spectrum may be used at the time of the generation of the thickness distribution image performed by the thickness distribution image generation unit 13.
In addition, the spectrum measurement step S1 does not need to be performed as a first step, and may be performed before the processing in which information of the X-ray spectrum is required. Further, in the case in which the spectrum of the X-rays output from the light source 10 is known by the previous measurement, or in the case in which the X-ray spectrum corresponding to a tube voltage and a tube current set in the light source 10 is known, the spectrum measurement unit 11 may not be provided, and further, the spectrum measurement step S1 may not be performed every time the imaging unit 12 performs the acquisition of the phase contrast image.
The imaging unit 12 receives the X-rays, which are output from the light source 10 and passed through the observation object 20, on an imaging plane, and acquires the phase contrast image I of the observation object 20 (the imaging step S2). Further, the imaging unit 12 receives the X-rays output from the light source 10 on the imaging plane in the state in which the observation object 20 is not disposed, and acquires a background image lin.
In addition, the phase contrast imaging by using the X-rays in the configuration as illustrated in
As the spectrum measurement unit 11, for example, a semiconductor detector such as Si, CdTe, and the like, a photon counting X-ray imaging sensor, and the like can be used. In addition, the photon counting X-ray imaging sensor can also be used as the imaging unit 12, and further, the spectrum can be measured by performing the photon counting with the light reduced at the time of the spectrum measurement by using the imaging unit 12.
In the above cases, the spectrum measurement unit 11 and the imaging unit 12 may be configured in common, and further, spectrum correction is not required, and therefore it is preferable. In the case in which the spectrum measurement unit 11 and the imaging unit 12 use devices made of the same element, sensitivity correction is not required, and therefore it is preferable.
The thickness distribution image generation unit 13 generates the thickness distribution image of the observation object 20 based on the phase contrast image acquired by the imaging unit 12 (the thickness distribution image generation step S3). The thickness distribution image correction unit 14 corrects the thickness distribution image generated by the thickness distribution image generation unit 13 (the thickness distribution image correction step S4). The details of the above processes will be described later.
The thickness distribution image generation unit 13 and the thickness distribution image correction unit 14 may be configured by a computer including a processing unit (for example, a CPU, or the like) for performing operation processing, a storage unit (for example, a hard disk drive, a ROM, a RAM, or the like) for storing programs and various data necessary for performing the operation processing, a display unit (for example, a liquid crystal display, or the like) for displaying operation conditions and operation results, and an input unit (for example, a keyboard, a mouse, or the like) for receiving various inputs.
The monochromatic Paganin method (the following Formula (1)) described in Non Patent Document 1 is used when the thickness distribution image (
The respective parameters included in the above Formula (1) are as follows. An xyz orthogonal coordinate system is set as illustrated in
r is a variable representing a two-dimensional position on the xy plane at the z direction position on which the observation object is disposed. M is a magnification at the time of the acquisition of the phase contrast image. In the case in which a distance between the light source 10 and the observation object 20 is set to z1 and a distance between the observation object 20 and the imaging plane of the imaging unit 12 is set to z2, the magnification M is represented by the following Formula (2).
I(Mr) is the phase contrast image which is acquired by the imaging unit 12. Iin(Mr) is the background image which is acquired by the imaging unit 12 in the state in which the observation object 20 is not disposed, and is used for the normalization of the phase contrast image I(Mr). T(r) is the thickness distribution image.
k is a magnitude of a component parallel to the imaging plane in a wavenumber vector of the light on the imaging plane of the imaging unit 12. μ is a linear attenuation coefficient of the observation object 20. 1-δ is a refractive index of the observation object 20, and in general, δ is on the order of 10−6. F represents the Fourier transform, and F−1 represents the inverse Fourier transform.
Even in the case in which the noise is contained in the phase contrast image as shown in
In the case in which the light output from the light source is light having the single wavelength with the narrow wavelength band, the quantitativeness of the thickness distribution image generated by using the above Formula (1) is excellent. On the other hand, in the case in which the light output from the light source is light having a certain band (wavelength band), the quantitativeness of the thickness distribution image generated by using the above Formula (1) is low.
When the tube voltage of the X-ray source is different, the spectrum of the X-rays output from the X-ray source is different. Further, when the energy or the wavelength of the X-rays is different, the respective values of μ and δ of the observation object are different. However, in the above Formula (1), the thickness distribution image is generated using the respective values of μ and δ at a certain specific energy of the X-rays. As a result, in the case in which the phase contrast imaging is performed using the light source which outputs the light having the certain wavelength band, such as the X-ray source, the quantitativeness of the thickness distribution image generated based on the phase contrast image by using the above Formula (1) is low.
In order to solve the above problem, instead of the monochromatic Paganin method of the above Formula (1), it is considered to generate the thickness distribution image based on the phase contrast image by using the method (the polychromatic Paganin method) obtained by extending the Paganin method with the intention of being able to be applied to the case in which the irradiation light with which the observation object is irradiated has the wavelength band.
As the polychromatic Paganin method, the method described in Non Patent Document 2 is known, and in addition, some other polychromatic Paganin methods have been proposed. The polychromatic Paganin method described in Non Patent Document 2 is obtained by, in the above Formula (1), replacing μ and δ depending on the X-ray energy with μmean and δmean obtained by performing the weighted average with the X-ray spectrum.
The following Formula (3) is a formula for generating the thickness distribution image by using the polychromatic Paganin method which is formulated by the present inventor. In the following Formula (3), μmean is obtained by the weighted average of μ with the X-ray spectrum δ(λ), and is represented by the following Formula (4). Further, δmean IS obtained by the weighted average of δ with the X-ray spectrum δ(λ), and is represented by the following Formula (5). λ is the wavelength. The following Formula (4) and Formula (5) are represented by integration calculation, and further, these are obtained by summation calculation in numerical calculation.
The thickness distribution image A is generated by setting the X-rays with which the observation object is irradiated to the X-rays having the single wavelength (energy of 8.4 keV), and using the monochromatic Paganin method (the above Formula (1)) with the respective values of μ and δ at the above X-ray energy. The quantitativeness of the thickness distribution image A is excellent.
The thickness distribution image B is generated by setting the X-rays with which the observation object is irradiated to the X-rays having the wide wavelength band, and using the monochromatic Paganin method (the above Formula (1)) with the respective values of μ and δ at the X-ray energy of 8.4 keV included in the above wavelength band. As compared with the thickness distribution image A, in the thickness distribution image B, the thickness is large as a whole, and the quantitativeness is low. Further, in the thickness distribution image B, it is indicated that there is a certain thickness also in a region immediately outside the observation object (a region in which the observation object does not exist).
The thickness distribution image C is generated by setting the X-rays with which the observation object is irradiated to the X-rays having the wide wavelength band, and using the polychromatic Paganin method (the above Formula (3)) with the respective values of μmean and δmean obtained by the weighted average of μ and δ using the X-ray spectrum (
As described above, in the case in which the X-rays with which the observation object is irradiated are set to the X-rays having the wide wavelength band (the polychromatic light), the quantitativeness of the generated thickness distribution image is low regardless of whether the monochromatic Paganin method or the polychromatic Paganin method is used. Therefore, in the present embodiment, after the thickness distribution image generation step S3 of generating the thickness distribution image based on the phase contrast image by the thickness distribution image generation unit 13, the thickness distribution image correction step S4 of correcting the thickness distribution image by the thickness distribution image correction unit 14 is performed, thereby improving the quantitativeness of the thickness distribution image.
In the initialization step S11, the thickness distribution image T0(r) generated in the thickness distribution image generation step S3 is set as an initial image of the thickness distribution image T(r) in the repeated processing of the subsequent steps S12 to S18. The thickness distribution image T0, which is the initial image, is preferably generated based on the phase contrast image I after the normalization by using the background image lin. Further, the thickness distribution image T0, which is the initial image, may be generated by using any one of the monochromatic Paganin method and the polychromatic Paganin method.
In the light intensity distribution calculation step S12, a light intensity distribution I′ on the imaging plane of the imaging unit 12 is calculated based on the X-ray spectrum S(λ) and the thickness distribution image T(r). Specifically, when the observation object having the thickness distribution T(r) is irradiated with the X-rays having the X-ray spectrum S(λ) output from the light source 10, the intensity distribution I′ of the X-rays reaching the imaging plane of the imaging unit 12 after being passed through the observation object is calculated. The details of the light intensity distribution calculation step S12 will be described later.
In the update amount calculation step S13, an update amount ΔT(r) for the thickness distribution image T(r) is calculated based on the light intensity distribution I′ calculated in the light intensity distribution calculation step S12 and the phase contrast image I. The update amount ΔT(r) is represented by the following Formula (6).
In the evaluation value calculation step S14, an evaluation value ε used for determining whether or not to end the repeated processing of the steps S12 to S18 is calculated. The evaluation value δ is an arbitrary value as long as it can be used as an index indicating whether or not the absolute value of the update amount ΔT(r) calculated in the update amount calculation step S13 has become sufficiently small (that is, whether or not the thickness distribution image T(r) has sufficiently converged), or whether or not the absolute value of the difference between the light intensity distribution I′ and the phase contrast image I has become sufficiently small.
The evaluation value ε may be represented by, for example, the following Formula (7) or Formula (8).
In the determination step S15, it is determined whether or not the evaluation value ε calculated in the evaluation value calculation step S14 is larger than an allowable value α. In the case in which the evaluation value ε is the allowable value α or less, the processing of the thickness distribution image correction step S4 is ended. In the case in which the evaluation value ε is larger than the allowable value α, the processing proceeds to the thickness distribution image update step S16.
In the thickness distribution image update step S16, the thickness distribution image T(r) is updated by using the update amount ΔT(r) calculated in the update amount calculation step S13 (the following Formula (9)).
In the determination step S17, it is determined whether or not each of the pixel values of the thickness distribution image T(r) after being updated in the thickness distribution image update step S16 is 0 or more. In the case in which the pixel value of the thickness distribution image T(r) is a negative value, the pixel value is set to 0 in the non-negative constraint step S18, and then the processing returns to the light intensity distribution calculation step S12.
In the initialization step S21, the light intensity distribution I′ on the imaging plane of the imaging unit 12 is initialized. That is, each of the pixel values of the light intensity distribution I′ is set to 0. Further, in the initialization step S21, a value of an index n indicating the n-th energy En out of the energies E1 to EN is set to 1.
In the transmitted light complex amplitude calculation step S22, a complex amplitude distribution ψn(r) of the light of the energy En immediately after being transmitted through the observation object is calculated. A light intensity distribution In(r) immediately after the light of the energy En is transmitted through the observation object is represented by the following Formula (10). A phase change amount ϕn(r) caused by the light of the energy En being transmitted through the observation object is represented by the following Formula (11). The complex amplitude distribution ψn (r) of the light of the energy En immediately after being transmitted through the observation object is represented by the following Formula (12). In the following formulas, e is the elementary charge. c is the speed of light in vacuum. h is the Planck constant.
In the light propagation calculation step S23, based on the complex amplitude distribution ψn(r) of the light of the energy En immediately after being transmitted through the observation object calculated in the transmitted light complex amplitude calculation step S22, the light propagation calculation is performed, and a complex amplitude distribution Ψn of the light of the energy En on the imaging plane of the imaging unit 12 is calculated. At the time of the above light propagation calculation, a Fresnel diffraction calculation method, an angular spectrum method, or the like is used.
In the light intensity distribution update step S24, the light intensity distribution I′ on the imaging plane of the imaging unit 12 is updated by cumulatively adding the square of the absolute value of the complex amplitude distribution Ψn of the light of the energy En on the imaging plane of the imaging unit 12 calculated in the light propagation calculation step S23 to the light intensity distribution I′ (the following Formula (13)).
In the wavelength update step S25, the value of the index n is increased by 1, and the next energy is selected. In the determination step S26, it is determined whether or not n is N or less. In the case in which n is larger than N, the processing of the light intensity distribution calculation step S12 is ended. In the case in which n is equal to or less than N, the processing returns to the transmitted light complex amplitude calculation step S22.
The light intensity distribution I′ obtained at the end of the processing of the light intensity distribution calculation step S12 is the intensity distribution I′ of the X-rays reaching the imaging plane of the imaging unit 12 after being passed through the observation object when the observation object having the thickness distribution T(r) is irradiated with the multi-wavelength X-rays having the X-ray spectrum S(En) output from the light source 10.
As can be seen from these diagrams, the thickness distribution image corrected as described above (
Further, when the influence of the noise is verified, it is confirmed that the influence of the noise is small with respect to the quantitativeness of the thickness distribution image after the correction. That is, the feature that the phase contrast imaging is resistant to the noise is maintained even in the case in which the thickness distribution image is corrected in the thickness distribution image correction step S4.
As described above, according to the present embodiment, the thickness distribution image with the excellent quantitativeness can be generated even in the case in which the phase contrast imaging is performed by using the light source which outputs the light having the wavelength band.
The observation apparatus and the observation method are not limited to the embodiments and configuration examples described above, and various modifications are possible.
The observation apparatus of a first aspect according to the above embodiment includes (1) a light source for outputting light having a wavelength band, and irradiating an observation object with the light; (2) an imaging unit for receiving light output from the light source and passed through the observation object, and acquiring a phase contrast image of the observation object; (3) a thickness distribution image generation unit for generating a thickness distribution image of the observation object based on the phase contrast image; and (4) a thickness distribution image correction unit for correcting the thickness distribution image based on a spectrum of the light output from the light source, and (5) the thickness distribution image correction unit sets the thickness distribution image generated by the thickness distribution image generation unit as an initial image, and repeatedly performs calculation of an intensity distribution of the light after being passed through the observation object based on the spectrum and the thickness distribution image, calculation of an update amount based on the calculated intensity distribution and the phase contrast image, and update of the thickness distribution image based on the calculated update amount.
In the observation apparatus of a second aspect, in the configuration of the first aspect, the thickness distribution image generation unit may normalize the phase contrast image based on a background image acquired by the imaging unit, and may generate the thickness distribution image based on the normalized phase contrast image.
In the observation apparatus of a third aspect, in the configuration of the first or second aspect, the thickness distribution image generation unit may generate the thickness distribution image based on the phase contrast image by using a Paganin method on the assumption that irradiation light with which the observation object is irradiated is monochromatic light.
In the observation apparatus of a fourth aspect, in the configuration of the first or second aspect, the thickness distribution image generation unit may generate the thickness distribution image based on the phase contrast image by using a method obtained by extending a Paganin method on the assumption that irradiation light with which the observation object is irradiated has the wavelength band.
In the observation apparatus of a fifth aspect, in the configuration of any one of the first to fourth aspects, the observation apparatus may further include a spectrum measurement unit for measuring the spectrum of the light output from the light source.
In the observation apparatus of a sixth aspect, in the configuration of the fifth aspect, the imaging unit and the spectrum measurement unit may be configured in common.
The observation method of a first aspect according to the above embodiment includes (1) an imaging step of irradiating an observation object with light having a wavelength band output from a light source, receiving light passed through the observation object by an imaging unit, and acquiring a phase contrast image of the observation object; (2) a thickness distribution image generation step of generating a thickness distribution image of the observation object based on the phase contrast image; and (3) a thickness distribution image correction step of correcting the thickness distribution image based on a spectrum of the light output from the light source, and (4) in the thickness distribution image correction step, the thickness distribution image generated in the thickness distribution image generation step is set as an initial image, and calculation of an intensity distribution of the light after being passed through the observation object based on the spectrum and the thickness distribution image, calculation of an update amount based on the calculated intensity distribution and the phase contrast image, and update of the thickness distribution image based on the calculated update amount are repeatedly performed.
In the observation method of a second aspect, in the configuration of the first aspect, in the thickness distribution image generation step, the phase contrast image may be normalized based on a background image acquired by the imaging unit, and the thickness distribution image may be generated based on the normalized phase contrast image.
In the observation method of a third aspect, in the configuration of the first or second aspect, in the thickness distribution image generation step, the thickness distribution image may be generated based on the phase contrast image by using a Paganin method on the assumption that irradiation light with which the observation object is irradiated is monochromatic light.
In the observation method of a fourth aspect, in the configuration of the first or second aspect, in the thickness distribution image generation step, the thickness distribution image may be generated based on the phase contrast image by using a method obtained by extending a Paganin method on the assumption that irradiation light with which the observation object is irradiated has the wavelength band.
In the observation method of a fifth aspect, in the configuration of any one of the first to fourth aspects, the observation method may further include a spectrum measurement step of measuring the spectrum of the light output from the light source by a spectrum measurement unit.
In the observation method of a sixth aspect, in the configuration of the fifth aspect, the imaging unit and the spectrum measurement unit may be configured in common.
The present invention can be used as an observation apparatus and an observation method capable of generating a thickness distribution image with excellent quantitativeness in the case in which phase contrast imaging is performed using a light source which outputs light having a wavelength band.
From the invention thus described, it will be obvious that the invention may be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the invention, and all such modifications as would be obvious to one skilled in the art are intended for inclusion within the scope of the following claims.
Number | Date | Country | Kind |
---|---|---|---|
2023-127744 | Aug 2023 | JP | national |