The present invention relates to an evaluation device and method, and a program. The invention relates to a technique for visualizing and quantitatively evaluating a state of a sample of a biological tissue or the like by processing a measurement signal obtained from measurement in, for example, optical coherence tomography (OCT). The present application claims priority to Japanese Patent Application No. 2019-207348 filed in Japan on Nov. 15, 2019, and Japanese Patent Application No. 2020-070309 filed in Japan on Apr. 9, 2020, the contents of which are incorporated herein by reference.
In recent years, a technique called “OCT microscope” for imaging ex vivo samples using OCT has been studied. However, the OCT microscope is generally of a technique for morphological imaging, and is not capable of imaging tissue functions such as metabolism. Meanwhile, a signal analysis method called “dynamic OCT” has been proposed (Non-Patent Literature 1). However, this method has poor quantitativeness, making it difficult to correctly evaluate the degree of biological activities. In addition, this method is suitable for a special type of OCT called Full-field OCT (FF-OCT) and it is difficult to implement this method in widely used scanning OCT.
[Non-Patent Literature 1] Apelian et al., “Dynamic Full Field Optical Coherence Tomography: Subcellular Metabolic Contrast Revealed in Tissues by Interferometric Signals Temporal Analysis”, Biomedical Optics Express 7, No. 4, p. 1511-1524, Mar. 24, 2016
The present invention has been conceived taking the above-described circumstances into account and one objective of the present invention is to provide an evaluation method that enables quantitative evaluation of dynamic characteristics of samples, for example, dynamics and intracellular activities of biological tissues.
The present invention employs the following means to solve the above-described problems.
(1) An aspect of the present invention is an evaluation device including a measurement unit that acquires an optical coherence tomography (OCT) signal indicating a state of a biological tissue provided as a sample and acquires a signal value based on the OCT signal at an observation point in the sample and an evaluation unit that calculates a temporal variation characteristic value indicating a temporal variation characteristic of the signal value within a predetermined period.
(2) In another aspect of the present invention, the evaluation unit may calculate a variance of the signal value as the temporal variation characteristic value.
(3) In another aspect of the present invention, the evaluation unit may divide a sum of squares of a deviation between a signal intensity of the OCT signal and a mean value of the signal intensity at a frame time within the predetermined period by the number of frames in the predetermined period to calculate the variance at the observation point.
(4) In another aspect of the present invention, the evaluation unit may calculate a correlation coefficient of the signal value and a time-shifted signal value obtained by time-shifting the signal value by a time shift amount τ for each time shift amount τ, and calculate a decay speed of the correlation coefficient according to an increase in the time shift amount τ as the temporal variation characteristic value.
(5) In another aspect of the present invention, the evaluation unit may calculate, as a variance, a sum of squares of a deviation between a signal intensity of the OCT signal and a mean value of the signal intensity at a frame time within the predetermined period, calculate, as a covariance, a sum of a product of a deviation between a signal intensity of the OCT signal and a mean value of the signal intensity at a frame time within the predetermined period and another deviation between a time-shifted signal intensity of the OCT signal at a shift time shifted from the frame time by a time shift amount τ and a mean value of the time-shifted signal intensity, calculate the correlation coefficient by dividing the covariance by the variance for each shift amount τ, and perform regression analysis using a predetermined decay function using the correlation coefficient for each time shift amount τ and calculate a parameter of the decay function approximating the correlation coefficient, as the decay speed at an observation point.
(6) In another aspect of the present invention, the evaluation unit may calculate the decay speed using the correlation coefficient calculated with the time shift amount τ being non-zero.
(7) In another aspect of the present invention, the measurement unit may determine a polarization characteristic value based on a polarization characteristic at an observation point in the sample, based on a first measurement signal of a first interferometric component in a first polarization state, the first interferometric component being obtained by causing a first incidence component incident on the sample in the first polarization state to interfere with a component obtained by reflection or scattering of the first incidence component from the sample, a second measurement signal in a second polarization state with respect to the first interferometric component, a third measurement signal of a second interferometric component in the first polarization state, the second interferometric component being obtained by causing a second incidence component incident on the sample in the second polarization state to interfere with a component obtained by reflection or scattering of the second incidence component from the sample, and a fourth measurement signal in the second polarization state with respect to the second interferometric component, and the evaluation unit may determine the temporal variation characteristic value indicating a temporal variation characteristic of the polarization characteristic value.
(8) In another aspect of the present invention, the measurement unit may determine a Jones matrix at an observation point based on the first measurement signal, the second measurement signal, the third measurement signal, and the fourth measurement signal and determine a cumulative Jones matrix at the observation point from a Jones matrix at the observation point in the sample and a Jones matrix on a surface of the sample, and determine, as the polarization characteristic value, a cumulative phase retardation index value that is a phase difference between eigenvalues of the cumulative Jones matrix.
(9) In another aspect of the present invention, the measurement unit may determine a Jones matrix at an observation point based on the first measurement signal, the second measurement signal, the third measurement signal, and the fourth measurement signal and determine, from a Jones matrix at a first observation point in the sample and a Jones matrix at a second observation point in the sample, a local Jones matrix between the first observation point and the second observation point, and determine the polarization characteristic value based on a local phase retardation that is a phase difference between eigenvalues of the local Jones matrix.
(10) In another aspect of the present invention, the measurement unit may determine a birefringence by dividing the local phase retardation by a wavenumber of incident light incident on the sample and a thickness between the first observation point and the second observation point.
(11) In another aspect of the present invention, the evaluation unit may calculate the temporal variation characteristic value based on a variance or a standard deviation of the polarization characteristic value.
(12) In another aspect of the present invention, the evaluation unit may calculate the temporal variation characteristic value based on a variance or a standard deviation of a logarithmic value of the polarization characteristic value.
(13) In another aspect of the present invention, the evaluation unit may calculate a dynamic contrast by dividing the standard deviation of the polarization characteristic value by a mean value of the birefringence.
(14) In another aspect of the present invention, the measurement unit may convert, as the polarization characteristic values, a first Jones vector based on the first measurement signal and the second measurement signal and a second Jones vector based on the third measurement signal and the fourth measurement signal into a first Stokes vector and a second Stokes vector, respectively, and the evaluation unit may determine a temporal polarization uniformity based on a time average of the first Stokes vectors and a time average of the second Stokes vectors as the temporal variation characteristic value.
(15) In another aspect of the present invention, the measurement unit may determine a temporal polarization uniformity based on a time average of a corrected first Stokes vector obtained by subtracting a noise component from the first Stokes vector and a time average of a corrected second Stokes vector obtained by subtracting a noise component from the second Stokes vector.
(16) In another aspect of the present invention, the measurement unit may determine, as the polarization characteristic value, a Jones matrix at an observation point based on the first measurement signal, the second measurement signal, the third measurement signal, and the fourth measurement signal, and the evaluation unit may calculate a von Neumann entropy of the Jones matrix as the temporal variation characteristic value.
(17) In another aspect of the present invention, the evaluation unit may calculate an entropy of a noise component from a temporal polarization uniformity of a first Stokes vector and a temporal polarization uniformity of a second Stokes vector, the first Stokes vector and the second Stokes vector being obtained by conversion from a first Jones vector based on the first measurement signal and the second measurement signal and a second Jones vector based on the third measurement signal and the fourth measurement signal, respectively, and correct the von Neumann entropy based on the entropy of the noise component.
(18) In another aspect of the present invention, the first polarization state may be horizontal polarization, and the second polarization state may be vertical polarization, the first measurement signal may be a first horizontally polarized spectral interferometric signal, the second measurement signal may be a second horizontally polarized spectral interferometric signal, the third measurement signal may be a first vertically polarized spectral interferometric signal, and the fourth measurement signal may be a second vertically polarized spectral interferometric signal.
(19) In another aspect of the present invention, the evaluation unit may calculate the temporal variation characteristic value on a per observation period interval basis, the observation period interval being longer than the predetermined period.
(20) Another aspect of the present invention may include an output processing unit that determines an evaluation value indicating an active state of the sample based on the temporal variation characteristic value.
(21) Another aspect of the present invention may include an image processing unit that generates image data having, as a signal value, an output value for the temporal variation characteristic value at the observation point using a function to provide the output value monotonically changing with respect to a change in an input value.
(22) Another aspect of the present invention relates to an evaluation method for an evaluation device including acquiring an optical coherence tomography (OCT) signal indicating a state of a biological tissue provided as a sample and acquiring a signal value based on the OCT signal at an observation point in the sample, and calculating a temporal variation characteristic value indicating a temporal variation characteristic of the signal value within a predetermined period.
(23) Another aspect of the present invention relates to a program causing a computer of an evaluation device to perform a measurement procedure of acquiring an optical coherence tomography (OCT) signal indicating a state of a biological tissue provided as a sample and acquiring a signal value based on the OCT signal at an observation point in the sample, and an evaluation procedure of calculating a temporal variation characteristic value indicating a temporal variation characteristic of the signal value within a predetermined period.
According to the present embodiment, it is possible to detect a minute change (fluctuation) that was overlooked in the past and to realize quantitative evaluation of dynamics of biological tissues.
An evaluation method according to an embodiment to which the present invention is applied will be described in detail below with reference to the drawings. Further, characteristic portions in the drawings used in the following description may be expanded and illustrated for convenience in order to facilitate understanding of the characteristics, and the dimensions, ratios and the like of each constituent component are not necessarily the same as actual ones. Further, the materials, dimensions, etc. exemplified in the following description are examples, the present invention is not limited thereto, and the present invention can be appropriately modified within the range in which the gist of the invention is not changed.
First, the imager 10 performs optical coherence tomography (OCT) imaging (measurement) for the same site at the same position on a biological tissue a plurality of times (several times to several hundreds of times that is equal to several frames to several hundreds of frames), preferably 10 frames or more, and more preferably 15 frames or more within a predetermined period (e.g., one to 15 minutes, and typically within three minutes). The predetermined period (observation period) for one OCT operation may be shorter than an observation period interval to the adjacent observation period, and may be a period in which the accuracy required for evaluation of dynamic characteristics of the sample expressed by an OCT signal obtained by the OCT operation at the time point can be ensured. More specifically, an observation period may be determined between the frame intervals and thus the frequency component of the dynamic characteristics of the sample is included in the frequency band from the lowest frequency corresponding to the observation period to the maximum frequency corresponding to the frame interval. In addition, the observation period interval may be a period in which the accuracy required for evaluation of a global change trend of the active state of the biological tissue provided as a sample can be ensured. For example, a period that is sufficiently shorter than a predetermined time of a series of processes from separating from its parent body a biological tissue serving as a sample from its parent body to cell death (apoptosis), or a series of processes required for cell death after a cause thereof occurs in a biological tissue provided as a sample in the parent body (necrosis), and the like may be determined to be an observation period interval. From the perspective of knowing characteristics of an entire sample, it is preferable to perform the same OCT operation on different sites.
Next, the measurer 22 and the evaluator 24 quantitatively evaluate activities of the biological tissue based on a temporal change in the OCT signal intensity obtained from images of OCT of each time. Specific methods of quantitative evaluation include, for example, calculation of a speckle variance (SV), an OCT correlation decay speed (OCDS), and the like, and further evaluation of calculation results.
A speckle variance indicates a variance (fluctuation) of OCT signal intensities in a short time, and can be calculated using the following formula (1).
In formula (1) above, x and z indicate a position on a surface of a biological tissue and a position in the depth direction from the surface, respectively, I(x, z, ti) indicates an OCT signal intensity at each time at each position displayed on a linear scale or logarithmic scale, <I> indicates the mean OCT signal intensity, and N indicates the number of frames of an OCT signal within a predetermined period. x and z correspond to positions of observation points corresponding to individual pixels forming an OCT image.
More specifically, first, the measurer 22 measures each of OCT signal intensities I(x, z, t1), I(x, z, t2), . . . I(x, z, tN) for each observation point (x, z) at the time t1, t2, . . . tN of each frame. Next, the evaluator 24 calculates the mean <I> of the OCT signal intensity of N times. Next, the evaluator 24 squares the difference between the OCT signal intensity of each time and the mean <I>. That is, the evaluator 24 calculates [I(x, z, t1)−<I>]2, [I(x, z, t2)−<I>]2, . . . [I(x, z, tN)−<I>]2. Finally, the evaluator 24 divides the sum of the squared differences by N and thus can obtain the speckle variance σ2 (x, z).
The OCT correlation decay speed indicates a speed at which the correlation coefficient of the adjacent time intervals (t, t+τ) decreases in response to an increase in a time shift amount τ, and a correlation coefficient ρ(x, z, τ) can be calculated using the following formula (2).
[Math. 2]
ρ(x,z,τ)=σcov2(x,z,τ)/σI2(x,z) (2)
In formula (2) described above, x and z indicate a position on a surface of a biological tissue and a position in the depth direction from the surface, respectively, and σcov2 (x, z, τ) and σ12 (x, z) indicate the covariance and speckle variance (variance) of OCT signal intensities I (x, z, τ) and I (x, z, t+τ), respectively. The OCT signal intensity I (x, z, t+τ) is a signal value obtained by time-shifting the OCT signal intensity I (x, z, t) by a time shift amount τ. That is, a correlation coefficient ρ (x, z, τ) corresponds to the autocorrelation function of the signal value I (x, z, t) of the OCT signal in the observation point (x, z).
More specifically, the evaluator 24 calculates [I(x, z, t)−<I>]×[I(x, z, t+τ)−<I>] as the covariance σcov2 (x, z, τ) at adjacent time intervals (t, t+τ). Next, the evaluator 24 divides the covariance σcov2 (x, z, τ) by the speckle variance σ2 (x, z) calculated using formula (1) described above to obtain the correlation coefficient ρ (x, z, τ). Then, the evaluator 24 performs regression analysis on the obtained correlation coefficient ρ (x, z, τ) and applies the result to a predetermined function of the time shift amount τ to obtain a parameter of the function as an OCT correlation decay speed, and thus the function value of the function more closely approximates the correlation coefficient (x, z, τ). The predetermined function may be a function in which the function value given to the time shift amount is attenuated as the time shift amount increases, for example, an exponential function. When an exponential function is used, the base being the parameter is obtained to serve as an indication of the decay speed. Although linear analysis may be used as a method of regression analysis, the method is not limited to this, and non-linear analysis may be used.
As described above, the purpose of the evaluation method for biological tissues according to the present embodiment is to quantitatively evaluate the activity of a biological tissue by obtaining images of a specific site of the biological tissue a plurality of times in a short period and calculating the speckle variance, the OCT correlation decay speed, and the like. With this operation, it is possible to detect a minute change (fluctuation) that was overlooked in the past and to realize quantitative evaluation of dynamics of the biological tissue.
The effects of the present embodiment will be more apparent from examples below.
Further the present embodiment is not limited to the following examples, and can be appropriately changed in a range that does not change the gist of the invention.
A tumor aggregate sample obtained by culturing cells derived from human cancer tissues in a spherical shape was subjected to OCT imaging of the related art every 4 hours.
A tumor aggregate sample similar to that of Comparative Example 1 was subjected to high speed OCT imaging 100 times at intervals of 13 ms every two hours, as an example. The reason for setting the observation period interval to 2 hours is that the period is sufficient to capture the change trend of the activity state in the period from the removal of the tumor aggregate tissue provided as a sample from the living body to the death (typically, approximately 1 to 3 days). In addition, the reason for setting a single observation period to 100 times of imaging at intervals of 13 ms, that is, 1.3 seconds, is that the observation period is sufficiently shorter than the observation period interval and is sufficient for capturing the temporal change of optical characteristics in accordance with movement of the cells constituting the tissue or activities occurring within the cells (e.g., several Hz to 20 Hz). Next, the speckle variance was calculated based on the temporal change in the OCT signal intensity obtained from the images of OCT of each time.
A tumor aggregate sample similar to that of Comparative Example 1 was subjected to high speed OCT imaging similar to that of Example 1. Next, the OCT correlation decay speed was calculated based on the temporal change in the OCT signal intensity obtained from the images of OCT of each time.
A tumor aggregate sample similar to that of Comparative Example 1 was subjected to high speed OCT imaging similar to that of Example 1. Subsequently, the attenuation coefficient (AC) of the OCT signal intensity in the depth direction was calculated based on the OCT signal intensity obtained from the images of OCT of each time.
Further, the image of the first time among the OCT images of a plurality of times does not correctly reflect the attenuation trend of the correlation coefficients with respect to the sample in the subsequent images, and causes a significant difference from the estimation value estimated from the attenuation trend, and thus it is preferable in quantitative evaluation to exclude the correlation coefficient for the case where the time shift amount τ is zero and calculate the OCT correlation decay speed using the correlation coefficient for a non-zero time shift amount τ that is not zero.
A liver sample of a mouse cut out as a portion of a biological tissue was subjected to OCT imaging of the past on an hourly basis.
A liver sample similar to that of Comparative Example 2 was subjected to high speed OCT imaging 100 times at intervals of 10 ms on an hourly basis. Next, the speckle variance was calculated based on the temporal change in the OCT signal intensity obtained from the images of OCT of each time.
A liver sample similar to that of Comparative Example 2 was subjected to high speed OCT imaging similar to that of Example 4. Next, the OCT correlation decay speed was calculated based on the temporal change in the OCT signal intensity obtained from the images of OCT of each time.
A liver sample similar to that of Comparative Example 2 was subjected to high speed OCT imaging similar to that of Example 4. Next, the attenuation coefficient (AC) of the OCT signal intensity in the depth direction was calculated based on the OCT signal intensity obtained from the image of OCT of each time.
Further, the image of the first time among the OCT images of a plurality of times does not correctly reflect the attenuation trend of the correlation coefficients with respect to the sample in the subsequent images, and causes a significant difference from the estimation value estimated from the attenuation trend, and thus it is preferable in quantitative evaluation to calculate the OCT correlation decay speed, excluding the case where τ is zero.
Next, a second embodiment of the present invention will be described.
According to the analytical technique referred to as dynamic OCT described above, it is possible to express local activities of endogenous scattering factors forming biological tissues such as cells. However, in the technique described in Non-Patent Literature 1, it is difficult to evaluate activities of a living body correctly because the technique has poor quantitativeness in expressed local activities. On the other hand, in applications such as diabetes research and cardiovascular research, the application of dynamic imaging is expected to implement a visualization technique having specificity to specific tissues such as microblood vessels, lymphatic vessels, and myocardium. In order to quantitatively evaluate the activity of a biological tissue, it is also conceivable to perform OCT measurement multiple times at the same location of the biological tissue and analyze the temporal change of OCT signal intensity obtained in the measurement of each time. However, because all minute movements made in the tissue are reflected in the temporal change of the OCT signal, it is not possible to quantitatively evaluate the activity of a specific tissue simply by analyzing the temporal change of the signal intensity. The present embodiment has been proposed in view of this point.
An object to be observed that is provided as a sample Sm is primarily a part of a living body of a human or an animal. More specifically, it may be any of an ocular fundus, a blood vessel, a tooth, a subcutaneous tissue, and the like. This makes it possible to measure or observe the state inside the sample Sm in a non-invasive manner. Thus, the device is expected to be applied to diagnosis of in vivo tissues, for example, microvessels of an ocular fundus, lymphatic vessels, myocardium, and the like.
The OCT system 1 exemplified in
The OCT system 1 includes the light source 102, a coupler 104, a polarization delay unit 110, a circulator 120, a probe 128, the reference arm 130, a polarization diversity detection unit 150, a photodetector 190, and the measurement signal processing device 200. The light source 102, the coupler 104, the polarization delay unit 110, the circulator 120, the probe 128, the polarization diversity detection unit 150, and the photodetector 190 are components constituting an optical system. The components of the optical system are coupled using optical fibers as optical paths.
The light source 102 is a wavelength swept source that generates light having a wavelength to be periodically swept within a predetermined wavelength width (e.g., 40 to 120 nm). The light source 102 has a wavelength of near-infrared (e.g., 1000 to 1400 nm), for example, superluminescent diode (SLD), or the like. Light generated by the light source 102 is incident on the coupler 104.
The coupler 104 separates the light incident from the light source 102 into two systems of the probe arm and the reference arm 130 at a predetermined intensity ratio. The percentages of the light intensity for the probe arm and the light intensity for the reference arm 130 are, for example, 90% and 10%. The light supplied to the probe arm is supplied to the polarization diversity detection unit (PDDU) 150. The probe arm is a path formed by a fiber collimator 106, a polarization controller 108, the polarization delay unit (PDU) 110, the circulator 120, a fiber collimator 122, a polarization controller 124, an objective lens 126, and the probe 128 connected in this order. The probe arm is also called a sample arm or a measuring arm. Light supplied to the probe arm is incident on the polarization delay unit 110 via the fiber collimator 106 and the polarization controller 108. Light of another system is incident on the PPDU 150 via the reference arm 130. Further, the polarization controller 108 amplifies the intensity of the incident light to a predetermined sufficient intensity, and then emits the amplified light.
The PDU 110 includes a linear polarizer 112, a polarization beam splitter (PBS) 114, and two right-angle prisms (RAPs) 116 and 118. The PDU 110 separates the incident light into a horizontal polarization component and a vertical polarization component as components having two polarization states orthogonal to each other, and supplies the light obtained by combining the separated components to the circulator 120.
The linear polarizer 112 converts the light incident from the coupler 104 in the polarization state into linearly polarized light and emits the converted light to the PBS 114. To equalize the horizontal polarization component and the vertical polarization component of the emitted light, the polarization angle of the linear polarizer 112 is set to 45°. The PBS 114 has a reflective layer whose surface is arranged in the direction at an incident angle of 45°, the vertical polarization component of the incident light incident on the reflective layer from the linear polarizer 112 is transmitted as transmitted light, and the horizontal polarization component thereof reflects on the surface of the reflective layer as reflected light. The reflected light including the horizontal polarization component and the transmitted light including the vertical polarization component from the PBS 114 are incident on the RAPs 116 and 118, respectively. On the other hand, the reflective layer of the PBS 114 combines the transmitted light obtained by transmitting incident light including the horizontal polarization component that is incident on the reflective layer from the RAP 116 with the reflected light with respect to the incident light including the vertical polarization component incident from the PBS 118, and emits the combined light to the circulator 120.
The RAPs 116 and 118 each have a shape in which a cross section parallel to the optical path is an isosceles right triangle, and a bottom side of the isosceles right triangle is disposed to be orthogonal to the optical path from the PBS 114. The light incident from the PBS 114 is transmitted through the side face parallel to the base of the isosceles right triangle and is reflected on one side face parallel to one of the two sides facing the base, and the reflected light is reflected on the side face parallel to the other side to return to the side face parallel to the bottom to be transmitted through the side face and incident on the PBS 114. Further, the position of the RAP 118 is adjusted in advance and thus the optical path length between the PBS 114 and the RAP 116 and the optical path length between the PBS 114 and the RAP 118 are significantly different. In this way, the horizontal polarization component and the vertical polarization component that are incident on the sample Sm from the PBS 114 are emitted in a superimposed manner with a predetermined phase difference between each other.
The circulator 120 emits light incident from the PDU 110 through the fiber collimator 122 and the polarization controller 124 to the objective lens 126. The objective lens 126 condenses light incident on the lens to radiate the light to the sample Sm via the probe 128. The light obtained from reflection or scattering from the sample Sm or both of the phenomena is converted to parallel light by the objective lens 126 via the probe 128, passes through the polarization controller 124 and the fiber collimator 122 to return to the circulator 120, and is incident on the PPDU 150 as a measurement beam.
The reference arm 130 is a path formed by a fiber collimator 132, a fiber Bragg grating (FBG) 134, a fiber collimator 136, a delay line 138, a fiber collimator 140, and a polarization controller 142 connected in this order.
The FBG 134 reflects components of incident light of a specific wavelength as reflected light and transmits the rest components and causes the components to be incident on the delay line 138 via the fiber collimator 136 as transmitted light. The reflected light from the FBG 134 returns to the coupler 104 via the fiber collimator 132 and is incident from the coupler 104 to the photodetector 190. The band of components reflected from the FBG 134 is sufficiently narrower than the band of light generated by the light source 102. The photodetector 190 detects the intensity of the reflected light from the FBG 136 and outputs the intensity signal indicating the detected intensity to the measurement signal processing device 200 as a trigger signal. The trigger signal is used as a trigger for A-scan. Although the wavelength of the light generated by the light source 102 changes periodically within the range of a predetermined wavelength width, the timing at which the wavelength becomes a predetermined wavelength is detected by the photodetector 190, and an optical system control unit 212 resets A-scan at that timing. For example, a lower limit of the wavelength width for the photodetector 190 is preset as the wavelength to be detected. The reason for this is that the depth of an observation point to be observed is determined by the wavelength of probe light in SS-OCT.
The delay line 138 delays incident light incident from the FBG 134 and emits the delayed light to the PPDU 150 via the fiber collimator 140 and the polarization controller 142. The delay line 138 changes a delay amount of incident light and adjusts a delay amount, and thus the optical path length of the probe arm and the optical path length of the reference arm 130 are equal to each other. Further, the polarization controller 142 adjusts the intensity of incident light to a predetermined intensity, and emits light with the adjusted intensity.
The PPDU 150 includes a linear polarizer 152, a non-polarization beam splitter (NPBS) 154, two PBSs 156 and 158, four optical receivers 162, 164, 166 and 168, and two balanced polarization detectors (BPD) 170 and 172.
The linear polarizer 152 converts light incident from the reference arm 130 in a polarization state into linearly polarized light and emits the converted light to the NPBS 154. A polarization angle of the linear polarizer 152 is set to 45°. The NPBS 154 combines incident light incident from the reference arm 130 via the linear polarizer 152 and incident light incident from the probe arm. The NPBS 154 has a reflective layer whose surface is disposed in the direction in which the incident angle is 45° with respect to each of incident light from the reference arm 130 and incident light from the probe arm. The reflective layer combines transmitted light obtained by transmitting the incident light from the reference arm 130 and reflected light obtained by reflecting incident light from the probe arm, and emits interferometric light obtained from the combination to the PBS 158. The reflective layer combines reflected light obtained by transmitting the incident light from the reference arm 130 and transmitted light obtained by transmitting the incident light from the probe arm, and emits interferometric light obtained from the combination to the PBS 156.
The PBS 156 separates the interferometric light incident from the NPBS 154 into a horizontally polarized component and a vertically polarized component, and emits the separated horizontally polarized component and vertically polarized component to the optical receivers 162 and 166, respectively. The optical receivers 162 and 166 receive the horizontally polarized component and the vertically polarized component incident from the PBS 156, respectively, and guide the components to the BPDs 170 and 172 as a first horizontally polarized component and a first vertically polarized component. The first horizontally polarized component and the first vertically polarized component correspond to the horizontally polarized component and the vertically polarized component of the interferometric light based on the horizontally polarized component incident on the sample Sm.
The PBS 158 separates the light incident from the NPBS 154 into a horizontally polarized component and a vertically polarized component, and emits the separated horizontally polarized component and vertically polarized component to the optical receivers 164 and 168, respectively. The optical receivers 164 and 168 receive the horizontally polarized component and the vertically polarized component incident from the PBS 158, respectively, and guide the components to the BPDs 170 and 172 as a second horizontally polarized component and a second vertically polarized component. The second horizontally polarized component and the second vertically polarized component correspond to a horizontally polarized component and a vertically polarized component of the interferometric light based on the vertically polarized component incident on the sample Sm.
The BPD 170 detects the first horizontally polarized component and the second horizontally polarized component guided from the optical receivers 162 and 166, and converts the components into a first horizontally polarized spectral interferometric signal and a second horizontally polarized spectral interferometric signal that are analog electrical signals indicating the intensities of the detected first horizontally polarized component and second horizontally polarized component, respectively. The BPD 170 has the generated first horizontally polarized spectral interferometric signal and second horizontally polarized spectral interferometric signal pass through a low pass filter (LPF) 182 and a high pass filter (HPF) 186 to be output to the measurement signal processing device 200.
The BPD 172 detects the first vertically polarized component and the second vertically polarized component guided from the optical receivers 164 and 168, and converts the components into a first vertically polarized spectral interferometric signal and a second vertically polarized spectral interferometric signal that are analog electrical signals indicating the intensities of the detected first vertically polarized component and second vertically polarized component, respectively. The BPD 172 has the generated first vertically polarized spectral interferometric signal and second vertically polarized spectral interferometric signal pass through a low pass filter 184 and a high pass filter 188 to be output to the measurement signal processing device 200. Each of the first horizontally polarized spectral interferometric signal, the second horizontally polarized spectral interferometric signal, the first vertically polarized spectral interferometric signal, and the second vertically polarized spectral interferometric signal are used to generate an OCT image of one frame to realize Jones matrix OCT (JM-OCT).
Further, the BPDs 170 and 172 samples the width of the wavelength of the light emitted by the light source 102 to a signal value of a predetermined number of samples (e.g., 400 to 2000 samples) at a predetermined sampling frequency for each time of A-scan. Each of the LPFs 182 and 184 and the HPFs 186 and 188 is, for example, a Chebyshev filter. The cutoff frequency of the LPFs 182 and 184 is, for example, 62 MHz. The cutoff frequency of the HPFs 186 and 188 is, for example, 1 MHz.
Measurement Signal Processing Device
Next, a configuration example of the measurement signal processing device 200 according to the present embodiment will be described.
The measurement signal processing device 200 includes a control unit 210, a storage unit 230, an input/output unit 240, a display unit 250, and an operation unit 260. Some or all functions of the control unit 210 are realized as a computer including a processor such as a central processing unit (CPU), for example. The processor reads a program stored in the storage unit 230 in advance, and performs processing indicated by a command described in the read program to provide the function. In the present application, the processing indicated by the command described in the program may be referred to as executing the program, execution of the program, or the like. Some or all of the control unit 210 is not limited to a general-purpose hardware such as a processor, and may include dedicated hardware such as a large scale integration (LSI), an application specific integrated circuit (ASIC), or the like.
The control unit 210 includes an optical system control unit 212, a measurement signal acquisition unit 214, a polarization analysis unit 216, a variance characteristic analysis unit 218, an image processing unit 220, and an output processing unit 222. The measurement signal acquisition unit 214 and the polarization analysis unit 216 according to the present embodiment acquire an OCT signal, and function as a measurement unit that acquires a signal value based on the acquired OCT signal for each observation point of the sample. The variance characteristic analysis unit 218 functions as an evaluation unit for calculating a temporal variation characteristic value indicating temporal variation characteristic of the acquired signal value for each predetermined period.
The optical system control unit 212 drives a drive mechanism that makes a position of the probe variable, and scans an observation point of the sample Sm (B-scan). The optical system control unit 212 scans the observation point of the sample Sm in a predetermined direction that intersects the depth direction (hereinafter, the z direction) of the sample Sm (e.g., the x direction on the front of the sample Sm orthogonal to the depth direction). The optical system control unit 212 outputs a control signal indicating movement of the position of the probe 128 in that direction to the drive mechanism when a trigger signal input from the photodetector 190 is equal to or greater than a predetermined intensity, for example. A distance of the movement corresponds to a preset interval between observation points in the x direction. In addition, at this time, the optical system control unit 212 returns the position of the probe 128 to the reference point each time the number of observation points in the x direction from the reference point reaches a predetermined number (the number of lines). Thereafter, the measurement signal acquisition unit 214 acquires the measurement signal of the next frame. The repetition of the measurement signal causes the measurement signal to be accumulated per frame over time. In the example illustrated in
The measurement signal acquisition unit 214 receives the input of the first horizontally polarized spectral interferometric signal, the second horizontally polarized spectral interferometric signal, the first horizontally polarized spectral interferometric signal, and the second vertically polarized spectral interferometric signal as measurement signals from the PPDU 150 via the input/output unit 240. The measurement signal acquisition unit 214 performs a Fourier transform on the first horizontally polarized spectral interferometric signal, the second horizontally polarized spectral interferometric signal, the first vertically polarized spectral interferometric signal, and the second vertically polarized spectral interferometric signal, and calculates a first horizontally polarized OCT signal, a second horizontally polarized OCT signal, a first vertically polarized OCT signal, and a second vertically polarized OCT signal each indicating a complex amplitude for each observation point. The measurement signal acquisition unit 214 outputs the calculated first horizontally polarized OCT signal, second horizontally polarized OCT signal, first vertically polarized OCT signal, and second vertically polarized OCT signal to the polarization analysis unit 216.
The polarization analysis unit 216 calculates, for each observation point within the sample Sm, a polarization characteristic value indicating the polarization characteristics at the observation points based on the first horizontally polarized OCT signal, the second horizontally polarized OCT signal, the first vertically polarized OCT signal, and the second vertically polarized OCT signal input from the measurement signal acquisition unit 214. The polarization analysis unit 216 configures a Jones matrix indicating the polarization characteristics of the light waves to be measured, and calculates a predetermined polarization characteristic value as an index value representing the polarization characteristics from the configured Jones matrix.
The Jones matrix is a matrix with two rows and two columns indicating a change in a polarization state. A first Jones vector and a second Jones vector are arranged in the first and second columns of the Jones matrix, respectively. The first Jones vector and the second Jones vector are acquired by using incident light having polarization components orthogonal to each other. That is, the first Jones vector is a two-dimensional vector including complex amplitudes each indicated by the first horizontally polarized OCT signal and first vertically polarized OCT signal as elements. The second Jones vector is a two-dimensional vector including complex amplitudes each indicated by the second horizontally polarized OCT signal and second vertically polarized OCT signal as elements. Each column of the Jones matrix corresponds to a polarization state related to incidence, each row corresponds to a detected polarization state. The polarization analysis unit 216 outputs the calculated polarization characteristic value for each observation point to the variance characteristic analysis unit 218. Further, in the present application, the Jones matrix directly composed of the OCT signals or the conversion coefficients in the frequency domain thereof at this stage may be referred to as a measured Jones matrix.
The variance characteristic analysis unit 218 calculates a predetermined temporal variation characteristic value as an index value indicating a temporal variation characteristic in an observation period that is a predetermined period set in advance for the polarization characteristic value input from the polarization analysis unit 216. The observation period is, for example, typically about 150 to 600 frames when the frame rate is 60 frames/second. The variance characteristic analysis unit 218 outputs the calculated temporal variation characteristic value to the image processing unit 220. Further, examples of the polarization characteristic value and the temporal variation characteristic value will be described below.
The image processing unit 220 converts the temporal variation characteristic value input from the variance characteristic analysis unit 218 into a pixel value within a predetermined value range that can be expressed by a bit depth for each pixel using a predetermined function. The image processing unit 220 calculates a pixel value by adding a predetermined offset value to the multiplication value obtained by multiplying a value of a sigmoid function for a temporal variation characteristic value by a predetermined multiple. The function for converting the temporal variation characteristic value into a pixel value is not limited to a Sigmoid function, and a function is available as long as a function value obtained from an input value monotonically increases or decreases with respect to an increase in the input value, such as a linear function or a logarithmic function. The image processing unit 220 generates output image data indicating the pixel value converted for each of the observation points, and outputs the generated output image data to the display unit 250. The image processing unit 220 may store the output image data in the storage unit 230 in accordance with a control signal input from the output processing unit 222.
The output processing unit 222 controls the generation or output of the output image data indicating the display image based on an operation signal input from the operation unit 260. The operation signal indicates, for example, necessity of display or storage of a display image, an observation target region, or the like as a parameter. In a case where the control unit 210 has the capability of calculating a plurality of types of temporal variation characteristic values, calculation or the type of a display target among a plurality of types of temporal variation characteristic values may be indicated using operation signals. The output processing unit 222 may cause the display unit to display a setting screen for guiding a parameter that can be set in an operation, a parameter setting, and a parameter to be set, and may configure a user interface related to image display.
For example, when an operation signal indicating necessity of display of a display image is input, the output processing unit 222 outputs a control signal indicating whether display is needed to the image processing unit 220. The image processing unit 220 outputs the output image data to the display unit when the control signal indicating necessary of the display is input from the output processing unit 222, and does not output the output image data to the display unit when the control signal indicating unnecessity of the display is input from the output processing unit 222.
When an operation signal indicating an observation target region is input, the output processing unit 222 outputs a control signal indicating the range of an x coordinate or a y coordinate in the observation target region to the measurement signal acquisition unit 214. The measurement signal acquisition unit 214 performs B-scan in the range indicated by the control signal input from the output processing unit 222. For the observation target region, for example, the range of a surface of the sample Sm is defined as a parameter.
In addition to the above-described program, the storage unit 230 stores various types of data to be used in processing performed by the control unit 210 and various types of data acquired by the control unit 210. The storage unit 230 includes a non-volatile (non-transitory) storage medium, for example, a read only memory (ROM), a flash memory, a hard disk drive (HDD), or the like. The storage unit 230 includes a volatile storage medium, for example, a random access memory (RAM), a register, or the like.
The input/output unit 240 is connected to other devices wirelessly or by wire to input and output various types of data. The input/output unit 240 includes, for example, an input/output interface. The input/output unit 240 is connected to the polarization diversity detection unit 150 and the photodetector 190, for example. The display unit 250 displays an image based on the output image data input from the control unit 210. The display unit 250 may include, for example, any of a liquid crystal display, an organic electroluminescent display, or the like.
The operation unit 260 may include a member that receives a user operation, for example, a button, a lever, a dial, a mouse, a joystick, or the like, to generate an operation signal in accordance with the received operation. The operation unit 260 outputs the acquired operation signal to the control unit 210. The operation unit 260 may be an input interface that receives an operation signal wirelessly or by wire from other devices (e.g., a mobile device such as a remote controller).
OCT Signal Processing
Next, an example of OCT signal processing according to the present embodiment will be described.
(Step S106) The variance characteristic analysis unit 218 calculates a predetermined temporal variation characteristic value from the change characteristic value calculated by the polarization analysis unit 216 in the predetermined observation period. (Step S108) The image processing unit 220 converts a temporal variation characteristic value for each observation point calculated by the variance characteristic analysis unit 218 into a pixel value of a pixel corresponding to an individual observation point. (Step S110) The image processing unit 220 outputs the output image data indicating the transformed pixel value to the display unit 250 (image display). Thus, the display unit 250 visualizes a distribution of the temporal variation characteristic values in the observation target region, the values indicating the polarization characteristics in the observation target region.
Example of Polarization Characteristic Value and Temporal Variation Characteristic Value
Next, an example of a polarization characteristic value and a temporal variation characteristic value will be described. The polarization analysis unit 216 calculates a phase retardation, for example, as a polarization characteristic value. The phase retardation is the phase difference between an ordinary ray and an extraordinary ray caused by birefringence. That is, ordinary rays and extraordinary rays have polarization directions orthogonal to each other with respect to an optical axis of a sample, and are transmitted through the sample at different speeds. A phase retardation cumulated from a surface to an observation point of interest in the sample in the phase retardation is called a cumulative phase retardation (CPR). The polarization analysis unit 216 calculates a cumulative Jones matrix Jcz for the observation point by multiplying an inverse matrix Jm0−1 of a Jones matrix at a position on a sample surface corresponding to the observation point in a depth z by a measurement Jones matrix Jmz at the observation point in the depth z as shown in formula (3). The cumulative Jones matrix Jcz indicates a change in the polarization state from the sample surface to the observation point in the depth z.
[Math. 3]
J
cz
=J
mz
J
m0
−1 (3)
The polarization analysis unit 216 can calculates a phase difference arg(λc1 λc2*) of two eigenvalues λc1 and λc2 obtained by performing eigendecomposition on the cumulative Jones matrix Jcz as CPRs. Further, arg ( . . . ) indicates a deflection angle of a complex . . . , and ˜* indicates a complex conjugation to a complex ˜.
Further, the polarization analysis unit 216 may calculate a local phase retardation (LPR) that is a polarization phase retardation in a local depth region as another example of a polarization characteristic value. More specifically, the polarization analysis unit 216 calculates a local Jones matrix J112 for the observation points in depths z1 and z2 obtained by multiplying an inverse matrix Jcz1−1 of a cumulative Jones matrix for the observation point in the depth z1 by the cumulative Jones matrix for the observation point in the depth z2 by Jcz2 as shown in formula (4). The local Jones matrix J112 indicates a change in the polarization state from the observation point in the depth z1 to the observation point in the depth z2.
[Math. 4]
J
l12
=J
cz2
J
cz1
−1 (4)
A thickness Δz12 from the observation point in the depth z1 to the observation point in the depth z2 may be, for example, a thickness of a tissue to be observed indicated by an operation signal from the operation unit 260, or a distance between the observation points in the z direction. The polarization analysis unit 216 can calculates a phase difference arg (λ11 λ12*) of two eigenvalues l11 and λ12 of the local Jones matrix J112 as an LPR. Further, the polarization analysis unit 216 may calculate the local Jones matrix J112 for the observation points in the depths z1 and z2 by multiplying an inverse matrix Jmz1−1 of a measurement Jones matrix for the observation point in the depth z1 by a measurement Jones matrix Jmz2 for the observation point in the depth z2.
In addition, the polarization analysis unit 216 may calculate a birefringence b12 at the observation points in depths z1 and z2 by dividing the LPR by 2k0Δz12 as shown in formula (5) as another example of a polarization characteristic value. Where k0 indicates the center wavelength of incident light.
[Math. 5]
b
12
=LPR/2k0Δz12 (5)
The variance characteristic analysis unit 218 calculates the variance of the polarization characteristic value as an example of a temporal variation characteristic value within a predetermined observation period. The calculated temporal variation characteristic value indicates the magnitude of temporal variance of the polarization state indicated by the polarization characteristic value. In formula (6), σ12 (x, z) indicates the variance of an LPR. N, φ(x, z, ti) and <φ(x, z)> indicate the number of frames, an LPR, and a time average of LPRs in a predetermined observation period, respectively. (x, z) indicates coordinates of an observation point in the x-z plane. ti indicates an i-th sample time.
Although formula (6) illustrates the variance of an LPR, the variance characteristic analysis unit 218 may calculate the variance of the CPR or the variance of the birefringence, instead of LPR. The variance characteristic analysis unit 218 may calculate the square roots of these variances as standard deviations.
The variance characteristic analysis unit 218 may calculate the variance or standard deviation of the logarithmic value of the polarization characteristic value as another example of the temporal variation characteristic value. In the course of calculating the variance or standard deviation, the logarithmic value of the time averaged value is subtracted from the logarithmic value of the polarization characteristic value at each time, so the constant that is potentially multiplied by the polarization characteristic value is eliminated. Thus, it may be applied to evaluation of a substantial temporal variation characteristic. In addition, by taking the logarithmic value, it may be applied to a comparison between different phenomena having a large scale. In formula (7), log σ12 (x, z) indicates the variance of the logarithmic value of the LPR.
Although formula (7) takes the variance of the logarithmic value of the LPR as an example, the variance characteristic analysis unit 218 may calculate the variance of the logarithmic value of the CPR or the variance of the logarithmic value of the birefringence, instead of the variance of the logarithmic value of the LPR. The variance characteristic analysis unit 218 may calculate the square roots of these variances as standard deviations.
The variance characteristic analysis unit 218 may calculate, for example, a dynamic contrast of the polarization characteristic value as a temporal variation characteristic value within a predetermined observation period. The dynamic contrast of the polarization characteristic value corresponds to a value normalized by dividing the standard deviation of the polarization characteristic value by the time average. In formula (8), φd indicates a dynamic contrast of an LPR.
Although formula (8) takes a dynamic contrast of an LPR as an example, the variance characteristic analysis unit 218 may calculate a CPR or a dynamic contrast of a birefringence, instead of an LPR. In the course of calculating a dynamic contrast, the standard deviation is normalized with the time average, and thus a dynamic contrast can be applied to the evaluation of the substantial temporal variation characteristic rather than the standard deviation.
Further, the variance characteristic analysis unit 218 may calculate a temporal polarization uniformity (TPU) as another example of the temporal variation characteristic value, A method for calculating a TPU will be described with reference to
The first Stokes vector S1 and the second Stokes vector S2 are 4-dimensional vectors representing the polarization states indicated by the first Jones vector J1 and the second Jones vector J2, respectively, as shown in formula (10), and the vectors include element values of the first Jones vector J1 and the second Jones vector J2, respectively. In the following description, four element values s10 to s13 constituting the first Stokes vector J1 and four element values s20 to s23 constituting the second Stokes vector J2 will be called a zero-th to a third Stokes parameters s10 to s13 and a zero-th to a third Stokes parameters s20 to s23.
As shown in formula (10), the zero-th Stokes parameters s10 and s20 indicate the sum of the powers of horizontal components |g1H|2 and |g2H|2 and the powers of vertical components |g1V|2 and |g2V|2, that is, the intensity of entire light. The first Stokes parameters indicate the difference between the powers of the horizontal components |g1H|2 and |g2H|2 and the powers of the vertical components |g1V|2 and |g2V|2, that is, the difference between the components orthogonal to each other. The second Stokes parameters correspond to twice the real part of the products of complex conjugates of the horizontal and vertical components g1Hg1V* and g2Hg2H*, that is, the value obtained by multiplying the product of the intensity of each of the horizontal components g1H and g2H and the vertical components g1V and g2V, which are |g1H||g1V| and |g2H||g2V|, and the cosine values cos δ1 and cos δ2 of the phase differences δ1 and δ2 of the horizontal components and the vertical components by 2. The third Stokes parameters correspond to twice the imaginary part of the products of the complex conjugates of the horizontal and vertical components g1Hg1V* and g2Hg2V*, that is, the value obtained by multiplying the product of the intensity of each of the horizontal components g1H and g2H and the vertical components g1V and g2V, which are |g1H||g1V| and |g2H||g2V|, and the sine values sin δ1 and sin δ2 of the phase differences δ1 and δ2 of the horizontal components and the vertical components by 2.
The variance characteristic analysis unit 218 calculates time averages <S1> and <S2> in the observation period for each of the first Stokes vector S1 and the second Stokes vector S2, and calculates the sum of the zero-th to the third Stokes parameters that are element values as a zero-th time average <s10+s20>, a first time average <s11+s21>, a second time average <s12+s22>, and a third time average <s13+s23> (step S124 in
Then, the variance characteristic analysis unit 218 determines the value obtained by dividing the square root of the sum of squares of the first time average, the second time average, and the third time average by the zero-th time average as a TPU as shown in formula (11) (step S126 in
[Math. 11]
TPU=√{square root over (<(s11+s21)2>+<(s12+S22)2>+<(s13+s23)2>)}/<|s10+s20|> (11)
Further, the measurement Jones matrix includes a noise component as shown in formula (12). In formula (12), n1H, n1V, n2H, and n2V indicate noise components added to signal components E1H, E1V, E2H, and E2V, respectively.
The polarization analysis unit 216 can compensate for the noise components by subtracting a time mean power of element values of the noise components from a time mean power of element values included in each of the time average <S1> of the first Stokes vector and the time average <S> of the second Stokes vector as shown in formula (13). Here, the variance characteristic analysis unit 218 can calculate a TPU from which the noise components have been removed by substituting the time average <S1> of the first Stokes vector and the time average <S2> of the second Stokes vector before the correction of the noise components with a time average <S1′> of the first Stokes vector and the time average <S2′> of the second Stokes vector for the signal components after the correction of the noise components in formula (11).
In addition, the variance characteristic analysis unit 218 may calculate, for example, a von Neumann entropy of a Jones matrix defined for the observation point as a temporal variation characteristic value within the predetermined observation period. The von Neumann entropy is defined by formula (14). In formula (14), λi indicates an eigenvalue of a Hermitian matrix T (described below), and a normalized eigenvalue is obtained by normalizing the individual eigenvalues λi with the sum of the eigenvalues.
As shown in formula (15), it is known that an expected value E (R) of the LPR is a weighted mean value of Ri that is the LPR of the optical axis corresponding to the individual eigenvalues. A weight factor multiplied by the LPR of individual optical axes at weighted mean is given to the normalized eigenvalue λi′ corresponding to the optical axis. For this reason, the von Neumann entropy of the Jones matrix defined using the normalized eigenvalue can be regarded as a type of a temporal variation characteristic value for a polarization state. Although the von Neumann entropy of the Jones matrix is described in detail in the following documents, in the present embodiment, randomness caused by a temporal variance of the Jones matrix is evaluated as a polarization characteristic value.
Masahiro Yamanari et. al., “Estimation of Jones Matrix, Birefringence and Entropy using Cloude-Pottier Decomposition in Polarization-Sensitive Optical Coherence Tomography,” Biomedical Optics Express, Vol. 7, No. 9, p. 3551-3572, published Sep. 1, 2016. Masahiro Yamanari et. al., “Estimation of Jones Matrix, Birefringence and Entropy using Cloude-Pottier Decomposition in Polarization-Sensitive Optical Coherence Tomography: Erratum,” Biomedical Optics Express, Vol. 7, No. 11, p. 4636-4637, published Nov. 1, 2016.
The polarization analysis unit 216 and the variance characteristic analysis unit 218 can calculate a von Neumann entropy H in the following procedure. First, the polarization analysis unit 216 configures the four-dimensional vectors [g1H g2H g1V g2V]T configured by arranging elements of two rows and two columns of the measurement Jones matrix Jmz for each observation point in order of the rows and columns as a target vector κL. This target vector κL indicates substantially the same value as the measurement Jones matrix Jmz.
The polarization analysis unit 216 calculates a square matrix κLκL+ with four rows and four columns by multiplying the target vector κL by the Hermitian conjugate κL+ of the target vector. The variance characteristic analysis unit 218 determines the time average <κLκL+> of the square matrix κLκL+ within a predetermined period as a matrix T as shown in formula (16). The matrix T is a positive semi-definite Hermitian matrix with four rows and four columns.
In addition, the variance characteristic analysis unit 218 diagonalizes the matrix T, and calculates four eigenvalues λi (i=1 to 4). However, i is an index determined in descending order of the eigenvalues λi. The variance characteristic analysis unit 218 calculates a normalized eigenvalue λi′ by dividing an individual eigenvalue λi by the sum of the four eigenvalues Σj=14λj. The variance characteristic analysis unit 218 can calculate the value obtained by performing positive/negative reversal on the sum of the product of the normalized eigenvalue λi′ and the logarithmic value log (λi′) thereof as a von Neumann entropy H as shown in formula (14). The von Neumann entropy has a value of 0 or more and 1 or less. The von Neumann entropy H has the value 1 for a set of a fully random Jones matrices. However, the base of the logarithmic value in formula (14) is 4.
Further, the variance characteristic analysis unit 218 may determine a von Neumann entropy Hs of a signal component by subtracting a von Neumann entropy Hn of a noise component from a von Neumann entropy Hm determined based on the measurement Jones matrix as shown in formula (17).
[Math. 17]
H
s
=H
m
−H
n (17)
The variance characteristic analysis unit 218 can cause the von Neumann entropy Hn (E1, E2) of the noise component to approximate to the sum of a first noise component entropy H (E1) that is an entropy of a first noise component n1 and a second noise component entropy H (E2) that is an entropy of a second noise component n2 each added to a first Jones vector E1 and a second Jones vector E2 constituting a partial space of the Jones matrix Jmz as shown in formula (18). However, the first noise component n1 and the second noise component n2 are assumed to be independent of each other.
[Math. 18]
H
n(E1,E2)=Hn(E1)+Hn(E2) (18)
The variance characteristic analysis unit 218 can perform positive/negative reversal on the total of a j-th eigenvalue ζj(i) and a logarithmic value log(ζj(i)) of an i-th noise component to calculate an i-th noise component entropy H(Ei) as shown in formula (19).
However, the variance characteristic analysis unit 218 can calculate the value obtained by dividing the value obtained by adding P(i) that is a TPU of an i-th Jones vector to 1 or dividing P(i) by 1 by 2 as a first eigenvalue ζ1(i) and a second eigenvalue ζ2(i) as shown in formula (20).
The variance characteristic analysis unit 218 can calculate P(i) that is a TPU of the i-th Jones vector by dividing the square root of the sum of squares of the time averages of the first to the third Stokes parameters of the first Stokes vector and the second Stokes vector after the correction of the noise components by the time average of a zero-th Stokes parameter as shown in formula (21).
[Math. 21]
P
(i)=√{square root over (<|si1′|>+<|si2′|2>+<|si3′|2>)}/<|si0|> (21)
Calculation Example of Temporal Variation Characteristic Value
Next, an example of calculating the above-mentioned temporal variation characteristic value will be described.
In
As described above, the measurement signal processing device 200 according to the above-described embodiment includes the polarization analysis unit 216 that determines a polarization characteristic value based on polarization characteristics at an observation point in a sample, based on a first measurement signal (e.g., the first horizontally polarized spectral interferometric signal) of a first interferometric component in a first polarization state (e.g., horizontal polarization), the first interferometric component obtained by causing a first incidence component (e.g., a horizontal polarization component) incident on a sample in the first polarization state to interfere with a component obtained by reflection or scattering of the first incidence component from the sample, a second measurement signal (e.g., the second horizontally polarized spectral interferometric signal) in a second polarization state (e.g., vertical polarization) with respect to the first interferometric component, a third measurement signal (e.g., the first vertically polarized spectral interferometric signal) of the first interferometric component in the first polarization state, the first interferometric component being obtained by causing the first incidence component incident on a sample in the first polarization state to interfere with a component obtained by reflection or scattering of a second incidence component (e.g., a vertical polarization component) incident on the sample in a second polarization state from the sample, and a fourth measurement signal (e.g., the second vertically polarized spectral interferometric signal) in the second polarization state with respect to the second interferometric component, and the variance characteristic analysis unit 218 that determines a temporal variation characteristic value indicating a temporal variation characteristic of the polarization characteristic value. With this configuration, a temporal variation characteristic value of a polarization characteristic value for each observation point in the sample is determined. Because the temporal variance of the polarization characteristic value is significantly correlated with an activity of a tissue, the activity of the tissue can be quantitatively evaluated using a distribution of temporal variation characteristic values determined for each of observation points.
Further, the polarization analysis unit 216 may determine a Jones matrix for each observation point based on the first measurement signal, the second measurement signal, the third measurement signal, and the fourth measurement signal, determine a cumulative Jones matrix for an observation point from a Jones matrix for the observation point in the sample and a Jones matrix for a surface of the sample, and determine a CPR that is a phase difference between the eigenvalues of the cumulative Jones matrix as a polarization characteristic value. With this configuration, the temporal variation characteristic value of the CPR corresponding to the phase difference between the polarization components of the surface of the sample and the observation point can be utilized in evaluating the activity of the tissue.
Further, the polarization analysis unit 216 may determine a Jones matrix for each observation point based on the first measurement signal, the second measurement signal, the third measurement signal, and the fourth measurement signal, determine a local Jones matrix for a first observation point and a second observation point from a Jones matrix for the first observation point in the sample and a Jones matrix for the second observation point in the sample, and determine an LPR that is a phase difference between two eigenvalues of the local Jones matrix. With this configuration, the temporal variation characteristic value of the LPR corresponding to the phase difference between the polarization components generated in the section of the first observation point and the second observation point can be utilized in evaluating the activity of the tissue. As a result, the activity of the tissue can be evaluated for each minute region.
Furthermore, the polarization analysis unit 216 may determine a birefringence by dividing a local phase retardation by the wavenumber of incident light incident on the sample and the thickness of the first observation point and the second observation point. Thus, it is possible to evaluate the activity of the tissue for each minute region, and the birefringence may be used to facilitate the comparison of birefringences of other tissues or existing substances to be observed.
The variance characteristic analysis unit 218 may calculate a temporal variation characteristic value based on the variance or standard deviation of the polarization characteristic value. Thus, the magnitude of the temporal variance of the polarization characteristic value can be quantitatively evaluated.
The variance characteristic analysis unit 218 may calculate a temporal variation characteristic value based on the variance or standard deviation of the logarithmic value of the polarization characteristic value. In the course of calculating the variance or standard deviation, the constant potentially multiplied by the polarization characteristic value is erased, and thus the substantial temporal variance of the polarization characteristic value can be evaluated. In addition, by taking the logarithmic value, the comparison of temporal variation characteristic values of the other tissues and existing substances to be observed having different scales becomes easier.
The variance characteristic analysis unit 218 may calculate the dynamic contrast by dividing the standard deviation of the polarization characteristic value by the mean value of birefringences. By dividing by the mean value of the polarization characteristic values, the standard deviation of the polarization characteristic values is normalized, and thus the substantial temporal variance of the polarization characteristic values can be evaluated without changing the scale.
The polarization analysis unit 216 may convert a first Jones vector based on the first measurement signal and the second measurement signal and a second Jones vector based on the third measurement signal and the fourth measurement signal into a first Stokes vector and a second Stokes vector, respectively, as polarization characteristic values, and the variance characteristic analysis unit 218 may determine a TPU based on the time average of the first Stokes vectors and the time average of the second Stokes vectors as a temporal variation characteristic value. According to this configuration, the uniformity of the polarization states at observation points according to the elapse of time can be quantified by using the TPU. The TPU tends to be greater as the activity of a tissue becomes lower. Therefore, an inactive state of a tissue can be quantitatively evaluated using a distribution of TPUs determined for each of observation points.
The variance characteristic analysis unit 218 may determine a TPU based on the time average of the first Stokes vectors after correction of subtracting a noise component from the first Stokes vectors and the time average of the second Stokes vectors after correction of subtracting a noise component from the second Stokes vectors. According to this configuration, the noise components are removed from the first Stokes vector and the second Stokes vector, and the signal component is left. Thus, the influence of noise on the TPU can be suppressed, and the activity of the tissue can be accurately evaluated.
The polarization analysis unit 216 may determine a Jones matrix for each observation point from the first measurement signal, the second measurement signal, the third measurement signal, and the fourth measurement signal as the polarization characteristic value, and the variance characteristic analysis unit 218 may calculate a von Neumann entropy of the Jones matrix as the temporal variation characteristic value. According to this configuration, the randomness of the Jones matrix indicating the polarization state at the observation point can be quantified. Therefore, the activity of the tissue can be quantitatively evaluated using a distribution of the von Neumann entropy determined for each of observation points.
The variance characteristic analysis unit 218 may calculate an entropy of a noise component from a temporal polarization uniformity of the first Stokes vector and a temporal polarization uniformity of the second Stokes vector converted from the first Jones vector based on the first measurement signal and the second measurement signal and the second Jones vector based on the third measurement signal and the fourth measurement signal, respectively, and correct the von Neumann entropy based on the entropy of the noise component. According to this configuration, the contribution of the entropy of the noise component is compensated for by the von Neumann entropy, and the von Neumann entropy of the signal component is obtained. Thus, the influence of noise on the von Neumann entropy can be suppressed, and the activity of the tissue can be accurately evaluated.
The measurement signal processing device 200 may include the image processing unit 220 configured to generate image data having, as a signal value, an output value of a temporal variation characteristic value for each observation point using a function to provide an output value monotonically changing with respect to a change in an input value. According to this configuration, an image having a distribution of luminance or tone corresponding to the temporal variation characteristic value for each observation point is obtained. The measurement signal processing device 200 may include the output processing unit 222 that determines an evaluation value indicating an active state of a biological tissue provided as a sample based on a temporal variation characteristic value. Such an evaluation value may be, for example, a real value that increases as the degree of activity becomes higher. For example, the output processing unit 222 sets a function indicating the relationship between an evaluation value and the temporal variation characteristic value and parameters thereof in advance. The output processing unit 222 may store the evaluation values in the storage unit 230, or may output the values to other devices. The image processing unit 220 may convert the evaluation value calculated for each observation point by the output processing unit 222 into a signal value for each pixel as described above, and generate image data having the converted signal value. As a result, a user can easily evaluate the activity of the tissue in an observation region when he or she sees the obtained image.
Although the embodiments of the present invention have been described above in detail with reference to the drawings, specific configurations are not limited to those described above, and various changes in design or the like may be made within the scope that does not depart from the gist of the present invention.
For example, although the example in which the evaluation device 20 and the measurement signal processing device 200 are a part of the OCT system 1, respectively, in the above description, the invention is not limited thereto. The evaluation device 20 and the measurement signal processing device 200 may be independent from the OCT system 1 and may be a single device not including an optical system. In this case, the optical system control unit 212 may be omitted in the control unit 210 of the measurement signal processing device 200. Likewise, a control means for controlling the optical system may be omitted in the evaluation device 20. The evaluation device 20 and the measurement signal acquisition unit 214 are not limited to the optical system, and may acquire detection signals and measurement signals from other devices such as a data storage device and a PC wirelessly or by wire, for example, via a network. Further, the measurement signal processing device 200 may include any of the input/output unit 240, the display unit 250, and the operation unit 260 as described above, and some or all of them may be omitted. Further, the evaluation device 20 may include any of functional configurations corresponding to the input/output unit 240, the display unit 250, and the operation unit 260, and some or all of them may be omitted. Further, one or both of the image processing unit 220 and the output processing unit 222 may be omitted in the control unit 210 of the measurement signal processing device 200. In a case where the image processing unit 220 is omitted, the control unit 210 may output data indicating a generated temporal variation characteristic value to other devices, such as data storage devices, PCs, or other image processing devices wirelessly or by wire, and may output the data, for example, via a network. Further, the evaluation device 20 may include any of functional configurations corresponding to one or both of the image processing unit 220 and the output processing unit 222, and some or all of them may be omitted. A device serving as an output destination may have a function similar to that of the image processing unit 220, that is, a function of generating the output image data based on the data input from the evaluation device 20 or the measurement signal processing device 200 and displaying an image based on the generated output image data. In the evaluation device 20, a functional configuration corresponding to one or both of the image processing unit 220 and the output processing unit 222 of the measurement signal processing device 200 may be omitted. In addition, a part or all of the evaluation device 20 or the measurement signal processing device 200 according to the embodiments described above may be implemented as an integrated circuit such as a large scale integration (LSI). Each functional block of the evaluation device 20 or the measurement signal processing device 200 may be individually implemented as a processor, or a part or all thereof may be integrated and implemented as a processor. In addition, the method for implementation as an integrated circuit is not limited to LSI, and implementation may be achieved with a dedicated circuit or a general-purpose processor. In addition, if a technology for implementation as an integrated circuit to replace LSI is developed as a result of improvement of semiconductor technology, an integrated circuit according to the technology may be used. Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments and modified examples thereof. In the scope that does not depart from the spirit of the present invention, additions, omission, substitutions, and other changes of the configuration can be made. Furthermore, the present invention is not limited by the foregoing description, and is limited only by the appended claims.
According to the embodiments described above, for example, the invention is highly useful in regenerative medical culture tissue, organoid quality control, animal experiments, pharmaceutical evaluation for measurement of efficacy using cultured tissues, treatment effect evaluation in gene therapy of fundus photoreceptor cells, and the like.
Number | Date | Country | Kind |
---|---|---|---|
2019-207348 | Nov 2019 | JP | national |
2020-070309 | Apr 2020 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2020/042497 | 11/13/2020 | WO |