Near-infrared spectroscopy tomography reconstruction method based on neural network

Information

  • Patent Grant
  • 12089917
  • Patent Number
    12,089,917
  • Date Filed
    Friday, December 21, 2018
    5 years ago
  • Date Issued
    Tuesday, September 17, 2024
    2 months ago
Abstract
The present disclosure disclose a near-infrared spectroscopy tomography reconstruction method based on neural network which belongs to the field of medical image processing. In the Boltzmann radiation transmission equation, transmission process of light is regarded as absorption and scattering process of photons in medium, and interaction between light and tissue is determined by absorption coefficient, scattering coefficient and phase function of the response scattering distribution. In the transmission, only the particle property of light is taken into account, not the fluctuation of light. Therefore, polarization and interference phenomena related to the fluctuation of light are not considered, and only the energy transmission of light is tracked. The reconstruction method based on BP neural network is used to reconstruct the distribution of optical absorption coefficient, reconstruction results of absorption coefficient distribution can be obtained by calculation. This method can not only reconstruct the absorption coefficient distribution accurately, but also has high computational efficiency.
Description
CROSS-REFERENCE TO RELATED APPLICATION

This application is a national phase application of international application No. PCT/CN2018/122661 filed on Dec. 21, 2018, which in turn claims the priority benefits of Chinese application No. 201810338705.2, filed on Apr. 16, 2018. The contents of these prior applications are hereby incorporated by reference in their entirety.


TECHNICAL FIELD

The present disclosure belongs to the field of medical image processing, especially to a near-infrared spectroscopy tomography reconstruction method based on neural network.


BACKGROUND ART

Near-infrared spectroscopy tomography is a new imaging technique and a non-destructive testing methods all over the world. The application of near-infrared light as an imaging source has attracted extensive attention. The technical principle is: substances such as blood sugar and oxygen vary in different tissues which lead to differences in the absorption coefficient of near infrared lightμa and other optical parameters. Optical parameters, which are used to describe the optical properties of biological tissues, are also related to different physiological states of biological tissues. Based on these characteristics, the measurement of optical characteristics of organisms by near-infrared light can be used for imaging lesions or investigating the relative changes of biological optical parameters and other medical diagnostic items.


Compare with other method such as Computed Tomography, Magnetic Resonance Imaging, and Ultrasound Imaging, Near-infrared spectroscopy tomography has many significant advantages:

    • (1) Short imaging time, high time resolution, fast data acquisition speed.
    • (2) No ionizing radiation, no harm to the body, safe and reliable.
    • (3) Portable and easy to use, low cost, continuous disease monitoring.


Therefore, Near-infrared spectroscopy tomography has a wide range of uses and can be applied to various types of blood oxygen detection, such as brain functional imaging, breast cancer detection, neonatal brain detection, etc. It is also often used in small animal imaging directions.


Due to the boundary measurement data in the actual measurement process is limited and the inevitable mixed noise in measured near-infrared signal, the distribution of optical parameters with multiple finite element nodes should be reconstructed in the end which lead to the reconstruction of near-infrared spectral tomography becomes a discomfort and sickness problem in mathematics. Therefore, how to reconstruct the photoacoustic signal quickly and accurately is the key and difficult point in the study of near-infrared spectral tomography.


In order to solve the above problems, the regularization method is often used in reconstruction to transform the near-infrared image reconstruction problem into a nonlinear optimization problem. However, the ability of traditional methods to suppress artifacts in reconstructed images is weak and the imaging reconstruction time is relatively long. Therefore, the present disclosure considers using neural network to reconstruct near-infrared spectral images.


Artificial neural network (ANN), originated in the 1940s, is a hot topic in the field of artificial intelligence in recent years. It simulates the neural network of human brain, establish some simple model, form different networks according to different connection ways and complete various information processing tasks. BP neural network is the most widely used form of neural network. It was first discovered independently by David Runelhart, Geoffrey Hinton and Ronald w-llians, and David parker in the mid-1980s. It has good nonlinear mapping ability, self-learning ability, adaptive ability, generalization ability and fault-tolerant ability, so it is widely used in function approximation, pattern recognition, classified data compression and other aspects.


SUMMARY

The purpose of the present invention is to propose a near-infrared spectroscopy tomography reconstruction method based on neural network, which can improve the accuracy of the reconstructed image and reduce the imaging time. In order to realize the above purposes, the technical scheme adopted by the invention is:


1. In the Boltzmann radiation transmission equation, transmission process of light is regarded as absorption and scattering process of photons in medium, and interaction between light and tissue is determined by absorption coefficient, scattering coefficient and phase function of the response scattering distribution. In the transmission, only the particle property of light is taken into account, not the fluctuation of light. Therefore, polarization and interference phenomena related to the fluctuation of light are not considered, and only the energy transmission of light is tracked. energy diffusion approximation equation of light in tissue is expressed as:












1
c






Φ


(

r
,
t

)





t



+


μ
a



Φ


(

r
,
t

)



-




·

κ


(
r
)








Φ


(

r
,
t

)





=


q
0



(

r
,
t

)






(
1
)








wherein, c represents the speed at which light travels through the tissue, t represents time, r represents coordinate position vector, κ represents scattering coefficient, μa represents absorption coefficient; Φ(r, t) represents photon fluence rate at position r; q0(r, t) represents light source; the diffusion approximation equation under continuous wave mode is adopted without considering the influence of time on diffusion equation:

−∇·κ(r)∇Φ(r)+μa(r)Φ(r)=q0(r)  (2)

wherein q0(r) represents Isotropic light source; Φ(r) represents photon density distribution at position r;


In bioluminescence tomography, boundary conditions should also be considered in mathematical model. When refractive index of medium inside and outside the boundary is not same, the photon will reflect when it reaches boundary. the boundary condition corresponding to steady-state diffusion equation in near-infrared optical tomography is: air tissue boundary is expressed by exponential mismatch type III condition which is also known as Robin or mixed boundary condition which is expressed as:

Φ(ξ)+2An(ξ){circumflex over (n)}·κ(ξ)∇Φ(ξ)=0  (3)

    • wherein ξ represents point on the outer boundary of tissue; {circumflex over (n)} represents the unit outer normal; An depends on mismatched relative refractive index (RI) between tissue and air and is expressed as:










A
n

=


1
+

R
n



1
-

R
n







(
4
)









    • wherein Rn represents internal reflection coefficient of diffusion transmission; n is related to optical refraction coefficient deviation inside and outside the boundary; based on the distribution of optical parameters, finite element method (FEM) and light approximate transmission equation is adopted to obtain boundary measured value Φ, Φ is used as the input of BP neural network x, then the output y of the network is the corresponding optical parameter distribution.





The structure of BP neural network is shown in FIG. 1.


2. The training of BP neural network is divided into two parts, forward propagation and back propagation; the first is the forward propagation process; set an input layer, a hidden layer and an output layer of BP network, wherein the input layer contain m nodes, the hidden layer contain q nodes and the output layer contain n nodes respectively; the weight between the input layer and the hidden layer is vki, and the weight between the hidden layer and the output layer is wjk; activation functions from the input layer to the hidden layer and from the hidden layer to the output layer are respectively expressed as f1(⋅) and f2(⋅); the output of hidden layer node zk is:











z
k

=




f
1



(




i
=
1

m




v
ki



x
i



)







k

=
1


,
2
,





,
q




(
5
)









    • the output of output layer node yi is:














y
i

=




f
2



(




k
=
1

q




w
jk



z
k



)







j

=
1


,
2
,





,
n




(
6
)









    • the second part is back propagation; firstly, set the mean square error function (MSE) as a loss function; the overall mean square error of m samples can be expressed as:












E
=



1
2






i
=
1

m






j
=
1

n




(


Y
j
i

-

y
j
i


)

2




=




i
=
1

m



E
i







(
7
)









    • the overall error is reduced by using steepest descent method, and the change of weight is expressed as:













Δ






w
jk


=



-
η









E




w
jk




=



-
η











w
jk





(




i
=
1

m



E
i


)


=




i
=
1

m




-
η










E
i





w
jk











(
8
)









    • wherein, η represents learning rate;

    • set the error signal as:













δ
yj

=


-




E
i





S
j




=



-




E
i





y
j




·




y
j





S
j




=




j
=
1

n




(


Y
j
i

-

y
j
i


)




f
2




(

S
j

)










(
9
)









    • wherein Sjk=1qwjkzk, according to the chain theorem, weight adjustment formula of the output layer is:













Δ






w
jk


=




i
=
1

m






j
=
1

n




η


(


Y
j
i

-

y
j
i


)





f
2




(

S
j

)




z
k








(
10
)









    • similarly, the weight adjustment formula of each node in the hidden layer is:













Δ






v
ki


=




i
=
1

m






j
=
1

n




η


(


Y
j
i

-

y
j
i


)





f
2




(

S
j

)




w
jk




f
1




(

S
k

)




x
i








(
11
)







BP neural network updates weight and bias with above formula (5)-(11) until the error meets the requirements or other stopping conditions. The network output is optical absorption coefficient distribution.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is schematic diagram of BP neural network, wherein “x” is input and the dimension is “m”, “y” is output and the dimension is “n”, “z” is output of hidden layer and the dimension is “q”. are “v” and “w” are weights of input layer to hidden layer and hidden layer to output layer respectively.



FIG. 2 is finite element mesh of replica, has a total of 2001 nodes.



FIG. 3 shows the position of light source and detector.



FIG. 4 shows the initial absorption coefficient distribution of the replica, the large black circular area is the background area, and absorption coefficient is set as 0.01, the smaller white area in black area is abnormal area added in background, and its absorption coefficient is set as 0.02.



FIG. 5 is the results of absorption coefficient distribution reconstructed by this method.





PREFERRED EMBODIMENT

The invention is described in detail accompanied with the appended drawings.


First, establish replica and finish the finite element mesh generation through Matlab toolbox nirfast, circular replica is used, and the finite element mesh generation results is shown in FIG. 2. A total of 16 light sources and 16 light detectors are set up in the experiment. These detectors are placed on outer boundary of a circular replica with a diameter of 80 mm as shown in FIG. 3, 256 measurements can be obtained through the light source and detector, and the imaging pixels are 2001 uniform finite element nodes on the circle. The measured value and absorption coefficient of each finite element node are taken as the input and output of BP neural network. Initial absorption coefficient distribution is shown in FIG. 4. The data set used for network training is calculated through forward solving process of nirfast toolbox's. There are 1027 samples in data set, including 927 samples in training set and 100 samples in test set, each sample contains an abnormal region. Each abnormal region is a circular region with a radius of √{square root over (60)}, and the center position of each sample abnormal region is different.


The reconstruction method based on BP neural network is used to reconstruct the distribution of optical absorption coefficient, In the experiment, set the number of iterations epoch=20000, learning rate η=1, node number of hidden layers q=100, anticipation error is 1×10−5, weight and the bias are set between (−1,1). Experimental results show that the above parameters can be used to obtain a better reconstruction effect.


The invention uses a reconstruction method of optical absorption coefficient distribution based on BP neural network. Reconstruction result of absorption coefficient distribution as shown in FIG. 5 can be obtained by this method, the training time is 54 minutes and reconstruction time is 0.066849s. Experimental results show that this method can not only reconstruct the absorption coefficient distribution accurately, but also has high computational efficiency.

Claims
  • 1. A near-infrared spectroscopy tomography reconstruction method based on neural network applied to biological tissue, comprising: an energy diffusion approximation equation (1) of light in the biological tissue is expressed as:
  • 2. The near-infrared spectroscopy tomography reconstruction method based on neural network applied to biological tissue according to claim 1, a training of the BP neural network is divided into two parts, forward propagation and back propagation; the first part is the forward propagation; set an input layer, a hidden layer and an output layer of the BP neural network, wherein the input layer contains m nodes, the hidden layer contains q nodes and the output layer contains n nodes respectively; a weight between the input layer and the hidden layer is vki, and a weight between the hidden layer and the output layer is wjk; activation functions from the input layer to the hidden layer and from the hidden layer to the output layer are respectively expressed as f1(⋅) and f2(⋅); an output of hidden layer node zk is:
Priority Claims (1)
Number Date Country Kind
201810338705.2 Apr 2018 CN national
PCT Information
Filing Document Filing Date Country Kind
PCT/CN2018/122661 12/21/2018 WO
Publishing Document Publishing Date Country Kind
WO2019/200959 10/24/2019 WO A
US Referenced Citations (4)
Number Name Date Kind
11371934 Han Jun 2022 B2
20160097716 Gulati Apr 2016 A1
20220018762 Ekin Jan 2022 A1
20220192524 Leabman Jun 2022 A1
Foreign Referenced Citations (5)
Number Date Country
101342075 Jan 2009 CN
105534606 May 2016 CN
105581779 May 2016 CN
108814550 Nov 2018 CN
2017223560 Dec 2017 WO
Non-Patent Literature Citations (2)
Entry
Li, Ting, “Research on the Fast Reconstruction of OT Based on the Parallel BP Neural Network and Foundation Research on the in vivo Monitoring of Thermal Coagulation of Biological Tissue” Thesis Paper of Nanjing University of Aeronautics and Astronautics the Graduate School College of Automatization; (Dec. 2008) ; English Abstract is at p. 5.
The International Search Report of corresponding International application No. PCT/CN2018/122661, dated Mar. 20, 2019.
Related Publications (1)
Number Date Country
20200196870 A1 Jun 2020 US