The present invention relates to a microwave temperature image reconstruction system. More specifically, the present invention relates to the use of an algorithm which shows itself particularly adapted to temperature image reconstruction.
The large potential of temperature imaging has been recognized for long. For example in the medical community such data is known to potentially improve a variety of diagnostic and interventional procedures. In the case of industrial applications, thermal information has shown to predict and prevent failures of electrical circuits and equipment. One potentially interesting imaging modality for temperature imaging is microwave imaging. Due to several practical drawbacks, microwave imaging has hardly been able to enter the industrial or medical end-user market though. One of these drawbacks lies in the difficult image reconstruction task which contrasts with the rather simple data acquisition process of a potential microwave imaging system.
Non-Destructive Evaluation (NDE) has been one of the engineering disciplines which mostly revolutionized diagnostic techniques in industry and in medicine during the last decades. MR (Magnetic Resonance), CT (Computerized Tomography), US (Ultra-Sound), and other NDE devices are being standard tools for a wide range of diagnostic fields. Furthermore they are currently changing significantly medical surgery, as their capability of visualizing intra-body information enables surgeons to minimize the invasiveness of their interventions. Even though NDE techniques are by themselves expensive, they are potentially even interesting from a financial point of view, as they can significantly decrease the expensive hospitalization time of patients. Similar arguments apply to industrial NDE which was able to bring quality assurance and failure prediction to an impressive performance.
Several NDE modalities are currently being used, including MR, CT, and US imaging. Each of these modalities images a particular physical quantity, such as MR can image proton density, CT images x-ray absorption coefficients, or US visualizes reflection coefficients for ultrasound waves. Therefore each of these modalities has applications for which they are mostly adapted, while being excluded from other applications due to their incapability to image the appropriate physical quantity. As a result, the development of new NDE imaging modalities which are able to image additional physical quantities is a main branch of engineering and fundamental research. One of these quantities, which have been recognized to be particularly valuable for a wide range of medical and industrial applications, is intra-body temperature. Currently, just MR imaging is capable to perform such measurements non-invasively, though being prohibitively expensive for a wide range of promising applications. As an example, cancer development is known to be accompanied with a local temperature increase of 1-2° C. Nevertheless, the temperature resolution and mere cost of MR temperature imaging prohibits its use in the important field of breast cancer detection.
As an alternative to MR temperature imaging, passive microwave temperature monitoring is a promising avenue. Microwave temperature imaging devices are in comparison to MR devices significantly smaller, cheaper, and less complex to implement. Nevertheless, their current research implementations are too premature to be produced and marketed on large scales. One of the main drawbacks lies in the fact that the data collected by microwave imaging devices is very sparse (only around 7 independent measurements) in comparison to the temperature resolution and spatial resolution one would like to obtain for the final temperature profiles. This implies that the image reconstruction is particularly challenging for such devices.
The present invention proposes a solution to this reconstruction problem. It uses “large” over-complete dictionaries which, on the one hand, reflect the variability of potential temperature profiles and, on the other hand, incorporate as much a-priory information as possible in order to provide reliable image reconstruction. Together with state-of-the-art algorithms for data decomposition using over-complete dictionaries, temperature profiles can be reconstructed reliably.
The system according to the invention uses passive microwave imaging for temperature imaging, where “passive” refers to the fact that the imaging system does not emit any radiation into the investigated object. Rather, it senses and measures the natural thermal radiation emitted from this object, which contrasts to active and scattering-based microwave imaging devices.
The above and other objects, features and advantages of the present invention will become apparent from the following description when taken in conjunction with the accompanying drawings which illustrate preferred embodiments of the present invention by way of example.
Passive microwave image reconstruction aims to solve the following equation for the unknown temperature profile, noted T(x):
where i indexes the M measurements of the system at frequencies fi. bi are the passively measured brightness temperatures sensed by the multi-frequency imaging antenna at different frequencies fi, as described in [2, 9]. γi are the antenna efficiencies at frequencies fi, Wi(x) are the spatial weighting functions at frequencies fi, and Ω is the sensing space of the microwave antenna. The spatial variable x may be a 1D, 2D, or 3D spatial vector, depending on the dimension of the reconstruction problem. In the 1D case (just one multi-frequency antenna), the number of measurements M lies at around 5 to 7, i.e. the antenna senses the brightness temperatures bi at 5 to 7 different frequencies fi. Therefore we have just 5 to 7 measurements to recover the whole 1D temperature profile T(x).
The weighting function Wi(x) weights the brightness temperature contributions from different spatial positions x. It therefore accounts for the absorption and scattering process of the temperature dependent thermal radiation from any point inside the investigated body to the passive measurement antenna.
Algorithms currently being used for the microwave image reconstruction of eq. 1 are presented in [1, 2]. Both approaches attempt to counter-balance the problem of having just few radiometric measurements available for the reconstruction, by giving a very restrictive prior on the temperature profile shape one would like to recover. In [1] and in the case of a 1D profile, the profile is assumed to be a single Gaussian:
with T0 being the amplitude of the Gaussian, x0 its position and σ its variance. The reconstruction algorithm determines the parameters, T0, x0 and σ, which explain optimally the measurements bi through eq. 1. The problem with this approach lies in the very strong Gaussian assumption of eq. 2. This assumption is too restrictive to deal with a large number of real world temperature profiles.
A more flexible approach to temperature image reconstruction has been proposed in [2]. There, a small sum of Chebyshev polynomials is assumed to build the temperature profile T(x):
where the hk(x) are the Chebyshev polynomials, and the tk are the respective weighting coefficients. K is the number of polynomials in the sum which is assumed to result in a good approximation of the real temperature profile T(x) by eq. 3. Using eq. 3, eq. 1 can be re-written in matrix form:
b=A·t, Eq. 4
with
This notation leads quite naturally to matrix inversion and Tikhonov regularization as used in [2] to solve the microwave reconstruction problem with Chebychev polynomials or potentially other functions. This approach though has still some important shortcomings which will be illuminated in the following paragraphs, and which motivated the disclosed invention.
Let us shortly assume an example where the Chebychev polynomials of [2] are replaced by 100 B-splines of order 3 (cubic B-splines) at one single scale and covering the whole imaging depth. The sum of eq. 3 with 100 B-splines would be able to represent a very large variety of temperature profiles T(x). In
min∥A·t−b∥+λ·t·tT, Eq. 5
where λ weights the importance of the smoothing constraint when solving eq. 1 for the optimal temperature profile, T(x). On the contrary to eq. 4, eq. 5 is not an ill-posed problem, as long as λ stays sufficiently big. The least-square solution to eq. 4 is written:
t=(AT·A+λ·I)−1·AT·b. Eq. 6
Here, I is the identity matrix. One can see that when λ gets too small and the matrix AT·A is ill-conditioned (which is in general the case for microwave temperature imaging) the inverse in eq. 6 does not exist.
In
The general solution to these problems as disclosed in this invention can be summarized as follows:
In conclusion, the disclosed invention describes a temperature image reconstruction procedure which, on the one hand, is capable to deal with the sparseness of the acquired radiometric data (just around M=7 measurements), and, on the other hand, succeeds in reconstructing a wide range of real-world temperature profiles for real-world medical and industrial applications without artifacts from the regularization term.
As will be shown in more detail in the following paragraphs, the disclosed invention maps the reconstruction problem into a well known formulation of decomposing signals with over-complete dictionaries and uses standard algorithms, such as matching pursuit [3], orthogonal matching pursuit [4], basis pursuit [5], high-resolution matching pursuit [6], etc. to solve the resulting equivalent problem.
The disclosed invention applies equivalently to 1D (profiles), 2D (images), or 3D (volumes) temperature image reconstruction.
The disclosed invention for radiometric temperature image reconstruction has to be implemented on a completely functional microwave temperature imaging device. Several design implementations of such a system are possible, all of which share common characteristics though. In
Microwave image reconstruction aims to solve the following integral equation:
where b(f) is the measured brightness temperature sensed by the passive imaging antenna at frequency f, γf is the antenna efficiency at frequency f, W(f,x) is the spatial weighting function at frequency f, Ω is the sensing space of the microwave antenna, and T(x) is the spatial temperature distribution the reconstruction algorithms aim to recover. The weighting functions W(f,x) might be obtained from a analytical model, as presented in [2] for the 1D case, or by electromagnetic simulations. The spatial variable x may be a 1D, 2D, or 3D vector, depending on the dimension of the reconstruction problem. Eq. 1 is known as a Fredholm equation of the first kind. There are several approaches to solving such equations [7]. In the concrete case of microwave temperature imaging, eq. 7 takes a slightly different form though. This is due to the fact that the brightness temperatures b(f) can practically only be measured at a very restricted number of discrete frequencies, noted fi, i=1, 2, . . . , M, with M around 5 to 7 for the 1D case. This small number of measurements, referred to as sparse data, stands in contrast to the resolution of the temperature profile T(x) one aims to obtain. Therefore, it is practically impossible to discretize T(x) to T(xj), j=1, 2, . . . , P, where the xj are the pixel coordinates, in order to find the matrix expression of eq. 1 as b=W·t, and using standard quadrature theory for the solution of eq. 1, such as presented in [8]. This is because in the simplest 1D case, the number P would have already to lie at around 256 or 512 (number of pixels along the 1D profile) in order to reach a practically valuable resolution for the temperature profile T(x). In other words, the matrix formulation would result in a system of only 5 to 7 linear equations with 256 or 512 unknowns T(xj). Obviously this is a rather hard, if not impossible task to be done reliably, and in the case of a 2D or even 3D reconstruction, this problem would be become even harder.
Alternatively, and in contrast to the classical approach to solving Fredholm equations of the first kind, we reformulate eq. 7 in a semi-discrete fashion as follows:
where i indexes the M discrete measurement frequencies fi of the system. This formally quite simple change in problem formulation gives the possibility to solve the described image reconstruction problem for microwave radiometry in an attractive way, in particular for cases where the number M of equations in eq. 8 is small in comparison to the resolution one would like to obtain for the temperature profile T(x). In the following this approach is described in detail.
Intuitively, in order to solve eq. 8 for the unknown function T(x), one has to attempt to find a representation for the space of possible temperature profiles T(x), which has to be entirely determined by not much more than the number M of frequencies at which measurements are being carried out, while reflecting the large variability we might find in real-world temperature profiles. In addition, we have to propose algorithms which determine the optimal fit, i.e. the most probable function T(x) for the given measurements bi. The disclosed reconstruction procedure exactly presents a general approach to solve such a problem for microwave radiometry. In general, the disclosed approach to solve eq. 8 for T(x) can be structured into the following two steps:
The next paragraphs describe these two general steps in more detail.
Theoretically, any set of functions of L2 would be admissible to span the reconstruction subspace of L2, noted ΩD, and therefore constitute the basis set, D. Practically though, any prior information about the temperature profile T(x) that can be incorporated into the chosen function set D should be employed in order to be able to implement an efficient and precise reconstruction algorithm. Furthermore, the basis set should be constructed, so that for any real-world temperature profile T(x) just a small subset of N basis functions from the potentially very large set of K basis functions (small in the sense of N<<K) is able to reconstruct T(x). Mathematically this means that real-world temperature profiles T(x) should have sparse representations in the space ΩD.
Once the function set D has been constructed, one has still to implement an algorithm which is able to determine the small set of N basis functions from the initial over-complete dictionary of K functions, and its associated non-zero weights tk which reconstruct an estimate of the unknown temperature profile T(x):
with just N<<K non-zero coefficients tk. In other words, this algorithms has to determine the set of coefficients {tk} from the sets of coefficients {tk,i}, i=1, 2, . . . , L of equation 9 for which most coefficients are zero.
In mathematical terms, we need an algorithm which determines a sparse representation of the temperature profile T(x) characterized by the set of measurements bi within the subspace ΩD of L2, spanned by the set of functions D. In the next paragraph such algorithms are shown
The initial reconstruction problem of eq. 7 can be rewritten, using the reconstruction approach described in the previous paragraph. Introducing eq. 11 into eq. 8, we get:
This problem formulation can also be written in matrix form as:
b=A·t, Eq. 13
with
The size of the matrix A is given by the number of measurements M of the system, and by the number of functions K in the over-complete set D. The number of rows is therefore M, while the number of columns is K.
Eqs. 12 and 13 allow reinterpreting the temperature image reconstruction in a way which gives direct access to a large range of algorithms perfectly adapted to the problem of finding the optimal weighting coefficients tk for the profile reconstruction through eq. 10. In fact, eq. 14 can be seen as a transformation F, which transforms the space ΩD spanned by the basis functions of the set D onto a subspace of RN (the vector space of N-dimensional vectors of real numbers), denoted ΩR:
The resulting subspace ΩR of RN can be seen as a vector space spanned by the vectors {ak} which are just the rows in the matrix A of eq. 13. As a last step, we normalize the vectors ak and therefore the rows of A and reformulate the temperature profile reconstruction of eq. 14 accordingly:
The symbol ∥ak∥ stands for the classical vector norm of RN defined by
Eq. 16 is the reformulation of the initial temperature profile reconstruction, characterized by eq. 7, as standard sparse data decomposition using over-complete dictionaries. Solving eq. 17 for a sparse representation aims to determine the few non-zero expansion coefficients t′k, which result in a good approximation of b. Matching pursuit [3], orthogonal matching pursuit [4], basis pursuit [5], high-resolution matching pursuit [6], etc. are known algorithms for this task. Once this decomposition of b has been determined, the one-to-one correspondence of eq. 15 between the over-complete set of base vectors {a′k} of ΩR and the over-complete set of basis functions {hk(x)} of ΩD enables the temperature profile reconstruction through eq. 10:
In
In the notational context of the previous paragraphs, general sparse decomposition using over-complete dictionaries tries to solve the following equation:
min|t′∥0, subject to b=A′·t′, Eq. 18
where ∥.∥0 denotes the l0-norm. The minimization of the l0-norm results in searching for a sparse representation, as the l0-norm counts the non-zero expansion coefficients t′k in the expansion and tries to minimize their number N under the constrained that the data term is valid. Unfortunately, this problem can only be solved in a combinatorial way, and is therefore computationally very expensive. Therefore one approach consists of replacing the l0-norm with a l1-norm:
min∥t′∥1, subject to b=A′·t′. Eq. 19
where ∥.∥1 denotes the l1-norm. The fact of minimizing the l1-norm of t′ results in searching for a sparse representation, i.e. just few expansion coefficients t′k have significant magnitude. On the contrary to eq. 18, this problem can be solved with linear programming [5]. Interior point methods or simplex methods [13, 14, 15] can be used to solve eq. 19. Matlab's Optimization Toolbox [12, 15] has standard implementations of these algorithms which are perfectly suited to solve eq. 19.
A similar approach as basis pursuit is called basis pursuit denoising. It solves the following equation:
min|b−A′·t′∥2+λt′λ1, Eq. 20
where λ is a weighting coefficient, weighting the importance of the regularization term based on the l1-norm of the decomposition coefficients t′k, and ∥.∥2 denotes the l2-norm. The l1-norm component of the minimization problem results in searching for a sparse representation of the initial reconstruction problem. This formulation of sparse data decomposition using over-complete dictionaries can use quadratic programming [16, 17]. Again, this is computationally much more efficient than trying to solve eq. 18, and as for eq. 19, there is a standard implementation of quadratic optimization in Matlab's Optimization Toolbox [12].
As mentioned, a large number of further known algorithms exist, which can be applied to the presented invention, i.e. to sparse microwave temperature image reconstruction using over-complete dictionaries. A complete overview of these algorithms would go beyond the scope of this text though. Common to all these algorithms is there localization within a concrete system design which would implement the disclosed invention, as was outlined in
It has to be noted that Thikonov regularization as presented in [2] is not part of the presented class of algorithms, as it does not search for a sparse solution of the inversion problem. This is shown in
As mentioned, the described reconstruction approach is applicable to 1D, 2D, or 3D reconstruction. The example implementations presented herein are in the context of the reconstruction of 1D temperature profiles for medical applications. Several medical applications could potentially take important profit from an easy-to-use and relatively cheap temperature measuring system. For example, thermal tumor ablation is a medical procedure for cancer treatment whose success is directly related to the exact control of the intra-body temperature distribution. During a thermal tumor ablation treatment, thin needles are introduced percutaneously until their tips reach inside the tumor volume. At the tips, radio-frequency heats the tumor tissue up to a temperature guaranteeing cell death. In this procedure, two characteristics are fundamental for the success of the treatment: On the one hand, all the cancerous tissue has to be killed, and on the other hand, as few healthy tissue as possible should be ablated. As in such a treatment, the killing of the body cells is directly related to reaching or not reaching a particular temperature threshold, the specific system implementation presented herein can significantly improve the security and reliability of the medical treatment plan through real-time monitoring of the internal temperature distribution.
Tumor detection is mentioned as a second field of medical application for the presented system implementation. It employs the fact that tumor cells manifest themselves through a small local temperature increase of 1-2° C. Therefore, the temperature monitoring capability of the presented system allows the medical doctor to use temperature as an additional manifestation of cancerous cells during cancer screening.
Any concrete implementation of a microwave temperature imaging device has to contain a certain set of functional building blocks. These building blocks were sketched schematically in
Both systems comprise one single (1D temperature profile) multi-frequency spiral microwave antenna 1 as disclosed by Jacobsen and Stauffer in [9]. The employed antenna operates at 7 frequencies in the range of 0.5 to 3.75 GHz. The signal sensed by the antenna passes through an analogue connection 6 to a Dicke null-balancing radiometer 7, as described by Jacobsen and al. in [10]. The Dicke radiometer detects sequentially the signal contributions at the different frequencies of the multi-frequency antenna of the system. The resulting sequential analogue signals from the radiometer are directly related to the brightness temperatures at the corresponding frequencies, and these brightness temperatures are directly related to the real intra-body temperature distribution through eq. 8. In order to reconstruct a one dimensional profile of intra-body temperatures from the brightness temperatures, the reconstruction procedure disclosed herein is getting applied to the brightness temperatures, i.e. to the outputs from the analogue-to-digital converter 3, 10, 15.
As mentioned in the general description, any specific reconstruction implementation needs to specify two aspects: first, the over-complete set of basis functions {hk(x)} has to be specified, and second, the optimization algorithm has to be chosen. It is important to note that in the present context of 1D temperature profile reconstruction, the spatial variable x parameterizes just a 1D space Ω, i.e. is represented by one-component vectors. The size of the imaging space Ω is given by the maximal sensing depth dmax of the microwave antenna, such as e.g. 10 cm for the cases presented herein.
In real-world medical applications for microwave temperature monitoring, such as cancer detection or thermal tumor ablation monitoring, bell-shaped temperature distributions can be expected. Therefore, we propose to use 1D B-splines at different scales and positions to build up the over-complete set D of K basis functions.
Herein, B-splines of order Nd=3 (cubic B-splines) and at Ns=30 consecutive scales are used to build the over-complete set D of base functions. The overcompleteness of D arises from the different scales of the B-splines. At the lowest scale, 4 B-splines cover the whole reconstruction space Ω, while at each higher scale, one spline is added. Therefore, at each scale s, Np(s)=s+4 B-splines at different positions are added to the set D, and the whole over-complete set of basis functions can be parameterized as:
D={h
k(x)}={βs,p(s)N
s=0, 1, . . . , 29,
p(s)=1, 2, . . . , s+4.
with
In
Therefore in the present case, we have |D|K=555. In accordance with the disclosed reconstruction procedure, we have to transform the base functions of D by the transformation given in eq. 15. In order to be able to do this, we need to specify the explicit weighting functions characterizing the used antenna. In the case of 1D reconstruction, an analytic model of the weighting function is given in [2]:
where the parameters di are called the antenna sensing depths at frequencies fi. For the employed spiral antenna and the chosen frequencies, the sensing depths lie at {0.9 cm, 1.2 cm, 1.5 cm, 1.8 cm, 2.1 cm, 2.4 cm, and 2.7 cm}. For this weighting function and for the chosen B-spline basis functions, an analytical solution for the transformation integral of eq. 15 exists, which can be determined easily using the following recursive formula:
This equation can be verified easily using partial integration, or it can be found in mathematical reference books such as in [23]. Therefore the vectors {ak′} can be calculated analytically. If the transformation integral of eq. 15 cannot be solved analytically because the weighting functions Wi(x) have a more complex form than given in eq. 24, or because electromagnetic simulations have been used to obtain a discrete model of these weighting functions, numerical integration has to be employed.
The reconstruction process can formally be summarized for the sample implementations presented in this section as follows:
b=A′·t′, Eq. 26
where b is the vector whose components are the measured brightness temperatures at the 7 frequencies. The matrix A′ is constituted of K=555 normalized vector columns with 7 components each, noted ak′, and t′ are the K=555 expansion coefficients one likes to recover. Therefore, eq. 14 becomes explicitely:
Two concrete algorithms to solve eq. 26 for a sparse solution (just N<<K components of t′ are non-zero) of the unknowns t′ are presented in the context of two concrete sample implementations in the following two sections. Once the parameters t′ have been determined, the temperature profile T(x) is calculated as
The resulting reconstructed temperature profile T(x) is finally visualized on a computer screen 5 for visual inspection by the medical doctor or industrial investigator.
In the next two sections, the implementation specific aspects of the presented sample implementations will be presented.
The sample implementation outlined in
min∥t′∥1, subject to b=A′·t′. Eq. 29
The resulting solution vector t′ represents the expansion coefficients to be used for the temperature profile estimation by eq. 28.
In
The system according to
For the embedded sample implementation as outlined in
The reconstruction algorithm implemented on the embedded C6713 Compact device 11 from Orsys [21], calculates the matrix A′ through the mathematical expression given in eq. 27. The FOCUSS algorithm detailed in [18] is used to determine the expansion coefficients t′ for the reconstruction of the temperature profile T(x) through eq. 28. This algorithm solves the following expression iteratively as described in
min∥b−A′·t′∥2+λ∥t′∥1. Eq. 30
Eq. 30 represents the so-called “basis pursuit de-noising” approach to data decomposition using over-complete dictionaries. In
Number | Date | Country | Kind |
---|---|---|---|
05405418.4 | Jun 2005 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB2006/052129 | 6/27/2006 | WO | 00 | 12/28/2007 |