The present invention relates to volumetric image data characterization, and more particularly to a system and method for covariance estimation in the presence of margin-truncation for volumetric characterization.
Object detection and tracking methods have incorporated non-linear optimization techniques for determining objects in image data. The non-linear optimization methods include, for example, the Levenberg-Marquardt method and the Trust-region method. These methods locally approximate a cost function by a quadratic model defined by the Hessian, reducing the problem's complexity. Other methods have employed a series of feature detection methods using scale selection with second derivative functions have been used. In the field of medical imaging, a number of studies exploited eigen values of the Hessian for classifying local structures such as vessels. These methods did not, however, exploit the exact analytical relationship of fully parameterized covariance and Hessian in the context of robust covariance estimation.
Therefore, a need exists for a system and method for covariance estimation in the presence of margin-truncation.
According to an embodiment of the present disclosure, a method for determining a volume of interest in data includes determining fixed-bandwidth estimations of a plurality of analysis bandwidths, wherein the estimation of the fixed-bandwidth comprises, providing an estimate of a mode location of the volume of interest in the data, and determining a covariance of the volume of interest using a local Hessian matrix. The method further includes determining the volume of interest as a most stable fixed-bandwidth estimation across each of the plurality of analysis bandwidths.
The estimate of the mode location is provided manually. Providing the estimate of the mode location comprises determining a mean shift estimation of the volume of interest within each analysis bandwidth.
Determining the covariance further includes determining a scale-space representation at the mode location, determining a scale-space Hessian at the mode location, and determining the covariance of the volume of interest from the scale-space Hessian. The covariance is determined based on a truncated Gaussian fitted to the volume of interest, the truncated Gaussian comprising a plurality of arbitrarily missing tails.
The data is volumetric image data. The volume of interest is determined as a confidence ellipsoid of the fitted Gaussian in the data.
According to an embodiment of the present disclosure, a program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for determining a volume of interest in data. The method includes determining fixed-bandwidth estimations of a plurality of analysis bandwidths, wherein the estimation of the fixed-bandwidth comprises, providing an estimate of a mode location of the volume of interest in the data, and determining a covariance of the volume of interest using a local Hessian matrix. The method further includes determining the volume of interest as a most stable fixed-bandwidth estimation across each of the plurality of analysis bandwidths.
According to an embodiment of the present disclosure, a method for determining a covariance of a volume of interest includes determining a scale-space representation at a given mode location, determining a scale-space Hessian at the given mode location, and determining the covariance of the volume of interest from the scale-space Hessian, wherein the covariance defines a spread of the volume of interest. The covariance is determined based on a truncated Gaussian fitted to the volume of interest, the truncated Gaussian comprising a plurality of arbitrarily missing tails.
Preferred embodiments of the present invention will be described below in more detail, with reference to the accompanying drawings:
FIGS. 4A-F are images of covariance estimates of two-dimensional synthetic Gaussian according to an embodiment of the present disclosure;
According to an embodiment of the present disclosure, a method for characterizing anisotropic spread and orientation of local structures in a d-variate multi-modal non-negative function evaluated in continuous scale-space utilizes a class of blob-like structures that can be locally approximated by a Gaussian-based model. Such blob-like structures appear frequently in practical situations and represent significant objects of interest such as tumors in volumetric medial images and storm locations in radar data to name a few. According to an embodiment of the present disclosure, the mean vector and the covariance matrix of a Gaussian function represents the center-location and the anisotropic spread of the blob-like structure, respectively. Therefore, the covariance estimation with Gaussian model that best fits given local structures provides a direct means for characterization the spread of the local structures.
One difficulty in this scenario is the problem of margin-truncations induced by nearby structures. Margin-truncation may arise when multiple structures are clustered tightly in a data space so that surrounding structures impose estimation bias for the targeted structure. To avoid such bias, a truncated Gaussian whose tails are arbitrarily missing needs to be fitted to the targeted structure.
According to an embodiment of the present disclosure, the margin-truncation problem is resolved by inducing semi-global spread (covariance) information from local curvature (Hessian) information measured at a mode location. Referring to
A robust estimation method is employed based on a continuous scale-space theory to cope with sensitivity to noises in signals and errors in mode estimates 102. Resulting multi-scale analysis framework relates the covariance to the scale-space Hessian 103, a Hessian matrix determined with a signal evaluated in the continuous scale-space. The Hessian realizes robust association between the accurate global spreads and the noise-sensitive curvatures 104. Using a Hessian matrix according to an embodiment of the present disclosure, the robustness of the covariance estimation is improved in the presence of the margin-truncation. Preliminary studies have been conducted to evaluate a method according to an embodiment of the present disclosure.
It is to be understood that the present invention may be implemented in various forms of hardware, software, firmware, special purpose processors, or a combination thereof. In one embodiment, the present invention may be implemented in software as an application program tangibly embodied on a program storage device. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
Referring to
The computer platform 201 also includes an operating system and microinstruction code. The various processes and functions described herein may either be part of the microinstruction code or part of the application program (or a combination thereof), which is executed via the operating system. In addition, various other peripheral devices may be connected to the computer platform such as an additional data storage device and a printing device.
It is to be further understood that, because some of the constituent system components and method steps depicted in the accompanying figures may be implemented in software, the actual connections between the system components (or the process steps) may differ depending upon the manner in which the present invention is programmed. Given the teachings of the present invention provided herein, one of ordinary skill in the related art will be able to contemplate these and similar implementations or configurations of the present invention.
From
Suppose a d-dimensional multi-modal continuous non-negative function f(x) represents an image signal of interest: using the symbol u for describing one of the spatial extrema of f in the sense of image analysis or modes in the sense of density estimation. Suppose that the local region of f around u can be approximated by a product of a d-variate Gaussian function and a positive multiplicative parameter,
where S is a set of data points which belong to the neighborhood u and whose function values are consistent with the structural characteristics of the local data. In practical scenarios this is a reasonable approximation, given an appropriate definition of S. The problem of interest can now be understood as the parametric model fitting and the estimation of the model parameters: mean u, covariance Σ, and amplitude α.
Referring to
F(x;H)=f(x)*Φ(x;0,H). (3)
Referring to
Eq. (4) provides a means for determining the scale-space Hessian directly from the signal f.
Referring to
F(x;H)=α×Φ(x;u,Σ+H), (5)
P(x;H)=α×Φ(x;u,Σ+H)×(Σ+H)−1[(u−x)(u−x)t−(Σ+H)](Σ+H)−1 (6)
Eq. (5) and Eq. (6) collapse into the following forms without the exponential when evaluated at the mode location u,
F(u;H)=α(2π)−d/2|Σ+H|−1/2 (7)
P(u;H)=−α(2π)−d/2|Σ+H|−1/2(Σ+H)−1 (8)
Eq. (8) expresses the relationship of the scale-space Hessian matrix P(u;H) and the covariance matrix Σ of the Gaussian model that locally approximates the function f around u. Recall that P(u;H) can be determined directly from the signal f(x) using Eq. (4). Therefore, transforming Eq. (8) to the form of Σ=g(P) will provide a direct formula of interest. The following analytically derives such function g. Considering a symmetric Schur decomposition of Σ+H and P,
Σ+H=UΛUt, (9)
P=VΓVt,
UUt=VVt=I. (10)
By definition, Σ and H are confined to be symmetric positive definite. P is symmetric negative definite if the mode u is at a stable critical point of −f. Eq. (8) holds when the mode u is at a peak F, not on a saddle point. When P is numerically measured from f, assurances are needed that u satisfies the condition and equivalently that P is negative definite. When these conditions meet, Λ and Γ are diagonal matrices with positive and negative components, respectively. And the orthogonal based U and V become equivalent.
Next, Λ is determined as a function of Γ. Substituting the decompositions Eq. (9) and Eq. (10) into Eq. (8) and assuming U=V yields
Manipulating this equation while maintaining the equality provides,
Combined Eq. (11) with the decompositions Eq. (9) and Eq. (10) results in,
Eq. (12) yields a desirable form of the formula, however it is cumbersome to have the multiplicative factor α as a free parameter to be estimated. The margin-truncation problem also makes direct estimation of an α difficult. Addressing this issue, a solution has been determined that vanishes α. Rewriting Eq. (12) as follows,
where Q is a matrix function that depends only on the scale space Hessian matrix P. Substituting this to Eq. (7) yields,
It can be seen that α is vanished from Eq. (12) by substituting Eq. (15),
Note that F(u;H) can be numerically computed from the signal f using Eq. (3) without imposing much computational burden similar to the case for P. Thus, Eq. (16) gives a result.
Referring to
Eq. (18) gives the extended fixed-bandwidth mean shift vector for f. The mean shift procedure 302 is defined as iterative updates of a data point xi until convergence; yj+1=m(yj;H)+yj given y0=xi. The convergence point ym from a number of starting points defines a mode estimate uk in F(H). The set S, describing the neighborhood of the estimate uk, is given by combining all data points that converge into the same mode. The mode is a center location for the volume of interest, e.g. a tumor.
The D-dimensional spread and orientation of the volume of interest whose center location as a spatial extremum is estimated (see
Turning now to the scale selection criterion, the multi-scale analysis treats H, analysis bandwidth, as a variable parameter. It supposes a set of analysis bandwidth H1, . . . ,HK is given a priori. The estimation is performed independently for each bandwidth Hk 301. The bandwidth that provides the optimal among K estimates is sought by a certain criterion. A stability test can be used as a scale selection criterion. Given a set of estimates {(uk,Σk)}, a form of the Jensen-Shannon divergence (JS(k)) is defined by,
where
and α is a neighborhood parameter. Note that the form of this divergence measurement for two adjacent scales reduces to the Bhattacharyya distance. The most stable estimate across the analysis bandwidth provides a local minimum of the divergence profile. Such an estimate may be treated as a final estimation of the multi-scale analysis 304. The final estimate defines a volume in the scale-space determined to be an object of interest, such as a tumor in medical image data.
Experimental data has been gathered using an embodiment of the present disclosure. A two-dimensional (2D) implementation of an embodiment of the present disclosure is evaluated with a 2D synthetic Gaussian data. In order to investigate its robustness against the margin-truncation problem, test data was symmetrically truncated at its tails along the main axis. The covariance estimates achieved were compared with those by the standard sample estimation method. The covariance estimates were derived for three analysis bandwidth h=1,2,3 where H=hI. The sample estimate is given with the marginal density directly computed form f normalized by the total probability mass.
A three-dimensional (3D) implementation of the covariance estimation according to an embodiment of the present disclosure is incorporated to the multi-scale analysis framework. The implementation was evaluated with the high-resolution computed-tomography (HRCT) images showing lung tumors. Beyond the margin-truncation problem, these data impose the non-Gaussianity effect, with which the data signal deviates largely from the used Gaussian model. Clinically it has been shown that the non- and part-solid nodules, showing high non-Gaussianity, have a higher chance of becoming malignant over time. Thus, it is important that any solution is also robust against this effect.
Having described embodiments for a system and method for covariance estimation in the presence of margin-truncation, it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the invention disclosed which are within the scope and spirit of the invention as defined by the appended claims. Having thus described the invention with the details and particularity required by the patent laws, what is claimed and desired protected by Letters Patent is set forth in the appended claims.
This application claims priority to U.S. Provisional Application Ser. No. 60/508,094, filed on Oct. 2, 2003, which is herein incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
60508094 | Oct 2003 | US |