This disclosure is directed to methods for automatically segmenting aortic cross-sections on computed tomography angiography acquisitions.
The aorta is the largest artery in the body and is the primary conduit of oxygenated blood. An aortic aneurysm (AA) is a permanent and irreversible localized dilation of this vessel, and if left untreated, will gradually expand until rupture, resulting in death in 90% of cases. AAs are the 13th leading cause of death in the United States. Standard procedure assesses the risk of aneurysm rupture based on maximal aortic diameter. Current clinical tools for acquiring these measurements requires a great deal of user interaction and can be quite time consuming.
Treatment for this disorder, such as open repair, runs significant risk including infection, pseudoaneurysm formation, and secondary impotence. Endovascular stent repair is gaining popularity but the long term outcome of this procedure is not yet known and not all AAs are candidates for stents. Therefore, for AAs not thought to be an imminent rupture risk, surveillance is considered preferable to immediate aggressive treatment. This is particularly true in the largest population affected by this disorder, men over 65, since morbidity from other causes may occur prior to rupture.
How to determine the rupture risk of an AA, though, is still an open question. Proposed indicators are manifold: wall stress, wall stiffness, intraluminal thrombus thickness, and wall tension have all been suggested. Standard procedure, however, calls for intervention (open repair or stent) when the maximal diameter is greater than 5.5 cm. The change over time of the maximal diameter has also been put forth as a prognostic measure.
Currently there are two common approaches to aortic diameter measurement. The first involves making linear measurements on a Maximum Intensity Projection (MIP) of the image volume. However, the selection of MIP projection angle may introduce a high degree of subjectivity in this measurement. The second employs a double oblique MPR to obtain a reconstructed image orthogonal to the vessel path on which measurements are made. The drawback of this approach is that it is time consuming and as a result the aorta may be sparsely sampled due to practical limits on the duration of the analysis. In addition, when performed manually, the orthogonal plane may not be correct, introducing error. Reproducing the same orthogonal cross-section position in a longitudinal study may also prove difficult. Finally, the manual measurement made may not be correct as it relies on the user subjectively determining which points are connected to form the maximal diameter.
One approach uses 3D level sets to segment the lumen as well as vessel border. For the vessel border a stopping criterion based on the assumption that the aortic surface is smooth and round is employed. Centerlines are created to compute orthogonal MPRs.
Another approach is an active shape model formulation in which landmarks are defined by correlating with adjacent slices rather than training data. The model is initialized manually and the two-slice model climbs one slice at a time along the aorta. The focus is on the abdominal aorta where the central axis of the vessel is approximately perpendicular to the image stack and thus does not require a centerline calculation, but does require a training set and runs the risk of degeneracy of the modes of variation since the aortic cross-sections are frequently circular.
Another approach is to segment aneurysms in the brain using a Geodesic Active Region Model combined with non-parametric region-based information. In this domain, however, the challenges come in the morphology of the vessel, the brain vascular being more detailed and complex as compared to the aorta, and the issue of thrombi is not addressed.
Exemplary embodiments of the invention as described herein generally include methods and systems for automatically segmenting aortic cross-sections by semi-automatically determining the centerline of the aorta (lumen) and reconstructing a series of images orthogonal to this centerline. The vessel cross-sections are automatically segmented with a modified isoperimetric segmentation algorithm. Due to the challenges introduced by thrombi, calcifications, and the similarity in gray scale between the vessel wall and surrounding structures, segmentations may be user edited. From the edited segmentations a 3D model of the aorta is constructed. Finally, the two image volumes are registered for facilitating follow-up studies.
According to an embodiment of the invention, it is possible to obtain complete coverage of the aorta. It is not unusual for a practicing clinician to be constrained to only a few minutes to examine a study. Using system according to an embodiment of the invention, within seconds the clinician has available a series of optimal, reproducible, orthogonal cross-sections of the entire vessel which may be visually inspected for any irregularities. Further, the user can segment these cross-sections and have the guaranteed maximal diameter automatically computed. With the creation of a 3D model, it becomes possible to evaluate the efficacy of wall stress, wall stiffness, etc., as well as volumetric features. After the 3D model is constructed, stent planning is possible and the stage is set to compute rupture risk indicators such as wall stress (in conjunction with blood pressure readings). Finally, via registration, side by side comparison of the same aorta at different time points becomes straightforward. Since the monitoring of both AAs at risk as well as repaired aortas is commonplace, this feature can be valuable.
According to an aspect of the invention, there is provided a method for automatically analyzing an aortic aneurysm including providing a digitized 3-dimensional image volume of an aorta, wherein said image comprises a plurality of intensities defined on a 3D grid of voxels, determining which voxels in said image are likely to be lumen voxels, determining a distance of said lumen voxels from an aortic boundary, finding a centerline of the aorta in said image volume based on said lumen voxel distances, constructing a series of 2-dimensional multiplanar reformatted (MFR) image planes orthogonal to this centerline, segmenting aortic cross sections in each said MPR image plane wherein an aortic wall is located in each MPR image, and constructing from said aortic wall locations a 3D model of the aorta.
According to a further aspect of the invention, the method comprises providing two input voxels in said aorta to initialize said centerline.
According to a further aspect of the invention, one of said voxels is near the base of the aorta, and the other voxel is near the iliac bifurcation.
According to a further aspect of the invention, determining which voxels are likely to be lumen voxels comprises calculating a histogram using a Gaussian estimator on a distribution of intensities near each input voxel, and thresholding each volume voxel against a likelihood of belonging to the aortic lumen.
According to a further aspect of the invention, finding a centerline of the aorta comprises forming a path between said input voxels from those lumen voxels having a greatest distance from said aortic boundary.
According to a further aspect of the invention, the method comprises smoothing said centerline.
According to a further aspect of the invention, segmenting aortic cross sections in said MPR image planes comprises finding an image partition S,
According to a further aspect of the invention, minimizing said isoperimetric ratio comprises representing said lumen intensities by a Laplacian matrix L whose entries are defined by voxels i, j by representing said lumen intensities by a Laplacian matrix L whose entries are defined by voxels i, j by
wherein eij represents an edge connecting neighboring voxels i,j, w(eij) is a weight for edge eij defined by w(eij)=e−(D
wherein d is a vector of voxel degrees, x is a partition indicator function defined by
U indicates a Laplacian matrix with uniform weights, u represents the vector of degrees for a graph with uniform weights, and γ is a circularity parameter.
According to a further aspect of the invention, minimizing said cost function comprises selecting a node corresponding to the intersection of the centerline with the MPR as a ground voxel, vg, eliminating the row/column corresponding to vg to form a reduced Laplacian and degree vector L0, d0, solving L0x0=d0 for x0 allowing x to take on any real value, and thresholding the partition indicator x at a value that yields a partition corresponding to a lowest isoperimetric ratio.
According to a further aspect of the invention, the method comprises separating lumen and thrombus voxels from background voxels using a K-means method.
According to another aspect of the invention, there is provided a method of automatically analyzing an aortic aneurysm comprising providing a digitized 3-dimensional image volume of an aorta, wherein said image comprises a plurality of intensities defined on a 3D grid of voxels, finding a centerline of the aorta in said image volume, constructing a series of 2-dimensional multiplanar reformatted (MFR) image planes orthogonal to this centerline, separating aortic lumen and thrombus voxels from background voxels using a K-means method, segmenting aortic cross sections in each said MPR image plane by finding an image partition S,
According to a further aspect of the invention finding said aortic centerline includes providing two input voxels in said aorta to initialize said centerline, calculating a histogram using a Gaussian estimator on a distribution of intensities near each input voxel, thresholding each volume voxel against a likelihood of belonging to the aortic lumen wherein luimen vioxels are identified, determining a distance of said lumen voxels from an aortic boundary, and forming a path between said input voxels from those lumen voxels having a greatest distance from said aortic boundary, wherein said path forms a centerline.
According to another aspect of the invention, there is provided a program storage device readable by a computer, tangibly embodying a program of instructions executable by the computer to perform the method steps for automatically analyzing an aortic aneurysm.
FIGS. 1(a)-(c) illustrate successive stages of a segmentation process according to an embodiment of the invention.
Exemplary embodiments of the invention as described herein generally include systems and methods for automatically segmenting aortic cross-sections on computed tomography angiography acquisitions. Accordingly, while the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that there is no intent to limit the invention to the particular forms disclosed, but on the contrary, the invention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.
As used herein, the term “image” refers to multi-dimensional data composed of discrete image elements (e.g., pixels for 2-D images and voxels for 3-D images). The image may be, for example, a medical image of a subject collected by computer tomography, magnetic resonance imaging, ultrasound, or any other medical imaging system known to one of skill in the art. The image may also be provided from non-medical contexts, such as, for example, remote sensing systems, electron microscopy, etc. Although an image can be thought of as a function from R3 to R, the methods of the inventions are not limited to such images, and can be applied, to images of any dimension, e.g. a 2-D picture or a 3-D volume. For a 2- or 3-dimensional image, the domain of the image is typically a 2- or 3-dimensional rectangular array, wherein each pixel or voxel can be addressed with reference to a set of 2 or 3 mutually orthogonal axes. The terms “digital” and “digitized” as used herein will refer to images or volumes, as appropriate, in a digital or digitized format acquired via a digital acquisition system or via conversion from an analog image.
According to an embodiment of the invention, a method for automatically segmenting aortic cross-sections determines the centerline of the aorta (lumen), reconstructing a series of images orthogonal to this centerline, and automatically segments the vessel cross-sections with a modified isoperimetric segmentation algorithm.
The image volume is resampled at step 47 into a series of multi-planar reconstructions (MPRs) normal to the centerline. The intersection of the centerline with these images forms a point in the center of the lumen, the channel part of the aorta. This serves as input to the segmentation of the aortic border.
To determine the maximal aortic diameter, the entire vessel border is segmented. Segmentation of this border, in the presence of thrombus, which is the clotted blood in the aorta, is challenging due to the bimodal distribution of intensities within the aorta (including sharp internal boundaries) and the presence of nearby confounding structures such as the diaphragm, veins and branch vessels.
A segmentation approach according to an embodiment of the invention takes into consideration the following factors: (1) Lumen and thrombus intensities may be estimated; (2) An algorithm capable of cutting weakly-connected confounding structures should be employed; (3) The aortic cross-sections may be assumed to be generally circular; and (4) A point in the lumen from the centerline intersection is available.
To separate lumen and thrombus voxels from background voxels, a K-means algorithm is employed to cluster distinct intensity groups within the image. The K-means algorithm is an algorithm to cluster objects based on attributes into k partitions. It is a variant of the expectation-maximization algorithm in which the goal is to determine the k mean values of data generated from Gaussian distributions. The objective of the algorithm is to minimize total intra-cluster variance, or, the squared error function
where there are k clusters Si, i=1, 2, . . . , k and μi is the centroid or mean point of all the points xjεSi. The algorithm starts by partitioning the input points into k initial sets, either at random or using some heuristic data. It then calculates the mean point, or centroid, of each set. It constructs a new partition by associating each point with the closest centroid. Then the centroids are recalculated for the new clusters, and algorithm repeats by alternate application of these two steps until convergence, which is obtained when the points no longer switch clusters, or alternatively, when the centroids are substantially unchanged.
According to an embodiment of the invention, the isoperimetric segmentation algorithm disclosed in “Isoperimetric Graph Partitioning for Image Segmentation”, Leo Grady and Eric L. Schwartz, IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 28, no. 3, pp. 469-475, March 2006, the contents of which are herein incorporated by reference, is a good candidate, since it takes input as a single point and can correctly cut weakly-connected confounding structures. However, this algorithm does not encourage circularity of the segmentation (on a weighted graph) and therefore requires modification.
The isoperimetric segmentation algorithm is described in terms of graph-theoretic concepts, so a description of these concepts follows. An image can be formulated as a graph G=(V, E) with voxels corresponding to vertices (nodes) vεV and edges eεEV×V. An edge, e, spanning two vertices, vi and vj, is denoted by eij. Let n=|V| and m=|E| where | | denotes cardinality. A weighted graph has a value (typically nonnegative and real) assigned to each edge called a weight. The weight of edge eij, is denoted by w(eij) or wij. The degree of a vertex vi, denoted di, is
An exemplary edge weight is defined as a function of the intensity differences of the two nodes (voxels) spanned by the edge.
The classic isoperimetric problem attempts to find, for a fixed area, the region with a minimum perimeter. More formally, the isoperimetric constant is the minimum of the ratio of the area of a boundary of a region S to its volume over all possible regions S:
Intuitively, a partition is sought that provides a region that is both large and has a small boundary with its surroundings. That is, it cuts weakly connected structures, such as bottlenecks. The boundary of a set, S, is defined as
where
The volume for a graph can be defined as
where di is the vertex degree defined above. In calculating the isoperimetric ratio, regions of uniform intensity are given preference over regions possessing a large number of pixels.
The isoperimetric ratio can be expressed in matrix form. To start, define an indicator vector, x, that takes a binary value at each node:
Note that a specification of x may be considered a partition. Define the n×n matrix, L, of a graph as
The notation Lv
Then, by definition of L, |∂S|=xTLx, and VolS=xTd, where d is the vector of node degrees. Thus, the isoperimetric ratio of a graph G may be rewritten in terms of the indicator vector as
subject to the constraint that the set S has a fixed volume: VolS=xTd=k. Given an indicator vector, x, h(x) represents the isoperimetric ratio associated with the partition specified by x. Segmentation of the aorta wall involves finding a partition S where S⊂V that separates the aortic epithelial layer from the surrounding tissue.
It can be shown that the solution given by the minimization of h(x), above, with uniform incident weights leads to a circle, the classical solution of the isoperimetric problem from which the algorithm was motivated. Therefore, one may combine the above term from the isoperimetric algorithm with a circularity term
where U indicates the Laplacian matrix with uniform weights and u represents the vector of degrees for a graph with uniform weights. This minimization leads to the solution of the standard isoperimetric algorithm with the weights modified by adding a constant γ to all weights. The parameter γ controls the level of circularity enforced on the solution, with γ=0 representing no preference for circles and γ=∞ forcing the solution to be a circle, regarding of the image content. According to an embodiment of the invention, a good balance can be achieved by setting γ=0.03.
The constrained optimization of the isoperimetric ratio is made into a free variation via the introduction of a Lagrange multiplier λ and relaxation of the binary definition of x to take non-negative real values by minimizing the cost function
Q(x)=xTL′x−λ(xTd−k).
Since L′ is positive semi-definite and xTd is nonnegative, Q(x) will be at a minimum for any critical point. Differentiating Q(x) with respect to x and setting to a minimum yields
2L′x=λd.
Thus, finding the x that minimizes Q(x) (minimal partition) reduces to solving a linear system. Henceforth, the scalar multiplier 2 and the scalar λ are dropped, since only the relative values of the solution are significant, and the prime on L will be suppressed.
Unfortunately, the matrix L is singular: all rows and columns sum to zero, so finding a unique solution to (1) requires an additional constraint.
It is assumed that the graph is connected, since the optimal partitions are clearly each connected component if the graph is disconnected (i.e., g(x)=0). Note that in general, a graph with c connected components will correspond to a matrix L with rank (n−c). If one arbitrarily designates a node, vg, to include in S (i.e., fix xg=0), it is reflected in (1) by removing the gth row and column of L, denoted by L0, and the gth row of x and d, denoted by x0 and d0, so that
L0x0=d0, (2)
which is a nonsingular system of equations.
Solving (2) for x0 yields a real-valued solution that may be converted into a partition by setting a threshold. It can be shown that the partition containing the node corresponding to the removed row and column of L must be connected, for any chosen threshold, i.e., the nodes corresponding to x0 values less than the chosen threshold form a connected component.
At step 52, the K-means algorithm is applied to separate the lumen and thrombus voxels from background voxels. An exemplary, non-limiting value of K is 5. The mean corresponding to the lumen intensity is known from the location of the centerline point, and the thrombus mean is selected, by looking for a mean that is nearby to the centerline, but not belonging to the lumen mean. A mean is rejected as not representing a thrombus if the number of voxels belonging to the mean is too small or falls outside a learned range of plausible thrombus intensities.
At step 53, weights (affinities) between neighboring pixels, i and j, are defined by
wij=e−(D
where DL is an estimated lumen distribution, DT is the estimated thrombus distribution, and γ is the circularity defined above, and the L matrix is built from the weights. Note that edges connecting a lumen or thrombus vertex with a non-lumen or non-thrombus vertex are given a low weight.
At step 54, the ground node is chosen as the point on the centerline that intersects with the slice, and the corresponding row and column is eliminated from the Laplacian to determine L0 and d0. The equation L0x0=d0 is solved for x0 at step 55.
At step 56, the potentials x are thresholded at the value that gives partitions corresponding to the lowest isoperimetric ratio. At step 58 the algorithm loops back to repeat steps 51-56 for remaining MPRs. Finally, at step 59, a 3D model of the aorta is constructed from the sequence of segmented MPRs.
The binary definition of x can be extended to the real numbers in order to solve L0x0=d0 in step 55. Therefore, to convert the solution, x, to a partition, step 56 is performed. Conversion of a potential vector to a partition may be accomplished using a threshold. A cut value is a value, α, such that S={vi|xi≦α} and
FIGS. 1(a)-(c) illustrate successive stages of a segmentation process. The left image,
An approach according to an embodiment of the invention was validated on four patients with two image volumes each (Time1 and Time2) acquired six months to 1.5 years apart. Patients were imaged at least twice between February 2002 through December 2005 using 4-slice (Volume Zoom, Siemens Medical Solutions), 16-slice (Sensation 16, Siemens) and/or a 64-slice (Sensation 64, Siemens) CT system. A contrast-enhanced, non-gated spiral examination was typically used to image the thoracic aorta in a single breathhold. Non-overlapping, 3 mm thick slices were reconstructed.
An expert radiologist reformatted the Time1 datasets manually (via double oblique) to obtain cross-sections, and measured aortic diameters manually using virtual calipers at 9 points along the aorta. Both the Time1 and Time2 datasets were loaded into a prototype according to an embodiment of the invention, which registered them and created a centerline. The expert scrolled thru the automatically generated cross-sections to approximately the same points as before and manually measured diameters as well as generating automatic diameters on both time points. An exemplary dataset for one patient is shown in the table depicted in
Referring now to
The average difference between Man X/Man Diam and Auto X/Man Diam for Time 1 over all patients was 0.197+/−0.152 cm. The signed difference was 0.136+/−0.209 cm with the Man X/Man Diam on average larger. This indicates that an automatic centerline method of an embodiment of the invention was on average better at finding the orthogonal image plane to the vessel. The measurement of the vessel diameter is never smaller than in the true orthogonal cross-section. The difference over all image volumes for Auto X\Man Diam and Auto X\Auto Diam was 0.342+/−0.245 cm. Each image required 0.52 edits on average.
An approach according to an embodiment of the invention can yield time savings. On average, it took the expert radiologist approximately 15 minutes to perform the manual double oblique sampling of a single dataset. With a prototype according to an embodiment of the invention, he was able to visually analyze and make measurements on two image acquisitions from the same patient in 10 minutes, and with complete coverage of the aorta.
The points chosen for comparison by the expert radiologist were often located near bifurcations of the aorta. These bifurcation points make it easier to consistently compare the same location when performing a manual analysis but make the automatic segmentation trickier since the segmentation can bleed into the adjoining vessel.
It is to be understood that the present invention can be implemented in various forms of hardware, software, firmware, special purpose processes, or a combination thereof. In one embodiment, the present invention can be implemented in software as an application program tangible embodied on a computer readable program storage device. The application program can be uploaded to, and executed by, a machine comprising any suitable architecture.
The computer system 61 also includes an operating system and micro instruction code. The various processes and functions described herein can either be part of the micro instruction code or part of the application program (or combination thereof) which is executed via the operating system. In addition, various other peripheral devices can be connected to the computer platform such as an additional data storage device and a printing device.
It is to be further understood that, because some of the constituent system components and method steps depicted in the accompanying figures can be implemented in software, the actual connections between the systems components (or the process steps) may differ depending upon the manner in which the present invention is programmed. Given the teachings of the present invention provided herein, one of ordinary skill in the related art will be able to contemplate these and similar implementations or configurations of the present invention.
While the present invention has been described in detail with reference to a preferred embodiment, those skilled in the art will appreciate that various modifications and substitutions can be made thereto without departing from the spirit and scope of the invention as set forth in the appended claims.
This application claims priority from: “Semi-Automatic Aortic Aneurysm Analysis”, U.S. Provisional Application No. 60/793,866 of O'Donnell, et al., filed Apr. 21, 2006, the contents of which are herein incorporated by reference.
Number | Date | Country | |
---|---|---|---|
60793866 | Apr 2006 | US |