The present application hereby claims priority under 35 U.S.C. §119 on German patent application number DE 10 2006 019 918.9 filed Apr. 28, 2006, the entire contents of which is hereby incorporated herein by reference.
Embodiments of the invention generally relate to a method for the mathematical generation of a virtual catheter in tomographic volume data. For example, they may relate to one in which the virtual catheter is assembled from a multiplicity of catheter segments which can be described in a particularly simple manner and which are in each case approximated to the measured volume data by error calculation and variation of their parameters. In addition, embodiments of the invention also generally relate to a tomography system for carrying out the method and/or a storage medium with program code for the method according to an embodiment of the invention.
Various techniques for vessel segmentation in tomographic volume data are known in the prior art. By way of example, reference is made to the following documents:
[1] O. Wink, W. Niessen, and M. Viergever, “Fast Delineation and Visualization of Vessels in 3-D Angiographic Images”, IEEE Trans. Med. Imag., Vol. 19, No. 4, pages 337-346, April 2000; [2] A. Frangi, W. Niessen, R. Hoogeveen, et al., “Model-based Quantitation of 3-D Magnetic Resonance Angiographic Images”, IEEE Trans. Med. Imag., Vol. 18, No. 10, pages 946-956, October 1999; and Reference [3] to S. Worz and K. Rohr, “A new 3D parametric intensity model for accurate segmentation and quantification of human vessels”, in Proceedings of the Fifth International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI'04), ser. Lecture Notes in Computer Science, Vol. 3216. Saint-Malo, France: Springer-Verlag Berlin Heidelberg, Sep. 26-30, 2004, pages 491-499.
In document [1], the center line of the vessel is approximated by a multiplicity of straight lines joined together. The center lines and the vessel surface are determined iteratively by adapting rays in a plane normal to the running straight center line. The problem in this method is that when the vessel boundaries are not clearly defined, they are easily penetrated and the method proceeds into emptiness.
In document [2], it is proposed to approximate the center line of a vessel by way of an “active contour approach”, wherein a multiplicity of markings must first be set by the operator for this purpose. Once the center line has been adapted, the contour is fitted by an “active surface model”. Since the center line and the vessel lumen are determined in two separate independent steps, the determination of the center line, in particular, is limited in its accuracy. In addition, the user interaction for determining the center line is very high. The precision of adaptation is correspondingly limited.
In document [3], finally, a method is proposed in which a multiplicity of cylinders individually approximated to the vessel lumen are used and joined together. These cylinders have no functional relations to one another and can also replicate curvatures only inadequately.
In at least one embodiment, the invention provides a method for vessel segmentation in tomographic volume data which carries out the segmentation within a short computing time, on the one hand, and with optimum adaptation to the actual contour of the vessels, on the other hand. In at least one embodiment, the invention represents a tomography system for carrying out this method and a storage medium with program code for the method according to at least one embodiment of the invention.
The inventor has found that at least one embodiment of a method for the mathematical generation of a virtual catheter in tomographic volume data is particularly advantageous if the catheter to be generated virtually is composed of a multiplicity of catheter segments each of which can be described separately in a closed mathematical expression and which are in each case approximated to the measured volume data by error calculation and variation of their parameters. In this context, both the center lines and the surfaces of the catheter segments generated should merge into one another.
It is particularly advantageous to use for the reduction of the parameters to be adapted transition criteria between the surfaces and the center lines of the virtual segments which generate smooth transitions. A multiplicity of parameters of the in each case following segment, which should otherwise have to be recalculated for each virtual catheter segment, can thus already be predetermined. The description of the envelope of the segments and of the center line of the segments by second-degree polynomials is particularly suitable for the representation in a mathematically closed form.
Accordingly, in at least one embodiment, the inventor proposes a method for vessel segmentation in tomographic volume data, preferably in CT volume data, comprising the following method steps:
In this context, it may be advantageous if the continuing catheter segments continuously merge into one another at least with respect to their center lines and the center lines of the continuing catheter segments exhibit the same spatial direction at their contact points.
This correspondingly also applies to the envelopes of adjacent catheter segments which advantageously should continuously merge into one another or, in an improved variant, are selected in such a manner that the surface tangents of the envelopes of adjacent catheter segments continuously merge into one another.
These abovementioned criteria ensure not only a natural course of the catheter created virtually but additionally reduce the degrees of freedom of the in each case following catheter segment and thus also the number of freely determinable parameters so that a drastic shortening of the computing time is also advantageously obtained.
For example, the center lines of the catheter segments S(n) can be described by the following formula in the Cartesian system of coordinates:
where n is the index for the consecutive number of the catheter segment, x, y, z are the Cartesian coordinates, t is an arbitrary parameter which increases monotonously with the length of the center line and aij are the parameters to be determined in the polynomials.
The radius of the center line of the catheter segments can also be described by the following formula in the Cartesian system of coordinates:
where n is the consecutive number of the catheter segment, x, y, z are the Cartesian coordinates, t is an arbitrary parameter which increases monotonously with the length of the center line and bi are the parameters to be determined in the polynomials.
According to at least one embodiment of the invention, the mathematical effort is also reduced if, after the first catheter segment is known, the following applies to the parameters of the center line of the (n+1)th catheter segment mentioned thereafter:
where Tn is the last parameter t and x(n)(Tn), y(n)(Tn), z(n)(Tn) are the last coordinates of the center line of the nth catheter segment.
After the first catheter segment is known, the following can similarly apply to the parameters of the radius of the envelope of the (n+1)th catheter segment mentioned thereafter:
b0(n+1)=r(n)(Tn),
where Tn is the last parameter t and r(n)(Tn) is the last radius of the envelope of the nth catheter segment S(n).
It can also be assumed advantageously that, after the first catheter segment is known, the following applies to the parameters of the center line of the (n+1)th catheter segment mentioned thereafter:
and/or that, after the first catheter segment is known, the following applies to the parameter of the radius of the envelope of the (n+1)th catheter segment mentioned thereafter:
Furthermore, the virtual (n+1)th catheter segment S(n) can be optimally adapted in a first step due to the fact that at the end point of the nth and, at the same time, the starting point of the (n+1)th center line, a spherical sector is described with a radius in the progressive direction. The spherical sector is used as “search space” for determining the optimum (n+1)th catheter segment. To adapt the catheter segment to the actual vessel, the catheter segment is selectively swung to and fro within the spherical segment (compare
A further advantageous embodiment of the method according to the invention provides that the following quality function E(aij(n)) is used as a measure of the optimum adaptation of the parameters aij(n) of the virtual nth catheter segment S(n) to the respective vessel section:
E(aij(n))={dot over (E)}Ex+λEIn,
where EEx is also called “external energy” and represents a measure of the quality of the adaptation of the virtual catheter segment to the vessel, EIn is called “internal energy” and represents a measure of the curvature of the virtual catheter segment and λ corresponds to a weighting factor between the “energies”. In this context, smaller “energy” values signify better adaptation to the real vessel.
The measure of the “external energy” EEx can be calculated, for example, by using the following formula:
where Vn is the volume of the nth catheter segment; n is the perpendicular from position ri to the center line (normal vector) (compare
The measure of the “internal energy” EIn can be calculated correspondingly by using the following formula:
with the segment length Sn and the curvature of the center line
where
is the first derivation of c with respect to
is the second derivation of c with respect to t and ∥ ∥i
It is also advantageous that the calculation is continued until a threshold value for the quality of adaptation is reached or until a predetermined total length of the virtual catheter is reached or until a termination signal is received from the operator.
The context of at least one embodiment of the invention also includes a tomography system comprising a computing unit which has at least one stored computer program or program modules which, in one embodiment, wholly or partially executes/execute at least one embodiment of the method described above in operation on the computing unit of the tomography system.
Similarly, at least one embodiment of the invention also includes a storage medium which is integrated into a computing unit or is intended for a computing unit of a tomography system and at least one computer program or program modules is/are stored on it which, in one embodiment, at least partially executes/execute at least one embodiment of the method described above on the computing unit of the tomography system.
In the text which follows, at least one embodiment of the invention will be described in greater detail with reference to an example embodiment with the aid of the figures, wherein only the features necessary for understanding the invention are shown and the following reference symbols are used: 1: CT system; 2: first X-ray tube; 3: first detector; 4: second, optional X-ray tube; 5: second, optional detector; 6: gantry housing; 7: patient; 8: patient table; 9: system axis; 10: control and computing unit; 11: memory; 12: contrast medium pump; 13: ECG line; 14: control and data line; 15: control line of the contrast medium pump;
c(n)(t): center line of the nth segment with the run variable t; ct(t*): tangential vector; d: distance between voxel and center line; K: spherical segment; n: run variable of the catheter segments; {right arrow over (n)}: normal vector; Prg1-Prgn: computer programs; Prgx: selected computer program; P: crossover point in the spherical segment; R: radius; r: voxel position; r(n)(t): radius of the nth segment with the run variable t; S(n): nth catheter segment; t: continuing control variable; t*: parameter; u1: longitudinal axis of the first catheter segment; x,y,z: Cartesian coordinates; θ: aperture angle.
In detail:
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present invention. As used herein, the singular forms “a”, “an”, and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “includes” and/or “including”, when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
Spatially relative terms, such as “beneath”, “below”, “lower”, “above”, “upper”, and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as “below” or “beneath” other elements or features would then be oriented “above” the other elements or features. Thus, term such as “below” can encompass both an orientation of above and below. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein are interpreted accordingly.
Although the terms first, second, etc. may be used herein to describe various elements, components, regions, layers and/or sections, it should be understood that these elements, components, regions, layers and/or sections should not be limited by these terms. These terms are used only to distinguish one element, component, region, layer, or section from another region, layer, or section. Thus, a first element, component, region, layer, or section discussed below could be termed a second element, component, region, layer, or section without departing from the teachings of the present invention.
In describing example embodiments illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the disclosure of this patent specification is not intended to be limited to the specific terminology so selected and it is to be understood that each specific element includes all technical equivalents that operate in a similar manner.
Referencing the drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views, example embodiments of the present patent application are hereafter described. Like numbers refer to like elements throughout. As used herein, the terms “and/or” and “at least one of” include any and all combinations of one or more of the associated listed items.
To determine the spread/extent of diseases of coronary vessels, conventional angiography of the coronary vessels is mostly used wherein a vessel catheter has to be placed for this purpose. This catheterization is an invasive imaging technique in which a catheter is introduced into an arm or a leg of the patient and is guided through the blood vessel system into the coronary vessels under guidance of two-dimensional imaging. At present, such heart catheterization is considered to be the standard method for visualizing blockages, narrowing or abnormalities in the coronary vessels.
The inventor, inspired by the conventional procedure of catheterization, proposes a novel technique for separating blood vessels from volume images by guiding a synthetic catheter model virtually through a three-dimensional image record generated by tomographic recordings of a patient. In the text which follows, an actual variant of an embodiment of the invention is described in detail without restriction of the general applicability of the invention.
An actual catheter model according to an embodiment of the invention includes a tubular generated surface with a center line in the interior. The center line c(t)=(x(t),y(t),z(t)) is described by three spatial coordinates x(t), y(t) and z(t) parameterized in t. The parameter t is a control variable which increases monotonously with the advance on the curve. The generated surface is arranged in such a manner that it has a circular, generally also ellipsoidal cross section. Its distance from the center line is described by the radius r(t) which, like the center line, also depends on the parameter t.
The successive catheter segments are numbered. The nth segment of the center line can then be described by the following formula:
The coefficients ai,j(n), i=1, . . . , 3; j=0, . . . , 2 must be selected in such a manner that the curve segment is assembled flat with the preceding segment, that is to say without discontinuity and with the same direction of tangent, and that it joins the center of the underlying vessel piece as well as possible.
In the same manner, the radius of the nth catheter segment S(n) is described by the formula
In this context, the coefficients bj(n), j=0, . . . , 2 are selected in such a manner that they approximate the genuine vessel surfaces and ensure smooth transitions between the successive surface segments.
Apart from the fact that this model has the appearance of genuine vessels—which normally do not have any discontinuities or sharp edges—the use of the quadratic splines has the advantage that many calculations for approximating the model to the records can be carried out analytically in mathematically closed form. This reduces the necessity of iterative estimations to a minimum and leads to precisely calculable and very time-efficient algorithms.
After each expansion step of the algorithm, the axes of inertia u1, u2, u3 and corresponding Eigen values λ1≧λ2≧λ3 are calculated by determining the tensor of inertia of the current segment volume found. As soon as the segment volume exhibits a noticeable deflection along one of its axes of inertia, for example λ1>>λ2 and λ1>>λ3, the algorithm is stopped. The first catheter segment is then represented as a straight cylinder with the longitudinal axis u1. The two smaller Eigen values 2 and 3 are used for calculating the initial radius. A small arrow in the recording on the bottom right in
Once the nth catheter segment has been adapted to the data, the model automatically elongates itself by an (n+1)th segment. This (n+1)th segment is described by its 12 model parameters ai,j(n+1) and bj(n+1), i=1, . . . , 3; j=0, . . . , 2.
Eight of these parameters only have the purpose of meeting the smoothness criterion of the center line and the surface radius at the transition point between the individual segments. If it is assumed that the parameter t of the nth segment is in the interval [0, Tn], the steadiness condition of the center line and of the surface radius implies that the conditions
apply to the steadiness of the center line and
b0(n+1)=r(n)(Tn)
applies to the steadiness of the surface radius.
From the smoothness conditions at the transition points, the following mathematical rules are obtained:
for the smoothness of the center line and
for the smoothness of the surface radius.
The four parameters a12(n+1), a22(n+1), a32(n+1) and b2(n+1) of the (n+1) model segment are thus the only free parameters of the next segment which are to be determined newly and the values of which are sought with respect to the best possible fit to the vessel considered.
If quadratic splines are used, the above integral can be solved analytically and allows an efficient and precise determination of the arc length. The inverse relation Tn(Sn) must be determined by an iterative numeric approximation as long as there is no analytic inversion of the above formula.
For each given center line configuration, the free model parameter b2(n+1) must be varied for determining the associated optimum segment surface area. This process is iteratively repeated until the best center line and radius configuration for a given crossover point is found. The positions of the crossover points are then determined more closely iteratively in order to obtain the optimum segment model.
The center lines and radius adaptation are carried out for various segment lengths Sn. If the quality function described in the next section is normalized with respect to length, the values can be compared directly for selecting the optimum length of the current segment.
For a given set of model parameters ai,j(n+1) and bj(n+1), i=1, . . . , 3; j=0, . . . , 2, the quality of adaptation to the underlying image is determined by calculating a quality function. The quality function consists of two terms, an external energy and an internal energy. The external energy represents the quality of adaptation of the model to the image data and the internal energy describes the degree of curvature of the segment model.
The external energy is dependent on the fact that the average image intensity of a vessel cross section is typically maximum in the center and rapidly decreases with increasing distance from the center. The decrease in intensity is specified in units of the directional derivative of the image intensity f, which is perpendicular to the center line. With a given point r=(x,y,z) in space, the directional derivative of the intensity f in the direction n=(n1, n2, n3) perpendicular to the center line is defined by
where ∇f({right arrow over (r)})=(fx({right arrow over (r)}),fy({right arrow over (r)}),fz({right arrow over (r)}))T designates the gradient of f at the point r. The model segment is optimum when the directional derivative
averaged over the volume Vn of the catheter segment is minimum.
The directional derivatives are negative when the intensity decreases. The sum runs over all voxels i, the positions ri of which are within the given catheter segment. In contrast to existing approximations which are based on sending out search beams or calculated gradient information only from the vessel surface, the proposed energy term evaluates the information of all voxels within the given catheter segment. The proposed and preferred approximation is thus less sensitive in the case of noise or vessel surfaces in vessels which adjoin other high-contrast objects such as ventricles and bones.
The external energy depends on the center line and on the radius of the tubular surface area and takes into consideration their mutual dependence. The vessel intensity normally decreases rapidly in the vertical direction from the center line, the energy becomes minimum when the center line of the model is aligned on the vessel. The radius is similarly forced to adapt itself to the true vessel thickness. If the radius is greater than the present vessel cross section, the order of magnitude of the direct derivative is small in the periphery. If the sum of the directional derivative is divided by the higher volume, EEx decreases. If the intensity is at a maximum in the center of the cross section, the first derivative in the direction of the normal approaches zero the closer one comes to the center. Thus, too small a surface radius also leads to a smaller energy EEx.
The decisive problem in calculating the above formula is the determination of the amount of voxels located within the present model segment and the calculation of the corresponding normal to the center line. As shown in
<{right arrow over (c)}t(t*),{right arrow over (r)}i−{right arrow over (c)}(t*)>=0,
where the left-hand expression of this equation is the inner product of two vectors.
To solve the above equation with respect to t*, the root of a third-order polynomial must be determined in t which can be calculated analytically in a mathematically closed form, that is to say by directly solving an equation. Depending on the situation, the cubic polynomial either has one real and two complex zero positions or three real zero positions. The parameter t* should be the smallest real zero position located in the interval [0, Tn]. The distance di of voxel ri from the center line is given by the following formula
di=∥{right arrow over (r)}i−{right arrow over (c)}(t*)∥l
The normal vector {right arrow over (n)}i is then defined as
The voxel position ri is within the catheter segment when di≦r(t*).
The inner energy is dependent on the total curvature of the center line of the model. The local curvature κ(t) of the curve c(n)(t) is defined as
where “x” is the cross product between two vectors. The path integral of the squared curvature along the curve defines the so-called energy of the bend. For a straight line, the energy of the bend is zero and the more frequently and greater a curve is bent, the greater it becomes. The inner energy of the catheter segment is here the bowing energy normalized to the arc length of the curve Sn, for example
If quadratic splines are used, the integral can be solved analytically with a closed solvable equation. The inner energy induces a certain stiffness in the catheter model. This prevents extreme curvatures of the model in the regions where the signal-noise ratio of the external energy is low.
The catheter segment is considered to be optimum when the total energy
E(a12(n),a2(n),a32(n),b2(n))=EEx+λEIn
is minimum, wherein λ designates a constant weighting factor which describes the relative influence of the external energy in the total energy. Minimization of the quality function can be interpreted in such a manner that a catheter segment with a rather smooth center line is obtained which fits the underlying vessel data as well as possible. Since the internal and external energy is normalized to the volume and the length of the segment, catheter segments with different volumes and lengths can also be compared.
According to at least one embodiment of the invention, the iterative process of segment adaptation and catheter elongation runs until one of the following events occurs:
if necessary, the operator can modify the last catheter segment—during the process of virtual catheter construction—by drawing with the mouse at the catheter end and can continue the process if desired.
The capability of the virtual catheter to subdivide coronary arteries into individual segments from volume data of a CTA (computer tomography angiography) is shown in
In addition, the operator can also select a subregion of the segmented vessel by two mouse clicks on the starting and end points. Both points can slide interactively along the center line for reaching a particular segment of interest. Similarly, the parameters of volume, bowing energy, average of minimum and maximum radius and average of minimum and maximum HU values can be displayed for the selected vessel section. Furthermore, other clinically relevant parameters can also be derived from the model.
The proposed method according to an embodiment of the invention utilizes the tubular vessel geometry for achieving efficient and rugged segmentation. Clinically relevant parameters such as vessel radius, volume, surface, etc., are given by the adapted model and do not need to be extracted from binary masks. Thus, segmentation of a vessel section of interest can be obtained with a single mouse click. The operator can predefine a particular length of the vessel which is to be segmented. If the catheter is visualized during the calculation, the operator can abort or modify the process, if desired.
The technical/algorithmic progress can be summarized as follows:
As a precaution, it should be noted that the method according to an embodiment of the invention is not restricted to catheter segments having a round cross section but can also be extended to elliptical cross sections in a generalization of the description listed above. By accommodating further parameters, an even better adaptation of the catheter segments to the course and external form of the vessels considered is thus possible, the calculation in closed form still being analytically possible.
It must also be pointed out that the method according to an embodiment of the invention can be carried out not only in conjunction with CT data but also with tomographic MR data. In this context, it is not HU values but other grayscale values or color values of the image representation which are used as criterion of the adaptation.
The CT system 1 is controlled by a control and computing unit 10 via the control and data line 14 wherein the reconstruction, evaluation and segmentation according to the invention of the data measured in the detectors can also be effected on this computing unit with the aid of the programs Prg1 to Prgn stored in an internal memory 11 or on a storage medium. In addition, an optionally usable contrast medium pump 12 with its control line 15 is shown in order to provide for the contrast medium application normally used in cardio or general vessel recordings. Control is effected via the control and computing unit 10. In addition, an ECG line 13 from the patient 7 to the control and computing unit 10 is shown which also handles the operation of an ECG as is necessary in most cases with cardio recordings, for example.
It is additionally also pointed out that within the context of an embodiment of the invention, any type of generation of the recordings, that is to say with or without contrast medium and/or with or without ECG triggering and/or with one or more focus/detector systems, is intended to be contained.
However, the processing of the volume data and/or the performance of the method according to an embodiment of the invention can also be transferred to other computing stations without departing from the context of the invention. It is also understood that the aforementioned features of embodiments of the invention can be used not only in the combination specified in each case but also in other combinations or by themselves without departing from the context of the invention.
Overall, at least one embodiment of the invention thus proposes a method for mathematically generating a virtual catheter in tomographic volume data in which the virtual catheter is assembled from a multiplicity of catheter segments, each of which can be separately described in a closed mathematical expression and which are in each case approximated to the measured volume data by error calculation and variation of their parameters. In particular, transition criteria between the surfaces and the center lines of the virtual segments which create smooth transitions and thus already predetermine a multiplicity of parameters of the segment following in each case are used in order to reduce the parameters to be adapted. The description of the envelope of the segments and of the center line of the segments by means of second-degree polynomials is particularly suitable for representation in a mathematically closed form.
Still further, any one of the above-described and other example features of the present invention may be embodied in the form of an apparatus, method, system, computer program and computer program product. For example, of the aforementioned methods may be embodied in the form of a system or device, including, but not limited to, any of the structure for performing the methodology illustrated in the drawings.
Even further, any of the aforementioned methods may be embodied in the form of a program. The program may be stored on a computer readable media and is adapted to perform any one of the aforementioned methods when run on a computer device (a device including a processor). Thus, the storage medium or computer readable medium, is adapted to store information and is adapted to interact with a data processing facility or computer device to perform the method of any of the above mentioned embodiments.
The storage medium may be a built-in medium installed inside a computer device main body or a removable medium arranged so that it can be separated from the computer device main body. Examples of the built-in medium include, but are not limited to, rewriteable non-volatile memories, such as ROMs and flash memories, and hard disks. Examples of the removable medium include, but are not limited to, optical storage media such as CD-ROMs and DVDS; magneto-optical storage media, such as MOs; magnetism storage media, including but not limited to floppy disks™, cassette tapes, and removable hard disks; media with a built-in rewriteable non-volatile memory, including but not limited to memory cards; and media with a built-in ROM, including but not limited to ROM cassettes; etc. Furthermore, various information regarding stored images, for example, property information, may be stored in any other form, or it may be provided in other ways.
Example embodiments being thus described, it will be obvious that the same may be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the present invention, and all such modifications as would be obvious to one skilled in the art are intended to be included within the scope of the following claims.
Number | Date | Country | Kind |
---|---|---|---|
10 2006 019 918.9 | Apr 2006 | DE | national |