The present invention relates generally to computerized imaging as may be utilized for locating particular points in an organ and, more particularly with providing an image of a heart and catheter for facilitating placement and manipulation of the catheter for treating atrial fibrillation.
Atrial fibrillation (AFIB) is a leading cause of stroke in human beings and one of the most common heart rhythm disorders. Typically, it involves the occurrence of extra firing of cells in the heart. At the present time, treatments for atrial fibrillation typically include the use of anti-arrhythmic drugs, cardiac surgery, using an external defibrillator, or by radio-frequency (RF) catheter ablation of sites pertaining to the excess firing of cells. Depending on various factors, including the condition of the patient, a selection is made for the most suitable course of treatment. RF ablation in particular has the potential of becoming a therapy of choice, as an alternative to other methods for treating atrial fibrillation.
In order to guide the process of finding the site of origin where the excess firing of cells occur, modem cardiac mapping systems have made it possible to draw the heart as a three-dimensional (3D) model and can provide real-time electrical activation information. Such mapping systems include CARTO XP™, EnSite 3000™ and Constellation™, all of which require special catheters that are much more expensive than normal catheters, in order to provide the position of the pacing catheter accurately. See for example, Savard, P., Sierra, G., LeBlanc, A., Leonard, M., Nadeau, R., “Prototype of a Fluoroscopic Navigation System to Guide Catheter Ablation in Cardiac Arrhythmias, First Experiences”, Proceedings of XXV Conference of The IEEE Engineering in Medicine and Biology Society 2003, 138-142.
More recently, registration of high-resolution 3D atrial computerized tomography (CT) and magnetic resonance (MR) volumes with cardiac mapping systems provides a more realistic picture of patients' heart anatomy and electrical activities, thereby representing a major technological advance in diagnosing complex arrhythmias. See, for example, Sun, Y., Azar, F., Xu, C., Hayam, G., Preiss, A., Rahn, N., Sauer, F., “Registration of High Resolution 3D Atrial Images with Electroanatomical Cardiac Mapping: Evaluation of registration methodology”, SPIE 2005, whereof the disclosure is hereby incorporated herein by reference to the extent it is not incompatible with the present invention.
Newly released software described in the afore-mentioned publication by Sun, Y. et al., nevertheless requires expensive cardiac mapping systems and specialized catheters to provide the 3D position of the catheter for 3D/3D registration and catheter tracking. A 2D/3D intensity-based registration algorithm specialized for the application of radiation therapy is introduced in Wein, W., “Intensity Based Rigid 2D-3D Registration Algorithms for Radiation Therapy”, Master thesis, 2003; registration and other topics are reviewed in this work, whereof the disclosure is hereby incorporated herein by reference to the extent it is not incompatible with the present invention.
The need is herein recognized for a more cost-effective navigation system for the human heart than is provided by existing cardiac mapping systems, without seriously sacrificing their associated 3D visualization capability, in order to meet the demands of an aging population of patients who are more likely to experience severe arrhythmias and whose medical expenses are soaring, even for those who have insurance coverage. The present invention is generally applicable to images obtained by MR and CT imaging systems. Accordingly, the following description sometimes refers to one or the other or both types of images; this should not be construed to limit the description to either. It is also anticipated that the invention will also be useful in conjunction with other analogous imaging systems. Typically, a reference to an image may also be construed to mean an actual image or an equivalent image dataset.
In accordance with an aspect of the invention, a method for imaging for cardiac catheter guidance comprises displaying a two-dimensional (2D) image of a heart, including a catheter; registering and blending the 2D image and a three-dimensional (3D) image of the heart to derive a blended image; displaying the blended image and the 3D image; and extracting an image of the catheter and inserting it into at least one of the blended image and the 3D image.
In accordance with another aspect of the invention, a method for imaging for cardiac catheter guidance, comprises: displaying a two-dimensional (2D) image of a heart; registering the 2D image and a three-dimensional (3D) image of the heart; deriving a blended image by fusion of the 2D image and the 3D image; displaying the blended image; extracting a given feature image from the 2D image; and inserting the feature image into the 3D image.
In accordance with another aspect of the invention, steps of the method are performed under automatic control.
In accordance with another aspect of the invention, the step of deriving a blended image by fusion comprises blending of the 2D image and the 3D image.
In accordance with another aspect of the invention, the step of blending comprises superimposing one of the 3D image and the 2D image over the other.
In accordance with another aspect of the invention, relative weights of the superimposed 3D image and the 2D image are selectable by operator control.
In accordance with another aspect of the invention, the registering comprises utilizing intensity-based registration.
In accordance with another aspect of the invention, the registering comprises utilizing feature-based registration.
In accordance with another aspect of the invention, the step of extracting a given feature image comprises extracting a catheter image.
In accordance with another aspect of the invention, a method for imaging for cardiac catheter guidance, comprises: acquiring a two-dimensional (2D) image of a heart by fluoroscopy; acquiring a three-dimensional (3D) image of the heart by at least one of (a) computerized tomography (CT) imaging and (b) magnetic resonance (MR) imaging; registering the 2D and the 3D images; generating a blended image from the 2D and the 3D images; extracting an image of a catheter from the 2D image; displaying the blended image; and inserting the image of the catheter into at least one of the blended image and the 3D image.
In accordance with another aspect of the invention steps of the method are performed under automatic control.
In accordance with another aspect of the invention a method in accordance with the invention, comprises optionally displaying the 3D image.
In accordance with another aspect of the invention the step of generating the blended image comprises: superimposing the 2D image on top of the 3D image.
In accordance with another aspect of the invention, relative intensities of the 2D image and the 3D image are controllable by a user.
In accordance with another aspect of the invention the step of displaying the blended image and the 3D image comprises: juxtaposing the 3D image and the blended image.
In accordance with another aspect of the invention the step of displaying the blended image and the 3D image comprises: superimposing a further image on the blended image.
For example, this could comprise a surface extraction from the volume image.
In accordance with another aspect of the invention the step of registering comprises utilizing intensity-based registration.
In accordance with another aspect of the invention the step of utilizing intensity-based registration comprises: digitally reconstructing a radiography (DRR) image from volumetric data from the 3D image; and comparing quantitatively the DRR image with the 2D image to derive a rigid transformation relating an isocenter coordinate of the fluoroscopy to that of the 3D image.
In accordance with another aspect of the invention the step of utilizing intensity-based registration comprises: utilizing 2D images from a plurality of views for intensity-based registration so as to increase registration accuracy.
In accordance with another aspect of the invention the step of utilizing intensity-based registration comprises: utilizing 2D images from a plurality of views for intensity-based registration.
In accordance with another aspect of the invention, the step of utilizing intensity-based registration comprises: utilizing 2D images from a plurality of views for intensity-based registration so as to increase registration accuracy with respect to depth estimation.
In accordance with another aspect of the invention, steps are performed under automatic control.
In accordance with another aspect of the invention, the step of utilizing intensity-based registration comprises injecting contrast agent to highlight vessels to improve registration.
In accordance with another aspect of the invention, wherein the step of registering comprises utilizing feature-based registration.
In accordance with another aspect of the invention, the step of utilizing feature-based registration wherein: the step of acquiring a 2D image of a heart by fluoroscopy comprises utilizing a C-arm mounting for the fluoroscopy; selecting landmarks corresponding to respective physical features present in a plurality of 2D images captured from different views corresponding respectively to different respective parameter settings of the C-arm; computing true 3D positions of the physical features by using the parameter settings; identifying landmark points corresponding in volumetric data of the 3D image; and aligning the true 3D positions with corresponding respective landmark points for achieving registration.
In accordance with another aspect of the invention the step of selecting landmarks comprises utilizing the parameter settings including any of angulations, zooming effects, table movements, and similar parameter changes.
In accordance with another aspect of the invention the landmark points comprise at least - 3 pairs of points.
In accordance with another aspect of the invention the landmark points comprise at least one pair of points.
In accordance with another aspect of the invention, registering and fusing the 2D and the 3D images for generating a blended image from the 2D and the 3D images.
In accordance with another aspect of the invention, a method, comprises adding a color component to the 3D image.
In accordance with another aspect of the invention, a method comprises extracting and highlighting edges in the 3D image.
In accordance with another aspect of the invention, a method comprises highlighting the catheter image shown in the 2D image by any of background suppression, edge enhancement filtering, and automatic window-leveling.
In accordance with another aspect of the invention a method for imaging for cardiac catheter guidance, comprises: acquiring a two-dimensional (2D) image of a heart by fluoroscopy including a catheter image; acquiring a dataset for a three-dimensional (3D) image of a heart; registering the 2D and the 3D images; generating a blended image from the 2D and the 3D images after the registering; extracting an image of the catheter; displaying the blended image and the 3D image; and inserting the catheter image into at least one of the blended image and the 3D image.
In accordance with another aspect of the invention a method for imaging for cardiac catheter guidance, comprises: displaying a two-dimensional (2D) image of a heart, including a catheter image; extracting an image of the catheter; deriving a three- dimensional (3D) image of the heart; registering the 2D and 3D images; blending the 2D and 3D images to derive a blended image; displaying the blended image and the 3D image; and inserting the catheter image into the blended image.
In accordance with another aspect of the invention, a system for imaging for cardiac catheter guidance, comprises: a memory device for storing a program and other data; and a processor in communication with the memory device, the processor being operative with the program to perform: acquiring a two-dimensional (2D) image of a heart by fluoroscopy including a catheter; acquiring a three-dimensional (3D) image of the heart by at least one of (a) computerized tomography (CT) imaging and (b) magnetic resonance (MR) imaging; registering the 2D and the 3D images; generating a blended image from the 2D and the 3D images after the registering; extracting an image of the catheter; displaying the blended image and the 3D image in combination; and inserting the image of the catheter into at least one of the blended image and the 3D image.
In accordance with another aspect of the invention, a computer program product comprises a computer useable medium having computer program logic recorded thereon for program code for performing imaging for cardiac catheter guidance, by: acquiring a two-dimensional (2D) image of a heart by fluoroscopy including a catheter; acquiring a three-dimensional (3D) image of the heart by at least one of (a) computerized tomography (CT) imaging and (b) magnetic resonance (MR) imaging; registering the 2D and the 3D images; generating a blended image from the 2D and the 3D images; extracting an image of the catheter; displaying the blended image and the 3D image in combination; and inserting the image of the catheter into at least one of the blended image and the 3D image.
In accordance with another aspect of the invention, system for imaging for cardiac catheter guidance, comprises: memory apparatus for storing a program and other data; and processor apparatus in communication with the memory apparatus, the processor apparatus being operative with the program to perform: acquiring a two-dimensional (2D) image of a heart by fluoroscopy including a catheter; acquiring a three-dimensional (3D) image of the heart by at least one of (a) computerized tomography (CT) imaging and (b) magnetic resonance (MR) imaging; registering the 2D and the 3D images; generating a blended image from the 2D and the 3D images after the registering; extracting an image of the catheter; displaying the blended image and the 3D image in combination; and inserting the image of the catheter into at least one of the blended image and the 3D image.
The invention will be more fully understood from the detailed description which follows, in conjunction with the drawings, in which:
The present invention is concerned with registration and fusion of 3D atrial CT and MR volumes with two-dimensional (2D) fluoroscopic images through automatic 2D/3D registration techniques, involving alignment between a volumetric data set with data of a projected image. Generally, registration is the bringing into spatial alignment of image data originating from different devices and/or that has been obtained at different times. The augmented visualization of highly detailed 3D data can help physicians move the catheter with greater confidence and guide it more precisely to specific areas of the heart responsible for generating the arrhythmia, thereby improving ablation success rates and lowering risks related to the procedure.
Since fluoroscopy is already used by radiologists on a routine basis to guide RF ablation, and an expensive cardiac mapping system together with a specialized catheter are no longer required, the navigation system in accordance with the present invention will help to reduce medical costs and increase the number of ablation procedures that can be carried out in a given facility on a yearly basis. This is especially important for medium-sized community hospitals, for example, that cannot afford to purchase a single conventional mapping system, typically costing in the neighborhood of $400,000.
In accordance with principles of the present invention, automatic 2D/3D registration techniques are applied to fuse high-resolution 3D CT and MR volumes with 2D fluoroscopy for the clinical application of atrial fibrillation (AFIB) catheter ablation. See the afore-mentioned thesis by Wein, W.
It has been demonstrated in the afore-mentioned publication by Sun, Y. et al. that the display of a detailed anatomic 3D volume during catheter ablation enables physicians for the first time to track the movement of the catheter within an exact representation of the patient's heart, allowing for more precise navigation of catheters to targeted points within the heart. The present invention provides a cost-effective alternative to the 3D-3D fusion disclosed in the afore-mentioned publication by Sun, Y. et al. by eliminating the requirement for expensive cardiac mapping systems and specialized catheters. Rather, the 3D volume is registered through 2D/3D registration techniques and fused using a special blending effect with the 2D projected fluoroscopic image to guide the procedure of catheter ablation.
While the foregoing is, in a sense, not a true 3D navigation process because the 3D location of the catheter is not identified, the image of the 3D volume obtained through special rendering techniques reveals important 3D information that can greatly assist physicians in visualizing the location of the invasive medical instruments utilized and in minimizing the number of incisions and trials needed. The system in accordance with the present invention can be regarded as a “2.5-D” navigation system for cost-effective catheter ablation.
The invention will be further described below by way of exemplary embodiments illustrating the best mode known to the present inventors of practicing the invention, in conjunction with the figures.
Three principal components are utilized in an embodiment of the present invention to be described next.
The first component relates to data acquisition, as indicated by boxes 2 and 4 in
A second component relates to 2D/3D registration, as indicated at 6 in
For a second applicable technique, using feature-based registration, landmarks corresponding to the same physical points, such as salient points on pulmonary veins (PV), can be picked on the fluoroscopic images that are captured from different views. The true 3D positions of the physical points picked can then be computed using the parameter settings of the C-Arm for the different views such as angulations, zooming effects, table movements, and so forth. Registration is achieved by aligning the calculated 3D points with the corresponding real 3D points picked on the 3D volumetric data. At least one pair of points is needed to achieve the estimation in translation, and at least three pairs of points are needed if six-parameter rigid-body transformation is required.
The technique using intensity-based registration typically requires less operator involvement and interaction than the technique using feature-based registration and is therefore more adaptable to automatic operation.
A third component relates to 2D/3D Image Fusion. In a broader sense, this represents the fusion of information from a plurality of source images. In the present embodiment, 3D volumetric data is rendered using a volume rendering technique (VRT) and is superimposed on top of 2D fluoroscopy.
Colors can be added to the rendered VRT image for colored display, and edges of the rendered VRT image can be extracted and highlighted. 2D Fluoroscopy: catheters shown in 2D fluoroscopy can be highlighted through background suppression, edge enhancement filtering and automatic window-leveling for enhanced display.
Blending, which in the present embodiment may be considered as part of an overall fusion process is indicated by step 8 in
Both the blended image and the 2D fluoroscopic image are available for display at 12, noting that the blended image inherently contains the 2D fluoroscopic image information. Depending on a user's preferences, the degree of relative brightness between the blended image and the 2D fluoroscopic image being controllable, so that one or the other can be made perceptually dominant. In another option, the 2D fluoroscopic image may be displayed alongside the blended image. An extracted catheter may be superimposed on either or both images.
The resulting 2.5-D navigation system in accordance with the present invention provides a number of benefits for RF ablation procedures, including the following.
It enables the display of the ablation catheter in the context of rendered VRT image, whose special 3D effects, such as color, shading, lighting, etc., provide the physician with a more realistic picture showing the anatomy of the heart, as compared to conventional projected fluoroscopy. This allows physicians to accurately locate, map, and ablate tissue associated with causes of arrhythmia, and hence potentially increases the success rate of AFIB ablation.
Furthermore, the process of finding good working projections is facilitated by viewing the registered 3D CT/MR volume from different angles synchronized by C-arm coordinates with the corresponding physical movement of the C-Arm of the imaging apparatus, so that the C-arm will be in the correct position for the corresponding 2D fluoroscopy without the need for capturing X-rays for recalibration. This will help to reduce the radiation dose to both the patient and the physician.
Another benefit is that the enabling of 3D road mapping of a pacing catheter using the registered VRT image can replace the conventional 2D road mapping using fluoroscopy, which saves contrast injection of the patient when viewing angulations need to be changed.
Also, catheter visualization can be enhanced through both catheter extraction techniques and blending effect with the rendered VRT image from 3D data.
A further important advantage is that a normal catheter, rather than an expensive specialized catheter, can be used for AFIB ablation under the guidance of fluoroscopy and the superimposed 3D volume, thereby reducing the expense of the cardiac mapping system, which yields reduced operational cost and medical expenses
A software prototype was built on Inspace™ to demonstrate the efficacy of 2D/3D registration and fusion articulated. Inspace™ is a Syngo™—based application. (Siemens Universal Software Platform for Medical Imaging). Illustrative figures for the application of the software prototype on AFIB ablation are described below.
While a primary present application of the invention is in the field of AFIB ablation treatment, it is nevertheless contemplated that analogous procedures in other medical interventions or treatments, cardiac and otherwise, may benefit from the utilization and advantages of the present invention.
As will be apparent, the present invention is best intended to be implemented with the use and application of imaging equipment in conjunction with a programmed digital computer.
The invention may be readily implemented, at least in part, in a software memory device and packaged in that form as a software product. This can be in the form of a computer program product comprising a computer useable medium having computer program logic recorded thereon for program code for performing the method of the present invention.
The present invention has also been explained in part by way of examples using illustrative exemplary embodiments. It will be understood that the description by way of exemplary embodiments is not intended to be limiting and that, while the present invention is broadly applicable, it is helpful to also illustrate its principles, without loss of generality, by way of exemplary embodiments.
It will also be understood that various changes and substitutions not necessarily herein explicitly described may be made by one of skill in the art to which it pertains. Such changes and substitutions may be made without departing from the spirit and scope of the invention which is defined by the claims following.
Specific reference is hereby made to copending U.S. Provisional Patent Application No. 60/726,597 (Attorney Docket No. 2005P18854US) filed Oct. 14, 2005, in the names of inventors Rui Liao, Chenyang Xu, Yiyong Sun, and Frank Sauer, and entitled Method and System for Catheter RF ablation Using 2D- 3D Registration, and whereof the disclosure is hereby incorporated herein by reference and whereof the benefit of priority is claimed.
Number | Date | Country | |
---|---|---|---|
60726597 | Oct 2005 | US |