The present invention relates to an apparatus and method for calibration, tracking and volume construction data for use in image-guided procedures, and more particularly, to an apparatus and method for calibration, tracking and volume construction data for use in image-guided procedures within the context of anatomical imaging.
The majority of the background work was performed using an Endorectal ultrasound probe. However, this work is also applicable in other anatomical areas of interest using both flexible and rigid ultrasound probes. These areas include the colon, esophagus, pancreas, duodenum, liver, breast, kidney, heart, prostate, and any other part of the body that can be imaged by ultrasound. The following detailed description describes embodiments of the present invention as used for the rectum.
Rectal cancer is a growing problem in the world today, and it has been estimated that 42,000 new cases will be diagnosed in the United States in 2003. The annual rate has been growing and the percentage of cases in which rectal cancer is determined to be the primary cause of death has increased. In 1999 there were only 34,700 estimated cases, but in approximately 20% of these cases cancer was determined to be the primary cause of death for the patient. It is expected that approximately 7,000 more cases will be diagnosed in 2003 as compared to 1999, with this number growing at a rate of approximately 1000-3000 cases per year.
Rectal cancer generally comprises cancer cells found living in the tissues of the rectum. Most rectal cancers are sporadic; even hereditary diseases such as familial adenomatous polyposis (FAP), begin with a spontaneous mutation in the tumor suppressor gene, adenomatous polyposis coli (APC) that causes it to become inactivated. Since the APC gene helps to regulate the growth of new cells (i.e., it is a tumor suppressor gene), the inactivation of it disrupts the natural balance found in healthy tissue and allows the over production of potentially malignant tissue. This inactivation also causes the hypomethylation of DNA, which may lead to k-ras activation. K-ras is an oncogene which, when permanently activated, causes uncontrollable growth of cells. If the activation of K-ras is coupled with the inactivation of the APC gene, the opportunity for the uncontrollable growth of new tissue is even greater.
Most new colorectal growths, or neoplasms, do not begin as malignant tumors. Most new growths in the rectum begin as adenomas or adenomatous polyps. An adenoma is a benign neoplasm of glandular epithelium. There are two types of glandular features by which adenomas are classified, namely, villous and tubular. Villous adenomas are flat and found in the rectum more often than tubular; they also are at increased risk of becoming malignant. Tubular adenomas tend to be on a stalk and found in the colon or rectum. The malignant tissues formed from adenomas are called carcinomas, giving rise to the name adenocarcinoma (a malignant tumor arising from an adenoma). In rectal cancer, most adenocarcinomas originate from polyps, but not all polyps found in the rectum are adenomas. The rate at which polyps transform to cancer is related to size and type (tubular vs. villous) and is reported to be between about 2 and 9.3 percent. Because of the risk of malignant transformation, polyp removal prior to cancerous transformation is the best clinical option.
Hereditary nonpolyposis colorectal cancer (HNPCC) is an inherited disease of importance that causes rectal cancer. HNPCC is caused by a mutation in one of the genes that codes for DNA repair. The following is a list of the genes can be altered causing HNPCC: hMSH2, hMLH1, hPMS1 and HPMS2. When this mutated gene does not reconstruct the DNA in the correct sequence, errors occur that can lead to cancerous growth. This disease presents itself at an earlier age, and the tumors tend to be villous. The Amsterdam Criteria was defined in 1991 for research purposes and is a way to classify a tumors as HPNCC. Surgeons continue to apply the criteria to clinical cases, and therefore, it has become important in colorectal cancer diagnosis. The criteria tell physicians to consider HNPCC when (i) three family members have colon cancer, (ii) two generations of the family have colon cancer, and (iii) at least one individual was diagnosed with the disease before the age of 50. However, these criteria do not work well in a population-based examination for colon cancer because up to 2% of non-hereditary colon cancer patients meet them. There are also other types of malignant rectal tumors, including endocrine tumors (carcinoids) and Kaposi sarcomas, that will not be the focus of this thesis.
Besides being an inheritable disease, many studies have shown that dietary factors can influence the onset of sporadic rectal cancer. It is a common belief that there are also other risk factors such as (i) a large, daily caloric intake, (ii) a large percentage of dietary fat, (iii) being obese, (iv) an inadequate fiber intake, and (v) a low percentage of fresh fruits and vegetables. There have not been enough conclusive epidemiological studies to determine a percent intake of dietary fat that causes cancer or percent intake of fiber that might be protective. It is also not known how the combination of a high fat/low fiber diet compares in the rate of rectal cancer occurrence to the combinations of high fat/high fiber or low fat/low fiber diets. Whatever the future research may show, there are a few conclusions that can be drawn from the work that has already done and the observations that have already been made. The most obvious conclusion is that especially for those people in high-risk families for rectal cancer, a controlled diet that is low in fat and high in fiber, fruits, and vegetables has a chance of decreasing the probability of developing polyps and hopefully rectal cancer.
The rectum begins at the lower end of the colon when the longitudinal bands of muscle (Taenia) surrounding the colon coalesce. It continues for approximately 15 cm until it narrows and forms the anus. The transition region from the rectum to the anus is accompanied by the bowel narrowing as it passes through the levator muscles. In this region, the composition of the rectal wall changes making tumor staging difficult. “The rectum is arbitrarily divided into three portions, the lower rectum (0-6 centimeters (cm)), the middle rectum (7-11 cm) and the upper rectum (12-15 cm). These categories are useful in planning surgical approach. The lower rectum is normally found to be dilated when compared to the middle and upper sections. Also, there are differences in the lymphatic systems draining the lower and middle/upper rectum. Lymphatic drainage from the upper rectum is exclusively upwards along the superior rectal vessels. While lymph drainage from the lower rectum may take any of three routes, the main direction of spread from tumors in any part of the rectum is upwards. The differences in lymphatic drainage can also cause differences in surgical approaches among the three regions. However, the main anatomical difference in the three regions that affects the surgical approach is the pelvis. Because of the bony pelvis, the principle of wide local removal of the cancer-bearing bowel segment is subject to severe limitations by the anatomy of the pelvic rectum.
To understand the surgical treatment of a rectal tumor, it is important to first understand the anatomy of the rectum. A representation of the layers of the rectum is shown in
Staging was historically performed clinically and evaluated post-operatively using the pathology specimen. In the early 1980's clinicians realized the importance of ERUS in rectal cancer staging, and in 1985 the accepted staging methods were revised to include ERUS. The layers of the rectal wall with a representation of degree of invading tumors (stage) are shown in
Currently, there is not an accurate manor to stage lymph nodes associated with rectal cancer. CT and MRI both have reported accuracies between 60 and 65 percent while ERUS has reported accuracies ranging from 58 to 81 percent. Improved N-staging techniques should improve benign and malignant lymph node detection in the future. However, a malignant lymph node does not mean that there is spread of the cancer to other sites, and metastatic spread can occur without involved lymph nodes. Therefore, improved lymph node staging does not assure an improvement in the outcome of rectal cancer. While this technology may improve M staging, this thesis is focused on the T staging of rectal cancer with endorectal ultrasound.
There are many different techniques that researchers and clinicians have tried to use to detect and stage rectal cancer. Some commonly used screening techniques include the Fecal occult blood test (FOBT), the Digital Rectal Exam (DRE), Sigmoidoscopy and Colonoscopy. Some commonly used staging techniques include DRE, Positron Emission Tomography (PET), Magnetic Resonance Imaging (MRI), Computed Tomography (CT), Endorectal Ultrasound (ERUS) and Trans-vaginal Ultrasound (TVUS). Reliable screening and staging techniques are important parts of the prevention and treatment of rectal cancer. However, improvements are needed in both screening and staging.
Attempts have been made to use PET for T staging of rectal cancer, but have not been successful. The PET technique provides a functional image with limited anatomical detail. Therefore, it is thought that it is useful in looking at the recurrence of the cancer, or at the spread of metastatic cells to other organs, but is currently not useful in the anatomic, primary staging of rectal cancer. However, it has been proposed that the combination of PET with either CT or MR for this purpose may be of use in the future
MRI has seen limited clinical use for various reasons, one of which being that there has not been an overwhelming consensus of its utility by the surgeons treating rectal cancer. The possibility of using MRI for the preoperative staging of rectal cancer was introduced in 1986 and was determined to be good for M staging. However, with only a few exceptions, the consensus of the majority of the experts in the field show that there are major limitations for a widespread use of MR in T staging of rectal cancer using body coils. One major disadvantage is that it is likely to overstage T2 tumors. However, MRI has shown been useful in determining the difference in mucinous and nonmucinous rectal carcinomas, and MR has also been used to look at the local recurrence of rectal cancer or the spread of the cancer to other organs in the body may be of clinical use. Even so, the use of MR in these situations is not wide spread in the United States.
With the introduction of endorectal coils, the accuracies of T staging with MRI has greatly improved, rivaling that of ERUS. One study reported accuracies of 92% for T1-T2 tumors and 94% in T3 tumors as compared to post-operative pathological results. These coils, combined with different pulse sequences, have allowed for the visualization of the individual layers of the rectal wall. However, this same study reported some problems with this system that limits its usefulness as a T staging technique. This procedure requires a long examination time, the costs are relatively high, and movement-related artifacts in the images sometimes decreases the resolution so that the individual layers of the rectum cannot be seen. Another study used an endorectal coil MRI and found it to be a reliable local staging technique for rectal cancer, but even though its accuracy is very high, ERUS is still the preferred method because of ease of application and cost.
With the continued efforts to reduce the cost of MRI, the improvements in the resolution of higher field MR magnets, and the new applications that may potentially be discovered, the practicality of its use either in T staging or looking at rectal cancer recurrence may increase in the future. A group in Austria and Germany has just reported the possibility of using a value, called the perfusion index of a tumor, to predict the outcome of adjuvant preoperative therapy and to introduce MR as a potential screening technique. The perfusion index is calculated from a preoperative, dynamic, T1-weighted image set taken of a primary rectal carcinoma. This type of noninvasive, predictive screening is one of the many new ideas that could prove to be of great value in the future.
Computed tomography (CT) is another imaging modality that, like MRI, provides tomographic slices of the imaged volume. When CT was first introduced into the role of T and M staging, it was thought to be very accurate. However, for T staging, its many limitations were quickly discovered. It does not differentiate the layers of the rectal wall. CT has a wide spread of inter- and intra-observer accuracies, and is inaccurate in the identification of lymph node metastases. The ability to detect local tumor extension is stage dependent, being accurate in the identification of late stage (T4) tumors, and very poor at the identification and differentiation of T2 and T3 tumors.
CT has been utilized in three other areas including the selection of patients for pre-operative adjuvant therapy, the tracking of recurrent cancer postoperatively and looking at systemic disease (i.e., liver metastases). Because CT provides an anatomic image, it allows a view of the tumor in relation to the surrounding structures. It also shows liver metastases (M staging), if the cancer has spread metastatically. Therefore CT is a good choice for use in the selection of patients for pre-operative therapy. However, using CT to look for recurrent tumors has problems. In CT, a recurrent tumor tends to image like a local soft tissue mass, typically with central hypodensities, after intravenous contrast injection. But, a major difficulty with CT in detecting recurrent cancer is its insensitivity to local tumor at the anastomatic site, inability to detect tumor within a fibrotic surgical scar, and inability to differentiate between hyperplastic and tumorous lymph nodes. While ERUS is the preferred method to detect early local recurrence, no single method is outstanding. PET can be useful for tumors greater than about 0.5 cm and that actively uptake FDG, and even with the problems that exist using CT, it is worth noting again that it is a good technique to use in the identification of late stage tumors and M staging, as well as in the diagnostic work-up of patients for pre-operative adjuvant therapy. Therefore, CT used in combination with other imaging modalities, provides useful information for the staging and treatment of rectal cancer.
Endorectal ultrasound has emerged as the imaging modality of choice for staging rectal cancer and has been shown to be especially accurate for early stage tumors (T1,T2) and tumors that penetrate the rectal wall (T3). As shown in
Some of the problems using ERUS arise from 1) inter-user variability (including T2 vs T3 discrepancies), 2) user to user portability, 3) adjuvant therapy, and 4) stenosis. Inter-user variability and the wide range in reported staging accuracies are due to the inflammation of some tumors as well as the non-tomographic nature of ERUS. Another problem encountered with the use of ERUS is that adjuvant, preoperative radiotherapy can increase the echogenicity of the rectal wall thereby reducing its accuracy in T staging. ERUS is also less accurate in the lower rectum because changes in anatomy cause the examination to be more difficult; although, the position of the tumor with respect to the circumference of the rectum does not decrease the accuracy in T staging. There have been problems with overstaging and understaging of mid-stage tumors for two reasons: 1) the overstaging is caused by the lack of differentiation between tumor and inflammation and is a problem associated with T2 tumors, and 2) the understaging is thought to be caused by a lack of specific, cellular information at the microscopic level. With ultrasound, the resolution of the image can be improved by increasing the frequency. However, there is a trade off for increased frequency, which is decreased imaging depth. Therefore a useful balance of imaging resolution and depth must be found. Frequencies from 5 to 10 MHz have been shown to provide acceptable results.
ERUS is limited in the visualization of stenotic tumors of the rectum. Approximately 17 percent of stenotic tumors are impossible to stage with ERUS. In women this problem is currently being solved with the use of transvaginal ultrasound (TVUS) because of the improved visualization with this technique. However, this problem will not be solved in men unless improvements are made in the ERUS systems, or another imaging modality is shown to image stenotic tumors well.
Despite the many limitation, ERUS is a very valuable technique used in the staging of rectal cancer. It is inexpensive, relatively easy to use, and identifies early stage and T3 tumors extremely well. It is important for the clinician to understand its limitations and also its potential benefits when combined with other forms of imaging. The combination of DRE, ERUS, and CT seems to be the most accurate, most commonly used, and most cost effective for the complete staging and operative planning of rectal cancer
Endorectal ultrasound is the current standard of care for T staging of rectal cancer. However, ERUS in its current form is not readily portable among examiners. Some common sources of error when using ERUS include false instrumentation, interpretive errors, anatomic defects, imaging failure and inevitable errors. The first three of these error sources can be classified as “preventable” errors and the last two as non-preventable errors. False instrumentation may include problems caused by inadequate contact of balloon to irregular tumor surface and a gap formed by air, fluid or feces. Any images in this category would not give the examiner a clear and accurate view of the tumor, thereby reducing the likelihood of a correct diagnosis. The second preventable category, interpretive errors may be due to examiner confusion and lead mostly to the overstaging of a tumor even though the exam provided clear ultrasonic images. Interpretive errors would therefore be consistent with an examiner who, for example, had inadequate experience. Imaging error due to anatomic defects are not naturally occurring defects but those caused by previous biopsies, polypectomies, or operations resulting in edema, abscesses, or fibrosis. It is desirable to implement improvements in an ERUS system that would eliminate user dependent error.
Although ERUS is presently the standard of care for the accurate staging of rectal cancer, in its current format, it is limited by its 2D nature, lack of portability, and difficulty in obtaining accurate intra and inter examiner comparisons.
ERUS image interpretation is associated with a significant learning curve. One group characterized ERUS as a relatively simple procedure to learn, and once a moderate degree of experience is gained, should be routinely incorporated into the evaluation of rectal neoplasms. However, they also suggest that an examiner's interpretative skills would stay at a high level of accuracy after 15 ERUS exams have been performed. Yet another report defines a moderate number of exams as 30 per year, and if less than 30 are performed annually, it should be expected that the results would not be as accurate as possible. Therefore they conclude that the centralization of transrectal ultrasonography service is mandatory if a high level of quality is to be achieved with this method.
Inter-observer accuracy may be dependent upon stage. Several reports have demonstrated inter-observer agreement to be low for T2 tumors, high for T3 tumors, and that accurate interpretation of T1 and T2 tumors requires a very experienced clinician. This group and others have concluded that image interpretation explains some differences in reported accuracies among studies.
The accurate staging of rectal tumors is necessary because understaging may lead to undertreatment and overstaging results in potentially more invasive operations and subsequent increased morbidity and mortality. The current research describes the initial work to incorporate image guided therapy techniques to make this goal of a more accurate ERUS system feasible.
Once a rectal tumor has been accurately staged, the next decision is the appropriate treatment for the patient. This decision is very important because the extent and invasiveness of resection or other therapies used will determine local control, cure, need for adjuvant therapy, sphincter preservation, and preservation or loss of sexual and urinary functions. The number of potential treatments form a relatively short list, however, one of them has decisively been shown to be the optimal cure for most cases of rectal cancer. This option is surgery, which involves the resection of the cancerous tissue from the rectum. Other treatments include electrocoagulation for distal rectal cancer less than 4 cm in diameter (although only in debilitated patients), local intraoperative radiation therapy (IORT), chemotherapy, oral medication (aspirin, NSAIDS and COX-2 inhibitors), and immunotherapy. Of these, electrocoagulation and IORT are the only treatments that are currently being used completely independent of surgery and are intended only as palliation.
There are two broad classifications of operations, those with the intent to cure and preserve sphincter function and those that cure without preservation of sphincter function. The examples herein will focus on those operations with the intent to cure and will not take sphincter preservation into account. Currently there are different surgical procedures that are appropriate for different stages of tumors, as well as for tumors found in different parts of the rectum. However, there is generally agreement among surgeons that a 1 cm distal surgical margin and a tumor free circumferential margin are appropriate for most resections.
The first type of surgery is local excision with the intent to cure. There are four surgical approaches to local excision including transanal, trans-sacral, trans-sphincteric and transanal endoscopic microsurgery. Transanal excision is the most commonly performed. In this operation, the resected section is limited to the immediate area surrounding the tumor. This procedure is appropriate for tumors that are low stage, are less than about 3 cm in diameter, and are thought to be without lymph node metastases. Local excision can be completed with good margins and a low risk of recurrence for patients who are appropriately selected. With all of the benefit of local excision provides, it should again be noted that the correct staging of the tumor is significant in the success of the treatment.
Radical surgery has been shown to have the most impressive results is Total Mesorectal Excision (TME). The findamental principle of TME is a precise, careful anatomical dissection in the embryological plane that exists between the mesorectum, derived from the dorsal mesentery, and the parietal presacral fascia. The four main principles of TME include mesorectal dissection with direct visualization; Specimen-orientated surgery, the objective of which is an intact mesorectum with no tearing of the surface and no circumferential margin involvement; recognition and preservation of the autonomic nerves on which sexual and bladder function depend; and a major increase in sphincter preservation and reduction in the number of permanent colostomies. TME does require more time in operating room than other more traditional radical surgeries, however, it is currently thought to be the best option when radical excision is needed. TME's advantage is the low local recurrence without additional therapy.
One of the most fundamental forces in the development of surgery and other forms of directed therapy is the need to increase the information available to physicians and to place that information in both spatial and temporal contexts. The field of interactive image guided procedures, as it is known today, began in the 1980's and focused on tracking the surgical position in the physical space and display position in image space. This technique was first used in the field of neurosurgery and eventually crossed over into many other medical fields. IGPs have four basic components including image acquisition, image-to-physical-space registration, three-dimensional tracking, and display of imaging data and location. There has been much concurrent advancement in these four areas, which is a necessity for the timely incorporation of IGP into common medical practice.
Current research is showing the potential widespread use of three dimensional (3D) ultrasound within the medical community. Limitations of two dimensional (2D) ultrasound that are addressed by 3D imaging include: mentally transforming multiple 2D images to form a 3D impression of the anatomy and pathology is not only time-consuming and inefficient, but is also more importantly, variable and subjective, which can lead to incorrect decisions in diagnosis, and in the planning and delivery of therapy; diagnostic (e.g. obstetric) and therapeutic (e.g. staging and planning) decisions often require accurate estimation of organ or tumor volume; conventional 2D ultrasound techniques calculate volume from simple measurements of height, width and length in two orthogonal views, by assuming an idealized (e.g. ellipsoidal) shape, which can potentially lead to low accuracy, high variability and operator dependency; conventional 2D ultrasound is suboptimal for monitoring therapeutic procedures, or for performing quantitative prospective or follow-up studies, due to the difficulty in adjusting the transducer position so that the 2D image plane is at the same anatomical site and in the same orientation as in the previous examination; the validity of diagnostics with 3D as compared to 2D ultrasound is being tested, and the reported conclusions to date show 3D to be superior.
Some reported techniques to collect 3D data from 2D ERUS probes include magnetic tracking, the timed pull-out method, and a rotating stepper motor for a stationary, side firing probe. For a 360-degree rotating ERUS probe, only optical tracking, magnetic tracking and the timed pullout method are viable options. Magnetic localization systems are currently not as accurate as optical localization systems.
The timed pullout method is also known as linear scanning. The timed pullout method can provide relatively accurate results, but requires a bulky device holding the ERUS probe and placed close to the patient. This device contains the stepper motor and controls the linear movement of the probe. Because of the size of the mechanical mechanism that must be used for the timed pullout method, and the fact that any accidental movement of the device would cause invalid data, optical ERUS tracking is more useful and less of a hindrance to the clinician in the procedural room.
It is desirable to provide an apparatus and method for calibration, tracking and volume construction data for use in image-guided procedures. Further, is desirable to provide an apparatus and method for calibration, tracking and volume construction data for use in image-guided procedures within the context of endorectal imaging and for the detection and staging of tumors.
Briefly stated, the present invention comprises an apparatus and method for calibration, tracking and volume construction data for use in image-guided procedures.
In one embodiment, present invention comprises an apparatus that collects and processes physical space data while performing an image-guided procedure on an anatomical area of interest. The apparatus includes a calibration probe that collects physical space data by probing a plurality of physical points, a tracked ultrasonic probe, a tracking device that tracks the ultrasonic probe in space and an image data processor comprising a computer-readable medium. The tracked ultrasonic probe outputs one of two-dimensional (2D) ultrasonic image data, three-dimensional (3D) ultrasonic image data and four-dimensional (4D) ultrasonic image data. The physical space data provides three-dimensional (3D) coordinates for each of the physical points. The computer-readable medium holds computer-executable instructions that includes determining registrations used to indicate position in both image space and physical space based on the physical space data collected by the calibration probe; using the registrations to map into image space, image data describing the physical space of the tracked ultrasonic probe used to perform the image-guided procedure and the anatomical area of interest; and constructing a three-dimensional volume based on the ultrasonic image data on a periodic basis.
In another embodiment, the present invention comprises a method of collecting and processing physical space data while performing an image-guided procedure on an anatomical area of interest. The method includes collecting physical space data by probing a plurality of physical points using a calibration probe. The physical space data provides three-dimensional (3D) coordinates for each of the physical points. An ultrasonic probe that outputs one of two-dimensional (2D) ultrasonic image data, three-dimensional (3D) ultrasonic image data and four-dimensional (4D) ultrasonic image data is tracked using a tracking device that tracks the ultrasonic probe in space. In an image data processor comprising a computer-readable medium holding computer-executable instructions (i) based on the physical space data collected by the calibration probe, determining registrations used to indicate position in both image space and physical space; (ii) using the registrations to map into image space, image data describing the physical space of the tracked ultrasonic probe used to perform the image-guided procedure and the anatomical area of interest; and (iii) constructing a 3D volume based on the ultrasonic image data on a periodic basis.
In another embodiment, the present invention comprises an article of manufacture for collecting and processing physical space data while performing an image-guided procedure on an anatomical area of interest. The article of manufacture includes a computer-readable medium holding computer-executable instructions for performing a method. The method includes collecting physical space data from a calibration probe that is used to probe a plurality of physical points. The physical space data provides three-dimensional (3D) coordinates for each of the physical points. Tracking data about an ultrasonic probe that outputs one of two-dimensional (2D) ultrasonic image data, three-dimensional (3D) ultrasonic image data and four-dimensional (4D) ultrasonic image data is received from a tracking device that tracks the ultrasonic probe in space. Based on the physical space data collected by the calibration probe, registrations used to indicate position in both image space and physical space are determined. The registrations are used to map into image space, image data describing the physical space of the tracked ultrasonic probe used to perform the image-guided procedure and the anatomical area of interest. A 3D volume is constructed based on the ultrasonic image data on a periodic basis.
The foregoing summary, as well as the following detailed description of the invention, will be better understood when read in conjunction with the appended drawings. For the purpose of illustrating the invention, there are shown in the drawings embodiments which are presently preferred. It should be understood, however, that the invention is not limited to the precise arrangements and instrumentalities shown. In the drawings:
Certain terminology is used in the following description for convenience only and is not limiting. The words “right”, “left”, “lower”, and “upper” designate directions in the drawings to which reference is made. The words “inwardly” and “outwardly” refer direction toward and away from, respectively, the geometric center of the object discussed and designated parts thereof. The terminology includes the words above specifically mentioned, derivatives thereof and words of similar import. Additionally, the word “a”, as used in the claims and in the corresponding portions of the specification, means “one” or “at least one.”
Preferred embodiments of the present invention include Image Guided Procedures (IGP). IGP have four basic components: image acquisition, image-to-physical-space registration, three-dimensional tracking, and display of imaging data and location. A relevant IGP system is disclosed in U.S. Pat. No. 6,584,339 B2 (Galloway, Jr. et al.), the contents of which is incorporated by reference herein. U.S. Pat. No. 6,584,339 B2 is attached hereto as an Appendix. In IGP, physical space data provides three-dimensional (3D) coordinates for each of the physical surface points. Based on the physical space data collected, point-based registrations used to indicate position in both image space and physical space are determined. The registrations are used to map into image space, image data describing the physical space of an instrument used to perform the IGP, an anatomical region of interest and a particular portion to be studied (e.g., a tumor or growth). The image data is updated on a periodic basis.
Further, preferred embodiments of the present invention utilize an optically tracked two dimensional (2D) ultrasound probe to acquire a 3D image(s). Embodiments of the present invention, therefore permit the creation of a 3D ultrasound volume from 2D tracked ultrasound data. Acquired imaging scans (e.g., Computed Tomography (CT) scans) can be used as a comparison and/or in conjunction with pre-operative and inter-operative 3D ultrasound volume sets. The 3D ultrasound volume sets provide the ability to be tracked over time. Optionally, the ultrasound probe outputs one of two-dimensional (2D) ultrasonic image data, three-dimensional (3D) ultrasonic image data and four-dimensional (4D) ultrasonic image data.
Besides ease of use, optical tracking has an advantage over the other 3D acquisition methods which is a result of coordinate integrated imaging. When using a tracked ultrasonic device, such as a tracked ultrasonic probe 352(
Referring to
In one preferred embodiment of the present invention described using
The optical tracking system 340 determines triangulated position data based on emissions from a plurality of infrared emitting diodes (IREDs) distributed over the surface of a handle of the calibration probe 320, the TERUS probe 352 and/or another instrument. The optical tracking system 340 includes the optical tracking sensor 325 and optionally an optical reference emitter 90. The optical tracking sensor tracks the IREDS that are disposed on the handle of the calibration probe 320 and IREDS disposed on the reference emitter 90. The reference emitter 90 is rigidly or semi-rigidly attached to the patient.
Alternatively, the tracking system 340 may include a magnetic tracking device in a handle of the tracked ultrasonic probe 352 that is tracked by magnetic tracking techniques.
Alternatively, the tracking system 340 may include radiofrequency (RF) tracking using an RF signal generator that is built into a handle of the tracked ultrasonic probe 352.
Alternatively, the tracking system 340 may include gyroscopic tracking of the tracked ultrasonic probe 352.
Other hardware, operating systems, software packages, and image tracking systems may utilized without departing from the present invention.
Locations of targets are found using two different imaging modalities, CT and ultrasound, and the target registration error (TRE) between these two image sets are calculated. Fiducial markers 48 (
For calibration, two rigid bodies are used that both have Infrared Light Emitting Diodes (IREDS) and are tracked by the optical tracking localization system. One rigid body 353 was attached to the TERUS probe 352, and the TERUS probe 352 was securely fixed. The rotating tip of the TERUS probe 352is immersed in a bath of water or other suitable material. The ERUS mounted rigid body 352 functions as a reference to which the second rigid body is tracked. The second rigid body is the pen probe 320 with a ball-tip such as a 3 mm ball-tip. The tip of the calibration probe 320 is placed into the beam of the TERUS probe 352 and can be seen as a bright spot in a corresponding ultrasound image (see
An experimental setup or “rectal phantom” 500 was created to simulate a human rectum and to test the TERUS-based IGP system 300.
For exemplary purposes,
It is generally desirable to recalibrate the TERUS probe 352 when the rigid body 353 is removed and then reattached to the TERUS probe 352, and/or when the ultrasound is transmitted at a different frequency or viewed at a different field of view from the previous calibration. The second condition is of interest to particular TERUS probe 352 described above because this TERUS probe 352 includes a multi-frequency transducer that is easily interchangeable among the three frequencies and different fields of view.
The next step is the registration of the CT volume to the physical space. This is accomplished by using the extrinsic fiducials 48 that are attached to the outside of the patient's body and using rigid registration techniques. The (x,y,z) locations of the fiducials 48 are found in the CT set and in physical space, and then registered using the quaternion method. To find the locations in CT space, a three-dimensional volume is created from the tomogram set. The fiducial caps 48 used in the scan are radio-opaque and show up bright in the images (see e.g.,
The centroid of each fiducial cap 48 is found using an intensity based approach and interpolation within slices to provide an accuracy of about half of the slice thickness. This process is known as super-resolution. As previously described, the physical space locations are then determined using the tracked physical space calibration probe 320. The rigid registration is then performed with a subset of the fiducials 48 from the two data sets. This registration creates a transformation matrix that rotates and translates one set of data to match the orientation of the other set. This transformation matrix, along with the average error of all of the fiducials 48, are calculated. For example, FRE for the above experimental test is presented in Table 2(b). An accurate fiducial registration error is necessary for, but does not guarantee, an accurate target registration error. Therefore, one fiducial 48 or an additional fiducial 48 can be used as a target, like in the calibration process, to check the accuracy of the FRE. The RMS error of the additional fiducial 48 is reported as the registration TRE (see Table 2(b)).
The final stage in the process involved finding the (x,y,z) locations of the targets in the CT tomograms the same way that the fiducial locations were found. Then by using the output transformation matrix from the registration process, the locations of those points in physical space are calculated. The locations of the targets are also found using the TERUS probe 352, and their respective (x,y,z) locations in physical space are calculated using the transformation matrices from the calibration process and tracked image guided system. This provides two data sets containing the locations of the same targets in physical space located by two different methods. The values found using CT are taken to be the actual locations, and the values found using the TERUS probe 352 are compared to the actual. The distance between the locations of each target is then found, and is recorded as the target registration error (TRE). Exemplary individual TREs and the average TRE are reported in Table 2(c). It should be noted that an accurate TRE is the only true verification of an accurately tracked system.
The average TRE of the targets using the TERUS probe 352 is about 3.04 millimeters (mm). The required tumor margins for rectal cancer are on the order of centimeters (cm). Thus, use of a TERUS system 300 to improve ultrasound imaging in rectal cancer is possible. The incorporation of IGP techniques to pre-operative staging, inter-operative visualization and post-operative follow-up of rectal cancer with TERUS improves the accuracy of staging, reduces the overall morbidity and mortality rates and assists clinicians to detect and follow recurrences of rectal cancer over time.
By optically tracking the TERUS probe 352 as data is collected, the intensity value for each pixel can be saved and then inserted into the nearest voxel in a corresponding volume matrix. Then validation of the accuracy of a volume reconstruction can be performed by finding the 3D coordinates of targets that are inside of the volume and comparing them to known physical locations. Over-determining the data placed into the volume around the area of interest is desirable so that speckle can be reduced and the signal to noise in the area will be improved by averaging a particular pixel's value from different images. Transformation of a 2D coordinate location in ultrasound image space into its corresponding 3D physical space occurs pixel by pixel and any unfilled voxels are left empty. It is contemplated that vector mathematics can be utilized to speed up the process. During the transformation process, the intensity value of each pixel is placed into the appropriate 3D voxel. Multiple intensity values that map to the same voxel in 3D space are handled. Preferably, arithmetic averaging is used when multiple intensity values are mapped to the same voxel such that the average of the multiple intensity values is placed into the voxel. Alternately, when multiple intensity values are mapped to the same voxel in 3D space, the intensity value is overwritten into the voxel.
Of course, the preferred embodiments of the present invention are not limited to endorectal imaging and evaluation and may be utilized to analyze other anatomical regions of interest such as the vagina, the uterus, colon, stomach, upper intestine, pancreas, throat and the like. Tracking flexible ultrasound allows for applications in colon, esophageal, pancreatic, duodenal, and other such cancers. The use of rigid ultrasound probe in this invention allows for use in the liver, breast, kidney, prostate, and other such parts of the body that can be imaged by rigid ultrasound probe. Therefore, embodiments of the present invention include a tracked ultrasonic probe 352 that is one of a rigid body, a flexible body and a combination of a rigid body and a flexible body.
The National Cancer Institute reports the expected number of new cancer diagnosis for 2005 at http://seer.cancer.gov. The four largest areas of new cancer cases are (i) prostate, 232,090, (ii) breast, 211,240, (iii) colon and rectal, 145,290, and (iv) urinary/bladder, 63,210. The expected new cases of cancer of all types is to increase over time. The preferred embodiments may be utilized in conjunction with laparoscopic and endoscopic surgical techniques, as well, such as by inserting an ultrasonic probe 352into a body through a cannula.
Esophageal and pancreatic cancers remains quite lethal with low survival even in patients undergoing surgery. Endoscopic ultrasound is considered part of the standard for staging pre-operatively. The addition of tracked technologies may enable further treatment or selection criteria for patients with these diseases.
Prostate cancer is treated in a multitude of methods, surgically, external beam, and brachytherapy with radiation seeds as well as hormonal therapy. All modes of treatment rely on diagnostic ultrasound to determine the optimum method. Tracked devices may change the algorithms for treatment of this very common cancer.
Breast cancer can be caught early with screening however mammography has limitations of radiation as well as discomfort and post surgical changes. Tracked ultrasound has the potential to perform inter-exam comparisons in a digital manner and detect earlier lesions.
It is also contemplated that the tracked ultrasound probe 352 is one of a tracked angio-access ultrasound probe and a tracked intra-vascular ultrasound probe for use in arterial/vascular procedures like angiograms, by-passes, valve replacements or the like. It is further contemplated that the tracked ultrasound probe 352 is a tracked endoscopic ultrasound probe for gastrointestinal procedures. It is further contemplated that the tracked ultrasound probe 352 a tracked bronchoscope ultrasound probe for use in the lungs or airway. It is further contemplated that the tracked ultrasound probe 352 is a tracked arthroscopic ultrasound probe for use in joint procedures.
While described above as being used in combination with a CT scan, other imaging techniques such as Positron Emission Tomography (PET), Magnetic Resonance Imaging (MRI) and the like, may be utilized.
The ultrasound-based IGP system 300, when used with a second imaging technique (e.g., CT, PET, MRI and the like), enables other analysis such as size changes of a target (e.g., a tumor) in an anatomical region of interest (e.g., the rectum).
The present invention may be implemented with any combination of hardware and software. If implemented as a computer-implemented apparatus, the present invention is implemented using means for performing all of the steps and functions described above.
The present invention can be included in an article of manufacture (e.g., one or more computer program products) having, for instance, computer useable media. The media has embodied therein, for instance, computer readable program code means for providing and facilitating the mechanisms of the present invention. The article of manufacture can be included as part of a computer system or sold separately.
From the foregoing, it can be seen that the present invention comprises an apparatus and method for calibration, tracking and volume construction data for use in image-guided procedures, and more particularly, within the context of endorectal imaging and for the detection and staging of tumors. It will be appreciated by those skilled in the art that changes could be made to the embodiments described above without departing from the broad inventive concept thereof. It is understood, therefore, that this invention is not limited to the particular embodiments disclosed, but it is intended to cover modifications within the spirit and scope of the present invention as defined by the appended claims.
This application claims priority to U.S. Provisional Patent Application No. 60/652,953 filed on Feb. 15, 2005 entitled “Method and Apparatus for Calibration, Tracking and Volume Construction Data for Use in Image-Guided Procedures.”
Number | Date | Country | |
---|---|---|---|
60652953 | Feb 2005 | US |