The invention provides a device and method for tracking an ultrasound.
Ultrasound devices typically include an ultrasonic transducer with scan/receive heads, a processing unit, and a display device. Ultrasonic transducers may be adapted for special applications such as, for example, transcutaneous applications, laparoscopic applications, transrectal applications, endo-cavity probes, vaginal probes, 2D and 3D phased array probes, and/or other probes or applications. Laparoscopic ultrasound devices typically include an ultrasonic transducer with a movable scan head, a handle, and an apparatus for controlling the orientation of the scan head. An image-guided ultrasound device makes use of sensor elements or position indicating elements placed into the head of the ultrasound transducer and a companion tracking device that can determine the position and/or orientation of sensor elements in the coordinate system of the tracking device. After calibrating the sensor elements to the scan plane of the ultrasonic transducer, the position and/or orientation of the scan plane can also be determined. Using registration techniques, position and orientation information regarding the scan plane of the ultrasound device enables merging and integration of live ultrasound images to preoperative scans (e.g., computerized tomography [CT] scans, magnetic resonance [MR] scans, or other images). Information regarding registration of position/orientation data to image/scan data, production of merged or integrated images therefrom, and/or other information useful with the invention may be found in U.S. patent application Ser. No. 11/059,336 (U.S. Patent Publication No. 2005/0182319), entitled “Method and Apparatus for Registration, Verification, and Referencing of Internal Organs,” which is hereby incorporated by reference herein in its entirety.
Attachment of one or more electromagnetically tracked sensor elements to an ultrasound such as, for example, a laparoscopic ultrasound, may offer a number of advantages over the state of the art in trackable ultrasound devices. For example, the scan plane of an ultrasonic transducer can be tracked within the patient's body (as opposed to optical tracking, which is limited to line-of-sight applications) for the aforementioned purpose of superimposing ultrasound images to preoperative images. In addition, it would be advantageous to utilize devices and methods that do not require constant recalibration of the sensor elements with the scan plane in situations where the relative positions of the sensor elements and the ultrasound transducer are changed after initial calibration. By placing a sensor element adjacent to the transducer of an ultrasound device, the device is intrinsically more accurate because the “lever effect” caused when the sensor is located far from the transducer is minimized. The “lever effect” causes a small error in angular measurement by the sensor element to appear as a large error in the position of the transducer.
In one embodiment, the invention provides a trackable ultrasound device such as, for example, a trackable laparoscopic ultrasound device, that may be used to produce merged images of preoperative scans and interoperative ultrasound images. In one embodiment, the trackable ultrasound device includes an ultrasonic transducer that generates an image of material existing along its scan plane. The trackable ultrasound device also includes a tracker, which is affixed to or near the ultrasonic transducer such that the tracker moves along with any movable parts of a scan head to which the ultrasonic transducer is attached. As affixed in this manner, the tracker enables the determination of the location, direction, and/or orientation of the scan plane even when the ultrasonic transducer moves relative to other parts of the ultrasound device.
In one embodiment, the ultrasonic transducer may include features that allow mating of the tracker to the scan head. Such features may include but are not limited to machined grooves, keyways, divots, alignment pins, spring-loaded balls to engage holes, alignment marks, or other features. These features may allow repeatable and accurate alignment and realignment of the tracker with the scan head.
In one embodiment, the ultrasound device may include fiducials (also referred to herein as “fiducial markings”). These fiducials may include divots, indicator markings, ball bearings, or other elements that are visible under one or more imaging modalities. These fiducials may provide point and/or path references, wherein a reference path can include a plurality of points provided by multiple fiducials. In one embodiment, the position of these fiducials may be sampled using a tracked pointer. In one embodiment, the fiducials may be visible on one or more imaging modalities such as, for example, an x-ray device or other imaging modality. The fiducials may be present on the ultrasonic transducer/scan head, the tracker, or other part of the ultrasound device.
The tracker may also include one or more sensor elements. The sensor elements may include electromagnetic sensor coils or other position indicating elements that can be used to indicate position and/or orientation relative to a tracking device. In some embodiments, if two or more sensor elements are used, they can be placed at a known angle relative to one another, thereby providing a perspective indication of depth.
As mentioned above, the tracker includes a plurality of fiducials (e.g., “tracker fiducial markings”). In general, the tracker fiducial markings are in a fixed and known spatial relationship with the sensor elements of the tracker. Accordingly, the fiducials on the scan head (e.g., scan head fiducial markings or transducer fiducial markings) are in a fixed and known spatial relationship with the scan plane of the ultrasonic transducer.
In one embodiment, the invention provides for the prevention of relative movement between the tracker and the ultrasonic transducer by using alignment and engaging features (e.g., alignment elements) on the scan head, the tracker, and/or other parts of the device. This prevents the need for recalibration of the tracker to the ultrasonic transducer. For example, the alignment and engaging features enable the tracker to be removed and reliably replaced onto the scan head in the same position, while preserving an initial calibration (i.e., because the alignment features ensure that the relative positions of the tracker and the ultrasonic transducer remain the same).
In another embodiment, movement of the tracker relative to the ultrasonic transducer can be prevented by using the alignment and engaging features on the scan head, the tracker, and/or other portions of the ultrasound device to engage special jigs, thus eliminating the necessity of recalibration.
In one embodiment, if relative movement between the tracker and the ultrasonic transducer does occur after initial calibration (e.g., either by intentional remounting or for other reasons), the invention provides a method for adjusting the initial calibration, thus avoiding a time-consuming and/or difficult recalibration. This calibration adjustment method compensates for the relative movement between the tracker and the ultrasonic transducer using the tracker fiducial markings and the scan head fiducial markings.
In one embodiment, the initial calibration maybe performed. In this initial calibration, the scan plane of the ultrasonic transducer may be calibrated relative to (or brought into coincidence with) the coordinate system of the tracker. This may be done using methods known in the art and may result in the calculation of an initial calibration transformation matrix Tts.
In one embodiment, the tracker fiducial markings and the scan head fiducial markings may then be sampled in the same frame of reference (e.g., using a tracked probe, imaging modality, or other method) and used to obtain primary transformation matrix Ttu.
The calibrated system may then be used. This use may be in a clinical application or may include a test use. In any event, the initial calibration transformation matrix Tts is employed to determine the scan plane of the ultrasonic transducer from sampled data of the sensor elements of the tracker. As mentioned herein, this determination allows preoperative images to be merged with interoperative ultrasound data.
In one embodiment, the tracker may then be removed from the ultrasound device and replaced in a different position relative to the ultrasonic transducer. The tracker fiducial markings and the scan head fiducial markings are again sampled (e.g., using a tracked probe, imaging modality, or other method) and used to calculate a secondary transformation matrix T′tu between the scan head and the tracker.
A differential transformation matrix T is then calculated between Ttu (the primary transformation matrix) and T′tu (the secondary transformation matrix). The differential transformation matrix represents the difference between the first and second relative positions of the tracker and the ultrasonic transducer/scan head. Because the spatial relationships between the sensor elements and the scan plane are known relative to their respective fiducial markings (e.g., the tracker fiducial markings and the scan head fiducial markings) the differential transformation matrix provides an accurate representation of how to adjust the initial calibration.
Accordingly, the initial calibration is adjusted and the trackable laparoscopic ultrasound device can be used without recalibration.
These and other objects, features, and advantages of the invention will be apparent through the detailed description of the preferred embodiments and the drawings attached hereto. It is also to be understood that both the foregoing general description and the following detailed description are exemplary and not restrictive of the scope of the invention.
In one embodiment, the invention provides a device for tracking the ultrasonic transducer of an ultrasound device such as, for example, a trackable laparoscopic ultrasound device.
Signals are sent to and from ultrasonic transducer 103 via cable 105, which may be routed through the interior of handle 101 and elongated shaft 102. In other embodiments, cable 105 may be routed or located elsewhere.
Trackable laparoscopic ultrasound device 100 is designed to generate an image of material existing along a scan plane 106, which extends from ultrasonic transducer 103. In one embodiments, more than one scan plane may originate from ultrasonic transducer 103.
Trackable laparoscopic ultrasound device 100 also includes a tracker 107, which is affixed to or near ultrasonic transducer 103 at a location 108 such that tracker 107 moves along with any movable parts of scan head 110 such as, for example, an articulating (movable) section of scan head 110, ultrasonic transducer 103, or other movable part. As affixed in this manner, tracker 107 enables the determination of the location, direction, and/or orientation of scan plane 106 even when ultrasonic transducer 103 moves relative to elongated shaft 102 or other parts of ultrasonic device 100. This eliminates the need for encoders or other devices to measure the location of the transducer. In one embodiment, cable 109 routes signals from tracker 107 to control equipment (e.g., a tracking device, a computer-implemented control unit, and/or other device) that determines the position and orientation of tracker 107/ultrasonic transducer 103.
As mentioned above, tracker 107 may be fixed to ultrasound device 100 such that tracker 107 moves with ultrasonic transducer 103. As such, tracker 107 may be fixed to an articulating shaft 202 that includes ultrasonic transducer 103. In one embodiment, tracker 107 may be placed in a location that does not overlap ultrasonic transducer 103.
Any electrical connections (e.g., signal carrying lead-wires, etc.) required by tracker 107 may be provided by cable 109.
In one embodiment, ultrasonic transducer 103 may include features (e.g., alignment elements) that allow mating of tracker 107 to scan head 110 (e.g., to part of articulating shaft 201 or other part of scan head 110 that enables tracker 107 to move with ultrasonic transducer 103). Such features may include but are not limited to machined grooves, keyways, divots, alignment pins, spring-loaded balls to engage holes, alignment marks, or other features. Tracker 107 may include corresponding/mating alignment elements machined into its body to allow repeatable and accurate alignment and realignment of tracker 107 with scan head 110.
In one embodiment, alignment elements may be present on both the scan head 110 and the tracker 107, and may allow engagement and temporary fixation of external jigs. The jigs may enable precise, reproducible alignment to be performed between tracker 107 and scan head 110. The jigs may alternately provide a way to measure the alignment of scan head 110 and tracker 107 (or changes therein between first and second positions). One such jig may engage scan head 110. Another part of the jig or a separate jig may engage tracker 107. In one embodiment, the jig or jigs may be equipped with protrusions, “wings,” or extensions that may engage either tracker 107 or the scan head 110. These wings may provide a way of assisting the alignment or clamping of tracker 107 or scan head 110, and may optionally contain fiducials, divots, sensor elements, or paths. The wings may provide a “lever-arm effect” enabling more precise relative rotational alignment or measurement of the relative positions of tracker 107 and ultrasonic transducer 103 that might otherwise be possible using features on the devices themselves. Details of an embodiment of a calibration jig are included in
In one embodiment, trackable laparoscopic ultrasound device 100 may contain fiducials (also referred to herein as “fiducial markings”). Fiducials may include divots, indicator markings, ball bearings, or other elements. These fiducials may provide point and/or path references, wherein a reference path can include a plurality of points provided by multiple fiducials. In one embodiment, the position of these fiducials may be sampled using a tracked pointer. In one embodiment, the fiducials may be visible on one or more imaging modalities such as, for example, an x-ray device or other imaging modality. The fiducials may be present on ultrasonic transducer 103, tracker 107, or other part of ultrasound device 100.
Housing 300 can be mounted to trackable laparoscopic ultrasound device 100 by threading it over scan head 110 using mounting hole 302. Housing 300 can then be secured to ultrasound device 100 using mounting element 303. In some embodiments, mounting element 303 may include, for example, a band, a screw, clips that elastically engage features on scan head 110, or other restraining element or fastener. In some embodiments, multiple mounting elements may be used.
In some embodiments, housing 300 may include alignment elements 308 and/or 309 that enable repeatable placement of tracker 107 on ultrasound transducer 103.
In one embodiment, one or more sensor elements 301 may be attached to housing 300. Sensor elements 301 may include electromagnetic sensor coils, optical devices, inertial measurement systems, or other position indicating elements that can be used to indicate position and/or orientation relative to a tracking device. In some embodiments, tracker 107 may include one sensor element 301 that is a 6 degree of freedom sensor element. In other embodiments, tracker 107 may include two or more 4 or 5 degree of freedom sensor elements 301 (as illustrated in
Any sensor wires used with sensor elements 301 may be connected to their respective sensor elements 301 and may exit tracker 107 at position 305 (position 305 may comprise a portion of cable 109). If wireless sensor elements 301 are used, wiring may not be needed. Sensor elements 301 may be rigidly affixed to housing 300 using adhesive such as, for example, epoxy and, as illustrated in
As mentioned above, tracker 107 can also further include a plurality of tracker fiducials 203. In general, tracker fiducials 203, are in a position known and fixed relative to sensor elements 301 in a coordinate system 307 that is the coordinate system of sensor elements 301 and their corresponding tracking device.
In one embodiment, tracker 107 contains machined features such as notches, prominences, marks, or other alignment elements 308 or 309 for engaging corresponding/mating alignment elements on trackable laparoscopic ultrasound device 100. In one embodiment, the notches or alignment elements 308 and 309 are used for engaging an external jig that is mounted to tracker 107. In one embodiment, tracker fiducials 203 may also be used for this purpose. The jig used may be mounted to trackable laparoscopic ultrasound device 100 using notches or other similar features on ultrasound transducer 103.
In one embodiment, a jig used in this manner may be insertable through laparoscopic ports (e.g., 12 mm ports, 5 mm ports, or other ports) such that an internal endocavitary calibration may be performed. This internal endocavitary calibration may be used to correct for minor inhomogeneities at the site of use. Additionally, the presence of a computerized tomography (CT) scanner during use (e.g., in the operating room) may necessitate the presence of internal fiducials on the jig, tracker 107, or the patient. In one embodiment, fiducials internal to a patient may include curved needles or other elements.
Prior to use with a patient, tracker 107 is placed onto/attached to a laparoscopic ultrasound device (thus forming a trackable laparoscopic ultrasound device, the same as or similar to device 100). The device must then be calibrated to relate the coordinate system of tracker 107 (e.g., coordinate system 307 of
Any subsequent movement of tracker 107 relative to the ultrasonic transducer will normally necessitate another time-consuming recalibration prior to use. However, the present invention overcomes the need for this time-consuming recalibration. In one embodiment, the invention provides for the prevention of relative movement between tracker 107 and ultrasonic transducer 103 by using alignment and engaging features (e.g., alignment elements 308, 309, 501, etc.) on scan head 110 and tracker 107. This prevents the need for recalibration of tracker 107 to ultrasonic transducer 103. For example, the alignment elements 308 and 309 enable tracker 107 to be removed and reliably replaced onto scan head 110 in the same position, while preserving an initial calibration (e.g., because the alignment elements ensure that the relative positions of tracker 107 and ultrasonic transducer 103 remain the same). In one embodiment, the alignment elements on tracker 107 mate with corresponding alignment elements 501 present on scan head 110 (illustrated in
In one embodiment, tracker 107 itself may comprise female receiver “ring” (see, for example, mounting hole 302 of
In another embodiment (which may be used in conjunction with other methods to serve as a “check” or verification that the system is accurate), the necessity of recalibration following movement of tracker 107 relative to ultrasonic transducer 103 can be prevented by using the alignment and engaging features on scan head 110 (e.g., alignment elements 501), tracker 107 (e.g., alignment elements 508 and 509), and/or other portions of ultrasound device 100 to engage special jigs. In one embodiment, the jigs may be of large dimensions, may enable the relative positions and rotations of tracker 107 relative to ultrasonic transducer 103 to be carefully adjusted since the lever arm effect exaggerates the relative positions. In one embodiment, fiducials and/or sensor elements may be placed on the aforementioned jigs, if used.
In one embodiment, if relative movement between tracker 107 and ultrasonic transducer 103 does occur after initial calibration (e.g., either by intentional remounting or for other reasons), the invention provides a method for adjusting the initial calibration, thus avoiding a time-consuming and/or difficult recalibration. This calibration adjustment method compensates for the relative movement between tracker 107 and ultrasonic transducer 103 using tracker fiducials 203 and scan head fiducials 204. As mentioned above, this method may be used in conjunction with other methods to serve as a “check” that the system is accurate.
In performing the calibration, at least three calibration locations are sampled on using the sensor elements (sensor elements 103) of tracker 107. The same three calibration locations may then be sampled using scan plane 106 of ultrasonic transducer 103. The resultant data may be considered initial calibration sample data and may be used to calculate an initial calibration transformation matrix Tts. Transformation matrix Tts relates the coordinate system of the scan plane 106 of ultrasonic transducer 103 with the coordinate system of tracker 107 and represents the rigid transformation between the scan plane 106 and the reported position and orientation of tracker 107. Since the initial calibration relates tracker 107's coordinate system with that of scan plane 106 of ultrasonic transducer 103, the calibration can be calculated for any positioning of tracker 107 onto scan head 110 once the relative position between tracker 107 and ultrasonic transducer 103 is known in the calibrated situation.
In one embodiment, the initial calibration of operation 401 may take place in a water tank as described in Gee et al. and Lindseth et al. The water tank is normally used to assist in the propagation of the sound waves which otherwise are attenuated in air. Typically, such a calibration takes the form of measurements of the location of several points in the water tank (formed, for example, by the intersection of crossed wires suspended in the tank) with the ultrasound in the coordinate system of the scan plane of the ultrasound and determining the location of the same points in space of the position sensor.
In an operation 402, fiducials on both tracker 107 (e.g., tracker fiducials 203) and ultrasonic transducer 103 (e.g., scan head fiducials 204) may then be sampled in the same frame of reference. A calculation relating the coordinate system of tracker 107 to the coordinate system of scan head 110 (and thus to scan plane 106) may then be performed using a method such as the iterative closest point (ICP), singular valued decomposition (SVD) technique, or other technique to determine a primary transformation matrix. Sampling of these fiducials may be performed using, for example, a tracked probe (e.g., electromagnetically tracked or otherwise tracked) or imaging using on an x-ray device or other imaging modality, to obtain the locations of all points in a common coordinate system. This sampled data may be considered the “first positions” of the fiducials relative to one another. The primary transformation matrix Ttu is then calculated between the tracker fiducials of tracker 107 and the transducer fiducials of scan head 110.
In an operation 403, the calibrated system may be used. This use may be in a clinical application or may include a test use. In any event, the initial calibration transformation Tts is employed to determine scan plane 106 of ultrasonic transducer 103 from sampled data of sensor elements 301 in tracker 107. As mentioned herein, this determination allows preoperative images such as CT images to be merged with interoperative ultrasound data. Operation 403 also includes removing tracker 107 from ultrasound device 100 and replacing tracker 107 in a different position relative to ultrasound transducer 103. In one embodiment, operation 403 need not involve removing tracker 107 from ultrasound device 100, but may include simply moving tracker 107 relative to scan head 110.
In an operation 404, tracker fiducials 203 on tracker 107 and the scan head fiducials 204 on scan head 110 are again sampled (e.g., using a tracked probe, imaging modality, or other method) in the same coordinate system and a secondary transformation matrix T′tu (which may be different from Ttu) is determined between scan head 110 and tracker 107. Here the prime (′) in T′tu refers to a transformation occurring at a subsequent time from the unprimed value Ttu. These sampled data may be considered the “second positions” of the fiducials relative to one another.
In an operation 405, a differential transformation matrix T is calculated between Ttu (the primary transformation) and T′tu (the secondary transformation). The differential transformation matrix T represents the difference between the first relative positions of tracker 107 and ultrasonic transducer 103 (the positions in which the initial calibration was calculated) and the second relative positions of tracker 107 and ultrasonic transducer 103. Because the relative positions between both 1) tracker fiducials 203 and sensor elements 301 and 2) scan head fiducials 204 and scan plane 206, are known and static, the difference between tracker fiducials 203 and scan head fiducials 204 (e.g., as represented by the differential transformation matrix T) provides an accurate representation of how to adjust the initial calibration. The transformation between the two coordinate systems is calculated as T=T1tu T′tu where the “−1” superscript represents the inverse of the matrix.
In an operation 406, an adjusted calibration transformation matrix T′ts is calculated. Transformation matrix T′ts may be calculated by applying the differential transformation matrix T to the initial calibration transformation matrix Tts. As mentioned above, this may also take into account the known and fixed positions of the tracker fiducials 203 to sensor elements 301, and the known and fixed positions of scan head fiducials 204 to scan plane 106. Essentially, scan plane 106 of ultrasonic transducer 103 is corrected by applying the differential transformation matrix T, so that scan plane 106 is known relative to tracker 107 in the new location/position. This enables the tracked coordinates of tracker 107 to be related to scan plane 106 of ultrasonic transducer 103 without having to perform a subsequent calibration step.
In an operation 407, trackable laparoscopic ultrasound device 100 may be used to merge preoperative images with interoperative ultrasound images using the tracked positions of tracker 107 and the adjusted calibration transformation matrix T′ts, without re-calibrating the device. As such, wherever, tracker 107 is moved relative to ultrasonic transducer 103, only a differential fiducial transformation matrix need be calculated.
Calibration jig 600 may also include outrigger elements 606 that assist in aligning tracker 107 with the ultrasonic transducer 103. The function of calibration jig 600 is, as above, to (1) assist in mechanically repositioning tracker 107 to the same location relative to ultrasonic transducer 103 and/or (2) enable the calculation of a new coordinate transformation of ultrasonic transducer relative to tracker 107. By knowing this relationship and the initial relationship between scan plan 106 and tracker 107, determination of tracker 107's location and orientation will provide enough information to accurately depict the location of scan plane 106 in any operation involving the combined device (i.e., ultrasound device 100). This will enable the location of scan plane 106 to be depicted on both CT and live ultrasound, for example.
In an operation 702, the combination of tracker 107 and ultrasonic transducer 103 is placed in calibration jig 600 and the location of tracker 107 relative to the calibration elements of calibration jig 600 (e.g., sensor elements 601, fiducials 603, digitization holes 604) is determined, taking care not to disturb the relative positions of tracker 107 and ultrasonic transducer 103. This may be done by measuring the location of tracker 107 using sensor elements 301 or tracking fiducials 203 on tracker 107 and then measuring the location of the sensor elements 602, fiducials 603, and/or digitization holes 604 on calibration jig 600. The position of tracker 107 relative to calibration jig 600 is used to determine a first calibration matrix Ttc, which may then be calculated using an ICP or SVD calculation as described in operation of 402 of process 400. Sampling of the fiducials in operation 702 may be performed using, for example, a tracked probe (e.g., electromagnetically tracked or otherwise tracked) or imaging the fiducials using on an x-ray device or other imaging modality, to obtain the locations of all points in a common coordinate system. Sampling of sensor elements 602 is performed using tracking device associated with the sensor elements such as an electromagnetic tracking device that may determine the locations and orientations of the sensor elements in a frame of reference.
In an operation 703, the calibrated system may be used. This use may be in a clinical application or may include a test use. In any event, the initial calibration transformation matrix Tts is employed to determine scan plane 106 of ultrasonic transducer 103 from sampled data of sensor elements 301 in tracker 107. As mentioned herein, this determination allows preoperative images such as CT, PET or MR images to be merged with intraoperative ultrasound data. Operation 703 also includes removing tracker 107 from ultrasound device 100 and replacing tracker 107 in a different position relative to ultrasound transducer 103. In one embodiment, operation 703 need not involve removing tracker 107 from ultrasound device 100, but may include simply moving tracker 107 relative to scan head 110.
In an operation 704, the combination of tracker 107 and ultrasound transducer 103 is returned to the calibration jig (having been removed for use in operation 703). Tracker fiducials 203 on tracker 107 and fiducials 603 or 604 of calibration jig 600 are again sampled (e.g., using a tracked probe, imaging modality, or other method) in the same coordinate system and a second transformation matrix T′tc (which may be different Ttc) from is determined between scan head 110 and tracker 107. Here the prime (′) refers to a transformation occurring at a subsequent time. Alternately, the second matrix T′tc may be determined by sampling the sensor elements 301 in the tracker 107 and the sensor elements 602 in calibration jig 600.
In an operation 705, a differential transformation matrix T is calculated between Ttc (the first transformation) and T′tc (the second transformation). The differential transformation matrix represents the difference between the first relative position of tracker 107 and ultrasonic transducer 103 (the positions in which the initial calibration was calculated) and the second relative positions of tracker 107 and ultrasonic transducer 103 (a subsequent location of the tracker, which may have been moved during use, cleaning or by accident). Because the relative positions between both 1) tracker fiducials 203 and sensor elements 301 and 2) scan head fiducials 204 and scan plane 206, are known and static, the difference between tracker fiducials 203 and scan head fiducials 204 (e.g., as represented by the differential transformation matrix) provides an accurate representation of how to adjust the initial calibration. The transformation between the two coordinate systems is calculated as T=T1tc T′tc where the “−1” superscript represents the inverse of the matrix.
In an operation 706, an adjusted calibration transformation matrix T′ts is calculated. Transformation matrix T′ts may be calculated by applying the differential transformation matrix T to the initial calibration transformation matrix Tts. As mentioned above, this may also take into account the known and fixed positions of the tracker fiducials 203 to sensor elements 301, and the known and fixed positions of scan head fiducials 204 to scan plane 106. Essentially, scan plane 106 of ultrasonic transducer 103 is corrected by applying the differential fiducial transformation matrix T, so that scan plane 106 is known relative to tracker 107 in the new location/position. This enables the tracked coordinates of tracker 107 to be related to scan plane 106 of ultrasonic transducer 103 without having to perform a subsequent calibration step.
In an operation 707, trackable laparoscopic ultrasound device 100 may be used to merge preoperative images with interoperative ultrasound images using the tracked positions of tracker 107 and the adjusted calibration transformation matrix T′ts, without re-calibrating the device. As such, wherever, tracker 107 is moved relative to ultrasonic transducer 103, only a differential fiducial transformation matrix need be calculated.
In some embodiments, more than one tracked ultrasound transducers can be used at one time. For example, a tracked ultrasound transducer can be used together with a second ultrasound transducer that provides increased and focused ultrasound energy for ablative treatment or pulsed focused ultrasound energy for assisted drug delivery. In these embodiments, the treatment ultrasound is tracked to the proper location and used to provide treatment, while the diagnostic ultrasound monitors the progress of the treatment, aids in navigation (e.g., by providing images), and may serve other purposes. In another embodiment, a single transducer may include both treatment (e.g., focused energy) and image capabilities. An example of a device capable of this dual use may be available from Focus Surgery™ of Indianapolis, Ind., U.S.A. In some embodiments, the diagnostic ultrasound can be replaced with an endoscope.
Other embodiments, uses and advantages of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The specification should be considered exemplary only, and the scope of the invention is accordingly intended to be limited only by the following claims.
This application claims priority to U.S. Provisional Patent Application No. 60/692,271, filed Jun. 21, 2005, which is hereby incorporated by reference herein in its entirety.
This invention may be supported by the Department of Health and Human Services. The Government of the United States of America may have certain rights in the invention disclosed and claimed below.
Number | Name | Date | Kind |
---|---|---|---|
3021842 | Flood | Feb 1962 | A |
4080706 | Heilman et al. | Mar 1978 | A |
4279252 | Martin | Jul 1981 | A |
4697595 | Breyer et al. | Oct 1987 | A |
4722056 | Roberts et al. | Jan 1988 | A |
4777951 | Cribier et al. | Oct 1988 | A |
4887606 | Yock et al. | Dec 1989 | A |
4895168 | Machek | Jan 1990 | A |
4935019 | Papp, Jr. | Jun 1990 | A |
4961433 | Christian | Oct 1990 | A |
5014708 | Hayashi et al. | May 1991 | A |
5042486 | Pfeiler et al. | Aug 1991 | A |
5045080 | Dyer et al. | Sep 1991 | A |
5085659 | Rydell | Feb 1992 | A |
5116345 | Jewell et al. | May 1992 | A |
5187658 | Cline et al. | Feb 1993 | A |
5204625 | Cline et al. | Apr 1993 | A |
5207675 | Canady | May 1993 | A |
5211165 | Dumoulin et al. | May 1993 | A |
5221283 | Chang | Jun 1993 | A |
5247935 | Cline et al. | Sep 1993 | A |
5251127 | Raab | Oct 1993 | A |
5251635 | Dumoulin et al. | Oct 1993 | A |
5255680 | Darrow et al. | Oct 1993 | A |
5265610 | Darrow et al. | Nov 1993 | A |
5271400 | Dumoulin et al. | Dec 1993 | A |
5275165 | Ettinger et al. | Jan 1994 | A |
5290266 | Rohling et al. | Mar 1994 | A |
5291010 | Tsuji | Mar 1994 | A |
5291890 | Cline et al. | Mar 1994 | A |
5304933 | Vavrek et al. | Apr 1994 | A |
5305203 | Raab | Apr 1994 | A |
5307812 | Hardy et al. | May 1994 | A |
5318025 | Dumoulin et al. | Jun 1994 | A |
5323779 | Hardy et al. | Jun 1994 | A |
5327884 | Hardy et al. | Jul 1994 | A |
5353808 | Viera | Oct 1994 | A |
5365927 | Roemer et al. | Nov 1994 | A |
5368031 | Cline et al. | Nov 1994 | A |
5368032 | Cline et al. | Nov 1994 | A |
5377678 | Dumoulin et al. | Jan 1995 | A |
5383454 | Bucholz | Jan 1995 | A |
5383465 | Lesny et al. | Jan 1995 | A |
5386828 | Owens et al. | Feb 1995 | A |
5389101 | Heilbrun et al. | Feb 1995 | A |
5391199 | Ben-Haim | Feb 1995 | A |
5396905 | Newman et al. | Mar 1995 | A |
5400383 | Yassa et al. | Mar 1995 | A |
5437277 | Dumoulin et al. | Aug 1995 | A |
5443066 | Dumoulin et al. | Aug 1995 | A |
5443068 | Cline et al. | Aug 1995 | A |
5445150 | Dumoulin et al. | Aug 1995 | A |
5465732 | Abele | Nov 1995 | A |
5480382 | Hammerslag et al. | Jan 1996 | A |
5490840 | Uzgiris et al. | Feb 1996 | A |
5493598 | Yassa et al. | Feb 1996 | A |
5526812 | Dumoulin et al. | Jun 1996 | A |
5526814 | Cline et al. | Jun 1996 | A |
5558091 | Acker et al. | Sep 1996 | A |
5603318 | Heilbrun et al. | Feb 1997 | A |
5645065 | Shapiro et al. | Jul 1997 | A |
5646524 | Gilboa | Jul 1997 | A |
5646525 | Gilboa | Jul 1997 | A |
5647373 | Paltieli | Jul 1997 | A |
5705014 | Schenck et al. | Jan 1998 | A |
5713858 | Heruth et al. | Feb 1998 | A |
5715166 | Besl et al. | Feb 1998 | A |
5715822 | Watkins et al. | Feb 1998 | A |
5740802 | Nafis et al. | Apr 1998 | A |
5749835 | Glantz | May 1998 | A |
5769790 | Watkins et al. | Jun 1998 | A |
5769861 | Vilsmeier | Jun 1998 | A |
5848969 | Panescu et al. | Dec 1998 | A |
5857032 | Wang et al. | Jan 1999 | A |
5868673 | Vesely | Feb 1999 | A |
5873845 | Cline et al. | Feb 1999 | A |
5880976 | DiGioia, III et al. | Mar 1999 | A |
5931786 | Whitmore, III et al. | Aug 1999 | A |
5944023 | Johnson et al. | Aug 1999 | A |
5978696 | VomLehn et al. | Nov 1999 | A |
6016439 | Acker | Jan 2000 | A |
6036682 | Lange et al. | Mar 2000 | A |
6073043 | Schneider | Jun 2000 | A |
6097978 | Demarais et al. | Aug 2000 | A |
6106476 | Corl et al. | Aug 2000 | A |
6141576 | Littmann et al. | Oct 2000 | A |
6147480 | Osadchy et al. | Nov 2000 | A |
6165184 | Verdura et al. | Dec 2000 | A |
6188355 | Gilboa | Feb 2001 | B1 |
6196980 | Akerfeldt et al. | Mar 2001 | B1 |
6203493 | Ben-Haim | Mar 2001 | B1 |
6203543 | Glossop | Mar 2001 | B1 |
6205411 | DiGioia, III et al. | Mar 2001 | B1 |
6210339 | Kiepen et al. | Apr 2001 | B1 |
6216029 | Paltieli | Apr 2001 | B1 |
6226543 | Gilboa et al. | May 2001 | B1 |
6233476 | Strommer et al. | May 2001 | B1 |
6235038 | Hunter et al. | May 2001 | B1 |
6241690 | Burkett et al. | Jun 2001 | B1 |
6266551 | Osadchy et al. | Jul 2001 | B1 |
6266552 | Slettenmark | Jul 2001 | B1 |
6272370 | Gillies et al. | Aug 2001 | B1 |
6272371 | Shlomo | Aug 2001 | B1 |
6285898 | Ben-Haim | Sep 2001 | B1 |
6285903 | Rosenthal et al. | Sep 2001 | B1 |
6288785 | Frantz et al. | Sep 2001 | B1 |
6308089 | von der Ruhr et al. | Oct 2001 | B1 |
6314310 | Ben-Haim et al. | Nov 2001 | B1 |
6317621 | Graumann et al. | Nov 2001 | B1 |
6332089 | Acker et al. | Dec 2001 | B1 |
6336906 | Hammarstrom et al. | Jan 2002 | B1 |
6338716 | Hossack et al. | Jan 2002 | B1 |
6356783 | Hubbard, Jr. | Mar 2002 | B1 |
6380732 | Gilboa | Apr 2002 | B1 |
6381485 | Hunter et al. | Apr 2002 | B1 |
6383174 | Eder | May 2002 | B1 |
6385482 | Boksberger et al. | May 2002 | B1 |
6427079 | Schneider et al. | Jul 2002 | B1 |
6442417 | Shahidi et al. | Aug 2002 | B1 |
6453190 | Acker et al. | Sep 2002 | B1 |
6468265 | Evans et al. | Oct 2002 | B1 |
6473635 | Rasche | Oct 2002 | B1 |
6484118 | Govari | Nov 2002 | B1 |
6493589 | Medhkour et al. | Dec 2002 | B1 |
6498944 | Ben-Haim et al. | Dec 2002 | B1 |
6499488 | Hunter et al. | Dec 2002 | B1 |
6500114 | Petitto et al. | Dec 2002 | B1 |
6512958 | Swoyer et al. | Jan 2003 | B1 |
6529758 | Shahidi | Mar 2003 | B2 |
6547782 | Taylor | Apr 2003 | B1 |
6558333 | Gilboa et al. | May 2003 | B2 |
6574492 | Ben-Haim et al. | Jun 2003 | B1 |
6574498 | Gilboa | Jun 2003 | B1 |
6580938 | Acker | Jun 2003 | B1 |
6585654 | White et al. | Jul 2003 | B2 |
6588333 | Homer et al. | Jul 2003 | B1 |
6591129 | Ben-Haim et al. | Jul 2003 | B1 |
6593127 | McKinnon | Jul 2003 | B1 |
6593884 | Gilboa et al. | Jul 2003 | B1 |
6615155 | Gilboa | Sep 2003 | B2 |
6619838 | Bencini et al. | Sep 2003 | B2 |
6628987 | Hill et al. | Sep 2003 | B1 |
6690963 | Ben-Haim et al. | Feb 2004 | B2 |
6702780 | Gilboa et al. | Mar 2004 | B1 |
6711429 | Gilboa et al. | Mar 2004 | B1 |
6719700 | Willis | Apr 2004 | B1 |
6735471 | Hill et al. | May 2004 | B2 |
6748112 | Nguyen et al. | Jun 2004 | B1 |
6753873 | Dixon et al. | Jun 2004 | B2 |
6782287 | Grzeszczuk et al. | Aug 2004 | B2 |
6783536 | Vilsmeier et al. | Aug 2004 | B2 |
6785571 | Glossop | Aug 2004 | B2 |
6788967 | Ben-Haim et al. | Sep 2004 | B2 |
6792303 | Taimisto | Sep 2004 | B2 |
6893429 | Petersen | May 2005 | B2 |
6895268 | Rahn et al. | May 2005 | B1 |
6916290 | Hedengren et al. | Jul 2005 | B2 |
7085400 | Holsing et al. | Aug 2006 | B1 |
7386339 | Strommer et al. | Jun 2008 | B2 |
7570791 | Frank et al. | Aug 2009 | B2 |
20010008972 | Gielen | Jul 2001 | A1 |
20010011175 | Hunter et al. | Aug 2001 | A1 |
20010031919 | Strommer et al. | Oct 2001 | A1 |
20010031985 | Gilboa et al. | Oct 2001 | A1 |
20010036245 | Kienzle, III et al. | Nov 2001 | A1 |
20010038354 | Gilboa | Nov 2001 | A1 |
20010039419 | Francischelli et al. | Nov 2001 | A1 |
20010047133 | Gilboa et al. | Nov 2001 | A1 |
20020005719 | Gilboa et al. | Jan 2002 | A1 |
20020038102 | McFarlin et al. | Mar 2002 | A1 |
20020042571 | Gilboa et al. | Apr 2002 | A1 |
20020049375 | Strommer et al. | Apr 2002 | A1 |
20020049451 | Parmer et al. | Apr 2002 | A1 |
20020062203 | Gilboa | May 2002 | A1 |
20020074005 | Hogg et al. | Jun 2002 | A1 |
20020087101 | Barrick et al. | Jul 2002 | A1 |
20020143317 | Glossop | Oct 2002 | A1 |
20020156363 | Hunter et al. | Oct 2002 | A1 |
20020156417 | Rich et al. | Oct 2002 | A1 |
20020165448 | Ben-Haim et al. | Nov 2002 | A1 |
20020165468 | Tolkowsky et al. | Nov 2002 | A1 |
20030018251 | Solomon | Jan 2003 | A1 |
20030021455 | Dixon et al. | Jan 2003 | A1 |
20030028233 | Vardi et al. | Feb 2003 | A1 |
20030030004 | Dixon et al. | Feb 2003 | A1 |
20030074011 | Gilboa et al. | Apr 2003 | A1 |
20030092988 | Makin | May 2003 | A1 |
20030114778 | Vilsmeier et al. | Jun 2003 | A1 |
20030114846 | Fuimaono et al. | Jun 2003 | A1 |
20030130576 | Seeley et al. | Jul 2003 | A1 |
20030171680 | Paltieli | Sep 2003 | A1 |
20030171739 | Murphy et al. | Sep 2003 | A1 |
20030208102 | Gilboa | Nov 2003 | A1 |
20030208296 | Brisson et al. | Nov 2003 | A1 |
20030216639 | Gilboa et al. | Nov 2003 | A1 |
20030220557 | Cleary et al. | Nov 2003 | A1 |
20040019274 | Galloway, Jr. et al. | Jan 2004 | A1 |
20040024309 | Ferre et al. | Feb 2004 | A1 |
20040034297 | Darrow et al. | Feb 2004 | A1 |
20040034300 | Verard et al. | Feb 2004 | A1 |
20040036867 | Jedamzik et al. | Feb 2004 | A1 |
20040077942 | Hall et al. | Apr 2004 | A1 |
20040078036 | Keidar | Apr 2004 | A1 |
20040097804 | Sobe | May 2004 | A1 |
20040097805 | Verard et al. | May 2004 | A1 |
20040097806 | Hunter et al. | May 2004 | A1 |
20040138548 | Strommer et al. | Jul 2004 | A1 |
20040143188 | Barzell et al. | Jul 2004 | A1 |
20040147837 | Macaulay et al. | Jul 2004 | A1 |
20040147939 | Rabkin et al. | Jul 2004 | A1 |
20040158146 | Mate et al. | Aug 2004 | A1 |
20040221853 | Miller | Nov 2004 | A1 |
20040234933 | Dawson et al. | Nov 2004 | A1 |
20040249267 | Gilboa | Dec 2004 | A1 |
20040254458 | Govari | Dec 2004 | A1 |
20050033149 | Strommer et al. | Feb 2005 | A1 |
20050038337 | Edwards | Feb 2005 | A1 |
20050049520 | Nakao | Mar 2005 | A1 |
20050054900 | Mawn et al. | Mar 2005 | A1 |
20050059886 | Webber | Mar 2005 | A1 |
20050085715 | Dukesherer et al. | Apr 2005 | A1 |
20050085720 | Jascob et al. | Apr 2005 | A1 |
20050085793 | Glossop | Apr 2005 | A1 |
20050107688 | Strommer | May 2005 | A1 |
20050113659 | Pothier et al. | May 2005 | A1 |
20050182295 | Soper et al. | Aug 2005 | A1 |
20050182319 | Glossop | Aug 2005 | A1 |
20050228270 | Lloyd et al. | Oct 2005 | A1 |
20060147100 | Fitzpatrick | Jul 2006 | A1 |
20070032862 | Weber et al. | Feb 2007 | A1 |
Number | Date | Country |
---|---|---|
6367896 | Feb 1997 | AU |
722539 | Aug 2000 | AU |
9609484 | Dec 1999 | BR |
2226938 | Feb 1997 | CA |
69420228 D | Sep 1999 | DE |
69420228 | Apr 2000 | DE |
19845267 | May 2000 | DE |
0 845 959 | Jun 1998 | EP |
0 654 244 | Aug 1999 | EP |
1 466 552 | Oct 2004 | EP |
0107523 | Jan 2000 | IL |
0114610 | Jul 2000 | IL |
10-277047 | Oct 1998 | JP |
2000500031 | Jan 2000 | JP |
2005152463 | Jun 2005 | JP |
WO 9703609 | Feb 1997 | WO |
WO 9856295 | Dec 1998 | WO |
WO 0022904 | Apr 2000 | WO |
Entry |
---|
Knaan, Dotan, et al., Effective Intensity-Based 2D/3D Rigid Registration Between Fluoroscopic X-Ray and CT, MICCAI, vol. 1, 2003, pp. 351-358. |
Gee, A. H., et al., “3D Ultrasound Probe Calibration Without a Position Sensor”, CUED/F-INFENG/TR 488, University of Cambridge, Department of Engineering, Sep. 2004, 21 pages. |
Lindseth, Frank, et al., “Probe Calibration for Freehand 3D Ultrasound Reconstruction and Surgical Navigation”, Dec. 2002, 27 pages. |
Fuchs, Henry, et al., “Towards Performing Ultrasound-Guided Needle Biopsies from Within a Head-Mounted Display”, University of North Carolina, Department of Computer Science, 1996, 10 pages; [Lecture Notes in Computer Science; vol. 1131 archive Proceedings of the 4th International Conference on Visualization in Biomedical Computing table of contents, pp. 591-600 Year of Publication: 1996, ISBN:3-540-61649-7; Hamburg, Germany, Sep 22-25, 1996).]. |
Henry Fuchs, Andrei State, Mark A. Livingston, William F. Garrett, Gentaro Hirota, Mary Whitton and Etta D. Pisano (MD). “Virtual Environments Technology to Aid Needle Biopsies of the Breast: An Example of Real-Time Data Fusion.” Proceedings of Medicine Meets Virtual Reality:4 (Jan. 17-20, 1996, San Diego, California), IOS Press, Amsterdam, Jan. 1996. |
RITA StarBurst Soft Tissue Access System and RITA StarBurst Hard Tissue Access System, http://www.ritamedical.com, Rita Medical Systems, Inc., copyright 2002, 8 pages. |
Cool-tip RF Tissue Ablation System, Cool-tip RF System, and Cool-tip Electrodes, http://www.valleylab.com/static/cooltip/products.html, Valleylab, copyright 2004, 4 pages. |
LeVeen Needle Electrode, Boston Scientific, printed from http://www.bostonscientific.com/med—specialty/deviceDetail.ihtml?task= tskBasicDevice . . . , printed on Sep. 13, 2004, 1 page. |
Bradford J. Wood et al., “Navigation with Electromagnetic Tracking for Interventional Radiology Procedures: A Feasibility Study”, Laboratory Investigations, Journal of Vasc. Interv. Radiol., vol. 16, 2005, pp. 493-505. |
Tanase, Dafina, et al., “Magnetic Sensors for Use on Guide Wires or Catheters”, in SeSens 2001, in press 2002, pp. 868-872. |
Solomon, Stephen B., et al., “Three-Dimensional CT-Guided Bronchoscopy with a Real-Time Electromagnetic Position Sensor: A Comparison of Two Image Registration Methods”, Chest, vol. 118, No. 6, Dec. 2000, pp. 1783-1787. |
Solomon, Stephen B., et al., “Real-Time Cardiac Catheter Navigation on Three-Dimensional CT Images”, Journal of Interventional Cardiac Electrophysiology, vol. 8, 2003, pp. 27-36. |
Palti-Wasserman, Daphna, et al., “Identifying and Tracking a Guide Wire in the Coronary Arteries During Angioplasty from X-Ray Images”, IEEE Transactions on Biomedical Engineering, vol. 44, No. 2, Feb. 1997, pp. 152-164. |
Baert, Shirley A. M., et al., “Endpoint Localization in Guide Wire Tracking During Endovascular Interventions”, Academic Radiology, vol. 10, No. 12, Dec. 2003, pp. 1424-1432. |
Baert, Shirley A. M., et al., “Three-Dimensional Guide-Wire Reconstruction from Biplane Image Sequences for Integrated Display in 3-D Vasculature”, IEEE Transactions on Medical Imaging, vol. 22, No. 10, Oct. 2003, pp. 1252-1258. |
Baert, Shirley A. M., et al., “Guide-Wire Tracking During Endovascular Interventions”, IEEE Transactions on Medical Imaging, vol. 22, No. 8, Aug. 2003, pp. 965-972. |
Kobashi, Keiji, et al., “A New Biomechanical Model Based Approach on Brain Shift Compensation”, MICCAI 2003, LNCS 2878, 2003, pp. 59-66. |
Timinger, Holger, et al., “Motion Compensation for Interventional Navigation on 3D Static Roadmaps Based on an Affine Model and Gating”, Physics in Medicine and Biology, vol. 49, 2004, pp. 719-732. |
Lorigo, Liana M., et al., “Curves: Curve Evolution for Vessel Segmentation” Medical Image Analysis, vol. 5, 2001, pp. 195-206 (pp. 1-14). |
Chassat, Fabrice, et al., “Experimental Protocol of Accuracy Evaluation of 6-D Localizers for Computer-Integrated Surgery: Application to Four Optical Localizers”, MICCAI 98, vol. 1496, Oct. 1998, Cambridge, Massachusetts U.S.A., p. 277-284. |
Tsai, Roger Y., “A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses”, IEEE Journal of Robotics and Automation, vol. RA-3, No. 4, Aug. 1987, pp. 323-344. |
“Semi-Automatic Registration for Image Guided Surgery”, Traxtal poster presented at CAOS '99 (Computer Assisted Orthopaedic Surgery, 4th International Symposium), MICCAI, Mar. 17-19, 1999, Davos, Switzerland, 1 page. |
Wu, Xiaohui, et al., “A Direction Space Interpolation Technique for Calibration of Electromagnetic Surgical Navigation Systems”, Lecture Notes in Computer Science Medical Image Computing and Computer-Assisted Intervention, MICCAI 2003, LNCS 2879, Publisher: Springer-Verlag Heidelberg, 2003, pp. 215-222. |
Livyatan, Harel, “Calibration and Gradient-Based Rigid Registration of Fluoroscopic X-raysto CT, for Intra Operative Navigation”, Master of Science Thesis, supervised by Prof. Leo Joskowicz, School of Computer Science and Engineering, The Hebrew University of Jerusalem, Israel, Jul. 27, 2003, 92 pages. |
SuperDimension, Ltd, web page, updated in Sep. 2005, 1 page. |
Schweikard, Achim, et al., “Robotic Motion Compensation for Respiratory Movement During Radiosurgery”, Computer Aided Surgery, vol. 5, 2000, pp. 263-277. |
Solomon, Stephen B., et al., “Real-Time Bronchoscope Tip Localization Enables Three-Dimensional CT Image Guidance for Transbronchial Needle Aspiration in Swine” Chest, vol. 114, No. 5, Nov. 1998, pp. 1405-1410. |
Ellsmere, James, et al., “A Navigation System for Augmenting Laparoscopic Ultrasound”, Center for Integration of Medicine and Innovative Technology, Cambridge, Massachusetts, 8 pages. |
Hofstetter, R., et al., “Fluoroscopy Based Surgical Navigation—Concept and Clinical Applications”, Maurice E. Muller Institute for Biomechanics, University of Bern, Switzerland, 1997, 3 pages. |
Tapper, Michael, et al., “Problems Encountered in the Implementation of Tsai's Algorithm for Camera Calibration”, Proc. 2002 Australasian Conference on Robotics and Automation, Auckland, Nov. 27-29, 2002, pp. 66-70. |
Summers, Ronald M., et al., “Colonic Polyps: Complementary Role of Computer-Aided Detection in CT Colonography”, Radiology, vol. 225, No. 2, Nov. 2002, pp. 391-399. |
Hara, A. K., et al., “Reducing Data Size and Radiation Dose for CT Colonography”, AJR, vol. 168, May 1997, pp. 1181-1184. |
Number | Date | Country | |
---|---|---|---|
20070167787 A1 | Jul 2007 | US |
Number | Date | Country | |
---|---|---|---|
60692271 | Jun 2005 | US |