The present invention generally relates to calibration of an ultrasound probe. The present invention specifically relates to localizing an ultrasound probe and an ultrasound image generated by the ultrasound probe within a same coordinate system for purposes of determining an otherwise unknown transformation matrix between the ultrasound probe and the ultrasound image.
Electromagnetic (“EM”) tracking of a position of an ultrasound image has many benefits in medical diagnosis and intervention. For example, during a prostate brachytherapy or biopsy, a transrectal ultrasound (“TRUS”) probe may be utilized for image guidance of a navigation of needles/catheters inside the prostate tissue to specific targets for the delivery of treatment thereto. More particularly, the EM-tracking the position of the TRUS probe is used for reconstruction of three-dimensional (“3D”) volumes and also for localization of other objects in the ultrasound image coordinate system.
In order to employ an EM-tracked TRUS probe, it is imperative to identify a relationship between the ultrasound image coordinate system and the EM-tracker coordinate system. Historically, the TRUS probes may be calibrated manually in a water tank. In this method, while the TRUS probe is immersed in water, a user inserts an EM-tracked pointed object (e.g., a needle) into the ultrasound field of view. As soon as the pointed object intersects with the TRUS image, the operator marks the position of the object tip on the ultrasound image. To achieve a reliable calibration, this position marking process is repeated several times and at several positions of the TRUS probe. However, manual probe calibration is subjective, tedious and time-consuming. Besides, most often, the object is advanced toward the ultrasound image from one side only. Therefore, the ultrasound image thickness reduces that accuracy of the calibration.
A calibration phantom with automatic calibration may solve the aforementioned problems of manual calibration.
The present invention proposes a method and apparatus for automatic calibration of a tracked ultrasound probe, particularly an EM-tracked TRUS probe.
One form of the present invention is an ultrasound calibration system employing a calibration phantom, an ultrasound probe (e.g., a TRUS probe) and a calibration workstation. The calibration phantom encloses a frame assembly within a calibration coordinate system established by one or more phantom trackers (e.g., EM trackers). In operation, the ultrasound probe acoustically scans an image of the frame assembly within an image coordinate system relative to a scan coordinate system established by one or more probe trackers (e.g., EM trackers). The calibration workstation localizes the ultrasound probe and the frame assembly image within the calibration coordinate system and determines a calibration transformation matrix between the image coordinate system and the scan coordinate system from the localizations.
Another form of the present invention is an ultrasound calibration system employing a calibration phantom and a calibration workstation. The calibration phantom encloses a frame assembly within a calibration coordinate system established by one or more phantom trackers (e.g., EM trackers). In operation, an ultrasound probe (e.g., a TRUS probe) acoustically scans an image of the frame assembly within an image coordinate system relative to a scan coordinate system established by one or more probe trackers (e.g., EM trackers). The calibration workstation localizes the ultrasound probe and the frame assembly image within the calibration coordinate system and determines a calibration transformation matrix between the image coordinate system and the scan coordinate system from the localizations.
An additional form of the present invention is an ultrasound calibration method involving a positioning of an ultrasound probe relative to a calibration phantom enclosing a frame assembly within a calibration coordinate system, an operation of the ultrasound probe to acoustically scan an image of the frame assembly within an image coordinate system relative to a scan coordinate system of the ultrasound probe, a localization of the ultrasound probe and the frame assembly image within the calibration coordinate system, and a determination of a calibration transformation matrix between the image coordinate system and the scan coordinate system as a function of the localizations.
The foregoing forms and other forms of the present invention as well as various features and advantages of the present invention will become further apparent from the following detailed description of various embodiments of the present invention read in conjunction with the accompanying drawings. The detailed description and drawings are merely illustrative of the present invention rather than limiting, the scope of the present invention being defined by the appended claims and equivalents thereof.
To facilitate an understanding of the present invention, exemplary embodiments of the present invention will be provided herein directed to an ultrasound calibration system shown in
Referring to
An ultrasound probe of the present invention is any device as known in the art for scanning an anatomical region of a patient via acoustic energy. An example of the ultrasound probe includes, but is not limited to, TRUS probe 10 as shown in
A calibration phantom of the present invention is any type of container as known in the art of a known geometry for containing the frame assembly and having an acoustic window for facilitating a scanning of the frame assembly by the ultrasound probe. In practice, the calibration phantom may have any geometrical shape and size suitable for the calibration of one or more types of ultrasound probes. For example, as shown in
A frame assembly of the present invention is any arrangement of one or more frames assembled within a frame coordinate system. In practice, each frame may have any geometrical shape and size, and the arrangement of the frames within the frame coordinate system is suitable for distinctive imaging by the ultrasound probe of frame pixels dependent on the relative positioning of the ultrasound probe to the calibration phantom. Examples of each frame include, but are not limited to, Z-wire frames as shown in
A tracking system of the present invention is any system as known in the art employing one or more energy generator(s) for emitting energy (e.g., magnetic or optical) to one or more energy sensors within a reference area. For example, as shown in
The present invention is premised upon equipping the calibration phantom with one or more EM-phantom tracker(s) and upon equipping the ultrasound probe with one or more EM-probe tracker(s). In practice, the EM-phantom tracker(s) are strategically positioned relative to the calibration phantom for establishing a calibration coordinate system, and the EM-probe tracker(s) are strategically positioned relative to the calibration phantom for establishing a scan coordinate system. For example, as shown in
The present invention is further premised on determining a transformation matrix between the frame assembly and the calibration phantom prior to the calibration of the ultrasound probe. In practice, any method as known in the art may be implemented for determining a transformation matrix between the frame assembly and the calibration phantom. For example, as related to
A calibration workstation of the present invention is any type of workstation or comparable device as known in the art for controlling a calibration of the ultrasound probe in accordance with an ultrasound calibration method of the present invention. For example, as shown in
Referring to
Ultrasound imager 52 is a structural configuration of hardware, software, firmware and/or circuitry of workstation 40a as known in the art for generating an ultrasound image of frame assembly 21 as scanned by ultrasound probe 10 during a stage S62 of flowchart 60. Based on the geometry and arrangement of frames within frame assembly 21, any particular ultrasound image of frame assembly 21 as scanned by ultrasound probe 10 will illustrate a unique spacing of frame pixels as known in the art. For example, as shown in
Image localizer 53 is a structural configuration of hardware, software, firmware and/or circuitry of workstation 40a as would appreciated by those skilled in the art for localizing the ultrasound image within the calibration coordinate system of calibration phantom 20. More particularly, during a stage S62 of flowchart 60, image localizer 53 processes the unique frame imaging of ultrasound image 11 (e.g., ultrasound image 11a) to determine a position of ultrasound image 11 within the frame coordinate system and to compute a transformation matrix T1→F between ultrasound image 11 and frame assembly 21.
Probe calibrator 54 is a structural configuration of hardware, software, firmware and/or circuitry of workstation 40a as would appreciated by those skilled in the art for calibrating TRUS probe 10 as a function of the previously computed transformation matrixes. More particularly, during a stage S63 of flowchart 60, probe calibrator 54 executes the following equation [1] to compute a transformation matrix TI→T between ultrasound probe 10 and ultrasound image 11.
T
I→P=(TP→EM)−1*TF→EM*TI→F [1]
In practice, stages S61 and S62 may be implemented in any order or concurrently. Furthermore, flowchart 60 may be repeated as necessary or desired for different positions of the ultrasound probe relative to the calibration phantom.
To facilitate a further understanding of the ultrasound calibration system, a description of various embodiments of calibration phantom 20 and frame assembly 21 will now be provided herein.
Referring to
Alternatively, calibration phantom 20a may be with up to six (6) EM sensors 31a located at precisely known location with respect to Z-frames 21a. Combined together, these sensors may be utilized to create calibration coordinate system CEM, and may also be utilized for noise reduction in EM tracking. In a preferred setting, six (6) EM sensors 31a would be utilized on the side walls of calibration phantom 20.
During the calibration procedure, calibration phantom 20a is filled with water and/or appropriate liquid(s) or gels and TRUS probe 10 captures an axial image 11a of Z-frames 21a through calibration phantom 20. Z-frames 21a intersect with image 11a at six (6) points as shown in
EM sensor(s) 32a on TRUS probe 10 are localized in the calibration coordinate system CEM using EM sensor(s) 31a and the EM field generator 30 such that transformation matrix TP→EM between the probe coordinate system CP and the calibration coordinate system CEM is known. Knowing the transformation matrices TF→EM, TP→EM and TI→F, the calibration transformation matrix TI→P may be computed in accordance with equation [1] as previously described herein.
In practice, an ultrasound probe may have more than one (1) imaging array on the shaft. Typically, if there are two (2) imaging arrays, these arrays are orthogonal to each other. For example, if one array images an axial plane, then the other array images a sagittal plane. Accordingly, calibration phantom 20a may be designed and constructed to enable calibration of an axial imaging array with respect to EM sensor(s) 32a on TRUS probe 10 as shown in
Alternatively, the two (2) imaging arrays may be simultaneously calibrated to the EM tracker on the probe by having two (2) orthogonal pairs 21a and 21b of Z-frames mounted in the calibration phantom 20 as shown in
In another embodiment (not shown in any drawing), a single pair 21a of Z-frames may be used to sequentially calibrate both the axial array and the sagittal array of ultrasound probe 10. For this embodiment, calibration phantom 20a is designed to have two (2) openings/cavities to hold ultrasound probe 10. For one opening/cavity, the axial array of ultrasound probe 10 intersects pair of Z-frames and is calibrated as previously explained herein. In the other orthogonal opening/cavity, the sagittal array of ultrasound probe 10 intersects the same pair Z-frames and is calibrated independent of the axial array calibration.
Referring back to
To address the accuracy of EM phantom trackers,
Accordingly, a transformation TEMi→Ref from each of the other box EM trackers (CEmi, i∈{2,3, . . . }) to the reference coordinate system (CRef=CEMI) is known from a precise design calibration phantom 20a. In addition, there is another transformation matrix T′EMi→Ref from each of EM sensor 31b-31h to reference sensor 31a measured by a tracking correction module (not shown) of calibration workstation 40a, which is different from TEMi→Ref due to deviations and errors in the magnetic field inside calibration phantom 20a. Therefore a correction function ƒ may be identified in accordance with the following equation [2]:
T
EMi→Ref=ƒ(T′EMi→Ref) [2]
where ƒ can be linear or quadratic. After identification of this corrective function, the EM measurement of the probe position is correctable by the tracking correction module of calibration workstation 40a in accordance with the following equation [3]:
T
P→Ref=ƒ(T′P→Ref) [3]
where T′P→Ref is the measured probe to reference transformation matrix by the EM tracking system and TP→Ref is the corrected probe to reference transformation matrix. This new probe position delivers higher accuracy in TRUS-EM calibration.
In one scenario, the corrective function in accordance with the following equation [4]:
T
P→Ref
=T′
P→Ref
+Σw
i(xp, yp, zp)(TEMi→Ref−T′EMi→Ref) [4]
where wi(xp,yp,zp) is a linear function and xp, yp and zl, are the coordinates of the TRUS probe EM-tracker measured by the tracking correction module of calibration workstation 40a.
Referring to
TRUS probe 10, calibration phantom 20, EM field generator 30, EM-phantom tracker 31 and EM-probe tracker 32 have previously described herein with reference to
A sensor assembly of the present invention is any arrangement of one or more sensors (e.g., EM sensors or optical sensors) mounted within the calibration phantom. In practice, any arrangement of the sensors within the calibration phantom is suitable for positional imaging by the ultrasound probe for validation purposes of the transformation matrix between the ultrasound probe and generated images. An example of a sensor arrangement includes, but is not limited to, the EM sensors 23 as shown in
A validation workstation of the present invention is workstation or comparable device as known in the art for controlling a validation of a calibration of the ultrasound probe in accordance with an ultrasound validation method of the present invention. For example, as shown in
Referring to
As previously described herein ultrasound imager 52 is a structural configuration of hardware, software, firmware and/or circuitry of workstation 40b as known in the art for generating an ultrasound image of sensor assembly 22 as scanned by ultrasound probe 10 during a stage S72 of flowchart 70. Based on the arrangement of sensors within calibration phantom 20, any particular ultrasound image of sensor assembly 22 as scanned by ultrasound probe 10 will correspond to a distinctive positioning of TRUS probe 10 relative to calibration phantom 20.
Image estimator 55 is a structural configuration of hardware, software, firmware and/or circuitry of workstation 40b as would appreciated by those skilled in the art for estimating a coordinate position of each sensor illustrated in the ultrasound image based on transformation matrix TI→P. More particularly, during stage S72 of flowchart 70, image estimator 55 receives tracking signals from sensor assembly 22 and estimates coordinate positions of each sensor illustrated in the ultrasound image based on transformation matrix TI→P and transformation matrix TP→EM.
Probe validator 54 is a structural configuration of hardware, software, firmware and/or circuitry of workstation 40b as would appreciated by those skilled in the art for visually validating the calibration of TRUS probe 10 based on the estimation of stage S72. More particularly, during a stage S73 of flowchart 70, probe validator 54 compares estimated coordinate positions of each sensor 22 within ultrasound image 12 to the actual position of each sensor 22 illustrated in the ultrasound image. For example, as shown in
To facilitate a further understanding of the ultrasound validation system,
In practice, validation workstation 40b (
Referring to
While various embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that the embodiments of the present invention as described herein are illustrative, and various changes and modifications may be made and equivalents may be substituted for elements thereof without departing from the true scope of the present invention. In addition, many modifications may be made to adapt the teachings of the present invention without departing from its central scope. Therefore, it is intended that the present invention not be limited to the particular embodiments disclosed as the best mode contemplated for carrying out the present invention, but that the present invention includes all embodiments falling within the scope of the appended claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2014/066937 | 12/16/2014 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
61917615 | Dec 2013 | US | |
61917615 | Dec 2013 | US |