The present disclosure generally relates to X-ray calibration. The present disclosure specifically relates to an imaging of an X-ray ripple marker for X-ray calibration.
X-ray C-arm systems are frequently used in minimally invasive surgical procedures (e.g., orthopedic procedures, vascular interventions, etc.) for enabling surgeons to see inside a patient body by taking X-ray images from arbitrary directions. More particularly, a mobile C-arm usually has wheels to provide mobility around the room and once positioned, the mobile C-arm allows the user to adjust the position of the C-arm in five (5) directions. While this provides flexibility in the execution of minimally invasive surgical procedures, the exact position and angle of the X-ray projection is not known. This precludes the user from employing advanced tools including making true three-dimensional (“3D”) measurements, large field of view imaging, dynamic overlay of pre-operative or intraoperative information, and target localization for image guided intervention. Thus, after a positioning of the mobile C-arm with respect to the patient body, there has been a need to compute a pose of the X-ray projection with respect to a fixed coordinate system, which is conventionally called C-arm Registration. Specifically, a mobile C-arm position is computed with respect to a fixed coordinate system and described by a homogeneous transformation composed of a translation vector (t∈R3) and a rotation matrix (R∈SO(3)). Therefore, the task has been to compute the pair (t, R) that accurately describes the position of the mobile C-arm with respect to the fixed coordinate system.
One historic approach for solving the C-arm Registration required an installation of hardware on the C-arm (e.g., optical tracking markers, inertial markers, etc.). This approach requires the addition of multiple components to the room and often negatively impacts the workflow for the procedure.
A current practice for C-Arm Registration is to provide a marker having a fixed position in the operating space (e.g., a marker attached to a robot or an operating table), and to generate an X-ray image of features of the marker to perform the C-arm Registration (e.g., steel balls or features of a known geometry). For such markers, there are cost-benefit tradeoffs with respect to a required registration accuracy, the number of opaque features on the marker, size of the marker, impact to the workflow, and impact to the x-ray image.
While known C-arm Registration methods have proven to be beneficial, there remains a need for improved techniques for providing accurate and reliable C-arm Registration, particularly for mobile C-arms. The present disclosure teaches a X-ray ripple marker that creates one or more X-ray imaged wave(s) with characteristics that are a function of a pose of an X-ray projection by the C-arm with respect to the X-ray ripple marker. In some implementations, X-ray ripple marker employs additional features (e.g., copper or steel balls) that improve registration algorithm robustness.
One embodiment of the present disclosure is an C-arm registration system employing a C-arm registration controller for registering a C-arm to an X-ray ripple marker including a ripple pattern radially extending from a fixed point of the X-ray ripple marker. The C-arm registration controller is configured to identify the ripple pattern within an X-ray image generated from an X-ray projection by the C-arm and illustrative of a portion or an entirety of the marker, to analyze the ripple pattern within the X-ray image to derive one or more transformation parameters, and to register the C-arm to the X-ray ripple marker based on the transformation parameter(s).
The identification of the ripple pattern within the X-ray image is characteristic of a pose of the X-ray projection by the C-arm relative to the X-ray rippler marker, and the transformation parameter(s) is(are) definitive the pose of the X-ray projection by the C-arm relative to the X-ray rippler marker.
The pose of the X-ray projection by the C-arm relative to the X-ray ripple marker encompasses a location and/or an orientation of the X-ray projection by the C-arm within a coordinate system associated with the X-ray ripple marker (e.g., a coordinate system having the fixed point of the X-ray ripple marker as the origin or a coordinate system of an intervention device such as an intervention robot system having the X-ray ripple marker attached thereto).
In one embodiment of the C-arm registration system, the C-arm registration controller employs non-transitory machine-readable storage medium encoded with instructions for execution by one or more processors to identify the ripple pattern within an X-ray image generated from an X-ray projection by the C-arm and illustrative of a portion or an entirety of the X-ray ripple marker, to analyze the ripple pattern within the X-ray image to derive the transformation parameter(s), and to register the C-arm to the X-ray ripple marker based on the transformation parameter(s).
Another embodiment of the present disclosure is an C-arm registration method executable by the C-arm registration controller. In operation, C-arm registration controller identifies the ripple(s) pattern within an X-ray image generated from an X-ray projection by the C-arm and illustrative of a portion or an entirety of the marker, analyzes the ripple pattern within the X-ray image to derive the transformation parameter(s), and registers the C-arm to the X-ray ripple marker based on the transformation parameter(s).
For various embodiments of the present disclosure, the ripple pattern includes a plurality of concentric circular ripples, a first series of concentric arc ripples, and/or a second series of concentric arc ripples dissimilar to the first series of concentric arc ripples in frequency, phase and/or amplitude.
For various embodiments of the present disclosure, the X-ray ripple marker further includes a chirp pattern and/or a landmark pattern axially aligned with the ripple pattern.
For purposes of the description and claims of the present disclosure:
The foregoing embodiments and other embodiments of the inventions of the present disclosure as well as various structures and advantages of the inventions of the present disclosure will become further apparent from the following detailed description of various embodiments of the inventions of the present disclosure read in conjunction with the accompanying drawings. The detailed description and drawings are merely illustrative of the inventions of the present disclosure rather than limiting, the scope of the inventions of the present disclosure being defined by the appended claims and equivalents thereof.
To facilitate an understanding of various aspects of the present disclosure, the following description of
Referring to
In practice, platform 40 may have any size and shape that facilitates an X-ray imaging of radial ripple(s) 30 radially extending from fixed point 41 of platform 40. For example, platform 40 may have a disc shape or a cuboid shape with radial ripple(s) 30 integrated onto a same side surface of the disc or the cuboid, and radially extending from any fixed point on that side surface of the disc or the cuboid (e.g., a center of the disc or the cuboid). The size of the disc and cuboid is not limited by the X-ray imaging space of one or particular types of X-ray imaging systems or generic to all X-ray imaging systems.
Also in practice, a radial ripple 30 may have any shape and dimensions that partially or fully encircles the fixed point. For example,
Further in practice, a radial ripple 30 may be integrated into platform 40 in any manner than facilitates an X-ray imaging of X-ray ripple marker 20 that distinguishes the radial ripple(s) 30 from the platform 40 within the X-ray image. For example,
Referring back to
For example,
In practice, a frequency, a phase and/or an amplitude of an X-ray imaged wave may be the characteristic(s) that is(are) a function of a position of an X-ray projection of a C-arm with respect to the X-ray ripple marker 20.
Further in practice, relative frequencies, relative phases and/or relative amplitudes of two or more X-ray imaged wave(s) may be the characteristics that is(are) a function of a position of an X-ray projection of a C-arm with respect to the X-ray ripple marker 20.
In one embodiment of ripple pattern 50 as shown in
In a second embodiment of ripple pattern 50 as shown in
Still referring to
Arc series 51a and arc series 51c are identical to each other in terms of frequency, phase and amplitude. Arc series 51a and arc series 51c are identical to arc series 51b and 51d in terms of phase, but dissimilar to arc series 51b and arc series in terms of 51d in frequency and amplitude.
For any embodiment of ripple pattern 50 (e.g., ripple pattern 50a of
In practice, a chirp may be disposed on the same side surface of the platform as ripple pattern 50, and/or a chirp may be disposed on a side surface of the platform opposing the ripple pattern 50.
For any embodiment of ripple pattern 50 (e.g., ripple pattern 50a of
In practice, the landmark pattern may be disposed on the same side surface of the platform as ripple pattern 50, and/or the landmark pattern may be disposed on a side surface of the platform opposing the ripple pattern 50.
From the description of
For example,
By additional example,
By further example,
To further facilitate an understanding of various aspects of the present disclosure, the following description of
While X-ray ripple marker 20a of
Referring to
Generally in the patient-less mode, an X-ray ripple marker 20 (e.g., X-ray ripple marker 20a of
Generally in the patient mode, an X-ray ripple marker 20 (e.g., X-ray ripple marker 20a of
More particularly to both the patient-less mode and the patient mode, as shown in
In practice, the X-ray projection may originate at any point of the X-ray source 61, such as, for example, a focal spot 65 as shown in
In practice, X-ray ripple marker 20 may establish coordinate system 21 having a fixed point of the X-ray ripple marker 20 as the origin of coordinate system 21, or alternatively, X-ray ripple marker 20 may be calibrated with a coordinate system 22 of an intervention device (e.g., an intervention robot system having the X-ray ripple marker 20 attached thereto).
Referring to
In practice, knowing the geometry of X-ray ripple marker 20 may serve as a basis for identifying X-ray maker 20 within the X-ray image when an entirety of X-ray ripple marker 20 is illustrated within the X-ray image, or the utilization of a landmark pattern (e.g., landmark pattern of copper balls 53) may serve as a basis for identifying X-ray maker 20 within the X-ray image when a portion of X-ray ripple marker 20 is illustrated within the X-ray image.
For example, in the patient-less mode, X-ray ripple marker 20 may be aligned between focal spot 65 and X-ray detector 62 whereby an entirety of X-ray ripple marker 20 may be illustrated within X-ray image 63 (
By further example, in the patient mode, a landmark pattern of copper balls 53 (
A stage S84 of flowchart 80 involves a derivation of transformation parameter(s) from the ripple pattern 50 identified in stage S82 to thereby register X-ray ripple marker 20 and X-ray C-arm 60 during a stage S86 of flowchart 80.
In practice, stage S84 involves a generation of transformation signal(s) from frequency(ies), phase(s) and/or amplitude(s) of the radial ripples of ripple pattern 50 identified in stage 82. The transformation signal(s) may be analyzed during stage S84 to derive transformation parameter(s) that define the position of the X-ray projection by the C-arm 60 (e.g., focal spot 65) relative to the X-ray ripple marker 20, meaning a location and/or an orientation of the X-ray projection within coordinate system 21 or coordinate system 22 may now be determined from the transformation parameter(s) during stage S86.
In one embodiment of stages 84 and 86, particularly for embodiments of ripple pattern 50 having an arrangement of radial ripples of the same frequency, phase and amplitude, a pose of X-ray ripple marker 20 in the C-arm space is described by a rigid body transformation composed of a rotation R and a translation t. The rotation is parameterized using ZXZ Euler angles as in accordance with the following equation [1]:
R(θz1,θx,θz2)=Rz(θz1)Rx(θx)Rz(θz2) [1]
The translation vector t is composed of elementary displace-ments along axes as shown in the following equation [2]:
Any point pMarker ∈R3 in marker space 21 or 22 may be converted in C-arm space (e.g., having focal spot 65 as an origin) in accordance with the following equation [3]:
pC-arm=R(θz1,θx,θz2)pMarker+t(tx,ty,tz) [3]
Similarly, a position of any point in C-arm space-pC-arm-can be translated in marker space 21 or 22 in accordance with the following equation [4]:
pMarker=R(θz1,θx,θz2)TpC-arm−R(θz1,θx,θz2)Tt(tx,ty,tz) [4]
In a second embodiment of stages 84 and 86, particularly for embodiments of ripple pattern 50 having an arrangement of a first series radial ripples and a second series of radial ripples having a frequency, a phase and/or an amplitude dissimilar from the first series of radial ripples, a distance from the focal spot 65 to the fixed point of the X-ray ripple marker 20 may be determined from the dissimilar frequencies, dissimilar phases and/or dissimilar amplitudes as will be exemplary described in the present disclosure with the description of
Still referring to
In one embodiment, a frequency-based filtering technique may be utilized during stage S88.
In a second embodiment, image subtraction technique may be utilized involving a transformation of a model of X-ray ripple marker 20 to an actual location and orientation of X-ray ripple marker in the X-ray image 65a to thereby subtract the X-ray ripple marker in the X-ray image 65a with minimal effect on image quality as will be exemplary described in the present disclosure with the description of
The following is a description of one embodiment of a patient mode of C-arm registration controller 70 (
s(r)=Aexp(2πifmr) [5]
where s(r) is the model sinusoidal pattern, A is the amplitude, fm is the frequency, and sp(s) is the projective geometry transformed pattern of s(r).
Referring to
A stage S96 of flowchart 90 encompasses controller 70 processing acquired X-ray image 63a and computed center point (xci, yci) coordinates 112 to compute wave projection parameters c1 and c2.
A stage S98 of flowchart 90 encompasses controller 70 processing acquired X-ray image 63a, wave projection parameters c1 and c2 and stored marker geometry 110 and C-arm geometry to obtain an initial approximation of transformation parameters (tx0, ty0, tz0, ⊖x0, ⊖y0, ⊖z0) 115.
A stage S100 of flowchart 90 encompasses controller 70 processing transformation parameters (tx0, ty0, tz0, ⊖x0, ⊖y0, ⊖z0)115, (xbbi(k), ybbi(k)) coordinates 111 for each ball bearing landmark and stored marker geometry 110 and C-arm geometry to obtain a refinement/least square optimization of transformation parameters (tx0, ty0, tz0, ⊖x0, ⊖y0, ⊖z0) 116, bearing projection 117 and error/rms 118.
More particularly, in one embodiment of stages S92 and S94, a marker geometry 110 is such that a connection of the closet two (2) ball bearings defines lines that will intersect in the marker center as shown in
The center of the ball bearings is computed using simple thresholding or more advanced algorithms, such as, for example, adaptive thresholding or Otsu thresholding. The ball bearing pairs are formed by simple clustering since the radial neighbor which is of interest is much closer than the lateral ones. After segmentation, blobs that are too small or too large are filtered out. Then, the intersection of the rays is computed using a linear least squares approach.
In one embodiment of stage S96,
In one embodiment of stage S98, c1, c2, and arrange of γ values are then used to compute the position of X-ray ripple marker 20a down to the twist around the axis of the marker 20a. An initial approximation of the marker position in the image space comprises five (5) degrees of freedom computed from wave projection parameters c1 and c2 and (1) degree of freedom which is twisted around z axis angle ⊖z2. The angle ⊖z2 is the one that maximizes the normalized cross correlation between the image signal retrieved at the coordinates corresponding to the projection of the rim chirp using the 5DOF initial position approximation and γ twist angle and the model chirp pattern in accordance with the following equation [7]:
In one embodiment of stage S100, the computed position is optimized using a least squares approach. For each ball bearing identified in the image, bi; i=1 . . . n, a model corresponding to position bmi; i=1 . . . n is computed and subsequently, using the approximate parameters tx, ty, tz, θz1, θx, θz2 and C-arm geometry 115, virtual projections are computed in accordance with the following equations [8] and [9]:
where (xs, ys, zs)T is the position of the source 61 with respect to the detector 62 coordinate system, and pszx and pszy are the pixel sizes in x and y directions. It is assumed that the detector coordinate system coincides with the image coordinate system with only a difference in pixel size.
A cost function may then represented in accordance with the following equation [10]:
C(tx,ty,tz,θz1,θx,tθz2)=Σi−1n∥bi−{tilde over (b)}i∥22 [10]
The cost function is minimized using a “Nelder-Mead” algorithm.
Referring to
Once the point-to-point homographic transform has been applied to the marker model 126b to provide a rough registration 65c of
The following Table I outlines the subtraction techniques
More particularly to both the patient-less mode and the patient mode, as shown in
where SM is the distance 132 from X-ray source 130 to X-ray ripple marker 133, SD is the distance from X-ray source 130 to X-ray detector 134 (which is known from calibration or DICOM data), TM is the time period of the ripple pattern and TI is image period (computed from image). Converting equation [11A] to frequencies yields the following equation [11b]:
fM is the frequency of the known ripple pattern and fI is image frequency (computed from image).
Equation [11b] is for looking in one direction of the image. The following equation [11c] is for two directions suitable for X-ripple marker 20b (
where fHM is the highest frequency of the known ripple pattern, fLM is the highest frequency of the known ripple pattern, fHI is highest image frequency (computed from image) and fLI is lowest image frequency (computed from image).
In practice, more than two directions may be utilized. Also in practice, a simplest approach is by using fast Fourier transform (FFT) along lines going through the center of X-ray ripple marker 20b of
Referring to
For example,
By further example,
For the first parallel position 151 (
For the second parallel position 152 (
For the first position 151 of
For the second position 153 of
Referring back to
In one embodiment of stage S140, xcd and ycd represent the center of the X-ray ripple marker 20b in detector coordinate system whereby the compute the translation of X-ray ripple marker 20b is computed in accordance with the following equations [12a]-[12c]:
tz=SD−SM [12]
tx=xcd*SD/SM [12]
ty=ycd*SD/SM [12]
By additional example illustrates a scenario where the ripple pattern of X-ray ripple marker 20b is titled with respect to the X-ray detector at a position 158 with a line 158L traversing through low frequency radial ripple series 51a and low frequency radial ripple series 51c, and a line 158H traversing through high frequency radial ripple series 51b and high frequency radial ripple series 51d.
To facilitate a further understanding of the various inventions of the present disclosure, the following description of
Referring to
Each processor 171 may be any hardware device, as known in the art of the present disclosure or hereinafter conceived, capable of executing instructions stored in memory 172 or storage or otherwise processing data. In a non-limiting example, the processor(s) 171 may include a microprocessor, field programmable gate array (FPGA), application-specific integrated circuit (ASIC), or other similar devices.
The memory 172 may include various memories, as known in the art of the present disclosure or hereinafter conceived, including, but not limited to, L1, L2, or L3 cache or system memory. In a non-limiting example, the memory 172 may include static random access memory (SRAM), dynamic RAM (DRAM), flash memory, read only memory (ROM), or other similar memory devices.
The user interface 173 may include one or more devices, as known in the art of the present disclosure or hereinafter conceived, for enabling communication with a user such as an administrator. In a non-limiting example, the user interface may include a command line interface or graphical user interface that may be presented to a remote terminal via the network interface 174.
The network interface 174 may include one or more devices, as known in the art of the present disclosure or hereinafter conceived, for enabling communication with other hardware devices. In a non-limiting example, the network interface 174 may include a network interface card (NIC) configured to communicate according to the Ethernet protocol. Additionally, the network interface 174 may implement a TCP/IP stack for communication according to the TCP/IP protocols. Various alternative or additional hardware or configurations for the network interface 174 will be apparent.
The storage 175 may include one or more machine-readable storage media, as known in the art of the present disclosure or hereinafter conceived, including, but not limited to, read-only memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash-memory devices, or similar storage media. In various non-limiting embodiments, the storage 175 may store instructions for execution by the processor(s) 171 or data upon with the processor(s) 171 may operate. For example, the storage 175 may store a base operating system for controlling various basic operations of the hardware. The storage 175 also stores application modules in the form of executable software/firmware for implementing the various functions of the controller 170a as previously described in the present disclosure including, but not limited to, a C-arm to marker registration module 178 and a ripple marker removal module 179 as previously described in the present disclosure.
In practice, controller 170 may be installed within an X-ray imaging system 160, an intervention system 161 (e.g., an intervention robot system), or a stand-alone workstation 162 in communication with X-ray imaging system 160 and/or intervention system 161 (e.g., a client workstation or a mobile device like a tablet). Alternatively, components of controller 170 may be distributed among X-ray imaging system 160, intervention system 161 and/or stand-alone workstation 162.
Referring to
Additionally,
Further, as one having ordinary skill in the art will appreciate in view of the teachings provided herein, structures, elements, components, etc. described in the present disclosure/specification and/or depicted in the Figures may be implemented in various combinations of hardware and software, and provide functions which may be combined in a single element or multiple elements. For example, the functions of the various structures, elements, components, etc. shown/illustrated/depicted in the FIGS. can be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software for added functionality. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared and/or multiplexed. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor (“DSP”) hardware, memory (e.g., read only memory (“ROM”) for storing software, random access memory (“RAM”), non-volatile storage, etc.) and virtually any means and/or machine (including hardware, software, firmware, combinations thereof, etc.) which is capable of (and/or configurable) to perform and/or control a process.
Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (e.g., any elements developed that can perform the same or substantially similar function, regardless of structure). Thus, for example, it will be appreciated by one having ordinary skill in the art in view of the teachings provided herein that any block diagrams presented herein can represent conceptual views of illustrative system components and/or circuitry embodying the principles of the invention. Similarly, one having ordinary skill in the art should appreciate in view of the teachings provided herein that any flow charts, flow diagrams and the like can represent various processes which can be substantially represented in computer readable storage media and so executed by a computer, processor or other device with processing capabilities, whether or not such computer or processor is explicitly shown.
Having described preferred and exemplary embodiments of the various and numerous inventions of the present disclosure (which embodiments are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the teachings provided herein, including the Figures. It is therefore to be understood that changes can be made in/to the preferred and exemplary embodiments of the present disclosure which are within the scope of the embodiments disclosed herein.
Moreover, it is contemplated that corresponding and/or related systems incorporating and/or implementing the device/system or such as may be used/implemented in/with a device in accordance with the present disclosure are also contemplated and considered to be within the scope of the present disclosure. Further, corresponding and/or related method for manufacturing and/or using a device and/or system in accordance with the present disclosure are also contemplated and considered to be within the scope of the present disclosure.
This application is the U.S. National Phase application under 35 U.S.C. § 371 of International Application No. PCT/EP2020/053927, filed on Feb. 14, 2020, which claims the benefit of U.S. Provisional Patent Application Ser. No. 62/806,005, filed Feb. 15, 2019. These applications are hereby incorporated by reference herein.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2020/053927 | 2/14/2020 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2020/165422 | 8/20/2020 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
10206645 | Claus et al. | Feb 2019 | B2 |
10893842 | Barak | Jan 2021 | B2 |
20040082854 | Essenreiter | Apr 2004 | A1 |
20060115054 | Yatsenko | Jun 2006 | A1 |
20080285724 | Dehler | Nov 2008 | A1 |
20100284601 | Rubner | Nov 2010 | A1 |
20120281808 | Graumann | Nov 2012 | A1 |
20160045269 | Elhawary | Feb 2016 | A1 |
20170035382 | Zhang | Feb 2017 | A1 |
20210322104 | Herrmann | Oct 2021 | A1 |
20220273375 | Mucha | Sep 2022 | A1 |
Number | Date | Country |
---|---|---|
112168357 | Jan 2021 | CN |
2017153839 | Sep 2017 | WO |
2018078445 | May 2018 | WO |
2019023375 | Jan 2019 | WO |
2020159984 | Aug 2020 | WO |
2020165422 | Aug 2020 | WO |
2020185048 | Sep 2020 | WO |
Entry |
---|
International Search Report and Written Opinion of PCT/EP2020/053927, dated May 12, 2020. |
Steger, Tenna et al “Marker Detection Evaluation by Phantom and Cadaver Experiments for C-arm Pose Estimation Pattern”, SPIE—International Society for Optical Engineering, vol. 8671, Mar. 2012. |
Calvet, Lilian et al “Detection and Accurate Localization of Circular Fiducials under Highly Challenging Conditions”, 2016 IEEE Conference on Computer Vision and Pattern Recognition, pp. 562-570 Jun. 27, 2016. |
Kainz, Bernhard et al “Fast Marker Based C-Arm Pose Estimation”, International Conference on Financial Cryptography and Data Security, Sep. 6, 2008, pp. 652-659. |
Number | Date | Country | |
---|---|---|---|
20220054103 A1 | Feb 2022 | US |
Number | Date | Country | |
---|---|---|---|
62806005 | Feb 2019 | US |