This application claims priority under 35 U.S.C. ยง 119 to European Patent Application No. 23160113.9, filed Mar. 6, 2023, the entire contents of which are hereby incorporated by reference.
The present disclosure generally relates to the tracking of objects, for example to is patient tracking in a surgical navigation context. In particular, a method for determining a patient-specific marker arrangement for a tracker of a surgical tracking system is presented. Also presented are a computer program product, an apparatus for determining a patient-specific marker arrangement, and a system comprising the apparatus and a manufacturing device configured to manufacture the tracker with the marker arrangement.
Surgical tracking systems are configured to track a surgical object such as a surgical instrument or a patient during a surgical procedure. To this end, one or more trackers are attached to the object that is to be tracked. Each tracker comprises one or more markers configured to be detected by a tracking sensor of the tracking system. Optical tracking systems, for example, use a tracking camera to capture image data representative of optically detectable markers. Based on positions of the markers in the image data, information about one or both of a position and an orientation of the tracker and, thus, of the tracked object can be determined.
The positions of the markers of a given tracker define a marker arrangement. Information indicative of these positions is typically required for the tracking system to identify the markers (and, thus, the tracker) in the image data.
Conventional trackers are mass-produced at high precision to ensure that they all have an identical marker arrangement. Therefore, all the trackers of a given tracker type have exactly the same relative positions between the markers. The tracking system thus only requires knowledge about these relative positions for a given tracker type, but not for each individual tracker. It has, however, been found that such pre-defined tracker types are not suitable for all use cases. For example, they may block a surgeon's activities or result in loss-of-sight issues.
In a surgical tracking context, the tracking camera requires a continuous line-of-sight towards the tracker that has previously been registered relative to a camera coordinate system. In case the line-of-sight is lost, the tracker can no longer be tracked and procedures relying on the tracker, such a navigation procedures, have to be paused or aborted.
A particular object may carry multiple trackers to allow for a continuous tracking even if the tracking camera loses its line-of-sight to one of the trackers. However, using multiple trackers may hinder a surgeon, i.e., may block surgical access or the surgeon's line-of-sight to an anatomical region of interest.
A technique for planning a tracker location to reduce a line-of-sight loss is discussed in WO 2014/159350 A1. The tracker location is determined based on at least one of pre- and inter-operative information regarding predetermined or tracked positions of objects located in an operating room.
There is a need for a marker arrangement for tracker that avoids one or more of the above or other problems.
According to a first aspect, a method for determining a patient-specific marker arrangement for a tracker of a surgical tracking system is provided. The marker arrangement is defined by marker positions. The method comprises receiving three-dimensional image data of a patient, obtaining, based on the three-dimensional image data, planning data for a surgical intervention, and determining the marker arrangement for the tracker based at least on the obtained planning data.
The marker arrangement may be defined in various ways. In some cases, the marker arrangement is defined by relative (e.g., Euclidean distances) between the marker positions. In other cases, the marker arrangement is defined by marker positions in a tracker coordinate system.
The three-dimensional image data may have been acquired using a three-dimensional medical imaging technology, such as computed tomography (CT) imaging, magneto-resonance imaging (MRI), or a two-dimensional medical imaging technology that permits a three-dimensional image reconstruction (e.g., by taking two-dimensional X-ray images from different orientations of a C-arm).
The marker arrangement may be a (planar or non-planar) two-dimensional or a three-dimensional arrangement. In certain variants, the method may comprise generating manufacturing instructions for manufacturing the marker arrangement as determined based at least on the obtained planning data. Thus, a customized tracker comprising an optimized marker arrangement may be manufactured (e.g., optimized from an obstruction perspective). The manufacturing instructions may comprise at least one of printing instructions and instructions for additive manufacturing (e.g., for three-dimensional printing). The manufacturing instructions may be machine-readable instructions (e.g., to control a printer or additive manufacturing device) or instructions addressed to a user (e.g., how to cut out the marker arrangement from a larger sheet on which multiple markers are printed or otherwise realized).
An exemplary manufacturing approach may comprise the steps of providing a substrate with at least one reflective surface configured to reflect electromagnetic radiation, and printing an absorbent layer configured to absorb electromagnetic radiation over the substrate in such a way that the absorbent layer covers less than the entire reflective surface. The substrate and the absorbent layer may form a layer stack. The absorbent layer may be printed to realize the marker arrangement as determined based at least on the obtained planning data. The marker arrangement may additionally be determined based on at least one of a surgery setup and tracker design rules (e.g., regarding a minimum and/or maximum number of markers, minimum and/or maximum distances between markers, etc.). The marker arrangement may take the form of a pattern.
At least one of the planning data (e.g., in the form of a surgery plan) and the surgery setup may define at least one of: a field of view of a signal detector (e.g., a tracking camera), a position and/or orientation of a patient or a body part of the patient, and a position and/or orientation of a surgeon. The marker arrangement may be dimensioned to scale with the viewing angle, or a dimension (e.g., size) of the patient.
The marker arrangement may be printed to fit onto a surface of the patient covered by the field of view of the tracking camera and not blocked by the surgeon.
The planning data (e.g., in the form of a surgery plan) may define at least one of an area of interest of the patient, a dedicated surgical procedure, and a trajectory of a surgical instrument. The marker arrangement may be printed to fit onto a surface of a body part that includes the area of interest. The marker arrangement may be printed to fit onto a surface of the patient that is not covered by (e.g., intersects with) the trajectory. The surface of the patient may be covered by the trajectory if a projection of the trajectory perpendicular the patient surface or along the field of view coincides with said surface of the patient.
The tracker design rules may define at least one marker or marker arrangement where the absorbent layer has an opening that does not cover the reflective surface. The tracker design rules may define at least one of a size and a shape of the at least one marker or the marker arrangement. The tracker design rules may define a minimum distance between markers. The minimum distance between markers may depend on a distance of the tracker to the tracking camera (e.g., the minimum marker distance may increase with increasing distance to the tracking camera, and vice versa). Additionally, or in the alternative, the minimum distance between markers may depend on a distance of the tracker to the anatomy that is to be tracked (e.g., the minimum marker distance may decrease with decreasing distance to the anatomy to be tracked, and vice versa).
In some variants, the method may comprise determining a surface of the patient based on the three-dimensional image data. Conventional image processing techniques such as thresholding can be used in this regard (e.g., thresholding of Hounsfield values obtained by a CT scan). In such an implementation, the marker arrangement may be determined also based on the determined surface of the patient. Determining the marker arrangement also based on the patient surface may comprise virtually arranging one or more markers on the determined surface of the patient. The marker arrangement may be determined based on the virtually arranged markers (e.g., in accordance with their virtually arranged pattern and/or distances).
Taking the surface of a patient into account may facilitate positioning of the tracker on the patient. As an example, the marker arrangement may be determined to not include markers on a protruding body part of the patient (e.g., a patient' nose) as derived from the determined surface. As a result, the tracker may be configured to have an opening or indentation to accommodate the protruding body part. In another example, the marker arrangement may be determined taking into account a surface curvature at the position where the tracker is to be placed on the patient.
In some variants, the planning data may be indicative of an anatomical region of interest of the patient. Determining the marker arrangement may comprise virtually arranging one or more markers relative to the anatomical region of interest. The markers may, for example, be arranged to surround the region of interest. The marker arrangement may be determined based on the virtually arranged markers (e.g., in accordance with their virtually arranged pattern and/or distances). Based at least in part on the region of interest, a size of the tracker and thus at least one of a size, a number and relative positions of the markers to each other may be determined. For example, the further the tracker is away from the region of interest, the larger it must be designed in size to achieve a desired accuracy. The desired accuracy may be predefined, e.g., according to a specific medical field and use-case.
In some variants, the planning data may be indicative of a planned trajectory of a surgical instrument. Determining the marker arrangement may comprise virtually arranging one or more markers relative to the planned trajectory. The marker arrangement may be determined based on the virtually arranged markers. For example, the marker arrangement may be determined in order to prevent collision of the tracker, i.e., a tracker's carrier substrate and the markers, with a surgical instrument moved along the planned trajectory during surgery. Determining the marker arrangement may comprise taking into account a margin for correction of the planned trajectory of the surgical instrument. The margin for correction may be predefined, e.g., according to a specific medical field and use-case.
In some variants, the planning data may be indicative of a planned incision. Determining the marker arrangement may comprise virtually arranging one or more markers relative to the planned incision. The marker arrangement may be determined based on the virtually arranged markers. The planned incision may be taking into account to prevent complicating access of a surgeon to the anatomical region of interest. For example, the markers may have a predefined minimum distance to the planned incision. Determining the marker arrangement may comprise taking into account a margin for correction of the planned incision.
In some variants, the planning data may be indicative of a planned position of a signal generator or signal detector of the surgical tracking system relative to a patient anatomy represented in the three-dimensional image data. Such a signal generator or signal detector may be provided for generating or detecting, respectively, an optical signal (e.g., in the infrared or visible spectrum). Taking into account the planned position, a region of the three-dimensional image data that has a line-of-sight to the signal generator or signal detector may be determined based on the planning data. The marker arrangement may then be determined based on the determined region of the three-dimensional image data.
In some variants, the tracker may have a substrate supporting the marker arrangement, and the method may comprise determining a shape of the substrate based on the planning data. The manufacturing instructions described above may comprise trimming instructions, e.g., instructions on using scissors or perforations, in order to obtain a custom-shaped tracker from the substrate. The trimming instructions may comprise trimming markings printed on the tracker substrate, e.g., on a layer stack, that indicate where the substrate is to be trimmed. Alternatively or additionally, the trimming instructions may be provided on a display, e.g., in form of an image of the substrate, e.g., the layer stack, with trimming markings or an animation of how to trim the substrate. The trimming instructions may be determined based on at least one of a surgery setup, the planning data, and tracker design rules as described herein. The marker arrangement may be determined based on the trimmed tracker (e.g., such that it fits on the trimmed tracker).
In some variants, the three-dimensional image data may have been captured by an imaging apparatus (e.g., a medical imaging apparatus configured to image a patient anatomy). In such a scenario, the method may comprise receiving positional data indicative of a position of the imaging apparatus when capturing the three-dimensional image data, wherein the marker arrangement is determined based on the positional data. The position of the imaging apparatus may be determined in a coordinate system of an operating room, i.e., relative to other objects in the operating room like the signal generator or signal detector of the surgical tracking system.
In some variants, determining the marker arrangement may take into account a criterion related to a minimum distance between markers. The minimum distance between markers may depend on a distance of the tracker to the signal detector, e.g., 3s a tracking camera (e.g., the minimum marker distance may increase with increasing distance to the tracking camera, and vice versa). Additionally, or in the alternative, the minimum distance between markers may depend on a distance of the tracker to the anatomy that is to be tracked (e.g., the minimum marker distance may decrease with decreasing distance to the anatomy to be tracked, and vice versa).
According to a second aspect, a computer program product, comprising instructions that, when executed on at least one processor, cause the at least one processor to carry out any of the method steps described herein. The computer program product may be stored on a non-transitory, computer-readable recording medium.
According to a third aspect, an apparatus for determining a patient-specific marker arrangement for a tracker of a surgical tracking system is provided. The marker arrangement is defined by marker positions. The apparatus is configured to receive three-dimensional image data of a patient; to obtain, based on the three-dimensional image data, planning data for a surgical intervention; and to determine the marker arrangement for the tracker based at least on the obtained planning data.
In some variants, the apparatus may be configured to perform any of the method steps described herein.
According to a fourth aspect, a system is provided. The system comprises the apparatus for determining a patient-specific marker arrangement described herein and a manufacturing device configured to manufacture a tracker with the determined marker arrangement.
Further details, advantages and aspects of the present disclosure will become apparent from the following embodiments taken in conjunction with the drawings, wherein:
In the following description of exemplary embodiments, aspects in the context of determining a patient-specific marker arrangement for a tracker of a surgical tracking system are presented. The tracker with the patient-specific marker arrangement may be configured to be detectable by any tracking technology, in particular involving emission or reflection of electromagnetic radiation (e.g., in the visible or infrared spectrum). The same reference numerals are used to denote the same or similar features.
In more detail,
One or more coordinate systems may be defined for one or more of the three-dimensional image data 102, the surgeon 110 and the surgical tracking system (e.g., relative to the tracking camera 120). In some variants, the planning data is represented in such one or more coordinate systems. In particular, the planning data may be represented in a coordinate system of the three-dimensional image data (i.e., the image coordinate system). The coordinate system of the three-dimensional image data 102 may be defined by the medical imaging apparatus capturing the three-dimensional image data 102. The planned position of the surgeon 110 may also be indicated in the coordinate system of the three-dimensional image data 102. Alternatively, the surgeon 110 may be tracked by the surgical tracking system or another tracking system with a known position relative to the surgical tracking system, and the position of the surgeon 110 may be determined within the coordinate system of the surgical tracking system. The coordinate system of the surgical tracking system may be defined relative to a signal generator or the signal detector 120 of the surgical tracking system.
The individual coordinate systems may be registered with each other or with a global coordinate system, e.g., a coordinate system of an operating room, OR, in which the surgical intervention will take place. The OR may accommodate the patient 100, the surgeon 110, and the surgical tracking system. After one or more coordinate system registrations, the planning data (e.g., in the image coordinate system) may include the positions and/or orientations of the surgeon 110 and the signal detector 120 relative to the position of the three-dimensional image data 102 and relative to each other. In such or other variants, the planning data may indicate one or more of the planned incision 104 and at least one planned trajectory 106 of one or more surgical instruments relative to the position of the three-dimensional image data 102.
The surgical tracking system may comprise one or more trackers, the signal detector 120 and, optionally, the signal generator. The one or more trackers may be attached to the patient 100, and, optionally, to at least one of the surgeon 110 and the one or more surgical instruments. The surgical tracking system may be configured for tracking one or more of the trackers (not shown in
In some variants, at least one tracker with active markers (e.g., light emitting diodes) is provided that emit electromagnetic radiation to be captured by the tracking camera 120. In such or other variants, at least one tracker with passive markers can be provided that reflect electromagnetic radiation to be captured by the tracking camera 120. The reflected electromagnetic radiation may be emitted by a signal generator (e.g., a light source) suitably positioned in the OR.
As shown in
To optimize the line-of-sight LOS between the signal detector 120 and the tracker that is to be attached to the patient 100 and/or to optimize access to the region of interest, a patient-specific marker arrangement for the tracker is determined based on the planning data. The planning data will in certain embodiments be obtained based on the three-dimensional image data 102 of the patient anatomy and, optionally, the positions of one or more of the surgeon 110, the signal detector 120, the planned incision 104 and one or more of the trajectories of 106 relative to the three-dimensional image data 102.
A method for determining a patient-specific marker arrangement for a tracker of a surgical tracking system is described in the following with reference to
In a first step 210, three-dimensional image data 102 of a patient 100 is received. As described herein, the image data 102 may be captured via a medical imaging apparatus. The image data 102 may be received from the image apparatus or from a memory, e.g., a database storing the image data 102. In many variants, the three-dimensional image data 102 of the patient 100 will be representative of a patient anatomy, e.g., a patient's spine or one or more vertebrae thereof.
In a second step 220, planning data for a surgical intervention are obtained based on the received image data 102. The planning data may comprise an indication of at least one of i) an anatomical region of interest of a patient 100 (e.g., a certain bone such as a dedicated vertebra or portion thereof), ii) one or more planned incisions 104, iii) one or more planned trajectories 106 for one or more surgical instruments, iv) a planned position and/or orientation of a surgeon 110 relative to the three-dimensional image data 102, v) a planned position and/or orientation of a signal generator and/or a signal detector 120 of a surgical tracking system relative to the three-dimensional image data 102. The planning data may be provided in a coordinate system of the three-dimensional image data 102. Different variants of planning data contents are explained in more detail below with reference to
In a third step 230, a marker arrangement for the tracker of the surgical tracking system is determined based at least in part on the obtained planning data. Different variants for determining the marker arrangement are explained in more detail below, with reference to
The trajectories 106 may be planned in a patient-specific manner relative to the three-dimensional image date 102 of the vertebrae 102A. Additionally, or in the alternative, the trajectories 106 may be planned in an indication-specific manner. For example, the trajectories 106 may be planned based at least in part on the three-dimensional image data 102 of the patient 100 and a preferred treatment for the patient 100, e.g., based on the medical history of the patient or a set of patients. The trajectories 106 may further be planned based at least in part on the preferences of the surgeon 110.
For example, the marker arrangement has been determined based on a rule that each marker 310 must have a minimum distance from each trajectory 106 of the surgical instrument. Additionally, such a rule may also apply to the shape of the tracker substrate 302. The minimum distances may be based at least in part on a margin for correction of the planned trajectories 106. Additionally or alternatively, the markers 310 may have a minimum distance from each other. The minimum distance may be based at least in part on a distance and orientation of the tracker 300 relative to the anatomical region of interest, e.g., one or more vertebrae 102A in which the pedicle screws are to be placed. For example, the larger the distance between the tracker 300 and the anatomical region of interest, the larger the minimum distance between the markers 310 may be defined. One or more of the markers 310 shown in
The above considerations also apply to any of the markers 410, 510, 610, 710 shown in the
The size of the markers 510 and/or the distance between the markers 510 may be determined based at least in part on a distance between the signal detector 120 and the three-dimensional image data 102 (e.g., a skin surface 102B of the patient where the markers 510 are eventually to be placed). Larger distances between the signal detector 120 and the three-dimensional image data 102 may require larger sizes of the markers 510 and/or larger distances between the markers 510 (and vice versa).
Further, the marker arrangement may be determined based on an anatomical region of interest of the patient 100. In the example of
When determining the marker arrangement, a minimum number of markers 310, 410, 510, 610, 710 comprised by the marker arrangement may be taken into account. This minimum number may be defined in tracker design rules. For example, the minimum number may be 3, 4, 5, 6 or higher.
In some of the above examples, it has been explained how a marker arrangement can be determined in view of certain constraints, with the objective to avoid obstructions for either the surgeon 110 or the signal detector 120. Once the marker arrangement has been determined, it may become necessary to define a suitably shaped tracker substrate 302, 402, 502, 602, 702 configured to accommodate the tracker arrangement. The shape of the tracker substrate 302, 402, 502, 602, 702 may be determined based on the marker arrangement (e.g., so as to accommodate each marker of the marker arrangement). There may exist additional constraints for the substrate 302, 402, 502, 602, 702, such as defining an opening or indentation in locations defined by the trajectories 106 (see
Once the marker arrangement and, optionally, the shape of the tracker substrate have been determined, instructions may be provided to the surgeon 110 regarding proper placement of the marker arrangement relative to the patient 100 (see
In some variants, the tracker 300, 400, 500, 600, 700, in particular the tracker substrate 302, 402, 502, 602, 702, may comprise a layer stack that may be printed based at least in part on the determined marker arrangement 310, 410, 510, 610, 710 (e.g., to directly print a custom-shaped tracker 300, 400, 500, 600, 700). In some variants a standardized layer stack may be printed and the manufacturing instructions may comprise trimming instructions to obtain a custom-shaped tracker 300, 400, 500, 600, 700 with the determined marker arrangement 310, 410, 510, 610, 710 by trimming the printed layer stack.
In the variant shown in
As has become apparent from the above description of exemplary embodiments, a technique for determining a patient-specific marker arrangement 310, 410, 510, 610, 710 for a tracker 300, 400, 500, 600, 700 of a surgical tracking system is provided. The risk of a line-of-sight loss between a signal detector 120 and the tracker 300, 400, 500, 600, 700 can be reduced when implementing the technique presented herein. As a result, procedures relying on object tracking, such as surgical navigation procedures, become more reliable. In such or other scenarios, the risk of obstructing a surgeon 110 can efficiently be reduced as well, leading to better surgical results.
Number | Date | Country | Kind |
---|---|---|---|
23160113.9 | Mar 2023 | EP | regional |