Patent Application
20170086941
The present invention is directed to the field of optical tracking systems and of markers used in such systems. Typically, such optical tracking systems are used in the field of computer assisted surgery or dentistry, robotic assisted surgery or dentistry, rehabilitation and other similar medical applications. On a more general level, they are used in the field of motion capture, that can be linked to medical applications or other applications where the tracking of movements is required.
Traditional optical pose tracking systems comprise two cameras. They use triangulation to determine the three-dimensional (3D) position of light generating elements in space. These light generating elements may either be active: they transmit light (e.g. LEDs) or passive: they reflect light (e.g. reflective disks or spheres), or a combination of active and passive. In the passive case, the light used to be generated on rings of LEDs located around the cameras of the optical tracking system. Emitted light is further reflected on tracked objects and sensed by the cameras.
Such a tracking system is able to compute (that is determine) the 3D position of a single light generating element. If at least 3 light generating elements with known relative positions are measured, it is further possible to compute (that is determine) a 3D orientation. Such an object is called a marker and markers are fixed on target objects/subjects to be tracked.
In a medical application context, a user (e.g. a surgeon) touches a region of interest on the patient's body using a distal tip of an object (e.g. a probe or a surgical instrument). A tracking system views the marker(s) affixed to the object and is able to retrieve its/their pose(s). Then, on the basis of the known relationship between the location of the marker(s) and the location of the object tip, the marker-tracking system determines the coordinates of the object's tip as well as its orientation. Such pieces of information can be used for example by an application to register the patient with a preoperative planning and/or to steer the interventional radiologist when inserting a biopsy needle.
Moreover, medical and especially surgical applications require the markers to be sterile. Common passive markers are usually disposable, autoclavable or a mix of the two.
In U.S. Pat. Pub. No. 2007/0183041, markers include light generating elements comprising two spherical caps of different radii that are disposed substantially concentric in relation to one another. Such technique enables to manufacture disposable markers as the Radix™ from Northern Digital™.
Most common reflective markers are using glass bead technology which embed numerous tiny glass beads in a reflective substrate (e.g. the 3M™ Scotchlite™ Reflective Material). The reflective foil is either taped on flat disks or stretched on spheres. U.S. Pat. No. 6,675,040 presents numerous different naive constructions of such markers. A more elaborated construction is described in U.S. Pat. No. 8,386,022, presenting a multi-face disposable marker comprising reflective disks.
The highly-textured surface of a reflective foil is susceptible to contamination from dirt, blood, fingers, oils, etc. Any contamination that is present on the surface of the marker may affect the retro-reflective performance of the passive marker, thereby contributing or causing inaccuracies in the determination of a position of the object to which the marker is affixed. Therefore, the part containing the reflective material should preferably be easily exchanged and ideally disposable for the sake of safety and simplicity. German Patent Publication DE102008022254A1 presents an exchangeable light generating element which further embed the reflective material within a dome to reduce the contamination problem.
International Patent Publication WO2014/127814A1 presents a marker with a recess mechanism to exchange the light generating element at each operation. The base of the marker is autoclave for further use. This product unfortunately comprises several compartments and recesses which are difficult to clean during the sterilisation process. There is moreover a high probability to damage/scratch the reflecting material when inserting the light generating element in the recess. This will have a high impact on the tracking precision and at the end on the security for the patient.
In light of all the drawbacks and deficiencies of the background art, more advanced and innovative devices and systems for markers are desired, for various tracking applications.
The invention generally relates to a low-cost marker for optical tracking which includes a marker, one or several light generating elements and a mechanism that enable to easily fix/exchange the light generating element on the markers.
There has thus been outlined, rather broadly, some of the features of the invention in order that the detailed description thereof may be better understood, and in order that the present contribution to the art may be better appreciated. There are many additional features of the invention that will be described hereinafter.
In this respect, before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction or to the arrangements of the components set forth in the following description or illustrated in the drawings. The invention is capable of other embodiments and of being practiced and carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein are for the purpose of the description and should not be regarded as limiting.
According to one aspect of the present invention, a low-cost marker for optical tracking is provided, preferably comprising at least two distinct parts, the first one providing a support with openings that are precisely placed and the second one comprising one or several light generating elements (reflectors, LEDs, salient points, etc.) that are fixed under the support, facing the optical tracking system.
Another object of the present invention is to provide a low-cost marker for optical tracking that is intended to be used during computer assisted surgery (respectively dentistry, or interventional radiology) operations together with a passive near-infrared optical pose tracking system.
Another object of the present invention is to provide a low-cost marker for optical tracking that could be used for any pose tracking application including motion capture, rehabilitation, gait analysis, quality control or reverse engineering or any other tracking application.
Another object of the present invention is to provide a low-cost marker for optical tracking that is cheap enough to be manufactured as a completely or partially disposable.
Other objects and advantages of the present invention will become obvious to the reader and it is intended that these objects and advantages are within the scope of the present invention. To the accomplishment of the above and related objects, this invention may be embodied in the form illustrated in the accompanying drawings, attention being called to the fact, however, that the drawings are illustrative only, and that changes may be made in the specific construction illustrated and described within the scope of this application, for example by using equivalent means.
In one embodiment, a marker for an optical tracking system is provided, wherein said marker comprises at least a support with a front surface and a back surface, wherein said support comprises at least three openings placed at predetermined positions on said support wherein one or several light generating element(s) is/are fixed on the back surface of the support, covering the openings such that the light generating element(s) are detectable through the openings by said tracking system, and means for maintaining said light generating element on said back surface and wherein the light generating elements can be placed or removed or replaced during the operation. The operation may by any tracking application using the present marker. It may by a surgical operation or another application.
In one embodiment, the openings of the maker are circular with a chamfer being located around the openings where its sharp part is close to the light generating element in order to reduce the tracking error when the marker is angulated.
In one embodiment, a light generating element covers at least one of said openings.
In one embodiment, the support comprises one light generating element per opening.
In one embodiment, the fixation of the light generating element(s) to the support of the marker is realized by a spring mechanism or another equivalent mechanism.
In one embodiment, the spring mechanism comprises at least a leaf spring.
In one embodiment, the fixation of the light generating element(s) to the support of the marker is realized by magnetic means, for example a permanent magnet.
In one embodiment, the fixation mechanism is located on the marker or support.
In one embodiment, the fixation mechanism is located on light generating element(s).
In one embodiment, the fixation mechanism is partly located on light generating element(s) and partly on the support.
In one embodiment, the light generating elements comprise a reflective foil.
In one embodiment, the foil is applied on the back surface of the support and covers at least the openings.
In one embodiment, the foil is maintained on said back surface by a lower marker part which is held by attachment parts.
In one embodiment, the light generating element comprises a diffuser and a light source.
In one embodiment, the light source comprises a Light Emitting Diode (LED) mounted on a Printed Circuit Board (PCB).
In one embodiment, a tracking system comprising at least one marker as defined herein is provided.
In one embodiment, the tracking system comprises at least two markers as defined herein and said system further comprising camera means tracking the markers.
In one embodiment of the tracking system, the camera means comprise two cameras and illuminating means to illuminate said reflective foil.
In one embodiment of the tracking system the illuminating means comprise a ring of LED surrounding each camera.
In one embodiment, an image guided surgery system comprising at least a marker as defined herein or a tracking system as defined herein is provided. The system may comprise a robotic element, such as a robotic arm, used in the operation.
Various other objects, features and advantages of the present invention will become fully appreciated as the same becomes better understood when considered in conjunction with the accompanying drawings, in which like reference/characters designate the same or similar parts throughout the several views, and wherein:
Turning now descriptively to the drawings, in which similar reference/characters denote similar elements throughout the several views, the figures exemplary illustrate a marker, one or several light generating elements (e.g. reflective parts, LEDs) and a mechanism system that allow to fix the light generating elements part(s) on the marker.
The marker comprises a support 17 and an attachment mechanism 11. The support 17 contains several openings 12, designed such as the light generating element 20 is visible through an opening and is ideally flat and circular.
The openings 12 should be very precisely tooled such that the visible part of the light generating element 20 seen through them is reproducible. This is especially interesting when manufacturing a batch of markers as it will avoid calibrating them individually.
The openings 12 should preferably have a chamfer 16 that will enable to see the light generating element 20 when angulating the marker 10 with respect to the tracking system without losing tracking accuracy.
The marker 10—also called rigid body in the literature—comprises several light generating elements 20 rigidly fixed together. The position of the light generating elements 20 with respect to the attachment mechanism 11 is called the geometry and should be well known. During the tracking process, these light generating elements 20 are detected in 3D by the tracking system. If at least three fiducials 20 are detected, an algorithm is further used to calculate the pose (position+translation) of the marker 10 in the tracking system referential. For example, the algorithms could be the ones described in Arun K. Somani et al., “Least-squares fitting of two 3-D point sets,” IEEE Transactions on pattern analysis and machine intelligence 5, 1987, pp. 698-700, this reference herewith incorporated by reference in its entirety. The precision of this step is partly defined by the precision of the geometry, which is influenced by the manufacturing process of the support. Preferably, the proposed marker 10 has circular openings 12—very precisely manufactured—under which the light generating element(s) 20, 21 is/are located so that the support acts as a mask. A chamfer 16 on one side of the opening facing the tracking means (e.g. cameras) avoids partial occlusion by enabling the tracking system to see the entire light generating element even if the openings 12 are not parallel to the cameras of the tracking system.
The marker 10 may be manufactured out of metal, carbon and/or hard plastic part or a mix therefrom. It may have the fixation mechanism 13, 15 directly integrated in the marker. It may be designed to be autoclaved or disposable for surgical applications. A marker may be directly integrated in the design of a probe/tool 51. Ideally, the support of the markers is precisely tooled and/or molded to avoid an individual calibration process.
The light generating elements 20 may be active (such as a LED) or passive (such as a reflective material). The visible surface (seen by the tracking system through the openings 12) is fixed on the back surface of the support 10. These openings 12 are slightly smaller than the reflective material and thus acts as masks. Alternatively, the fixation mechanism 30, 24, 25 could be part of the light generating element.
In case of passive elements, the reflective material is optimized to work in the wavelength specified by the tracking system (e.g. near infrared). The reflecting surface should be flat, as uniform as possible, and should give a good response with different angulations of the marker with respect to the tracking system. Ideally, the reflecting surface is larger than the hole 12 of the marker 10 so that it may be easily adjusted. The reflective part may be a disk 20 (e.g. shape and size of a flat coin) with a reflective foil 21 taped on it. The reflective part 20 may have magnetic parts in it or being made out of ferromagnetic material so that it may be magnetically clipped to the marker 15. Alternatively, the reflective part may just be a foil 21, as described in
In case of an active element—as shown for example in
The fixation mechanism enables to fix or attach the light generating element part on the marker. This fixation could be part of the marker 10 (e.g. the leaf springs 13 or magnetic fixation 14). The fixation could alternatively be placed on the light generating element (e.g. the leaf spring 25 or clipping system 24). Finally, the fixation could be partly on the marker and partly on the light generating element (e.g. the clipping system 14). A combination of the fixations is also possible.
The fixation is designed to attach the light generating element 20 to the back of the support's opening 12. It should also enable the light generating element 20 to be easily exchanged at any time (e.g. during a surgical intervention if it is occluded by body fluids for example).
The fixation mechanism may be a clip 24, 31, a magnetic clip 15, or a leaf spring 13, 25. Any other equivalent type of fixation mechanism is of course possible as are combinations. As the marker 10 could be used multiple times unlike the reflective parts 20, the fixation mechanism should preferably prevent or at least minimize any damage to the marker 10.
The Passive optical tracking systems comprise one or more cameras 41. They emit infrared light for example from a ring 42 surrounding each infrared camera lens and use spheres or discs as passive targets. Light generating elements are coated with a retro-reflective material containing small spheres that mirror the light back to the lenses, causing the light generating elements to appear as bright spots in the infrared images. Passive tracking systems can also detect light generating elements composed of infrared LEDs. Passive optical tracking systems can operate in visible and near IR spectra.
Passive optical tracking systems are widely used in surgery and motion capture applications. They basically comprise a set of camera with a known baseline—respective pose of the cameras. The cameras operate in the infrared so that the flashes are not disturbing the users. The flashes are emitted by infrared lights that are preferably arranged on a ring around the camera lenses.
Most commonly used camera are stereo-camera—with two cameras—fixed on a bar. The relative pose of the camera is factory calibrated. Once a light generating element is simultaneously detected by both cameras, it is possible to compute its 3D position by means of triangulation.
Example of commonly used passive optical tracking systems are Atracsys™ infiniTrack™ and fusionTrack™, NDI Polaris™ or Axios™ CamBar™. Any general purpose camera(s) can alternatively be used as passive optical tracking system. They generally are less precise than the ones comprising several cameras.
In an embodiment of the application, a user 50 is handling a probe 51. The marker 10 according to the present invention is fixed on (respectively part of) a probe 51 or tool. The user 50 (e.g. a surgeon) is handling the probe such that the reflective parts are visible by the cameras during tracking. A user could alternatively be a robot or another equivalent device.
In an embodiment of the invention, a marker 10 is fixed on an object (respectively a subject) to be tracked 60. In a surgical application, the subject is typically the patient to be operated. The marker 10 may be fixed on a bone structure (femur, tibia, pelvis, skull, etc.), a head frame used in neurology, or screwed, glued, fixed on the patient via an elastic band, glasses' frame, etc.
Prior to the surgical intervention, light generating elements 20, 21 have been fixed on the two distinct markers 10 by means of a fixation mechanism 13, 14, 15, 24, 25 as described above. Both markers 10 have a distinct geometry (relative pose of the openings) so that each can be uniquely detected by the system. The placement of the light generating elements 20 does not need to be precise but should perfectly fit the openings 12 of the marker 10 for a proper detection.
During the registration step, the surgeon will point specific anatomical structures by means of the probe 51 to create a matching between the pre-operative planning and the real patient. The reference marker on the patient is necessary to track and measure possible displacements of the patient and/or the passive tracking system during the assisted procedure.
During this step, at least three light generating elements 20 of each marker 10 should be visible by the tracking system 40. The tracking system 40 will perform image processing of the camera images to detect the center of gravity of the light generating elements 20, matching, triangulation and finally pose estimation given the unique geometry of the markers 10. The system will finally know the pose of the probe with respect of the marker 10 attached on the patient 60.
At the end of the surgical operation, the light generating elements 20 are thrown away. The marker 10 on the patient and the probe 51 are either designed to be autoclaved for further use or disposed.
Compared to existing technology (reflecting spheres), the proposed system according to the present invention has the advantage of being more precise because the precision does not rely on screwed or plugged spheres but only on the manufacturing of openings 12 which is by nature more precise. This will also reduce the operating costs as the reflective parts 20 are cheaper to manufacture compared to reflective disks. Finally, if the fixation mechanism is simple, ergonomics is improved because replacement of a reflective part during surgical procedure does not require a recalibration or reregistration step (which is required by existing systems).
What has been described and illustrated herein is a preferred embodiment of the invention along with some of its variations. The terms, descriptions and FIG.s used herein are set forth by way of illustration only and are not meant as limitations. Those skilled in the art will recognize that many variations are possible within the spirit and scope of the invention in which all terms are meant in their broadest, reasonable sense unless otherwise indicated. Any headings utilized within the description are for convenience only and have no legal or limiting effect.
The present application claims priority to earlier U.S. provisional application with the Ser. No. 62/232,597 filed on Sep. 25, 2015, the content of this earlier application being incorporated in its entirety by reference in the present application.
| Number | Date | Country | |
|---|---|---|---|
| 62232597 | Sep 2015 | US |
