Patent Application
20140135617
1. Field of the Invention
The present invention relates to computer implemented navigation systems used in surgical procedures.
2. Background of the Invention
Computerized surgical navigation systems are used to help guide a surgeon operating on a patient. In many instances, the use of navigation systems enables the surgeon to perform a surgery on a patient in a minimally invasive manner. For example, a navigation system helps the surgeon visualize or see the location of a surgical tool in relation to portions of the body that are not directly visible to the surgeon, such as organs or bones on the inside of the body, by showing on a display apparatus such as a television monitor or computer monitor the position of the surgical tool in relation to the portion inside the body. Thus, smaller and/or fewer incisions into the body are needed because the surgeon does not need a direct visual line of sight to a location of interest inside the body. Surgical navigation systems may also be used in other types of surgery, such as an orthopedic procedure, to help guide the surgeon while making cuts and/or placing objects on the patient's bones, for example, in positions that have been planned and marked with respect to pre-operative images taken of the body but without having to directly mark such locations on the patient's body.
There are many types of navigation systems that have been developed to assist with surgical procedures. In one well known exemplary navigation system, a multi-camera navigation system in communication with a computer processor tracks tracking devices with LED's that flash and have a known spatial configuration. One or more tracking devices called tool trackers are attached to surgical tools in a known spatial configuration, and such information is located in a database available to the computer processor. One or more tracking devices called patient trackers are also attached in a fixed position to the patient, such as with pins inserted into a bone. A set of two, three, or more tracking cameras, such as charge-coupled device (CCD) cameras, are located within an operating room and are connected to the computer processor. The CCD cameras are positioned in a known, fixed relation with each other, such as on a single bar, so that images from each of the three cameras may be processed and combined to triangulate the position of the trackers as viewed by the CCD cameras. In this system, the computer processor is used to concatenate several different position vectors including positional vectors from the cameras to the tool trackers and positional vectors from the cameras to the patient trackers to track the position of surgical tools with respect to the body. With appropriate registration of various coordinate systems performed by the computer processor, the position of the tool may then be shown on a display monitor in registration with a scan image of the patient, such as an X-ray, ultra-sound, MRI, or CT scan image or the like, that shows various points of interest on the inside of the body. Although such navigation systems are highly effective in helping the surgeon navigate a tool inside the body without being able to see directly into the body, this system takes a large amount of computing resources in order to make the required mathematical transformations of the various positional vectors from the cameras to the tool trackers and the cameras to the patient trackers. Although ongoing improvement in computing technology reduces the amount of time necessary to make such calculations, because the navigation is performed in real time during the surgery, any increase in the speed of calculation such as by reducing the amount of computing resources necessary would be desirable. Some exemplary surgical navigation systems based generally on this type of technology are disclosed in Chader U.S. Pat. No. 5,617,857, Schulz U.S. Pat. No. 5,622,170, Faul et al. U.S. Pat. No. 6,497,134, Faul et al. U.S. Pat. No. 6,608,688, and Malackowski et al. U.S. Pat. No. 7,725,162, each of which is incorporated in its entirety herein.
Another type of surgical navigation system includes a navigation camera is attached directly to a surgical tool for insertion into a patient's body. A target patch with optical navigation markers, printed thereon, is placed on the patient's body at or near a desired point of entry into the body. The patch is registered with the body, and the camera views the patch as the surgical tool is inserted into the patient's body. The camera is connected to a computer processor, which is programmed to process images of the optical navigation markers from the camera to determine a position of the surgical tool in reference to the patch and, thereby, the patient's body. Thus, the computer processor is able to process the images of the patch with the navigation markers thereon taken by the camera to track the position of, for example, a tip of the surgical tool that has been inserted in the body subcutaneously and displays such position on a computer monitor in registration with a scan image of the area of interest. An example of such a system is disclosed in more detail in Gilboa U.S. Patent Application Publication No. 2008/0208041, which is incorporated herein in its entirety. Although useful for navigating the surgical tool, this surgical navigation system requires that each surgical tool has its own tracking camera attached thereto and/or tracking patch for attachment to the patient's body that has been adapted specifically for a particular use with a particular surgical instrument and/or procedure. In addition, having a camera placed on the surgical tool itself may be cumbersome to the surgeon by adding weight or wires thereto.
Thus, the inventor of the present invention believes that it would be advantageous to overcome one or more of the challenges of these prior art navigation systems, such as reducing the amount of computing resources necessary to track the position of the tool tracker with respect to the patient's body and show such position in registration with a scan image of the body, removing cumbersome objects such as cameras from surgical tools, and providing a single system that may be readily and easily adaptable for use with many different instruments and procedures.
In one aspect of the invention, a surgical navigation system comprises a camera including means for attaching the camera in a fixed position to a patient, a surgical tool including a tracking element readable by the camera, and a computer processing unit comprising means for recognizing the tracking element in an image obtained by the camera and means for tracking the position of the surgical tool. A communication link is adapted to transmit images from the camera to the computerized processing unit.
In another aspect of the invention, a surgical navigation camera comprises a camera having a known focus, and means for attaching the camera in a fixed position to a patient.
In a further aspect of the invention, a method of tracking a surgical tool with respect to a patient comprises the steps of attaching a camera to the patient in a fixed position, and tracking a position of the surgical tool in relation to the patient using pictures taken by the camera and a computerized navigation system.
Other aspects and advantages of the present invention will become apparent upon consideration of the following detailed description.
Turning now to the drawings, a preferred embodiment of a navigation system 10 for providing navigation during surgery is shown in
The surgical tool 12 may be any tool used during surgery that can be manipulated and arranged in a manner consistent with the purposes, functionality, and methods described herein. In
The tracking element 14 includes an optical pattern that is readable by the camera and adapted to be processed by a digital image recognition computer program suitable for the uses and purposes described herein. The optical pattern is in a known, fixed position with respect to the tool tip 28, such that the position of the tool tip 28 can be determined from a two-dimensional image of the tracking element 14 taken by the camera 18. The optical pattern comprises passive markers, such as colored ink markings. As used herein, the term “position” means spatial information regarding both the orientation of an object and location or distance of the object from a given point. As shown in
The surgical tool 12 preferably is not physically connected to the camera assembly 16 or to any other instruments, such as by wires. Thus, for example, the surgical tool 12 can be considered to be wireless because it does not have a wired connection to other components of the navigation system 10. Of course, a surgical tool 12 may include internal wiring for such things as internal circuitry for other structures and/or functions that are contained wholly in the surgical tool. However, the navigation system 10 may have wired connections to other instruments. In addition, the surgical tool 12 with the tracking element 14 with a passive optical pattern may be lighter than a tracking element with LEDs or other heavier structures, and thereby be easier to use during the surgical procedure.
The camera 18 has a completely known focal geometry. The camera 18 is an optical video camera that has a fixed focus lens, which has a focal geometry, including a focal length, focal plane, and focal axis that is fixed with respect to the camera 18 and/or the camera assembly 16 and known to the computer processing unit 22. Thereby, images taken by the camera 18 have a constant relation with respect to the body of the camera 18 and thus a camera coordinate system 32 associated with the camera (also called the “camera space”). Alternatively, the camera 18 may have a changeable focal geometry, such as with a zoom lens, if the focal geometry is determinable and known when tracking.
The camera assembly 16 also includes means for attaching the camera 18 to the patient 20 in a stable, fixed position relative to a surrounding region of the patient 20, and fiducial marks, such as fiducial markers 34, and one or more validation features 36. The camera assembly 16 is preferably small enough to allow for movement and repositioning of the patient 20 while the camera assembly 16 is attached thereto. Further the camera assembly 16 can be packaged and delivered in a sterile condition for immediate use in the surgical procedure without the need to sterilize or drape the camera assembly 16 at the hospital. The camera assembly 16 is also preferably, small, lightweight, and relatively inexpensive so as to be suitable for single use and thereby render cumbersome reprocessing by a hospital unnecessary.
The attachment means may take any form suitable for use to fixedly attach the camera 18 to the patient 20 during a surgical procedure without unduly harming the patient 20 and that allows the camera 18 to be readily removed from the patient 20 at the completion of the surgical procedure. In the examples shown in
According to one optional aspect, the fiducial markers 34 are disposed on the base plate 38 in known positions around the camera 18 in sufficient number and location that the fiducial markers 34 may be used to identify the position of the camera 18 and camera coordinate system 32 from an image of the camera assembly 16. In one instance, the camera assembly 16 includes a plurality, preferably three or more, fiducial markers 34, such as metal balls, targets, or other known types of fiducial markers that can be identified in visual light, CT scan, MRI, X-ray, and/or other types of imaging modalities. In another aspect, the fiducial markers 34 may comprise preselected and identifiable shapes and/or objects directly on the body of the camera 18. As shown in
The validation feature 36 is an optional feature for validating and/or calibrating the surgical tool 12. As used herein, validation encompasses a procedure that checks whether the geometry, i.e., the form factor, of the surgical tool 12 is within a pre-defined tolerated range of error. For example, a validation of the surgical tool 12 checks whether the tool tip 28 is within a pre-defined tolerated distance of the theoretical position as defined in the database and either accepts or rejects the surgical tool 12. Also as used herein, calibration is a procedure that defines the geometry of the surgical tool 12, and most frequently the position of the tool tip 28, with respect to the tracking element 14. The validation feature 36 may take any suitable form for validating or calibrating the surgical tool 12. In one instance as shown in
Preferably, the camera 18 and the markers 34 are fixedly attached to the base plate 38 so that the camera 18 and camera coordinate system 32 are in a known, fixed position with respect to the markers 34. In some embodiments, however, the camera 18 is separable from the base plate 38 and can be reassembled only in a predefined spatial relationship thereto. The camera 18 is releasably attached to the base plate 38 with a specially adapted connector, such as a directional quick-release connector, which ensures that the camera 18 can be removed and reattached in only a single location and orientation. With this feature, the base plate 38 with the fiducial markers 34 can be scanned with the patient, and the camera can be attached thereafter when more convenient. In another embodiment, each fiducial marker 34 is also releasably attached to the base plate 38 by a specially adapted connector, such as a directional quick-release connector or a threaded stud, which ensures that the fiducial markers 34 are reattached in only a single location and/or orientation. This provides the same advantage of having a known spatial relation between the fiducial markers 34 and the camera coordinate system 32, and further may improve ease of handling during imaging and make it easier to maintain sterility during the surgical procedure.
The camera 18 is in communication with the computer processing unit 22 by a data communication link 44 that electronically transmits images obtained from the camera to the computer processor. As shown in
The computer processing unit 22 includes a computer processor 46 adapted with hardware and/or software programming that cause the computer processor 46 to read images of the tracking element 14 from the camera 18 and show the position of the surgical tool 12 in registration with a scan image 48 of the patient on the display device 24 from such images. The computer processor 46 may include any hardware and software architecture sufficient to engage in the various processing steps required by the navigation system 10. For example, the computer processor 46 may comprise a single computer, such as a microcomputer or server, or the processor may comprise multiple interconnected data storage and processing units, such as an internet-based processing system located on several disparate but interconnected computers. The scan image 48 may be any image useful to the surgeon to plan and/or execute the surgical procedure, and will generally include such modalities as a CT, ultra-sound, X-ray, MRI, infra-red, visible spectrum, and any other imaging modality suitable for use with surgical procedures. Often, the scan image 48 includes image data relative to subcutaneous structures in the patient's body, such as organs, bones, tumors, cancers, blood clots, and/or other items of interest inside the patient's body.
The computer processor 46 is in communication with the camera 18, the display device 24, and input/output devices 50, such as a keyboard, mouse, digitizer, printer, etc. The computer processor 46 also comprises various hardware and/or software modules or functionalities that adapt the computer processing unit 22 to function as required for the navigation system 10. Thus, the computer processor 46 includes in some manner the following functional components: digital memory that contains the scan image 48 of the patient 20; a database 52 comprising information on the form factor of the surgical tool 12 and tracking elements 14; a digital image recognition module 54 for parsing images received from the camera 18 and identifying various information therefrom, such as the position of the optical navigation markers 30 on the tracking element 14 and location of the tracking element from the camera 18; a registration module 56 for registering the camera 18 and/or the patient 20 with the scan image 48; a tracking module 58 for concatenating position vectors to show an image of a tracked surgical tool 12 in correlation with the scan image 48 on the display device 24 in real time; and a display functionality for displaying the various information on the display device 24. The software and hardware comprising the computer processing unit 22 may be adapted from any such generally available software and hardware, and the present disclosure is not limited to any particular such type of processing capabilities.
The database 52 is associated with the computer processing unit 22 in any suitable manner whereby the computer processor 46 can access the database 52. The database 52 may be any digital database system compatible for interaction with the computer processor 46 and associated hardware and software, and, for example, may be stored on-site or off-site, may be commercially available or proprietary. The database 52 preferably includes information regarding specific surgical tools 12, such as the form factor of a tool and positional and identifying information on the tracking element 14. The database 52 also preferably includes information regarding the camera assembly 16, such as basic form factor information relative to the fiducial markers 34 and the camera space. Of course, the database 52 may include other useful information, such as patient information, information relevant to a surgical procedure to be performed, etc.
The digital image recognition module 54 comprises means for determining a position of the surgical tool 12 with respect to the camera 18, and includes appropriate software and/or hardware algorithms implemented by the computer processor 46 that extract and calculate a position of the tracking element 14 with respect to the camera 18 from an image of the optical navigation markers 30 taken by the camera 18. Many digital image recognition software programs are known and any such program that is able to perform the necessary processes and functionality is sufficient. Preferably, the digital image recognition module 54 is capable of determining the position of the surgical tool 12 from a two-dimensional image of the tracking element 14 visible to the camera 18 by, for example, comparing the image of the optical navigation markers 30 with the form factor data of both the surgical tool 12 and the optical navigation markers 30 available from the database 52. Thus, because the optical navigation markers 30 have a unique two-dimensional image thereof from every possible viewing angle, the position of the tracking element 14 and the surgical tool 12 with respect to the camera 18 can be calculated from a single two-dimensional image thereof, which may be performed in a manner well-known in the art.
The registration module 56 comprises means for registering the camera coordinate system 32 with the scan image coordinate system 60 to be able to show the position of the surgical tool 12 in relation to the patient 20 in correlation with the scan image 48 of the patient on the display device 24. Many suitable registration functions and methods are known in the art and may be adapted for use with the navigation system 10 and methods described herein. Preferably, the registration module 56 is adapted to automatically register the camera 18 with the scan image 48 without any user interaction when the scan image 48 includes the region of interest of the patient and the camera assembly 16 rigidly attached to the patient 20. Alternatively or additionally, the registration module 56 is adapted to facilitate manual registration of the camera 18 with the scan image 48, in which case it may not be necessary for the fiducial markers 34 or the camera 18 to be visible in the scan image 48. Exemplary methods of both automatically and manually registering the camera 18 with the scan image 48 are described in more detail hereinafter.
The tracking module 58 comprises means for determining the position of the surgical tool 12 in relation to the patient 20 and combining such position superimposed and in registration with the scan image 48 of the patient 20 for showing on the display device 24. Any known computer programming capable of making such known mathematical transformations may be used. For example, the tracking module 58 may include a software and/or hardware algorithm that concatenate the position information from the digital image recognition module 54 in combination with form factor information from the database 52 and registration vectors from the registration module 56 to show the surgical tool 12 on the display device 24 in correlation with the scan image 48. Such registration generally is performed by known positional vector concatenation techniques, including positional vectors from the camera 18 to the surgical tool 12, and positional vectors of the camera 18 with respect to points on the patient 20 for example. Such mathematical transformations are well-known in the art and need not be discussed further herein. An advantage of the present navigation system 10 is that the algorithm for performing the concatenation calculations does not have to concatenate a positional vector from a tracking camera to a patient tracker attached to the patient 20 and used solely to identify the position of the patient 20 with respect to the navigation camera. Rather, fixedly attaching the camera assembly 16 directly to the patient 20 effectively eliminates the need for a patient tracker that is separate and independent from the navigation camera because the camera coordinate system 32 is directly correlated with the patient's body in the scan image 48, which reduces the number of coordinate transformations required during navigation and leads to faster performance and higher precision of navigation.
The various computer modules 54, 56, 58 described herein are described as modules only for the sake of simplicity of description. In fact, the functionalities described may be performed in any suitable hardware and/or software architecture capable of determining the orientation of the surgical tool 12 from a two-dimensional image of the tracking element 14 visible to the camera 18 and showing such orientation on the display device 24 in registration with the scan image 48 of the patient 20. In this manner, the computer processing unit 22 with any one of the various modules and/or hardware and software combinations described herein comprises a computer means for tracking the surgical tool, and the aggregate of the software programs comprising the modules 54, 56, 58 may be called simply the navigation software.
The computer processing unit 22 is in communication with the display device 24, which may be any device sufficient to display the position of the surgical tool 12 superimposed with and in correlation with the scan image 48 of the patient 20, such as a computer monitor, television, projector, and/or paper printout from a printer. Preferably, the scan image 48 includes image data portions inside the body of the patient 20 that may not be visible to the surgeon or to the camera 18 so that the display image 48 can show the position of the surgical tool 12 with respect to those portions of the patient's body that are not directly visible to the surgeon. In this manner, the display can display the position of the surgical tool 12 with respect to hidden portions of the patient's body in real time as the surgeon manipulates the surgical tool 12 during the surgical procedure.
Turning now to
At a block 80, the camera assembly 16 is attached to the patient 20 by the adhesive 40 on the bottom of the base plate 38 in a fixed position such that the camera coordinate system 32 does not move in relation to surrounding areas of the patient 20. Preferably, the camera assembly 16 is small enough to allow the patient 20 to be moved and repositioned by the surgeon as desired while the camera assembly 16 is attached to the patient 20. The camera assembly 16 is fixed to the body with the lens directed to view a region encompassing an expected area of activity during the surgical procedure. For example in an ear, nose, throat surgical procedure, as shown in
At a block 82, the position of the camera 18 is registered with the position of the patient 20 in a scan image 48. The registration procedure may be performed in any of many different manners and methods known for registering one coordinate system with another. Some specific or preferred automatic and manual methods of conducting such registration are discussed in detail hereinafter. Of particular relevance at this point, however, is that upon registration of the camera space with the scan image space, the relationship between the camera coordinate system 32 and the scan image coordinate system 60 is known sufficiently to be able to calculate and show the position of the surgical tool 12 with respect to the patient 20 in correlation with the scan image 48 on the display 24.
Upon registration of the camera 18 with the scan image 48, the surgical tool 12 with the tracking element 14 is introduced within the field of view of the camera 18, and a block 84 tracks the position of the surgical tool 12 by means of the navigation software, which shows such position on the display monitor 24 in relation to the scan image 48 at block 86. Thus, for example, as a surgeon manipulates the surgical tool 12 through the nasal cavities of the patient 20, the location of the tool tip 28 inside the patient's head is shown on the display monitor 24 in correlated relation to the scan image 48, thereby effectively allowing the surgeon to see on the display device where the surgical tool 12 is in relation to the target location 62 inside the patient 20.
The step of registering the camera with the scan image of the patient performed at block 82 may be performing automatically or it may be performed manually using the registration module 56 of the navigation software.
In
At block 100, the camera assembly 16 is attached to the patient 20 in a fixed position with respect to surrounding portions of the patient's body, as shown in
At block 102, a scan image 48 of the patient 20 is obtained with the camera assembly 16 secured to the patient 20, wherein the scan image 48 includes the camera assembly 16 as attached to the patient's body with the fiducial markers 34 visible. An exemplary scan image 48 so obtained is shown in
At block 104, the navigation software automatically recognizes and identifies the fiducial markers 34 visible in the scan image 48.
At block 106, the navigation software calculates the position of the camera assembly 16 from the position of the fiducial markers 34 in the scan image 48. The position of the fiducial markers 34 with respect to the camera coordinate system 32 and to the focal geometry of the camera 30 is known from form factor information retrieved from the database 52.
At block 108, the navigation software automatically registers the camera space with respect to the position of the patient 20 in the scan image 48 by identifying the position of the camera coordinate system 32 within the scan image 48. Because the patient 20 is fixedly connected to the camera assembly 16, the scan image coordinate system 60 is already directly correlated with the camera coordinates system 32. The registration module 56 automatically performs a coordinate transformation calculation as appropriate and thereby transforms the scan image coordinate system 60 into the camera coordinate system 32 or vice versa. Thereafter, the camera space is registered, or merged, with the scan image space, i.e., the positions of the camera 18 and the scan image 48 of the patient 20 are both known in relation to a single coordinate system, such as the camera coordinate system 32. Upon automatic registration of the camera 18, tracking of the surgical tool 12 is immediately available through the known relationships between the surgical tool 12, the camera coordinate system 32, the scan image coordinate system 60, and form factor information of the surgical tool 12 from the database 52.
At block 110, the surgical tool 12 is introduced into the view of the camera 18, as shown in
Advantageously, the navigation software does not have to recalculate the transformation between the camera coordinate system 32 and the scan image coordinate system 60 because the camera 18 does not move relative to the patient 20 after the registration procedure until after the surgical procedure is completed. In a preferred embodiment, for example, the scan image 48, which initially is in the scan image coordinate system 60, is transformed into the camera coordinate system 32 a single time during registration and is not recalculated thereafter. Therefore, during navigation, it is only necessary to update the positional vector of the surgical tool 12 relative to the camera coordinate system 32 whenever the surgical tool 12 moves relative to the camera 18. Thus, the navigation system 10 provides a significant reduction of computing resources over prior art navigation systems where the camera space is not fixedly correlated to the patient.
At block 112, a validation procedure is performed to verify whether the surgical tool 12 is within a pre-defined acceptable error range from the form factor information in the database 52. In one method, the tool tip 28 is placed on the validation feature 36 with the optical navigation markers 30 in the field of view of the camera 18. The surgical tool 12 is identified, relevant form factor information for the surgical tool 12 is retrieved from the database 52, and the theoretical position of the tool tip 28 is calculated from the retrieved form factor information. The theoretical position of the tool tip 28 is compared to the actual position of the tool tip 28 on the validation feature 36. If the theoretical position and the actual position of the tool tip 28 are within a pre-defined acceptable error distance of each other, then the surgical tool 12 is verified as acceptable for use in the surgical procedure and control passes to a block 114 for tracking and displaying the surgical tool 12. If the theoretical position and the actual position of the tool tip 28 are not within the pre-defined acceptable error distance of each other, then the surgical tool 12 is rejected for use in the surgical procedure and control passes to block 116.
At block 116, a decision is made whether to replace the surgical tool 12 with a different surgical tool 12 or to calibrate the surgical tool 12. If a new surgical tool 12 is selected, the procedure returns to block 110 and repeats. If, alternatively, it is decided to continue using the same tool 12, the procedure commences to block 118 for performing a calibration procedure.
At block 118, a calibration procedure is performed, wherein the form factor of the surgical tool 12 in relation to the tracking element 14 is calculated and written back to the database 52. In one method, the tool tip 28 is placed on the validation feature 36 with the optical navigation markers 30 in the field of view of the camera 18. The surgical tool 12 is identified by the tracking element 14, and relevant form factor information for the surgical tool 12 is written into the database 52. The position of the tracking element 14 with respect to the actual position of the tool tip 28 on the validation feature 36 is calculated, and that position information is written to the database 52 for use during subsequent tracking. After the surgical tool 12 has been calibrated, the surgical tool 12 preferably is again validated at block 112, and the procedure continues from there. In some circumstances, the calibration procedure may be necessary if there is not sufficient pre-defined form factor information in the database 52, in which case the calibration procedure may be an additional or alternative part of the validation procedure.
After performing the automatic registration, validation, and optional calibration procedures, the surgical procedure commences with complete tracking of the surgical tool 12 from the single camera 18 as the surgical procedure is performed. At block 114, the computer processing unit 22 displays or causes to be displayed the relative position of the surgical tool 12 to the patient 20 in registration with the scan image 48 shown on the display device 24.
Additional surgical tools 12 may be tracked by the camera 18 during the same surgical procedure. Each surgical tool 12 has a tracking element 14 with a unique set of optical navigation markers 30, i.e., having different shapes, colors, and/or spacing, which are stored in the database 52 and uniquely identify each surgical tool 12 to the navigation software. Alternatively, as described above, each tracking element 14 may include the same optical navigation markers 30 for positional tracking, and also include a unique optical identification marker that indicates the identity of the surgical tool 12.
Turning now to
In a method of using the navigation system 10 including a manual registration procedure, a scan image of the patient 20 is obtained at a block 120. The scan image is obtained without an image of the camera assembly 16 therein and thus may be taken before the camera 18 is attached to the patient 20.
At block 122, the camera assembly 16 is attached to the body of the patient 20, and the scan image is imported into the computer processing unit 22. Preferably, the camera assembly 16 is attached to a portion of the patient 20 that will not move in relation to the scanned portion of the patient during the surgical procedure.
At block 124, a registration tool is validated and/or calibrated with respect to the position of the camera 18. In one method, the surgical tool 12 is used as a registration tool. Alternatively, a separate tool, such as a pointer (not shown), is used as a registration tool. Validation of the registration tool may be completed in any manner known in the art. Preferably, the validation is performed automatically based on form factor information in the database 52, as described previously with respect to block 112 of
At block 126, the registration tool, such as the surgical tool 12, is used to locate points on the body of the patient 20 while tracking the registration tool with the camera 18. The points located may include specific physical landmarks and/or a cloud of points on a surface identifiable in the scan image 48 for performing a registration calculation.
At block 128, the camera 18 is registered with the scan image 48 by matching points located on the body at block 126 to corresponding portions of the scan image 48 of the patient 20 by any method sufficient therefore, such as by performing a point-to-point registration procedure and/or a surface matching registration procedure, and performing appropriate coordinate transformations. In a point-to-point registration procedure, physical landmarks located at block 126 are matched with corresponding structures in the scan image 48. Thereafter, a point-to-point registration procedure is performed to register the camera space with the scan image space by, for example, a point-to-point matching procedure and appropriate coordinate transformations known in the art. In a surface matching registration procedure, the cloud of points located at block 126 is matched to the corresponding surface visible in the scan image 48 by, for example, a surface matching procedure and appropriate coordinate transformations known in the art.
At block 130, if a surgical tool different from the tool used to register the scan image will be used to perform the surgical procedure, the new tool preferably is validated. The validation procedure at block 130 preferably is identical to the validation procedures already described herein and may be omitted if the same surgical tool is used during the procedure that was already validated at block 124 for use to locate the points on the body in block 126.
At block 132, the surgical procedure is started and tracking and displaying of the surgical tool 12 is performed. The steps of tracking the surgical tool 12 and showing the position of the surgical tool 12 on the display device 24 are performed in accordance with the method previously disclosed herein. Thereafter, the computer processing unit 22 shows a representation of the position of the surgical tool 12 in relation to the scan image 48 on the display device 24. In this manner, as the surgical tool 12 is manipulated within the surgical area, the surgeon can see on a video monitor, for example, the position of the surgical tool 12 with respect to interior portions of the patient's head in real time and thereby navigate the surgical tool 12 to a desired location therein, such as the target location 62. Such navigation may be particularly useful when, for example, the target location 62 is planned and identified in the scan image 48 and the navigation system shows where the surgical tool 12 is located in relation to that target location 62.
The navigation system 10 in another embodiment may be adapted to include more than one camera 18. The cameras 18 are attached to the patient 20 in a fixed position in the same manner as described previously. Preferably, two or more cameras 18 are also disposed in a fixed, known position in relation to each other, such as by being fixedly attached to the base plate 38 in a known and/or pre-selected orientation. The different cameras 18 may be focused toward different viewing areas around the patient 20 so that the fields of view of the cameras do not overlap or only overlap partially and thereby provide a larger region in which navigation is available. In another embodiment, two spaced-apart cameras 18 are focused on the same viewing area and provide stereo viewing and navigation capabilities, from which navigation by triangulation by known methods is possible. In this embodiment, registration and tracking is preferably performed in accordance with known methods, either as described herein or as known otherwise for stereoscopic navigation processes. Stereoscopic navigation may provide more precise localization tracking with better accuracy for distance perception, and allows for three-dimensional tracking of a single mark in space, such as with a single LED or optical navigation marker 30. Stereoscopic navigation also makes it possible to work with incomplete form factor information of the optical navigation markers.
The navigation system 10 described herein in its various forms is useful for providing navigation information to a surgeon, for example, during an surgical procedure and has several advantages over various surgical navigation systems of the prior art. One advantage is that by securely attaching the camera 18 to the patient 20 in a fixed position, it is possible to merge the camera space with the patient space and thereby eliminate the need for a separate patient tracker as used in many prior art systems. Eliminating the use of a separate patient tracker also eliminates at least one set of positional vectors that must be concatenated in order to track the position of the surgical tool 12 with respect to the patient 20 in a scan image 48 of the patient. Thus, in comparison to prior navigation systems, the present navigation system 10 reduces the amount of computing resources needed to track the surgical tool 12. Another advantage of the navigation system 10 over the prior systems is that separating the camera 18 from the surgical tool 12 allows a single camera 18 to be used to track more than one surgical tool. In addition, a single camera 18 or set of cameras may be used with many different surgical tools at once or in succession if the tracking element 14 includes unique tool identification information readable by the camera 18 and digital image recognition module 54. An additional benefit of the navigation system 10 is that there are no wires that have to be attached to the surgical tool 12 in order to enable the navigation system 10, whereas a system that includes cameras on the tool generally may need wires to provide an acceptable data communication link between the camera and the computer processor. In addition, the navigation system 10 may easily be adapted to navigate surgical tools in many different types of surgical procedures and is not limited to a single surgical procedure or even a predefined set of surgical procedures. Rather, the navigation system 10 may be easily adapted to provide navigation in almost any type of surgical procedure.
Numerous modifications to the present invention will be apparent to those skilled in the art in view of the foregoing description. Accordingly, this description is to be construed as illustrative only and is presented for the purpose of enabling those skilled in the art to make and use the invention and to teach the best mode of carrying out same. The exclusive rights to all modifications which come within the scope of the appended claims are reserved. All patents, patent applications, and other printed publications identified in this foregoing are incorporated by reference in their entireties herein.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12893821 | Sep 2010 | US |
| Child | 14156740 | US |
