Patent Application
20080300478
This disclosure relates generally to image-guided surgery systems (or surgical navigation systems), and in particular to systems and methods for displaying the real-time state of imaged anatomy, and accurately tracking and displaying surgical instruments during a surgical procedure.
Image-guided surgery systems track the precise location of surgical instruments in relation to multidimensional images of a patient's anatomy. Additionally, image-guided surgery systems use visualization tools to provide the surgeon with co-registered views of these surgical instruments with the patient's anatomy. The multidimensional images of a patient's anatomy may include computed tomography (CT) imaging data, magnetic resonance (MR) imaging data, positron emission tomography (PET) imaging data, ultrasound imaging data, X-ray imaging data, or any other suitable imaging data, as well as any combinations thereof.
Several surgical procedures require very precise planning for placement of surgical instruments that are internal to the body and difficult to view during the procedure. This is especially true when dealing with internal organs or anatomy that may deform in a predictable manner over time due to ongoing body activity, such as breathing and the beating of the heart.
Registration of 3D image datasets (CT, MR, PET, ultrasound, etc.) to a known reference frame can be a difficult problem in the operating room. The initial registration is typically defined by identifying common fiducial points within a region of interest between a 3D image dataset and a set of 2D or 3D fluoroscopic images. The previously acquired 3D image dataset defines a 3D rectilinear coordinate system, by virtue of their precision scan formation or the spatial mathematics of their reconstruction algorithms. However, it may be necessary to correlate 2D or 3D fluoroscopic images and anatomical features with features in a previously acquired 3D image dataset and with external coordinates of surgical instruments being used. As mentioned above, this is often accomplished by providing fiducials, or externally visible trackable markers that may be imaged, identifying the fiducials or markers on various images, and thus identifying a common set of coordinate registration points on the various images that may be tracked using a tracking system. Instead of using fiducials, tracking systems may employ an initialization process wherein the surgeon touches a number of points on a patient's anatomy in order to define an external coordinate system in relation to the patient's anatomy and to initiate tracking. In addition, image based registration algorithms can simplify the surgical workflow by using images that are available during the procedure without requiring direct contact with rigid patient landmarks.
The imaging and tracking accuracy of surgical instruments is impaired by a difference in the representation of a patient's anatomy in static images under dynamic circumstances, such as when the patient's anatomy deforms due to an ongoing body activity.
Therefore, it would be desirable to provide a system and method for tracking and displaying surgical instruments accurately in real-time, in both time and space, within both slice and volumetric medical images of organs that may deform in a predictable manner over time due to ongoing body activity.
The above-mentioned shortcomings, disadvantages and problems are addressed herein which will be understood by reading and understanding the following specification.
In an embodiment, a method of displaying real-time state of imaged anatomy during a surgical procedure comprising the steps of attaching a measurement device to a patient to measure and ongoing body activity and generating a gating signal corresponding to the ongoing body activity; establishing a navigation reference frame around the patient in a surgical field of interest; acquiring a time series of images of a patient's anatomy in the surgical field of interest in sync with the gating signal; determining an image position for each image in the time series in relation to the navigation reference frame; determining a position for at least one navigated surgical instrument used during the surgical procedure in relation to the navigation reference frame; and displaying the time series of images along with the at least one navigated surgical instrument used during the surgical procedure superimposed on the time series of images showing the real-time state of the imaged anatomy and the accurate positions of the at least one navigated surgical instrument within the real-time state of imaged anatomy.
In an embodiment, a method of displaying real-time state of imaged anatomy during a surgical procedure comprising the steps of attaching a measurement device to a patient to measure and ongoing body activity and generating a gating signal corresponding to the ongoing body activity; acquiring a time series of pre-operative 3D images of a patient's anatomy in a surgical field of interest in sync with the gating signal; establishing a navigation reference frame around the patient in the surgical field of interest; acquiring a time series of intraoperative 2D images of the patient's anatomy in the surgical field of interest in sync with the gating signal; reconstructing a time series of intraoperative 3D images from the time series of intraoperative 2D images; registering the time series of pre-operative 3D images with the time series of intraoperative 3D images; and displaying the time series of pre-operative 3D images along with at least one navigated surgical instrument used during the surgical procedure superimposed on the time series of pre-operative 3D images showing the real-time state of the imaged anatomy and the accurate positions of the at least one navigated surgical instrument within the real-time state of imaged anatomy.
In an embodiment, a method of displaying real-time state of imaged anatomy during a surgical procedure comprising the steps of attaching an EKG measurement device to a patient to measure the EKG of a patient and generating a gating signal corresponding to the measured EKG; acquiring a time sequence of pre-operative 3D CT volumetric images of a patient's anatomy in a surgical field of interest in sync with the gating signal; establishing a navigation reference frame around the patient in the surgical field of interest; acquiring a series of intraoperative 2D fluoroscopic images of the patient's anatomy in the surgical field of interest taken at various intervals while an imaging apparatus rotates around the patient; recording the EKG measurement and an image position within the navigation reference frame for each image in the series of intraoperative 2D fluoroscopic images; reconstructing a series of intraoperative 3D fluoroscopic volumetric images from the series of intraoperative 2D fluoroscopic images that have approximately the same EKG measurement; registering each intraoperative 3D fluoroscopic volumetric image in the time series with the navigation reference frame; registering each intraoperative 3D fluoroscopic volumetric image in the series with the corresponding pre-operative 3D CT volumetric image in the time sequence; and displaying the time sequence of pre-operative 3D CT volumetric images along with at least one navigated surgical instrument used during the surgical procedure superimposed on the time sequence of pre-operative 3D CT volumetric images showing the real-time state of the patient's imaged anatomy and the accurate positions of the at least one navigated surgical instrument within the real-time state of the patient's imaged anatomy.
In an embodiment, a method of displaying real-time state of imaged anatomy during a surgical procedure comprising the steps of attaching a respiratory cycle measurement device to a patient to measure the respiratory cycle of the patient and generating a gating signal corresponding to the measured respiratory cycle; establishing a navigation reference frame around the patient in a surgical field of interest; acquiring a time series of 2D fluoroscopic images of a patient's anatomy in the surgical field of interest in sync with the gating signal; recording the respiratory cycle measurement and an image position within the navigation reference frame for each image in the time series of 2D fluoroscopic images; and displaying the time series of 2D fluoroscopic images along with navigated surgical instruments superimposed on the time series of 2D fluoroscopic images showing the real-time state of the patient's imaged anatomy and the accurate positions of the navigated surgical instruments within the real-time state of the patient's imaged anatomy.
In an embodiment, an image-guided surgery system comprising a measurement device coupled to a patient for measuring an ongoing body activity of the patient and generating a gating signal corresponding to the ongoing body activity measurement; a plurality of tracking elements coupled to a navigation apparatus, wherein the navigation apparatus includes at least one processor; at least one imaging apparatus coupled to the navigation apparatus configured for imaging a patient's anatomy that deforms and changes position in relation to the ongoing body activity; and at least one display coupled to the a navigation apparatus and at least one imaging apparatus configured for displaying 2D slice and 3D volumetric images of the patient's anatomy that deforms and changes position in relation to the ongoing body activity and displaying an accurate position of at least one navigated surgical instrument within the 2D slice and 3D volumetric images in real-time.
Various other features, objects, and advantages of the invention will be made apparent to those skilled in the art from the accompanying drawings and detailed description thereof.
In the following detailed description, reference is made to the accompanying drawings that form a part hereof, and in which is shown by way of illustration specific embodiments that may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the embodiments, and it is to be understood that other embodiments may be utilized and that logical, mechanical, electrical and other changes may be made without departing from the scope of the embodiments. The following detailed description is, therefore, not to be taken as limiting the scope of the appended claims.
In various embodiments, a system and method for displaying the real-time state of imaged anatomy, and accurately tracking and displaying surgical instruments during a surgical procedure is disclosed. The disclosure provides a system and method that combines image-guided surgery (e.g., a surgical navigation) with time sequenced 2D images and/or 3D images by using one or more measures of an ongoing body activity, such as an EKG measurement or a respiratory cycle measurement, as a gating signal to determine which image in a sequence best represents the state of the imaged anatomy at a given point in time, and then displaying a navigated instrument or implant within that image at the given point in time.
The disclosure is explained with reference to selected surgical procedures using selected gating signals. However, it should be appreciated that the disclosure need not be limited to any surgical procedures or any gating signals. The systems and methods described may be used in any surgical procedure, where a patient's anatomy deforms due to ongoing body activity. The gating signal may be associated with a body activity, and correlated with the behavior of the patient's anatomy. For example, a surgical procedure related to the heart may be linked with an EKG signal as the gating signal, and a surgical procedure related to the liver may be linked with a respiratory cycle signal as the gating signal.
In surgical procedures, access to the body is obtained through one or more small percutaneous incisions or one larger incision in the body. Surgical instruments are inserted through these openings and directed to a region of interest within the body. Direction of the surgical instruments or implants through the body is facilitated by navigation technology wherein the real-time location of a surgical instrument or implant is measured and virtually superimposed on an image of the region of interest. The image may be a pre-acquired image, or an image obtained in near real-time or real-time using known imaging technologies such as computed tomography (CT), magnetic resonance (MR), positron emission tomography (PET), ultrasound, X-ray, or any other suitable imaging technology, as well as any combinations thereof.
Referring now to
The image-guided surgery system 10 also includes a measurement device 28 coupled to the patient 22, navigation apparatus 30 and at least one imaging apparatus 20 for measuring an ongoing body activity of patient 22. For example, the ongoing body activity may be breathing (respiration) or the beating of the heart, wherein patient anatomy deforms in a predictable manner over time due to the ongoing body activity. The measurement device 28 may be mounted on the portable cart 32 that includes components of the navigation apparatus 30 or may be positioned separately from the navigation apparatus 30. The measurement device 28 is configured for generating a gating signal associated with the ongoing body activity. For example, the measurement device 28 may be a respiratory cycle measurement device for measuring respiratory cycles of patient 22 or an electrocardiogram (EKG) measurement device for measuring cardiac cycles of patient 22. The respiratory cycle measurement device provides a gating signal associated with the changes in respiration detected by a change in position of a first tracking element 12 attached to the patient's chest relative to a second tracking element 14 that is fixed to the table 24, at least one imaging apparatus 20 or other fixed location. The EKG measurement device provides a gating signal associated with variations in electrical potential caused by the excitation of the heart muscle and detected at the body surface by sensors.
The gating signal generated by measurement device 28 may be coupled to at least one imaging apparatus 20 and navigation apparatus 30, and used to trigger image and data acquisition. The measurement device 28 measures an ongoing body activity of patient 22 and produces a gating signal off of the ongoing body activity to be used for triggering image and data acquisition of imaging apparatus 26 and navigation apparatus 30. The at least one imaging apparatus 20 automatically acquires data for a time series of images or for images at different anatomical levels.
The plurality of tracking elements 12, 14, 16 are operative to determine the positions of a patient's anatomy and surgical instruments. A first tracking element 12 may be attached to patient 22 on the patient's anatomy that changes position due to an ongoing body activity, a second tracking element 14 may be attached to at least one imaging apparatus 20 or attached to table 24 near the patient's anatomy that changes position due to an ongoing body activity, and a third tracking element 16 attached to a surgical instrument 18 to which an implant may be attached. For example, the first tracking element 12 may be attached to the chest of patient 22 and the second tracking element 14 may be attached to table 24 near the chest of patient 22. The location of the first tracking element 12 attached to patient 22 may change based on the ongoing body activity being measured. The plurality of tracking elements 12, 14, 16 may be coupled to the navigation apparatus 30 through either a wired or wireless connection.
In an exemplary embodiment, at least one tracking element 12 or 14 may act as a navigation reference that may be attached to patient 22 or table 24 near patient 22 in the surgical field of interest 34. The navigation reference creates a navigation reference frame for the image-guided surgery system 10 around the patient's anatomy in the surgical field of interest 34. Typically, the navigation reference used by an imaged-guided surgery system 10 is registered to the patient's anatomy prior to performing image-guided surgery or surgical navigation. Registration of the navigation reference frame impacts the accuracy of a navigated surgical instrument 18 or implant in relation to a displayed image.
In an exemplary embodiment, at least one tracking element 14 may act as a positional reference that may be attached to at least one imaging apparatus 20. The positional reference assists navigation apparatus 30 in determining imaging position in relation to at least one imaging apparatus 20.
In an exemplary embodiment, at least two tracking elements 12, 14 may be used for measuring an ongoing body activity. For example, for measuring the respiration cycle of a patient, a first tracking element 12 may be attached to the chest of patient 22 and a second tracking element 14 may be attached to table 24 or attached to at least one imaging apparatus 20. The navigation apparatus 30 would then be used to measure the difference in position between the first tracking element 12 attached to the chest of patient 22 and the second tracking element 14 attached to table 24 or attached to at least one imaging apparatus 20 during patient respiration.
In an exemplary embodiment, the navigation apparatus 30 may be configured for providing positional information of images relative to surgical instruments 18 and instrument navigation coordinates representing the tracking position of surgical instruments 18 in a patient's anatomy with reference to a gating signal in real-time during a surgical procedure.
In an exemplary embodiment, the at least one imaging apparatus 20 may be a fluoroscopic imaging apparatus for use during a surgical procedure. The at least one imaging apparatus 20 may be coupled to navigation apparatus 30 through either a wired or wireless connection. A second imaging apparatus (not shown) may be used to acquire a plurality of high quality images prior to performing the surgical procedure. This second imaging apparatus may comprise CT, MR, PET, ultrasound, X-ray, or any other suitable imaging technology, as well as any combinations thereof.
In an exemplary embodiment, the at least one display 26 is configured to show the real-time position and orientation of surgical instruments and/or implants on registered images of a patient's anatomy. Graphical representations of the surgical instruments and/or implants are shown on the display. These representations may appear as line renderings, shaded geometric primitives, or realistic 3D models from computer-aided design (CAD) files. The images and instrument representations are continuously being updated in real-time by the gating signal. The at least one display 26 may be coupled to at least one imaging apparatus 20 and navigation apparatus 30 through either a wired or wireless connection.
In an exemplary embodiment, the image-guided surgery system 10 may be an electromagnetic surgical navigation system utilizing electromagnetic navigation technology. However, other tracking or navigation technologies may be utilized as well.
In an electromagnetic surgical navigation system, the plurality of tracking elements 12, 14, 16 may include electromagnetic field generators and electromagnetic sensors that allow a surgeon to continually track the position and orientation of at least one surgical instrument 18 or an implant during a surgical procedure.
The electromagnetic field generators may include at least one coil, at least one coil pair, at least one coil trio, or a coil array for generating an electromagnetic field. A current is applied from the navigation apparatus 30 to the at least one coil, at least one coil pair, at least one coil trio, or a coil array of the electromagnetic field generators to generate a magnetic field around the electromagnetic field generators. The electromagnetic sensors may include at least one coil, at least one coil pair, at least one coil trio, or a coil array for detecting the magnetic field. The electromagnetic sensors are brought into proximity with the electromagnetic field generators in the surgical field of interest 14. The magnetic field induces a voltage in the at least one coil, at least one coil pair, at least one coil trio, or a coil array of the electromagnetic sensors, detecting the magnetic field generated by the electromagnetic field generators for calculating the position and orientation of the at least one surgical instrument 18 or implant. The electromagnetic sensors may include electronics for digitizing magnetic field measurements detected by the electromagnetic sensors. It should, however, be appreciated that according to alternate embodiments the electromagnetic field generators may be electromagnetic sensors, and the electromagnetic sensors may be electromagnetic field generators.
The magnetic field measurements can be used to calculate the position and orientation of at least one surgical instrument 18 or implant according to any suitable method or system. After the magnetic field measurements are digitized using electronics, the digitized signals are transmitted from the electromagnetic sensors to a computer or processor within the navigation apparatus 30 through a navigation interface. The digitized signals may be transmitted from the electromagnetic sensors to the navigation apparatus 30 using wired or wireless communication protocols and interfaces. The digitized signals received by the navigation apparatus 30 represent magnetic field information detected by the electromagnetic sensors. The digitized signals are used to calculate position and orientation information of the at least one surgical instrument 18 or implant. The position and orientation information is used to register the location of the surgical instrument 18 or implant to acquired imaging data from at least one imaging apparatus 20. The position and orientation data is visualized on at least one display 26, showing in real-time the location of at least one surgical instrument 18 or implant on pre-acquired or real-time images from at least one imaging apparatus 20. The acquired imaging data from at least one imaging apparatus 20 may include CT imaging data, MR imaging data, PET imaging data, ultrasound imaging data, X-ray imaging data, or any other suitable imaging data, as well as any combinations thereof. In addition to the acquired imaging data from various modalities, real-time imaging data from various real-time imaging modalities may also be available.
In an exemplary embodiment, the image-guided surgery system 10 may be integrated into a single integrated imaging and navigation system with integrated instrumentation and software.
The image-guided surgery system 210 includes a plurality of tracking elements that may be in the form of electromagnetic field generators 212 and electromagnetic sensors 216 that are coupled to a navigation interface 240. The electromagnetic field generators 212 each generate an electromagnetic field that is detected by electromagnetic field sensors 216. The navigation interface 240 receives digitized signals from electromagnetic sensors 216. The navigation interface 240 includes at least one Ethernet port. The at least one Ethernet port may be provided, for example, with an Ethernet network interface card or adapter. However, according to various alternate embodiments, the digitized signals may be transmitted from electromagnetic sensors 216 to navigation interface 240 using alternative wired or wireless communication protocols and interfaces.
The digitized signals received by navigation interface 240 represent magnetic field information from electromagnetic field generators 212 detected by electromagnetic sensors 216. In the embodiment illustrated in
In an exemplary embodiment, the electromagnetic field generators 212 and electromagnetic sensors 216 may be coupled to navigation interface 240 through either a wired or wireless connection.
The tracker module 250 communicates the position and orientation information to a navigation module 260 over local interface 242. As an example, this local interface 242 is a Peripheral Component Interconnect (PCI) bus. However, according to various alternate embodiments, equivalent bus technologies may be substituted.
Upon receiving the position and orientation information, the navigation module 260 is used to register the location of the surgical instrument or implant to acquired patient imaging data. In the embodiment illustrated in
Patient imaging data acquired prior to a surgical procedure may be transferred to system 210 and stored on data storage device 244. The acquired patient imaging data is loaded into memory 238 from data storage device 244. The acquired patient imaging data is retrieved from data storage device 244 by a data storage device controller 246. The navigation module 260 reads from memory 238 the acquired patient imaging data. The navigation module 260 registers the location of the surgical instrument or implant to acquired patient imaging data, and generates image data suitable to visualize the patient imaging data and a representation of the surgical instrument or implant. The imaging data is transmitted to a display controller 248 over local interface 242. The display controller 248 is used to output the imaging data to display 226.
The image-guided surgery system 210 may further include an imaging apparatus 220 coupled to an imaging interface 270 for receiving real-time imaging data. The imaging data is processed in an imaging module 280. The imaging apparatus 220 provides the ability to acquire images of a patient and display real-time imaging data in combination with position and orientation information of a surgical instrument or implant on display 226.
The image-guided surgery system 210 may further include a measurement device 228 for measuring an ongoing body activity of a patient. For example, the ongoing body activity may be breathing (respiration) or the beating of the heart, wherein patient anatomy deforms in a predictable manner over time due to the ongoing body activity. The measurement device 228 is attached to a patient with sensors to measure the ongoing body activity and coupled to a measurement device interface 290 for transmitting and receiving data. The measurement device interface is in turn coupled to the local interface 242. The measurement device 228 is configured for generating a gating signal associated with the ongoing body activity. For example, the measurement device 228 may be a respiratory cycle measurement device for measuring respiratory cycles of a patient or an EKG measurement device for measuring cardiac cycles of a patient.
While one display 226 is illustrated in the embodiment in
The benefits of this disclosure include both reduced radiation dose to the patient and surgical staff, and an improved understanding of the real-time state of the anatomy of interest, along with accurate surgical instrumentation positioning, during a surgical procedure. These benefits will contribute to improved surgical procedure outcomes.
Several embodiments are described above with reference to drawings. These drawings illustrate certain details of specific embodiments that implement the systems, methods and programs of the invention. However, the drawings should not be construed as imposing on the invention any limitations associated with features shown in the drawings. This disclosure contemplates methods, systems and program products on any machine-readable media for accomplishing its operations. As noted above, the embodiments of the may be implemented using an existing computer processor, or by a special purpose computer processor incorporated for this or another purpose or by a hardwired system.
As noted above, embodiments within the scope of the included program products comprising machine-readable media for carrying or having machine-executable instructions or data structures stored thereon. Such machine-readable media can be any available media that can be accessed by a general purpose or special purpose computer or other machine with a processor. By way of example, such machine-readable media may comprise RAM, ROM, PROM, EPROM, EEPROM, Flash, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code in the form of machine-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer or other machine with a processor. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) to a machine, the machine properly views the connection as a machine-readable medium. Thus, any such a connection is properly termed a machine-readable medium. Combinations of the above are also included within the scope of machine-readable media. Machine-executable instructions comprise, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing machines to perform a certain function or group of functions.
Embodiments are described in the general context of method steps which may be implemented in one embodiment by a program product including machine-executable instructions, such as program code, for example in the form of program modules executed by machines in networked environments. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Machine-executable instructions, associated data structures, and program modules represent examples of program code for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represent examples of corresponding acts for implementing the functions described in such steps.
Embodiments may be practiced in a networked environment using logical connections to one or more remote computers having processors. Logical connections may include a local area network (LAN) and a wide area network (WAN) that are presented here by way of example and not limitation. Such networking environments are commonplace in office-wide or enterprise-wide computer networks, intranets and the Internet and may use a wide variety of different communication protocols. Those skilled in the art will appreciate that such network computing environments will typically encompass many types of computer system configurations, including personal computers, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the like. Embodiments of the invention may also be practiced in distributed computing environments where tasks are performed by local and remote processing devices that are linked (either by hardwired links, wireless links, or by a combination of hardwired or wireless links) through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
An exemplary system for implementing the overall system or portions of the system might include a general purpose computing device in the form of a computer, including a processing unit, a system memory, and a system bus that couples various system components including the system memory to the processing unit. The system memory may include read only memory (ROM) and random access memory (RAM). The computer may also include a magnetic hard disk drive for reading from and writing to a magnetic hard disk, a magnetic disk drive for reading from or writing to a removable magnetic disk, and an optical disk drive for reading from or writing to a removable optical disk such as a CD ROM or other optical media. The drives and their associated machine-readable media provide nonvolatile storage of machine-executable instructions, data structures, program modules and other data for the computer.
The above-description of various exemplary embodiments of image-guided surgery systems and the methods have the technical effect of displaying surgical instruments accurately, in both time and space, within both slice and volumetric medical images of organs that may deform in a predictable manner over time due to an ongoing body activity.
While the invention has been described with reference to various embodiments, those skilled in the art will appreciate that certain substitutions, alterations and omissions may be made to the embodiments without departing from the spirit of the invention. Accordingly, the foregoing description is meant to be exemplary only, and should not limit the scope of the invention as set forth in the following claims.
