Patent Application
20200337534
The invention relates to the field of medical imaging and more particularly to an apparatus and method for locating a surgical port with respect to an endoscopic device.
Minimally invasive surgery is performed using elongated instruments 10, 20, 30 inserted into a patient's body through small ports 12, 22, 32, as shown in
In a standard clinical practice, the ports are located using guidelines published by professional associations, hospitals, or manufacturers of surgical equipment. The guidelines define entry points with respect to some well-known anatomical landmarks. For example, in cardiac surgery ports are located by defining anatomical landmarks, such as: ribs, sternum, and nipple, together with defining distances from these landmarks. This kind of guidance does not take into account variability in anatomy (both between patients and between pre-operative versus intra-operative anatomy), patient size, specificity of patient's disease or condition, and the like. A more patient-specific port placement can be beneficial, minimizing access-related tissue trauma and procedure times while improving outcomes.
After the instruments are inserted into the body cavity through the ports, they can be moved in four degrees of freedom (DOF): two angles of rotation pivoting around the port (fulcrum point), insertion, and rotation about the instruments longitudinal axis. The angles of rotation are rotation about imaginary axes that are perpendicular to each other and to the longitudinal axis of the instrument. Whereas rotation and insertion are intuitive and easy to use, mapping between the angles of rotation and an endoscope view of the body cavity is less intuitive, takes a long time to learn, and, as studies show, is the biggest hurdle to hand-eye coordination in minimally invasive surgery.
Much of the research on improving port placement is focused on developing computer algorithms to compute optimal ports for instruments based on preoperative 3D medical images. The subsequent translation of these optimized plans into an operating room is focused on using standard tool tracking technologies known from surgical navigation. However, tool tracking on preoperative 3D images does not take into account that spatial relationships between anatomical landmarks may significantly change from preoperative images to intraoperative situation. For example, in minimally invasive surgery CO2 is introduced into the natural cavity (such as chest or abdomen) to expand the patient and provide a larger space for instruments. After introduction of the CO2, the spatial arrangement between outer surface of the patient (e.g. chest) and organs (such as heart) would change. Thus, the preoperative planning of port placement would not be useful in the new arrangement.
Publ. Pat. Appl. No. US 2011/202069 A1 by Giuseppe M. Prisco et al. is directed to an apparatus for three-dimensional measurements in a fixed world reference frame. A reference fixture includes a joint and a joint tracker to track motion of the joint. A surgical instrument is connected to the reference fixture by a tether. A shape sensor extends from the reference fixture, through the tether, and into the surgical instrument. The shape sensor is substantially free of twist. Information from the joint tracker and the shape sensor are used to register three-dimensional information to a fixed world reference frame.
Pat. No. U.S. Pat. No. 7,930,065 to David Q. Larkin et al. is directed to a robotic surgery system with position sensors using fiber Bragg gratings to determine the position of a joint of an articulatable arm.
A method, device, and system are provided for placing a port for a surgical tool relative to real-time anatomical data
According to one aspect of the present invention, a method is provided for placing a port for a surgical tool relative to real-time anatomical data. The method comprises the steps of: placing an endoscope in a standard port, determining real-time anatomical data from an image from the endoscope, using a port localization apparatus to identify an optimal location for an instrument port relative to the image from the endoscope, and creating an instrument port at the identified location.
According to one embodiment, the port localization apparatus is affixed to the endoscope at a predetermined point, and the step of using a port localization apparatus to identify an optimal location for an instrument port comprises the steps of: locating a potential port location, determining a virtual projection of an instrument through the potential port location onto the plane of the endoscope image, overlaying a virtual representation of the instrument onto the endoscope image corresponding to the potential port location, and receiving an indication of whether or not the potential port location is an optimal port location.
According to one the indication of whether or not the potential port location is an optimal port location is provided by a user of the port localization apparatus.
According to one embodiment, the indication of whether or not the potential port location is an optimal port location is determined and provided by a processing device based on the position of the overlaid virtual representation of the instrument.
According to one embodiment, the method further comprises the step of: manipulating a positioning and orientation apparatus to project the virtual projection of the instrument onto the endoscope image. The positioning and orientation apparatus captures the angles of projection and a port localization program of instruction executed by a processor determines the location of the virtual projection on the endoscope image corresponding to the captured angles.
According to one embodiment, the port localization apparatus is a shape sensing tether and the positioning and orientation apparatus is a stylus. The shape sensing tether provides the 3D form of the tether so that a port localization program of instruction can determine the location of the free end of the tether in endoscope coordinates. Then a modeling program of instruction projects a virtual tool through a potential port location at the free end of the tether onto an endoscope image. The stylus allows a surgeon orient the stylus like a tool or even to manipulate it like a tool so that the orientation and the range of motion for a tool is projected onto the endoscope image. The tool orientation and the range of motion may be used to determine whether or not a potential port location is optimal.
According to one embodiment, the port localization apparatus is at least one rigid member and the positioning and orientation apparatus is at least one joint connected to the at least one rigid member and having an encoder measuring an angle of the joint.
According to another aspect of the present invention, a device is provided for locating a port for a surgical tool relative to real-time anatomical data from an endoscope. The device comprises: a port localization apparatus affixed to the endoscope at a predetermined point and locating a port at a known location relative to the endoscope.
According to one embodiment, the device further comprises a processor, the processor: determines the port location in an image space of the endoscope, determines a projection of an instrument through the port location onto an image from the endoscope, and overlaying a virtual representation of the instrument onto the endoscope image corresponding to the potential port location.
According to one embodiment the device further comprises a positioning and orientation apparatus operably connected to the port localization apparatus. The positioning and orientation apparatus is adapted to be manipulated to providing angles of projection at the port location for a projection of an instrument onto the endoscope image. The positioning and orientation apparatus captures the angles of projection and determining the location of the projection on the endoscope image.
According to one embodiment, the port localization apparatus is a shape sensing tether and the positioning and orientation apparatus is a stylus.
According to one embodiment, the port localization apparatus is at least one rigid member and the positioning and orientation apparatus is at least one joint connected to the at least one rigid member and having an encoder measuring an angle of the joint.
According to another aspect of the present invention, a system is provided for locating a port for a surgical tool relative to an endoscope. The system comprises: a processor, a memory operably connected with the processor, an endoscope providing an endoscope image, a port localization apparatus affixed to the endoscope at a predetermined point and locating a port at a known location relative to the endoscope, and a program of instruction encoded on the memory and executed by the processor to determine the location of the port.
According to one embodiment, the program of instruction executed by the processor: determines the port location in an image space of the endoscope, determines a projection of an instrument through the port location onto an image from the endoscope, and overlays a representation of the instrument onto the endoscope image corresponding to the potential port location.
According to one embodiment, the system further comprises a positioning and orientation apparatus operably connected to the port localization apparatus. The positioning and orientation apparatus is adapted to be manipulated to providing angles of projection at the port location for a projection of an instrument onto the endoscope image. The positioning and orientation apparatus captures the angles of projection and the port localization program of instruction determines the location of the projection on the endoscope image.
According to one embodiment, the port localization apparatus is a shape sensing tether and the positioning and orientation apparatus is a stylus.
According to one embodiment, the port localization apparatus is at least one rigid member and the positioning and orientation apparatus is at least one joint connected to the at least one rigid member and having an encoder measuring an angle of the joint.
The features and advantages of the invention will be more clearly understood from the following detailed description of the preferred embodiments when read in connection with the accompanying drawing. Included in the drawing are the following figures:
The present invention provides a method, device, and system for locating a port for a surgical tool relative to real-time anatomical data from an endoscope.
Returning to
The Bragg wavelength is sensitive to strain as well as temperature. This means that Bragg gratings can be used as sensing elements in fiber optic sensors. In an FBG sensor, the measurand (e.g., strain) causes a shift in the Bragg wavelength.
One of the main advantages of FBG's is that various sensor elements can be distributed over the length of a fiber. Incorporating 3 or more cores with various sensors (gauges) along the length of a fiber that is embedded in a structure allows for the 3-dimensional form of the structure to be precisely determined. A plurality of FBG sensors are positioned along the length of the fiber (e.g., in 3 or more sensing cores). From the Bragg wavelength shift, the strain can be measured at each FBG. From the strain measurements, at various positions, the curvature at these positions can be inferred. From the plurality of measured positions, the total 3-dimensional form is determined.
As an alternative to FBG, the inherent backscatter in conventional optical fiber can be exploited for shape sensing. One such approach is to use Raleigh scatter in standard, single-mode communications fiber. Raleigh scatter occurs as a result of random fluctuations of the index of refraction in the fiber core. These random fluctuations can be modeled as a Bragg grating with random variation of amplitude and phase along the grating length. By using this effect in 3 or more cores running within a single length of multicore fiber, the 3D shape and dynamics of the surface of interest is trackable.
With the optical fiber connected to the endoscope at a known anchor point, the spatial relationship to the endoscope image 16 is established using two mechanical properties of the mounting: (1) the distance from the center axis of the endoscope to the anchor point (d); and (2) the distance from the anchor point to the endoscope image plane (1) (i.e., the focal length of the endoscope+the distance from the lens of the endoscope to the anchor point along the axis of the endoscope).
These two values: (d) and (1) are used to translate the coordinate system of the fiber to the coordinate system of the endoscopic image so that the measured shape of the optic fiber beyond the anchor point 212 can be calculated in the endoscope coordinate system. Thus, a potential port location 112 can be contacted with the free end of the optic fiber 210 to locate it relative to the endoscopic image 16. Moreover, the shape of the optic fiber can be extended using a 3D modeling application to project a virtual surgical tool onto the plane of the endoscopic image 16. A representation of the surgical tool 216, such as a virtual dot, is then overlaid onto the endoscopic image 16, and used to determine whether or not the proposed port location 112 is optimal.
The memory 230 has encoded on it a localization program of instruction 232 executed by the processor 220 to locate a port for a surgical tool relative to real-time anatomical data from the endoscope 10. The system also comprises one or more displays 240 for presenting a user interface with endoscope data and one or more input and/or output devices 250 for entering user inputs, for example.
The memory 230 may also have endoscope program instructions 234 for presenting an endoscope image 16 on the display 240, and modeling program instructions 236 for modeling and projecting a virtual representation 216 of a surgical tool through a potential port location onto the endoscope image 16.
The processor 220 executes the endoscope program instructions 232 to determine real-time anatomical data from the endoscope 10 (Step 520). The real-time anatomical data may be the digitized endoscopic image 16, such as the coordinates and intensity values for each pixel of the image.
The port localization program instructions 232 executed by the processor 220 uses the port localization apparatus 210 to identify an optimal port location (Step 530). Then, the surgeon creates a port at the determined location (Step 540).
According to one embodiment, the port localization apparatus 210 comprises a tether with an optical shape-sensing fiber which is fixed to the endoscope at a known anchor point 212. As shown in
According to one embodiment, a representation of the projection of the surgical tool is overlaid on the endoscopic image 16 (Step 533). Based on the position of the representation, a determination is made of whether or not the potential port location is optimal. This determination can be made by the surgeon after looking at the position of the representation of the tool, or by the port localization program instructions 232 executed by the processor 220 using a modeling application. The port localization program instructions 232 executed by the processor 220 then receives the indication of whether or not the location is optimal (Step 534). The port localization program instructions 232 executed by the processor 220 may iteratively test potential port locations until an optimal location is located (Step 535).
According to another embodiment, a virtual line is determined directly from the free end of the optic fiber 210 to the center of the endoscope image 16 and the resulting tool angles at the potential port location are determined using a modeling application. Then a determination of whether or not the potential port location is optimal is made based on the determined tool angles.
For example, the tool angles may be determined for several potential port locations and the potential port location with the smallest tool angle or angle of rotation will be determined to be the optimal port location. Alternatively, a pre-determined optimal tool angle may be provided and if the actual determined tool angle for a potential port location is equal to or less than the pre-determined optimal tool angle the potential port location is determined to be the optimal port location. By minimizing the tool angle, tissue trauma is reduced as the tool contacts less tissue with a reduced tool angle. Also, a reduced tool angle allows for a shorter tool extension, providing better tool control and reducing positioning error.
According to one embodiment, a positioning and orientation apparatus 270 is connected to the localization apparatus 210 to project the projection of the instrument onto the endoscope image 16. The positioning and orientation apparatus 270 captures the angles of projection and determines the location of the projection on the endoscope image corresponding to the captured angles. The positioning and orientation apparatus 270 may be, for example, a stylus simulating the handle of a surgical tool. The optic fiber 210 may be fixed in the stylus, such as through a longitudinal opening, such that the end of the optic fiber (captured in the stylus) is held at the tool angles relative to the potential port location. In this embodiment, the angles are captured by shape sensing of the optic fiber.
The surgeon holds the positioning and orientation apparatus 270 at a potential port location and manipulates it to simulate the intended procedure. As described in the previous embodiment, the port locating program of instruction 232 translates the potential port location to endoscope coordinates using the known anchor point and the determined shape of the optic fiber. The modeling program instructions 236 extend a virtual tool from the potential port location along the angles defined by the end of the optic fiber held in the stylus. The projection of the tool is then overlaid onto the endoscope image 16 so that the surgeon can see the range of motion corresponding to the potential port location and determine whether or not the potential port location is optimal.
Alternatively, the determination of an optimal port location may be based on the range of motion for the virtual tool. The optimal port location corresponds to the greatest range of motion. The greatest range of motion can be determined, for example, by determining the range of motion for several potential port locations and determining that the potential port location with the greatest range of motion is the optimal port location. The range of motion can be determined by manipulating the poisoning and orientation apparatus 270 and measuring the area covered by the projection on the endoscope image.
Determining that the optimal port location corresponds to the greatest range of motion allows the surgeon to more easily reach all areas of interest with surgical tools using this optimal port location.
According to one embodiment, the joints 270 are motorized to manipulate a port localization apparatus, or even a surgical tool, during a procedure by driving the joints to angles corresponding to a desired location for automatic positioning. In this embodiment, the surgeon may input a location on the endoscope image to automatically position a tool.
As shown in
The invention can take the form of an entirely hardware embodiment or an embodiment containing both hardware and software elements. In an exemplary embodiment, the invention is implemented in software, which includes but is not limited to firmware, resident software, microcode, etc.
Furthermore, the invention may take the form of a computer program product accessible from a computer-usable or computer-readable medium providing program code for use by or in connection with a computer or any instruction execution system or device. For the purposes of this description, a computer-usable or computer readable medium may be any apparatus that can contain or store the program for use by or in connection with the instruction execution system, apparatus, or device.
The foregoing method may be realized by a program product comprising a machine-readable medium having a machine-executable program of instructions, which when executed by a machine, such as a computer, performs the steps of the method. This program product may be stored on any of a variety of known machine-readable medium, including but not limited to compact discs, floppy discs, USB memory devices, and the like.
The medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device). Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk an optical disk. Current examples of optical disks include compact disk-read only memory (CD-ROM), compact disk-read/write (CD-R/W) and DVD.
The preceding description and accompanying drawing are intended to be illustrative and not limiting of the invention. The scope of the invention is intended to encompass equivalent variations and configurations to the full extent of the following claims.
This application is a continuation-in-part of U.S. application Ser. No. 14/362,113 filed on May 30, 2014, which claims priority of PCT/IB2012/056350, filed on Nov. 12, 2012, which claims priority to U.S. Provisional Application No. 61/566,614, filed Dec. 3, 2011.
| Number | Date | Country | |
|---|---|---|---|
| 61566614 | Dec 2011 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14362113 | May 2014 | US |
| Child | 16926828 | US |
