This disclosure relates to medical instruments and methods and, more particularly, to a reference device employed in locating a target in endoscopic images.
Minimally invasive surgery is performed using elongated instruments inserted into a patient's body through small ports. Placement of ports plays an important role in the outcome of the surgery as instruments positioned in a suboptimal port may not be able to reach all areas of an organ of interest. This is especially a problem in minimally invasive coronary artery bypass surgery where larger incisions between ribs (referred to as a mini-thoracotomy) may be placed to achieve direct access to the heart and specifically to a target artery.
In an ideal case, the position of incision should be exactly above the target artery allowing access without spreading the ribs. However, in many cases, given that there are limited tools to help decide the position of the mini-thoracotomy, the incision can be positioned so that the artery is not directly accessible. In that case, rib retractors or rib lifting devices are needed. Use of such devices may result in postoperative pain, longer recovery times and additional risk of infection.
In accordance with exemplary embodiments of the present invention, a reference device for surgery is disclosed that includes a substrate forming a matrix of windows configured to be attached to an external portion of a body. The windows can provide access location choices from which access to a target area may be determined. A radiopaque marker can be integrated with the substrate such that the at least one radiopaque marker is visible in X-ray images. A fixing mechanism can be coupled to the substrate to secure the substrate in contact with the body to prevent motion of the substrate relative to the body.
For example, the substrate can form a net wherein openings in the net form the windows. The net can include mesh portions and the at least one radiopaque marker can be disposed at an intersection of the mesh portion. The fixing mechanism can include an adhesive and/or a belt or strap. The substrate can include a radiopaque material. Further, the substrate can include one or more indices for identifying the windows, which indices can be visible in an X-ray image in accordance with exemplary embodiments of the present disclosure.
Also in accordance with exemplary embodiments of the present invention, a method for selecting an access location for an anatomical target is disclosed that includes acquiring a first image of an internal anatomical feature; localizing an anatomical target in the first image; applying a reference grid on a body, the reference grid including a substrate forming a matrix of windows configured to be attached to an external portion of the body, the windows providing access location choices from which access to the anatomical target area may be made, the grid including at least one radiopaque marker integrated with the substrate such that the at least one radiopaque marker is visible in X-ray images; acquiring an X-ray image which includes the grid and the anatomical target; registering the first image with the X-ray image; and projecting the grid on the first image to select a grid window for accessing the anatomical target.
For example, acquiring a first image can include acquiring an endoscopic image including the internal anatomical feature and/or acquiring an X-ray image including the internal anatomical feature. Localizing an anatomical target in the first image can include selecting a target blood vessel for a bypass procedure. Projecting the grid on the first image to select a grid window can include selecting a grid window to avoid separating or lifting off of ribs during the bypass procedure. Applying a reference grid on the body can include adhering the reference grid to the body with adhesive. Exemplary embodiments of a method in accordance with the present invention can further comprise accessing the anatomical target through a grid window directly over the anatomical target and/or providing an index on the grid to identify a grid window corresponding to the anatomical target in the X-ray image.
Further, in accordance with exemplary embodiments of the present invention, a system for selecting an access location for an anatomical target is disclosed that includes a first imaging modality configured to generate a first image of an internal anatomical feature and to localize an anatomical target in the first image. A reference grid can be applied on a body. The reference grid can include a substrate forming a matrix of windows configured to be attached to an external portion of the body. The windows can provide access location choices from which access to the anatomical target area may be made. The grid can include at least one radiopaque marker integrated with the substrate such that the at least one radiopaque marker is visible in X-ray images. A second imaging modality can be configured to acquire an X-ray image that includes the grid and the anatomical target. A registering module can be configured to register the first image with the X-ray image. An image processing module can be configured to project the grid on the first image on a display to permit a selection of a best grid window for accessing the anatomical target.
For example, the first image modality can include an endoscope having a camera. The first image can include an X-ray image including the internal anatomical feature. The anatomical target can include a target blood vessel for a bypass procedure. The best grid window can include a grid window that avoids separating or lifting off of ribs during the bypass procedure. The reference grid can include an adhesive structured and configured for adhering the reference grid to the body. It is also possible that best grid window includes a grid window directly over the anatomical target. Exemplary embodiments of a system according to the present disclosure can further comprise an index on the grid to identify a grid window corresponding to the anatomical target in the X-ray image, for example.
These and other objects, features and advantages of the present disclosure will become apparent from the following detailed description of illustrative embodiments thereof, which is to be read in connection with the accompanying drawings.
This disclosure will present in detail the following description of preferred embodiments with reference to the following figures wherein:
In accordance with the present principles, methods for planning and locating a position for an incision for allowing direct access to a target blood vessel within a thoracic cavity (e.g., for a mini-thoracotomy or thoracotomy) without a need to spread or lift the ribs are provided. Intraoperative live incision planning is provided based on intraoperative images (e.g., endoscopy and X-ray) as opposed to using preoperative images. One advantage is that a relative position of ribs and thorax with respect to the heart is established at the time of incision. Preoperative images may have a very different spatial arrangement due to invasive changes introduced intraoperatively (e.g., collapsing the lung, introducing CO2, etc).
In one embodiment, a patient mounted device is employed to establish a relationship between an imaging modality, e.g., an endoscope and/or X-ray images, and a method to visualize areas on the thorax with respect to the images to precisely plan the incision and remove the need for rib lifting or retraction. The device and methods establish an exact position of mini-thoracotomy with respect to the target vessel (e.g., localize the target vessel in the endoscopy images). The device establishes a reference grid on the thorax with respect to X-ray images. A method to establish a relationship between the endoscope image (target vessel) and the X-ray image (reference grid) is thereby provided, and a most appropriate resection area is identified to access the target vessel.
It should be understood that the present invention will be described in terms of medical instruments; however, the teachings of the present invention are much broader and are applicable to any methods or instruments employed to locate internal targets. In some embodiments, the present principles are employed in accessing or analyzing complex biological or mechanical systems. In particular, the present principles are applicable to internal procedures on biological systems, and procedures in all areas of the body such as the lungs, gastro-intestinal tract, excretory organs, blood vessels, etc. The elements depicted in the FIGS. may be implemented in various combinations of hardware and software and provide functions which may be combined in a single element or multiple elements.
The functions of the various elements shown in the FIGS. can be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), non-volatile storage, etc.
Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (i.e., any elements developed that perform the same function, regardless of structure). Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein represent conceptual views of illustrative system components and/or circuitry embodying the principles of the invention. Similarly, it will be appreciated that any flow charts, flow diagrams and the like represent various processes which may be substantially represented in computer readable storage media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
Furthermore, embodiments of the present invention can take the form of a computer program product accessible from a computer-usable or computer-readable storage medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer readable storage medium can be any apparatus that may include, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device) or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk-read only memory (CD-ROM), compact disk-read/write (CD-R/W), Blu-Ray™ and DVD.
Referring now to the drawings in which like numerals represent the same or similar elements and initially to
A medical device or instrument 102 may include a catheter, a guidewire, a probe, an endoscope, a robot, an electrode, a filter device, a balloon device, other medical component, etc. The medical device 102 includes a camera 104 or other imaging mechanism capable of capturing real-time images internal to a body 160 of a patient. In a particularly useful embodiment, images are collected from inside a thoracic cavity 162 of the body 160. Cabling 127 may be employed to connect the device 102 to the workstation 112 to exchange commands, supply power and transfer data as needed.
The device 102 may be inserted through a port 158, e.g., into the thoracic cavity 162 to locate a target, such as, e.g., a blood vessel 131. For example, the blood vessel 131 may include a blood vessel to be harvested, such as, an internal mammary artery (IMA) or other suitable blood vessel. The port 158 and/or an incision may be employed to access the interior of the thoracic cavity 162 and be employed to insert the device 102 therein. In one embodiment, the device 102 includes an endoscope or a robotically driven endoscope. The camera 104 mounted on or in the device 102 is employed for transmitting internal images to a display 118 and/or to memory 116 for image processing, e.g., registration with other images using the registration module 136 or other image processing or generation using an image processing module 148. The endoscope 102 and/or the camera 104, inserted through the port 158, include a coordinate system 152. Images taken by an imaging system 110 also have their own coordinate system 138. These coordinate systems 138 and 152 can be registered using the registration module 136, and the methods described hereinbelow so that an optimal position for a resection can be determined over a target. The imaging system 110 may include an X-ray system, CT system, etc.
In accordance with one embodiment, a reference grid 166 is placed on the thorax (or other area) and employed with fluoroscopic images. The grid 166 may include a substrate 156, which includes a matrix of one or more radiopaque markers 150 integrated therein. The grid 166 may be attached to the thorax of the body 160 in an area or areas of interest (in cardiac surgery, the grid 166 can be placed on the left side of the patient, on top of the heart). The substrate 156 of the grid 166 forms windows 154, which can be marked with indices, e.g., alpha-numerical markers (numbers, letters, matrix combination of numbers and letters (e.g., B5)) to indicate position in the x-ray image 134.
A relationship between endoscope images 142 and preoperative images 135 and/or intraoperative 3D images 134 (CT angiography or Xper CT angiography) is established using a known method. The endoscope 102 is moved to visualize the target vessel 131, and a target bypass position is centered in the center of the endoscope view. The radiopaque grid 166 is placed on the thorax while the endoscope 102 is maintained in a same position. X-ray imaging is performed to establish a relationship between the endoscope 102 and the grid 166.
As both the endoscope 102 and the grid 166 will be visible in the image 134, a transformation between endoscope coordinate system 152 and the grid 166 can be found. Combining this relationship and the registration performed by registering the endoscope 102 with preoperative/intraoperative 3D images, a relationship between the endoscope image 134 and the grid 166 can be established.
A virtual overlay 106 of the grid 166 may be generated and placed over the endoscope image(s) 142 using the image processing module 148. The virtual overlay 106 over the endoscope image(s) 142 can be displayed on a display 118 using projective geometry and the established relationship described above. The virtual overlay 106 gives an intuitive visualization of the accessibility of the different areas, e.g., on the heart, via different resection ports on the thorax. A resection can be performed such that rib retraction or rib lifting is not necessary, which reduces trauma to the chest, among other things. The grid 166 assists in establishing an exact or optimal position for a mini-thoracotomy, etc. with respect to the target vessel 131 by localizing the target vessel in the endoscopy images 142, establishing the reference grid 166 on the thorax with respect to X-ray images 134, and establishing a relationship between the endoscope image 142 (target vessel) and the X-ray image 134 using the reference grid 166. A most appropriate resection area is then identified to access the target vessel 131.
Workstation 112 includes or is coupled with the display 118 for viewing images of the patient 160. Display 118 may permit a user to interact with the workstation 112 and its components and functions, or any other element within the system 100. This is further facilitated by an interface 120 which may include a keyboard, mouse, a joystick, a haptic device, or any other peripheral or control to permit user feedback from and interaction with the workstation 112.
Referring to
It should be understood that while the grid 166 is depicted as a net-like shape, the shape of the grid may include concentric circles, a single line with a plurality of parallel intersecting lines, concentric rectangles, etc. The windows 154 may be pre-shaped or located to provide the best opportunity for accessing an anatomical target. For example, the grid 166 may include location points that can be applied over external anatomical features (e.g., ribs, the sternum, etc.) to better position the windows 154 at optimal locations. The windows 154 represent access locations where a high probability of clear access can be obtained, which is verified directly using the virtual overlay image.
In a first step of an illustrative procedure, a relationship between an endoscope video stream as collected by the endoscope 102 and preoperative or intraoperative 3D images is established. Endoscopic registration to preoperative images may employ known techniques. The endoscope 102 is then moved to a position where a target vessel and a target bypass position can be visualized (e.g., in the center of the endoscope view). In a second step, the radiopaque grid 166 is placed on the thorax while the endoscope 102 is maintained in the same position. In the third step, X-ray imaging is performed to establish a relationship between the endoscope 102 and the grid 166. Both endoscope 102 and the grid 166 will be visible in the image. Therefore, a transformation between an endoscope coordinate system and the grid 166 can be found. Combining this relationship and the registration performed in the first step, a relationship between endoscope image and the grid 166 can be established. In a fourth step, a virtual overlay of the grid in endoscope images can be displayed using projective geometry and the established relationship.
Referring to
Referring to
Referring to
In block 514, an X-ray image is taken with the reference grid and preferably the endoscope position in view. The X-ray image may be a 2×2D or 3D X-ray. In block 516, a relationship between the endoscope and the reference grid is established. In block 518, the reference grid is projected onto the endoscope image. In block 520, a window is selected in the reference grid that avoids ribs or other regions of difficulty and a resection is performed to access the target area.
Referring to
Referring to
In the case of cardiac bypass grafting, the target coronary artery can often be identified in the X-ray image by a narrowing of the vessel (See
The present principles may be employed for different applications including endoscopically-guided minimally invasive surgeries or procedures. These procedures and surgeries are not limiting, and the present principles may be employed in, e.g., cardiac surgery, minimally invasive coronary artery bypass grafting, atrial septal defect closure, valve repair/replacement, laparoscopic surgery, hysterectomy, prostatectomy, gall bladder surgery, natural orifice transluminal surgery (NOTES), pulmonary/bronchoscopic surgery, neurosurgical interventions, video assisted thoracic surgery, etc.
In interpreting the appended claims, it should be understood that:
Having described preferred embodiments for guided incision planning for endoscopic minimally invasive surgery (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the disclosure disclosed which are within the scope of the embodiments disclosed herein as outlined by the appended claims. Having thus described the details and particularity required by the patent laws, what is claimed and desired protected by Letters Patent is set forth in the appended claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2013/054854 | 6/13/2013 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
61660215 | Jun 2012 | US |