1. Field of Invention
The field of the currently claimed embodiments of this invention relates to optical coherence tomography imaging and guidance systems.
2. Discussion of Related Art
Microsurgery requires both physical and optical access to limited space in order to perform tasks on delicate tissue. The ability to view critical parts of the surgical region and work within micron proximity to the fragile tissue surface requires excellent visibility and precise instrument manipulation. The surgeon needs to function within the limits of human sensory and motion capability to visualize targets, steadily guide microsurgical tools and execute all surgical targets. These directed surgical maneuvers must occur intraoperatively with minimization of surgical risk and expeditious resolution of complications. Conventionally, visualization during the operation is realized by surgical microscopes, which limits the surgeon's field of view (FOV) to the en face scope [1], with limited depth perception of micro-structures and tissue planes.
As a noninvasive imaging modality, optical coherence tomography (OCT) is capable of cross-sectional micrometer-resolution images and a complete 3D data set could be obtained by 2D scanning of the targeted region. Compared to other modalities used in image-guided surgical intervention such as MRI, CT, and ultrasound, OCT is highly suitable for applications in microsurgical guidance [1-3]. For clinical intraoperative purposes, a FD-OCT system should be capable of ultrahigh speed raw data acquisition as well as matching-speed data processing and visualization. In recent years, the A-scan acquisition rate of FD-OCT systems has generally reached multi-hundred-of-thousand line/second level [4,5] and approaches multi-million line/second level [6,7]. The recent developments of graphics processing unit (GPU) accelerated FD-OCT processing and visualization have enabled real-time 4D (3D+time) imaging at the speed up to 10 volume/second [8-10]. However, these systems all work in the standard mode, and therefore suffer from spatially reversed complex-conjugate ghost images. During intraoperative imaging, for example, when long-shaft surgical tools are used, such ghost images could severely misguide the surgeons. As a solution, GPU-accelerated full-range FD-OCT has been utilized and real-time B-scan images was demonstrated with effective complex-conjugate suppression and doubled imaging range [11,12]. Therefore, there remains a need for improved optical coherence tomography imaging and guidance systems.
A four-dimensional optical coherence tomography imagining and guidance system according to an embodiment of the current invention includes an optical coherence tomography system, a data processing system adapted to communicate with the optical coherence tomography system, and a display system adapted to communicate with the data processing system. The optical coherence tomography system is configured to provide data corresponding to a plurality of volume frames per second. The data processing system is configured to receive and process the data and provide three-dimensional image data to the display system such that the display system displays a rendered real-time three-dimensional image.
Further objectives and advantages will become apparent from a consideration of the description, drawings, and examples.
Some embodiments of the current invention are discussed in detail below. In describing embodiments, specific terminology is employed for the sake of clarity. However, the invention is not intended to be limited to the specific terminology so selected. A person skilled in the relevant art will recognize that other equivalent components can be employed and other methods developed without departing from the broad concepts of the current invention. All references cited anywhere in this specification, including the Background and Detailed Description sections, are incorporated by reference as if each had been individually incorporated.
The term “light” as used herein is intended to have a broad meaning that can include both visible and non-visible regions of the electromagnetic spectrum. For example, visible, near infrared, infrared and ultraviolet light are all considered as being within the broad definition of the term “light.” The term “real-time” is intended to mean that the OCT images can be provided to the user during use of the OCT system. In other words, any noticeable time delay between detection and image displaying to a user is sufficiently short for the particular application at hand. In some cases, the time delay can be so short as to be unnoticeable by a user.
In some embodiments, the data processing system 104 can include at least one parallel processing unit. In an embodiment of the current invention, the data processing system 104 includes a first parallel processing unit 108 configured to receive and process the data from the optical coherence tomography system 102 to provide pre-processed data, and the data processing system 102 further includes a second parallel processing unit 110 configured to receive and process the pre-processed data to provide the three-dimensional image data to the display system 106. In some embodiments, the first parallel processing unit 108 can be a first graphics processing unit (GPU-1) and the second parallel processing unit 110 can be a second graphics processing unit (GPU-2). (See, also
In some embodiments, the optical coherence tomography system 102 can be a Fourier domain optical coherence tomography system. The optical coherence tomography system 102 can be a fiber-optic optical coherence tomography system, for example. In some embodiments, the optical coherence tomography system can include an optical fiber probe for microsurgery.
In some embodiments, the display system can be at least one of a monitor, a head-mounted display or a viewing port. In some embodiments, the monitor, head-mounted display or viewing port can provide real time microsurgical guidance, for example.
In some embodiments, the second graphics processing unit can be further configured to perform at least one of segmentation, information overlay, or image overlay of the rendered real-time three-dimensional image.
In further embodiments, the optical coherence tomography system can be a functional optical coherence tomography system to perform at least one of spectroscopic, speckle, Doppler or optical coherence tomography, or any combination thereof.
Further additional concepts and embodiments of the current invention will be described by way of the following examples. However, the broad concepts of the current invention are not limited to these particular examples.
In this example, we implemented the real-time 4D full-range complex-conjugate-free FD-OCT based on the dual-GPUs architecture, where one GPU is dedicated to the FD-OCT data processing while the second one is used for the volume rendering and display. GPU based non-uniform fast Fourier transform (NUFFT) [12] is also implemented to suppress the side lobes of the point spread function and to improve the image quality. (See also, International Application No. PCT/US2011/066603, filed Dec. 21, 2011, assigned to the same assignee as the current application, the entire content of which is incorporated herein by reference for all purposes.) With a 128,000 A-scan/second OCT engine, we obtained 5 volumes/second 3D imaging and display. We have demonstrated the real-time visualization capability of the system by performing a micro-manipulation process using a vitro-retinal surgical tool and a phantom model. Multiple volume renderings of the same 3D data set were performed and displayed with different view angles. This embodiment of the current invention can provide the surgeon with comprehensive intraoperative imaging of the microsurgical region which could improve accuracy and safety of microsurgical procedures.
The system configuration for the following examples is shown in
A quad-core Dell T7500 workstation was used to host the frame grabber (PCIE-x4 interface), DAQ card (PCI interface), GPU-1 and GPU-2 (both PCIE-x16 interface), all on the same mother board. GPU-1 (NVIDIA GeForce GTX 580) with 512 stream processors, 1.59 GHz processor clock and 1.5 GBytes graphics memory is dedicated for raw data processing of B-scan frames. GPU-2 (NVIDIA GeForce GTS 450) with 192 stream processors, 1.76 GHz processor clock and 1.0 GBytes graphics memory is dedicated for the volume rendering and display of the complete C-scan data processed by GPU-1. The GPU is programmed through NVIDIA's Compute Unified Device Architecture (CUDA) technology [14]. The software is developed under the Microsoft Visual C++ environment with National Instrument's IMAQ Win32 APIs.
The signal processing flow chart of the dual-GPUs architecture according to this embodiment of the current invention is illustrated in
Compared to previously reported systems, this dual-GPU architecture separates the computing task of the signal processing and the visualization into different GPUs, which can provide the following advantages:
In our experiment, the B-scan size is set to 256 A-scans with 1024 pixel each. Using the GPU based NUFFT algorithm, GPU-1 achieved a peak A-scan processing rate of 252,000 lines/s and an effective rate of 186,000 lines/s when the host-device data transferring bandwidth of PCIE-x16 interface was considered, which is higher than the camera's acquisition line rate. The NUFFT method was effective in suppressing the side lobes of the PSF and in improving the image quality, especially when surgical tools with metallic surface are used. The C-scan size is set to 100 B-scans, resulting in 256×100×1024 voxels (effectively 250×98×1024 voxels after removing of edge pixels due to fly-back time of galvanometers), and 5 volumes/second. It takes GPU-2 about 8 ms to render one 2D image with 512×512 pixel from this 3D data set using the ray-casting algorithm [8].
First, we tested the optical performance of the system using a mirror as the target. At one side of the zero-delay, PSFs at different positions are processed as A-scans using linear interpolation with FFT and NUFFT, shown in
Next, in vivo human finger imaging was conducted to test the imaging capability of biological tissue. The scanning range is 3.5 mm (X)×3.5 mm (Y) lateral and 3 mm (Z) for the axial full-range. The finger nail fold region is imaged as
Finally, we performed a real-time 4D full-range FD-OCT guided micro-manipulation using a phantom model and a vitreoretinal surgical forceps, with the same scanning protocol as
In this example, a real-time 4D full-range FD-OCT system is implemented based on the dual-GPUs architecture according to an embodiment of the current invention. The computing task of signal processing and visualization into different GPUs and real-time 4D imaging and display of 5 volume/second has been obtained. A real-time 4D full-range FD-OCT guided micro-manipulation was performed using a phantom model and a vitreoretinal surgical forceps. This embodiment can provide surgeons with a comprehensive spatial view of the microsurgical site and can be used to guide microsurgical tools effectively during microsurgical procedures.
The embodiments illustrated and discussed in this specification are intended only to teach those skilled in the art how to make and use the invention. In describing embodiments of the invention, specific terminology is employed for the sake of clarity. However, the invention is not intended to be limited to the specific terminology so selected. The above-described embodiments of the invention may be modified or varied, without departing from the invention, as appreciated by those skilled in the art in light of the above teachings. It is therefore to be understood that, within the scope of the claims and their equivalents, the invention may be practiced otherwise than as specifically described.
This application claims priority to U.S. Provisional Application No. 61/482,294 filed May 4, 2011, the entire content of which is hereby incorporated by reference.
This invention was made with Government support of Grant No. R21 1R21NS063131-01A1, awarded by the Department of Health and Human Services, The National Institutes of Health (NIH). The U.S. Government has certain rights in this invention.
Number | Date | Country | |
---|---|---|---|
61482294 | May 2011 | US |