1. Field of Invention
The field of the currently claimed embodiments of this invention relates to optical coherence tomography, and more particularly to scanning speed variance correction in optical coherence tomography.
2. Discussion of Related Art
Optical coherence tomography (OCT) is a high resolution optical imaging modality widely used in biological and medical fields [1, 2]. For many clinical or intraoperative applications, a hand-held OCT system could be particularly useful; it would offer physicians greater freedom to access imaging sites of interest [3-10]. In a hand-held OCT system, it is desirable to have a robust and lightweight probe which can image detailed anatomical structures with a large field-of-view.
In conventional OCT systems, a mechanical scanner steers the OCT probe beam to perform lateral scans. Sequentially acquired A-scans are assembled according to a pre-defined raster [1] or circumferential [10] scanning patterns to form two dimensional (2D) or three dimensional (3D) images. Scanners used for OCT include galvanometer-mounted mirrors, piezoelectric transducers (PZT) and microelectromechanical systems (MEMS). Galvanometers have a high linearity and accuracy; however, they are usually bulky and heavy, especially in the case of 3D imaging which requires two galvanometers to perform 2D transverse scans. PZT scanners are smaller than galvanometers and therefore are more suitable for hand-held probes. However, they require a high driving voltage, which is a safety concern. MEMS scanners are smaller but relatively expensive, and they require relatively high voltage [11].
On the other hand, OCT scans can also be performed manually, similar to manually-scanned ultrasound imaging systems [12, 13]. A manually-scanned OCT probe without any mechanical scanner to steer the beam could be much simpler, cost-effective, and easy to use during intraoperative settings [14]. It has been shown that a simple 1D, hand-held OCT probe integrated with standard surgical instruments can be used for 2D OCT imaging and depth ranging during surgery [8, 15]. When surgeons manually scan the OCT probe integrated with a surgical tool across the target transversally, the time-varying A-scans can be acquired sequentially and can be used to form pseudo B-scan images. Due to the non-constant scanning velocity of the surgeon's hand, such a pseudo B-scan results in a non-uniform spatial sampling rate in lateral dimension. Such artifact varies widely between surgeons depending on the stability and dexterity of their hands.
Researchers in the ultrasound community have developed various methods in the last decade to correct the artifact induced by the non-constant scanning velocity in manual scanning, and ultrasound imaging systems have benefited from the use of manually scanned probes. In addition, methods including position tracking and speckle decorrelation have recently been adopted by the OCT community [9, 14, 16, 17]. The speckle decorrelation algorithm is particularly interesting and was demonstrated a few years ago by A. Ahmad et al. in OCT systems for the first time [14]. Compared to a video position tracking system, the speckle decorrelation technique may achieve better accuracy because the dimension of OCT speckle is in the order of micrometers [18]; which is sufficient for high-resolution OCT with a micrometer-resolution. Speckle decorrelation algorithm is attractive also because it does not require extra hardware components and is easy to implement.
According to an embodiment of the present invention, a lateral-distortion corrected optical coherence tomography system is disclosed. The system can include an optical coherence tomography sensor, a light source, a fiber-optic system arranged to provide a reference beam and an observation beam, an optical detection system arranged to receive combined light from the reference beam and the observation beam and to provide detection signals, and a data processing system arranged to communicate with the optical detection system and receive the detection signals. The data processing system can be configured to assemble an image corresponding to a scanning path by constructing a plurality of A-scans from the detection signals, determining displacement information from the plurality of A-scans, and arranging the plurality of A-scans according to the displacement information.
According to a further embodiment of the present invention, a method for lateral-distortion correction in optical coherence tomography is disclosed. The method can include receiving optical coherence tomography signals corresponding to a scanning path, constructing a plurality of A-scans from the optical coherence tomography signals, determining displacement information from the plurality of A-scans, arranging the plurality of A-scans according to the displacement information; and assembling an image corresponding to a scanning path.
Further objectives and advantages will become apparent from a consideration of the description, drawings, and examples.
Some embodiments of the current invention are discussed in detail below. In describing embodiments, specific terminology is employed for the sake of clarity. However, the invention is not intended to be limited to the specific terminology so selected. A person skilled in the relevant art will recognize that other equivalent components can be employed and other methods developed without departing from the broad concepts of the current invention. All references cited anywhere in this specification, including the Background and Detailed Description sections, are incorporated by reference as if each had been individually incorporated.
Lateral-distortion corrected optical coherence tomography system 100 includes an optical coherence tomography sensor 102. Optical coherence tomography sensor 102 can be a mechanical scanner, a handheld sensor or probe, or any other type of sensor as desired.
Lateral-distortion corrected optical coherence tomography system 100 includes a light source 104. The terms “light” or “optical” as used herein are intended to have a broad meaning that can include both visible and non-visible regions of the electromagnetic spectrum. For example, visible, near infrared, infrared and ultraviolet light are all considered as being within the broad definition of the term “light.” Light source 104 can provide any type of light as desired. In some embodiments, light source 104 can be, for example, a superluminescent (SLED) light source.
Lateral-distortion corrected optical coherence tomography system 100 includes a fiber optic system 106. Fiber optic system 106 can be optically coupled to light source 104 and said optical coherence tomography sensor 102, and can be arranged or otherwise configured to provide a reference beam and an observation beam.
Lateral-distortion corrected optical coherence tomography system 100 also includes optical detection system 108. Optical detection system 108 can be arranged or otherwise configured to receive combined light from the reference beam and observation beam of fiber optic system 106. Optical detection system 108 can also provide detection signals based on the combined light received from fiber optic system 106.
In some embodiments, the lateral-distortion corrected optical coherence tomography system 100 further includes a data processing system 110 configured to receive detection signals from optical detection system 108 and generate the any type of image, for example optical coherence tomography A-scans, images constructed from a plurality of optical coherence tomography A-scans, or any other type of image as desired. The data processing system 110 can be a workstation, for example. However, the broad concepts of the current invention are not limited to this example. Other data processing systems could be used according to the particular application. For example, the data processing system could be an application specific system, such as, but not limited to one or more ASICs and/or FPGAs. The data processing system could also be a personal computer, a laptop computer, a tablet computer, etc. It could also be a local or distributed computer, such as a computing system distributed over a local or wide area network, including the internet. The data processing system can also include one or more CPUs for running software and/or one or more graphics processing units (GPUs).
In some embodiments, the data processing system 110 can be further configured to perform correction of errors contained in the detection signals. For example, in some embodiments, data processing system 110 can collect a plurality of A-scans. The displacement between adjacent A-scans within this plurality of A-scans can be non-uniform due to variance in the scanning speed of optical coherence tomography sensor 102. Data processing system 110 can use, for example, a correlation between each adjacent A-scan to calculate a displacement estimate between each adjacent A-scan. Data processing system 110 can use this plurality of A-scans and the calculated displacement estimates to assemble an accurate image that does not contain, for example, artifacts, distortions, or other errors caused by variance in the scanning speed of optical coherence tomography sensor 102.
In some embodiments, Data processing system 110 can do this by arranging each A-scan into an image according to the displacement estimates. For example, each A-scan in the plurality of A-scans can be placed in a relative position in an image that is determined by the displacement estimates.
In further embodiments, Data processing system 110 can do produce an accurate image by first adding the displacement estimates together in order to determine a total displacement over the entire plurality of A-scans. Data processing 110 can then divide the total displacement into spatial positions that have a uniform displacement, and interpolate the A-scan data from the original plurality of A-scans at these spatial positions using the displacement estimates. In this way, data processing system 110 can construct a new plurality of A-scans in which the displacement between adjacent A-scans is uniform, and then use this new plurality of A-scans to assemble an image that is free from artifacts or other distortions due to scanning speed variance.
Further additional concepts and embodiments of the current invention will be described by way of the following examples. However, the broad concepts of the current invention are not limited to these particular examples.
In this example, we incorporated the theoretical speckle model into the decorrelation function to explicitly correlate the cross-correlation coefficient (XCC) to the lateral displacement between adjacent A-scans. We performed a series of experimental calibrations to validate our model and to show that lateral displacement between adjacent A-scans can be extracted quantitatively based on XCC. With the displacement extracted, we were able to correct the artifact induced by the non-constant scanning velocity. To test the method, we built and demonstrated a freehand-scanning OCT system capable of real-time scanning speed correction—for the first time to the best of our knowledge. Our system consists of a simple hand-held probe, a spectral-domain OCT engine, and software for image reconstruction and scanning speed correction. We integrated a single-mode fiber with a needle to serve as our probe. The spectral domain OCT engine uses a line scan CCD camera for spectral interferogram acquisition. We also developed our high speed software for real-time signal processing based on a general-purpose graphic processing unit (GPGPU). To demonstrate the system, using a simple 22 gauge needle integrated with a single-mode fiber probe, we obtained OCT images from various samples by freehand manual scanning, including images obtained from human in vivo.
One significant difference between this example and Ref [14] is that our method can directly calculate lateral displacement from the value of cross-correlation coefficient based on the speckle model we derived. Moreover, in this example, we have developed real-time scanning speed correction algorithm, because the scanning speed correction algorithm proposed in the manuscript could be easily parallelized and implemented using GPGPU
Theory
In this example, we use a Cartesian coordinate system (x, y, z) to describe the 3D space. z indicates the axial direction; x is the lateral direction or the direction of the manual scan. For simplicity, we assume the motion of the OCT needle probe is limited to x-z plane and the specimen is static.
Manually Scanned OCT Imaging
As shown in
v varies with time for a manual-scan OCT probe; fA is usually a constant for conventional data acquisition devices such as a frame grabber synchronized with an internal, periodical trigger signal. As a result, Δx varies with time in the same manner as v. Therefore, the lateral intervals between different A-scans are different for manual scan.
According to Nyquist theorem, the sampling rate, R, has to be larger than twice the highest spatial frequency of the specimen (Fn): R=1/Δx=fA/v>2Fn. Therefore, the scanning speed has to be smaller than vm shown in Eq (2).
Eq (2) also implies that a scanning velocity smaller than vm would lead to oversampling and information redundancy. Under the oversampling condition, there is correlation between adjacent A-scans. The degree of correlation can be measured by Pearson cross-correlation coefficient (XCC) shown as Eq (3).
In Eq (3), < > indicates to take the mean value of a signal. Here Ix,y(z) is the intensity of an A-scan at (x,y). Ix,y(z) is calculated by taking the square of the amplitude of the A-scan. Denote the complex valued OCT signal as Sx,y (z); then Ix,y(z)=Sx,y(z)S*x,y(z). Similarly, Ix+Δx,y+Δy(z+Δz) is the intensity of A-scan that is displaced by (Δx, Δy, Δz). σIx,y(z) and σIx+Δx,y+Δy(z+Δz) are the square roots of variance for Ix,y(z) and Ix+Δx,y+Δy(z+Δz).
As we assume the scanning is in x direction, Δy=Δz=0, Ix+Δx,y+Δy(z+Δz) becomes Ix+Δx,y(z) and Eq (3) becomes:
For simplicity, we use ρ to denote PIx,y(z),Ix+Δx,y(z) in subsequent equations.
If we assume the specimen has a homogeneous distribution of scatterers with a uniform scattering strength[19], e.g., the speckle is fully developed, the following relationship exist: <Ix,y(z)>=<Ix+Δx,y(z)>=I0; <Ix,y(z)2>=<Ix+Δx,y(z)2>=IRMS2. Therefore, we have:
σI
σI
[Ix,y(z)−Ix,y(z)][Ix+Δx,y(z)]=Ix,y(z)Ix+Δx,y(z)−I02
Based on the above relationships, we can simplify Eq. (3) to:
Similar to ultrasound images with fully developed speckle, with the moment theorem for the jointly zero mean, Gaussian random variables, and assuming that the real and imaginary parts of S are uncorrelated, we have,
I
x,y(z)Ix+Δx,y(z)=|Sx,y(z)Sx+Δx,y*(z)|2+I02 (4)
It is worth mentioning that to derive Eq (4), we only utilized statistical properties of the random variable involved. On the other hand, such statistical property is not related to the physical mechanisms of OCT image formation; and therefore the Eq (4) is applicable to OCT signal.
In the Eq. (4), |•|2 is the square of the amplitude of a complex value. Signal Sx,y(z) is determined by the physics of OCT image formation mechanism and can be expressed as the convolution of scattering distribution function a(x,y,z) with system's 3D point spread function (PSF) P(x,y,z)
Similarly, OCT signal Sx+Δx,y(z) can be expressed as
It is worth mentioning that J indicates integration over (−∞+∞) in the expressions of Sx,y(z), Sx+Δx,y(z) and in the following derivations.
Plugging the expression of Sx,y(z) and Sx+Δx,y(z) into Eq (4) and utilizing the fact that OCT system's PSF is not random, we have:
Assuming that the speckle is fully developed and thus scatterers in different spatial location are described by identical but independent random variables, we have the following relationship:
a(x−x′,y−y′,z−z′)a(x+Δx−x″,y−y″,z−z″)=a02δ(x′+Δx−x″)δ(y′−y″)δ(z′−z″)
In the above equation, a0 is a constant representing the scattering strength. Using the sifting property of delta function, we have
In OCT, the axial PSF P(z) and the lateral PSF P(x,y) are separable because axial and lateral PSFs are governed by different physical principles: axial PSF is determined by the temporal coherence of the light source while lateral PSF is determined by the imaging optics in the sample arm. Furthermore, in Gaussian optics model, P(x,y) is the product of PSFs in x and y dimensions. As a result, P(x,y,z) can be written explicitly as P(x,y,z)=Px(x) Py(y) PZ(z) and therefore we have:
Lateral PSF Px(x) can be expressed as:
In Eq (6), w0 is the Gaussian beam waist of probing beam. It is worth mentioning that Gaussian beam waist in this definition is the distance from the beam axis where the intensity of OCT signal drops to 1/e.
Plugging Eq. (5) into Eq (4), we have:
Using the expression of Px(x) shown as Eq. (6), ρ can be re-written as:
We are able to calculate the integration of Gaussian function over (−∞,+∞):
Therefore,
Eq (7) shows that the value of ρ is merely determined by Δx for fully developed speckle; therefore, we can calculate the cross-correlation coefficient ρ between adjacent A-scans and use the value of ρ to derive the time-varying Δx as:
For digitized sample points in A-scans, ρ can be calculated with Eq (9).
In Eq (9), i is the index of pixel in an A-scan and j is the index of A-scan. Segmentation of signal between if and il is selected to calculate ρ. Although Eq (3) and Eq (9) implies that XCC can be either positive or negative, it is unlikely that XCC of two adjacent A-scans has very small or negative value when lateral dimension is highly over-sampled. As demonstrated previously, speckle pattern is formed by convolving random scattering field with OCT system's PSF. Due to the finite dimension of PSF, adjacent A-scans are correlated as long as lateral displacement is small compared to the lateral width of PSF, no matter how sample field is like. However, it is true that XCC can become very small or negative. To deal with this problem, in our software implementation, we took the absolute value of XCC for displacement estimation so that the term inside of logarithm operator is never negative. In addition, we applied thresholding to the value of XCC because small XCC indicates decorrelation between A-scans and thus is not reliable for the displacement assessment. It is also worth mentioning that when XCC turns negative, it does not represent the change of scanning direction.
Scanning Speed Correction Based on Speckle Decorrelation
Eq. (8) indicates that lateral interval between A-scans can be extracted from the XCC and therefore we could use XCC to correct artifact induced by non-constant scanning speed. The flow chart of the scanning speed correction for one frame of data is shown in
OCT System and Software Implementation
The basic properties of the OCT system used for our calibration experiments have been reported in our previous work [23]. Briefly, it was a spectral domain OCT system based on GPGPU processing with a 70 kHz A-scan rate. In that set-up, an achromatic doublet lens at the sample arm was used to focus the incident light beam and collect back-scattered photons. We used the focal length of imaging objective, focal length of the collimator, and mode field diameter of the fiber to calculate w0. From our calculation, w0 equaled 6 βm and this indicated a 12 μm 1/e lateral resolution of our OCT. This was further verified by using our OCT system to image 1951 USAF resolution target. The obtained en face OCT image clearly showed that our OCT system can resolve the 5th element in group 6 which corresponds to a 10 μm FWHM lateral resolution and therefore 12 μm 1/e lateral resolution. Therefore, we assumed w0 to be 6 μm for this system when using Eq. (7) to correlate ρ and Δx. With the 12 μm lateral resolution, Fn=(1/12)(μm−1); therefore the largest scanning speed that satisfies the requirement of Nyquist sampling is about 420 mm/s, as implied by Eq. (2). For our calibration experiments, a high-speed galvanometer was used to perform lateral scanning.
Our freehand-scanning OCT was a modified version of this system. As shown in
The signal processing procedure of our system is briefly summarized in
To obtain an accurate value of w0 in our software for our single mode fiber probe, we have first used an estimation of w0 based on the experimentally measured lateral resolution of our CP OCT system from our previous work [25, 28] and indicate this value as w. Afterwards, we manually scanned a highly scattering phantom for 1 cm (L=1 cm) and acquired a certain number of A-scans that were uniformly distributed. We performed such scanning for 10 times and calculated the average A-scan number in all the measurements which is indicated by M. According to Eq. (8), we were able to obtain a better estimation of w0 that equals (wL)/(MΔxs). We varied the value of Δxs and obtained a consistent value of w0. All images in section 5.2 were acquired based on w0=18.5 μm which was constant for different values of Δxs.
Calibration of the Relationship Between Cross-Correlation Coefficient and Lateral Displacement In our calibration experiments, we scanned a phantom consisting of 9 layers of cellophane tape to verify the relationship between displacement Δx and ρ (XCC), shown as Eq. (7) and (8). We used a galvanometer to perform lateral scans with known scanning speeds. We applied a periodical sawtooth voltage V from a function generator to the galvanometer and synchronized V with the acquisition of a frame of data which contained N A-scans (N=1000). For a 100% duty cycle sawtooth driving voltage, Δx, lateral interval between adjacent A-scans stays constant because the driving voltage increases linearly during signal acquisition. Therefore, we could calculate the displacement between adjacent A-scans directly from the amplitude of the sawtooth function: Δx=γV/N. Here γ is a coefficient that relates the driving voltage (V) applied to galvanometer and the probing beam displacement (D) at the focal plane of the imaging lens: γ=D/V. γ was measured to be 1.925 mm/V in the OCT setup for our calibration experiments. As a result, by applying different V, we could achieve different scanning speeds and thus different Δx. We acquired B-scans at various scanning speeds. One example of the image obtained is shown 5(a) which contain 1000 A-scans, with a sampling interval Δx equal to 0.96 m.
For B-scan acquired at a certain spatial sampling interval determined by the driving voltage, we calculated ρi, XCC between the ith and (i+1)th A-scan, using pixels within the range as indicated by the double-head arrow in
Using the above processing, we obtained a value of ρ from each B-scan corresponding to a certain Δx. The result is shown as circles in
XCC, as the correlation of two random variables, is inherently a random variable. It is very important to evaluate the statistics of XCC to assess the accuracy in displacement estimation. To evaluate the statistics of XCC, we calculated the standard deviation and the mean of ρi from B-scans acquired experimentally at different spatial sampling intervals (δxi). The results are shown in
As shown in
Results in
Results
Quantitative Lateral Sampling Interval Extraction
We used the same OCT setup for this experiment as in the calibration experiments. To demonstrate that we can use XCC for the quantitative displacement extraction and thus quantitatively correct artifacts from non-uniform scanning speed, we applied a sinusoidal driving voltage (f=28 Hz, Vpp=1.5V) to the galvanometer and scanned the multilayered tape phantom. Knowing voltage applied to galvanometer and the value of γ from our previous measurement, we were able to calculate the displacement of the probe beam with regards to its neutral position when the voltage applied to the galvanometer was 0. The calculated displacement of the probe beam at different time is shown in the upper inset of
To validate the scanning speed correction algorithm, we took A-scans between 8 ms and 13 ms when the scanning velocity did not change its direction; thus, we didn't have to consider the ambiguity of scanning direction. Simply stacking A-scans acquired, we obtained
To demonstrate the effectiveness of our method more clearly, we manually scanned a phantom consisting of multiple layers of tape and saved all the A-scans obtained. Stacking all the A-scans, we obtained
Images Obtained from Manually Scanned OCT Probe with Real-Time Correction
Using our scanning speed corrected, hand-held OCT system, we manually scanned our single mode fiber probe across the surface of an infrared (IR) viewing card by moving the probe with a freehand. In our real-time scanning speed correction software, we set the spatial sampling interval Δx, to be 1 μm, 2 μm, and 4 μm and show the corresponding images obtained in
To further evaluate the accuracy of our scanning speed correction method, we imaged a quality resolution chart with 1 line per mm from Edmund Optics through manual scan, as shown in
We have also manually scanned the skin of a healthy volunteer using our hand-held OCT probe with 2 μm digital sampling interval. To perform manual scan, one of the author held the probe almost perpendicular to the sample surface and moved the probe laterally. Images obtained from the index finger tip and the palm are shown in
To further demonstrate the effectiveness of our method on heterogeneous samples, we performed manual scan on an onion sample and show the obtained image as
Discussion
Eq. (7) forms the mathematical foundation of this work. In deriving Eq. (7), it assumes that the speckle is fully developed. Therefore, to validate Eq. (7) experimentally, we used several different models to test our method. We used a multi-layered phantom without much heterogeneity in lateral dimension for our calibration experiments. However, most OCT images using real specimens have partially developed speckle instead of fully developed speckle. If the sample is heterogeneous, the correlation coefficient between adjacent A-scans not only depends on the lateral interval, but also depends on sample structure. Moreover, when the probe scans across a boundary within the sample, due to the abrupt change in OCT signal, a new A-scan will be attached to the data set regardless of the lateral displacement between the current and previous A-scans. As a result, heterogeneous sample can cause inaccuracy in lateral motion correction of our method. However, for highly scattering samples such as skin, it is usually reasonable to assume that areas corresponding to sample boundary take only a few pixels and therefore do not contribute significantly in the calculation of XCC. As a result, Eq. (7) is valid for highly scattering specimens when a significant portion of the specimen contains homogeneous scatterers, although speckle does not develop fully in most biological specimens. This was verified in the experiment using a quality resolution chart with abrupt changes in lateral features as a sample. We further tested and verified the method using in-situ tissue imaging.
As indicated by Eq. (7), to quantitatively estimate Δx from XCC, it requires that we know w0, the Gaussian beam waist of probing beam which can be calculated or experimentally measured. As a result, the calibrating decorrelation curve shown in
In this work, our assumption is that the manual scan is one dimensional in x axis and that there is no axial motion from the scanning probe, which is not exactly true in a realistic scenario. For example, human hands suffer from physiological tremor and this makes the probe to move randomly in both lateral and axial directions. However, experimental results have shown that the tremor during retinal microsurgery has low frequency motion (<1 Hz) with amplitude in the order of 100 μm [26]. As a result, with high data acquisition rate, adjacent A-scans usually do not have offset in axial direction for more than a few pixels. Moreover, a cross-correlation maximization-based shift correction algorithm was recently proposed to suppress artifact due to axial motion [27], which might be helpful to improve the performance of our image acquisition algorithm in the future. In our future study, we are going to conduct a more comprehensive theoretical and experimental study on motion tracking using OCT speckle texture analysis, by considering different types of motion including axial translation, lateral translation and rotation.
The embodiments illustrated and discussed in this specification are intended only to teach those skilled in the art how to make and use the invention. In describing embodiments of the invention, specific terminology is employed for the sake of clarity. However, the invention is not intended to be limited to the specific terminology so selected. The above-described embodiments of the invention may be modified or varied, without departing from the invention, as appreciated by those skilled in the art in light of the above teachings. It is therefore to be understood that, within the scope of the claims and their equivalents, the invention may be practiced otherwise than as specifically described.
This application claims the benefit of U.S. Provisional Application No. 61/583,020, titled “Distortion-free, free-hand OCT imaging,” which was filed Jan. 4, 2012.
This invention was made with Government support of Grants Number NIH, 1R01 EB 007969-01; NIH, NINDS 1R21NS063131-01A1; and NIH/NIE R01 1R01EY021540-01A1, awarded by the Department of Health and Human Services, National Institutes of Health (NIH). The U.S. Government has certain rights in this invention.
Number | Date | Country | |
---|---|---|---|
61583020 | Jan 2012 | US |