The present disclosure relates in general to fluorescence imaging apparatus, methods and systems, and more particularly, to the combination of fluorescence spectroscopy and optical coherence tomography in a single catheter, providing the capability to simultaneously obtain co-localized anatomical and molecular information.
Optical coherence tomography (OCT) provides high-resolution, cross-sectional imaging of tissue microstructure in situ and in real-time, while fluorescence imaging enables visualization of molecular processes. The integration of OCT with fluorescence imaging in a single catheter provides the capability to simultaneously obtain co-localized anatomical and molecular information from the subject tissue, such as an artery wall. For example, in “Ex. Vivo catheter-based imaging of coronary atherosclerosis using multimodality OCT and NIRAF excited at 633 nm” (Biomed Opt Express 2015, 6(4): 1363-1375), Wang discloses an OCT-fluorescence imaging system using He:Ne excitation light for fluorescence and swept laser for OCT simultaneously through the optical fiber probe. Another reference is titled “Dual modality intravascular optical coherence tomography (OCT) and near-infrared fluorescence (NIRF) imaging: a fully automated algorithm for the distance-calibration of NIRF signal intensity for quantitative molecular imaging”, by Ughi G J, Verjans J, Fard A M, et al., published in the Int. J. Cardiovasc. Imaging. 2015;31(2):259-268.
As can be seen, the catheter is connected to the rotary junction, which rotates the optics within the sheath. The rotary junction is translated by a pullback tray to effectuate a helical scan. Accordingly, excitation light (He:Ne) for fluorescence and swept laser for OCT are simultaneously delivered through the optical fiber probe equipped with an angle polished ball lens for side-viewing and irradiated to the tissue sample. Fluorescence light emitted from the tissue is collected through the cladding of the double clad fiber and directed to a photomultiplier (PMT), and recorded in the computer via data acquisition board (DAQ). The scattered light of the swept light is collected through the core of the double clad fiber and delivered to the dual-balanced detector and recorded in the computer through the DAQ. The rotary junction and the pullback tray, which respectively rotates and moves the optical fiber inside the catheter sheath, enables the helical scan of the arterial wall. This system allows the simultaneous recording of fluorescence signal and OCT data.
The fluorescence intensity depends on the distance between the probe and the tissue. Therefore, the fluorescence light intensity detected by an optical fiber is calibrated using the distance between the optical fiber and the tissue. The distance can be estimated with OCT data. Therefore, in a common, existing OCT-Fluorescence spectroscopy system, the fluorescence intensity can be calibrated by using the distance measured by OCT, in order to decipher the exact intensity.
A calibration function for fluorescence data is then obtained as g(x)=1/f(x). The calibration of the fluorescence signal is achieved by multiplying the calibration factor that is obtained by plugging in the distance value that corresponds to each element of the fluorescence dataset.
More prevalent use of existing OCT's has revealed some difficult situations in vessel wall segmentation, such as eccentric luminal shapes seen in a diseased artery, or remaining blood in the lumen due to insufficient clearing of the blood from the artery by flushing. If the lumen segmentation is inaccurate, this leads to over- or under-correction of fluorescence intensity. In addition, automatic segmentation and the calculation of distance correction for the entire pullback image requires vast computation, which may take a much longer time to process in order to display the distance-corrected image after pullback.
As such, minimizing the amount of data to be segmented, while retaining or improving upon the accuracy and accuracy for distance correction has become a very germane topic, and the desire for faster processing time, as well as reduced risk of inaccurate fluorescence images is now highly sought after in the field.
Accordingly, and in view of the above-referenced issues, the present innovation provides apparatus, methods and systems for performing a distance correction calculation in limited regions of the pullback where the fluorescence signal is above the detection threshold or limit of detection (LOD) value, thus significantly reducing error rates and accelerating data processing times.
The present patent application aims to teach apparatus, methods, and systems for providing accurate imaging in an OCT-Fluorescence spectroscopy system, along with decreasing lengthy processing times for the imaging.
In one embodiment, the subject disclosure teaches a method for correcting raw data collected from an OCT-fluorescence device, wherein the method comprises, collecting raw data from an OCT-fluorescence device; determining a threshold value for the raw data collected based on the fluorescence raw data; identifying raw data that is outside the threshold value; setting raw data that is outside the threshold value at zero; and applying a first algorithm to the raw data within the threshold value to produce a corrected data.
The method may further comprise the threshold value being calculated from a system background signal.
In another embodiment, the raw data collected from the OCT-fluorescence device is pre-processed to remove outlier values.
In other embodiment, the method consists of raw data collected from the OCT-fluorescence device is a single data element, or a cluster of data elements.
In further embodiments, of the raw data collected from the OCT-fluorescence device, data identified as outside the threshold value is greater than the threshold value.
In yet additional embodiments, of the raw data collected from the OCT-fluorescence device, data identified as outside the threshold value is less than the threshold value.
In additional embodiment, a second algorithm may be applied to the raw data collected from the OCT-fluorescence device, which is outside the threshold value.
In various embodiments, the first algorithm is a distance correction algorithm; furthermore, the distance correction algorithm comprises object surface segmentation in the raw data collected from the OCT-fluorescence device.
In yet additional contemplated embodiments, the distance correction algorithm further comprises calculating distance value between an object surface and an optical probe that corresponds to a fluorescence data position.
In further embodiments, the distance correction algorithm further comprises calculating the correction factors by plugging in at least two distance values to a correction function and multiplying the correction factor to the raw data collected from the OCT-fluorescence device.
In yet additional embodiments, the distance correction is selected from the group consisting of: OCT segmentation; distance calculation; distance correction of fluorescence; and combinations thereof.
In yet additional embodiments, the raw data collected from the OCT-fluorescence device, includes a near-infrared light, and/or optical coherence tomography data and/or structural data.
In further embodiment, the structural data is delivered by a core of a double clad fiber and the fluorescence data is delivered by a cladding of the double clad fiber.
In further embodiments, the subject disclosure teaches a method for correcting raw data collected from an OCT-fluorescence device, comprising: collecting raw data from an OCT-fluorescence device; calculating a distance from OCT-fluorescence device to a subject; determining a threshold value for the raw data collected based on the distance calculated; identifying raw data that is outside the threshold value; setting the raw data that is outside the threshold value at zero; and applying a first algorithm to the raw data within the threshold value to produce a corrected data.
Further objects, features and advantages of the present disclosure will become apparent from the following detailed description when taken in conjunction with the accompanying figures showing illustrative embodiments of the present invention.
Throughout the Figures, the same reference numerals and characters, unless otherwise stated, are used to denote like features, elements, components or portions of the illustrated embodiments. In addition, reference numeral(s) including by the designation “'” (e.g. 12′ or 24′) signify secondary elements and/or references of the same nature and/or kind. Moreover, while the subject disclosure will now be described in detail with reference to the Figures, it is done so in connection with the illustrative embodiments. It is intended that changes and modifications can be made to the described embodiments without departing from the true scope and spirit of the subject disclosure as defined by the appended paragraphs.
As the optical fiber-based system has a fluorescence background signal (optical fiber autofluorescence or Raman) there is a detection threshold for distinguishing the background signal and the signal from the sample. Hence, any sample signal that is below the limit of detection (herein referred to as “LOD”) can be disregarded when contrasting a fluorescence image. LOD can be determined as a metric of the background signal average and the signal fluctuation value such as standard deviation of the background signal. For example, the following equation can be used.
LOD=
where
The optical fiber in the catheter 32 rotates inside the catheter sheath 40 and the OCT light 12 and excitation light 34 are emitted from the side angle of the tip of the catheter 32. The OCT light 12 is delivered back to the OCT interferometer circulator 42 and combined with reference beam 20 to generate interference patterns. The output of the interferometer 42 is detected with a first detector 44, wherein the first detector 44 may be photodiodes or multi-array cameras, then recorded to a computer46 through a first data-acquisition board 48 (“DAQ1”).
Simultaneously, the fluorescence intensity is recorded through a second detector 52 (e.g. photomultiplier) through a second data-acquisition board 50 (“DAQ2”). The OCT signal and fluorescence signal are then processed by the computer 46 to generate an OCT-fluorescence dataset 54, which consists of multiple frames 56 of helically scanned data. Each set of frames 56 consist of multiple data elements of co-registered OCT and fluorescence data, which correspond to the rotational angle and pullback position.
LOD can be specified according to the system specification, determined by the user, or determined with the system calibration data, such as background signal measurements. Based on the result of the comparison of maximum fluorescence value and the LOD, different algorithms can be applied to that data section 58.
In one embodiment, if the maximum fluorescence value is greater than LOD, a distance correction algorithm can be performed. Distance correction can include: OCT segmentation 68; distance calculation and calculating distance correction factor 70; and calculating distance-corrected fluorescence data 72. The distance-corrected fluorescence data 72 is stored as a new fluorescence value 78. If the maximum fluorescence value is lower than LOD, fluorescence value in the section can be set as null, and stored as new fluorescence value 78. In this case, no OCT segmentation 68 and distance correction calculation 7o is performed. The algorithm then selects the next data section 58′ and repeats the same steps until all data sections 58 of the OCT-fluorescence dataset 54 have been analyzed.
In another embodiment, the method to equalize the noise with distance correction is described. The NIRAF signal is normalized by the correction function to obtain distance independent value:
K(i, j)=F(d(i, j))
P
Normal(i,j)=Praw(i, j)×K(i, j)
Where K is the correction factor, d is the distance from the probe to the target. F(d) is the correction function obtained from the experiment. Praw(i,j) and PNormal(i,j) are the pixel values before and after distance correction.
In one embodiment, a predetermined correction factor table for variable distance can be used instead of predetermined correction function. With the calculated distance d(i, j), the correction factor that is closest to d(i, j) is looked up from the correction factor table. By multiplying the selected correction factor to the fluorescence signal, distance corrected fluorescence value is obtained.
The fluorescence data elements 6o from the frames that do not contain the fluorescence data element higher than the system detection threshold 80 are set as null. New values are stored as distance corrected fluorescence data 72. Based on distance corrected fluorescence data 72, the fluorescence images may be rendered.
In another embodiment, depicted in
In
In another embodiment, the normalized OCT-fluorescence dataset 92 can be further modified by applying the gradation processing (e.g. gamma adjustment) to enhance the contrast of the fluorescence images. A non-linear gamma curve can be applied to the normalized data.
Rendered fluorescence image can be shown on the display attached to the computer. Different way of fluorescence data presentation can be used based on the user input. For example, distance corrected images can be shown first then a user can choose the internally normalized fluorescence images. In another embodiment, the user can also toggle with both raw image and corrected images. In another embodiment, different fluorescence images can be shown by overlaying multiple images based on user input.
During the distance correction process, while the signal amplitude is normalized to the distance, the noise in the NIRAF signal is also scaled accordingly. The correction process results in a NIRAF image with non-uniform noise distribution which makes the image quality in some area appear noisier than the other area and the signal to noise ratio of the image become non-uniform.
To correct the non-stationary noise issue produced by the distance correction process, a non-uniform image filtering approach is applied during the correction process.
It is reasonable and common practice to assume the NIRAF signal sensor produces the NIRAF signal with a stationary noise. Assume the stationary noise from the NIRAF signal sensor is N(0, σ2), which means that the standard deviation for each pixel Praw(i, j) is:
σ=√{square root over (Var(Praw(i,j)))}=√{square root over (E2(Praw(i,j)))}
After applying a distance correction, the corrected pixel PNormal(i, j) has a standard deviation of:
σ(PNormal(i, j))=√{square root over (E2(Praw(i, j)×K(i,j)))}=K(i, j) √{square root over (E2 (Praw(i, j)))}
To compensate for the factor of the standard deviation change, we apply a simple average filter mask centered at (i, j), with the mask size of K2(i, j), assuming the neighboring pixels all have the same distance correction factor. The resulted pixel has the standard deviation of:
By applying the variable sized mask to the pixel value during the distance correction operation, the resulted NIRAF image maintains the uniform signal to noise ratio. In implementation, K can be selected based on the normalized farthest range of effective NIRAF range such that the correction factor K is always greater than 1.
This application claims priority from U.S. Provisional Patent Application No. 62/925655 filed on Oct. 24, 2019 in the United States Patent and Trademark Office, the disclosure of which is incorporated herein, in its entirety, by reference.
Number | Date | Country | |
---|---|---|---|
62925655 | Oct 2019 | US |