Patent Application
20220022759
The present invention relates generally to a method of detecting a flow, such as a flow of blood within a blood vessel, in a sequence of images, which may be images of biological tissue. The present invention relates for example, though is not limited to, a method of processing an optical coherence tomography (OCT) image of tissue in order to improve the contrast of blood vessels.
As an extension of optical coherence tomography (OCT), optical coherence tomography angiography (OCTA) provides a non-invasive technique for imaging tissue vasculature, such as small blood vessels, including arterioles, capillaries and venules. While the image contrast in OCT is determined by the level of backscattering in the tissue, OCTA allows imaging the microvascular network via motion-induced changes in the OCT signal. OCTA typically allows achieving an image resolution and field of view in the ranges of 2-20 μm and a few mm to ˜20 mm, respectively. The imaging depth may be limited to less than 1 mm for human tissue.
OCTA identifies blood vessels by identifying differences in the OCT signal of time between that arising from moving scatterers in blood and that due to the surrounding largely static tissue. Such flow-induced differences are encoded in both the amplitude and phase of the complex OCT signal and may be detected by quantifying temporal changes in the OCT amplitude signal using speckle variance and/or correlation mapping/speckle decorrelation analyses.
There is however a need in OCTA to improve the sensitivity of detection of small blood vessels with low flow contrast, as well as to extend the imaging depth and field of view so as to provide the capability to image deeper blood vessels and larger tissue areas. Further, it would also be advantageous if processing speeds of images in OCTA could be improved.
In accordance with a first aspect of the invention, there is provided a method of detecting a flow in sequence of images of a material, the method comprising the steps of:
providing a sequence of at least three images of an area of the material, each image including a plurality of voxels or regions of interest such that the at least three images of the area of the material provide for each voxel or region of interest an intensity I(t) as a function of time t for at least three points in time;
Fourier transforming I(t) for each voxel or region of interest to obtain a distribution I(ω) of frequency co, I(t) including the intensities for the at least three points in time and; and
analysing I(ω) for each voxel or region of interest and generating a processed image of area of the material including the voxels or regions of interest, comprising associating voxels or regions of interest that have a larger amplitude IL(ωH) at a frequency ωH in a higher frequency range with a first visual property and voxels or regions of interest that have smaller amplitude IS(ωH) in the higher frequency range with a second visual property.
The first and second visual properties may for example be different shades of grey, colours or intensities. The step of analysing I(ω) may be performed such that a contrast in the processed image is increased between voxels or regions of interest associated with IL(ωH) and voxels or regions of interest associated with IS(ωH).
The inventors have observed that the amplitude I(ωH) in the higher frequency region is often larger for regions of interest which are associated with a flow, such as blood flow in a blood vessel, than for stationary regions. Embodiments of the present invention consequently have the advantage that for example the contrast between blood flow (and thereby blood vessels) and stationary areas of biological tissue can be increased and the identification of blood vessels is consequently improved.
In one embodiment the step of analysing I(ω) may comprise dividing IL (ωH) and IS (ωH) by an amplitude I(ωL) at a frequency ωL in a lower frequency range.
IL (ωH) and IS (ωH) may be respective averages of amplitude within a predetermined frequency range, such as a range of frequencies greater than 0.5, 1, 2 or 3 Hz.
I(ωL) may be an amplitude at a frequency of substantially 0 Hz (DC).
Providing a sequence of at least three images may comprise providing a sequence of at least three depth images. The depth images may be OCT images, such as OCT B-scans each comprising a sequence of OCT A-scans.
Each OCT B-scan may be obtained by detecting a sequence of light spectra (associated with OCT A-scans), and then applying an inverse Fourier transformation to each obtained light spectrum to transform the spectral intensity distribution to a spatial intensity distribution for forming an OCT image (OCT B-scan).
Further, the OCT image may comprise a plurality of OCT B-scans from different locations within the material and which together may form an OCT volume image.
The material may be biological tissue, such as tissue within an eye, such as a human eye, skin or brain. The method is typically performed in-vivo, but may alternatively also be performed ex-vivo.
The invention will be more fully understood from the following description of specific embodiments of the invention. The description is provided with reference to the accompanying drawings.
Notwithstanding any other forms which may fall within the scope of the disclosure as set forth in the Summary, specific embodiments will now be described, by way of example only, with reference to the accompanying drawings in which:
The present invention provides in a first aspect a method of detecting a flow in a sequence of images of a material. Referring to
The material in a specific embodiment is a biological tissue and more specifically human skin tissue, is performed in vivo and the method is a method of detecting a flow of blood within a blood vessel in the human skin. In a further embodiment, the material is a fabricated flow phantom comprising capillary regions and a static matrix region, which respectively model blood vessels and static tissue in a human tissue. The method more specifically comprises providing a sequence of at least three depth OCT images.
It will be understood that other biological tissues are however envisaged, such as tissue within a human eye. Materials other than a biological tissue are also envisaged and within the scope of the present invention. Further, the method may be performed ex-vivo.
As mentioned above, the inventors have observed that the amplitude I(ωH) in the higher frequency region is often larger for regions of interest which are associated with a blood flow in a blood vessel than for surrounding static tissue. This finding can be used to image for example blood vessels with a higher contrast.
Improving a blood vessel contrast for each of the flow phantom and for the human skin tissue in vivo will now be discussed. However, a person skilled in the art will appreciate that the present invention has broader applications. Further, it will be understood by a person skilled in the art that the present invention is not limited to OCT, but may be used for magnetic resonant imaging (MRI) and ultrasound imaging (for example).
An embodiment of the present invention comprises taking the frequency spectrum of a detected OCT signal from multiple acquisitions at a given voxel is analysed for each of the flow phantom and the human skin tissue and the method of detecting the flow of blood within a capillary and blood vessel, respectively, is herein referred as a short-time series OCT angiography (OCTA) method. The short-time series OCTA method is also compared to commonly used intensity-based OCTA methods, including speckle decorrelation (correlation mapping) and speckle variance. Results generally demonstrate, for a modest increase in acquisition times for a given OCT A-scan rate in the human tissue, improved vessel contrast and visibility, in particular, for small vessels. Further, the relative simplicity of the method lends itself to fast implementation. These advantages suggest its potential for future applications.
The basic assumption underlying the method in accordance with an embodiment of the present invention is that blood flow induces stronger non-zero frequency components in the OCT signal than those induced by the surrounding static tissue. As with other OCTA methods, the method first requires the acquisition of co-located OCT B-scans (i.e., B-scans from the same lateral location) at multiple time points, throughout an acquisition volume. The OCT intensity signal (i.e., the modulus of the complex amplitude of the OCT signal) at the same voxel locations comprises a discrete time series with the nth sample at location (x, y, z) denoted by:
I(x,y,z;tn)=I(x,y,z;t1+(n−1)T), (1)
where (x, y, z) is the voxel coordinate in the fast scanning, slow scanning and depth axes, respectively; I represents the OCT intensity signal as a function of the voxel coordinate with time point tn for n, an integer ranging from 1 to 2N+1, where 2N+1 is the total number of co-located B-scans (i.e., total number of time samples) acquired from the same lateral location; and T is the time interval between co-located B-scans.
The time series at each voxel in Equation (1) is discrete Fourier transformed to obtain the complex frequency signal with the frequency components F denoted by:
F(x,y,z;fm)=F(x,y,z;mfo), (2)
where f0 is the interval between neighbouring discrete frequencies, determined by 1/[(2N+1)T]; and m is the index of the (two-sided) frequency components ranging from −N to N. The average magnitude of the complex frequency signal at non-zero frequencies is then calculated as
Alternatively, if many B-scans are acquired for analysis (i.e., 2N+1≥29 for the scanning parameters used in this study), instead of a single frequency component, a narrow band centered on the zero-frequency component is excluded (i.e., high-pass filtered). This narrow band should be optimized for a particular tissue and setup, and will depend on the frequency spectrum recorded from static tissue. The optimization for human skin tissue, recorded using our system parameters, is shown in the Results section. However, there, we demonstrate that only a small number of co-located B-scans (˜5) is required for practical imaging of the vessel network with our method. Thus, the elimination of only the zero-frequency component, as shown in Equation (3), applies.
After Fourier transformation, voxels with low OCT signal intensity lead to a correspondingly low magnitude of the complex non-zero frequency components, even if there is flow. To enhance the flow detectability at low OCT signal levels, we incorporate weighting by the inverse of the OCT signal intensity (i.e., zero-frequency component scaled by the number of co-located B-scans), given by:
where
OCT scans were acquired using a commercial spectral-domain scanner (an upgraded TELESTO II, Thorlabs Inc., USA) to demonstrate the short-time series OCTA method on both a flow phantom and in vivo on normal human skin. The system has a center wavelength of 1300 nm and provides an imaging resolution of 5.5 μm (in air) and 13 μm, respectively, axially and laterally (as defined by the vendor). The scanner was operated at 76 kHz (A-scan/s), below its maximum of 146 kHz. Scans were acquired in one of two modes: 2D scanning by acquiring 200 co-located B-scans from a single lateral location with a FOV of 6×3.6 mm (1024×1024 pixels) in x and z directions, respectively; and 3D scanning with a FOV of 6×1.8×3.6 mm in x, y and z directions. In 3D scanning mode, 240 lateral (y) locations were scanned with a set of 5 co-located B-scans acquired from each location, using the same pixel sizes in x and z directions as in the 2D mode. It took approximately 4 and 21 s to acquire a scan, respectively, in the 2D and 3D scanning modes. In addition, the time interval between B-scans was 17.8 ms (˜56 B-scans/s) for both 2D and 3D modes, leading to a discrete frequency spectrum with components up to 28 Hz.
For comparison to short-time series OCTA, speckle variance in the same 3D scans was calculated over the 5 co-located B-scans using the method presented by Mariampillai et al. in “Speckle variance detection of microvasculature using swept-source optical coherence tomography,” Opt. Lett. 33(13), 1530-1532 (2008). Speckle decorrelation was determined for each adjacent pair of co-located B-scans using the formula described in P. Gong, S. Es'haghian, K. A. Harms, A. Murray, S. Rea, B. F. Kennedy, F. M. Wood, D. D. Sampson, and R. A. McLaughlin, “Optical coherence tomography for longitudinal monitoring of vasculature in scars treated with laser fractionation,” J. Biophotonics 9(6), 626-636 (2016), with a window of 3×3 pixels in the fast scanning and depth axes. This led to four decorrelation B-scans from each lateral location, which were then averaged to generate a single enhanced decorrelation B-scan. In addition, the speckle decorrelation and speckle variance was weighted by the averaged and thresholded OCT signal at the corresponding pixels to reduce the noise (J. Enfield, E. Jonathan, and M. Leahy, “In vivo imaging of the microcirculation of the volar forearm using correlation mapping optical coherence tomography (cmOCT),” Biomed. Opt. Express 2(5), 1184-1193 (2011)). The threshold used in short-time series OCTA was used here. The same lateral averaging window (3×3 pixels) was applied to the short-time series and speckle variance images to ensure a fair comparison.
Blood vessels were mainly compared over a depth range of 300 μm from the skin tissue surface (determined from the OCT depth scan by assuming an average refractive index of 1.4) to ensure sufficiently strong signals from all three methods. For each method, the maximum OCTA signal of each A-scan in this depth range was used to generate a projection image of vessels. For visualization, the same colormap was used in the projection and cross-sectional OCTA images. The lower and upper thresholds were set at, respectively, the 50% and 99.5% points of the cumulative distribution function of the OCTA signal in the image. These thresholds were empirically chosen to maximize the vessel contrast without loss of vessels with low signal. For quantification, each projection image was processed to measure the vessel area density, defined as the ratio of the total vessel area to the total tissue area in the thresholded vessel image. The threshold was set using the Otsu's method for each image (N. Otsu, “A threshold selection method from gray-level histograms,” IEEE Trans. Syst. Man Cybern. 9(1), 62-66 (1979)).
The silicone flow phantom was fabricated in house by mixing Elastosil® P7676A and P7676B fluid (Wacker Chemie AG, Germany) with titanium dioxide in a 3D-printed plastic container (see, S. Es'haghian, K. M. Kennedy, P. Gong, D. D. Sampson, R. A. McLaughlin, and B. F. Kennedy, “Optical palpation in vivo: imaging human skin lesions using mechanical contrast,” J. Biomed. Opt. 20(1), 016013 (2015)). The container was customized with two holes in the sidewall to hold a small glass capillary (outer diameter: 80 μm; inner diameter: 50 μm) that mimicked a blood vessel. After curing, the capillary was embedded in the silicone that mimicked the static tissue. The capillary was then connected to a syringe filled with a polystyrene microsphere suspension (nominally 0.5-μm diameter) to mimic the blood flow. The syringe was connected to a pump (Fusion 200, Chemyx Inc., USA) to introduce and control the flow speed. The scattering properties of the phantom were adjusted by tuning the ratio of titanium dioxide to Elastosil® P7676A and P7676B so that the phantom had a signal attenuation that approximately matched the attenuation of normal human skin.
Human subjects (n=4) were recruited for in vivo OCT scanning with ethics approval from the Human Research Ethics Committee of The University of Western Australia. Written consent was acquired from all subjects prior to OCT scanning of skin on the volar forearm, including one subject who had received laser treatment for wart removal. For this subject, one region from the treated area and one from the adjacent normal skin were selected for OCT imaging. To reduce bulk tissue motion during data acquisition, a spacer was attached to the skin surface to tightly couple the OCT probe and the skin tissue. A piece of thin metal with a center hole (5 mm in diameter) to image through was also attached to the skin as a fiducial marker to check for motion artefact. We observed a generally good vessel contrast and negligible vessel distortions, so no motion correction was performed. Further details on the imaging probe spacer and scanning setup can be found in P. Gong et al., “Optical coherence tomography for longitudinal monitoring of vasculature in scars treated with laser fractionation,” J. Biophotonics 9(6), 626-636 (2016). The acquired scans from the phantom and skin tissue were then processed using the three OCTA methods and compared.
This section firstly considers the contrast present in the short-time series OCTA method and its optimization by selecting the number of samples and incorporating signal weighting. The difference between short-time series implemented on the OCT intensity and on the complex signal is also shown. Results from the optimized short-time series OCTA method are then compared to those acquired from speckle decorrelation and speckle variance.
The blood vessel contrast in short-time series OCTA originates from the elevated non-zero frequency components induced by the moving scatterers in blood. An example of such vessel contrast, obtained from an extended time series of 200 B-scans,is shown in
Two-sided spectral density of the signal from 200 B-scans in the flow and static regions is shown in
The frequency spectrum of the OCT signal from the static matrix region in
Similar plots were obtained from in vivo skin, determined from 200 co-located B-scans, with the spectral density shown in
The frequency spectra shown in
The average magnitude increases, for both the flow regions in the capillary/blood vessels and for the static matrix/static tissue, versus the number of acquired co-located B-scans, as does the difference in the average magnitude between the flow and static regions. Notably, the ratio between the two (dotted plots) peaks at around 5-10 co-located B-scans before it reaches a plateau (with local fluctuations). In
To enhance the vessel signal in the flow regions with low OCT signal, we further weight the average magnitude of non-zero frequencies by the inverse of the linear OCT signal intensity, as described in Equation (4). The weighted image in
Intensity Vs. Complex Signal-Based Processing
As with other OCTA methods, it is possible to analyze either the intensity or the full complex OCT signal (i.e., intensity and phase). The short-time series method was applied to both cases in the same skin scans. A representative example is shown by the vessel projection images in
A customized imaging spacer and setup was used to minimize motion during data acquisition, which has previously been shown to be effective when used in combination with the speckle decorrelation method (P. Gong et al., “Optical coherence tomography for longitudinal monitoring of vasculature in scars treated with laser fractionation,” J. Biophotonics 9(6), 626-636 (2016)).
Whilst residual tissue motion is almost absent in
Comparison with Speckle Decorrelation and Speckle Variance
To further assess the performance of the OCTA method in accordance with embodiments of the present invention, the short-time series OCTA method was compared to two commonly used intensity-based OCTA methods, speckle decorrelation (correlation mapping) and speckle variance, applied to sets of 5 co-located B-scans in 3D scans.
Referring to
Vessels from the forearm skin are projected from the surface to 300 μm in depth. The arrows in the
Thus,
Such improvement is further quantified by measuring the vessel area density, with an estimated accuracy of approximately 1%. This results in a superior area density of 28% for the short time-series image shown in
The consistent superiority of vessel contrast afforded by short time series OCTA is observed in all human subjects (n=4) in this study, with a further example shown in
To further elucidate the contrast differences among the three methods, an experiment was performed to examine the OCTA signal in the phantom versus flow speed (9 values ranging from 0 to 2 mm/s).
In addition to visualization of normal vessel networks, short-time series OCTA also shows good vessel contrast for the subject with a treated wart. The resulting vessel image is shown in
The wart was removed with a laser ˜16 years prior to OCT scanning. Comparison of the images generated by the three OCTA methods consistently shows the improved visualization by the short-time series method, for both the normal and treated skin regions (not shown). Though the treated region shows a very comparable skin color to the normal skin, the underlying microvasculature visualized by the short-times series method clearly reveals the morphological differences. For example, the treated region presents a network with more branches and a distinct honeycomb-like pattern (i.e., local loops), absent from the normal skin. The quantified vessel area density in the treated region (34%) is significantly higher than that in the normal skin (29%). Such visualization and the associated contrast demonstrate the potential of short-time series OCTA for future studies of various cutaneous conditions.
Another important factor is the computation time, which can be limiting for applications requiring near-real-time or real-time imaging. Overall, speckle decorrelation is more time consuming than short-time series or speckle variance due to the requirement for window processing (not simply averaging) to generate the vessel signal. It took ˜420 ms to calculate the decorrelation of a pair of B-scans (1024×1024 pixels per B-scan) using a 3×3 pixel window on an Intel® Core™ i7-3820 processor with MATLAB R2016a (The MathWorks, Inc.). When a larger window is used for processing, the computation time increases significantly (e.g., 990 ms for a 5×5 pixel window). In contrast, data processing for the short-time series method and speckle variance is much faster, taking ˜64 ms and ˜27 ms, respectively, to process each set of 5 co-located B-scans. This feature indicates the promise for future implementation of the short-time series method on fast scanning OCT systems to enable in-procedure or even real-time visualization of microvasculature.
The method proposed in accordance with the described embodiment takes a short time series of OCT B-scans, i.e. a sequence of at least three images acquired at the same location as an input, and performs a discrete Fourier transform to determine the frequency content in order to image blood vessels. The observed higher magnitudes at non-zero (high-pass) frequencies in the blood vessels (up to 28 Hz demonstrated here) create a clear contrast to distinguish blood vessels from surrounding static tissue. This method is easily applicable to OCT scans acquired using normal scanning parameters for imaging of the microvascular network. In case studies on human skin, short-time series OCTA shows moderately but consistently improved vessel contrast in comparison to speckle decorrelation and speckle variance, especially for the smaller vessels. Whilst the in vivo comparison was demonstrated on skin tissue, application of short-time series OCTA method to other biological tissues, such as the retina, is also envisaged.
The number of co-located B-scans acquired from the same location is an important parameter for the practical implementation of the short-time series method in accordance with embodiments of the present invention. We chose five in this study so as to minimize the amount of collected data and corresponding total acquisition time, whilst still attaining a high vessel/static tissue contrast in skin.
Thus, the short-time series OCTA method in accordance with the specific embodiment of the present invention demonstrates the performance of imaging of tissue microvasculature in vivo, wherein the flow-induced signature in the frequency domain via Fourier transform of the time series of the OCT signal in five B-scans from the same lateral location was analysed. The angiography signal is computed as the average magnitude of the non-zero (high-pass) frequency components, clearly differentiating blood vessels and static tissue, as demonstrated in a flow phantom and in human skin in vivo. Weighting of the angiography signal by the inverse of the mean OCT signal demonstrated improved detection of blood vessels. The imaging performance of short-time series OCTA was assessed by comparison to the commonly used speckle decorrelation and speckle variance methods, showing consistently substantially improved results, evidenced by improved visualization, especially for small vessels, and increased vasculature density of the human cutaneous microvascular network.
It is also to be understood that, if any prior art publication is referred to herein, such reference does not constitute an admission that the publication forms a part of the common general knowledge in the art, in Australia or any other country.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2018904266 | Nov 2018 | AU | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/AU2019/051211 | 11/4/2019 | WO | 00 |
