Patent Grant
7924429
1. Technical Field
The present invention relates to coherent waveform based imaging, and more particularly to an optical coherence tomography (OCT) imaging system.
2. Statement of the Related Art
Many imaging systems utilize coherent waveforms to obtain information regarding target objects of interest. Examples include OCT, ultrasound diagnostics, and synthetic aperture radar. OCT is a low-coherence interferometer-based noninvasive medical imaging modality that can provide high-resolution sectional images of biological tissues (see for example, U.S. Pat. No. 5,321,501, U.S. Pat. No. 5,459,570, Huang, D. et al. (1991). “Optical coherence tomography.” Science 254(5035): 1178-81). Since first introduced, OCT has been used in a variety of medical research and diagnostic applications. One successful application of OCT imagery can include the use of OCT in the dermatological imaging of the skin. Another successful application of OCT imagery can include sectional imaging of the retina in the field of ophthalmology. In this regard, time domain based OCT has produced cross-sectional images of the retina of the eye that have proven value to ophthalmologists (see for example, Swanson, E. A. et al. (1993). “In-vivo retinal imaging by optical coherence tomography.” Optics Letters 18(21): 1864-1866; Izatt, J. A. et al. (1993). “Ophthalmic diagnostics using optical coherence tomography”. Ophthalmic Technologies III, SPIE, 1877: 136-144, Los Angeles, Calif., USA). Notwithstanding, time domain OCT instruments cannot acquire sufficient data to characterize completely important retinal pathologies.
The limitations of time domain OCT are the natural result of the inherent difficulties in acquiring and processing imagery of an unstable target—the human eye. For example, although ophthalmic OCT has been commercialized for several years, the spatial registration of an OCT image to fundus landmarks has not been achieved satisfactorily. In this regard, fundus landmarks can be used to relate different structural abnormalities at different retinal locations. Precise spatial registration of OCT sections to tissue location also can be important when interpreting other medical images. Yet, the unavoidable eye movement of a patient during image acquisition can complicate the ability to achieve precise spatial registration due to the unavoidable distortion of the OCT image.
As an alternative to OCT, the scanning laser opthalmoscope (SLO) provides en face fundus images familiar to ophthalmologists (see for example, Sharp, P. F. et al (2004) “The scanning laser ophthalmoscope—a review of its role in bioscience and medicine” Physics in Medicine and Biology 49: 1085-1096). In this regard, en face views are familiar to ophthalmologists not only from direct observations, but also from fundus photographs and fluorescein angiography. The strength of an en face view is that structural abnormalities at different retinal locations can be related to each other and to major retinal landmarks such as the fovea and optic nerve head. In any case, combining OCT with SLO (SLO/OCT) provides one possible means for precise spatial registration of the OCT image while providing an en face fundus image (see for example, U.S. Pat. No. 5,975,697, U.S. Pat. No. 6,769,769, CA2390072, US20040036838, US20040233457, and WO2004102112).
Specifically, time domain SLO/OCT systems utilize two-dimensional transverse scans to provide sectional images in planes perpendicular to the depth of the sample. In an SLO/OCT system, the fundus image can be acquired by splitting the reflected sample light during the transverse scan into two detection channels. A first channel can accommodate OCT while the second channel can be utilized in acquiring intensity image (see for example, U.S. Pat. No. 5,975,697, U.S. Pat. No. 6,769,769, CA2390072, US20040036838, US20040233457, and WO2004102112). As an alternative approach, the sectional images can be summed along the depth of the image (see for example, Hitzenberger, C. K. et al. (2003). “Three-dimensional imaging of the human retina by high-speed optical coherence tomography.” Optics Express 11(21): 2753-2761; Puliafito C. A. “Summary and Significance” American Academy of Ophthalmology Subspecialty Day on retina, Section X: Ocular Imaging, New Orleans, Oct. 23, 2004, 3:06 pm). The approach of two detection channels can require a more complicated setup and the signal-to-noise ratio of the OCT may be reduced by a partial sacrifice of the back-reflected sample light. By comparison, in the approach of summing the OCT images along their depth, accuracy can be sacrificed when the eye moves between different sections.
The present invention is an OCT method, system and apparatus which addresses the foregoing deficiencies of time domain ocular imaging. In particular, what is provided is a novel method, system and apparatus for anatomical mapping using spectral domain OCT. As well, time-domain OCT and swept source frequency OCT also can be applied to provide the enhanced anatomical mapping of the present invention. In this invention, the term spectral domain OCT (SD-OCT) is sometimes used to include both spectrometer based spectral or Fourier domain OCT, and tunable laser based swept source OCT since their basic principle of operation is very similar (see for example, Choma, M. A. et al. (2003). “Sensitivity advantage of swept source and Fourier domain optical coherence tomography.” Optics Express 11(18): 2183-2189). In accordance with the present invention, a fundus intensity image can be acquired from a spectral domain scanning of light back-reflected from an eye. The term “intensity image” as defined in this invention is a two-dimensional en-face image extracted from a 3D OCT data block by integrating the OCT signal over a depth range (Z-axis) greater than the axial resolution of the OCT system. For example, a fundus image can be extracted by the method disclosed herein from OCT data covering the fundus of the human eye. The fundus intensity image actually represents a reduction in total information content. Specifically, the squaring and summing over the spectra results in a loss of all depth information. Yet, the loss of depth information can achieve a shortcut to a particularly useful item of distilled information for the purpose of medical diagnostics.
A 3-D OCT data set can be reduced to generate an ocular mapping, including edema mappings and thickness mappings. Optionally, a partial fundus intensity image can be produced from the spectral domain scanning of the eye to generate an en face view of the retinal structure of the eye without first requiring a full segmentation of the 3-D OCT data. The partial intensity image is a two-dimensional en-face image extracted from a 3D OCT data block by integrating the OCT signal over a depth range greater than the axial resolution of the OCT system, but including only selected regions of the 3-D anatomical structure for integration.
The present invention can differ from conventional, time domain OCT technology because the mapping system of the present invention can be optimized to obtain the information necessary for assessing macular edema while simultaneously producing a fundus intensity image. As part of the optimization, the present invention utilizes optimized sampling grids. For example, in the case of volume measurements of fluid-filled spaces, which require several samples spread over the areal extent of the space, a raster scan can be utilized having evenly spaced points on a square grid.
Importantly, in accordance with the present invention, the data set acquired by the spectral domain scan can contain all of the 3-D information about retinal structure needed to estimate the volumes of fluid-filled spaces. Accordingly, 3-D segmentation algorithms can be applied to the intensity data set to outline spatial structures. As yet another important aspect of the invention, intensity information can be extracted from each measured spectrum to provide an en face view or an image of the fundus that can be used immediately to judge image data quality. In this regard, an operator can then decide whether or not to take another image. Because the intensity image is generated from the same data as the subsequent 3-D data set, the intensity image provides all necessary landmarks for precisely locating on the fundus the lesions revealed by the cross-sectional OCT scan. The intensity image also provides the landmarks needed for orienting the 3-D data set to other fundus images, such as fundus photographs and fluorescein angiograms.
As an additional advantage, because the fundus intensity image can be generated before segmentation of the 3-D data set, the fundus intensity image can be used to guide the segmentation. For example, retinal blood vessels represent discontinuities in the layered retinal architecture that often disrupt segmentation of cross-sectional images. The fundus intensity image can be processed by ordinary 2-D algorithms to identify the blood vessel positions. Subsequent processing of the OCT cross-sectional images then can be modified at each vessel location. For instance, an algorithm designed to follow layers can skip past a vessel and resume segmentation on the other side of the vessel. Additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The aspects of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the appended claims. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
A more complete understanding of the present invention, and the attendant advantages and features thereof, will be more readily understood by reference to the following detailed description when considered in conjunction with the accompanying drawings, wherein:
The present invention is a system, method and apparatus for anatomical mapping through the production of a 3-D data set, for instance through imagery produced utilizing OCT. In accordance with the present invention, a fundus intensity image can be acquired from a spectral domain scanning of light back-reflected from an eye. The 3-D data set can be reduced to generate an ocular mapping, including edema mappings and thickness mappings. Optionally, a partial fundus intensity image can be produced from the spectral domain scanning of the eye to generate an en face view of the retinal structure of the eye without first requiring a full segmentation of the 3-D data set.
In further illustration,
Specifically, the beam splitter 115 can be a 2×2 3 dB fiber coupler configured to split light emanating from the light source 105 into sample and reference arms. The sample arm can be coupled into the optical head of a light delivery system 165. The light delivery system 165 can include an x-y scanner 130 and optics for delivering the sample light into the eye 140 and collecting the back-reflected sample light. Optionally, the back-reflected sample light can be partially reflected through operation of a dichroic mirror 135 into a video camera 145 for real time viewing of the fundus.
By comparison to the sample arm, the reference arm can include a variable neutral density filter 125 used to adjust the reference intensity before and after the light reaches the optical reference system 170. Polarization controllers 120 can be used in both the reference and sample arms for fine tuning of the sample and reference polarization states to achieve maximal interference. In an exemplary configuration of the detection arm, a spectrometer 160 can be coupled to a line scan camera 155 to detect the combined reference and sample light. As is known in the art, a spectrometer will include an optical element such as a diffraction grating for angularly dispersing the light as a function of wavelength. The dispersed light falls on the pixels of the line scan camera. The light intensities measured by the camera pixels contain information corresponding to the distribution of reflection sites along the Z-axis depth in the sample.
Both the line scan camera 155 and the video camera 145 can be communicatively linked to a computer 150. The computer 150 can be coupled both to a data acquisition processor 190 configured to acquire data from the line scan camera 155, and also to a data reduction processor 195 configured to reduce the acquired data to produce anatomical maps 185A and partial fundus imagery 185B. The 3-D data sets would also be used to create cross-sectional OCT images 185C as known in the art.
By operation of the data acquisition processor 190, both a 3-D data set 180 and an intensity image 175 can be acquired. The intensity image 175 can be acquired in real time directly from the data acquisition processor using either digital or analog processing. Complex data processing associated with generating OCT images is not required. Consequently, an operator can discard the image if it is determined that the image is of too low quality without permitting further data processing. The 3-D data set 180, by comparison, can be produced by operation of the data reduction processor 195 from the image acquired by the data acquisition process 190. Notably, an intensity image 175 can also be derived from the 3-D data set. An intensity image created either directly from the data acquisition or from the 3-D data set can be useful for data registration to other imaging modalities. Moreover, blood vessels can be identified as an initial step in a segmentation process. In a swept source spectral domain OCT embodiment, the output wavelength of the light source can be varied or scanned, for example, via frequency modulation. Only a single photodetector is required rather than a spectrometer and a line scan camera. The intensity data as a function of wavelength is extracted over time.
In a more particular illustration,
In block 220, a fundus image can be generated directly from intensity data included within the spectra produced by the spectral domain scan. In this regard, it is to be noted that each captured spectrum contains at least two components from which can be extracted a signal proportional to the total reflected intensity. This intensity signal can be used to produce a 2-D image of the fundus that advantageously can appear similar to the image from an SLO. Various methods can be employed to obtain the intensity signal in “real-time”, so that the fundus image can be painted on a display screen as rapidly as it is acquired.
The method for extracting intensity information can be understood by considering the primary mathematical expression for the spectral intensity of the interference fringes falling on the line scan camera:
where ν is the frequency of the light; Rsn is the intensity reflection of a small region in the sample; Gs(σ) is the spectral density of the light source; the reflection of the reference arm is unity; distances are represented by propagation times τn,τm in the sample arm and τr in the reference arm and summation is across all axial depths in the sample beam. The third term in brackets is the mutual interference for all light scattered within the sample and the last term contains the interference between the scattered sample light and the reference light from which an a-scan is calculated. It is important to note that, in embodiments where the detector is a spectrometer, the parameter ν also represents position on the line scan camera. Hence, the primary equation can be broken conceptually into two parts: the first two terms represent slow variation across the linear array of camera pixels while the last two terms represent oscillations (interference fringes). Similarly, in the embodiments where the source is swept through a range of frequencies ν the first two terms in the primary equation represent slow variation in time of the detected signal, while the last two terms represent oscillations.
The new insight that leads to generation of a fundus image is to recognize that the desired information about total reflected sample intensity resides in both the second and fourth terms of the primary equation. This permits multiple methods for extracting the intensity. The method selected for a particular application will depend on desired speed and accuracy. Several examples of methodologies for obtaining a fundus intensity image follow in which F(x,y) is the output of the processing method for an a-line at scan point x,y on the fundus.
In a first example, the primary equation can be summed across ν (in practice, across the pixels of the line scan camera). Notably, the cosine terms in the primary equation which have many cycles across the spectrum will sum to (approximately) zero. Thus, applying the summation can yield
where
which is proportional to the sum of all reflected intensities in the sample, i.e., the desired fundus intensity. Digital summation of the camera output can be very fast and this method may be most suitable for painting the fundus image into a display window as rapidly as it is acquired. Various techniques can be used, if necessary, to compensate for small variations in
In another example, the fundus intensity can also be derived from the fourth term of the primary equation by separating the oscillatory component from the slow variation and recognizing that, for retina and other low reflectance samples, the third term is small relative to the fourth term. One method to achieve this is to apply a Fourier transform to the primary equation, to discard the low frequency terms, and then to square and sum the high frequency terms. By Parseval's theorem this is equivalent in the camera output signal to high pass filtering the primary equation to remove the low frequency component, then squaring the remaining oscillatory component and summing over the spectrum.
Neglecting the third term of the equation, the high pass filtering, squaring and summing of the primary equation can produce:
which can be displayed directly to produce an intensity image. It is noted that one can modify the parameters of the high-pass filter in order to change the contrast of the fundus image by changing the relative contributions of shallower and deeper structures. The choice of domain in which to operate depends on considerations of speed and ease of implementation. Operations on the camera output can be carried out digitally or, for highest speed, by analog processing. Similarly, in a third exemplary method for obtaining a fundus intensity image, the observation that a spectrometer normally discards the zero order beam can be utilized such that the intensity of the zero order beam also can have the form of the equation yielded by the summation of the primary equation. Thus, the intensity signal can be obtained directly with an auxiliary photodetector and displayed with conventional methods.
Returning now to
In block 240, the acquired set of spectral domain scans can be converted into a data set that contains the axial (Z-axis) reflectance of the sample. As part of the conversion process, the acquired spectra can be transformed from points linear in wavelength to points linear in frequency (wave number). This transformation can be accomplished mathematically. Alternatively, the transformation can be accomplished by building a line scan camera that has unequally-spaced pixels. Specifically, the modified line scan camera can incorporate pixels spaced according to the reciprocal of the distance along the light detector chip in the camera. The consequent variation in pixel size will cause variation in pixel gain, but this can be compensated electronically or digitally. The transformation would therefore take place instantly in hardware, greatly speeding up the generation of the spatial data. The product of the transformation may then be used in the conversion 240 to produce a set of Z-axis intensity information data for each unique X and Y position of the beam on the sample, i.e. a 3-D data set. As noted above, this 3-D data can be converted directly into a full intensity image, for example, by squaring and summing the intensity data at each X/Y position. The 3-D data is also used to generate conventional OCT cross-sectional images 185C. The 3-D data can also be subjected to a partial segmentation process (block 250) in order to outline and quantify fluid-filled spaces and other retinal features. This segmented data can also be used (block 260), to generate ocular maps, such as “edema maps” and “thickness maps” that can be used for diagnosis and treatment. The partial segmentation can also be used to generate a partial fundus image. The partial fundus image is generated the same way as the full fundus image from the 3-D data however, the depth location and range around that depth is limited and selected through the segmentation process. As discussed below, a partial fundus image can be created to highlight certain features or landmarks in the eye. Note that a full segmentation process would be one that identifies many (or all) retinal layers and/or structures. A partial fundus image requires finding only one surface, either a specific retinal layer, like the retinal pigment epithelium, or a more general description of retinal tilt and curvature such as the locus of the centroids of each a-scan.
Notably, the retina can be tilted and curved with respect to the Cartesian coordinate system of the acquired 3-D data set. Reference surfaces identified during segmentation can be used as boundaries to create a partial intensity image that help identify the tilt and curvature. The reference surfaces can capture this tilt and curvature as mathematical surfaces within the acquired data set. These reference surfaces can be generated by combining lines segmented on individual longitudinal cross sectional scans (B-scans). Reference surfaces also can typically correspond to known anatomical layers of the retina. Likely examples include the retinal pigment epithelium (RPE) and the inner limiting membrane (ILM). The reference surfaces can be used to visualize pathology or to define layers within the data set that have the variation due to retinal tilt and curvature removed. Data points within these layers can be used to form en face images or partial intensity images that represent retinal structures localized to a particular depth or anatomic layer.
A characteristic of the data set for the partial fundus intensity image is that it has thickness, in general greater than the axial resolution of the OCT. This and the fact that the layer is curved and tilted in a way intended to capture anatomy distinguishes it from “C-scans”—the tangential slices produced by SLO/OCT instruments—which are perpendicular to the scanning beam. Hence, C-scans are thin, the thickness being defined by the axial resolution, and they are not usually aligned with retinal structures.
Specifically, intensity in axial scans can be expressed as
where distance along the z-axis is represented by propagation time τ=nz/c with n the refractive index of tissue and c the speed of light in vacuum; τn and τr are the propagation times for light reflected by the nth scatterer in the sample and the reference mirror, respectively; Rn is the normalized intensity reflection of the nth scatterer; and summation is across all axial depths in the sample beam. Γ(τ) is the autocorrelation function of the light source and expresses the axial resolution of the system. Note Γ[τ±2(τn−τr)] falls rapidly to zero as (τn−τr) becomes greater than the axial resolution. For each depth τ, therefore, the reflected intensity comes from only a thin layer of the Rn.
Thus, a tissue layer defined as above can be expressed by its upper boundary τ0(x,y) and lower boundary τ1(x,y). The total reflectance of the scatterers in the tissue layer at each point (x,y) can be obtained by squaring
and then summing from τ0 to τ1. The result is the desired partial fundus intensity image
Still, it is to be understood that the partial fundus intensity image (as well as the fundus intensity image) can be obtained without the explicit use of the above equation. In fact, any monotonic transformation of the a-line intensities, when summed, can produce an apparent partial fundus intensity image, though the relative intensities of the different structures can differ. For example, the squaring step can be omitted prior to the summing step and the resulting partial fundus intensity image can suffice. In fact, performing a monotonic transformation, strictly speaking, is not required as a transformation having a “little wiggle” can provide a similar result. Notwithstanding, the above equation can provide a true intensity and serves as a preferred example of the technique. Note that the generation of a partial fundus image need not be restricted to a summation between two surfaces, but could also be defined by an integral under a z-profile that followed the reference surface, (e.g., the two surface example defines a rectangular z-profile).
The partial fundus intensity image can be applied to the registration of OCT with other modalities. Specifically, in addition to its use for display of pathology, a partial fundus intensity image can be used to provide high contrast images of the retinal blood vessels that are useful for aligning the OCT data set to images from other clinical modalities (such as fundus photographs). Due to scattering by red blood cells, major retinal blood vessels cast strong shadows onto the underlying tissue. By placing one boundary of the slab a distance below the ILM that excludes the light scattered by the blood vessels themselves, then forming the partial fundus intensity image from all tissue below that boundary, these shadows are emphasized and the blood vessel pattern stands out in stark relief against the brighter retinal reflection. This type of partial fundus intensity image can be referred to as a shadowgram as other partial fundus intensity images can be used to emphasize intra-retinal or sub-retinal structures by the reflected light of the structures rather than the shadows produced by the incidence of light upon the structures.
The fundus intensity image also solves the specific problem of image registration for assessment of the retinal nerve fiber layer in glaucoma diagnosis. In the case of the retinal nerve fiber layer, more accurate registration will reduce measurement variance and improve the detection of glaucoma progression.
The method of the present invention can be realized in hardware, software, or a combination of hardware and software. An implementation of the method of the present invention can be realized in a centralized fashion in one computer system, or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system, or other apparatus adapted for carrying out the methods described herein, is suited to perform the functions described herein.
A typical combination of hardware and software could be a general purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein. The present invention can also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which, when loaded in a computer system, is able to carry out these methods.
Computer program or application in the present context means any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following a) conversion to another language, code or notation; b) reproduction in a different material form. Significantly, this invention can be embodied in other specific forms without departing from the spirit or essential attributes thereof, and accordingly, reference should be had to the following claims, rather than to the foregoing specification, as indicating the scope of the invention.
The following references are incorporated herein by reference:
This application is a continuation of U.S. patent application Ser. No. 12/322,607, filed Feb. 4, 2009, which in turn is a continuation of U.S. patent application Ser. No. 11/975,239, filed Oct. 18, 2007 (U.S. Pat. No. 7,505,142), which in turn is a continuation of U.S. patent application Ser. No. 11/219,992, filed Sep. 6, 2005 (U.S. Pat. No. 7,301,644), which in turn claims priority from U.S. Provisional Application Ser. No. 60/632,387, filed Dec. 2, 2004, the disclosure of which is incorporated herein by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5321501 | Swanson et al. | Jun 1994 | A |
| 5459570 | Swanson et al. | Oct 1995 | A |
| 5465147 | Swanson | Nov 1995 | A |
| 5921926 | Rolland et al. | Jul 1999 | A |
| 5975697 | Podoleanu et al. | Nov 1999 | A |
| 6201989 | Whitehead et al. | Mar 2001 | B1 |
| 6769769 | Podoleanu et al. | Aug 2004 | B2 |
| 6927860 | Podoleanu et al. | Aug 2005 | B2 |
| 7301644 | Knighton et al. | Nov 2007 | B2 |
| 7433046 | Everett et al. | Oct 2008 | B2 |
| 7474407 | Gutin | Jan 2009 | B2 |
| 7505142 | Knighton et al. | Mar 2009 | B2 |
| 7659990 | Knighton et al. | Feb 2010 | B2 |
| 20040239938 | Izatt | Dec 2004 | A1 |
| Number | Date | Country |
|---|---|---|
| 2390072 | Dec 2003 | CA |
| WO-2004043245 | May 2004 | WO |
| WO-2004102112 | Nov 2004 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20100208201 A1 | Aug 2010 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60632387 | Dec 2004 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12322607 | Feb 2009 | US |
| Child | 12644526 | US | |
| Parent | 11975239 | Oct 2007 | US |
| Child | 12322607 | US | |
| Parent | 11219992 | Sep 2005 | US |
| Child | 11975239 | US |
