Colorimetric three-dimensional microscopy

Abstract
An optically reflective or translucent object (14) can be microscopically imaged in all three dimensions and in true color for observation by a human observer. An interferometric optical setup is employed, using the low temporal coherence of a tunable broad-band light source (10, 20) to resolve the axial dimension, a single opto-mechanical or electronic scanning mechanism for accessing different object depths, and a two-dimensional photo sensor device (15, 34) capable of demodulating the temporally or spatially modulated scanning signals to reconstruct the object's full volume. Three volume scans are carried out sequentially, and the tunable broad-band source (10, 20) is operated in such a way that its spectral distribution for each of the volume scans results in an effective system sensitivity corresponding to one of the three CIE (Commission Internationale d'Éclairage) tristimulus curves, or a linear combination thereof. The linear combination of the three volume images forms the full, true-color volume image for human observers. By using reference objects (43) in the imaged volume, the three-dimensional images can be corrected for spatially- and wavelength-dependent dispersion and absorption.
Description

BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 shows the three tristimulus curves for the standard observer according to the CIE (Commission Internationale de d'Éclairage, 1931). The overall spectral sensitivity of an optical system making use of three different light sources with spectra S1, S2 and S3 must correspond to the three curves x, y and z or to a linear combination thereof, if true color acquisition for a human observer is desired.



FIG. 2 schematically shows three-dimensional optical coherence tomography with three-color data acquisition according to the prior art



FIG. 3 schematically shows three-dimensional optical coherence tomography with true-color data acquisition according to the present invention. The tunable light source 10 is operated sequentially in such a manner that the produced spectra S1, S2 and S3 result in a total spectral system response corresponding to the three CIE tristimulus curves x, y and z or to a linear combination thereof.



FIG. 4 schematically shows a three-dimensional optical coherence tomography apparatus with true-color data acquisition according to the present invention, offering dynamic coherent focus for the high-resolution imaging of objects with an extended depth. Only one opto-mechanical scanning element is required, moving the optical subsystem 25 with the plane reference mirror 26 and the imaging optics 31. As in FIG. 3, a tunable light source 20 is employed, with which a total system response according to the CIE tristimulus curves is achieved.



FIG. 5 shows an example of the signals M1, M2 and M3 in one pixel acquired with the three illumination spectra S1, S2 and S3. If the propagation speed of the light emitted by the three light sources differs in the measurement volume (“dispersion”), the depth scale of the three signals will not coincide. By making use of some reference objects, the three depth scales can be recalibrated to match up again.



FIG. 6 shows a measurement volume with regions of differing absorption and the presence of a few objects with known spectral reflection properties as a function of depth coordinate z.





WAYS TO IMPLEMENT THE INVENTION

The colorimetric three-dimensional microscopy system according to the invention is schematically illustrated in FIG. 3: A tunable light source 10 is used whose emission properties can be electronically controlled to produce different emission spectra S1, S2 and S3. The tunable light source must be able to produce light in the complete visual wavelength range (approx. 400-700 nm). The total effective spectral system response of each of said three emission spectra corresponds to one of the three CIE tristimulus curves shown in FIG. 1 (or a linear combination thereof. Since all optical elements of the OCT system with their spectral properties contribute to the total spectral system response (quantum efficiency of the photodetector, absorption characteristics of the beam path, reflection properties of beam splitter and reference mirror, emission spectrum of the light source), the emission spectrum of the tunable light source 10 must be selected and optimized accordingly.


A first possible embodiment of such a tunable light source 10 consists of an intense broad-band light source, which is filtered with an electrically or mechanically switchable filter with the above described spectral characteristics. Possible embodiments of such light sources include a high-intensity white LED, or a high-pressure gas discharge lamp with a sufficiently wide spectrum to cover all visible wavelengths (e.g. metal halide lamps).


Another possible embodiment of a tunable light source is a monochromatic light source such as a Ti:Sapphire laser system, whose wavelength and intensity are swept at high speed over the desired range, so that an averaged, effective spectrum as described above is obtained. The speed of this sweep must be so high that the detector sees a complete spectrum during the time of one fringe period of the OCT signal.


The light from the light source 10 is coupled into the multi-mode optical fiber 11, and is guided to the input of an optical interferometer, such as a Michelson, a Mach-Zehnder, or a Kösters interferometer. The interferometer type used for illustrative purposes in FIG. 3 is a Michelson interferometer, consisting of a beam splitter 12, a reference beam path with plane reference mirror 13, an object beam path with the object sample 14, and a two-dimensional image sensor 15, capable of demodulating the OCT signals produced by moving the reference mirror 13 along the reference beam path axis. A complete volumetric OCT data set for one selection of light source can therefore be acquired with one scan of the single opto-mechanical scanner that is moving the reference mirror 13. After each scan, the spectrum of the tunable light source is changed, selecting in sequence the three spectral distributions with which the effective spectral system responses that correspond to the CIE tristimulus curves are obtained.


An alternative, non-mechanical depth-scanning mechanism consists of using a fixed relative position of reference mirror and object, and by realizing the depth scanning through a dispersive optical element and electronic scanning of a one- or two-dimensional image sensor in the photodetector device, as known from FD-OCT, and as described for example by R. A. Leitgeb et al. in “Performance of Fourier domain vs. time domain optical coherence tomography,” Optics Express, vol. 11, pp. 889-894, March 2003.


If the axial extent of an object under study is larger than a few ten micrometer, it becomes necessary to adapt the focus of the imaging lens (not shown) used in the OCT setup illustrated in FIG. 3 for imaging one plane of the object 14 onto the plane of the image sensor 15. In the prior art this is achieved by moving the object imaging lens synchronously with reference mirror 13. In a system according to this invention, a true-color, high-speed OCT imaging system with a single opto-mechanical scanner can be realized, as it is schematically described in FIG. 4.


A tunable light source 20 is used, whose emission properties can be electrically controlled, in order to produce three emission spectra S1, S2 and S3. The total spectral system response with these three emission spectra correspond to the three CIE tristimulus curves shown in FIG. 1. The light from the light source 20 is coupled into a multi-mode optical fiber 21, and the collimating lens 22 converts the emitted light into a parallel beam illuminating an optical interferometer, such as a Michelson interferometer, a Mach-Zehnder interferometer, or a Kösters interferometer. The interferometer type used for illustrative purposes in FIG. 4 is a Michelson interferometer, consisting of a beam splitter 23, partitioning the impinging source light beam into a reference beam path, and into an object beam path. The object beam path contains an object imaging lens 31, focusing the incoming light onto a focal plane 30 on or in the object under study, and collecting the reflected or scattered light from the object plane 30 back into the object beam path. In the reference beam path, a plane deflection mirror 24 redirects the light beam in such a way that it is parallel to the light in the object beam path. The light in the reference beam path is then focused by reference imaging lens 27 onto a plane reference mirror 26. The reference mirror 26 and the reference imaging lens 27, as well as the object imaging lens 31 in the object beam path are mounted on the same optical subsystem module 25, which can be moved axially by a single opto-mechanical scanner, as indicated by the double arrow. The distance from the beam splitter 24 to the reference mirror 26 is equal to the distance from the beam splitter 24 to the object focus plane 30. If the object imaging lens 31 is identical to the reference imaging lens 27, the geometrical displacement of the measurement focus in the object beam path is equal to the change in optical length in the reference beam path, thus giving the OCT apparatus dynamic coherent focus over the full scanning distance with a single opto-mechanical scanner.


It is also possible to use different lenses 27 and 31, while still obtaining dynamic coherent focus, by placing a compensation plate 28 in the reference beam path on the optical subsystem module 25. The properties of this compensation plate are chosen such that it provides for identical thicknesses and refractive properties in the reference as well as in the object beam path.


The beam splitter 23 recombines the reflected light from the reference beam path and the object beam path to a detection beam path, where the interfering light is focused with an detector imaging lens 33 onto the plane of a image sensor 34. As described above, the OCT image sensor 34 is capable of demodulating separately for each pixel the incident light, which is temporally modulated according to the axial movement of the optical subsystem module 25.


The average size of the speckles in the image sensor plane 34 varies as a function of the optical aperture 32 in the detection beam path. For optimum contrast, the average speckle size should be in the range of the effective photosensitive area of the single detector pixels. As a consequence, the aperture 32 should be chosen such that the average speckle size has optimum size. Since all components determining the optical magnification of the OCT microscope are contained in the optical subsystem module 25, a different value of the optical magnification can be realized by simply replacing one module 25 for another module 25, having a different set of lenses 31 and 27. All other parts of the OCT microscope according to the present invention are not affected.


If the object under study reflects or scatters only a small amount of light back into the interferometer, the light from the reference beam path should be correspondingly reduced, in order to improve the contrast of the detected signal in the sensor plane 34. A neutral density plate 29 arranged in the reference beam path can achieve this. The transmission ratio of said neutral density plate 29 must be chosen in way that results in optimum signal contrast for different types of objects.


If the average propagation speed of the light in the object volume under study is differing significantly for the three spectral distributions S1, S2 and S3 of the tunable light source, i.e. if the refractive index n(λ) shows significant variation as a function of the wavelength λ, the effect of optical dispersion will become manifest: The three depth scans measured with the three illumination spectra S1, S2 and S3 will exhibit a different depth scale. This is illustrated in the left part of FIG. 5, showing experimental depth measurement data M1, M2 and M3 for a single lateral position, corresponding to the three sequential depth scans with illumination spectra S1, S2 and S3. Applying known pattern recognition techniques, as described for example by S. Theodoridis et al., “Pattern Recognition”, Academic Press 2003, San Diego, chapters 7 (Feature Generation II) and 8 (Template Matching), pp. 269-349, salient signal features that correspond to the same scattering or reflecting element of the object are identified in the three measurements M1, M2 and M3. In the simplest case, where the refractive index is changing abruptly from a first value to a second one (step function), the resulting signal feature in the three measurements will consist of the envelope of the autocorrelation function of the corresponding spectral distribution of the tunable light source. Since that function is precisely known, occurrences of it in the measured signals can be determined reliably.


Once the corresponding salient signal features in three measurements M1, M2 and M3 have been determined, the different coordinate segments of the depth axis z of the three data sets are adapted to each other, so that the salient signal features in the three measurements coincide, as indicated on the right side of FIG. 5. The simplest method to carry out this step consists of the following technique: The first measurement M1 is employed as the reference data set. For each of the two other measurements M2 and M3, the different coordinate sections of the depth axis, i.e. the segments between salient points, are stretched or compressed linearly, so as to let the salient signal points of the two measurements M2 and M3 with the distorted depth axis coincide with the salient signal points of the reference measurements M1. In this way an identical depth scan axis for the three measurements can be established, effectively correcting the effect of optical dispersion.


A further problem of prior art optical microscopy can be successfully addressed by a microscopy system according to the invention: In the presence of absorbing layers whose characteristics depend on the wavelength and the depth coordinate, it has not been possible until today to obtain a true-color volumetric representation of a microscopic scene. This problem is illustrated in FIG. 6, showing a structure of light absorbing layers 40, 41 and 42 with uniform absorption characteristics, as well as a few reference objects 43 with known spectral reflectance performance: Their absolute optical reflectance factors R1, R2 and R3 for the three illumination spectra S1, S2 and S3 of the tunable light source are known. The light arriving at the depth plane in which these objects lie (shown as dashed line in the figure) has been filtered by the multitude of layers on top of the particular object. Thus an unknown amount of the light has been absorbed. The light is reflected by the object, and is transmitted again through the same layers with their unknown absorption characteristics. Since the emitted light power P1, P2 and P3 is known for each of the illumination spectra S1, S2 and S3 of the tunable light source, the actually measured signal Mi=Pi·Ri·Ai (i=1 . . . 3) can be used to calculate the total attenuation coefficients A1, A2 and A3 for the depth plane in which the known reference objects are located, by the formula Ai=Mi/(Pi·Ri), (i=1 . . . 3). With the assumption that the object consists of homogeneous layers with constant properties in the lateral direction, it becomes possible to correct the color measurement data in the whole measurement volume, and this correction is colorimetrically accurate in all planes in which reference objects are located.









TABLE 1







Tristimulus curves x, y, z












Wave-






length
x
y
z



[nm]
[a.u.]
[a.u.]
[a.u.]







380
0.001
0.000
0.007



385
0.002
0.000
0.011



390
0.004
0.000
0.020



395
0.008
0.000
0.036



400
0.014
0.000
0.068



405
0.023
0.001
0.110



410
0.044
0.001
0.207



415
0.078
0.002
0.371



420
0.134
0.004
0.646



425
0.215
0.007
1.039



430
0.284
0.012
1.386



435
0.329
0.017
1.623



440
0.348
0.023
1.747



445
0.348
0.030
1.783



450
0.336
0.038
1.772



455
0.319
0.048
1.744



460
0.291
0.060
1.669



465
0.251
0.074
1.528



470
0.195
0.091
1.288



475
0.142
0.113
1.042



480
0.096
0.139
0.813



485
0.058
0.169
0.616



490
0.032
0.208
0.465



495
0.015
0.259
0.353



500
0.005
0.323
0.272



505
0.002
0.407
0.212



510
0.009
0.503
0.158



515
0.029
0.608
0.112



520
0.063
0.710
0.078



525
0.110
0.793
0.057



530
0.166
0.862
0.042



535
0.226
0.915
0.030



540
0.290
0.954
0.020



545
0.360
0.980
0.013



550
0.433
0.995
0.009



555
0.512
1.000
0.006



560
0.595
0.995
0.004



565
0.678
0.979
0.003



570
0.762
0.952
0.002



575
0.843
0.915
0.002



580
0.916
0.870
0.002



585
0.979
0.816
0.001



590
1.026
0.757
0.001



595
1.057
0.695
0.001



600
1.062
0.631
0.001



605
1.046
0.567
0.001



610
1.003
0.503
0.000



615
0.938
0.441
0.000



620
0.854
0.381
0.000



625
0.751
0.321
0.000



630
0.642
0.265
0.000



635
0.542
0.217
0.000



640
0.448
0.175
0.000



645
0.361
0.138
0.000



650
0.284
0.107
0.000



655
0.219
0.082
0.000



660
0.165
0.061
0.000



665
0.121
0.045
0.000



670
0.087
0.032
0.000



675
0.064
0.023
0.000



680
0.047
0.017
0.000



685
0.033
0.012
0.000



690
0.023
0.008
0.000



695
0.016
0.006
0.000



700
0.011
0.004
0.000



705
0.008
0.003
0.000



710
0.006
0.002
0.000



715
0.004
0.002
0.000



720
0.003
0.001
0.000



725
0.002
0.001
0.000



730
0.001
0.001
0.000



735
0.001
0.000
0.000



740
0.001
0.000
0.000



745
0.001
0.000
0.000



750
0.000
0.000
0.000



755
0.000
0.000
0.000



760
0.000
0.000
0.000



765
0.000
0.000
0.000



770
0.000
0.000
0.000



775
0.000
0.000
0.000



780
0.000
0.000
0.000










LIST OF REFERENCE SYMBOLS






    • 1, 2, 3 Broad band light source


    • 4 Beam splitter


    • 5 Reference mirror


    • 6 Sample object


    • 7 Photo sensor


    • 10 Tunable light source


    • 11 Multi-mode optical fiber


    • 12 Beam splitter


    • 13 Reference mirror


    • 14 Sample object


    • 15 Photo sensor


    • 20 Tunable light source


    • 21 Multi-mode optical fiber


    • 22 Collimating lens


    • 23 Beam splitter


    • 24 Deflection mirror


    • 25 Optical subsystem module


    • 26 Reference mirror


    • 27 Reference imaging lens


    • 28 Compensation plate


    • 29 Neutral density plate


    • 30 Object plane


    • 31 Object imaging lens


    • 32 Optical aperture


    • 33 Detector imaging lens


    • 34 Photo sensor


    • 40, 41, 42 Absorbing layer


    • 43 Reference object




Claims
  • 1. A calorimetric optical coherence tomography microscopy apparatus for recording three-dimensional images of optically translucent or reflective sample objects, comprising a broadband light source, and an interferometric optical setup for detecting a three-dimensional image of an optically translucent or reflective object, characterized in thatthe broadband light source is a tunable light source that is able to produce light over the complete visual spectrum.
  • 2. The microscopy apparatus according to claim 1, characterized in that the tunable light source is arranged to emit in sequence light with three different spectra, wherein the spectra are such that an effective spectral distribution of the light detected is proportional to the CIE tristimulus curves x, y and z or a linear combination thereof, if an object with spectrally constant, white reflectance is employed as the sample object.
  • 3. The microscopy apparatus according to claim 1, characterized in that the interferometric optical setup for detecting three-dimensional images of an optically translucent or reflective object comprisesa beam splitter, arranged to split up a collimated beam of light produced by the broadband light source into a reference beam and an object beam, and arranged to recombine the reference beam and the object beam to a detection beam;a movable, planar reference mirror, arranged to reflect said reference beam back to the beam splitter;a movable object imaging lens; arranged to focus said object beam to an object focus plane, and to collimate light reflected from said object focus plane back to the object light beam;actuator means for synchronously moving the reference mirror and the object imaging lens;a photo sensor, able to convert incident light to an electric current signal; anda detector imaging lens, arranged to focus the detection beam coming from the beam splitter to the photo sensor.
  • 4. The microscopy apparatus according to claim 3, characterized in that the apparatus comprisesone or more planar deflection mirrors that are arranged to deflect the reference beam and/or the object beam exiting the beam splitter in such a way that the reference beam and the object beam are oriented parallel to each other; anda movable reference imaging lens, arranged to focus the reference beam coming from the beam splitter to the plane of the reference mirror;
  • 5. The microscopy apparatus according to claim 3, characterized in that the photo sensor is a two-dimensional image sensor with a plurality of pixel elements.
  • 6. The microscopy apparatus according to claim 5, characterized in that the pixel elements of the two-dimensional image sensor are able to individually demodulate the detected signal.
  • 7. The microscopy apparatus according to claim 3, characterized in that the reference imaging lens, and the object imaging lens have identical optical properties and geometric dimensions.
  • 8. The microscopy apparatus according to claim 3, characterized in that one or more compensation plates are placed in the reference beam and/or the object beam, in a fixed position in relation to the reference mirror, the reference imaging lens, and the object imaging lens, wherein the one and more compensation plates correct for differences in the optical properties and geometric dimensions of the reference imaging lens, and the object imaging lens, so that the total effective thickness and the refractive properties of the materials in both the reference beam path and the object beam path are identical.
  • 9. The microscopy apparatus according to claim 3, characterized in that the reference mirror, the reference imaging lens, and the object imaging lens are arranged in an exchangeable cartridge.
  • 10. The microscopy apparatus according to claim 3, characterized in that a compensation plate is placed in the object beam, in a fixed position in relation to the object imaging lens, and that the compensation plate and the object imaging lens are arranged in an exchangeable cartridge.
  • 11. The microscopy apparatus according to claim 1, characterized in that the tunable light source is a tunable monochromatic light source with electronically changeable and controllable frequency.
  • 12. The microscopy apparatus according to claim 1, characterized in that the apparatus is a time encoded frequency domain OCT apparatus, and the relative displacement of the optical signals from the reference beam path and the object beam path is realized using a tunable monochromatic light source, whose frequency can be changed and controlled electronically.
  • 13. A method for recording three-dimensional color images of optically translucent or reflective sample objects, using an optical coherence tomography technique with a microscopy apparatus according to claim 1, characterized in thatdispersion effects caused by different effective propagation velocities of different illumination light spectra are corrected bycarrying out a multitude of depths scans with illumination light having different spectra;identifying salient features in the different depth scans, originating from the same optical structures in the object; andadjusting the depth scan axes of the different depth scans, so that the corresponding salient features in the different depth scans coincide.
  • 14. The method according to claim 13, wherein three depth scans are carried out.
  • 15. A method for recording three-dimensional color images of optically translucent or reflective sample objects, using the optical coherence tomography technique, particularly using a microscopy apparatus according claim 1, characterized in thatabsorption effects in a sample volume caused by homogeneous layers oriented perpendicular to the depth scan axis with unknown absorption characteristics are corrected byarranging one or more reference objects with known spectral reflectance characteristics in different depths in the sample volume;obtaining the effective total attenuation coefficients of the distinct object planes, in which the reference objects are situated, by dividing a detector signal corresponding to the light reflected by one single reference object by the product of the optical reflectance ratio of said single reference object and the emitted light power; andapplying the obtained effective attenuation coefficients for correcting a three-dimensional color image of the sample object.
  • 16. The method according to claim 15, wherein separate effective total attenuation coefficients are obtained for different applied illumination light spectra.
  • 17. The microscopy apparatus according to claim 2, characterized in that: the interferometric optical setup for detecting three-dimensional images of an optically translucent or reflective object comprisesa beam splitter, arranged to split up a collimated beam of light produced by the broadband light source into a reference beam and an object beam, and arranged to recombine the reference beam and the object beam to a detection beam;a movable, planar reference mirror, arranged to reflect said reference beam back to the beam splitter;a movable object imaging lens; arranged to focus said object beam to an object focus plane, and to collimate light reflected from said object focus plane back to the object light beam;actuator means for synchronously moving the reference mirror and the object imaging lens;a photo sensor, able to convert incident light to an electric current signal; anda detector imaging lens, arranged to focus the detection beam coming from the beam splitter to the photo sensor; the apparatus comprisesone or more planar deflection mirrors that are arranged to deflect the reference beam and/or the object beam exiting the beam splitter in such a way that the reference beam and the object beam are oriented parallel to each other; anda movable reference imaging lens, arranged to focus the reference beam coming from the beam splitter to the plane of the reference mirror;
  • 18. A method for recording three-dimensional color images of optically translucent or reflective sample objects, using an optical coherence tomography technique with a microscopy apparatus according to claim 17, characterized in that: dispersion effects caused by different effective propagation velocities of different illumination light spectra are corrected bycarrying out a multitude of depths scans with illumination light having different spectra;identifying salient features in the different depth scans, originating from the same optical structures in the object;adjusting the depth scan axes of the different depth scans, so that the corresponding salient features in the different depth scans coincide; and
  • 19. A method for recording three-dimensional color images of optically translucent or reflective sample objects, using an optical coherence tomography technique with a microscopy apparatus according to claim 12, characterized in that: dispersion effects caused by different effective propagation velocities of different illumination light spectra are corrected bycarrying out a multitude of depths scans with illumination light having different spectra;identifying salient features in the different depth scans, originating from the same optical structures in the object;adjusting the depth scan axes of the different depth scans, so that the corresponding salient features in the different depth scans coincide; and
  • 20. A method for recording three-dimensional color images of optically translucent or reflective sample objects, using the optical coherence tomography technique, particularly using a microscopy apparatus according to claim 17, characterized in that: absorption effects in a sample volume caused by homogeneous layers oriented perpendicular to the depth scan axis with unknown absorption characteristics are corrected byarranging one or more reference objects with known spectral reflectance characteristics in different depths in the sample volume;obtaining the effective total attenuation coefficients of the distinct object planes, in which the reference objects are situated, by dividing a detector signal corresponding to the light reflected by one single reference object by the product of the optical reflectance ratio of said single reference object and the emitted light power; andapplying the obtained effective attenuation coefficients for correcting a three-dimensional color image of the sample object; and
  • 21. A method for recording three-dimensional color images of optically translucent or reflective sample objects, using the optical coherence tomography technique, particularly using a microscopy apparatus according to claim 12, characterized in that: absorption effects in a sample volume caused by homogeneous layers oriented perpendicular to the depth scan axis with unknown absorption characteristics are corrected byarranging one or more reference objects with known spectral reflectance characteristics in different depths in the sample volume;obtaining the effective total attenuation coefficients of the distinct object planes, in which the reference objects are situated, by dividing a detector signal corresponding to the light reflected by one single reference object by the product of the optical reflectance ratio of said single reference object and the emitted light power; andapplying the obtained effective attenuation coefficients for correcting a three-dimensional color image of the sample object; and
Provisional Applications (1)
Number Date Country
60839424 Aug 2006 US