1. Field of the Invention
The invention relates to a microscope device comprising an electronic two-dimensional sensor (charge coupled device (CCD) or CMOS)) for observing a moving specimen and to a corresponding observation method. The invention also relates to an incoherent microscope illumination arrangement having maximized brightness.
2. Description of Related Art
If one wishes to analyze a moving specimen by using a conventional microscope device, one encounters the problem that the specimen moves also on the detector and hence the image of the specimen would “blur” in space for longer exposure times. In order to avoid such problem, it is known to use so-called TDI (Time Delayed Integration) methods, wherein during exposure a row-wise charge displacement occurs on the image sensor chip, which displacement has to be exactly synchronized with the velocity of the specimen.
Longer exposure times are required in particular for investigations using fluorescence analysis, since the signals measured therein are small, and for achieving a good signal to noise ratio many exciting photons are required. If these photons are applied during a too short time period (for example by stroboscope illumination), the required photon flux densities cause secondary photochemistry and hence result in damage of the specimen. Therefore, in most cases stationary specimens are investigated by means of the microscope, and the excitation energy is distributed over longer time periods.
However, a continuously moved specimen always is beneficial in case that high specimen throughput is important. For example, cell-based screening assays can be significantly accelerated by using a continuously moving specimen. Moreover, the cells, which suffer from the acceleration forces occurring in the usual “top and go”-operation, are spared. Such devices are described, for example, in Netten et al. (1994) Bioimaging, Vol. 2, No. 4, pages 184-192.
From US 2001/012069 A1, U.S. Pat. No. 6,545,265 B1 and DE 102 06 004 A1 microscope devices are known, wherein moving specimens are investigated by using TDI sensor chips and wherein the microscope is designed for obtaining confocal images. Confocal microscopes usually are designed such that the excitation light passes through a mask which is imaged onto the specimen, and the light collected by the objective likewise passes through a mask prior to impinging on the detector. The mask arranged in the image beam path may be a separate mask, or it may be the same mask as the mask arranged in the illumination beam path. Thereby it can be prevented that light which does not originate in the focal plane of the objective reaches the detector, since such light is not imaged onto the mask arranged in the image beam path. Thereby a certain depth resolution of the microscope can be achieved.
Since a confocal microscope does not allow to illuminate the entire specimen at the same time (illumination takes place only at the bright spots of the illumination pattern generated by the mask arranged in the illumination beam), the illumination pattern has to be moved relative to the specimen in order to image the entire specimen. According to US 2001/012069 A1 and DE 102 06 004 A1, to this end the specimen is moved relative to the microscope objective, while the illumination pattern is stationary with regard to the microscope. The TDI sensor chip serves to compensate the movement of the specimen in order to maintain sufficient lateral resolution. The relative movement between the illumination pattern and the specimen, however, occurs in such a manner that each point of the specimen is illuminated exactly for the same time period. Such an embodiment is also described in U.S. Pat. No. 6,545,265 B1, wherein in addition an alternative embodiment is described, wherein the specimen is fixed in space and the illumination pattern is moved across the specimen by moving the mask. This mask also serves as a confocal aperture for the image beam path. Since the specimen in this case does not move on the detector, no TDI sensor ship is required.
From U.S. Pat. No. 6,310,687 B1 a method for wide field illumination of a specimen moving relative to the microscope is known, wherein it is ensured by a corresponding mechanical design of the microscope that the illumination beam and the image beam exactly follow the moving specimen. Due to this follow-up movement the specimen is imaged onto the detector in a stationary manner, so that no TDI sensor is required.
Detectors which have been manufactured specifically for TDI operation with variable row shift frequency usually are optimized for illumination modes which involve high photon flux densities. Hence, such detectors usually have a larger reading noise than detectors, which are optimized for low-light fluorescence measurements and the row frequency of which cannot be freely selected.
It is an object of the invention to provide for a microscope device and a method for observing a moving specimen, which device and method, respectivly, can be adapted to the given measurement requirements as well as possible.
According to the invention this object is achieved by a microscope device as defined in claims 1 and 2, respectively, and by corresponding methods as defined in claims 18 and 19, respectively.
According to the solution of claims 1 and 18, on the one hand charge shift occurs on the detector and on the other hand the illumination beam path and the image beam path, i.e. the image field illuminated by the light source and imaged onto the detector, are moved during observation relative to the specimen into the direction of the specimen movement by means of the adjustable beam deflection element in such a manner that the velocity of the charge shift acts to exactly compensate the movement of a point of the specimen on the detector. This is beneficial in that a very high flexibility is achieved in that the velocity of the charge shift (“TDI velocity”), unlike in the prior art, has no longer to exactly correspond to the specimen velocity, but rather it can be selected essentially freely, since only the sum of specimen movement, adjustment velocity of the beam deflection element and charge shift velocity is fixed. In particular, thereby detectors may be used whose row frequency cannot be freely selected (unlike usual TDI chips whose row frequency can be freely selected), whereby lower reading noise and lower costs can be achieved. Moreover, due to the adjustable beam deflection element it is possible to successively view the same portion of a moving specimen twice or more times, for example, prior to and after addition of a substance to be tested.
The solution according to claims 2 and 19 utilizes the effect that, by making the illumination beam path and the image beam path partially follow the specimen movement, the velocity of the specimen on the detector can be kept so small, irrespective of the velocity of the specimen relative to the objective, that the specimen does not blur within the exposure time required for taking an intermediate image, i.e. that the image of the specimen on the detector moves, for example, for less than half of the width of a diffraction limited row of the detector. Thereby the specimen movement on the detector may be compensated by a corresponding row-wise shift of the intermediate images relative to each other when combining the intermediate images for creating the final image, without a TDI camera being necessary.
According to a second aspect the invention relates to an incoherent illumination arrangement for a microscope requiring structured illumination, in particular for a confocal microscope. In confocal microscopy, as shown, for example, in
When using coherent, i.e. laser, light sources, the reduced exposure time may be compensated by correspondingly increasing the local illumination intensity by using, for example, microlenses, which provide for a concentration (focussing) of the illumination light in the transparent portions of the illumination mask (hereinafter the areas of the illumination mask which are transparent for the illumination light shall be designated, for the sake of simplicity, “openings”, irrespective of whether in these areas the mask material actually is cut through or only is transparent). If the illumination mask is fixed, a simple microlens array (or a cylinder lens array for specimen scanning by means of parallel stripes, (“slit scan” methods)) or a holographic optical element (HOE) is sufficient for concentrating most of the illumination light onto the illuminated portion of the total area, i.e. onto the openings of the illumination mask.
When using incoherent illumination, however, the invariance principle of Lagrange prevents such desired light concentration. This principle means that for each illumination beam path the product of the diameter d1 of the light source and the numerical aperture NA1 of the light collection optics equals the product of the diameter d2 of the illuminated area and the numerical aperture NA2 under which the object is illuminated. In order to be able to illuminate, under a microscope objective having a numerical aperture of 1.2, a spot having a diameter of 0.2 mm, one hence needs a luminous area having a diameter of 3×0.2=0.6 mm, if the collector optics used has a numerical aperture of 1.2/3=0.4.
It is an object of the invention to provide for an illumination arrangement for a microscope requiring structured illumination, in particular for a confocal microscope, comprising an incoherent light source, wherein a local luminous flux as high as possible should be achieved.
According to the invention, this object is achieved by an illumination arrangement as defined in claim 25.
According to this solution the optical arrangement used for imaging the light source onto the illumination mask comprises a plurality of microelements effecting focussing at least in one direction, wherein each opening of the mask is specifically associated with one of the microelements and wherein the optical arrangement is designed for imaging exclusively an area of highest luminous flux of the light source into the respective opening. Thereby it is enabled to choose only the brightest part of an incoherent light source having strongly inhomogeneous brightness for illuminating the specimen, whereby a luminous flux can be achieved in the illumination pattern which is much higher than that which can be achieved with a mask under wide field illumination.
The brightest available incoherent light sources are arc lamps having a luminous area of a diameter of about 0.6 to 2 mm. However, in the luminous area there is no homogenous intensity distribution, rather there is a much brighter “hot spot” very close to one of the two electrodes, with the intensity decreasing in all directions with increasing distance to this “hot spot”. The invention allows to use exclusively the hot spot for illumination by imaging only the hot spot into the illumination openings of the illumination mask, but not the darker area of the arc surrounding the hot spot.
Whereas in case of wide field illumination a more extended field has to be illuminated and to this end also light from darker regions of the arc has to be used, according to the invention, wherein the specimen surface does not have to be illuminated homogeneously, but rather only in portions thereof, illumination modes can be realized by means of optical elements, such as a microlens array, which use the principle of a fly's eye, according to which illumination modes the specimen is illuminated in parallel by many images of the arc, with only the hot spot being used for this purpose.
These and further objects, features and advantages of the present invention will become apparent from the following description when taken in connection with the accompanying drawings which, for purposes of illustration only, show several embodiments in accordance with the present invention.
In
A beam deflection element 26 is arranged between the tube lens 24 and the objective 10 in or close to a plane conjugated with regard to the objective pupil, which beam deflection element 26 is adjustable in order to move the image field 30, which is illuminated by the excitation light 14 and which is imaged by the microscope onto a detector 28, relative to the specimen 12. The beam deflection element 26 may be, for example, a plane mirror which is rotatable around an axis 32. The imaging of the image field 30 onto the detector 38 is achieved by means of the microscope objective 10, the deflection element 26, the tube lens 24, the lens 20 and an additional lens 34 arranged between the beam splitter 18 and the detector 28. Thereby the light collected by the objective 10 from the specimen 12 also passes through the mask 22, which acts as a confocal aperture for the image beam path. In the example shown the beam splitter 18 is transparent for the light emitted by the specimen, whereas it reflects the excitation light. However, of course, also the reverse configuration is possible. The illumination pattern generated by the mask 22 may be, for example, a line pattern or a spot pattern. The detector 28 may be, for example, a CCD chip capable of shifting the charges, during taking of an image, in a row-wise manner at a velocity which may be selected at least within a certain range. All elements of the microscope device, in particular also the mask 22, are stationary, except for the deflection element 26 and the specimen 12.
By using a fixed mask 22—in contrast to confocal microscopes using linearly movable or rotating masks (Nipkow technology, see, for example DE 198 24 460 A1)—methods for increasing the local luminous flux are simplified.
In
According to the invention, the microscope device is designed and operated in such a manner that, as illustrated in
In order to avoid blurring of the image of the specimen on the detector 28 when taking an image, the charge may be shifted, when using a TDI camera as the detector 28, row-wise at a velocity Vc=Vd into the same direction. In order to obtain an image of the specimen which is not blurred the condition Vc=Vs−Vp has to be fulfilled, i.e. the velocity of the specimen, the adjustment velocity of the beam deflection element and the charge shift velocity have to be selected such that the velocity of the charge shift compensates for the movement of a point 12A of the specimen 12, which is imaged onto the detector 28, on the detector 28. Since the choice of the adjustment velocity of the deflection element 26 usually does not have to comply with specific limitations, the specimen velocity and the charge shift velocity may be chosen relatively freely corresponding to the choice of the adjustment velocity of the beam deflection element 26, wherein nevertheless a clear image of the specimen is made possible. In particular, a detector 28, for example, may be chosen, which allows for setting the charge shift velocity only at relatively coarse steps or within relatively narrow range.
Also, a relatively high specimen velocity may be chosen irrespective of the imaging requirements in order to achieve a high throughput, since, by a corresponding almost complete follow-up movement of the image field 30, still a relatively low velocity Vd of the movement of the specimen across the detector 28 can be realized. Moreover; the adjustment of the deflection element 26 may be used to successively take an image of the same portion of the specimen 12 twice or more times, for example, prior to and after adding a substance to be tested.
Rather than compensating, as described above, the movement of the image of the specimen 12 on the detector 28 by corresponding charge shift by the detector 28 which is designed as a TDI camera, according to a modified embodiment of the invention a two-dimensional detector without TDI charge shift capacity may be used by reading sequentially intermediate images out of the detector 28 during observation, wherein only the illuminated zones (rows) are read out, while the intermediate non-illuminated regions (rows) are binned and are thrown away. A number of such intermediate images may be combined as a final image by relative row-wise shift of the intermediate images, if the specimen velocity, the adjustment velocity of the beam deflection element and the relative row-wise shift are selected such that in the final image the relative row-wise shift acts to compensate the movement of a specimen point, which is imaged onto the detector, on the detector. This method utilizes the effect that, by providing for a partial follow-up movement of the illumination beam path and the image beam path with regard to the specimen movement, the specimen velocity on the detector can be kept so small, irrespective of the velocity of the specimen with regard to the objective, that the image of the specimen does not blur within the exposure time required for taking an intermediate image, i.e. that the image of the specimen on the detector, for example, does not move for more than half of the width of a row (typically the spatial resolution, i.e. the width of a row, of the detector 28 is on the order of the diffraction limitation).
According to all variants, when taking an image of the specimen (i.e. when taking a TDI image or a final image composed of intermediate images) the pattern has to move for at least one period of the pattern (usually the illumination pattern is periodic) relative to the specimen 12, in order to ensure that all specimen points in the illuminated area have been illuminated for the same time period (in the case in which a final image is composed of intermediate images, for example, 20 intermediate images may be taken per period of the pattern (i.e. during the time which is required by a specimen point for passing through one period of the specimen 20 intermediate images are taken)). In general, during the time when an image is taken the pattern should move by a distance relative to the specimen 12 which corresponds to the period length or to an integer multiple of the period length).
The arrangement of
As already mentioned, the movement of the image of the specimen 12 on the detector 28 has to be relatively slow, namely so slow that during the exposure time necessary for an intermediate image no significant blurring of the image of the specimen 12 on the detector 28 occurs. Since this relative velocity may be adjusted relatively freely by means of the deflection element 26, despite the required relatively slow relative velocity a high specimen velocity may be realized for achieving high throughput. As already mentioned, the final image is then assembled from the intermediate images, wherein the shift of the image of the specimen on the detector is correspondingly corrected when reconstructing the image.
In
The microlenses 58 are designed according to the geometry of the openings 60. For example, if the openings 60 are (circular) holes, the microlenses 58 are lenses which focus in both dimensions, or, if the openings 60 are slits, the microlenses 58 are cylindrical lenses, i.e. lenses which focus only in one dimension. In any case, the microlenses 58 are adjusted to the openings 60.
According to the arrangement shown in
Imaging of the arc 62 may be chosen, for example, in such a manner that only 10% to 30% of the area between the two electrodes 51 and 53 is imaged into the opening 60, with this area starting at the hotter electrode 53.
The arrangement shown in
This can be avoided by providing for a spatial filter already before the microlens arrangement 54, so that only the illumination light originating in the area 64 of maximal luminous flux is utilised for the collimated illumination beam impinging on the microlens arrangement 54, i.e. the (collector) optics 52 is designed such that it blocks, in the light collimated onto the microlens arrangement 54, light originating in the surroundings of the area 64 of maximal luminous flux. This can be achieved, for example, by generating an intermediate image of the luminous area 62 by means of the collector optics 52, with an aperture being provided in the intermediate image plane for blocking light originating in the surroundings of the area 64 of maximal luminous flow. Preferably, a light-guide is used as such aperture, which then in addition may serve to separate the (hot) location of the generation of light from the microlens arrangement 54.
In general, the shown type of incoherent illumination is suitable not only for stationary but also for moving microelements and masks, respectively, i.e. so-called Nipkow-systems.
The entrance slit 70—and hence the hot spot 64—is imaged onto the light entrance surface 76 of a light-guide rod 78 by means of an optical arrangement 72 comprising an element 74 which acts in a dispersive manner in the direction perpendicular to the paper plane of
Thus the light entrance surface 76 of the light-guide rod 78 replaces the exit slit of the monochromator 66. Along the direction of the height h the intensity distribution of the hot spot 64 is maintained when entering into the light guide rod 78, whereas the image of the hotspot 64 is spectrally “blurred” along the direction of the width b, wherein the spectral distribution along the direction of the width b is determined by the geometry of the monochromator 66 and the type of the dispersive element 74. When the light reaches the light exit surface 80 of the light-guide rod 78, the wavelength received over the width b of the light entrance surface 76 have been mixed so far that the light exit surface 80 is illuminated in an essentially homogeneous manner.
The height of the light exit surface 80 is imaged onto a mask 56 having openings 60 by means of a cylinder lens 82 and a cylindrical microlens array 54, which imaging occurs in a manner analogue to that shown in
In total, the imaging optics is designed in such a manner that the light exit surface 80 is imaged by means of crossed cylinder optics into an intermediate image plane in such a manner that the dimension along the direction of the width b is imaged only once, whereas the dimension along the direction of the height h is imaged multiple times, as described above.
The entrance slit 70 is imaged onto the opening 60 of a mask 56 by means of an optics 90 comprising an element 74 acting as a dispersive element along the direction of the beams shown in
When using such an arrangement, a much lower dispersion is required compared to an arrangement wherein the exit slit serves to illuminate the entire object field. Thus, rather than using a diffraction grating, a dispersion prism may be used as the dispersive element 74, having a wavelength-independent efficiency of almost 100%, wherein the dispersion prism may be manufactured by combining different types of glass having approximately liner dispersion, if, as in this case, only low dispersion is necessary. By rotating the prism 74 or by changing the angle at which the light passes through the prism 74, the wavelength of the light passing through the slits 60 of the illumination mask 56 may be adjusted continuously.
It is to be understood that the masks 56 of the embodiments of
While various embodiments in accordance with the present invention have been shown and described, it is understood that the invention is not limited thereto and is susceptible to numerous to numerous changes and modifications as known to those skilled in the art. Therefore, this invention is not limited to the details and described therein, and includes all such changes and modifications as encompassed by the scope of the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
10 2007 009 550.5 | Feb 2007 | DE | national |