Patent Application
20190369376
The present application claims priority benefit of German Application No. DE 10 2018 113 208.5 filed on Jun. 4, 2018, the contents of which are incorporated by reference in its entirety.
The present invention relates in a first aspect to a method for operating a light microscope with structured illumination. In a second aspect the invention relates to an optic arrangement for structured illumination in a light microscope.
In a generic method for operating a light microscope with structured illumination, a structuring device produces illumination patterns. The structuring device splits impinging light in at least three coherent beam parts which correspond to a −1., 0. and +1. diffraction order of light.
The structuring device may, for example, have a grating (phase diffraction grating) in an intermediate image plane of the illumination beam path. Light is diffracted at the grating and thus beam parts of a −1., 0. and +1. diffraction order, inter alia, are produced. In the specimen plane, the beam parts interfere and thus produce a structured illumination. Such an illumination pattern in the specimen plane may constitute a grating structure, for example a line structure consisting of alternating bright and dark areas. Several specimen images are recorded with differently rotated lattice vectors of the gratings in the intermediate image plane. As examples, the grating may be rotated to this end, or differently oriented gratings are illuminated one after the other. Furthermore, several microscope images with different phases of the illumination modulation are recorded. For shifting the phase, the grating may be shifted in the intermediate image plane, for example, or a plane-parallel wobble plate near an intermediate image plane may be tilted.
Alternatively the structuring device may comprise a waveguide chip instead of a grating. A waveguide chip is also referred to as a photonic integrated circuit (PIC) and comprises a substrate in which light guide channels are formed. These light guide channels are usually no hollow spaces but differ in the material from surrounding substrate. The waveguide chip comprises at least an input port for light at which impinging light is forwarded and split in the waveguide chip into at least three path sections (light guide channels) which lead to at least three exit ports. One impinging light beam may thus lead to three coherent beam parts which exit at the exit ports and may interfere with each other in the specimen plane. The at least three exit ports and their respective path sections correspond to −1., 0. and +1. diffraction orders of light, i.e., the exit ports may be arranged to form a dot pattern in a pupil plane of the illumination beam path which corresponds to the dot pattern which would be formed in a pupil plane by a grating arranged in an intermediate image plane. Alternatively it is not necessary that the exit ports are arranged in this dot pattern; rather light may be guided from the exit ports via, for example, optical fibers to form said dot pattern in a pupil plane. In a cross-section of the illumination light, the 0. diffraction order is located between the +1. and −1. diffraction orders and may in particular have the same spatial distance to the +1. diffraction order and to the −1. diffraction order.
In the generic method, a plurality of illumination patterns with different phases are provided one after the other. To this effect, different phase shifts for the beam parts are set with phase shifters. At least one microscope image is recorded for each of the illumination patterns and then the microscope images are used to calculate a high resolution image.
Via different input ports of the waveguide chip, differently oriented illumination patterns can be generated, wherein different phases of the illumination patterns are respectively set with the phase shifters.
The calculated high resolution image is to be understood as an image which is calculated from the plurality of microscope images. As it includes information from all microscope images, it is referred to as high resolution, which, however, shall not be construed as any specification of an image resolution.
Analogously, a generic optic arrangement for structured illumination comprises a structuring device which splits impinging light in at least three coherent beam parts which correspond to −1., 0. and +1. diffraction orders of light, respectively. In particular, the structuring device may comprise a waveguide chip, comprising at least an input port followed by a light guide path which forks into at least three path sections which in turn lead to at least three exit ports of the waveguide chip. Two outer exit ports and their respective path sections are, in short, referred to as “(corresponding to) a −1. and +1. diffraction orders of light”. This shall illustrate that light beams emanating from the outer exit ports may correspond to the −1. diffraction order and the +1. diffraction order of light diffracted at a grating. A respective central exit port which is situated between the two outer exit ports and its respective path section is referred to as corresponding to a 0. diffraction order due to its central arrangement of the exit port. The waveguide chip further comprises a respective phase shifter at each path section for shifting a phase of light in these path sections.
Generic methods and optic arrangements for structured illumination are described by the applicant in DE 10 2017 109 645.0. Another optic arrangement with waveguide chip is furthermore described by the applicant in WO 2014/060270 A2.
A difficulty resides in providing sufficiently large phase shifts steadily, precisely and efficiently. These challenges are hard to overcome with, in particular, phase shifters arranged at a waveguide chip. With thermal phase shifters, for example, sufficiently large temperature differences need to be set at the path sections of the waveguide chip. Even if this succeeds, the problem remains that the considerable temperature differences may possibly result in no stable phase variation of a desired size. Also with other phase shifters, for example piezoelectric phase shifters, difficulties arise, in particular in material stress caused by the comparably strong piezoelectric expansion and compression, and in possibly occurring hysteresis in which the material remains partially deformed even if the setting is changed back to an initial value.
Another optic arrangement for providing a structured illumination is described in US2013/0335819A1. Differences over this document are addressed in a later section.
It may be regarded as an object of the invention to indicate a method and an optic arrangement which provide a structured illumination for a light microscope, wherein a phase of illumination patterns can be varied in a simple and efficient way.
Various example embodiments relate to methods for operating a light microscope with structured illumination. One such method includes: providing illumination patterns by means of a structuring device which splits impinging light into at least three coherent beam parts which correspond to a −1., 0. and +1. diffraction orders of light. Different phases of the illumination patterns are caused by setting different phase values for the beam parts with phase shifters. The phase shifters are not only provided for the beam parts of the −1. and +1. diffraction orders but also for the beam part of the 0. diffraction order. At least two different phase values Φ0 are set with the at least one phase shifter for the 0. diffraction order to provide a plurality of illumination patterns with different phases. At least one microscope image per illumination pattern is recorded. A high resolution image is then calculated from the recorded-microscope images.
Another set of example embodiments relate to an optic arrangement for structured illumination in a light microscope. The optic arrangement has a structuring device configured to split impinging light in at least three coherent beam parts which correspond to a −1., 0. and +1. diffraction orders of light. The arrangement further includes a plurality of phase shifters configured to shift the phases of the beam parts for setting different phases of illumination patterns. The arrangement also has a control unit configured for setting different phase shifts not only with the phase shifters of the −1. and +1. diffraction orders, but also setting at least two different phase values with the phase shifter or phase shifters belonging to the 0. diffraction order, and calculating the high resolution image from the thus recorded microscope images.
A focus of the invention resides in the way how to set phase shifts of the beam parts that interfere in the specimen plane to form an illumination pattern. The structuring device which splits light into the coherent beam parts may be formed in basically any way. For example, gratings may be used as the structuring device. At the grating, the light is diffracted into a plurality of diffraction orders, wherein these beam parts are spatially separated from each other in a pupil plane or in a region of a pupil plane where they can be modified independently from each other. A beam part is here understood as either a diffraction order of light or a light beam corresponding to a diffraction order. The latter is the case if the structuring device comprises a light splitter instead of a diffractive element; the splitter being configured to split impinging light into a plurality of beam parts. These beam parts may be guided such that their arrangement in a pupil plane forms a pattern that just corresponds to the beam parts of the −1., 0. and +1. diffraction orders of a grating (which grating would be arranged in an intermediate image plane). For example, the structuring device may comprise a waveguide chip which may be designed as described above.
At least one splitter may be integrated in the waveguide chip. After the splitter, the beam parts are guided along respective path sections in the waveguide chip. An optic arrangement with a waveguide chip offers a particularly compact design with a low number of components, or a low number of components moveable relative to each other. However, even without a waveguide chip, splitters may be used, wherein the beam parts are then guided by, e.g., optical fibers and/or mirrors into a desired illumination spot pattern. Furthermore, phase modulators may be used as structuring devices as described in Applicant's yet unpublished applications DE 102018110072, DE 102018110083, DE 102018110109 and DE 10 2018110117. With these phase modulators, the phase is shifted per pixel over the cross-section of a light beam. This may be realized with, e.g., a liquid crystal matrix or a matrix of liftable mirrors. In this way, in the region of a pupil plane, the beam parts are spatially separated from each other and may be modified independently from each other with phase shifters. Depending on the kind of structuring device, also beam parts of higher diffraction orders may occur. Such beam parts of higher diffraction orders may be filtered out and only the beam parts which correspond to the −1., 0. and +1. diffraction orders are guided further towards the specimen plane.
For easier understanding, the following explanations often refer exemplarily to a waveguide chip. It is to be understood that these variants of the invention may also be modified by forming the structuring device without a waveguide chip, for example with gratings, the above-mentioned phase modulators or with splitters and optical fibers.
For easier comprehension of the effects of the invention, a mathematical description of the illumination patterns shall now be given. By means of the waveguide chip or a differently designed structuring device, a plurality of beam parts are produced which interfere with each other in a specimen plane and thus form the illumination pattern. The beam parts correspond to a −1., 0. and +1. diffraction orders which would result from illuminating a grating in an intermediate image plane. It will be shown that the illumination pattern can be described by a first order modulation contrast and a second order modulation contrast, wherein the second order modulation contrast indicates that a periodic intensity variation (a cosine function) changes spatially with double the frequency of the first order modulation contrast. The phase of the second order modulation contrast is described by a phase value Φ1 which is set for the beam part of the +1. diffraction order, and by a phase value Φ−1 which is set for the beam part of the −1. diffraction order. The phase of the first order modulation contrast is not only determined by the phase values Φ1 and Φ−1, but also by a phase value Φ0 that is set for the beam part of the 0. diffraction order. For shifting the phase of the illumination pattern, the invention also uses a certain change of the phase value Φ0. This has the consequence that 01 and 0−1 merely need to be changed to a lesser extent. Thus, with the invention the phase shifters only need to set smaller phase shifts compared with conventional methods. Nevertheless, the same phase shift of the illumination patterns is achieved as in scenarios not falling under the invention in which Φ1 and Φ−1 are strongly varied but Φ0 is constant for all measurements.
For the mathematical description, the electric field vectors E0, E1, and E2 of the three beam parts of the 0., +1. and −1. diffraction orders will now be defined. The vector arrows are omitted in the continuous text. Throughout the following description, the index 2 will indicate the −1. diffraction order:
Here, i is the imaginary t; k1, k2, k0 are the wave number vectors (spatial frequencies), r is the spatial vector, Φ1, Φ2 and Φ0 are the phases, ep,y is the unit vector of the electric field in the y direction for each beam part, ep,z,x,1, ep,z,x,2 and ep,z,x,0 are the unit vectors of the electric field in the x-z plane for the three beam parts; eiδ1, eiδ2 and eiδ0 indicate a phase offset of the electric field in the x-z plane relative to the electric field in the y direction; a b, c, d are amplitudes/constants and conj.comp. indicates the complex conjugate of the whole respectively preceding expression. The imaginary part cancels out due to the sum with conj.comp. and the multiplication with ½. Thus only the real part of the respective electric field remains. The wave number vectors k1, k2, k0 are shown in
Here, ex, ey and ez are the unit vectors in the x, y, and z directions, φ is the angle of the wave number vectors relative to the x axis and λ is the wavelength of the light in the medium. The angle of the wave number vector relative to the y axis θ is 90° (see
{right arrow over (e)}
p,y
=−{right arrow over (e)}
y
{right arrow over (e)}
p,z,x,1=(sin(θ)sin(φ){right arrow over (e)}x−cos(θ){right arrow over (e)}y−sin(θ)cos(φ){right arrow over (e)}z)=sin(φ){right arrow over (e)}x−cos(φ){right arrow over (e)}z
{right arrow over (e)}
p,z,x,2=(sin(θ)sin(φ){right arrow over (e)}x−cos(θ){right arrow over (e)}y−sin(θ)cos(φ){right arrow over (e)}z)=sin(φ){right arrow over (e)}x−cos(φ){right arrow over (e)}z
{right arrow over (e)}
p,z,x,0=sin(θ){right arrow over (e)}x=cos(θ){right arrow over (e)}y={right arrow over (e)}x
The electric field intensity I is proportional to the square of the sum of the electric fields E0, E1, E2 of the three beam parts, wherein the square is determined by multiplication with the complex conjugates E0*, E1*, E2*:
I∝{{right arrow over ({tilde over (E)})}1+{right arrow over ({tilde over (E)})}2+{right arrow over ({tilde over (E)})}0}·{{right arrow over ({tilde over (E)})}1′+{right arrow over ({tilde over (E)})}2′+{right arrow over ({tilde over (E)})}0′}
I∝|{right arrow over ({tilde over (E)})}1|2+|{right arrow over ({tilde over (E)})}2|2+|{right arrow over ({tilde over (E)})}0|2+{right arrow over ({tilde over (E)})}2{right arrow over ({tilde over (E)})}1′+{right arrow over ({tilde over (E)})}0{right arrow over ({tilde over (E)})}1′+{right arrow over ({tilde over (E)})}1{right arrow over ({tilde over (E)})}0′+{right arrow over ({tilde over (E)})}0{right arrow over ({tilde over (E)})}2′+{right arrow over ({tilde over (E)})}2{right arrow over ({tilde over (E)})}0′
The square terms E02, E12, E22 are constants:
|{right arrow over ({tilde over (E)})}1|2=|{right arrow over ({tilde over (E)})}2|2=c2+a2
|{right arrow over ({tilde over (E)})}0|2=b2+d2
Using these constants, the above expression for the electric field intensity I is reworded as:
By using the expression of the wave number vectors k according to
As can be seen, the illumination intensity I comprises two summed modulation terms (cosine functions). The modulation term
in the first row is referred to as second order modulation term since its spatial frequency is double the frequency of the other modulation term, i.e., the first order modulation term reproduced in the second line above and comprising
For recording a plurality of microscope images with different phases of the structured illumination, the phases in the above wave expressions must be varied. For the second order modulation contrast, it is thus necessary to vary the phase offset (Φ1-Φ2). For the first order modulation contrast, it is necessary to consider that two cosine functions are multiplied:
Thus a phase shift may not only be achieved by varying Φ1 and Φ2, it is rather also possible to vary Φ0 in order to achieve a phase shift of the intensity pattern.
With a suitable change of Φ0, the required changes of Φ1 and Φ2 are smaller compared with the case that Φ0 would have the same value for all image recordings.
This finding is used in the invention.
According to the invention, the method of the above-referenced kind does not only employ phase shifters for each of the −1. and +1. diffraction order beam parts. Rather, also at least one phase shifter for each 0. diffraction order beam part is provided. For providing a plurality of illumination patterns of different phases, at least two different phase values for Φ0 are set with the phase shifter for the 0. diffraction order.
The optic arrangement of the above-referenced kind comprises, according to the invention, a control unit configured to set different phase shifts not only with the phase shifters belonging to the −1. and +1. diffraction order beam parts. Rather, also the phase shifter(s) belonging to the 0. diffraction order are used to set at least two different phase values, in particular two phase values varying from each other exactly by π.
Advantageously, by using different phase values Φ0, smaller changes of Φ1 and Φ2 suffice.
Other conventional systems, which do not use a waveguide chip and integrated phase shifters as a structuring device, do not change Φ0 in the way the invention requires. US 2013/0335819 A1, for example, describes a setup for structured illumination in which three beam parts are produced which correspond to a −1., 0. and 1. diffraction order of light. Pivotable transparent plates are used here as phase shifters. The beam parts that correspond to the −1. and 1. diffraction orders are phase shifted with phase shifters as shown in
In some variants of the invention, microscope images may be recorded for which the phase shifter of the 0. diffraction order is set to two different phase values Φ0 which differ from each other by π. As apparent from the above expression for the first order modulation contrast, a change of Φ0 by π leads to a change in the +/− sign of the expression
the reason being, as it is well-known, that a cosine function changes its +/− sign but continues to have the same absolute value when shifted by π. If the whole phase region shall be selectable for the first order modulation contrast, a constant Φ0 would require the phase expression (Φ1−Φ2)/2 in
to be varied over an interval of 2π; instead, the change in the +/− sign due to a change of Φ0 by π results in that the phase expression (Φ1−Φ2)/2 only needs to be varied by 1π in order to cover the whole phase region.
For each of the two phase values of Φ0 of the phase shifter for the 0. diffraction order, which phase values differ from each other by π, (i.e., for each of the two Φ0 values,) different phase shifts (i.e., different phase values/phase settings) may be set with the phase shifters of the −1. and +1. diffraction orders, i.e., different pairs of Φ1, Φ2, wherein in each case a microscope image is recorded. For example, two or more microscope images with the same Φ0 and with different pairs of Φ1, Φ2 may be recorded, and additionally two or more microscope images with Φ0 changed by π and with different pairs of Φ1 and Φ2 are recorded.
As phase shifters, in principle any elements may be used that are adapted to variably change a phase of impinging light. For example, movable/pivotable transparent plates may be arranged in the beam paths of the different beam parts. The phase shifters may also be integrated in the waveguide chip. In this case the phase shifters are provided at the respective path sections that belong to the beam parts of the −1, 0. and +1. diffraction orders. Also a plurality of phase shifters may be consecutively arranged along one and the same path section for easier generation of sufficiently large phase shifts. Thermal phase shifters, piezoelectric phase shifters, electro-optic phase shifters or acousto-optic phase shifters may be used, in particular integrated in a waveguide chip. A thermal phase shifter changes the temperature of a respective path section. Depending on the temperature, the optic path lengths changes and hence the phase is shifted. With a piezoelectric phase shifter, an applied electric voltage extends or compresses the material of the respective path section and thus varies the optical path length. With an electro-optical phase shifter, an electric voltage can be applied at electrodes arranged at the waveguide chip next to a path section, and thus an electric field is produced in the respective path section. This changes the index of refraction in the path section and thus the phase of light running in that path section is shifted. An acousto-optic phase shifter is configured to generate an acoustic wave in the respective path section, whereby an optical path length for the light wave is changed.
For providing the different illumination patterns, the two phase shifters belonging to the −1. and +1. diffraction orders may be changed in opposite directions, starting from a specific operating point. A thermal phase shifter will thus, starting from an operating point of e.g. 200° C., heat the +1. diffraction order path section while the −1. diffraction order path section is cooled/allowed to cool down. Thus Φ1 and Φ2 are changed in opposite directions. The phase of the first order modulation contrast as well as the phase of the second order modulation contrast depend on the difference (Φ1−Φ2). Therefore, the change in opposite directions constitutes an efficient phase change and does not require undue large changes of one of the two values Φ1 and Φ2.
The phase shifters for the −1. and +1. diffraction orders may also be changed in opposite directions, starting from the operating point, such that the resulting phase shifts of Φ1 and Φ2 for the −1. and +1. diffraction orders have the same absolute value but different +/− signs. That means in particular Φ1=−Φ2 or ΔΦ1=−ΔΦ2, wherein ΔΦ1 and ΔΦ2 are the phase shifts relative to phase values Φ1 and Φ2, with which a microscope image is recorded. This not only avoids the problem that unequal changes of the absolute values of Φ1 and Φ2 would require undue large variations of one of the two values in order to cover the whole phase region. Rather, setting Φ1=−Φ2, also has the substantial advantage that in the expression
of the first order modulation contrast, the part (−Φ1−Φ2)/2 is always constant or zero, i.e., in particular
may be true, and thus this cosine term may be varied solely by Φ0; the other parameters of this expression (considered as a whole) remain constant while setting the different phases and recording the microscope images. If now Φ0 is set to either one of two values that differ from each other by π, the +/− sign of this expression changes, and Φ1 and Φ2 are only relevant for the first cosine term of the expression of the first order modulation contrast:
It is easily understood in this expression that the phase (Φ1−Φ2)/2 does not need to be varied by more than 1π to cover the whole phase region if additionally Φ0 is changed by π.
In some variants of the invention, the different illumination patterns are provided by adjusting the phase shifters for the −1. and +1. diffraction orders over an interval in which a phase shift (Φ1−Φ2)/2 of a first order modulation contrast spans at most an interval of π, i.e., in particular, 0≤(Φ1−Φ2)/2≤π. For providing phase shifts of a first order modulation contrast that are larger than π, additionally the phase shifter for the 0. diffraction order changes the phase shift Φ0, in particular Φ0 is varied by π.
All microscope images used to calculate a high resolution image may thus be recorded while different illumination patterns are produced for which the phase shifters belonging to the −1. diffraction order and the +1. diffraction order are adjusted such that always 0π≤(Φ1−Φ−1)/2≤1π is true. As noted above, Φ−1 and Φ2 are synonymously used to indicate the phase shift at the path section for the −1. diffraction order. For providing a phase shift of the first order modulation contrast within an interval corresponding to 1π . . . 2π, now Φ1 and Φ−1 are not varied such that 1π≤(Φ1−Φ−1)/2≤2π would apply. Rather, the phase value Φ0 for the 0. diffraction order is changed by π while the phase shifters for the −1. and +1. diffraction orders are still adjusted such that always 0π≤(Φ1−Φ−1)/2≤1π applies.
Due to the change of Φ0 it suffices if a maximal difference between settings of the phase shifters for the −1. and +1. diffraction orders, i.e.,
a maximal temperature difference between two thermal phase shifters,
a maximal voltage difference between two piezoelectric or electro-optic phase shifters or
a maximal frequency difference between two acousto-optic phase shifters,
is at most as large that (Φ1-Φ−1)/2≤1π is still fulfilled at the maximal difference.
In the following, with reference to a table it is illustrated how the phase shifts according to some embodiments of the invention may be set for allowing to shift the phase over the whole phase region without excessively large changes of Φ1 and Φ−1. In this example, the whole phase region of 2π is covered by five steps, i.e., by the phase steps: 0.2π/5, then 1·2π/5, then 2·2π/5, then 3·2π/5 and finally 4·2π/5. The phase of the first order modulation contrast shall be changed in these steps. According to the above formula, the phase of the second order modulation contrast varies double as fast (i.e., by (Φ1−Φ−1) instead of (Φ1−Φ−1/2) so that the phase steps for the second order modulation contrast are indicated below for covering 4π.
As described above, Φ1 and Φ2 may be varied in opposite directions and by the same absolute values, i.e., such that Φ1=Φ2.
As indicated, for shifting the phase of the first order modulation contrast by, e.g., 1,2·π, the expression
is not varied by 1,2·π but only by 0,2·π. This is compensated by simultaneously varying Φ0 by π. It shall be stressed that Φ0 and the expression
effect different terms and their effects thus do not simply correspond to their sum (see formulas above for the first order modulation contrast). Due to the phase jump of Φ0 by π, any phase shifts with the whole phase region of 2π can be set without the need to set extreme changes with the phase shifters. In particular, it may be provided that Φ0 is only switched between exactly two values which differ from each other by π, for all recorded microscope images.
According to the table above, a phase shift of the first order modulation contrast between 1π and 2π is set by means of a phase shift of Φ0 without changing
by more than 1π.
The teaching of the above table may be generalized to an arbitrary number of n steps instead of 5 steps. The phase region of 2π for the first order modulation contrast or the phase region of 4π for the second order modulation contrast is then divided in n steps which in particular have the same step size.
The microscope images that are taken into calculation to yield a high resolution image may be recorded with two (in particular exactly two) different phase values Φ0 for the 0. diffraction order, which phase values differ from each other by π. Furthermore, also the absolute values of Φ0 may be suitably chosen. Φ0 determines the z plane in which the illumination pattern has a maximal modulation contrast, i.e., a maximal brightness difference between brightest and darkest areas of the pattern. The modulation contrast thus has a z-dependency that is influenced by Φ0. The two absolute values of Φ0 with which the microscope images are recorded may be chosen such that a z-dependent modulation contrast of the illumination pattern has a maximum in a detection plane. The detection plane indicates a plane which is sharply imaged onto a detector/a camera. Generally, absolute values of Φ0 may be used with which the modulation contrast has at least not a minimum; suitable are also absolute values of Φ0 with which the z-dependent modulation contrast is closer to its maximum than to its minimum.
The described variants refer to three diffraction orders, however, this number shall not be construed as an upper limit. Further path sections may also be provided which correspond to other diffraction orders, e.g., a −2. diffraction order and +2. diffraction order. The above statements also apply to those cases. If further diffraction orders are used, ideal numerical values may slightly deviate from the values given herein; nevertheless, advantages can be reached with the values indicated herein.
The description of the −1, 0. and +1. diffraction order beam parts relate to the phase shifts for an illumination pattern in a specific orientation. For calculating the high resolution images, also illumination patterns in other orientations are recorded. Again the described different phase shifts are set. The statements regarding the phase shift of the beam part/path section of the 0. diffraction order thus refer to illumination patterns of the same orientation and are also analogously implemented for other illumination pattern orientations.
The invention also relates to a light microscope with an optic arrangement configured as described above. The described variants of the method shall also be considered as variants of the optic arrangement of the invention. In particular, a control unit of the optic arrangement may be configured to control the phase shifters such that the results described with reference to the variants of the method are reached. Further exemplary embodiments may deviate from the indicated numerical values; in particular, deviations of up to 10% or up to 20% of the indicated values may be used, thus realizing the described advantages of the invention at least partially.
Further features of the invention are described in the following with reference to the attached schematic figures:
Similar components are referred to with the same reference signs throughout all figures.
The microscope 1 comprises a light source 4 which emits light 5 that can be guided via an input port selection device 8 to different input ports of a waveguide chip 90 of the optic arrangement 95. The waveguide chip 90 or the combination of a waveguide chip 90 and input port selection device 8 constitute a structuring device 91 by means of which light exiting the waveguide chip 90 is suitable for structured illumination microscopy (SIM).
The input port selection device 8 is here formed by a scanner 8 with one or a plurality of pivotable mirrors or other pivotable light deflecting elements. In the following description, however, the scanner 8 may also be replaced by other variable beam deflection devices which may, in particular, be based on the acousto-optic principle.
The light source 4 may comprise a plurality of lasers as indicated in
Depending on the deflection direction of the scanner 8, different input ports of the waveguide chip 90 can be selected.
Each input port of the waveguide chip 90 leads to a plurality of exit ports which are arranged in a dot pattern. Light that enters through an input port thus exits the waveguide chip 90 in a dot pattern. A dot pattern consists of coherent light beam bundles which may interfere in a specimen plane 20 to form an illumination pattern. As each input port of the waveguide chip 90 connects to different exit ports, it is possible to switch between different dot patterns.
The exit ports of the waveguide chip 90 may be arranged in a pupil plane. A dot pattern in the pupil plane thus leads to a structured intensity pattern, for example stripes, in the specimen plane 20.
Structured light 15 exiting the waveguide chip 90 is guided to the specimen plane 20 via different optical components which may comprise an optical element 18, for example a tube lens or a zoom arrangement 18, and an objective 19 in addition to further components.
As shown in
The deflector 27 may comprise two reflective surfaces 9 and 16 which are rigidly connected with each other. The reflective surface 9 reflects light from scanner 8 to one of the optical fibers 11.1, 11.2, 11.3. The reflective surface 16 reflects light 15 from the exit ports of the waveguide chip 90 to the optical element 18 and the objective 19.
Light coming from the specimen is detected with a detector or camera 28. For example, a (dichroic) beam splitter 24 may be used to direct light coming from the specimen to the detector/camera 28 (and not to the waveguide chip 90). Another detector 22 may be used for a laser scanning process in which the deflector 27 is arranged such that light 5 is not guided through the waveguide chip 90. Optionally, lenses and filters 26 may be used in front of each of the detector 22 and the camera 28.
A control unit 21 may be configured to control the phase shifters of the waveguide chip 90 which is described in more detail further below.
Turning to
Each light guide path 32, 42, 52 leads to a respective splitter 33, 43, 53 which splits the light guide path 32, 42, 52 into a plurality of parts, referred to as path sections 34-36, 44-46, 54-56. Each path section leads to a respective exit port 37-39, 47-49, 57-59 where light exits the waveguide chip 90.
The depicted example comprises a first, second and third input ports 31, 41, 51. The exit ports 37 to 39 connected with the first input port 31 form a first dot pattern. Analogously, the exit ports 47 to 49 of the second input port 41 and the exit ports 57 to 59 of the third input port 51 form a second and a third dot pattern, respectively.
The waveguide chip 90 defines a plane P which may be arranged in or parallel to a pupil plane. In other words, the (main) directions of the light guide paths 32, 42, 52 span a plane P which is parallel to the pupil plane and may be arranged in the region of the pupil plane or in the pupil plane. All exit ports 37-39, 47-49, 57-59 are thus arranged in the region of or in the pupil plane.
A dot pattern in the pupil plane spatially corresponds to the beam bundles of different diffraction orders of a grating which is conventionally arranged in an intermediate image plane. The diffraction orders comprise in particular a zeroth diffraction order which is a central beam part, and a −1. diffraction order and a +1. diffraction order which may have a common distance to the 0. diffraction order. In a pupil plane, these 0., −1. and +1. diffraction orders may form three dots, substantially along a line.
A central path section 45 with its exit port 48 corresponds to the 0. diffraction order, wherein the exit port 48 may be located at or in the region of an optical axis of the light microscope. The two outer path sections 44, 46 with their respective exit ports 47, 49 correspond to the −1. and +1. diffraction orders. The light parts of the 0., −1. and +1. diffraction orders interfere in the specimen plane and form there an illumination pattern. For calculating a high resolution image, several specimen images with different illumination patterns are consecutively recorded. Differently oriented illumination patterns are here produced by consecutively illuminating the different input ports 31, 41, 51. Furthermore, for each illumination of one of the input ports, several microscope images are recorded which differ in the phase of the illumination pattern.
To vary the phase of the illumination pattern, phase shifters 144, 145, 146 are arranged at the path sections 44, 45, 46 of the 0., −1. and +1. diffraction orders for varying optical path lengths in these path sections 44, 45, 46. The phase shifters 144, 145, 146 are integrated in the waveguide chip 90 and may for example be thermoelectric, piezoelectric, acousto-optic or electro-optic phase shifters. For example, a thermoelectric phase shifter changes the temperature of the respective path section and thus the optical path length. In this way, the phase shifter 145 changes a phase value Φ0 for light of the 0. diffraction order, the phase shifter 144 changes a phase value Φ−1 (also referred to as Φ2) for light of F the −1. diffraction order; and the phase shifter 146 adjusts a change of the phase value Φ1 for light of the +1. diffraction order. As an abbreviation, light of the +1. diffraction order” is used to refer to light that travels through the path section which has its exit port arranged such that (or from which exit port the light is guided such that), when interfering in the specimen plane, the light corresponds to a +1. diffraction order of a grating in an intermediate image plane (which grating is not used here).
As explained in more detail above, the interfering beam parts of the 0., −1. and +1. diffraction orders form an illumination pattern with an intensity that oscillates with a first order modulation contrast and a second order modulation contrast. For varying the phase of the illumination pattern, it is necessary to vary the phases of the first and second order modulation contrasts. The first order modulation contrast is proportional to:
Its phase is varied in that the phase shifters 144-146 vary the phases Φ0, Φ1 and Φ2.
Starting from an operating point, the phases Φ1 and Φ2 are changed in opposite directions. In case of a thermoelectric phase shifter, for example, it starts from an initial temperature which is higher than the ambient temperature and may n particular be equal for both sections 44, 46. Now one of the path sections 44, 46 is heated and the other of the path sections 44, 46 is heated less or is not heated such that its temperature drops. The temperatures of the two path sections 44, 46 are changed such that Φ1 and Φ2 are just changed by the same absolute value or have the same absolute value. Depending on whether or not there is a constant phase difference between Φ1 and Φ2 which is to be considered in the equations, the phase shifters 144, 146 may thus be controlled such that Φ1=−Φ2 or Φ1=−Φ2+const. is always true, wherein const. is a constant which is constant for the different phase settings with which the microscope images are recorded.
Consider the above expression of the first order modulation contrast for the case that the phases of the +1. and −1. diffraction orders are varied according to Φ1=−Φ2, and Φ0 would not be varied (which is not part of the claimed matter); it is apparent that in this scenario:
the phase expression
in the second cosine term is constant for the different phase settings and thus does not contribute to the phase shifting,
the phase expression
in the first cosine term would have to be varied over an interval of 2π in order that the phase shifting covers a whole period.
For
to cover an interval of 2π, it is necessary to vary each of Φ1 and Φ2 by 2π, respectively, i.e., they must in particular have values within the interval 0π to 2π. This requires disadvantageously large temperature changes.
In contrast, in some embodiments of the invention, Φ1 and Φ2 are each varied by only 1π (or less), and thus
an interval of π. Nevertheless, variations over the whole phase region shall be possible. To this end, Φ0 may be changed by π. This changes the argument of the last cosine term in the above expression by π, thus changing the +/− sign of this cosine term. The change in the +/− sign corresponds to the mentioned variation of
in the region of 1π to 2π. Advantageously, with the invention the phase can be shifted over the whole phase region of the intensity modulation, wherein Φ1 and Φ2 only need to be varied by rather small amounts and thus only moderate temperature changes are necessary at the path sections 44 and 46.
The above descriptions of the path sections 44-46 and their respective phase shifters 144-146 similarly apply to the other path sections 34-36 and 54-56 with their respective phase shifters 134-136 and 154-156.
Instead of the described phase shifters integrated in the waveguide chip, separate phase shifters may also be arranged in the beam path behind the waveguide chip. For example, transparent wobble plates may be used as phase shifters which provide different optical path lengths of transmitted light depending on their tilt angle.
A high resolution image may now be calculated from a plurality of microscope images, wherein a respective microscope image is recorded for n different phase settings per illuminated input port of the waveguide chip. With the three input ports, 3n microscope images are thus recorded and taken into calculation to form one high resolution image. For all of these phase settings, the phase shifters may be controlled such that Φ1 and Φ2 are each set to several different values in an interval with an interval span of each 1π (or such that (Φ1−Φ2)/2 is set to several values in an interval spanning 1π), and additionally Φ0 is set to two values which differ from each other by π. Advantageously, the phase shifters only need to be adjusted over comparably small intervals.
For a particularly good contrast in an interference pattern, the relative intensities of light from the exit ports 47 to 49 are relevant. The first order modulation contrast provides a z modulation and thus provides an axial resolution enhancement (i.e., in z direction/along the optical axis). The second order modulation contrast provides the lateral resolution enhancement. The splitter 43 may be configured such that the intensity in the central exit port 48 is lower than the intensities of the other exit ports 47, 49. For example, the intensity in the central exit port 48 may be between 2% and 25% of the light intensity reaching the splitter 43. The remaining light intensity is shared n equal parts among the two other exit ports 47, 49. These descriptions in turn apply similarly to the other path sections and exit ports.
The groups of exit ports 37-39, 47-49 and 57-59 differ from each other in the arrangement of the resulting dot patterns. Each input port 31, 41, 51 connects with a central exit port 38, 48, 58 which are formed next to each other in a central region which may correspond to an optical axis of the microscope. Distances between the central exit ports 38, 48, 58 are smaller than distances to the other exit ports 37, 39, 47, 49, 57, 59 which are arranged on a circular band around this central region. As it is merely possible to form the central exit ports 38, 48, 58 next to each other and not at exactly the same position, the remaining exit ports 37, 39, 47, 49, 57, 59 may not be arranged exactly on a circle but rather on a circular band, wherein the exit ports 37 and 39 have the same distance to the exit port 38 and similarly the exit ports 47 and 49 have the same distance to the exit port 48 and the exit ports 57 and 59 have the same distance to the exit port 58.
Different dot patterns that are rotated relative to each other correspond in the specimen plane to structured intensity patterns that are rotated relative to each other.
In addition to the depicted path sections, light from an input port can also be distributed into several path sections. The exit ports of these path sections may be arranged to correspond to further diffraction orders, or may form other patterns.
All exit ports of the waveguide chip 90 may be arranged in a common plane P 4 which is in or at a pupil plane. This is achieved in that light is coupled out of the waveguide chip 90 under an angle relative to the directions of the light guide paths 32, 42, 52. The angle may have any value that differs from 0. In particular, the angle to plane P may be approximately 90° or more generally between 20° and 90°.
This is further described with reference to
If the surface 71 is an interface between air and the substrate/the respective path section, then an evanescent light field penetrates the air. For typically used light wavelengths, this evanescent field may have a size of for example, approximately 100 nm. Due to interaction with air molecules, the evanescent field may cause damage to the surface 71. To avoid such problems, the surface 71 may be coated (for example with a metal or a dichroic layer) to reduce/avoid interaction of an evanescent field with air. Alternatively, the recess 72 may be provided with a cover and filled with a protective gas, for example Argon. The surface 71 then contacts the protective gas which does not interact with the evanescent field.
Instead of using total internal reflection, it is also possible to provide a mirror at the surface 71.
After the reflection at the interface 71, a light beam widens and thus exits the waveguide chip 90 with a larger cross-section compared with a case in which the light beam would leave the waveguide chip 90 at the interface 71 without previously crossing the substrate. The larger cross-section reduces a peak intensity over the cross-section. This reduced peak intensity ensures that no damages occur at the surface 37 at which the light exits the wave guide. Advantageously, no further elements (for example end caps as used at optical fibers) are necessary for coupling light out of the waveguide chip 90. Rather, light may simply exit the substrate 70 without further elements being required.
Additional optical elements, for example a microlens or a half-wave plate, may be directly attached to the exit port (i.e., the area of the substrate where reflected light exits). Such an efficient arrangement and attachment of microlenses or other components would not be possible if light were to exit the waveguide chip at the side of the interface/mirror 71.
The efficiency of each splitter depends on the polarization of incoming light. Preferably, the light is linearly polarized in a direction in which the light is split (as indicated with the arrows in
This is further explained with reference to
Two half-wave plates may be provided to rotate the polarization direction always by 90°. Such half-wave plates 25 are shown in
Turning to
The described optic arrangement comprising a waveguide chip allows fast switching between different illumination patterns that differ in their respective orientation and phase. The optic arrangement may be compact with only a small number of movable components. The advantageous phase variation at light guide paths corresponding to a 0. diffraction order allows to particularly efficiently provide illumination patterns with different phases. The exemplary embodiments shown in the figures may also be modified such that the structuring device is formed without the waveguide chip. For example, instead of the waveguide chip, splitters and optical fibers may be provided to produce the same dot patterns described with reference to the figures. Furthermore, a grating or phase modulators may be used instead of the waveguide chip to provide the coherent beam parts. For each beam part that is guided to the specimen plane, at least one respective phase shifter may be provided so that all beam parts can be phase-shifted independently from each other. Beam parts that are produced with a grating and for which there are no phase shifters may be filtered out before reaching the specimen plane.
While the invention has been illustrated and described in connection with currently preferred embodiments shown and described in detail, it is not intended to be limited to the details shown since various modifications and structural changes may be made without departing in any way from the spirit of the present invention. The embodiments were chosen and described in order to best explain the principles of the invention and practical application to thereby enable a person skilled n the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated.
| Number | Date | Country | Kind |
|---|---|---|---|
| DE102018113208.5 | Jun 2018 | DE | national |
