Patent Application
20230296870
This disclosure relates to re-scan optical systems and methods, in particular to such systems and methods wherein the so-called static sample light path of the re-scan system is provided with a prism and/or wherein the optical system comprises one or more optical elements for causing at least two foci in the static sample light path.
The discussion below is merely provided for general back-ground information and is not intended to be used as an aid in determining the scope of the claimed subject matter.
A re-scan confocal microscope is known from De Luca G M, Breedijk R M, Brandt R A, et al. Re-scan confocal microscopy: scanning twice for better resolution. Biomed Opt Express. 2013; 4(11):2644-2656. Published 2013 Oct. 25. doi:10.1364/BOE.4.002644, hereinafter referred to as “De Luca”. This microscope has two units: 1) a standard confocal microscope with a set of scanning mirrors which have double function: scanning the excitation light and de-scanning the sample light, and 2) a re-scanning unit that “writes” the light that passes a pinhole onto a camera. By controlling the ratio of the angular amplitude of the respective scanning mirrors and re-scanning mirrors, the properties of the microscope can be controlled.
In such a re-scan system it is important that the scanning and re-scanning mirrors perform synchronized movements. Preferably, each sweep of the scanning mirror exactly begins, respectively ends, at the same time as a corresponding sweep of the re-scanning mirror begins, respectively ends. If the scanning and re-scanning mirror move asynchronously, the obtained image will have a low quality. As will be understood, at higher scan speeds, the mirrors move faster and the acceptable margin of absolute error for the synchronization becomes smaller. Since the degree of synchronization of the mirrors in the system of De Luca is limited, the scan speed is also limited.
In order to overcome such synchronization problems, a single scanning mirror may be used both for scanning the excitation light, more generally referred to as illumination light, and for re-scanning the fluorescent light, more generally referred to as sample light. For example, Roth et al.: Optical photon reassignment microscopy (OPRA). Optical Nanoscopy 2013 2:5, hereinafter referred to as “Roth”, disclose an optical photon reassignment microscope. In this microscope, a laser emits 488 nm illumination light that is directed to a dichromatic beam splitter, which reflects the illumination light onto a scanning unit. The scanning unit scans the illumination light onto an objective, which focuses the illumination light onto a sample. The returning fluorescent light is then directed back to the scanning unit and de-scanned. Subsequently, the fluorescent light is separated from the illumination light using the dichromatic beam splitter. After this separation, the fluorescent beam passes through an adjustable detection pinhole which can be used to achieve confocal sectioning. The pinhole is positioned between two lenses which expand the fluorescent beam. After expansion, the fluorescent beam is re-scanned using the same scanning system and projected via a lens to a camera.
A disadvantage of the latter microscope set-up is that, because the same scanning system is used for both scanning and re-scanning, the optical set-up is quite large. The de-scanned fluorescent light beam is namely guided all the way around the scanning system and then directed onto the scanning system which re-scans the fluorescent light beam onto the camera. Therefore, there is a need in the art for more compact optical re-scanning systems.
Therefore, one aspect of this disclosure relates to a re-scan optical for scanning a sample light spot over an imaging plane of an imaging system in order to form an image of a sample. The system comprises an illumination optical system for directing, and optionally focusing, illumination light at the sample therewith providing an illumination light spot at the sample. The illumination light spot causes sample light. The system further comprises a detection optical system for focusing at least part of the sample light onto an imaging plane of an imaging system herewith causing a sample light spot on the imaging plane. The system further comprises a light directing element for scanning the illumination light spot over and/or through the sample and de-scanning the sample light from the sample and scanning the sample light spot over said imaging plane of the imaging system. The detection optical system is configured to direct the de-scanned sample light along a light path running from the light directing element back to the light directing element so that the light directing element can perform said scanning of the sample light spot over said imaging plane. Further,
If the re-scan optical system comprises said one or more optical elements that is or are configured to cause at least two foci of the sample light in said light path, then preferably the light path is provided with these one or more optical elements, for example in the sense that these one or more optical elements are positioned in said light path.
The light path may be understood to be configured to revert and/or invert the sample light an appropriate number of times so that the sample light spot is scanned in the correct direction over the imaging plane of the imaging system. What is the correct direction will be explained in more detail below.
Moving the illumination light spot over the sample may also be referred to as scanning. Moving the sample light spot over the imaging plane of the imaging system may also be referred to as re-scanning. In re-scan optical systems, using the same mirror for scanning as well as re-scanning, enables to prevent synchronization problems. If two separate mirrors are used for scanning and re-scanning respectively, then these two mirror may, for some reason, move out of sync, which deteriorates the obtained images as explained in the background section.
The inventor has realized that it is not possible to implement an arbitrary number of mirrors in an optical re-scan system in which the scan mirror and re-scan mirror cannot be moved independently from each other. This is for example the case when the scan mirror and re-scan mirror are the same mirror and/or when there is some mechanical connection between the scan mirror and re-scan mirror. The scan mirror and re-scan mirror may be mechanically connected in the sense that the scan mirror is formed by one reflective surface of a more-sided, e.g. double-sided, reflector and the re-scan mirror is formed by another reflective surface of this more-sided, e.g. double sided, reflector.
As will be explained below, in a re-scan system, it is important that the sample light spot is scanned over the imaging plane in the correct direction. This principle will now be explained with reference to
As said, the illumination light spot 24 possesses a spatial light intensity distribution, in this example the intensity distribution has a higher intensity at its center and lower intensities at its edges. Therefore, when this illumination light spot 24 moves over a fluorescent particle, this particle will first be illuminated with a lower intensity, then with a high intensity, and then again with a lower intensity.
The right hand side of the figure schematically shows three different examples A, B, C of what can happen on the imaging plane 44 of the imaging system 46 at each time instance. Each row shows for a particular time instance the sample light 28 as present on the imaging plane. In principle, the lower the intensity with which a particle is illuminated, the lower the intensity of the resulting sample light from this particle. This is reflected in
Further, center 62 is also the center of what may be referred to herein as the sample light spot 63. For clarity, the sample light spot 63 is only indicated in column B, in truncated form. The sample light spot at a given time may be understood to cover the region on the imaging plane that would receive sample light if the entire illuminated part of the sample would emit sample light at that given time. The sample light spot is not infinitely small and also exhibits a spatial light intensity distribution. Further, it should be understood that this light intensity distribution varies as the illumination light spot 24 moves over and/or through the sample. To illustrate, if the illumination light spot 24 does not illuminate any photo-excitable particle, then the intensity of the sample light spot is zero everywhere throughout its spatial distribution. This situation for example occurs at time t1, where the illumination light spot 24 has not yet reached particle 56. On the other hand, if the illumination light spot 24 illuminates a particle in a sample with its maximum intensity, i.e. if the high intensity part, e.g. the center, of the illumination light spot 24 covers the particle, then the sample light spot has a relatively high intensity. This for example happens at time t3 at which the center of the illumination light spot 24 illuminates particle 56 and at time t6 at which the center of the illumination light spot 24 illuminates particle 58. Further, at time t2, the illumination light spot 24 weakly illuminates particle 56, which gives rise to so called off-axis sample light 28 in the imaging plane. At t2, the sample light spot 63 exhibits an asymmetric light intensity distribution in the sense that sample light 28d is not concentric with the sample light spot 63. In re-scan optical systems, the direction in which the image 60 of the illumination light spot and thus the direction in which the sample light spot moves over the imaging plane, should be selected taking into account the illumination light spot's direction of movement over and/or through the sample as well as the orientation of the image of the illumination light spot 60 at the imaging plane 44, which may also referred to as the orientation of the sample light spot.
The sample light spot 63 (and thus illumination light spot image 60) is scanned over the imaging plane, in example A from left to right and in examples B and C from right to left. The arrows 61 serve as a guide to the eye in order to show that the sample light spot moves at a constant velocity over the imaging plane.
At any given time, if the illumination light spot 24 is approaching (respectively moving away from) an arbitrary particle that is being illuminated at that given time which causes, at that given time, sample light 28 at a certain position in the imaging plane, then the image 60 of the illumination light spot (and the sample light spot 63) should also approach (respectively move away from) that certain position. Herein, the arbitrary particle that is being illuminated at the given time is typically illuminated by a low intensity edge of the illumination light intensity distribution.
It may thus be understood that, at any given time, the illumination light spot's direction of movement relative to an illuminated particle that causes sample light at a certain position in the imaging plane at the given time, should thus substantially be the same as the direction of movement of the image 60 of the illumination light spot (and the sample light spot 63) relative to said certain position in the imaging plane.
The illumination light spot 24 may be understood to approach respectively move away from a particle if a center of the illumination light spot 24 approaches respectively moves away from the particle. Similarly, the illumination light spot image 60 (and sample light spot 63) may be understood to approach respectively move away from a position in the imaging plane if a center 62 of the illumination light spot image 60 and sample light spot approaches respectively moves away from that position. One element approaching respectively moving away from another may be understood to be any relative movement from the one element to the other that reduces respectively increases the distance between them. Thus, “approaching a particle” should not be construed as being limited to “moving straight towards the particle”. An illumination light spot that is going to pass by a particle at a distance, meaning that the center of the illumination light spot will not cover that particle, may also be referred to as an illumination light approaching that particle.
The sample light spot's 63 direction of movement in examples A (left to right) and C (right to left) is correct, whereas it is incorrect for example B (right to left). This can be determined based on the above principles. In example A, at t2, the illumination light spot 24 illuminates particle 56. As a result, at the imaging plane 44, sample light 28a appears at the imaging plane at a certain position that at t2 is on the right of the center 62 (of both the illumination light spot image 60 and the sample light spot 63). At t2, the illumination light spot 24 is approaching particle 56. Therefore, the correct direction of movement for the illumination light spot image 60 and sample light spot 63 in the imaging plane is towards the position where sample light 28a appears, i.e. to the right.
For each example, an aggregate spatial intensity distribution 64 in the imaging plane 44 is shown. The aggregate spatial intensity distribution 64A for A shows that the image does not suffer from significant distortions. However, it may be problematic to distinguish the two particles 56 and 58 from the result 64A, because there seems to be a single high intensity region in the center of the aggregate light distribution 64A and not two separate high intensity regions. Example A corresponds to the case wherein the optical system exhibits a sweep factor M=1 as described in De Luca and as shown in
Example B differs from example A in that the illumination light spot image 60 moves in the opposite direction (right to left), whereas the orientation of the illumination light spot image 60 (and thus the orientation of the sample light spot 63) is the same for both examples A and B. As a consequence, the aggregate light intensity distribution 64B is highly distorted. Of course, this effect is even worse when many particles are illuminated at the same time.
Example C differs from example A in that the sample light spot 60 moves in the opposite direction (right to left) and in that the orientation of the sample light spot 63 is different. In example C the orientation of the sample light spot is reverted (or inverted depending on how the horizontal plane is defined) with respect to the sample light spot of example A. This causes the sample light 28c to be positioned left from the sample light spot's center 62, whereas for A the sample light 28a is positioned right from the sample light spot's center 62. Example C yields the same result as example A in terms of image quality. However, the aggregate light distribution 64C is reversed/inverted with respect to aggregate light distribution 64A. Example C also corresponds to the case wherein the system exhibits a sweep factor M=1 as described in De Luca.
In light of the above, it is clear that the orientation of the illumination light spot image 60 at the imaging plane 44 plays an important role. After all, the illumination light spot image in the imaging plane 44 may be reversed and/or inverted with respect to the sample light generated by the sample. The orientation of the sample light spot 63 influences where the sample light 28 is positioned with respect to sample light spot 63, in particular with respect to center 62 of sample light spot 63. The sample light 28 may for example be positioned right or left from the center 62 depending on the number of reversions. A reversion, also referred to as an x-flip, may be understood to be a rotation of 180 degrees around a vertical line. The sample light may for example be positioned below or above the sample light spot's center depending on the number of inversions. An inversion, also referred to as a y-flip, may be understood to be a rotation of 180 degrees around a horizontal line. As explained above, the position of the sample light with respect to the illumination light spot image determines in which direction the illumination light spot image should move, given a certain direction of movement for the illumination light spot.
When the re-scan optical system comprises separately controllable scanning and re-scanning mirrors, as for example the system shown in De Luca, then the appropriate scanning and re-scanning directions can be easily achieved. If resulting images are highly distorted, then probably the illumination light spot image is moved incorrectly. In such case, one would simply need to revert the movement of one of the mirrors in order to achieve correct, high quality imaging.
Unfortunately, such a correction is not possible when the scanning mirror and re-scanning mirror cannot be controlled separately, for example because the system comprises a mirror that is both used as scanning mirror and re-scanning mirror. If separate control is not possible, then a certain movement of the illumination light spot over and/or through the sample corresponds one to one to a movement of the illumination light spot image over the imaging plane of the imaging system.
A typical re-scan system has two dynamic paths and two static paths. The first dynamic path may be understood to be the light path from scanning mirror to the sample and back to the scanning mirror again. The second dynamic path may be understood to be the light path from the re-scanning mirror to the imaging plane. The first static light path may be referred to as the static illumination path and may be understood to be the light path that the illumination light follows from the light source to the scanning mirror. The second static light path may be referred to as the static sample light path and may be understood to be the light path that the sample light follows from the scanning mirror to the re-scanning mirror again. Thus, in case the same mirror is used for scanning and re-scanning the static path is the path that the sample light follows from the (re)scanning mirror back onto the (re)scanning mirror again. If in this disclosure, reference is made to “the light path”, it means the static sample light path, unless otherwise indicated or unless it is clear from the context that another light path is meant.
If it turns out that a re-scan system that comprises a single mirror as scanning and re-scanning mirror, moves the sample light spot in the wrong direction, then adding a mirror in a dynamic path of the system does not solve the problem. After all, if a mirror is added in a dynamic path, then not only causes this mirror an additional orientation change of the sample light spot, it also flips the (re)scan direction. Clearly, an incorrect pair of (i) scan direction and (ii) orientation of the sample light spot cannot be remedied by reverting both the scan direction and the orientation of the sample light spot.
Based on the above considerations about the orientation of the sample light and the scan direction, redesigning the optical setup of Roth to reduce its size is not straightforward. It is for example not possible to simply redesign the static path and remove a mirror. As explained above, this would yield distorted images because it changes the orientation of the illumination light spot image 60 in the imaging plane without changing the direction of movement of the illumination light spot image 60 in the imaging plane. As a consequence, the direction of movement of the illumination light spot image 60 would be incorrect.
The inventor has realized that a more compact optical setup is possible by implementing a prism and/or at one or more optical elements for forming at least two foci in the static sample light path and/or sample light deflecting prism configured to deflect the sample light without inverting and/or reverting the sample light. These measures namely obviate the need to implement a third mirror in the static sample light path and enable compact optical set-ups. It should be appreciated that, of course, in theory, mirrors can be placed close together in order to make the optical system more compact. However, in practice, this is very cumbersome and technically challenging. In practice, if many mirrors are positioned very close to each other, then often the support structure of one mirror blocks the light bundle that reflects from the other. Also, the more mirrors are present in the static path, the more difficult it is to correctly align them. To illustrate, if the sample light in the static sample light path reflects from a first mirror, then from a second mirror and then from a third mirror to the re-scanning mirror, then the correct orientation of the third mirror is dependent on both the orientation of the first mirror and the orientation of the second mirror. If, instead of the third mirror, a prism is for example implemented after the second mirror, or a pair of lenses, then only the first and second mirror have to be properly aligned and the prism or lens pair can simply be placed in the light path between the second mirror and re-scanning mirror. Preferably, such prims or lens pair does not change the direction of the sample light in the sense that light that is incident on a prism/lens pair has the same propagation direction when it hits the prism/lens pair as when it leaves the prism/lens pair. Hence, implementing a prism and/or optical elements, such as lenses for creating at least two foci, enables to reduce the size of the re-scan optical system and at the same time simplify the optical setup.
Preferably, the sample light, throughout its journey along the static sample light path, is reversed an even number of times, e.g. zero times or two times or four times or six times, and not an uneven number of times, e.g. not three times, if such reversions cause the orientation of the sample light spot to flip around a line perpendicular to a scanning direction of the sample light spot, said line lying in the imaging plane of the imaging system.
Preferably, the sample light, throughout its journey along the static sample light path, is inversed an even number of times, e.g. zero times or two times or four times or six times, and not an uneven number of times, e.g. not three times, if such inversions cause the orientation of the sample light spot to flip around a line perpendicular to a scanning direction of the sample light spot, said line lying in the imaging plane of the imaging system.
To illustrate, if the sample light spot is scanned in only one direction, as may for example be the case if the illumination light spot is line-shaped and covers the entire to be investigated sample, and if a reversion (resp. inversion) of the sample light in the static sample light path causes the orientation of the sample light spot to flip around a line that is perpendicular to said scan direction, said line lying in the imaging plane of the imaging system, and if an inversion (resp. reversion) of the sample light in the static sample light path causes the orientation of the sample light spot to flip around a second line parallel to said scan direction, said second line lying the imaging plane as well, then the number of reversions (resp. inversions) of the sample light in the static sample light path should be even, e.g. zero or two, and the number of inversions (resp. reversions) in the static sample light path may be any arbitrary number.
As another example, if the sample light spot is scanned in two directions, x and y, as may for example be the case if the illumination light spot is circular-shaped and is scanned in the x and y direction over the to be investigated sample, and if a reversion (resp. inversion) of the sample light in the static sample light path causes the orientation of the sample light spot to flip around a line perpendicular to the x direction, said line lying in the imaging plane of the imaging system, and if an inversion (resp. reversion) of the sample light in the static sample light path causes the orientation of the sample light spot to flip around a second line perpendicular to the y direction, said second line lying the imaging plane as well, then the number of reversions of the sample light in the static sample light path should be even, e.g. zero or two, and the number of inversions in the static sample light path should be even as well.
A reversion (resp. inversion) in the static sample light path is for example achieved by a reflection of the sample light from a mirror. A point focus in the static sample light path causes both a reversion and inversion of the sample light. A line focus in the static sample light path causes either a reversion or inversion of the sample light, depending on the orientation of the line focus and assuming that the line focus is not oriented such that it flips the orientation of the sample light spot around a line that is at a non-90 degrees, nonzero degrees, angle with respect to the scan direction. Such a line focus may for example be achieved by providing the static path with two cylindrical lenses. Preferably, the at least two foci that are caused by the one or more optical elements, cause at least two reversions or cause at least two inversions. For example, if there are two and only two foci caused by the optical elements, one focus may be a line focus and another focus may be a point focus. The two foci may for example also be two line foci that both cause a reversion of the sample light. The two foci may for example be two line foci that both cause an inversion of the sample light. The two foci may also be two point foci.
The light directing element may be a movable reflector configured to reflect the illumination light and the sample light, such as a movable mirror. The reflector may be movable in the sense that it can rotate around an axis of rotation. Additionally or alternatively, the light direction element may be an acousto-optic modulator (AOM) or an electro-optic modulator (EOM). Such deflectors can be used as reflectors having a controllable direction of reflection.
The light directing element may be understood to be configured to scan the illumination light spot over and/or through the sample and simultaneously de-scan the sample light from the sample and simultaneously scan the sample light spot over said imaging plane of the imaging system. Note that scanning the sample light spot over the imaging plane may be referred to as re-scanning. Of course, as used herein, if two events, such as scanning the illumination light spot and re-scanning the sample light spot (that resulted from scanning the illumination light spot) are said to be simultaneous then in fact they may occur shortly after one another due to the non-infinite speed of light and for example due to photo-excited molecules in the sample remaining excited for some time before they decay and emit a photon. This is for example the case with scanning and re-scanning because the sample light has to travel from sample via the static path to the re-scanning mirror.
It should be appreciated that one or more, e.g. all, of the at least two foci may be a line focus. Additionally or alternatively, one or more, e.g. all, of the at least two foci may be a point focus. A point focus may be understood to both revert and invert the sample light, whereas a line focus only reverts or only inverts the sample light, depending on the orientation of the line focus.
Preferably, the prism that is configured to invert and/or revert the sample light is a prism that is configured to provide inline inversion or reversion of the sample light. This may be understood as that the propagation direction of the sample light that hits the prism is the same as the propagation direction of the sample light that leaves the prism and/or as that the propagation direction of the sample light leaving the prism is not laterally displaced with respect to the propagation direction of the sample light hitting the prism. “Lateral” may be understood to be a direction perpendicular to the propagation direction of light.
Preferably, the one or more optical elements also provide inline inversion and/or reversion. Further, preferably, the one or more optical elements are transmissive optical elements in the sense that they are transmissive to at least the wavelength of interest, i.e. the wavelength of the sample light.
Any optical element described herein, such as the sample light deflecting prisms, that are configured to deflect sample light may be understood to change the propagation direction of the sample light. This may be understood as that sample light has a first propagation direction just before it hits the optical element, however, has a second propagation direction different from the first propagation direction when it has just exited the optical element.
Optionally, the re-scan system comprises a light source, for example a light source as described herein. Optionally, the re-scan optical system comprises a microscope system, for example a microscope system as described herein. Optionally, the re-scan optical system comprises an imaging system, for example an imaging system as described herein.
In an embodiment, the light path is provided with
This embodiment advantageously ensures that the sample light spot is scanned in the correct direction.
In an embodiment, the prism that is configured to invert and/or revert the sample light is a Dove prism. This is advantageous, because it can be easily aligned and a Dove prism does not change the direction of the light path.
In an embodiment, the prism that is configured to invert and/or revert the sample light is a Pechan prism.
The prism that is configured to invert and/or revert the sample light may also be a Schmidt-Pechan prism, an Abbe-Koenig prism, Porro-Abbe prism, or double Porro prism.
In an embodiment, the light path is provided with a sample light deflecting prism configured to deflect the sample light without reverting the sample light and/or configured to deflect the sample light without inverting the sample light. This embodiment is advantageous in that it enables to reduce the number of optical elements in the static light path. To illustrate, instead of a mirror and an (inline) prism configured to invert and/or revert the sample light, a single sample light deflecting prism that deflects the sample light without reverting or inverting it can be used. This allows for even more compact optical setups. Such sample light deflecting prism may be a Bauernfeind prism or pentaprism, for example. It should be appreciated that the light path may comprise a plurality of sample light deflecting prisms configured to deflect the sample light without reverting the sample light and/or configured to deflect the sample light without inverting the sample light.
In an embodiment, the one or more optical elements comprise at least three lenses, preferably at least four lenses. With three lenses, when positioned appropriately and having appropriate focal distances, two sample light foci can be easily created.
In an embodiment, the light path is provided with
With four lenses, it may be simpler to design a setup that causes two foci, because then simply two telescopes, each telescope being formed by two lenses, can be implemented in the static path. One of these telescopes can be used to focus the sample light on a pinhole or optical slit. In this embodiment, preferably, the light path does not comprise a prism that is configured to invert and/or revert the sample light. Advantageously, the four lenses provide flexibility on how to achieve that the re-scan optical system has a desired optical magnification.
In an embodiment, the light directing element is configured to scan the sample light spot in a first scan direction over the imaging plane. In such embodiment, a reversion or, respectively, inversion of the sample light in said light path may be understood to cause an orientation of the sample light spot in the imaging plane to flip around a line that is perpendicular to said first scan direction and that lies in the imaging plane of the imaging system. In this embodiment, said light path is configured to cause an even number of reversions or, respectively, inversions of the sample light in said light path.
In this embodiment, the light directing element may further be configured to scan the sample light spot in a second scan direction over the imaging plane different from the first scan direction, e.g. perpendicular to the first scan direction. In such embodiment, an inversion or, respectively, reversion of the sample light in said light path may be understood to cause an orientation of the sample light spot in the imaging plane to flip around a line that is perpendicular to said second scan direction and that lies in the imaging plane of the imaging system. In this embodiment, said light path is configured to cause an even number of inversions or, respectively, reversions of the sample light in said light path.
It should be appreciated that optical elements cause reversion and/or inversions of the sample light in the static path and by suitably combining these optical elements in the static light path, an appropriate number (i.e. an even number) of reversions can be achieved (and an appropriate number of inversions as well if the sample light spot is scanned in two dimensions). To illustrate, a lens pair typically causes one reversion and one inversion of the sample light, (hence, a single lens may be understood to cause 0.5 reversion and 0.5 inversion of the sample light) a pair of spherical mirrors causes three reversions (hence one spherical mirror may be understood to cause 1.5 reversions), a mirror causes one reversion, a pentaprism does not cause any reversion or inversion yet does deflect the sample light, a prism that is used as a mirror causes one reversion of the sample light, a Porro prism does not cause any reversion or inversion of the sample light, a pair of cylindrical mirrors may be understood to cause three reversions of the sample light (hence a cylindrical may be understood to cause 1.5 reversions). Further, a Dove prism causes one reversion (or inversion, depending on its orientation) of the sample light, a Pechan prism causes one reversion and one inversion of the sample light, an Abbe-Koenig prism causes one reversion and one inversion of the sample light, a Porro-abbe prism causes one reversion and one inversion of the sample light, a Double Porro prism causes one reversion and one inversion of the sample light, and a cylindrical lens may be understood to cause 0.5 reversion (or 0.5 inversion depending on its orientation). As said, such building blocks may be suitably combined in the static light path in order to achieve an even number of reversions and, if required, an even number of inversions. This will be explained in more detail with reference to
In an embodiment, the illumination light spot is a line-shaped illumination light spot. This embodiment enables to quickly scan samples.
In an embodiment, the system comprises a light splitter that is configured to separate the illumination light from the sample light. The light splitter is for example configured to reflect the illumination light towards the sample and let pass the sample light or to reflect the sample light and let pass the illumination light. Preferably, the filter is positioned in the light path.
In an embodiment, the splitter is a dichroic filter, such as a dichroic mirror, for separating the sample light from the illumination light.
In an embodiment, the light path is provided with a pinhole and/or optical slit. This embodiment improves the optical sectioning capabilities of the system. The pinhole and/or optical slit are preferably configured to block sample light coming from regions in the sample that are not in focus of the scan lens. Preferably, the light path is provided with optical elements configured to focus the sample light at the pinhole or optical slit.
In an embodiment, the imaging system is configured to integrate sample light incident at the imaging plane over time. The imaging system may be configured to integrate the sample light that is incident on the imaging plane during a single scan of the sample. Then, preferably, the imaging system is configured to integrate incident sample light over a time period that is equal to a duration of a single scan. The imaging system may be configured to integrate the sample light that is incident on the imaging plane during multiple, e.g. repeated, scans of the sample. Then, preferably, the imaging system is configured to integrate incident sample light over a time period that is longer than the duration of a single scan, for example equal to five scan periods. The imaging system may be configured to integrate the sample light that is incident on the imaging plane during a part of the scan of the sample. Then, preferably, the imaging system is configured to integrate incident sample light over a time period that is shorter than the duration of a single scan. A single scan of the sample as used herein may be understood as the illumination light spot illuminating each position of a region of interest on or in the sample once, whereas for example two scans of the sample may be understood as the illumination light spot illuminating each position of the of the region of interest twice, et cetera.
In an embodiment, the re-scan optical system is configured to move the illumination light spot over and/or through the sample at a first velocity and move the sample light spot over the imaging plane at a second velocity, such that the second velocity is different from, preferably higher than, more preferably approximately twice as high as, a baseline velocity. Herein, the baseline velocity is defined as the first velocity multiplied by the optical magnification of the re-scan optical system. This embodiment allows to increase the resolution of the obtained image as explained in De Luca.
In an embodiment, the system comprises an objective configured to gather the sample light from the sample and focus the sample light on a primary imaging plane of the re-scan microscope system. In such embodiment, the detection optical system may be configured to image images in the primary imaging plane onto the imaging plane of the imaging system, preferably with an optical magnification of approximately 0.5, which would mean that an image of the sample light spot in the primary image plane, see primary image plane 16 in
One aspect of this disclosure relates to a method for scanning a sample light spot over an imaging plane of an imaging system in order to form an image of a sample using a re-scan optical system as described herein. The method comprises causing the light directing element to scan the illumination light spot over and/or through the sample and de-scan the sample light from the sample and scan the sample light spot over said imaging plane of the imaging system. Additionally or alternatively this method comprises directing the sample light through the light path.
Elements and aspects discussed for or in relation with a particular embodiment may be suitably combined with elements and aspects of other embodiments, unless explicitly stated otherwise. Embodiments of the present invention will be further illustrated with reference to the attached drawings, which schematically will show embodiments according to the invention. It will be understood that the present invention is not in any way restricted to these specific embodiments.
Aspects of the invention will be explained in greater detail by reference to exemplary embodiments shown in the drawings, in which:
In the figures identical reference numerals indicate identical or similar elements.
Before the illumination light 6 is incident on light directing element 14, it reflects from dichroic mirror 12. Preferably, dichroic mirror 12 is positioned at a 45 degrees angle with respect to the propagation direction of the incoming illumination light 6, so that the propagation direction of the illumination light 6, upon reflection, changes 90 degrees.
The light directing element 14 reflects the illumination light 6 towards a scan lens that is configured to focus the sample light on a primary image plane 16, also referred to as interface plane 16, of a microscope 17 that comprises a tube lens 18 and objective 20. The re-scan optical system does not per se comprise a microscope. It may for example be configured to make an optical connection with the microscope. In the depicted embodiment, the scan lens 15 creates a vertical line at primary image plane 16. Herein, vertical may be understood to be parallel to the indicated y axis. The distance between the scan lens 15 and light directing element 14 is approximately equal to the focal distance of scan lens 15. In an example, the effective focal distance of scan lens 15 is approximately 75 mm. The scan lens 15 for example has a diameter of 2 inch.
Each microscope may have a different focal length for the tube lens 18. The distance between the primary image plane 16 and the tube lens is preferably equal to the focal distance of the tube lens.
In re-scan microscope systems as described herein, similarly for any microscope system, the objective 20 is preferably the NA-limiting component of the total optical system. NA stands for Numerical Aperture.
The objective 20 is configured to focus the illumination light onto sample 22 herewith causing an illumination light spot 24 on or in the sample 22. The illumination light spot 24 causes sample light 28 from the sample 22. This sample light 28 may be illumination light that is reflected from the sample. However, typically, the illumination light 6 causes photoluminescence, such as fluorescence and/or phosphorescence, in the sample and, typically, the sample light 28 is photo luminescent light, such as fluorescent light and/or phosphorescent light.
The objective 20 is configured to capture the sample light 28 coming from the sample. On the way back, from the objective 20 up to the dichroic filter 12, the sample light 28 travels along the same path as the illumination light 6 did on its way to the sample. In other words, from objective 20 to dichroic filter 12, the sample light path is substantially identical to the illumination light path.
In this embodiment, the sample light 28 passes through filter 12. At the same time, the filter reflects any illumination light that has reflected from sample 22. As such, the filter 12 may be understood to separate the illumination light 6 from the sample light 28.
After having passed through filter 12, the sample light is incident on lens 30. Preferably the distance between lens 30 and the light directing element 14 is approximately equal to the focal length of lens 30. In an example, the focal length of lens 30 is 80 mm.
The lens 30 focuses the sample light 28, via mirror 32, at the optical slit 34. In an example, the optical slit has a width of approximately 50 micrometers and a length of 2-3 cm. After the sample light 28 has passed optical slit 34, it reflects from mirror 36 and meets lens 38. The optical distance between the optical slit 34 and lens 38 is preferably equal to the focal length of lens 38. Lens 38 may be identical to lens 30.
After lens 38, the sample light is incident on prism 40 that inverts and/or reverts the sample light. This prism may be a Dove prism as shown in
After prism 40, the sample light is incident on light directing element 14 again. The optical distance between lens 38 and light directing element 14 is preferably close, e.g. equal, to the focal length of lens 38. In this embodiment, the sample light 28 hits the light directing element 14 at a different angle than the angle at which the illumination light 6 hits the light directing element. When the sample light 28 hits the light directing element 14, the light directing element 14 functions as a re-scanner that scans the sample light 28 over the imaging plane 44 of imaging system 46.
Thus, the static sample light path in the embodiment of
The imaging system for example comprises a camera, such as a CCD camera. The imaging plane preferably comprises a plurality of pixels that are arranged in a predefined manner, e.g. in a 2D lattice.
Before the sample light 28 reaches imaging plane 44, it is incident on a re-scan lens 42 that is configured to focus the sample light onto the imaging plane 44. Preferably, the distance between the light directing element 14 and lens 42 is equal to the focal length of lens 42. In an embodiment lens 42 is identical to lens 15. Lens 42 may have a focal length of 75 mm.
The optical magnification of the re-scan microscope system may be understood to be determined by the optical magnification provided by the combination of objective 20 and tube lens 18, referred to as Mmicr in De Luca, and by the optical magnification M2 of the detection optical system. In the depicted embodiment, the optical magnification of the detection optical system is determined by scan lens 15, lenses 30 and 38 and re-scan lens 42. In the depicted embodiment, the optical magnification M2 of the detection optical system is given by M2=(f_30*f_42)/(f_115*f_38), wherein f_x denotes the focal length of lens x.
It should be appreciated that the velocity of an image of the sample light spot in primary image plane 16, v_16, is given by the multiplication of a first velocity, v_1, i.e. the actual velocity of the illumination light spot 24 over and/or through the sample 22, with the optical magnification of the combination of objective 30 and tube lens 28, i.e. v_16=v_1×Mmicr.
The baseline velocity, v_B, in the depicted embodiment is then given by v_B=v_1×Mmicr×M2.
In one embodiment, the second velocity, i.e. the velocity with which the sample light spot moves over the imaging plane 44, is approximately twice as high as the baseline velocity, v_2≈2×v_B. Note that the second velocity is equal to the velocity with which the image 60 of the illumination light spot in the imaging plane 44 moves over the imaging plane 44. This can for example be achieved by configuring the detection optical system such that it images an image in the primary image plane 16 onto the imaging plane 44 of the imaging system 46 with an optical magnification of approximately 0.5, M2≈0.5. In this manner, the second velocity is twice as high as the baseline velocity if v_16 and v_2 are equal.
As described in De Luca, the so called sweep factor M is preferably approximately equal to 2. In the depicted embodiment, the respective amplitudes of the scanning and re-scanning mirror are the same, of course, because the same mirror is used as scanning and re-scanning mirror. Therefore, in the depicted embodiment, the sweep factor M is given by M=(f_38)/(f_30).
In
The duration of a single scan may be between 25 ms and 10 seconds.
In the embodiment of
It should be appreciated that the two additional lenses 48 and 49 introduce an additional inversion and an additional reversion in the static sample light path and thus also influence the orientation of the sample light spot in the imaging plane. Hence, these lenses cause that the scanning direction of the sample light spot at the imaging plane 44 is correct.
In particular, the four lenses 30, 38, 48 and 49 cause two foci of the sample light in the static sample light path. Hence, in the depicted embodiment, the four lenses together cause two reversions and two inversions and mirror 32 causes a reversion and mirror 36 causes a reversion. Hence, in this static path, the sample light 28 is reversed four times and inverted twice. In the depicted embodiment, we may assume that a reversion causes a flip of the sample light spot around a vertical line whereas the sample light spot is horizontally scanned. Thus, in light of the above, the number of reversions of the sample light in the static sample light path should be even, which it is, because there are four reversions of the sample light in the static sample light path.
In this embodiment, the sweep factor M as defined in De Luca is given by M=(f_38*f_49)/(f_30*f_48). This formula shows that the additional two lenses 48 and 49 provide flexibility in how to achieve a desired sweep factor of for example M=2. If for example, lenses 30 and 38 are identical, then a sweep factor of M=2 can be obtained by selecting the focal length of lens 49 twice as large as the focal length of lens 48.
In
Columns D and F illustrate respective examples where the direction of movement of the illumination light spot image is correct. Column E illustrates an example wherein the direction of movement of the illumination light spot image 60 is incorrect. The obtained image 64E of column E is highly distorted. However results 64D and 64F, which are mirror images of each other, each clearly show two high intensity regions that respectively correspond to particles 56 and 58. This illustrates that a sweep factor higher than 1, preferably a sweep factor of approximately 2 (see De Luca) yields better images in terms of sharpness. Images 64D and 64F obtained with M=2 are better than images 64A and 64C obtained with M=1. Whereas in images 64A and 64C no two separate high intensity regions can be distinguished, which would correspond with the two particles 56 and 58, in images 64D and 64F two high intensity regions can be distinguished.
Such line-shaped illumination light spot 24 also has a spatial intensity distribution. Reference numeral 52 indicates the light intensity in the illumination light 24 along line 54.
Similarly as in
In this embodiment, plane 14, i.e. the light directing element, is a conjugate plane of the back focal plane 72 of the microscope 17. Further, planes 19, 16, 34 (the aperture slit), are conjugate planes of the focal plane of the microscope 17, i.e. the plane at which the illumination light is focused.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The description of embodiments of the present invention has been presented for purposes of illustration, but is not intended to be exhaustive or limited to the implementations in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the present invention. The embodiments were chosen and described in order to best explain the principles and some practical applications of the present invention, and to enable others of ordinary skill in the art to understand the present invention for various embodiments with various modifications as are suited to the particular use contemplated.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2026002 | Jul 2020 | NL | national |
This application is a Section 371 National Stage Application of International Application No. PCT/NL2020/050415, filed Jul. 1, 2021 and published as WO/2022/005286 A1 on Jan. 6, 2022, in English, the contents of which are hereby incorporated by reference in their entirety.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/NL2021/050415 | 7/1/2021 | WO |
