This application is a U.S. National Phase of PCT/HU2012/000001, filed Jan. 5, 2012, which is incorporated herein by reference.
The present invention relates to a method for scanning along a continuous scanning trajectory with a scanner system comprising a first pair of acousto-optic deflectors for deflecting a focal spot of an electromagnetic beam traversing a consecutive lens system defining an optical axis (z) in an x-z plane, and a second pair of acousto-optic deflectors for deflecting the focal spot in a y-z plane being substantially perpendicular to the x-z plane.
Three-dimensional (3D) laser scanning technologies have great importance in performing measurements on biological specimens (including scanning, imaging, detection, excitation, etc.).
State of the art technologies commonly apply two-photon laser scanning microscopes that use a laser light of lower photon energy of which two photons are needed to excite a fluorophore in a quantum event, resulting in the emission of a fluorescence photon, which is then detected by a detector. The probability of a near simultaneous absorption of two photons is extremely low requiring a high flux of excitation photons, thus two-photon excitation practically only occurs in the focal spot of the laser beam, where the beam intensity overcomes the two-photon threshold. The photon number is increased also by mode-locking the excitation laser causing photons to arrive in high intensity bounces at the sample. Generally a femtosecond pulsed laser is used to provide the required photon flux for the two-photon excitation, while keeping the average laser beam intensity sufficiently low to avoid thermal sample deterioration.
In the case of analysing biological specimens it is generally preferred to move the focus spot of the laser beam instead of moving the specimen, which would be difficult to carry out when using submerge specimen chambers or when electrical recording is performed on the biological specimen with microelectrodes. Moving the focus spot along an arbitrary trajectory can be achieved by deflecting the laser beam to scan different points in a focal plane (x-y plane) and by displacing the objective along its optical axis (axis z) e.g. via a piezo-positioner in order to change the depth of the focal plane. XY scanning is conventionally achieved by deflecting the laser beam within a given focal plane (x-y plane) via mechano-optical deflecting means such as deflecting mirrors mounted on galvanometric scanners.
The inertia of the mechanical scanning components (i.e. the scanning mirrors and the microscope objective) presents certain limitations with regard to the achievable scanning speed, since the scanning components need to be physically displaced in order to perform 3D scanning.
Rapid acousto-optic deflectors (deflector) have been proposed as an alternative to the conventional mechano-optic solutions.
Kaplan et al. (“Acousto-optic lens with very fast focus scanning”, OPTICS LETTERS/Vol. 26, No. 14/Jul. 15, (2001)) proposed an acousto-optic lens made up of two deflectors with counter propagating acoustic waves locked in phase, to achieve purely focal plane shift along the z axis without lateral moving of the beam. In this type of application chirped frequency acoustic waves should be generated, i.e. the frequency of the acoustic wave in the acousto-optic medium of the deflectors is continuously changed. Changing the focus of the acousto-optic lens is achieved by changing the sweep rate of the acoustic frequencies through the optical aperture of the acousto-optic devices. To simultaneously move the beam and change the focal plane the sweep rates have to be changed and acoustic frequency difference between the two deflectors of a pair should be introduced. To move the focal spot along the x axis acoustic frequency difference between the deflectors deflecting in the x-z plane, to move along the y axis, acoustic frequency difference between the deflectors of the pair deflecting in the y-z plane should be applied. The amount of the frequency difference in the respective pairs determines the x and y coordinates of the spot.
The above principle is used in acousto-optic scanners in order to provide 3D scanning. In an acousto-optic scanner four deflectors are used to achieve true 3D scanning—i.e. focusing the exciting laser beam to points within a diamond like spatial volume as described in U.S. Pat. No. 7,227,127. In normal operation, random access scanning is used, that means that any selected point in the 3D space can be addressed by adding proper control to the acousto-optic deflectors. This mode is called random access multipoint scanning (RAMP).
For the RAMP operation in 3D the deflectors should be filled with chirped acoustic waves that change their frequencies linearly with time, with nearly equal frequency sweep rate, but different starting frequency. The slope of the chirps determines focal depth (z level) whereas the difference between the instant frequencies present in the members of the deflector pairs deflecting in the x-z or y-z planes, respectively, gives the lateral distance x and y of the focal spot, relative to the axis.
The frequency functions in the members of the pair deflecting e.g. in the x-z plane can be defined as
f1x=f10x+a1x·t,f2x=f20x+a2x·t
In the RAMP operation the z level is controlled (kept constant) by keeping the amount of a1x and a2x equal (a1x=a2x) from which it follows that the x level is determined by: f2x−f1x=f20x−f10x. In prior art acousto-optic scanners the values a1x and a2x are kept equal in order to form a stable focus spot in a desired spatial location. The switching time between two different spatial points in RAMP mode is determined by the acoustic velocity, since the new acoustic waves must fill the optical aperture of the deflectors completely. If the aperture has a width D across the sound, the time needed to fill the acousto-optic medium with the new acoustic wave of velocity vac is: tsw=D/vac. (In acoustically rotated TeO2 deflector configuration this time is 21 μs for an aperture of 15 mm).
One of the problems associated with the conventional RAMP mode is that it is not possible to conduct measurements during the switching time because the discrete change of the frequency results in the spot spreading out in space, whereby multi-photon excitation does not occur any more.
It is an object of the present invention to overcome the problems associated with the prior art. In particular, it is an object of the invention to eliminate the switching time associated with the RAMP mode of acousto-optic deflectors and to provide a new operating mode for moving the focus spot continuously along an arbitrary scanning trajectory (curve).
The inventors have realised that if the slopes in the two deflectors in an x-z or y-z pair are not kept equal, but instead varied in time, then it is possible to move the focal spot along trajectories (curves) in 2D and 3D.
The above objects are achieved by the method according to claim 1.
Particularly advantageous embodiments of the inventive method are defined in the attached dependent claims.
With the inventive method it is not necessary to wait until the new frequencies fill the optical aperture, since if the frequency differences change continuously in time, this causes the spot to move along neighbouring points, without the need for “jumping” from one measurement point to another, that would spread out the spot in space. The inventors have recognized and demonstrated theoretically and experimentally that the point spread function PSF of the focal spot is not distorted only by the fact that it is moving. Appropriate control of the acousto-optic devices, on the other hand, can be achieved by suitable electronic driver and controlling software.
Further details of the invention will be apparent from the accompanying figures and exemplary embodiments.
Accordingly, an incident electromagnetic beam 14 (generally a laser beam) is split by the first deflector 12 into an undeflected zero order beam 16, a first order deflected beam 18 and higher order deflected beams which are neglected in the following discussion as generally only the first order beam 16 is of interest. The first order beam 18′ deflected (diffracted) by the second deflector 12′ will have the same direction as the incident beam 14 and consequently as the zero order beam 16 deflected by the first deflector 12. Therefore this zero order beam 16 must be separated from the twice diffracted first order beam 18′ exiting the second deflector 12′. There are two commonly applied technologies for separating the zero order beam 16. If the deflectors 12, 12′ are made up of anisotropic crystals and use anisotropic Bragg diffraction involving slow shear acoustic waves the polarisation of the first order diffracted beam 18 is rotated by 90 degrees compared to the undiffracted zero order beam 16, thus the zero order beam 16 may simply be filtered out via a polarising filter. According to the second technology the twice diffracted first order beam 18′ and the zero order beam 16 are separated spatially: the spacing d between the two deflectors 12, 12′ must be greater than that predicted by the beam aperture D of the first deflector 12 and the first order diffraction angle θ. In practice the required d spacing is approximately d=10*D. This imposes that the two counter-propagating acoustic beams cannot be realized within the same deflector.
In order to compensate for different types of optical aberrations various scanning systems 100 have been proposed as discussed in detail in WO2010076579.
The present invention can be applied in any prior art scanner comprising two pairs of acousto-optic deflectors and in particular with any of acousto-optic deflector systems disclosed in WO2010/076579 The inventive method is suitable for increasing the speed of acousto-optic scanning in two-photon microscope technology and allows both for scanning in 2D (along segments within a given focal plane, i.e. where the z coordinate is constant), and for scanning in 3D (along an arbitrary 3D trajectory within the sample).
The frequency functions in the deflectors 12, 12′ of the pair 10 deflecting in the x-z plane can be defined as
f1x=f10x+a1x·t,f2x=f20x+a2x·t
Similarly the frequency functions for the deflectors 22, 22′ of the pair 20 deflecting in the y-z plane is:
f1y=f10y+a1y·t,f2y=f20y+a2y·t
In the more simple embodiment line scans are made possible in 2D by keeping the z coordinate constant and changing only the x and y coordinates. In this case it is possible to make use of the slope mismatch between the acoustic frequency sweeps (i.e. a1x is not equal to a2x as in the RAMP operation mode) within the consecutive acousto-optic deflectors 12, 12′, or 22, 22′ deflecting in the x-z or y-z plane. The velocity of the scanning in a given plane can be set by nearly symmetrically increasing the mismatch between the slopes of the deflectors in the deflector pairs 10 and 20 respectively: this means that a1x−a2x, a1y−a2y is no longer zero. If the deflectors 12 and 12′ of the first pair 10 are identical, and the deflectors 22 and 22′ of the second pair 20 are identical as well, the vx and vy velocity of the deflected focus spot does not change, if the slopes in the two deflectors 12, 12′ and 22, 22′ of a pair 10 and 20 are shifted symmetrically to maintain:
Δax=a1x−a2x=const, and Δay=a1y−a2y=const.
Hence a1x and a2x and a1y and a2y can be chosen as:
a1x=a10x+Δax and a2x=a10x−Δax
a1y=a10y+Δay and a2y=a10y−Δay.
If the deflectors 12, 12′ and 22, 22′ respectively are not identical, then the following equations can be used.
If the frequency sweeps responsible for the deflection in the x-z plane have the slopes a1x and a2x, respectively, than the focal spot will move in the measurement plane along the x axis with the velocity:
vx=(K2(λ)a2x−K1(λ)a1x)·fobj/M
where K(λ) is the dependence of the deflection angle θ on the acoustic frequency f in a given deflector: θ=K(λ)f, λ being the optical wavelength, The first and second deflectors of a pair may be of different configuration and geometry, therefore K1 and K2 are different. M is the magnification of the optical system between the scanner 100 and the objective 200 and fobj is the effective focal length of the objective, or of any lens system used as an objective 200. The same is valid for the y-z plane:
vy=(K2(λ)a2y−K1(λ)a1y)·fobj/M
Thus by setting the two velocities both arbitrary drift directions in a given focal plane can be adjusted.
Simulations have shown that the spot itself does not change its parameters significantly during the drift, the Strehl ratio only decreases with the distance from the optimum point (from the middle of the scanned volume) according to the rule valid for stationary focal spots.
The sweep slope mismatch is optimized for minimum astigmatism in any z≠0 plane, to obtain the best spot size and shape. The minimum astigmatism restriction causes difference in the frequency slopes of the x deflecting and y deflecting deflector pairs: a1x and a2x as well as a1y and a2y set for the x-z and y-z planes respectively. We use a quite simple method in the algorithm that determines the frequency sweep slopes, which cause the spot to move in a plane at a predetermined z in the wanted direction with a wanted velocity v.
In the scanning system 100 depicted in
where Mx and My are the magnifications of the telecentric system linking the scanning system 100 and the objective 200 in the respective planes.
The slope differences Δax=a1x−a2x, Δay=a1y−a2y between the two deflectors 12, 12′ and 22, 22′ deflecting in the same direction x or y, respectively, are set by the desired spot drift parameters: direction and velocity. The direction can be defined as the angle α of the drift direction with respect the x axis. A given direction a and given velocity v can be set by the slope differences determined as:
The z level of the plane does not change, if the slopes in the two deflectors (12, 12′ and 22, 22′) of a pair (10 and 20) are shifted symmetrically to maintain K2x(λ)a2x+K1x(λ)a1x=const and K2y(λ)a2y+K1y(λ)a1y=const.
When we do not use linear chirps, instead we use nonlinear chirps, and in the same time do not maintain symmetric shift in the slopes of the different deflectors, we can in principle achieve scanning along arbitrary 3D path, given by the function z=f(x,y), x,y,z being the Cartesian coordinates of the sample volume, e.g. with the origin at the point defined by intersection of the optical axis z and the nominal focal plane of the objective. The basic equations for the velocities using the well known a1x etc slope values are:
But to have the spot not spread out in space zx=zy and vzx=vzy must always be fulfilled. These give restrictions on the possible values of the slopes and their temporal derivatives, å1x, å2x etc.:
The coordinate z can be generally expressed as:
In an exemplary setting a1x and a2x are controlled according to the equations:
a1x=b1xt+c1x, and a2x=b2xt.
In this case:
{dot over (a)}1x=b1x,{dot over (a)}2x=b2x,
Furthermore, taking a scanning system 100 wherein the deflectors 12, 12′ are identical: K1x=K2x=Kx thus:
Using these values the frequencies in a given deflector pair 10, e.g. x are:
f1x=f10x+b1xt2+c1xt, and f2x=f20x+b2xt2
With these the x coordinate can be determined:
x=fobjKxMx((b1x−b2x)t2+c1xt+(f10x−f20x)).
The above considerations can be applied for controlling the y direction scanning similarly:
a1y=b1yt+c1y, and a2yt and K1y=K2y=Ky
from which the y coordinate can be determined in the same manner:
y=fobjKyMy((b1y−b2y)t2+c1yt+(f10y−f20y)).
Using the constraints set for z (zx=zy, and vzx=vzy) constraints can be found between b1x, b2x, b1y, b2y, c1x, c1y, f10x, f20x, f10y, f20y.
In order to render the equations more simple f10x, f20x are chosen as: f10x=dx, and f20x=0 and f10y=dy, and f20y=0.
In this case the above constraints result in:
A further constraint can be set by requiring that the velocity along z be constant with t, meaning that the t dependent terms in the expression of vz must have zero coefficients.
This puts the constraint to the b coefficients:
Applying this to the formula of x (and y symmetrically), we get:
and the velocity along x accordingly:
the expression of z:
To avoid t dependence of vx (and t2 dependence of x) b1x can set as b1x=0. This immediately implies b2x=0 that would result in vzx=0, unless the magnification between the cells and the objective in the x-z plane is 1: Mx=1.
If b1x=0 and Mx=1 simultaneously, very simple formulas arise for the coordinates, since only the slope of the frequency in the second deflectors x 12′ and y 22′ must vary with time. For this both magnifications Mx=My=1 should be constrained. This can be nearly satisfied with a setup involving long focal length (compared to the distances between the x and y deflectors 12, 12′, 22, 22′ and the deflector sizes I) lenses, or exactly satisfied with specially designed cylinder astigmatic lenses. In this simple case the coordinates are:
and the velocities:
But from the z constraints
When wishing to scan along an arbitrary continuous trajectory the above equations allow to set c1x, c1y and dy−dx so as to determine the desired x, y coordinates, whereas the z coordinate can be set accordingly by setting b2x, and b2y, using c1x and c1y determined from x and y.
The above-described embodiments are intended only as illustrating examples and are not to be considered as limiting the invention. Various modifications will be apparent to a person skilled in the art without departing from the scope of protection determined by the attached claims.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/HU2012/000001 | 1/5/2012 | WO | 00 | 10/6/2014 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2013/102771 | 7/11/2013 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20100328759 | Kirkby | Dec 2010 | A1 |
Entry |
---|
Kaplan et al. (Acousto-optic lens with very fast focus scanning, Optics Letters, vol. 26 No. 14, Jul. 2001, pp. 1078-1080). |
Number | Date | Country | |
---|---|---|---|
20150085346 A1 | Mar 2015 | US |