The invention relates to an optical scanning device comprising:
P
mn
=mT
1
+nT
2 (m=1 to L1, n=1 to L2)
P
mn
=mT
1
+nT
2 where (m=1 to L1, n=1 to L2)
Optical scanning microscopy is a well-established technique for providing high resolution images of microscopic samples. According to this technique, one or several distinct, high-intensity radiation spots are generated in the sample. Since the sample modulates the radiation of the radiation spot, detecting and analyzing the radiation coming from the radiation spot yields information about the sample at that radiation spot. A full two-dimensional or three-dimensional image of the sample is obtained by scanning the relative position of the sample with respect to the radiation spots. The technique finds applications in the fields of life sciences (inspection and investigation of biological specimens), digital pathology (pathology using digitized images of microscopy slides), automated image based diagnostics (e.g. for cervical cancer, malaria, tuberculosis), and industrial metrology.
A radiation spot generated in the sample may be imaged from any direction, by collecting radiation that leaves the radiation spot in that direction. In particular, the radiation spot may be imaged in transmission, that is, by detecting radiation on the far side of the sample. Alternatively, a radiation spot may be imaged in reflection, that is, by detecting radiation on the near side of the sample. In the technique of confocal scanning microscopy, the radiation spot is customarily imaged in reflection via the optics generating the radiation spot, i.e. via the spot generator.
U.S. Pat. No. 6,248,988 proposes a multispot scanning optical microscope featuring a two-dimensional array of multiple separate focussed light spots illuminating the object and a corresponding array detector detecting light from the object for each separate spot. Scanning the relative positions of the array and object at slight angles to the rows of the spots then allows an entire field of the object to be successively illuminated and imaged in a swath of pixels. Thereby the scanning speed is considerably increased.
The array of radiation spots required for this purpose is usually generated from a collimated beam of light that is suitably modulated by a spot generator so as to form the radiation spots at a certain distance from the spot generator. According to the state of the art, the spot generator is either of the refractive or of the diffractive type. Refractive spot generators include lens systems such as micro lens arrays, whereas diffractive spot generators include phase structures such as the binary phase structure proposed in WO2006/035393.
The detector on which the array of radiation spots is imaged generally has an aspect ratio which does not differ substantially from one. In other words, the sensitive area is typically more or less quadratic. Off-the shelf image sensors typically have an aspect ratio of 3:4 or 4:5, which is suitable for viewing images on conventional displays. The use of off-the-shelf components is preferred from the point of view of cost. Furthermore, in order to maximize use of the sensitive area of the image sensor, the aspect ratio of the array of radiation spots is generally chosen to match the aspect ratio of the image sensor.
It is an object of the present invention to provide means and methods for optically scanning a sample using a two dimensional array of spots, wherein the throughput is increased as compared to the state of the art.
According to the invention, the angle γ between the scanning direction and the first lattice vector T1 is at most as large as the angle between the scanning direction and the second lattice vector T2, and the ratio L1/L2 is less than 0.6. Of the two lattice vectors, T1 is thus the one that is more aligned to the scanning direction than the other one. As is shown the Appendix B, the aspect ratio μ=L1/L2 being less or equal √⅓≈0.6 is a necessary condition for the throughput of the scanning device to be maximum for a given frame rate of the photodetector and a given extension and resolution of the array. Although this specific value has been derived for an array having square unit cells (see the Appendix B) it can also be advantageously applied to the case of an array having a hexagonal unit cell, the latter being very similar to an array having a square unit cell due to the fact that for both array types the lattice vectors T1 and T2 have the same magnitude (that is, |T1|=|T2|) and define an angle of comparable magnitude. In the case of a square unit cell T1 and T2 define a right angle while in the case of a hexagonal unit cell T1 and T2 define an angle of 60°. The extension D (length of the longer diagonal of the array) is usually determined by the available field of view of the collection optical system, i.e. the optical system collecting the spot array after it has interacted with the sample. For a given value of the extension D and a given resolution R, the aspect ratio μ=L1/L2 and the number L1 are not independent (see again Appendix B). Thus the condition μ<0.6 implicitly sets an upper bound for L1. As is seen from Appendix A, the alignment tolerance of the array is thereby improved. The range L1/L2<0.6 is also preferred for the reason that the throughput is increased with respect to the prior art assuming that the minimum read-out period (the inverse of the frame rate) required for detecting the radiation spots (using, e.g., a pixelated image sensor) is proportional to the size of the image of the array of light spots. These aspects are further elucidated in Appendices A and B. The notations (Lx, Ly) and (L1, L2) are used synonymously in this application. The notation (Lx, Ly) is generally used when referring to an array having a square unit cell.
The ratio L1/L2 may be less than 0.4. In fact, for a sufficiently large value of β=2D/R and a given frame rate F, maximizing the throughput requires L1/L2<0.4.
The ratio L1/L2 may be less than 0.2. In fact, for a sufficiently large value of β=2D/R and a given frame rate F, maximizing the throughput requires L1/L2<0.2.
The value L1 may advantageously be 2, 3, or 4. These values are advantageous if the sensitive area of a detector for imaging the array of radiation spots is matched to the size of the array, assuming that the frame rate of the detector is inversely proportional to the size of the sensitive area. Furthermore, alignment tolerances are particularly large for these values of L1.
According to a preferred embodiment, the product L1L2 is maximum or the area of the lattice unit cell is minimum, with a tolerance of 10%, under the constraint that the shape of the unit cell, the resolution, and the length of a lattice diagonal are fixed. Thereby the throughput of the scanning device is maximized, assuming either that the frame rate of the detector is given or that the frame rate is inversely proportional to the size of the area of radiation spots.
The unit cell of the lattice is preferably a square or a hexagon. A lattice having a square unit cell is particularly simple to implement. A lattice having a hexagonal lattice cell allows for closest packing of radiation spots, thereby maximizing the number of radiation spots per area.
According to a preferred embodiment, L1 differs from Λ by less then 1.0 or L1 equals Λ with a tolerance of 10%, Λ being defined by
√{square root over (2)}D/R=(1+Λ2)Λ,
D being the length of a lattice diagonal and R being the resolution. Thereby the throughput is optimized for any given detector having a fixed frame rate, as shown in Appendix B.
Preferably the optical scanning device further comprises a detector and imaging optics for generating an optical image of the array of radiation spots on the detector. More preferably, the detector is a pixelated image sensor.
Preferably the detector has an essentially circular field of view and the image of a lattice diagonal measures between 0.9 and 1.0 times the diameter of the field of view of the detector. Thus the image of the array of radiation spots fits comfortably into the field of view.
The detector may have a sensitive area having an aspect ratio between 3:4 and 4:3. Such detectors are readily available and provide an economic solution although the aspect ratio of the sensitive area does not match the aspect ratio of the array of radiation spots. Advantageously, unused portions of the sensitive area can be deactivated to increase the frame rate.
The spot generator preferably comprises a binary phase structure or an array of microlenses. The spot generator thus allows modulating an incident radiation beam to form the desired array of radiation spots at a desired distance from the spot generator.
The optical scanning device may be a microscope.
The optical scanning method according to the invention is characterized in that the angle γ between the scanning direction and the first lattice vector T1 is at most as large as the angle between the scanning direction and the second lattice vector T2, and the ratio L1/L2 is less than 0.6.
The method may comprise the additional step of generating an optical image of the array of radiation spots on a detector. Preferably the detector is a pixelated image sensor.
Preferably a portion of a sensitive area of the detector is deactivated. As stated above, the aspect ratio of the array of radiation spots is preferably substantially less than one. Yet standard image sensors have a rectangular sensitive area that is more or less quadratic, with aspects ratios not smaller than 3:4. Thus, when the array according to the invention is projected onto the image sensor, a substantial portion of the sensor's surface is superfluous. The frame rate of the sensor can then be substantially increased by deactivating the unused portion of the surface, that is, by reading out only the portion of the surface covered by the array of radiation spots.
In the drawings, similar or analogous features appearing in different figures are designated using the same reference numerals and are not necessarily described more than once.
Referring to
where F is the frame rate of the image sensor.
Referring now to
Another exemplary embodiment (not shown) uses a 28×142 spot array, so 3976 spots and an aspect ratio 0.20. The resolution is 0.51 μm, the pitch 7.20 μm, and the field of view is 1.04 mm (which fits a 20× objective on the imaging side). The accuracy in aligning the skew angle must be better than 1.3 mrad, which is feasible. The image sensor can have 1024×1280 pixels (1.3 Mpix, aspect ratio 4:5) with a nominal frame-rate of 500 Hz. By the use of windowing the frame-rate can be increased with a factor of 4. The throughput follows as 0.53 mm2/sec, which allows for imaging a histo-pathology slide with typical relevant area of 15 mm×15 mm in about 7 minutes.
A further increase in throughput may be achieved by using non-square spot arrays, in particular in using a hexagonal spot array. Generally, the array can be characterized by the lateral position of the spots of the array being given by Rnm=np1E1+mp2E2, where n and m are integers labelling the spots, E1 and E2 are independent unit-vectors in the plane of the array, and p1 and p2 are the pitches in the direction of E1 and E2. The pitches must be larger than the smallest allowed distance between any two spots. Closest packing of spots (and hence largest number of spots) is then obtained if p1=p2=p. Furthermore, the angle α between the unit vectors E1 and E2 must be larger than π/3=60° in order to maintain the minimum spot separation p. It turns out that the total number of spots in the array L is independent of α, and that the aspect ratio of the spot array is proportional to 1/sin α. It follows that the minimum aspect ratio is obtained for the hexagonal spot array (α=π/3). Using windowing in the readout of the image sensor can thus increase the throughput with a factor 1/sin(π/3)=2/√3=1.15 compared to the case of a square array, i.e. a 15% increase in throughput can be realized in this way.
Referring to
While the invention has been illustrated and described in detail in the drawings and in the foregoing description, the drawings and the description are to be considered exemplary and not restrictive. The invention is not limited to the disclosed embodiments. Equivalents, combinations, and modifications not described above may also be realized without departing from the scope of the invention.
The verb “to comprise” and its derivatives do not exclude the presence of other steps or elements in the matter the “comprise” refers to. The indefinite article “a” or “an” does not exclude a plurality of the subjects the article refers to. It is also noted that a single unit may provide the functions of several means mentioned in the claims. The mere fact that certain features are recited in mutually different dependent claims does not indicate that a combination of these features cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.
The array of spots consists of Lx columns and Ly rows, and has a pitch p. The scan direction makes an angle γ with the rows, so that the set of spots generates a set of equidistant scan lines. The line spacing is R/2, with R the resolution. This scanning method implies that:
p sin γ=R/2
p cos γ=LxR/2.
These relations are also given in U.S. Pat. No. 6,248,988. It follows that the number of spots in the x-direction is given by:
In the case of a misalignment the angle γ (as defined in terms of resolution R, pitch p and number of columns Lx) may be have a different value γ′=γ+δγ. The question is how this will affect the image. Suppose we label the spots in the array with a pair of integers (i,j) labelling rows and columns, so i runs from 1 to Ly and j runs from 1 to Lx. Taking the origin of our (x,y) coordinate system at the lower left spot (Ly,1) it follows that the x and y-position of spot (i,j) are given by:
x
ij=cos γ′(j−1)p−sin γ′(Ly−i)p
y
ij=sin γ′(j−1)p+cos γ′(Ly−i)p.
Expanding to first order in δγ and eliminating p and γ in favour of R and Lx gives that:
In the well aligned case δγ=0 the spots are located on equidistant scan lines, spaced by a distance R/2. We may label the scan lines with an integer index k=i−1+Lx(Ly−j), which takes values 1, 2, 3, . . . , LxLy. The y-value of scan line with index k is then simply (k−1)R/2. There is a delay between adjacent scan lines in the scan direction (the x-direction). The delay between scan lines that are both in the same row is Lx samples (the scanner takes samples spaced with R/2), the delay between the last scan line of a row and the first of the adjacent row is Lx(Lx−1)+1 samples.
In the misaligned case the different scan lines are no longer equidistant, and the delay of adjacent scan lines is no longer an integer amount of samples. This will result in a distorted image. The spacing between adjacent scan lines in the same row is now (1+Lxδγ)R/2 and amounts to a uniform stretch in the y-direction, which is not too big of a problem, as it means that the resolution of the image is now slightly different, namely R′=(1+Lxδγ)R. The spacing between the last scan line of a row and the first of the adjacent row is (1−(Lx(Lx−1)δγ)R/2≦(1−(Lx2+1)δγ)R′/2, which differs from the stretched resolution R′ by an amount (Lx2+1)δγR′/2. This must be much less than the nominal scan line spacing R/2, so we must require that:
It follows that a small Lx and hence a small ratio 2p/R is advantageous from the point of view of alignment. This condition is also sufficient to guarantee that the delay between adjacent scan lines is much less than the sampling distance R/2.
In the following a lattice with square unit cell is considered. An analogous consideration applies for a lattice having a non-square unit cell, in particular a hexagonal unit cell.
The throughput B of the scanning device is defined as the scanned area per time. In the case of a two dimensional array,
where R is the resolution, L=LxLy is the total number of radiation spots, and F is the frame rate. The lattice pitch p satisfies (see
The length D of the lattice diagonal satisfies
p
2
L
x
2
+p
2
L
y
2
=D
2
which can be rewritten as
The parameter
is assumed fixed. The number of rows Ly thus depends on the number of columns Lx according to
We thus obtain the following relation between the total number of points L and the number of columns Lx:
which may be expressed as
where q=Lx2 and f=L2. The first and second derivatives of f with respect to q are
The first derivative f′ is seen to vanish for q=q0, where q0 satisfies
Furthermore f″(q0) is negative. Hence f (q) assumes a maximum for q=q0. It is further noted that this is also the only maximum. It is concluded that for a given value of β and a given frame rate F, the throughput is maximum if Lx is the integer number that best satisfies
In other words, in order to maximize the throughput under the constraint β=constant, Lx must differ from the real number Λ by less than 1, Λ satisfying
It is mentioned that the same result can be established working with the independent variables Lx and Ly and taking into account the constraint (1+Lx2)(Lx2+Ly2)=β2 by means of a Lagrange multiplier or by using the ratio x=2p/R or the aspect ratio as independent variable.
For any values of Lx and Ly the aspect ratio
satisfies
Inserting for q the optimum value q0 determined above and using the identity β2=2q0(1+q0)2 yields
where μ0 is the aspect ratio for q=q0, that is, μ0 is the optimum aspect ratio. Since q0≧1, the optimum aspect ratio satisfies
The optimum pitch p0, that is, the pitch
is found to satisfy
In the case of a lattice having a non-square unit cell, in particular a hexagonal unit cell, an analogous relation holds, with the left-hand side replaced by the area of the unit cell.
It is also possible to establish a direct relation between the number of spots and the aspect ratio. Eliminating Lx from the equations above gives
This function takes a maximum at the point defined by the analysis above. In practice the field of view is so large that several thousands of spots can be accommodated. This means that the parameter β is very large, typically in the range 1000-5000. For these values of β, the optimum aspect ratio is given to a good approximation by:
The error is less than 2% for β>10 and less than 0.1% for β>1000.
It is interesting to compare the optimum throughput B0 (that is, the throughput for q=q0) to the throughput BSQR obtained with a square array having the same parameter β. Substituting Ly=Lx in the identity (1+Lx2)(Lx2+Ly2)=β2 and solving for Lx2 gives
For large values of β, that is, for β>>1, and assuming that the same frame rate F is the same for the optimum array and the square array one obtains:
For large values of β the throughput is thus increased by a factor of approximately 1.4 with respect to a square array.
Next the case is examined in which the photosensor is adapted to the array of radiation spots such that its frame rate F is inversely proportional to the area of the array:
In this case the throughput
is inversely proportional to the area of the lattice unit cell, that is:
The throughput then increases as Lx decreases and has a minimum for Lx=1.
Number | Date | Country | Kind |
---|---|---|---|
08305063.3 | Mar 2008 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB2009/051069 | 3/16/2009 | WO | 00 | 9/17/2010 |