The present invention relates to methods and apparatus for determining one or both of information about a target object or attributes of incident radiation.
WO 2005/106531, which is incorporated herein by reference for all purposes, discloses a method and apparatus of providing image data for constructing an image of a region of a target object. Incident radiation is provided from a radiation source at the target object. An intensity of radiation scattered by the target object is detected using at least one detector. The image data is provided responsive to the detected radiation. A method for providing such image data via an iterative process using a moveable probe function is disclosed. The methods and techniques disclosed in WO 2005/106531 are referred to as a ptychographical iterative engine (PIE).
PIE provides for the recovery of image data relating to at least an area of a target object from a set of diffraction pattern measurements or to the determination of information associated with radiation illuminating the target object. Several diffraction patterns are recorded at a measurement plane using one or more detectors, such as a CCD or the like.
WO 2010/064051, which is incorporated herein by reference for all purposes, discloses an enhanced PIE (ePIE) method wherein it is not necessary to know or estimate a probe function. Instead a process is disclosed in which the probe function is iteratively calculated step by step with a running estimate of the probe function being utilised to determine running estimates of an object function associated with a target object.
Other methods are known which are referred to a coherent diffraction imaging (CDI) which are based on the measurement of scattered radiation, such as that by P Thibault, Dierolf, et al entitled “Probe Retrieval in Ptychographic Coherent Diffractive Imaging” disclosed in Ultramicroscopy, 109, 1256-1262 (2009) and WO2011033287 entitled “Method And Apparatus For Retrieving A Phase Of A Wavefield”, which is herein incorporated by reference, by the present inventor.
Ptychography, up until now, has relied on diffraction patterns measured using a regular 2D matrix of detector pixels. Whilst this is computationally convenient it is not always the most appropriate experimental configuration. It is the aim of embodiments of the invention to enable arbitrary detector geometries to be used in ptychography.
In ptychography object and illumination functions (plus, in some embodiments, other experimental parameters such as illumination positions) are iteratively refined until a set of forward propagated wavefronts (Ψh(u)) are consistent with radiation measured at a detector. In particular, whether an intensity of propagated wavefronts (Ψj(u)) are consistent with the intensity of radiation measured at the detector. For mathematical convenience the object and illumination functions are generally represented as 2D (or 3D) regular arrays. However experimental configurations and detector geometries may not perfectly match these regular arrays.
It is an object of embodiments of the invention to at least mitigate one or more of the problems of the prior art.
According to a first aspect of the present invention there is provided methods and apparatus as set forth in the appended claims.
According to an embodiment of the invention there is provided a method comprising determining an array of elements at which a wavefront is to be estimated, determining a mapping between one or more of a plurality of detector elements at which incident radiation is to be measured and one or more of the array elements.
In some embodiments, each detector element is associated with a plurality of array elements. In other embodiments, each array element is associated with a plurality of detector elements.
The mapping may be indicative of a portion of the array elements associated with the one or more detector elements. The mapping may comprise identification information for each detector element associated with each array element. Some array elements may not be associated with corresponding detector elements.
The mapping may comprise, for each array element, a weighting value. The weighting value may be indicative of a relative contribution of each array element to the detector element. The weighting value may be between first and second predetermined values. The second predetermined value, such as 1, may indicate a full contribution, whilst the first predetermined value may indicate less contribution, such as no contribution.
The wavefront may be estimated by a ptychographic method. The wavefront may be estimated by an iterative phase retrieval method. The wavefront estimated may be updated. The wavefront may be estimated based on a probe function indicative of one or more characteristics of radiation incident on an object or a post-object aperture, and an object function indicative of one or more characteristics of the object. The wavefront may be estimated by a direct calculation method
Embodiments of the invention will now be described by way of example only, with reference to the accompanying figures, in which:
A radiation source, which although not shown in
The lens 20 forms a probe function P(r) which is arranged to select a region of the target object 30 for investigation. The probe function selects part of an object exit wave for analysis. P(r) is the complex stationary value of this wave field calculated at the plane of the object 30.
It will be understood that rather than weakly (or indeed strongly) focusing illumination on the target object 30, unfocused radiation can be used with a post target aperture. An aperture is located post target object to thereby select a region of the target for investigation. The aperture is formed in a mask so that the aperture defines a “support”. A support is an area of a function where that function is not zero. In other words outside the support the function is zero. Outside the support the mask blocks the transmittance of radiation. The term aperture describes a localised transmission function of radiation. This may be represented by a complex variable in two dimensions having a modulus value between 0 and 1. An example is a mask having a physical aperture region of varying transmittance.
Incident radiation thus falls upon the up-stream side of the target object 30 and is scattered by the target object 30 as it is transmitted. The target object 30 should be at least partially transparent to incident radiation. The target object 30 may or may not have some repetitive structure. Alternatively the target object 30 may be wholly or partially reflective in which case a scattering pattern is measured based on reflected radiation.
An exit wave ψ(r) is formed after interaction of the illuminating radiation with the object 30. In this way ψ(r) represents a two-dimensional complex function so that each point in ψ(r), where r is a two-dimensional coordinate, has associated with it a complex number. ψ(r) will physically represent a wave that would emanate from the object 30. The object 30 can be represented by a complex function, O(r), with its complex value given by a modulus and phase which represent the modulus and phase alterations introduced by the object 30 into a perfect plane wave incident upon it. For a thin object (one in which the interaction between object 30 and probe can be approximated to occur in a single plane), the exit wave will be given by: ψ(r)=O(r)·P(r), however it will be understood that a more complex model can be used to generate the exit wave, such as a multi-slice calculation disclosed by the present applicant in WO2012038749. The probe function P(r) selects a part of the object exit wave function for analysis. It will be understood that rather than selecting an aperture, a transmission grating or other such filtering function may be located downstream of the object. The probe function P(r) may be an aperture transmission function. The probe function can be represented as a complex function with its complex value given by a modulus and phase which represent a complex stationary value of this wave field calculated at the plane of the object.
This exit wave ψ(r) may form a diffraction pattern Ψ(u) at a diffraction plane. Here u is a two-dimensional coordinate in a detector plane. The diffraction pattern Ψ(u) may be the Fourier transform of the exit wave ψ(r).
It will be understood that if the diffraction plane at which scattered radiation is detected is moved nearer to the specimen then Fresnel diffraction patterns will be detected rather than Fourier diffraction patterns. In such a case the propagation function from the exit wave ψ(r)) to the diffraction pattern Ψ(u) will be a Fresnel transform rather than a Fourier transform. It will also be understood that the propagation function from the exit wave ψ(r) to the diffraction pattern Ψ(u) may be modelled using other transforms.
In order to select the region of the target object 30 to be illuminated or probed, the lens(es) 20 or aperture may be mounted upon an x/y translation stage which enables movement of the probe function with respect to the object 30. Equally, it will also be realised that the object 30 may be moved with respect to the lens(es) 20 or aperture. The relative translation can be implemented by moving a translation stage in a grid arrangement of positions or a spiral arrangement among any others. It is also possible to rely on drift of probe or object to provide the translation diversities i.e. without using a translation stage or other means to cause movement of, for example, the object.
A detector 40 is a suitable recording device such as a CCD camera or the like which allows the diffraction pattern to be recorded. The detector 40 allows the detection of the diffraction pattern in a detector plane i.e. a plane different from that of the object 30. The detector 40 comprises an array of detector elements, such as in a CCD, as will be discussed in relation to
Referring to
The present inventors have determined that it is possible to map from a 2D regular array to the actual physical detector shape(s).
In the illustration of
It should be apparent that other numbers of segments may be envisioned, as could different physical arrangements such as quadranted concentric rings. Such detectors are often used in electron and optical microscopy.
A second illustration, as shown in
A third example is the general situation of a geometric distortion of a measured detector array 610, as shown in
Methods according to embodiments of the present invention also enable the accommodation of binned detectors, where the pixel size is larger than that used in the reconstruction algorithm i.e. at which a diffraction pattern is estimated, and sparse detectors where the pixel fill-factor is less than one, which may be significantly less than one.
To resolve the differences between the forward-calculated 2D array and the physical detector geometry, a detector mapping approach has been developed. Each detector element e is mapped to one or more pixel element(s) in a forward-calculated diffraction pattern wavefront array (Ψ(u)). A weighting coefficient between first and second values, such as 0 and 1, may be associated with each pixel element to account for partial overlap, as illustrated in
Continuing with example 1, if the four quadrants are labelled A, B, C and D, the first few entries in the map for quadrant A may be:
. . .
A reference or origin location is determined for the mapping. In the above example, the origin is the top-left pixel of the wavefront array is identified as 1,1. Where the first two numbers in brackets represent the x,y co-ordinates of the pixel elements mapped to that detector and the, optional, third number is the weighting factor. It will be appreciated that other representations of the map are also possible.
In the ptychographic methods, such as that disclosed by WO2005106531, which is herein incorporated by reference, the forward-calculated wavefront is updated using the measured diffraction pattern intensity as follows:
Where Ψnew (ψnew in the priority document) is the updated wavefront, Ψ is the forward-calculated wavefront (ψfwd in the priority document, where Ψ=ψfwd) and I(u) is the measured intensity at the detector plane. This is generally termed the “modulus projection”. All functions are 2D arrays, represented by the co-ordinate vector u.
Incoherent modes may be incorporated into a ptychographic reconstruction. In this case, the measured intensity is used to scale each pixel in each mode according to:
Where m is the mode number. The denominator inside the square root is essentially the incoherent sum of all modes.
In the prior art, the calculations rely on regular grids. Embodiments of the present invention enable arbitrary detector geometries to be used. Instead of incoherent modes, Eqn 2 can be applied to a sum of pixels in the forward-calculated wavefront, Ψfwd, incident on a detector element. Thus, as explained above with reference to example 1, each element of the detector, such as quadrant A, may be associated with a plurality of elements of the forward calculated wavefront.
For each detector element, the corresponding pixels in Ψfwd, mapped to it via the detector map, can be updated via:
Where e is the detector element mapped to pixels, px, in the forward-calculated wavefront and apx is the weighting factor for that pixel. Eqn 3 can therefore be applied to each element in the detector in turn, resulting in an updated wavefront for use in the remainder of the iterative ptychography reconstruction.
It is important to note that some pixels in the forward-calculated wavefront may not be mapped to a detector element. These pixels will therefore not be modified by Eqn 3, allowing for gaps between detector elements to be accommodated. The pixels in the forward calculated wavefront not mapped to detector elements are allowed to “float” where the pixel value is not updated; instead the forward-calculated value is retained.
The method utilises a set of J diffracted intensities, Ij (e), recorded by the detector 40, wherein each diffracted intensity Ij consists of a set of e detector elements. The method attempts to minimise a difference between the measured intensity Ij(e) of radiation and the forward calculated wavefront as mapped to the elements of the detector 40 as the measured intensity. This may be expressed as:
I
fwd=Σpx(e)(a(px(e))|Ψj(px(e))|2) Eqn 4
wherein Ifwd is the incoherent sum of all pixels in the forward calculated wavefront, px(e) mapped to each detector element, e, consisting of the square of the modulus of the wavefront incident upon the detector 40.
Within each iteration of the method an estimate of the probe and object functions is updated for each of the J diffraction patterns measured by the detector 40. An order of considering each of the J measured intensities is chosen. The order may be numerically sequential i.e. j=1, 2, 3 . . . J. In this case, beginning with diffraction pattern j and progressing through to J updated estimates of the probe P1(r) . . . PJ(r) and object O1(r) . . . OJ(r) are produced. However, considering the diffraction patterns in a raster fashion (each pattern in a row sequentially and each row sequentially) may cause problems particularly in relation to the estimate of the probe function drifting during the method. Therefore, in some embodiments, the diffraction patterns may be considered in a random or other pseudo-random order. However, for the purposes of explanation, a sequential ordering of the set of diffraction patterns will be considered.
Prior to a first (k=1) iteration of the method, initial probe P0 (r) 311 and object O0(r) 312 functions are selected. The initial probe P0 (r) and object O0(r) functions 311, 312 may be predetermined initial values, such as initial guesses i.e. pre-calculated approximations, random distributions, or may be based on other initial measurements or prior calculations. The functions are modelled at a number of sample points and are thus represented by matrices. Such matrices can be stored and manipulated by a computer or other such processing unit. In some embodiments, the sample points are equally spaced and form a rectangular array.
In step 320 an exit wave ψj(r) is determined by multiplying the current object and probe functions. For the first (k=1) iteration of the method, for the first probe position j=1, the initial probe P0(r) and object functions O0(r) are multiplied to determine the first exit wave ψ1(r). For subsequent iterations of the method, the currently selected function i.e. Oj(r) Pj(r) are multiplied to determine the current exit wave ψj(r).
In step 330 the exit wave ψj(r) is propagated to a measurement plane of the detector 40. The propagation produces an estimate Ψj(u) of the wavefront at the plane of the detector 40 as indicated by step 335. The exit wave ψj(r) is propagated to the measurement plane by a suitable transform T, as shown in Equation 5. In some embodiments, the transform T may be a Fourier transform, although in other embodiments the transform may be a Fresnel free space propagator. It is also envisaged that other transforms may be used which are suited to the particular application of the method.
Ψj(u)=T[ψj(r)] Equation 5
In step 340 a mapping is performed between the array of elements at which the forward calculated wavefront (u) is estimated and the elements e of the detector 40 at which incident radiation is measured. Similarly, in step 360 a reverse of the mapping is performed between an updated wavefront at the detector 40 and the array of elements at which the wavefront Ψj(u) was previously estimated. In some embodiments, steps 340, 360 (explained below) are integrated into a single step which includes the mapping in both directions (from and to the array of elements at which the forward calculated wavefront is estimated) and updating of the forward calculated wavefront based on the radiation measured by the detector 40.
In step 350 the forward calculated wavefront Ψj(u) at the plane of the detector 40 is updated based on the measured diffraction pattern Ije received in step 345 of
Ψj(u)=Aj(u)exp(iϕj(u)) Equation 6
A modulus of the forward calculated wavefront Ψj(u) may updated based on the measured intensity Ije. Therefore, as explained above with reference to Equations 3 and 4, for each detector element e, the updated wavefront Ψnew may be determined as:
In step 368 the updated wavefront Ψj,
ψ′j(r)=T−1[Ψj,new(u)] Equation 8
In steps 370 and 375 the probe and object function are updated. The updating provides an improved probe Pj+1(r) and object guess OJ+1(r). The updating may be performed as described in the incorporated reference WO 201/064051, or by any other method. As described in WO 201/064051, the object function may be updated according to Equation 9 and the probe function according to Equation 10:
The parameter α governs the rate of change of the object guess. This value may be adjusted between 0 and 2 as higher values may lead to instability in the updated object guess. According to embodiments of the present invention the probe function is reconstructed in much the same manner as the object function. Aptly the probe function guess is carried out concurrently with the update of the object guess. (It will be appreciated that the probe Function could optionally be updated more often or less often than the object Function).
The result of this update function generates the running estimate for the probe function. The parameter β governs the rate of change of the probe guess. This value may be adjusted between 0 and 2 as higher values may lead to instability in the updated probe guess.
In step 380 it is determined whether every probe position for the current iteration has been addressed. In other words, it is determined in some embodiments whether j=J. If the current probe position is not the last probe position of the current iteration, then the next probe position is selected. The next probe position may be selected in step 385 by j=j+1. However, if the current probe position is the last probe position for the current iteration, then the method moves to step 390.
In step 390 it is determined whether a check condition is met. In some embodiments, the check condition may be determining whether the current iteration number k is a predetermined value, such as k=100 i.e. determining whether a predetermined number of iterations have been performed. Whilst this check is computationally easy, it takes no account of the accuracy of the image data. Therefore, in some embodiments, the check condition compares a current estimate of the diffraction pattern against that recorded by the detector 40. The comparison may be made considering a sum squared error (SSE) as in Equation 11:
Where N is a number of pixels in the array representing the wave function. The method may end when the SSE meets one or more predetermined criteria, such as being below a predetermined value.
If the predetermined criteria is not met, then the method moves to step 395 in preparation for a next iteration (k=k+1) where the probe position is reset i.e. the first probe position is reselected, such as j=1.
As can be appreciated, embodiments of the present invention provide methods whereby a detector having a plurality of elements can be used to measure an intensity of radiation, wherein the plurality of elements do not correspond directly to an array of elements at which the radiation is estimated.
It will be appreciated that embodiments of the present invention can be realised in the form of hardware, software or a combination of hardware and software. Any such software may be stored in the form of volatile or non-volatile storage such as, for example, a storage device like a ROM, whether erasable or rewritable or not, or in the form of memory such as, for example, RAM, memory chips, device or integrated circuits or on an optically or magnetically readable medium such as, for example, a CD, DVD, magnetic disk or magnetic tape. It will be appreciated that the storage devices and storage media are embodiments of machine-readable storage that are suitable for storing a program or programs that, when executed, implement embodiments of the present invention. Accordingly, embodiments provide a program comprising code for implementing a system or method as claimed in any preceding claim and a machine readable storage storing such a program. Still further, embodiments of the present invention may be conveyed electronically via any medium such as a communication signal carried over a wired or wireless connection and embodiments suitably encompass the same.
All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and/or all of the steps of any method or process so disclosed, may be combined in any combination, except combinations where at least some of such features and/or steps are mutually exclusive.
Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise. Thus, unless expressly stated otherwise, each feature disclosed is one example only of a generic series of equivalent or similar features.
The invention is not restricted to the details of any foregoing embodiments. The invention extends to any novel one, or any novel combination, of the features disclosed in this specification (including any accompanying claims, abstract and drawings), or to any novel one, or any novel combination, of the steps of any method or process so disclosed. The claims should not be construed to cover merely the foregoing embodiments, but also any embodiments which fall within the scope of the claims.
Number | Date | Country | Kind |
---|---|---|---|
1520426.6 | Nov 2015 | GB | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/GB2016/053621 | 11/21/2016 | WO | 00 |