The invention relates to a method of imaging a specimen using an X-ray imaging apparatus, comprising the following steps:
The invention also relates to an X-ray imaging apparatus that can be used in performing such a method.
The invention further relates to a charged-particle microscope provided with such an X-ray imaging apparatus.
X-ray imaging has various important applications in, for example, medical science, forensics, metallurgy/materials science, structural performance/integrity studies, geology/petrology, lithography, security screening, etc. Traditionally, the employed X-ray source generates Bremsstrahlung (and characteristic/element-specific) X-rays by bombarding a metal source with a high-energy electron beam. These X-rays are directed so as to traverse the specimen in question (which may, for example, be a portion of a larger body) and then land on an X-ray imaging device (camera, detector) such as a CCD image sensor, for instance. The image thus registered will in many situations be used “as is”; however, in other situations, a collection of such images will be acquired along different lines of sight relative to the specimen, and these will then be used to construct an X-ray tomogram.
In tomographic imaging (also referred to as Computed Tomography (CT)), there are various ways to achieve a series of different lines of sight as alluded to above. For example, one can choose to:
As regards the specimen/source relative motion employed to achieve different lines of sight [data acquisition step], use is conventionally made of:
See, for example, the following reference:
The “raw” imaging data obtained in the data acquisition step can subsequently be used as a basis for tomogram construction [data processing step]. For example:
Tomographic imaging as referred to here can be performed using a standalone apparatus, which is conventionally the case in medical imaging applications, for example, where the specimen (e.g. a human or animal) is macroscopic. Standalone CT tools are also available for performing so-called “micro CT”, in which a micro-focused source is used to image microscopic specimens, e.g. in geology/petrology, biological tissue studies, etc. Continuing this drive toward ever-greater resolution, so-called “nano CT” instruments have also been developed; these may be standalone tools, but, for example, they may also be embodied as (add-on) modules for (a vacant vacuum/interface port of) a charged-particle microscope (CPM), in which case the CPM's charged-particle beam can be used to irradiate a metal target, causing production of Bremsstrahlung (and characteristic) X-rays that are then used to perform the desired tomography (see
wikipedia.org/wiki/X-ray_microtomography
wikipedia.org/wiki/Nanotomography
www.ndt.net/article/dir2007/papers/24.pdf
It should be noted that, as referred to here in the context of a CPM, the phrase “charged particle” should be broadly construed as encompassing:
wikipedia.org/wiki/Electron_microscope
wikipedia.org/wiki/Scanning_electron_microscope
wikipedia.org/wiki/Transmission_electron_microscopy
wikipedia.org/wiki/Scanning_transmission_electron_microscopy
wikipedia.org/wiki/Focused_ion_beam
wikipedia.org/wiki/Scanning_Helium_Ion_Microscope
W. H. Escovitz, T. R. Fox and R. Levi-Setti, Scanning Transmission Ion Microscope with a Field Ion Source, Proc. Nat. Acad. Sci. USA 72(5), pp 1826-1828 (1975).
www.ncbi.nlm.nih.gov/pubmed/22472444
It should also be noted that, in addition to imaging and/or surface modification, a charged particle beam in a CPM may also have other functionalities, such as performing spectroscopy, examining diffractograms, etc.
Although known X-ray imaging methods/apparatus produce tolerable imaging results, there is always room for improvement. In that context, the current inventors have worked extensively to identify shortcomings in conventional X-ray imaging approaches, and to address these effectively so as to produce improved performance. The results of such endeavor are the subject of the current application.
It is an object of the invention to provide an innovative X-ray imaging method/apparatus. More specifically, it is an object of the invention that this technique should employ a radically different illumination strategy as compared to known techniques.
These and other objects are achieved in a method as set forth in the opening paragraph above, which method is characterized by the following steps:
The invention achieves various different advantages—both physical and mathematical in nature—which can be set forth as follows:
(i) In order to achieve fast imaging—with sufficient signal-to-noise ratio (SNR)/contrast-to-noise ratio (CNR)—one would like to employ a high X-ray flux, since this will deliver a relatively large X-ray dose in a relatively short time span. This is of particular importance in tomographic imaging, where a large number (e.g. hundreds) of individual images has to be acquired (for input into the tomogram reconstruction process), and where a given throughput penalty per image will ultimately add up to a relatively severe cumulative imaging delay. To address this problem and achieve higher X-ray flux, one might consider increasing the beam current of the bombarding electron beam in the X-ray source; however, such an increase will eventually run up against a thermal limit, since an excessively high beam current will ultimately cause the bombarded metal target to start melting. This problem is exacerbated in the case of the relatively small metal targets used in micro CT and nano CT, where the limited target volume constrains the available total current. The invention addresses this problem by providing the opportunity to simultaneously use the X-ray flux from several sub-sources (component sources) at once; in this way, the beam current per source can be kept (just) low enough to prevent source melting, and higher flux is instead achieved using source multiplicity. The obvious problem with this approach is that the composite (integrated) image thus registered by the detector will be a “blurred mess” of (only partially overlapping) individual images from each of the component sources—something which would normally render such an approach unviable. However, the current invention solves this problem by using innovative mathematical deconvolution techniques to “disentangle” the composite image, and render it just as usable as a conventional, single-source image.
(ii) By working with a cluster of component sources instead of a single source, the inventive method introduces new variables, which can be tuned for image optimization purposes. In particular, the invention opens the way to optimize the source configuration (number/spatial distribution/angular spread of component sources) to match a given specimen type/structure. For example:
In a particular embodiment of the invention, said deconvolution is performed using an iterative re-weighted convergence technique employing a Point Spread Function kernel for said cluster of component sources. In this regard, the following deserves mention:
(I) Examples of Iterative Re-weighted Convergence (IRC) techniques include, for example, iterative re-weighted least-squares (IRLS) optimization, iterative re-weighted/l minimization, etc. See, for example the following reference:
wikipedia.org/wiki/Iteratively_reweighted_least_squares
Considered in general terms, such techniques seek to iteratively minimize a chosen divergence criterion. In this regard, many different divergence criteria can be chosen, depending on the particulars of a given situation (e.g. a particular noise model employed, such as Gaussian or Poisson). Examples include Least Squares Distance, Csiszar-Morimoto F-divergences, Bregman Divergences, Alpha-Beta-Divergences, the Bhattacharyya Distance, the Cramér-Rao Bound, and derivatives/combinations of these.
With regard to these broad divergence classes, the following can be noted:
wikipedia.org/wiki/F-divergence.
wikipedia.org/wiki/Bregman_divergence
wikipedia.org/wiki/Bhattacharyya_distance
For additional information, see, for example:
wikipedia.org/wiki/Least_squares
wikipedia.org/wiki/Kullback-Leibler_divergence wikipedia.org/wiki/Cramer-Rao_bound
(II) The Point Spread Function (PSF) kernel can, for example, be determined by recording a camera image of the employed cluster of component sources in the presence of a test specimen comprising a feature that emulates a Dirac delta function—such as a small hole, or a small absorbing body (e.g. gold sphere), for instance; this essentially produces a “pinhole image” of the kernel. Alternatively, it may be calculated/modeled for a given cluster configuration, e.g. using a Monte Carlo method. Yet another possible approach is to just image the source using a SEM (e.g. in backscatter mode). Such steps can be performed before or after (or during) specimen imaging with the cluster in question.
(III) If desired, the IRC technique can be regularized by incorporating into the optimization process an extra (additive) term that is a function of image gradient.
For a further elucidation of these points, see (for example) Embodiment 7 below.
In a particular embodiment of the current invention, the distribution of component sources is non-regular, i.e. the cluster of sub-sources in the inventive source has a geometrically non-regular arrangement. As opposed to a regular distribution—in which the component sources are arranged on (the nodes of) a regular “grid”, such as an orthogonal, hexagonal or nested-circular grid, for instance—the component sources in the present arrangement cannot be fitted to a strict grid; as a result, the associated Fourier spectrum will tend to be “flatter”, as opposed to being dominated by the characteristic frequencies associated with a regular grid. This effect becomes more pronounced as the distribution becomes more irregular, and is optimum for a random/pseudo-random distribution. Such a “Fourier space-filling” arrangement can be of particular benefit when imaging substantially “homogeneous” specimens, such as biological tissue or grained mineralogical matrix, for example.
As regards the size (angular extent) of the inventive cluster of sub-sources, the following considerations deserve mention. Consider a smallest circle that just encapsulates a given cluster configuration, and whose plane is substantially normal to an axis extending from a barycenter Cs of the specimen toward a barycenter Cc of the cluster. The diameter of this circle is W, and this will subtend a given (planar) “opening angle” θ at Cs, with a value dependent on the distance L from Cs to Cc. If W is relatively small relative to L, then θ˜W/2L (radians) or (180/π)×W/2L (degrees). In the current invention, the angular span (distribution, extent) of the cluster of component sources is “confined” in that θ<<180°, so that the cluster only occupies a relatively (very) small area of a hemisphere of radius L centered on Cs. For example, one can choose an angular distribution/cluster size that satisfies θ<10°, preferably θ<5°, and even more preferably θ<1°. In a specific set-up, for instance, the inventors used W≈2 μm and L≈200 μm, resulting in θ≈0.3°. A tendency seen by the inventors in various experiments was that, in the current invention, the resolution of the deconvolved image tends to be better when using relatively confined/compact clusters (i.e. relatively small θ values).
In an exemplary embodiment of the present invention, the following applies:
In the embodiment just described, the combination of supporting material+suspended bodies essentially acts as a sort of “spatial filter”, whose (fixed) configuration/pattering will cause localized generation of X-rays at some locations (the coordinates of the metallic bodies) with intervening areas of insignificant X-ray generation (in the supporting low-Z material). In an alternative/supplemental embodiment to that set forth in the preceding paragraph—which provides flexible/“programmable” configuration possibilities—the employed source comprises an array of individually selectable FEGs (Field Emission Guns; which may be of cold-cathode or Schottky type, for example). Such arrays are, for example, known from electron-beam lithography, where they are employed to produce a grid of electron beams that are used to simultaneously write a corresponding grid of pattern subsections on a semiconductor substrate. In the current invention, however:
Note that, in embodiments in which the component sources are fired sequentially rather than simultaneously, one might ask why the camera doesn't make a separate image for each firing event rather than acquiring an integrated/composite image. One reason is that the (relatively slow) capture rate of the employed camera may not be able to keep pace with a (relatively fast) firing rate of the component sources (chosen so as to mitigate thermal issues in the source, for example).
The invention will now be elucidated in more detail on the basis of exemplary embodiments and the accompanying schematic drawings, in which:
If one wants to perform a tomographic imaging series, then the procedure in the preceding paragraph can be repeated for a series of different viewing axes Vi, allowing the specimen S to be viewed along different lines of sight; thereafter, the various images acquired in this manner are used as input to a mathematical reconstruction procedure to produce a tomogram. The various viewing axes Vi are achieved by employing a stage apparatus to produce relative motion between the source Sx and specimen S, e.g. by producing translational/rotational motion of the source Sx/camera D and/or the specimen S in a pre-determined way. Such stage apparatus may, for example, comprise one or more linear motors, piezoelectric actuators, stepper motors, voice coil motors, pneumatic/hydraulic actuators, etc., and can readily be tailored by the skilled artisan to suit the needs of a given setup. In the specific embodiment depicted here, stage apparatus A can translate/rotate specimen S relative to source Sx/camera D.
Also shown in the Figure is a virtual reference surface Sr, which, in this case, is a cylindrical surface whose cylindrical axis coincides with longitudinal axis L. This reference surface Sr has a radius Rsr, chosen to be less than or equal to the distance Rsx of the source Sx from the axis L. The viewing axis Vi intersects this reference surface Sr at intersection point Pi. Note that, if viewing axis Vi is projected linearly along L, it will coincide with a diameter of a virtual disc-shaped terminal surface St at butt ends of the surface Sr. Associated with the reference surface Sr is a cylindrical coordinate system (R, θ, Z). The set {Pi} of intersection points Pi corresponding to the abovementioned series of viewing axes Vi can be regarded as representing a “data acquisition locus”, such as the circular or helical scanning path referred to above, or the lattice-like locus set forth in aforementioned patent application EP15181202.1, for example.
In the prior art, the source Sx shown in
Considering the axis Vi of
With regard to the discussion above, the following non-limiting data can be mentioned:
As an alternative to the set-up shown in
Note that the inventive source illustrated in
The particle-optical column 3 comprises an electron source 17 (such as a Schottky emitter), (electrostatic/magnetic) lenses 19, 21 (in general, more complex in structure than the schematic depiction here) to focus the electron beam 5 onto the specimen 13, and a deflection unit 23 to perform beam deflection/scanning of the beam 5. When the beam 5 impinges on/is scanned across the specimen 13, it will precipitate emission of various types of “stimulated” radiation, such as backscattered electrons, secondary electrons, X-rays and cathodoluminescence (infra-red, visible and/or ultra-violet photons); one or more of these radiation types can then be sensed/recorded using one or more detectors, which may form an image, spectrum, diffractogram, etc., typically by assembling a “map” (or “matrix”) of detector output as a function of scan position on the specimen. The present Figure shows two such detectors, 25, 27, which may, for example, be embodied as follows:
The microscope 1 further comprises a controller/computer processing unit 31 for controlling inter alia the lenses 19 and 21, the deflection unit 23, and detectors 25, 27, and displaying information gathered from the detectors 25, 27 on a display unit 33 (such as a flat panel display); such control occurs via control lines (buses) 31′. The controller 31 (or another controller) can additionally be used to perform various mathematical processing, such as combining, integrating, subtracting, false colouring, edge enhancing, and other processing known to the skilled artisan. In addition, automated recognition processes (e.g. as used for particle analysis) may be included in such processing.
Also depicted is a vacuum port 7′, which may be opened so as to introduce/remove items (components, specimens) to/from the interior of vacuum chamber 7, or onto which, for example, an ancillary device/module may be mounted (not depicted). A microscope 1 may comprise a plurality of such ports 7′, if desired.
If desired, the microscope 1 can also comprise an in situ CT module 7″ as shown in
Such a CT module 7″ may be permanently present (ab initio) in the vacuum enclosure 7, or it may be an add-on module that can be mounted (post-manufacture of the CPM 1) on/within a spare vacuum port 7′, for example.
Reconstruction Algorithms for a Compound/Composite Source (Patterned Source)
In the following, the imaging process is modeled using a convolution operation, where y is the measured image, h the point spread function kernel, x the unknown ‘un-blurred’ image and * the convolution operator:
y=h*x (1)
In Bayesian terms, one can represent the probability of the sought image x given the known image y as
P(x|y)=P(y|x)P(x) (2)
Examples of likelihood functions P(y|x) that can be used include the following:
A. Levin, et al., Image and depth from a conventional camera with a coded aperture,
ACM Transactions on Graphics (TOG) 28(3) (ACM), 2007.
Any of the previously mentioned optimization techniques can be used. In particular the Iterative Re-weighted Least Square (IRLS) method proves effective in solving (8). It is to be noted that, in (7) and (8), one assumes prior knowledge of the PSF kernel h, which encodes the way the ideal image pixels are mixed in the blurred observed image. Such knowledge of h can be obtained by imaging the source pattern in the absence of the sample, from theoretical optical modeling, or from simulations, for example. If one cannot discern h beforehand, then one can alternately solve for both variables x and h in a so-called blind reconstruction problem. In this case (8) will be reformulated as:
Additionally, if the kernel h is characterized with high-resolution—e.g. using measurements, theoretical knowledge or simulation—one can recover a super-resolved image from the observed image using compressive sensing techniques. In this task, one represents the convolution imaging process of (1) by a matrix-vector multiplication, by serializing x and y while representing the kernel h by the corresponding matrix operator H, leading to:
y=D·H·x (10)
where D is a down-sampling matrix operator (e.g. sampling every other image pixel). In the well-known compressive sensing approach, the reconstruction task can be cast as a constrained ti-minimization problem:
Various methods can be employed to solve for (11), such as Linear Programming, Basis Pursuit De-noising, Orthogonal Matching Pursuit and Iterated Hard Thresholding, for example.
Number | Date | Country | Kind |
---|---|---|---|
15195079 | Nov 2015 | EP | regional |
Number | Name | Date | Kind |
---|---|---|---|
9390881 | Yun | Jul 2016 | B2 |
20090185660 | Zou | Jul 2009 | A1 |
20090316860 | Okunuki | Dec 2009 | A1 |
20110170663 | Boese | Jul 2011 | A1 |
20150071402 | Handa | Mar 2015 | A1 |
20150228440 | Hwu et al. | Aug 2015 | A1 |
20150279615 | Potocek et al. | Oct 2015 | A1 |
20150371815 | Potocek et al. | Dec 2015 | A1 |
20160013015 | Potocek et al. | Jan 2016 | A1 |
20160111247 | Potocek et al. | Apr 2016 | A1 |
Number | Date | Country |
---|---|---|
2648208 | Oct 2013 | EP |
2010109401 | Sep 2010 | WO |
2010150136 | Dec 2010 | WO |
Entry |
---|
“Transmission Electron Microscopy”, Wikipedia, Retrieved from the Internet Jul. 25, 2016, http://en.wikipedia.org/wiki/Transmission_ electron_microscopy, 23 pages. |
“X-Ray Microtomography”, Wikipedia, Retrieved from the Internet Aug. 4, 2016, https://en.wikipedia.org/wiki/X-ray_microtomography, 5 pages. |
Cichocki, A., et al. “Families of Alpha-Beta-and Gamma-Divergences: Flexible and Robust Measures of Similarities”, Entropy, Jan. 14, 2010, pp. 1532-1568, vol. 12 Issue 6. |
Cichocki, A., et al. “Generalized Alpha-Beta Divergences and Their Application to Robust Nonnegative Matrix Factorization”, Entropy, Jan. 14, 2011, pp. 137-170, vol. 13 Issue 1. |
Escovitz, W.H. et al., “Scanning Transmission Ion Microscope with a Field Ion Source,” Proc. Nat. Acad. Sci. USA, May 1975, pp. 1826-1828, vol. 72, No. 5. |
Levin, A., et al. “Image and depth from a conventional camera with a coded aperture”, ACM Transactions on Graphics, Jul. 29, 2007, 9 pages, vol. 26 Issue 3. |
Neuser, E., et al. “NanoCT® Visualizing internal 3D structures with submicrometer resolution”, DIR 2007, 18 p, vol. 39 Issue 41,International symposium on digital industrial radiology and computed tomography, France. |
Varentsov, D. et al. “First biological images with high-energy proton microscopy”, Physica Medica (2013), pp. 208-213, vol. 29. |
“Bhattacharyya Distance”, Wikipedia, Retrieved from the Internet Nov. 7, 2016, http://en.wikipedia.org/wiki/Bhattacharyya_distance, 4 pages. |
“Bregman Divergence”, Wikipedia, Retrieved from the Internet Nov. 7, 2016, http://en.wikipedia.org/wiki/Bregman_divergence, 4 pages. |
“Cone Beam Computed Tomography”, Wikipedia, Retrieved from the Internet Aug. 4, 2016, https://en.wikipedia.org/wiki/Cone_beam_computed_tomography, 8 pages. |
“Cramer-Rao Bound”, Wikipedia, Retrieved from the Internet Nov. 7, 2016, http://en.wikipedia.org/wiki/Cramer-Rao_bound, 7 pages. |
“Electron Microscope”, Wikipedia, Retrieved from the Internet Oct. 15, 2015, http://en.wikipedia.org/wiki/Electron_microscope, 11 pages. |
“F-Divergence”, Wikipedia, Retrieved from the Internet Nov. 7, 2016, http://en.wikipedia.org/wiki/F-divergence, 3 pages. |
“Focused Ion Beam”, Wikipedia, Retrieved from the Internet Jul. 11, 2016, https://en.wikipedia.org/wiki/Focused_ion_beam, 7 pages. |
“Iteratively Reweighted Least Squares”, Wikipedia, Retrieved from the Internet Nov. 7, 2016, https://en.wikipedia.org/wiki/Iteratively_reweighted_least_squares, 3 pages. |
“Kullback-Leibler Divergence,” Wikipedia, Retrieved from the Internet Nov. 9, 2012; http://en.wikipedia.org/wiki/Kullback%E2%80%93Leibler_divergence, 14 pages. |
“Least Squares”, Wikipedia, Retrieved from the Internet Nov. 7, 2016, http://en.wikipedia.org/wiki/Least_squares, 11 pages. |
“Nanotomography”, Wikipedia, Retrieved from the Internet Aug. 4, 2016, from https://en.wikipedia.org/wiki/Nanotomography, 1 page. |
“Scanning Electron Microscope”, Wikipedia. Retrieved from the Internet Jul. 25, 2016, http://en.wikipedia.org/wiki/Scanning_electron_microscope, 23 pages. |
“Scanning Helium Ion Microscope”, Wikipedia, Retrieved from the Internet on Jul. 25, 2016, http://en.wikipedia.org/wiki/Scanning_Helium_Ion_Microscope, 2 pages. |
“Scanning Transmission Electron Microscopy”, Wikipedia, Retrieved from the Internet Jul. 25, 2016, http://en.wikipedia.org/wiki/Scanning_transmission_electron_microscopy, 5 pages. |
“Spiral Computed Tomography”, Wikipedia, Retrieved from the Internet Aug. 4, 2016, https://en.wikipedia.org/wiki/Spiral_computed_tomography, 2 pages. |
Number | Date | Country | |
---|---|---|---|
20170138870 A1 | May 2017 | US |