The invention relates to a holographic microscope and a method of holographic microscopy and relates more particularly, but not exclusively, to an in-line lensless digital holographic microscope and a method of in-line lensless digital holographic microscopy.
Microelectromechanical systems (MEMS) may include forming mechanical elements, electronics, sensors and actuators on a common silicon substrate using micromachining technology. MEMS are becoming increasingly important in scientific and engineering fields. It is desirable for both development and testing that the mechanical properties of MEMS structures can be accurately observed. This may require static and/or dynamic observation.
Various methods exist for optical metrology. For example U.S. Pat. No. 6,262,818 discloses an off-axis digital holographic microscope. The illumination source is expanded into a collimated beam, with magnification provided by optical lenses.
In general terms in a first aspect the invention proposes a holographic microscope with a diverging beam illumination source. This may have the advantage that the hardware configuration is simplified and/or reduced in size by removing the need for lenses. Because the components are able to be placed closer together, the numerical aperture may be increased which may result in improved lateral resolution, depth resolution, and/or reduced twin image noise in the real image plane.
In a second independent aspect the invention proposes an in-line digital holographic microscope. This may have the advantage that the distance from the object to the transducer can be minimised, allowing wider field of view, higher imaging resolution and/or higher phase sensitivity.
In a third independent aspect the invention proposes a digital holographic microscope with a reflector provided on an external surface of a beam splitter. This may have the advantage of allowing more compact hardware.
In a forth independent aspect the invention proposes a digital holographic microscope with a spatial light modulator provided to modulate a reference beam. This may have the advantage of allowing control of the reference beam.
The four independent aspects may be also combined in one or more combinations.
In a first specific expression of the invention there is provided a holographic microscope comprising:
The signal may be a digital signal. The microscope may further comprise a processor configured to receive the signal and to determine desired characteristics of the object based on at least the signal. The microscope may be lensless and/or the diverging beam may be unfocussed. The transducer may be a Charge Coupled Device (CCD) digital image sensor. The reflector may have a reflecting surface configured to be transverse to the diverging radiation beam to reflect the second portion as the reference beam. The microscope may be an in-line digital holographic microscope. The reflector may be a reflective coating on a surface of the beam splitter distant to the source. The reflector may be a spatial light modulator.
In a second specific expression of the invention there is provided a method of digital holography comprising:
The method may further comprise processing the signal to determine desired characteristics of the object. The processing the signal may comprise:
The digital hologram may be in the form:
The zero padding may be in the form:
The reconstruction wave is a converging spherical wave which may be determined according to the optical system geometry, for example the complex conjugate of the diverging spherical reference wave.
The impulse response function may be determined according to:
The reconstructed wavefront may be determined according to:
U(x′,y′)=ℑ{H(ξ,η)R*(ξ,η)g(ξ,η)}
In order that the invention may be fully understood and readily put into practical effect there shall now be described by way of non-limitative example only exemplary embodiments, the description being with reference to the accompanying illustrative drawings, in which:
a) to (c) are images of reconstructions at different depths without zero padding;
a) and (b) are images of reconstructions at different depths with partial zero padding;
c) to (d) are images of reconstructions at different depths with further zero padding;
a) is an optical microscopic image;
b) to (d) are reconstructed images;
a) is an optical microscopic image;
b) is a reconstructed image;
a) is reconstructed images of cantilevers at first resonant frequency;
b) is reconstructed images of cantilevers at second resonant frequency;
A holographic microscope 100 is shown in
The microscope 100 is housed in a casing 112. The illumination source 102 may for example be a diverging laser attached within the casing 112. The diverging beam of radiation may be, for example, visible light, visible laser light, UV light, X-rays, or visible blue light. The wavelength of the light may for example be chosen according to the application and/or the required lateral resolution. The diverging beam may be delivered from the end 113 of an optical fibre, where the smaller the diameter of the fibre (for example in the order of a single wavelength) the greater the cone of the emitted light coming through it. Therefore a smaller diameter fibre may increase the Numerical Aperture (“NA”) of the system and thus the system resolution. Preferably, there is no lens at the end 113 of the fibre.
The object 104, for example a MEMS device, may be inserted into a cartridge 114, which is then locked into place in the casing 112 for observation. The cartridge 114 may include apertures for electrical connections to the object 104. By controlled energisation of the object 104, dynamic observation is possible. The cartridge 114 may be moveable to adjust the magnification. The object is centred about a longitudinal axis 116.
The beam splitter 106 for example may be a cube beam splitter with an internal partially reflective surface 118 oriented at 45° to the lateral axis 103. The beam splitter 106 is centred about the intersection of the lateral axis 103 and the longitudinal axis 116 and attached within the casing 112. For example the partially reflective surface may be non-polarising and have a transmittance and reflectance of between 40-50% respectively.
The reflector 108 may for example be a mirror centred on and oriented transverse to, the lateral axis 103, and therefore “in-line” with, or parallel to the longitudinal axis 116. The mirror may be attached within the casing 112.
The transducer 110 may for example be a digital image sensor such as a Charged Coupled Device (CCD) or Complementary Metal Oxide Semiconductor (CMOS) sensor centred on the longitudinal axis 116 and attached with the casing 112.
The signal from the transducer may be processed by a processor such as a Digital Signal Processor (DSP) according to a programmed algorithm. The processor may also control the object for dynamic observation.
For example
Let (x, y) be the object plane and (ξ,η) be the hologram plane. The diverging beam from the fibre is divided into two parts called object O(ξ,η) and reference R(ξ,η) waves. The hologram H(ξ,η), which is the interference of the object wave O(ξ,η) and reference wave R(ξ,η), may be represented as shown in Equation (1):
H(ξ,η)=|O(ξ,η)|2+|R(ξ,η)|2+O*(ξ,η)R(ξ,η)+O(ξ,η)R*(ξ,η) (1)
where O* and R* are the complex conjugate of the O and R respectively.
The transducer, at the hologram plane, records this interference pattern. The recorded pattern may be represented as a two-dimensional array of discrete signals using the sampling theorem. Let M×N be the total number of pixels of the CCD with corresponding size Δξ and Δη, then the digital hologram H(m,n) stored at 302, can be shown as in Equation (2):
where represents the two-dimensional convolution and (α, β)ε[0,1] are the fill factors of the CCD pixels.
As the recording distance increases, the magnification increases, but a corresponding decrease in the reconstructed image size may counteract an increased magnification. The process at 304 may be implemented by fictitiously increasing the hologram size by zero-padding, to mitigate the loss in image size.
In the exemplary embodiment, reconstruction pixel size along the x, and y dimensions change depending on the distance from the object to transducer. To keep the analysis concise we present equations only for the x dimension, but the same equations hold for the y dimension too. The pixel size change in the x dimension is shown in Equation (3):
where Δξ and Δx′ are the x dimension pixel size at the recording and at the reconstruction planes respectively, λ is the wavelength of the laser, M is the total number of pixels along x direction and d is the distance from the object to the transducer.
In order to have equal pixel size at reconstruction distances d1 and d2 (d1 and d2 are shown from the transducer to the reconstructed image plane) the hologram size may be increased from Mx to Mx′ by zero padding as shown in Equation (4):
Following reconstruction the central M×N portion of the propagated wavefront is retained. Zero padding fictitiously increases the hologram size which may compensate for the pixel resizing effect of reconstruction.
The reconstructing wave may also decrease the pixel size of the reconstruction wavefront. An additional zero padding of the hologram by a factor of (D−d1)/(D−d2 ) may be used to compensate for this, so that overall pixel number of the hologram is shown in Equation (5):
where D is the distance between the fibre and the transducer (via the mirror).
The additional zero padding further compensates so that the pixel size remains constant for different levels of magnification.
Determining the reconstruction wave R*(ξ,η) at 306 may be implemented by calculating the complex conjugate of the diverging reference wave. The reconstruction geometry is shown in
Let U(x′, y′) be the reconstructed wavefront behind the hologram. If the reconstruction wave is the complex conjugate of the reference wave, and the hologram H(ξ,η) is illuminated by the reconstruction wave R*(ξ,η), then a real image of the object is formed at an image plane (x′, y′) at a distance d′ from the hologram plane where d′ is same as the distance d from the object 104 to the transducer 110. U(x′, y′) may be defined as shown in Equation (6):
is the wave number and r is defined by the Fresnel's approximation as shown in Equation (7):
Equation (6) can be rewritten using Equation (7), in the form of a Fresnel approximation or Fresnel transform as shown in Equation (8):
Determining the impulse response g(ξ,η) at 308 may be implemented as shown in Equation (9):
The impulse response is calculated according to the optical system geometry.
Equation (8) can be rewritten using Equation (9), as shown in Equation (10):
are the spatial frequencies present in the hologram.
Determining the reconstructed wavefront at 310 may be implemented by calculating the Fourier transform of the product of the hologram, the reconstruction wave and the impulse response function, as shown in Equation (11):
U(x′,y′)=ℑ{H(ξ,η)R*(ξ,η)g(ξ,η)} (11)
The image intensity can be calculated as shown in Equation (12):
I(x′,y′)=|U(x′,y′)|2 (12)
The phase can be calculated as shown in Equation (13):
The numerical reconstruction of digital holograms can provide the 3-D reconstruction of the image from the two dimensional hologram. Another advantage may be that the twin image is less problematic in the reconstructed real image. This is because the twin image forms on the opposite side of the real image and appears as a defocused image at the real image plane. In case of smaller size objects, the amplitude of the twin image may be significantly smaller at the real image plane. Also, because of the divergence of the out-of-focus twin image at the real image plane, the amplitude may become negligible compared with the real image wave. Increasing the lateral size of the hologram using zero padding may further decrease the background noise created by the twin image. The effect zero-order term during reconstruction of the in-line hologram can be removed by pre-processing of hologram using high-pass filter.
The lateral resolution of system may depend on the numerical aperture (NA) and wavelength, similar to a conventional microscope. According to the Rayleigh criteria of resolution, the minimum distance requirement Δx between of two points to be resolved, may be approximated by Equation (14):
The depth of focus Δz, or depth resolution, may be approximated by Equation (15):
Therefore 3-D resolution may be increase with a larger NA. A larger CCD sensing area increases the NA of the system because of larger light collection capability and will also increase the 3-D resolution.
Magnification of the system may be approximated by Equation (16)
D/(D−d) (16)
where D is the fibre 102 to transducer 110 distance (measured via the mirror) and d is the object 104 to the transducer 110 distance. The positioning of the object plane may be used to change the magnification of the system.
An experimental configuration shown in
a), (b) and (c) show the results from the experimental configuration without step 304. Here the central part (contains 200×200 pixels) of the reconstructed images shows the central region (group 7) of the USAF target. It can be seen that the image has shifted towards the centre in the reconstructed images as the distance d increases. The magnification should be highest in
a) & (b) show the reconstruction after zero padding according to Equation (4) at distances 21.33 mm & 27.07 mm respectively, here considering 20.33 mm as the reference distance (d1). It can be seen that the image sizes corresponding to all the three distances (
a) shows an image form an optical microscope with 5× magnification.
Static and dynamic observation of MEMS cantilevers (50 μm×200 μm) are shown is
In a further exemplary embodiment shown in
In a still further exemplary embodiment shown in
The terms lensless and unfocused may in the context of at least one embodiment be understood to mean that the microscope does not include a lens between the beam splitter and the object and/or between the beam splitter and the transducer.
Whilst there has been described in the foregoing description exemplary embodiments, it will be understood by those skilled in the technology concerned that many variations in details of design, construction and/or operation may be made without departing from the present invention.