The present invention relates to an image generation device which generates an image by irradiating an object to be measured with spatially modulated light.
Optical devices which irradiate semiconductor devices and the like with spatially modulated light and observe resulting images have conventionally been known. For example, the following Patent Literature 1 discloses an optical device in which a sample is irradiated with light through a diffraction grading from a light source device, and a sample image generated at this time is captured by a CCD camera. This light source device obtains a plurality of modulated images by capturing images while moving the diffraction grading at a constant velocity in a direction perpendicular to stripes of the diffraction grating, and then subjects the modulated images to image processing, so as to form an image of the sample. The following Patent Literature 2 discloses a microscope device in which an SLM (Spatial Light Modulator) is arranged in an optical path of illumination light in order to irradiate a sample with spatially modulated light.
Patent Literature 1: Japanese Patent Application Laid-Open No. 2001-117010
Patent Literature 2: Japanese Patent Application Laid-Open No. 2007-199572
Since the above-mentioned conventional devices for generating images irradiate a sample with spatially modulated light and capture the resulting sample image through an optical system including an objective lens, an image-forming lens, and the like, however, there is a limit to improving the resolution of the finally generated two-dimensional image of the sample. That is, the upper limit of resolution in the two-dimensional image of the sample tends to be determined by optical performances of the optical system and the pixel resolution and the sensitivity of the two-dimensional imaging device.
In view of such a problem, it is an object of the present invention to provide an image generation device which can obtain a pattern image of a sample having an improved resolution with a simple device structure.
For achieving the above-mentioned object, the image generation device in accordance with one aspect of the present invention is an image generation device for generating an image of an object to be measured, the device comprising a laser light source for emitting laser light, a laser modulation unit for modulating an intensity of the laser light, a laser scanning unit for scanning an irradiation position of the laser light with respect to the object, a control unit for controlling the laser modulation unit and laser scanning unit so as to irradiate the object with illumination light having a plurality of spatial modulation patterns, a detection unit for detecting a signal issued from the object in response to irradiation with the illumination light having the plurality of spatial modulation patterns, a signal generation unit for producing characteristic distribution information associating irradiation position information concerning the irradiation position of the illumination light controlled by the control unit with characteristic information concerning a characteristic of the signal detected by the detection unit in response to the irradiation with the laser light at the irradiation position and generating a two-dimensional characteristic image including a plurality of pieces of the characteristic distribution information corresponding to the spatial modulation pattern, and an image processing unit for generating a pattern image of the object according to a plurality of two-dimensional characteristic images generated so as to correspond to the plurality of spatial modulation patterns.
In thus constructed image generation device, the laser light emitted from the laser light source irradiates an object to be measured such as a semiconductor device or biological sample, while its intensity is modulated by the laser modulation unit and its irradiation position with respect to the object is scanned by the laser scanning unit. Here, while the control unit controls the laser modulation unit and laser scanning unit so as to irradiate the object with illumination light having a plurality of two-dimensional spatial modulation patterns, the detection unit detects a signal issued from the object. Further, while characteristic distribution information associating irradiation position information concerning the irradiation position of the illumination light with information concerning a characteristic of the signal detected in response to the irradiation with the laser light at the irradiation position is produced corresponding to each spatial modulation pattern, a two-dimensional characteristic image is generated so as to correspond to each spatial modulation pattern, and the image processing unit generates a pattern image of the object according to a plurality of two-dimensional characteristic images. This makes it unnecessary for the pattern image being acquired from the object to pass through an optical system including an objective lens, an image-forming lens, and the like and thus can easily improve the resolution of the pattern image of the sample. In addition, the phase and orientation of spatial modulation patterns of illumination light irradiating the object can be changed easily, so that a high-resolution image having a desirable position and orientation can be obtained rapidly.
The present invention can obtain a pattern image of a sample having an improved resolution with a simple device structure.
In the following, preferred embodiments of the present invention will be explained in detail with reference to the drawings. In the drawings, the same or equivalent parts will be referred to with the same signs while omitting their overlapping descriptions.
Specifically, the optical system 9 is constituted by a relay lens 21, a mirror 23, and an objective lens 25. The relay lens 21 is an optical system for efficiently guiding the laser light, whose irradiation angle is oscillated by the laser scanner 5, to the objective lens 25 and acts to project the exit pupil of the objective lens 25 onto a reflecting surface of the laser scanner 5, so that the laser light reflected by the laser scanner 5 securely reaches the objective lens 25. Here, the mirror 23 may be omitted.
The laser scanner 5 is an optical system which changes the advancing direction of the laser light, so as to scan its irradiation position two-dimensionally. That is, the laser scanner 5 changes the incident angle of the laser light incident on the relay lens 21, thereby two-dimensionally scanning the irradiation position on the front face of the object A of the laser light irradiating the same through the optical system 9. Employable as thus configured laser scanner 5 is a galvanometer mirror having two mirrors whose axes of rotation are orthogonal to each other, while their angles of rotation are electrically controllable. Examples of others employable as the laser scanner 5 include polygon mirrors, MEMS (Micro Electro Mechanical System) mirrors, AOD (acousto-optical deflectors), resonant scanners (resonance type galvanometer scanners), and EO scanners (electro-optical deflectors).
Here, the intensity of the laser light issued from the laser light source 3 is adapted to be modulated by a control signal from the laser output control unit 11 connected to the laser light source 3, while the position at which the front face of the object A is irradiated with the laser light through the laser scanner 5 is changeable by a control signal from the scanner control unit 13 connected to the laser scanner 5. The modulation pattern control unit 15 is connected to the laser output control unit 11 and scanner control unit 13, so as to control them such that the object A is irradiated with illumination light according to a plurality of predetermined spatial modulation patterns.
Spatial modulation patterns defined by the modulation pattern control unit 15 will now be exemplified with reference to
As illustrated in
In synchronization with irradiation timings of illumination light having spatial modulation patterns such as those mentioned above, the electric signal detector 7 detects electric signals such as photo induced currents. For example, the electric signal detector 7 detects a characteristic value such as a current value of an photo induced current occurring in response to irradiation with the laser light as a voltage difference between two terminals of the object A. The electric signal imaging unit 17 is connected to the electric signal detector 7 and modulation pattern control unit 15 and forms an image of the characteristic value detected by the electric signal detector 7. That is, as irradiation position information on XY coordinates or the like, the electric signal imaging unit 17 specifies the irradiation position of laser light on the object A when the characteristic value is detected. Then, the electric signal imaging unit 17 produces characteristic distribution information associating the irradiation position information with characteristic information concerning the characteristic value of the electric signal detected in response to the irradiation with laser light at the irradiation position corresponding thereto. Further, the electric signal imaging unit 17 generates a two-dimensional characteristic image including a plurality of pieces of characteristic distribution information corresponding to the respective spatial modulation patterns having irradiated the object A. For example, the electric signal imaging unit 17 generates a two-dimensional characteristic image signal in which the characteristic values are arranged at their corresponding coordinates on the object A. When spatial modulation patterns such as those illustrated in
The plurality of characteristic images generated by the electric signal imaging unit 17 are subjected to image processing by the image data operation unit 19. For example, the image data operation unit 19 irradiates the front face of the object A with a spatial modulation pattern having stripes in a row along the Y axis, while changing the spatial phase by a desirable frequency, so as to generate a plurality of characteristic images. The plurality of characteristic images are obtained here as moiré (interference fringe) components caused by the stripe pattern of the illumination light and the structure of the object A, while spatial high-frequency components resulting from fine structures of the object A appear as being converted into low-frequency components as moirés. Therefore, from a characteristic distribution obtained from the plurality of characteristic images, the image data operation unit 19 produces an original characteristic distribution image resulting from the actual structure of the object A according to the frequency information of the spatial modulation pattern used for irradiation. By irradiating the sample A with a plurality of spatial modulation patterns along four directions, while changing the spatial phase by a desirable frequency, and then performing the same image processing, the image data operation unit 19 can produce a plurality of characteristic distribution images and generate a high-resolution pattern image whose resolution is enhanced in the four directions from the plurality of characteristic distribution images.
In the image generation device 1 explained in the foregoing, the object A is irradiated with the laser light emitted from the laser light source 3, while its intensity is modulated by the laser output control unit 11 and its irradiation position with respect to the object A is scanned by the laser scanner 5. At this time, while the modulation pattern control unit 15 controls the laser output control unit 11 and laser scanner 5 such that the object A is irradiated with illumination light having a plurality of two-dimensional spatial modulation patterns, the electric signal detector 7 detects an electric signal issued from the object A. The electric signal imaging unit 17 produces, corresponding to each spatial modulation pattern, characteristic distribution information associating irradiation position information concerning the irradiation position of the illumination light with information concerning a characteristic of the electric signal detected in response to the irradiation with the illumination light at the irradiation position and generates a two-dimensional characteristic image corresponding to each spatial modulation pattern, while the image data operation unit 19 generates a pattern image of the object A according to a plurality of two-dimensional characteristic images. This makes it unnecessary for the pattern image being acquired from the object A to pass through an optical system including an objective lens, an image-forming lens, and the like and thus can easily improve the resolution of the pattern image of the sample.
The image generation device 1 can also easily acquire high-resolution pattern images of the object A without necessitating complicated driving mechanisms for driving diffraction gratings and the like. That is, only a simple optical system and a laser scanner or the like are required to be mounted in this embodiment. In addition, the phase and orientation of spatial modulation patterns of illumination light irradiating the object can be changed easily under the control of the modulation pattern control unit 15, so that a high-resolution image having a desirable position and orientation can be obtained rapidly. By contrast, the conventional device using an SLM (Spatial Light Modulator) for generating a spatial modulation pattern necessitates a very fine SLM in order to diffract light to a given direction by a given angle. When varying the phase of stripes to be projected on a sample among three kinds, for example, three times the number of stripes at a resolution limit equals the number of pixels required in one axial direction. When a stripe is desired to be formed in an oblique direction with respect to an axis, three times more number of pixels are further necessary for adjusting the pixels to the stripe pitch, since each pixel has a rectangular form. As a result, the conventional device necessitates an expensive SLM. Problems such as transmission/reflection losses in the SLM, losses at pixel joints, zero-order light, and higher-order light also occur.
In the case where the object A exhibits a nonlinear reaction, e.g., it generates multiphoton absorption such as two-photon absorption or causes second harmonic generation (SHG), techniques in which laser light is modulated while being scanned two-dimensionally are likely to cause such a reaction. As a result, imaging with a higher resolution is possible by utilizing two-photon absorption, for example.
Since the laser output control unit 11 modulates the intensity of the laser light so as to change it according to a trigonometric function, spatial modulation patterns can be formed easily.
The optical signal detector 107 detects reflected light or the like issued from the object A as an optical signal. An example of the optical signal detector 107 is a photoelectric transducer such as a photomultiplier or phototube which outputs a characteristic value such as the intensity of reflected light as an electric signal. For each of a plurality of spatial modulation patterns, the optical signal imaging unit 117 generates a two-dimensional characteristic image (characteristic image) including a plurality of pieces of characteristic distribution information from characteristic distribution information associating characteristic information concerning the characteristic value of the optical signal detected by the optical signal detector 107 with irradiation position information of laser light on the object A at the time when the characteristic value is detected.
A spatial filter 35 and a condenser lens 33 are arranged between the optical signal detector 107 and beam splitter 31. The spatial filter 35 is placed at a position conjugate to an end face of the fiber of the laser light source 3, so as to form a confocal optical system, while its filter diameter is configured so as to be substantially equal to the beam spot diameter produced on a plane conjugate to the fiber end face. The spatial filter 35 blocks a reflected/scattered component from a part deviated from a focal point in the reflected/scattered light having returned through the optical system from the object A.
The image generation device 101 explained in the foregoing can acquire a characteristic of reflected/scattered light occurring upon irradiation of the object A with a spatial modulation pattern as a pattern image having an improved resolution in the object. In addition, the phase and orientation of spatial modulation patterns of illumination light irradiating the object can be changed easily under the control of the modulation pattern control unit 15, so that a high-resolution image having a desirable position and orientation can be obtained rapidly.
Employable as the optical signal detector 207 is a photoelectric transducer such as a photomultiplier which can output a characteristic value such as the intensity of weak fluorescence as an electric signal. As illustrated in
An excitation wavelength selection filter 43 is disposed between the laser light source 3 and dichroic mirror 41. The excitation wavelength selection filter 43 is provided in order to select a wavelength suitable for a fluorescence excitation characteristic of the object A from wavelengths of the laser light source 3.
A barrier filter 45 is disposed between the optical signal detector 207 and dichroic mirror 41. The barrier filter 45 cuts off the excitation light so as to prevent it from reaching the optical signal detector 207 when optical signal detector 207 detects the fluorescence. This barrier filter is a longer-wavelength-transmitting high-pass filter which has such a property as to cut off the wavelength component of the excitation light by absorbing or reflecting it and transmit therethrough the wavelength component of the fluorescence or a bandpass filter which transmits therethrough only the wavelength component of the fluorescence.
Thus constructed image generation device 201 can acquire a characteristic of fluorescence occurring upon irradiation of the object A with a spatial modulation pattern as a pattern image having an improved resolution in the object. In addition, the phase and orientation of spatial modulation patterns of illumination light irradiating the object can be changed easily under the control of the modulation pattern control unit 15, so that a high-resolution image having a desirable position and orientation can be obtained rapidly.
The present invention is not limited to the above-mentioned embodiments. For example, the structure illustrated in
Specifically, an axicon 211 and a converter lens 212 may be inserted between the laser light source 3 and laser scanner 5. The axicon 211, which is a conical prism, is an optical element which converts a parallel beam having a circular cross section emitted from the laser light source 3 into a beam having a ring-shaped cross section. The converter lens 212 is a lens by which the ring-shaped beam emitted from the axicon 211 is projected as an annular form onto the laser scanner 5. Using such an optical system for illumination light can shape the laser light from the laser light source 3 into a ring form at the pupil position of the objective lens 25. This can reduce the half width of the laser light spot on the front face of the object A and thus can prevent the contrast of the spatial modulation pattern from decreasing when scanning the laser beam at an Airy disk diameter.
A structure which can observe multiphoton excitation such as two-photon excitation in the object A as illustrated in
Here, it will be preferred if the detection unit detects an electric signal issued from the object, while the signal generation unit generates characteristic distribution information associating the irradiation position information of the illumination light with characteristic information concerning a characteristic of the electric signal. In this case, an electric characteristic such as a current value of a photo induced current occurring in response to the irradiation of the object with the laser light can be acquired as a pattern image in the object, whereby the accuracy in analyzing characteristics of electric devices such as semiconductors can be improved.
It will also be preferred if the detection unit detects an optical signal issued from the object, while the signal generation unit generates characteristic distribution information associating the irradiation position information of the illumination light with characteristic information concerning a characteristic of the optical signal. When this structure is employed, a characteristic of light such as reflected light or fluorescence occurring upon the irradiation of the object with the laser light can be acquired as a pattern image having an improved resolution in the object.
It is also preferable for the laser light from the laser light source to include a wavelength enabling multiphoton absorption in the object. In this case, the effect on the object is on a par with the square and cube of the spot form in two- and three-photon absorptions, respectively, so that the signal generated is equivalent to that obtained by scanning with an effectively small spot, whereby stripes of modulation can be made finer, which makes it possible to further improve the resolution.
It is also preferable for the laser modulation unit to modulate the intensity of the laser light so that the intensity changes according to a trigonometric function. Providing such a laser modulation unit makes it easier to form the spatial modulation patterns.
The present invention is used for an image generation device which generates an image by irradiating an object to be measured with spatially modulated light and can obtain a pattern image of a sample having an improved resolution with a simple device structure.
1, 101, 201 . . . image generation device; 3 . . . laser light source; 5 . . . laser scanner (laser scanning unit); 7 . . . electric signal detector (detection unit); 11 . . . laser output control unit (laser modulation unit); 15 . . . modulation pattern control unit; 17 . . . electric signal imaging unit (signal generation unit); 19 . . . image data operation unit (image processing unit); 107, 207 . . . optical signal detector (detection unit); 117 . . . optical signal imaging unit (signal generation unit); A . . . object to be measured
Number | Date | Country | Kind |
---|---|---|---|
2010-142882 | Jun 2010 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2011/063976 | 6/17/2011 | WO | 00 | 1/30/2013 |