This invention relates to an optical microscope, and particularly, to a multilayer observation optical microscope for observation of a three-dimensional dynamic state of an sample in real time, and to a multilayer observation unit that can be used in the optical microscopes.
A microscope is generally used for observation of a sample at each depth by adjusting focal point alignment. Especially, a confocal microscope has an excellent resolution in a direction of the optical axis and enables observation of an optical slice image of a sample having a three dimensional structure. Thus the microscopes, in recent years, have been rapidly employed widely in the fields of medicine and biology as optical observation means.
The measurement is conducted in a manner such that fluorescence after passing through the pinhole is reflected on the dichroic mirror 11 and then converged by a convex lens 12 and directed to a high speed CCD camera 3. In a case where a live tissue is observed with such a confocal microscope (for example, an observation of a mouse heart tissue), observation is performed with some level of effectiveness on the removed heart 20 or the like perfused using a cannula 21 and an observation site thereof is irradiated with a laser light beam while being monitored by an electrocardiogram measuring instrument 22.
Since a confocal microscope has high resolution in the optical axis, however, it is necessary to observe a live cell and a live tissue at different depth of observation in order to obtain three-dimensional images of the live cell and the live tissue in real time, which requires moving things each having a weight, such as the sample stage and the objective lens; therefore, a three dimensional observation in real time has been disabled (see, for example, a patent document No. 1 (JP-A No. 06-341955) and a non-patent literature No. 1 (OLYMPUS OPTICAL CO., LTD's catalogue “scanning laser microscope” retrieved Sep. 30, 2002 from a homepage of Internet,
URL: http://www.nagano-it.go.jp/seimitu/setubi/se-shuuseki10/se-04laser.html (column on specifications).
It is a fundamental object of the invention to provide an optical system solving difficulty in three dimensional scanning in an optical microscope system including a conventional confocal laser microscope as described above.
It is another object of the invention to provide an optical system enabling observation of a three dimensional dynamic state of a live tissue and cell with a fluorescence microscope at high speed.
A first invention, in order to achieve the fundamental object, is directed to a multilayer observation optical microscope, wherein, a pair of convergence/collimation lenses are arranged on the optical axis along which an irradiation light beam enters into an sample from the objective lens, and a phase varying means is arranged between the lenses for varying a phase of a transmitting light beam in a given area on a plane traversing the optical axis, and thereby, the light beam incident on the objective lens is focused on the sample at a depth corresponding to the phase of a wavefront thereof.
According to the fundamental configuration, the wavefront of the irradiation light beam outputting from the collimation lens through the phase varying means changes its phase in a certain area of a plane traversing the optical axis in each state of the phase varying means opposite the collimation lens. Then as the level of change in phase is larger, the depth of a focal point of a light beam incident on the objective lens is correspondingly deeper. A width of change in depth of a focus can be wider depending on a wavelength of the irradiation light beam and in the invention, the depth can be realized to a value on the order of 100 μm in the visual wavelength band (which depends on an NA and a magnification of an objective lens to be used).
According to a second aspect of the invention, in a confocal microscope, the optical axis on which the pair of convergence/collimation lenses are arranged is a common optical axis of an irradiation light beam with which an sample is irradiated through an objective lens and a fluorescent beam radiated from or reflected by the sample and passing through the objective lens in a reverse direction, in which construction a technical effect of the first invention is mostly exerted in the confocal microscope.
The observation light beam is a light beam including information on an sample, and a fluorescent beam excited by an irradiation light beam or a reflecting light.
According to a third aspect of the invention, the phase varying means comprises a rotating disc having plural phase plate segments thereon, the respective phase plate segments having optical characteristics stepwise different from each other and sequentially traversing the optical axis.
According to a fourth aspect of the invention, the respective phase plate segments of the phase varying means comprise isotropic transparent films of different thickness so as to effect different optical characteristics thereof.
According to a fifth aspect of the invention, the respective phase plate segments of the phase varying means comprise isotropic transparent films having different refractive index so as to effect different optical characteristic thereof.
According to a sixth aspect of the invention, two-dimensional scanning on a sample stage of the optical microscope and phase scanning with the phase varying means are synchronized with each other so as to enable a three-dimensional dynamic state of the sample to be observed. With such a construction, a CCD) camera, for example an intensified high speed CCD camera with an existing image pickup speed of 1000 frames/sec, placed at the end of the optical path for fluorescence observation makes it possible to observe a three-dimensional dynamic state of a live tissue at high speed.
A first optical axis direction observation position control means for displacement of a sample stage or an objective lens, a pair of convergence/collimation lenses disposed in the optical axis along which an irradiation light beam incident on a sample impinges through the objective lens, and a second optical axis direction observation position control means are arranged. The second optical axis direction observation position control means comprises a phase varying means disposed between the two lenses for changing a phase of a transmitting light in a given area on a plane traversing the optical axis. Consequently, not only is observation of a sample at a deep position in the optical axis enabled, but also observation in the optical direction can also be minutely effected in a short time. In addition, two-dimensional scanning on the sample stage of the optical microscope with a sample light beam is synchronized with the first optical axis direction observation position control means and the second optical axis direction observation position control means, so that three-dimensional observation of a sample can be achieved in a specific region. In order to generate a three dimensional image from information obtained by the synchronization operation, normalization of control lengths of the first optical axis direction observation position control means and the second optical axis direction observation position control means is conducted in advance. In addition, by normalizing control lengths of the first optical axis direction observation position control means and the second optical axis direction observation position control means, a length in the optical axis can be measured by the second optical axis direction observation position control means in a short time. That is, by employing a multilayer observation optical microscope, wherein a pair of convergence/collimation lenses are arranged on the optical axis along which an irradiation light beam enters into an sample from the objective lens, and a phase varying means is arranged between the lenses for varying a phase of a transmitting light beam in a given area on a plane traversing the optical, a first observation plane obtained by a first set value of the phase varying means is observed and a second observation plane obtained by a second set value of the phase varying means is observed, and a distance in the optical axis direction between the first observation plane and the second observation plane can be measured from a difference between the first set value of the phase varying means and the second set value of the phase varying means.
A three-dimensional inspection method can be realized on a sample in the medical organ field and a sample in the electronics field. That is, it is determined whether a sample is normal or not by a process including the following steps; a step of preparing an sample having an optically three-dimensional structure; a step of setting the sample on a sample stage; a step of measuring three-dimensional digital data of the sample using the construction of an optical microscope according to the claimed invention; a step of setting three-dimensional inspection criterion digital data capable of determining that the sample has a normal three-dimensional shape; and a step of comparing the measured three-dimensional digital data of the sample with the inspection criterion digital data. Repeated measurement of three-dimensional data also enables inspection of a dynamic state.
In preparation of a sample of the medical organ field, it is made possible to prepare an sample enabling the sample to be observed with optical sharpness by mixing a fluorescent material into the sample. Preparation of a sample in the electronics field is performed in a process for forming depressions and protrusions on a substrate surface.
It is possible not only to determine two-dimensional data, but also to inspect with three-dimensional data including data in the depth direction. While, in a semiconductor integrated circuit, a surface structure is more and more three-dimensional, inspection can be performed at high speed by a three-dimensional inspection method of the invention.
A seventh invention provides a multilayer observation unit comprising a rotating disc having plural phase plate segments thereon, the respective phase plate segments having optical characteristics stepwise different from each other and being adjacently arranged in a circumferential direction, wherein the multilayer observation unit is arranged between a pair of convergence/collimating lenses disposed on an optical axis of a light beam incident on an objective lens so as to serve as a phase varying means for varying a phase of a light beam transmitting through the respective phase plate segments in a given area on a plane traversing the optical axis when the phase plate segments sequentially traverse the optical axis between the lenses, whereby a focus depth is changed according to the phase of the wavefront of a light beam incident on the objective lens through the unit.
According to a multilayer observation real-time optical microscope, especially a confocal microscope, of the invention, a three-dimensional structure of a cell and an tissue can be observed as it is with a high precision. That is, in a conventional method that cannot conduct observation in layers, a working of a tissue, which is essentially three-dimensional, is transformed only into a two-dimensional plane by cell culture or the like in a Petri dish to thereby visualize the working, which makes it difficult to be said that the cell culture captures a natural state of an organ, whereas in the invention, the working of a organ is visualized at high speed and sterographically.
a) to 2(c) are schematic diagrams of a multilayer observation unit serving as a main part of the microscope shown in
a) to 3(c) are schematic diagrams illustrating a procedure for synthesizing a three-dimensional image in which, in a multilayer observation real-time confocal microscope of the invention, a two-dimensional scanning (picking-up of optical laminagrams) is performed at three levels of the lowest depth Z1 shown in
According to an embodiment of the invention, there is provided a multilayer observation unit enabling a high speed observation of a three dimensional dynamic state of a cell, a tissue or the like. A construction of the entire microscope is such that a disc composed of optical phase plate segments as a phase varying means constituting the multilayer observation unit (a unit observing multiple layers at respective observation depths in the z direction) is inserted between a microscope that has been put into practical use which observes a two dimensional (x-y) plane at high speed and a light source (a laser) used therefor. The unit has a construction in which optical phase plate segments (circular arc pieces) having stepwise different optical characteristic are arranged in the shape of a disc in such a manner that the segments sequentially traverse the optical axis by rotation and, with such a construction, changes an observation depth at high speed to thereby obtain two-dimensional slice images at depths (in layers), thereby enabling a three-dimensional image of a tissue cell to be synthesized and reproduced.
Applicable optical microscopes can include: a general fluorescence microscope, a two-photon microscope and an optical microscope in which an sample is irradiated with a light beam using an objective lens, in addition to a confocal microscope, and description will be given of a confocal microscope that is the most effective in the following preferred embodiment.
A preferred embodiment of a multilayer observation real-time confocal microscope of the invention is as shown in
The high speed confocal scanner 2 is constructed in such a manner that a microlens array disc 9 disposed on the laser light source 1 side and a so-called Nipkow disc 10 having many pinholes arranged spirally on the collimation lens 4 side are coaxially installed with and opposite each other (see
A dichroic mirror 11 transmitting an excitation laser light beam and reflecting fluorescence returned back from the sample is inserted between both discs 9 and 10, a convex lens 12 is disposed in a reflecting fluorescent beam optical path, and an image is formed on a light receiving face of the CCD camera 3. The CCD camera 3 can pick up an x-y scanning image with the optical axis at the maximum speed 1000 frames/sec in correspondence to the high speed confocal scanner 2.
Only the side view of a multilayer observation unit 7 of the invention is shown together with a driving motor 13 in the optical system of
A laser beam passing through the multilayer observation unit 7 and exiting the collimation lens 6 impinges on the objective lens 14 in the fluorescence phase contrast microscope unit 8 and is, as shown as model, focused in a cell/tissue sample 15 accommodated in a Petri dish or the like at a variable depth. In this case, an optical path bending mirror 16 constituted of a plane mirror is disposed before the objective lens 14 in the microscope unit 8 for convenience in optical system construction (sec
a) to 2(c) are model views showing a procedure for effectively adjusting a depth of a focus formed by the objective lens 14 by a phase plate of the multilayer observation unit 7 inserted between the convergence/collimation lenses 5 and 6, in which the above described optical path bending mirror 16 is omitted. Herein,
In
In
In
From the above description, it can be understood that since, in the embodiment of the invention, a phase plate element of the multilayer observation unit 7 is thicker as an element is displaced in order of a segment a, to a segment b and to a segment c, a depth of a focus of the wavefront emitted in an area from the optical axis point to the periphery in an object plane of the objective lens 14 is effectively displaced by a sufficient distance. It is clear that the displacement of a depth occurs, as in the embodiment, in a case where thicknesses of phase plate segments (isotropic transparent films) in the multilayer observation unit 7 are stepwise altered, in addition thereto, in a case where refractive indexes thereof are stepwise altered without changing thickness or in a case where both cases are combined with each other.
a) to 3(c) are model diagrams showing a general procedure in which an optical cross-sectioned images are obtained while an observation depth is sequentially altered with a high speed confocal microscope of the invention and a real-time three-dimensional image is obtained by an image processing with the images. In
Plural lines 18 drawn at each level are scanning lines formed according to the number of the microlens/pinhole array on the double disc 9 and 10 of the high speed focal point scanner 2 shown in
The steps of
The whole left ventricle 23 can also be observed by moving the sample stage or the objective lens in the optical axis. By normalizing a distance of displacement of the sample stage or the objective lens in the optical axis and a distance of focal point displacement caused by the multilayer observation unit, and conducting observation under synchronization, as shown in
By normalizing a distance in displacement of the sample stage or the objective lens in the optical axis direction of the objective lens and a distance of focal point displacement caused by the multilayer observation unit, a depth of the sample in the optical axis direction can also be measured in a short time. Alternatively, a focal point displacement distance with the multilayer observation unit can be normalized by previously observing a reference sample in which a distance in the depth direction has been measured. The depth of different observation planes can be measured by measuring a difference between an observable observation plane and a focal point displacement distance caused by the multilayer observation unit. On measurement of a depth, it is preferable to use the phase varying means capable of controlling a focal point displacement distance in the optical axis in analogue. By using an electro-optic crystal device having Pochels effect or Kerr effect that can be controlled by an applied electric field as the phase varying means, a focal point displacement distance in the optical direction can be controlled in analog. An example of a material having Pochels effect is a LiNbO3 (lithium niobate) crystal. An example of a material showing Kerr effect is CS2, which is a liquid. A microscope of the invention can simultaneously perform three-dimensional observation and measurement of a length in a short time. Therefore, the invention is optimally applied in an inspection step not only for experiments in a laboratory but also in a production level of microdevices.
A displacement distance range in the optical axis direction can be wider by altering magnifications of the convergence/collimation lenses of the multilayer observation unit. By changing magnifications of the convergence/collimation lenses of the multilayer observation unit according to a size of an sample, the sample can be three-dimensionally observed in one scanning. By providing a structure altering magnifications of the convergence/collimation lenses, a displacement distance range can be optically wider with effectiveness for even a small change in phase by the phase varying means. In other words, the multilayer observation unit can be down sized. A smaller sized phase varying means facilitates a high speed operation for change in phase.
Since a three-dimensional observation can be performed at high speed, a three-dimensional inspection is enabled on a sample in the biomedical organ field and a sample in the electronics field. That is, first of all, a sample having an optically three-dimensional structure is prepared. For example, preparation in the biomedical field is achieved by staining the sample with fluorochrome. In preparation of a sample in the field of electronics such as a semiconductor integrated circuit and the like, depressions and protrusions are formed on a surface of a silicon wafer fabricated generally by etching or the like. A sample is provided for determining whether the sample has a normal three-dimensional configuration including the absolute value of a depth of concavity and convexity or not, and is set on the sample stage. Three dimensional digital data of the observation data is measured by using the construction of a optical microscope of the invention. In order to determine whether the sample has a normal three-dimensional shape or not, digital data obtained by observation of a different sample in a normal three-dimensional shape is set in advance as inspection criterion reference digital data. By comparing three-dimensional digital data of the sample for inspection which has been measured with the inspection criterion digital data, it can be determined whether or not the sample is normal. With repetition of measurement of three-dimensional data conducted, inspection in a dynamic state changing with time can be performed. Inspection in a dynamic state can be realized by evaluating three-dimensional data scanning under synchronization at correct timings. Inspection in a dynamic state requires setting the inspection criterion three-dimensional digital data which changes with time prior to the inspection.
A conventional pattern inspection of an integrated circuit on a silicon wafer has generally been determined based on two-dimensional digital data. An inspection method of the invention enables an inspection using three-dimensional digital data including digital data in the depth direction. In a semiconductor integrated circuit, a surface structure is going to be more and more three-dimensionally progressed, in which situation three-dimensional inspection will be able to be performed at higher speed using a microscope of the invention. In also the medical field, a microscope of the invention can be used in an application requiting inspecting many of samples at a high speed such as medical examination.
According to a multilayer observation real-time optical microscope, especially a confocal microscope, of the invention, as described above, a three-dimensional structure of a cell and a tissue can be observed in situ with a high precision. That is, in a conventional method that cannot observe a sample as a multilayer structure, structure and function in a three-dimensional tissue is constructed by two-dimensional images taken from cultured cells in Petri dish, which is difficult way to understand a natural state of an organ, and in contrast thereto, in the invention, structure and function in an organ is visualized at a high speed and sterographically.
The technical effects of the invention as described above will provide much of information that has not been obtained so far from results of the observation. The effects would be expected to be extremely useful in the medicine field, the biology field and fields related thereto.
In fabrication of a real-time optical microscope of the invention, it is only required to insert the multiple layer observation unit in the optical path immediately before the objective lens of a conventional optical microscope; therefore, the real-time optical microscope can be fabricated at comparatively low cost, which also leads to an extremely great industrial advantage.
Number | Date | Country | Kind |
---|---|---|---|
2002-379869 | Dec 2002 | JP | national |
2003-337105 | Sep 2003 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP03/16641 | 12/24/2003 | WO | 00 | 6/24/2005 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2004/061515 | 7/22/2004 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5952562 | Yagi et al. | Sep 1999 | A |
6094300 | Kashima et al. | Jul 2000 | A |
6404545 | Ishiwata | Jun 2002 | B1 |
Number | Date | Country |
---|---|---|
08136810 | May 1996 | JP |
11-038324 | Feb 1999 | JP |
2002-287035 | Oct 2002 | JP |
Number | Date | Country | |
---|---|---|---|
20060147176 A1 | Jul 2006 | US |