System and method using fluorescence to examine within a patient's anatomy

Information

  • Patent Grant
  • 8626271
  • Patent Number
    8,626,271
  • Date Filed
    Friday, April 13, 2007
    17 years ago
  • Date Issued
    Tuesday, January 7, 2014
    10 years ago
Abstract
A system for examining an area of a patient's anatomy that comprises a probe capable of fluorescing, and a scanning beam assembly that scans the probe with a beam of excitation radiation and detects the probe's fluorescence. The scanning beam assembly including a radiation source capable of emitting one or more wavelengths of radiation that are capable of exciting the probe and causing the probe to fluoresce, a scanning device that directs the radiation onto a field-of-view to create a scan of the field-of-view, a detector to detect radiation returned from the field-of-view, and a controller to convert the detected radiation into a displayable fluorescence image.
Description
FIELD OF THE INVENTION

The present invention is related generally to imaging fluorescence in the anatomy, and more particularly to medical applications of fluorescent imaging of the anatomy using a scanning beam assembly.


BACKGROUND OF THE INVENTION

U.S. Published Application 2005/0020926 discloses a scanning beam imager (SBI) which is reproduced in FIG. 1 herein. This imager can be used in applications in which cameras have been used in the past. In particular it can be used in medical devices such as video endoscopes, laparoscopes, etc.



FIG. 1 shows a block diagram of one example of a scanned beam imager 102. An illuminator 104, which is part of a variable illuminator 109, creates a first beam of light 106. A scanner 108 deflects the first beam of light across a field-of-view (FOV) 111 to produce a second scanned beam of light 110, shown in two positions 110a and 110b. The scanned beam of light 110 sequentially illuminates spots 112 in the FOV 111, shown as positions 112a and 112b, corresponding to beam positions 110a and 110b, respectively. While the beam 110 illuminates the spots 112, the illuminating light beam 110 is reflected, absorbed, scattered, refracted, or otherwise affected by the object or material in the FOV 111 to produce scattered light energy. A portion of the scattered light energy 114, shown emanating from spot positions 112a and 112b as scattered energy rays 114a and 114b, respectively, travels to one or more detectors 116 that receive the light and produce electrical signals corresponding to the amount of light energy received. Image information is provided as an array of data, where each location in the array corresponds to a position in the scan pattern. The electrical signals drive a controller 118 that builds up a digital image and transmits it for further processing, decoding, archiving, printing, display, or other treatment or use via interface 120.


Illuminator 104 may include multiple emitters such as, for instance, light emitting diodes (LEDs), lasers, thermal sources, arc sources, fluorescent sources, gas discharge sources, or other types of illuminators. In some embodiments, illuminator 104 comprises a red laser diode having a wavelength of approximately 635 to 670 nanometers (nm). In another embodiment, illuminator 104 comprises three lasers: a red diode laser, a green diode-pumped solid state (DPSS) laser, and a blue DPSS laser at approximately 635 nm, 532 nm, and 473 nm, respectively. Light source 104 may include, in the case of multiple emitters, beam combining optics to combine some or all of the emitters into a single beam. Light source 104 may also include beam-shaping optics such as one or more collimating lenses and/or apertures. Additionally, while the wavelengths described in the previous embodiments have been in the optically visible range, other wavelengths may be within the scope of the invention. Light beam 106, while illustrated as a single beam, may comprise a plurality of beams converging on a single scanner 108 or onto separate scanners 108.


One example of these scanners employs a MEMS scanner capable of deflection about two orthogonal scan axes, in which both scan axes are driven at a frequency near their natural mechanical resonant frequency of the MEMS device upon which it is constructed. In another example, one axis is operated near resonance while the other is operated substantially off resonance. For completeness it is also noted that scanners are also know that employ two reflectors, one of which oscillates sinusoidally and the other of which simply scans linearly.


Scanning beam imagers are advantageous because they are often able to provide higher resolution and a broader scan area. The SBI is able to provide pixel by pixel interrogation with a high range of data capture. However, even with a SBI there are some the anatomy structures within the anatomy that are difficult to examine, like the biliary tree, colon, and the gastrointestinal tract. The SBI can be adapted, as in the present invention, for use in fluorescent imaging to visualize the anatomy or an instrument that is fluorescing due to the presence of a fluorescent probe or fluorophore. Provided herein is a system that is an improvement in fluorescent imaging of the anatomy; a system that is capable of visualizing the biliary tree during a cholecystectomy or cancer cells during a colorectal cancer resection or lumpectomy, or ureters during a colorectal or gynecological procedure.


SUMMARY OF THE INVENTION

In one aspect, the present invention provides a system for examining an area of a patient's anatomy that comprises a probe capable of fluorescing, and a scanning beam assembly that scans the probe with a beam of excitation radiation and detects the probe's fluorescence. The scanning beam assembly comprises a radiation source capable of emitting one or more wavelengths of radiation that are capable of exciting the probe and causing the probe to fluoresce, a scanning device that directs the radiation onto a field-of-view to create a scan of the field-of-view, a detector to detect radiation returned from the field-of-view, and a controller to convert the detected radiation into a displayable fluorescence image. In another embodiment, the radiation source emits at least one wavelength of radiation to image the field-of view. The displayable image of the fluorescence is anatomically registered to the image of the field-of-view when displayed.


In another aspect, the present invention provides a method for observing fluorescence within an area of a patient's anatomy that comprises delivering a probe capable of fluorescing into patient's anatomy, introducing at least part of a scanning beam assembly into the anatomy to scan the area of the anatomy including the probe, exciting the probe, detecting the probe's fluorescence, and converting the probe's fluorescence into a displayable image of the fluorescence within the area of the anatomy including the probe. The scanning beam assembly comprises a radiation source capable of emitting one or more wavelengths of radiation that are capable of exciting the probe and causing the probe to fluoresce, a scanning device that directs the radiation onto the area of the anatomy to create a scan of the area; a detector to detect radiation returned from the area of the anatomy, and a controller to convert the detected radiation into a displayable fluorescence image.


In another aspect, the present invention provides a method of observing an area of a patient's anatomy that comprises delivering a probe capable of fluorescing to an area of patient's anatomy, introducing an instrument including at least in part a fluorophore, exposing the probe and the fluorophore to one or more wavelengths of radiation capable of exciting the probe, fluorophore, or both into fluorescing, detecting the fluorescence of the probe, fluorophore, or both, converting the detected fluorescence of the probe and fluorophore into a fluorescence image that can be displayed, and displaying the fluorescence image on a display system that is capable of displaying a combined image.


In another aspect, the present invention provides a method for examining an area of a patient's anatomy that comprises introducing at least part of a scanning beam assembly into the anatomy to scan the anatomy, scanning the anatomy with a wavelength of radiation that is capable of exciting naturally occurring autofluorescent cell constituents, detecting the cell constituents fluorescence, and converting the fluorescence into a displayable fluorescence image. The scanning beam assembly including a radiation source capable of emitting one or more wavelengths of radiation that are capable of exciting the probe and causing the probe to fluoresce, a scanning device that directs the radiation onto a field-of-view, a detector to detect radiation returned from the field-of-view, and a controller to convert the detected radiation into a displayable fluorescence image.


The scanning beam assembly has an optical pathway that is largely a single optical fiber that can transmit a combined beam of radiation along its length. This optical architecture has the advantage of allowing a large amount of imaging radiation, excitation radiation, or both to be delivered to a small region (e.g., a single pixel) using a low-power source. The result is high radiation intensity which provides a significant improvement in the signal to noise ratio and photosensitivity for fluorescent imaging.





BRIEF DESCRIPTION OF THE FIGURES


FIG. 1 is a schematic illustration of a scanning beam imager known in the art from U.S. Published Application 2005/0020926;



FIGS. 2A and 2B are block diagrams of embodiments of a scanning beam assembly including a fluorescence detector; and



FIG. 3 is a block diagram of another embodiment of the scanning beam assembly.





DETAILED DESCRIPTION OF THE INVENTION

Before explaining the several embodiments of the present invention in detail, it should be noted that each embodiment is not limited in its application or use to the details of construction and arrangement of parts and steps illustrated in the accompanying drawings and description. The illustrative embodiments of the invention may be implemented or incorporated in other embodiments, variations and modifications, and may be practiced or carried out in various ways. Furthermore, unless otherwise indicated, the terms and expressions employed herein have been chosen for the purpose of describing the illustrative embodiments of the present invention for the convenience of the reader and are not for the purpose of limiting the invention.


It is further understood that any one or more of the following-described embodiments and examples can be combined with any one or more of the other following-described embodiments or examples.


In one embodiment, the present invention provides a system for examining an area of a patient's anatomy. The system comprises a probe capable of fluorescing and a scanning beam assembly that scans the probe with a beam of excitation radiation and detects the probe's fluorescence. The scanning beam assembly comprises a radiation source capable of emitting one or more wavelengths of radiation that are capable of exciting the probe and causing the probe to fluoresce, a reflector that receives the radiation from the radiation source to direct the radiation onto a field-of-view, wherein the reflector oscillates in at least two directions to create a scan of the field-of-view, at least one detector to detect radiation returned from the field-of-view, and a controller to convert the detected radiation into a displayable image of the fluorescence within the field-of-view.


Fluorescence is an optical phenomenon that occurs when radiation is absorbed and excites electrons to a higher energy level, and then nearly instantaneously the electrons move from the excited energy level to a lower energy level, which causes the material to emit radiation at a longer wavelength. Some fluorescent probes have been attached to genetic material and introduced into living organisms, making fluorescent probes a powerful method to obtain information about the structure, function, and health of cells.


The term “probe capable of fluorescing” as used herein means any compound, agent, substance, mixture, colloid, or biological material that is capable of fluorescing. In some embodiments, the probe may be delivered within the anatomy to an area where it may be caused to fluoresce. The following examples of probes capable of fluorescing are not to be construed as limiting. In one embodiment, the probe may be a mixture containing a fluorescence material, for example, a glucose solution mixed with fluoroscein. In another embodiment, the probe may be any type of colloid that is capable of fluorescing, for example, a fluorescent tagged sulfur colloid. In another embodiment, the probe may be a nanoparticle capable of fluorescing. The nanoparticle may be an inorganic nanoparticle, like a semiconductor nanocrystal, a silica-based nanoparticle, or any other inorganic particle capable of attaching to or containing a fluorescence material. The nanoparticle may be an organic nanoparticle, like a liposomal sphere, dimer structure, or other organic structures capable of attaching to or containing a fluorescence material. In another embodiment, the probe may be an antibody, such as a monoclonal antibody or a polyclonal antibody that is fluorescent tagged. The antibody may be any protein structure that may selectively attach to one or more locations on a biological cell or surface. In another embodiment, the probe may be a compound, substance, mixture, colloid, or biological material such as a peptide, nucleotide, liposome, an agent that targets vascular structures and/or deformities, or an anti-angiogenic drug that contains a fluorescent dye or has something capable of fluorescing attached thereto. In one embodiment, the probe may be a combination of any of the above probes. In another embodiment, the probe may include an agent that acts as a linking agent to bind the probe to a particular the anatomy or biomolecule.


In one embodiment, the probe may be a semiconductor nanoparticle. By use of the term “semiconductor nanoparticle” is meant any nanometer crystal or nanocrystal, cluster, nanosphere, nanorod, and/or nanocup of semiconductor compounds capable of emitting electromagnetic radiation upon excitation. In one embodiment, the semiconductor nanoparticle may instead be a nanostructure. A nanostructure is of a more intermediate size between molecular and microscopic structures. In some embodiments, the semiconductor compounds may come from Group II-VI and/or Group III-V elements. A semiconductor nanoparticle usually has a discrete quantized energy spectrum. The corresponding wave functions are spatially localized within the semiconductor nanoparticle, but extend over many periods of the crystal lattice. One of the optical features of small excitonic semiconductor nanoparticles immediately noticeable to the unaided eye is coloration. While the material which makes up the semiconductor nanoparticle defines its intrinsic energy signature, more significant in terms of coloration is the size. The larger the semiconductor nanoparticle, the redder (the more towards the red end of the spectrum) the fluorescence.


In some embodiments, semiconductor nanoparticles may have the general formula MX, where X is selected from the group consisting of S, Se, or Te and resulting in the general formula MS, MSe, or MTe. Metal “M” may be Mg, Ca, Sr, Ba, Zn, Cd, and Hg as taught in U.S. Pat. No. 6,207,392 to Weiss et al. and U.S. Pat. No. 6,333,110 to Barbera-Guillem. In one embodiment, M is lead (Pb) and the resulting semiconductor nanoparticle may be PbS, PbSe, or PbTe. These lead based semiconductor nanoparticles have fluorescent wavelengths of about 700 to about 2500 nanometers (in the infrared range). PbS has a wavelength range of 850 to 2100 nm. PbSe has a wavelength range of 1200 to 2340 nm.


One commercially available semiconductor nanoparticle is PLxBead™ from Crystalplex Corp. (Pittsburgh, Pa.). The PLxBead™ semiconductor nanoparticle emit light for 30 minutes or more and can be produced in a variety of colors. Other semiconductor nanoparticles are available from Evident Technologies (Troy, N.Y.). Evident Technologies provides various semiconductor nanoparticle cores (CdSe, PbS, and PbSe) and core-shell arrangements (CdSe/ZnS) called EviDots™. They also provide EviTags™ semiconductor nanoparticles, which are functionalized semiconductor nanoparticles for biological applications. The EviTags™ semiconductor nanoparticles are functionalized with an amine or carboxyl terminal group.


Semiconductor nanoparticles may be tagged in numerous ways. The following examples of ways to tag semiconductor nanoparticles are merely representative and are not meant to be limiting. A bifunctional ligand can be used to link the semiconductor nanoparticle to a biomolecule. A TOPO-capped (trialkylphosphine oxide) semiconductor nanoparticle may be bound to a modified acrylic acid polymer by hydrophobic forces. Semiconductor nanoparticles may undergo silanization to attach to a biomolecule, which involves solubilization and bioconjugation of the semiconductor nanoparticle using a mercaptosilane compound. Semiconductor nanoparticles can be negatively charged and be electrostatically attracted to positively charged biomolecules. The semiconductor nanoparticles can be incorporated into microbeads and nanobeads that individually carry a “code” that targets specific biomolecules. For cancer cells, the semiconductor nanoparticles may be folate-conjugated, such that the semiconductor nanoparticle can bind to the folic acid inside cancer cells. Additionally, semiconductor nanoparticles can be “functionalized,” as explained in U.S. Pat. No. 6,333,110, so that the semiconductor nanoparticle will contact and bind with living the anatomy.


In another embodiment, the probe may be a silica-based nanoparticle. By use of the term “silica-based nanoparticle” is meant any nanoparticle consisting of a core containing photoluminescent dye molecules surrounded by a protective silica shell. The silica-based nanoparticles are commonly known as Cornell dots or CU dots. The silica-based nanoparticles may be used in place of a semiconductor nanoparticle or nanostructure in any of the applications disclosed herein. Silica-based nanoparticles are described in U.S. Published Patent Applications 2004/0101822 to Wiesner et al., 2006/0183246 to Wiesner et al., and 2006/0245971 to Burns et al., which are hereby incorporated by reference in their entirety.


In another embodiment of the system, the probe may be a fluorescent tagged monoclonal antibodies or fragments of a monoclonal antibodies. Monoclonal antibodies are antibodies that are identical because they were produced by one type of immune cell and are clones of a single parent cell. Given (almost) any substance, it is possible to create monoclonal antibodies that specifically bind to that substance. The mAb can then serve to detect or purify that substance. For example mAb can be developed that are immunofluorescence test monoclonal antibodies (fluorescent tagged mAb) that bind only to cancer cell-specific antigens. Some fluorescent tagged mAb may even induce an immunological response against the target cancer cell.


In one embodiment, the fluorescent tagged mAb is injected into the area of the anatomy to be examined. The area of the anatomy may be the colon, rectum, gastrointestinal tract, esophagus, or any region in the body where there are cancerous cells or a cancerous lumps. The fluorescent tagged mAb after binding to the cancer cells and being exposed to the fluorescence excitation beam of radiation will emit a fluorescence wavelength(s) that is then detected and displayed on the image display system. The image showing the location of the fluorescence on or within the area of the anatomy indicates to a surgeon where the cancerous cells are located, so that the cancerous cells can all be removed during surgery. This technique is an improvement in visualizing the cancerous cells in the anatomy, which includes the surrounding the anatomy, lymph nodes, etc., surrounding the main cancer source (i.e. a lump or tumor). The anatomy surrounding the main cancer source is called the “margin.” The assembly 200 detects fluorescence of the fluorescent tagged mAb and may be capable of margin identification of cancer cells during colorectal cancer resection, a lumpectomy, or in diagnosing various cancers in the gastrointestinal tract, like Barrett's esophagus. To visualize the esophagus a flexible endoscope embodiment of the present invention is passed through the mouth to examine the esophagus, stomach and the first part of the small intestine called the duodenum.


In another embodiment of the system for examining an area of a patient's anatomy, the fluorescent probe is a fluorescent tagged sulfur colloid (FTSC). The fluorescent tag may be a semiconductor nanoparticle, a silica-based nanoparticle, or any other fluorescence marker that may be combined with or tagged onto the sulfur colloid to make the sulfur colloid capable of fluorescing. The FTSC may be injected into an area of the anatomy where cancer originated. The FTSC will be carried by the lymphatic vessels to the sentinel lymph node where cancer cells are likely to have spread. The sentinel lymph node is the first node, or group of nodes, in the body to come into contact with cancer cells that have left the original cancer location and started to spread. For example, the usual location for the sentinel lymph nodes in breast cancer is under the arm. The FTSC can then be exposed to an excitation wavelength from an excitation source using the assembly 200 (described below) or embodiments thereof, so that the sentinel lymph nodes will be fluorescently imaged on the display system. A surgeon may then surgically remove, ablate, or treat the sentinel lymph nodes.


In one embodiment, the scanning beam assembly, described below, may be used to excite naturally occurring autofluorescent biomolecules within the anatomy. Autofluorescence may occur in endogenous cell constituents such as, but not limited to, NADH, riboflavin and flavin coenzymes.


The term “fluorescence image” as used herein means the visual representation of the radiation from the fluorescence of the probe or autofluorescent molecule. The fluorescence image may be formed from the intensity pattern of fluorescence given off by an excited probe or autofluorescent molecule. Fluorescence results in radiation of a different wavelength than the wavelength of necessary excitation radiation.


The term “reflectance image” as used herein means the visual representation of the field-of-view or anatomy derived from all other radiation (not the fluorescence) returned from the FOV. The returned radiation is the result of the other wavelengths of radiation interacting with the FOV (i.e., reflecting, refracting, scattering, absorbing). The fluorescence image and the reflectance image may be displayed together in anatomical registrations, such that the location of the fluorescence on the anatomy is displayed.


Referring now to FIGS. 2A and 2B, scanning beam assembly 200 is illustrated as including radiation source 202 for emitting a beam of radiation 203, scanning device 212, imaging detector 222, fluorescence detector 224, and controller 226. Radiation source 202 may contain at least one imaging source 204 and at least one fluorescence excitation source 206. Other embodiments for radiation source 202 are disclosed in commonly assigned U.S. patent application Ser. No. 11/716,806 MEDICAL DEVICE INCLUDING SCANNED BEAM UNIT FOR IMAGING, THERAPY, AND/OR DIAGNOSIS, which is hereby incorporated by reference in its entirety. Radiation emitted from imaging source 204 is shown as imaging radiation 205. Fluorescence excitation source 206 emits excitation radiation 207. In some embodiments, imaging radiation 205 and excitation radiation 207 may be combined by combiner 208. Beam combiner 208 combines these sources of radiation into a single beam of radiation 203, which travels through optical fiber 210 to the scanning device 212.


In one embodiment, the beam of radiation 203 hits partially-reflective lens 214, the radiation is reflected back toward optical fiber 210 onto the scanning device 212. In one embodiment, scanning device 212 may be a MEMS oscillating reflector. The MEMS type reflector may oscillate in at least two directions to scan the field-of-view (FOV). The MEMS reflector then directs the radiation 203 out onto the FOV. The FOV will return some of radiation 203 back toward lens 214 (i.e., as reflected, absorbed, scattered, and/or refracted radiation) along with fluorescence radiation from a probe within the FOV that may be excited by the fluorescence excitation radiation 207.


In one embodiment, scanning device 212 may be a point source from a single optical fiber that can be scanned using a small metal cantilever driven in vibratory mechanical resonance. In another embodiment, a two-dimensional scanner may include a quartz mechanical resonator or micro-optical scanner to drive the optical fiber itself. The scanning fiber may be driven by a piezo electric 2D actuator in an amplitude-modulated circular pattern or spiral pattern.


In another embodiment, scanning device 212 may include a moving lens. The moving lens may be any suitable refracting device that is capable of directing the radiation from the radiation source onto the FOV.


In one embodiment, as shown in FIG. 2A, radiation returned from the field of view is collected at lens 214 by collectors and transmitted back up optical fiber 210. The returned radiation is deflected by mirror 216. Returned radiation 217 is directed toward imaging detector 222 and the fluorescence detector 224. The beam of returned radiation 217 may enter splitter 218 to be separated into returned imaging radiation 219 and fluorescence 223 emitted from a probe or probes capable of fluorescing.


In another embodiment, as shown in FIG. 2B, radiation returned from the field of view is collected at lens 214 by collector 213 and transmitted by return fiber 215 to beam splitter 218. Return fiber 215 bypasses mirror 216 in this embodiment.


Fluorescence detector 224, in FIGS. 2A, 2B and 3, may be a spectrometer tunable to various wavelengths that correspond to fluorescence wavelength(s) of a chosen probe. The spectrometer may be tunable to several wavelengths at once or at separate times, allowing for the use of a plurality of probes within the same area of the anatomy. In another embodiment assembly 200 may include a plurality of spectrometers set at various wavelengths. Some probes emit weak or strong fluorescence radiation in the visible range, others may emit radiation outside the visible range, and yet other probes may have a combination thereof. For probes with stronger emissions outside the visible range the spectrometer may be used to detect the stronger wavelengths. The spectrometer may filter the wavelengths to a narrower band of wavelengths to increase the frequency or wavelength sensitivity of the system. The spectrometer's wavelength selection capacity may also be used to select and detect weak wavelengths in the visible range. If a probe emits strongly in the visible range, the photodetectors 222 may be used to detect the fluorescence.


In another embodiment, fluorescence detector 224 may be a filter that detects a particular fluorescence wavelength. In another embodiment, fluorescence detector 224 may include a plurality of filters, where one filter may be selected to be placed into the fluorescence detector position at a time.


The returned imaging radiation 219 is separated into various wavelengths by a separator 220 selected to separate the radiation into a plurality of desired wavelengths. The separate wavelengths are then directed to the appropriate detectors within photodetector 222. The fluorescence 223 is directed to fluorescence detector 224. Fluorescence detector 224 and photodetector 222 convert the fluorescence and returned imaging radiation into signals to be transmitted to controller 226. Controller 226 converts the signals into displayable images for both the fluorescence and the FOV. Controller 226 will create a fluorescence image that may be displayed within the color scheme of a display system so that the fluorescence image may be registered within the image of the FOV. In some embodiments, the wavelengths of the fluorescence are outside the visible range, so controller 226 converts the fluorescence signal into a fluorescence designated color that is within the color scheme of the display system. In other embodiments, the wavelength of the fluorescence may be within the wavelengths of the imaging source and radiation from the imaging source that was returned from the field of view. Separate photodetectors, like 222, may be used to detect the fluorescence 223 and the returned imaging radiation 219. The controller 226, in this embodiment, generates a fluorescence signal from the fluorescence 223 and keeps it separate from the signals generated from the returned imaging radiation 219, and converts the fluorescence signal into a fluorescence designated color within the color scheme of the display system so that the fluorescence stands out on the image of the rest of the field-of-view. The resulting image is significantly improved in spectral efficiency and performance over systems that do not employ probes. The image may be displayed on a display system for the user to examine the area within the anatomy that now has a portion of the area shown as containing the fluorescence of the probe.


Optical fiber 210 may be rigid or flexible, which makes the fiber 210 adaptable for use with endoscopes, laparoscopes, catheters, or any other medical scope. Optical fiber 210 allows for the delivery of a large amount of imaging or excitation radiation to a single pixel detection system and only requires a low-power source. The use of a single pixel detector allows the detection area to be in excess of 107 μm2, which will increase the photosensitivity and reduce the imager's noise intensity.


Referring now to FIG. 3, in another embodiment, scanning beam assembly 200 is illustrated as including radiation source 202, first filter 209, second filter 211, scanning device 212, imaging detector 222, fluorescence detector 224, and controller 226. Radiation source 202 may contain at least one imaging source 204 that emits imaging radiation 205 that may be capable of emitting a fluorescence excitation wavelength within the imaging radiation wavelengths. Imaging radiation 205 may be filtered by first filter 209 to remove the wavelength(s) from the imaging radiation that are within the range of the expected fluorescence wavelengths from the probe. For example, if a probe fluoresces at a wavelength of about 530 nm, then first filter 209 will remove wavelengths of about 530 nm from imaging radiation 205, so that any detection of wavelengths of about 530 nm will be known to be from the probe's fluorescence. The filtered radiation travels through optical fiber 210 to the scanning device 212, out onto the FOV, and some of the filtered radiation returns from the FOV along with fluorescence wavelengths from a probe that was delivered to the FOV.


Returned radiation 217 may be directed toward splitter 218. Returned radiation 217A may be separated by separator 220 before entering photodetector 222. Returned radiation 217B may be filtered by a second filter 211 to remove all wavelengths except the wavelengths within the range of expected fluorescence wavelengths. The expected fluorescence wavelengths pass through the filter as fluorescence beam 223. Fluorescence 223 may be detected by fluorescence detector 224, which may be any of the fluorescence detectors described above. In another embodiment, fluorescence detector 224 may be a photodetector, like photodetector 222. Photodetector 222, fluorescence detector 224, and controller 226 are described above in more detail.


In one embodiment, the system further includes a display system for displaying an image of the fluorescence within the field-of-view. The display system may be any type of screen that will effectively show the area of the anatomy and the location(s) in or on the anatomy where the probe is emitting fluorescence, i.e. the fluorescence is anatomically registered with the visual image of the area of the anatomy being examined. In one embodiment the display system may be a monitor that receives the output from the scanning beam assembly's controller. In one embodiment the display system may include a recording medium and a digitizer.


In certain embodiments, at least part of the scanning beam assembly may be included in a medical instrument. The medical instrument may include scanning device 212, collector 213, optical fiber 210, lens 214, and any other components necessary to make the reflector scan the field-of-view. The medical instrument may be insertable within the anatomy to scan the anatomy with a beam of radiation that excites the probe and detects the probe's fluorescence. The insertable portion of the medical instrument may be a rigid or flexible. The medical instrument may be an endoscope, laparoscope, catheter, surgical stapler, surgical clamp, surgical grasper, trocar, needle or any other medical scope, tool, or device adapted to scan the anatomy with a beam of radiation. In other embodiments, the scanning portion that is insertable into the anatomy may be housed within a deployable scanning beam unit or scanning module as disclosed in U.S. patent application Ser. No. 11/651,255 METHOD OF IN VIVO MONITORING USING AN IMAGING SYSTEM INCLUDING SCANNED BEAM IMAGING UNIT, which is herein incorporated by reference in its entirety.


In some embodiments, the probe may be delivered to an area within a patient's anatomy. The area within the anatomy may be a tumor, a cancer site, a lumen, an organ, the blood stream, the lymphatic system, or any other particular area of the anatomy to be imaged using fluorescence. Any conventional or known method for delivering the probe can be used, although, intravenous injection is most common. In one embodiment, the probe may be contained in an injectable suspension.


In another embodiment, the medical instrument may be coated with a fluorophore. The fluorophore may be any of the above listed compounds or substances capable of fluorescing. The instrument may be any medical instrument that is to be inserted within the anatomy during a procedure. The instrument may be introduced intralumenally in an open and/or laparoscopic procedure, into a body cavity, or other body the anatomy. In other embodiments, the fluorophore may be part of a housing covering the instrument, or part of the material making up a piece of the instrument itself. In some embodiments, the housing may be a plastic containing the fluorophore. In other embodiments, the tip of the instrument includes the fluorophore.


The fluorophore contained on or within the material of the instrument may then be excited by an excitation wavelength to cause the fluorophore to fluoresce. The fluorescence may be visible to the naked eye, visualized using the assembly described above, or both. In some embodiments, the reflector that is directing the beam of radiation onto the field of view including the instrument containing the fluorophore may be within the same location as the instrument, while in other embodiments the reflector may be external to the lumen or area of the body where the instrument is located. If the reflector is external to the lumen, then the source may need to emit longer wavelengths of radiation to penetrate through the anatomy, so the excitation radiation can reach the fluorophore and cause it to fluoresce. The radiation may be near infrared or longer wavelengths. In one embodiment, the fluorophore may be a semiconductor nanocrystal within the material on or in the instrument, or a coating on the instrument. The fluorophore while fluorescing enables the visualization of the movement of the instrument as it is routed through the lumen, body cavity, or other the anatomy.


In another aspect, the present invention provides a method for observing fluorescence within an area of a patient's body that comprises delivering a probe capable of fluorescing into a patient's anatomy, introducing at least part of a scanning beam assembly into the anatomy to scan the area of the anatomy including the probe, exciting the probe, detecting the probe's fluorescence, and converting the probe's fluorescence into a displayable image of the fluorescence within the area of the anatomy including the probe. The scanning beam assembly comprises a radiation source capable of emitting one or more wavelengths of radiation that are capable of exciting the probe and causing the probe to fluoresce, a reflector that receives the radiation from the radiation source to direct the radiation onto the area of the anatomy, wherein the reflector oscillates in at least two directions to create a scan of the area of the anatomy, at least one detector to detect radiation returned from the area of the anatomy, and a controller to convert the detected radiation into a displayable image of the fluorescence within the area of the anatomy. The observed fluorescence may enable the examination, diagnosis, treatment, or visualization of the area of the anatomy that includes the probe.


The probe may be delivered by any of the methods mentioned above, but is not limited thereto. The instrument may be introduced transorally, transanally, translumenally, or through a trocar. The beam of radiation is emitted as described above through an optical pathway, usually an optical fiber bundle. The probe's fluorescence may be detected by a specialized fluorescence detector, or if the fluorescence is in the visible range a photodetector may be used. In one embodiment, the detector is a spectrometer, which may be included in an assembly 200 like that illustrated in FIG. 2. The fluorescence may be displayed using a display systems.


In one embodiment, the method may be used during a surgical procedure to visualize part(s) of the anatomy near a surgery site. The visualization may protect the visualized parts of the anatomy from being compromised during the surgical procedure. For example, to protect the biliary tree from bile duct compromise during a cholecystectomy a probe capable of fluorescing may be injected into the biliary tree. The visualization of the biliary tree should decrease the occurrence of bile duct compromise during surgery. The probe may then be excited and the probe's fluorescence detected using the scanning assembly 200. Assembly 200 converts the detected fluorescence using controller 226 into an image that can be displayed. This image may then be displayed on a display system so a surgeon can see where the biliary tree is during the procedure. In one embodiment, the surgical instrument being used may include a fluorophore so the surgeon can determine where the instrument is in relation to the fluorescing biliary tree. The probe may be any of the probes listed above. In one embodiment, the probe may be a nanoparticle, such as a semiconductor nanocrystal. The semiconductor nanocrystal provides orders of magnitude greater light emission and has a wide separation between the excitation wavelength and the fluorescence emission wavelength, so little filtering of the wavelengths is needed.


In another embodiment, the method may be used to determine the extent, margin, or outer limits of a specific structure. For example, but not limited thereto, a fluorescence probe may be used to visualize the extent of the diseased or compromised the anatomy around a benign or cancerous legion (tumor) such that a surgeon may reliably remove a clinically relevant ‘margin’ of the anatomy around the diseased or compromised the anatomy.


In one embodiment, the semiconductor nanocrystal is one of the lead based semiconductor nanoparticles, PbS, PbSe, or PbTe. The semiconductor nanoparticles are suspended in an injectable form that may be intralumenally injected into the biliary tree. The excitation wavelength for PbS, PbSe, or PbTe may be tailored to the infrared spectrum. The excitation wavelength may be between about 700-2500 nm. These wavelengths allow the excitation radiation to penetrate deeper into the anatomy (i.e., the biliary tree) than shorter wavelengths, thus causing the semiconductor nanocrystals to fluoresce. The fluorescence is detected, converted, and displayed for the doctor to visualize the biliary tree during the cholecystectomy and avoid bile duct compromise.


In another embodiment, the method may be used during colorectal or gynecological procedures to visualize at least one of the kidneys, ureters, urethra, and bladder to protect them from being compromised. The probe may be contained within an intravenous solution that may be injected (i.e., intravenously) into the bloodstream. The solution containing the probe will pass through the bloodstream to the kidneys where the kidneys will clear the probe from the bloodstream. The probe may remain in the kidneys for fluorescence visualization, or may be flushed from the kidneys into the ureters, the bladder, and out the urethra. Some of the probe may remain in each of the kidneys, ureter, bladder, and urethra allowing for the visualization of them all at once. In other embodiments, a probe that is selective to one of the kidneys, ureter, bladder, or urethra may be used.


In another embodiment of the present invention, a method of examining an area of a patient's anatomy and an instrument that comprises delivering a probe capable of fluorescing to a the anatomy; introducing an instrument containing at least in part a fluorophore; exposing the probe, fluorophore, or both to a radiation source or sources that emits one or more wavelengths of radiation capable of exciting the probe, fluorophore, or both into fluorescing; detecting fluorescence of the probe, fluorophore, or both; converting the detected fluorescence into an image that can be displayed; and displaying the fluorescence on a display system that is capable of displaying an image of the anatomy and the instrument. In one embodiment, the instrument is introduced into the colon or other parts of the gastrointestinal track. An instrument containing a fluorophore gives the user the advantage of knowing the location of the instrument (i.e., a colonoscope if in the colon) as it moves along the length of the lumen (i.e., the colon).


The probe may be delivered to the anatomy by any of the ways disclosed above. In one embodiment, the fluorophore is included in a coating on the instrument. In another embodiment the fluorophore is included in a housing that covers the instrument. In yet another embodiment, the fluorophore is included in material that the instrument is made of. The fluorophore may be included in any part of the instrument, preferably the tip of the instrument.


The probe and fluorophore may be any of the above listed compounds or substances capable of fluorescing. In one embodiment, the probe and fluorophore may be selected from fluorescent tagged monoclonal antibodies, semiconductor nanocrystals, fluorescent tagged sulfur colloids, fluorescent dyes, or combinations thereof. In some embodiments, the probe and fluorophore may be the same, while in other embodiments they may be different.


In one embodiment, the radiation source may be any of the fluorescent excitation sources described above, and may be included in a scanning beam assembly similar to the assembly 200 shown in FIG. 2. The radiation source may emit one or more wavelengths of radiation that are capable of exciting the probe, fluorophore, or both. In one embodiment, one wavelength may excite both the probe and fluorophore, while in other embodiments the probe and fluorophore may be excited by different wavelengths. In one embodiment, the probe and fluorophore may be excited by different wavelengths at the same time, while in other embodiments it may be advantageous to excite one probe at a time.


In one embodiment, the scanning beam assembly is separate from the instrument and is introduced into the anatomy to scan the field-of-view with excitation wavelengths. The scanning of the beam will expose the probe and fluorophore to the excitation wavelengths and cause the probes to fluoresce. The scanning beam assembly includes a radiation source capable of directing the radiation onto at least one reflector that oscillates in at least two directions to create a scan of a field-of-view, at least one detector to detect radiation returned from the field-of-view, and a controller to convert the detected radiation into a signal indicative of the field-of-view including the fluorescence. In one embodiment, the scanning beam assembly may be placed relative to, but outside the site within the anatomy where the probe and fluorophore are to be visualized. Then using wavelengths of radiation that are capable of penetrating the site within the anatomy as the excitation radiation, the excitation radiation will travel through the nearby anatomy and excite the probe and fluorophore, causing them to fluoresce. In some embodiments, infrared radiation may be needed to penetrate the anatomy, however, in other embodiments when the anatomy is thinner, like a blood vessel, green wavelengths of radiation may be enough to penetrate the anatomy to excite the probe or fluorophore. In some embodiments the fluorescence given off by the probe, fluorophore, or both may be visible with the naked eye. If the fluorescence is to be displayed on a display system, then the fluorescence given off may need to be of a long enough wavelength to travel back through the anatomy to reach the detectors of the scanning beam assembly. In another embodiment, a detector may be included in the instrument, and may be connected to the scanning beam assembly's controller using an optical fiber or connected to some other controller and display system.


In another embodiment, the instrument containing the fluorophore also includes at least part of a scanning beam assembly to scan the area of the anatomy that includes the probe and instrument's fluorophore. The scanning beam assembly is described above in more detail.


While the present invention has been illustrated by description of several embodiments, it is not the intention of the applicant to restrict or limit the spirit and scope of the appended claims to such detail. Numerous other variations, changes, and substitutions will occur to those skilled in the art without departing from the scope of the invention. For instance, the device and method of the present invention has been illustrated in relation to examining and imaging fluorescence in the anatomy, but it will be understood the present invention has applicability to fluorescent imaging in other materials. Moreover, the structure of each element associated with the present invention can be alternatively described as a means for providing the function performed by the element. It will be understood that the foregoing description is provided by way of example, and that other modifications may occur to those skilled in the art without departing from the scope and spirit of the appended Claims.

Claims
  • 1. A system for examining an area of a patient's anatomy comprising: a) a probe capable of fluorescing, the probe configured to be deliverable within the anatomy; andb) a medical instrument including at least part of a scanning beam assembly and having an outer surface that includes, at least in part, a fluorophore, wherein the scanning beam assembly scans the probe with a beam comprising imaging radiation and excitation radiation and detects the probe's fluorescence while simultaneously detecting imaging radiation returned from a field-of-view, the scanning beam assembly comprising: a radiation source configured for simultaneously emitting one or more wavelengths of imaging radiation and excitation radiation, the excitation radiation being configured for exciting the probe and the fluorophore and causing the probe and the fluorophore to fluoresce;a scanning device that includes an oscillating reflector that directs the imaging and excitation radiation onto the field-of-view to create a scan of the field-of-view;a separator that separates radiation returned from the field-of-view into imaging radiation and fluorescence radiation;a first detector configured to detect the imaging radiation and a second detector configured to detect the fluorescence radiation; anda controller configured to convert the detected imaging radiation into a displayable image of the field-of-view and the detected fluorescence radiation into a displayable fluorescence image of both the probe and the fluorophore;wherein the fluorophore while fluorescing enables the visualization of the movement of the outer surface of the instrument.
  • 2. The system of claim 1 further comprising a display system for displaying the image of the field-of-view and the fluorescence image.
  • 3. The system of claim 2 wherein the fluorescence image of the probe is anatomically registered with the image of the field-of-view.
  • 4. The system of claim 2 wherein the controller converts the fluorescence radiation into a fluorescence designated color that is within a color scheme of the display system such that the fluorescence stands out on the image of the field-of-view.
  • 5. The system of claim 1 wherein the probe is selected from the group consisting of a nanoparticles, antibody, colloid, dye, mixture, substance or combinations thereof that are capable of fluorescing.
  • 6. The system of claim 5 wherein the probe is configured to be delivered within the patient's anatomy to a tumor, a cancer site, a lumen, an organ, or blood stream.
  • 7. The system of claim 5 wherein the probe is an injectable solution delivered to the blood stream to be cleared by the kidneys so the probe is distributed within at least one of the kidneys, ureters, bladder, and urethra.
  • 8. The system of claim 5 wherein the nanoparticles is a semiconductor nanoparticles, a silica-based nanoparticle, or mixtures thereof.
  • 9. The system of claim 5 wherein the antibody is a fluorescent tagged monoclonal antibody.
  • 10. The system of claim 1 wherein the second detector is a spectrometer or a filter.
  • 11. The system of claim 10 wherein the second detector is a tunable spectrometer that is tunable to various wavelengths including at least one fluorescence wavelength of the probe.
  • 12. The system of claim 1 wherein the fluorophore is a nanoparticle, colloid, dye, substance, mixture, or combination thereof that are capable of fluorescing.
  • 13. The system of claim 1 wherein the fluorophore is a part of a housing covering the instrument, a coating on the instrument, or a part of the instrument itself.
  • 14. A method for observing fluorescence within an area of a patient's anatomy comprising: delivering a probe capable of fluorescing into a patient's anatomy;introducing an instrument into the anatomy to scan the area of the anatomy that includes the probe, wherein the instrument includes at least part of a scanning beam assembly and has an outer surface that includes a fluorophore, the scanning beam assembly comprising: a radiation source configured for simultaneously emitting one or more wavelengths of imaging radiation and excitation radiation, the excitation radiation being capable of exciting the probe and the fluorophore and causing the probe and the fluorophore to fluoresce;a scanning device that directs the imaging and excitation radiation onto the area of the anatomy to create a scan of the area;a separator that separates radiation returned from the area of the anatomy into imaging radiation and fluorescence radiation;a first detector configured to detect the imaging radiation and a second detector configured to detect the fluorescence radiation; anda controller configured to convert the detected imaging and fluorescence radiation into a displayable image of the anatomy that includes a fluorescence image;scanning the area of the anatomy that includes the probe and at least a portion of the medical instrument that includes the fluorophore with imaging radiation and excitation radiation;detecting the probe's fluorescence with the second detector;converting the probe's fluorescence into a displayable fluorescence image;detecting the fluorescence of the fluorophore with the second detector;converting the detected fluorescence of the fluorophore into a fluorescence image of the outer surface of the portion of the instrument comprising the fluorophore;detecting the imaging radiation returned from the anatomy with the first detector;converting the imaging radiation returned from the anatomy into an image of the anatomy; anddisplaying the fluorescence image of the outer surface of the instrument on a display system combined with the fluorescence image of the probe and the image of the anatomy.
  • 15. The method of claim 14 further comprising displaying the fluorescence image of the probe in anatomical registration with the image of the anatomy.
  • 16. The method of claim 15 wherein the controller converts the fluorescence radiation into a fluorescence designated color that is within a color scheme of the display system such that the fluorescence stands out on the image of the anatomy.
  • 17. The method of claim 14 wherein the probe is selected from the group consisting of a nanoparticle, antibody, colloid, dye, mixture, substance or combinations thereof that are capable of fluorescing.
  • 18. The method of claim 17 wherein the nanoparticle is a semiconductor nanoparticle, a silica-based nanoparticle, or mixtures thereof.
  • 19. The method of claim 17 wherein the antibody is a fluorescent tagged monoclonal antibody.
  • 20. The method of claim 17 wherein the probe is delivered within the patient's anatomy to a tumor, a cancer site, a lumen, an organ, or blood stream.
  • 21. The method of claim 17 wherein the probe is an injectable solution delivered to the blood stream to be cleared by the kidneys to distribute the probe within at least one of the kidneys, ureters, bladder, and urethra for fluorescence observation during a colorectal or gynecological procedure.
  • 22. The method of claim 17 wherein the probe is injected into a biliary tree for fluorescence observation during a cholecystectomy.
  • 23. The method of claim 14 wherein the second detector is a spectrometer or a filter.
  • 24. The method of claim 23 wherein the second detector is a tunable spectrometer that is tunable to various wavelengths including at least one fluorescence wavelength of the probe.
  • 25. The method of claim 14 wherein the fluorophore is selected from the group consisting of a nanoparticle, antibody, colloid, dye, mixture, substance and combinations thereof that are capable of fluorescing.
  • 26. The method of claim 25 wherein the nanoparticle is a semiconductor nanoparticle, a silica-based nanoparticle, or mixtures thereof.
  • 27. The method of claim 25 wherein the antibody is a fluorescent tagged monoclonal antibody.
  • 28. A method for examining an area of a patient's anatomy comprising: introducing a medical instrument into the anatomy to scan the anatomy, wherein the medical instrument has an outer surface that includes, at least in part, a fluorophore and includes at least part of a scanning beam assembly; the scanning beam assembly comprising: a radiation source configured for simultaneously emitting one or more wavelengths of imaging radiation and excitation radiation, the excitation radiation being capable of exciting a naturally occurring autofluorescent cell constituent and the fluorophore;a scanning device that directs the imaging and excitation radiation onto a field-of-view to create a scan of the field-of-view, the scanning device including a reflector that receives both the imaging and the excitation radiation from the radiation source onto the anatomy, wherein the reflector oscillates in at least two directions to create a scan of the anatomy with both the imaging and excitation radiation;a separator that separates radiation returned from the field-of-view into imaging radiation and fluorescence radiation;a first detector configured to detect the imaging radiation and a second detector configured to detect the fluorescence radiation; anda controller configured to convert the detected imaging and fluorescence radiation into a displayable image of the anatomy that includes a fluorescence image;scanning the area of the anatomy that includes the autofluorescent cell constituent and at least a portion of the medical instrument that includes the fluorophore with at least the excitation radiation;detecting the fluorescence of the autofluorescent cell constituent with the second detector; andconverting the fluorescence into a displayable fluorescence image of the autofluorescent cell constituent;detecting the fluorescence of the fluorophore with the second detector;converting the detected fluorescence of the fluorophore into a fluorescence image of the outer surface of the portion of the instrument having the fluorophore;detecting the imaging radiation returned from the anatomy with the first detector;converting the imaging radiation returned from the anatomy into an image of the anatomy; anddisplaying the fluorescence image of the outer surface of the instrument on a display system combined with the fluorescence image of the autofluorescent cell constituent and the image of the anatomy;wherein the second detector is a tunable spectrometer that is tunable to various wavelengths including at least one fluorescence wavelength of the autofluorescent cell constituent.
  • 29. The method of claim 28 further comprising displaying the fluorescence image of the autofluorescent constituent in anatomical registration with the image of the anatomy.
US Referenced Citations (374)
Number Name Date Kind
3758199 Thaxter Sep 1973 A
3959582 Law et al. May 1976 A
4082635 Fritz et al. Apr 1978 A
4141362 Wurster Feb 1979 A
4313431 Frank Feb 1982 A
4379039 Fujimoto et al. Apr 1983 A
4403273 Nishioka Sep 1983 A
4409477 Carl Oct 1983 A
4421382 Doi et al. Dec 1983 A
4524761 Hattori et al. Jun 1985 A
4527552 Hattori Jul 1985 A
4573465 Sugiyama et al. Mar 1986 A
4576999 Eckberg Mar 1986 A
4597380 Raif et al. Jul 1986 A
4643967 Bryant Feb 1987 A
4676231 Hisazumi et al. Jun 1987 A
4760840 Fournier, Jr. et al. Aug 1988 A
4803550 Yabe et al. Feb 1989 A
4872458 Kanehira et al. Oct 1989 A
4902083 Wells Feb 1990 A
4902115 Takahashi Feb 1990 A
4934773 Becker Jun 1990 A
4938205 Nudelman Jul 1990 A
5003300 Wells Mar 1991 A
5023905 Wells et al. Jun 1991 A
5048077 Wells et al. Sep 1991 A
5074860 Gregory et al. Dec 1991 A
5078150 Hara et al. Jan 1992 A
5163936 Black et al. Nov 1992 A
5163945 Ortiz et al. Nov 1992 A
5172685 Nudelman Dec 1992 A
5192288 Thompson et al. Mar 1993 A
5200819 Nudelman et al. Apr 1993 A
5200838 Nudelman et al. Apr 1993 A
5207670 Sinofsky May 1993 A
5218195 Hakamata Jun 1993 A
5251025 Cooper et al. Oct 1993 A
5251613 Adair Oct 1993 A
5269289 Takehana et al. Dec 1993 A
5318024 Kittrell et al. Jun 1994 A
5334991 Wells et al. Aug 1994 A
5368015 Wilk Nov 1994 A
5370643 Krivoshlykov et al. Dec 1994 A
5387197 Smith et al. Feb 1995 A
5393647 Neukermans et al. Feb 1995 A
5436655 Hiyama et al. Jul 1995 A
5467104 Furness, III et al. Nov 1995 A
5488862 Neukermans et al. Feb 1996 A
5531740 Black Jul 1996 A
5545211 An et al. Aug 1996 A
5552452 Khadem et al. Sep 1996 A
5557444 Melville et al. Sep 1996 A
5590660 MacAulay et al. Jan 1997 A
5596339 Furness, III et al. Jan 1997 A
5608451 Konno et al. Mar 1997 A
5629790 Neukermans et al. May 1997 A
5648618 Neukermans et al. Jul 1997 A
5649952 Lam Jul 1997 A
5657165 Karpman et al. Aug 1997 A
5658710 Neukermans Aug 1997 A
5659327 Furness, III et al. Aug 1997 A
5694237 Melville Dec 1997 A
5701132 Kollin et al. Dec 1997 A
5713891 Poppas Feb 1998 A
5728121 Bimbo et al. Mar 1998 A
5735792 Vanden Hoek et al. Apr 1998 A
5742419 Dickensheets et al. Apr 1998 A
5742421 Wells et al. Apr 1998 A
5751465 Melville et al. May 1998 A
5768461 Svetkoff et al. Jun 1998 A
5797944 Nobles et al. Aug 1998 A
5817061 Goodwin et al. Oct 1998 A
5823943 Tomioka et al. Oct 1998 A
5827176 Tanaka et al. Oct 1998 A
5827190 Palcic et al. Oct 1998 A
5841553 Neukermans Nov 1998 A
5861549 Neukermans et al. Jan 1999 A
5867297 Kiang et al. Feb 1999 A
5895866 Neukermans et al. Apr 1999 A
5903397 Melville et al. May 1999 A
5907425 Dickensheets et al. May 1999 A
5913591 Melville Jun 1999 A
5947930 Schwemberger et al. Sep 1999 A
5969465 Neukermans et al. Oct 1999 A
5969871 Tidwell et al. Oct 1999 A
5982528 Melville Nov 1999 A
5982555 Melville et al. Nov 1999 A
5993037 Tomioka et al. Nov 1999 A
5995264 Melville Nov 1999 A
6007208 Dickensheets et al. Dec 1999 A
6008781 Furness, III et al. Dec 1999 A
6013025 Bonne et al. Jan 2000 A
6016440 Simon et al. Jan 2000 A
6017356 Frederick et al. Jan 2000 A
6017603 Tokuda et al. Jan 2000 A
6024744 Kese et al. Feb 2000 A
6043799 Tidwell Mar 2000 A
6044705 Neukermans et al. Apr 2000 A
6046720 Melville et al. Apr 2000 A
6049407 Melville Apr 2000 A
6056721 Shulze May 2000 A
6057952 Kubo et al. May 2000 A
6059720 Furusawa et al. May 2000 A
6061163 Melville May 2000 A
6064779 Neukermans et al. May 2000 A
6069725 Melville May 2000 A
6086528 Adair Jul 2000 A
6086531 Tomioka et al. Jul 2000 A
6088145 Dickensheets et al. Jul 2000 A
6097353 Melville et al. Aug 2000 A
6122394 Neukermans et al. Sep 2000 A
6139175 Tomioka et al. Oct 2000 A
6140979 Gerhard et al. Oct 2000 A
6151167 Melville Nov 2000 A
6154305 Dickensheets et al. Nov 2000 A
6154321 Melville et al. Nov 2000 A
6157352 Kollin et al. Dec 2000 A
6166841 Melville Dec 2000 A
6172789 Kino et al. Jan 2001 B1
6178346 Amundson et al. Jan 2001 B1
6179776 Adams et al. Jan 2001 B1
6191761 Melville et al. Feb 2001 B1
6192267 Scherninski et al. Feb 2001 B1
6200595 Motoyashiki et al. Mar 2001 B1
6204829 Tidwell Mar 2001 B1
6204832 Melville et al. Mar 2001 B1
6207392 Weiss et al. Mar 2001 B1
6210401 Lai Apr 2001 B1
6220711 Melville Apr 2001 B1
6221068 Fried et al. Apr 2001 B1
6229139 Neukermans et al. May 2001 B1
6235017 Jegorov et al. May 2001 B1
6243186 Melville Jun 2001 B1
6245590 Wine et al. Jun 2001 B1
6256131 Wine et al. Jul 2001 B1
6257727 Melville Jul 2001 B1
6272907 Neukermans et al. Aug 2001 B1
6276798 Gil et al. Aug 2001 B1
6281862 Tidwell et al. Aug 2001 B1
6284185 Tokuda et al. Sep 2001 B1
6285489 Helsel et al. Sep 2001 B1
6285505 Melville et al. Sep 2001 B1
6288816 Melville et al. Sep 2001 B1
6292287 Fujinoki Sep 2001 B1
6293911 Imaizumi et al. Sep 2001 B1
6294239 Tokuda et al. Sep 2001 B1
6294775 Seibel et al. Sep 2001 B1
6317103 Furness, III et al. Nov 2001 B1
6323037 Lauto et al. Nov 2001 B1
6324007 Melville Nov 2001 B1
6327493 Ozawa et al. Dec 2001 B1
6331909 Dunfield Dec 2001 B1
6333110 Barbera-Guillem Dec 2001 B1
6338641 Nicholls Jan 2002 B2
6352344 Tidwell Mar 2002 B2
6353183 Ott et al. Mar 2002 B1
6362912 Lewis et al. Mar 2002 B1
6364829 Fulghum Apr 2002 B1
6369928 Mandella et al. Apr 2002 B1
6369953 Melville et al. Apr 2002 B2
6369954 Berge et al. Apr 2002 B1
6370406 Wach et al. Apr 2002 B1
6370422 Richards-Kortum et al. Apr 2002 B1
6373995 Moore Apr 2002 B1
6384406 Wine et al. May 2002 B1
6388641 Tidwell et al. May 2002 B2
6392220 Slater et al. May 2002 B1
6396461 Lewis et al. May 2002 B1
6414779 Mandella et al. Jul 2002 B1
6417502 Stoner et al. Jul 2002 B1
6423956 Mandella et al. Jul 2002 B1
6425900 Knodel et al. Jul 2002 B1
6426013 Neukermans et al. Jul 2002 B1
6433907 Lippert et al. Aug 2002 B1
6435637 Lyman Aug 2002 B1
6441356 Mandella et al. Aug 2002 B1
6445362 Tegreene Sep 2002 B1
6447524 Knodel et al. Sep 2002 B1
6462770 Cline et al. Oct 2002 B1
6464363 Nishioka et al. Oct 2002 B1
6467345 Neukermans et al. Oct 2002 B1
6470124 Le Gargasson et al. Oct 2002 B1
6477403 Eguchi et al. Nov 2002 B1
6478809 Brotz Nov 2002 B1
6485413 Boppart Nov 2002 B1
6492962 Melville et al. Dec 2002 B2
6494578 Plummer et al. Dec 2002 B1
6498941 Jackson Dec 2002 B1
6503196 Kehr et al. Jan 2003 B1
6510338 Irion et al. Jan 2003 B1
6512622 Wine et al. Jan 2003 B2
6513939 Fettig et al. Feb 2003 B1
6515278 Wine et al. Feb 2003 B2
6515781 Lewis et al. Feb 2003 B2
6520972 Peters Feb 2003 B2
6522444 Mandella et al. Feb 2003 B2
6525310 Dunfield Feb 2003 B2
6527708 Nakamura et al. Mar 2003 B1
6529770 Grimblatov Mar 2003 B1
6530698 Kuhara et al. Mar 2003 B1
6535183 Melville et al. Mar 2003 B2
6535325 Helsel et al. Mar 2003 B2
6537211 Wang et al. Mar 2003 B1
6538625 Tidwell et al. Mar 2003 B2
6545260 Katashiro et al. Apr 2003 B1
6560028 Melville et al. May 2003 B2
6563105 Seibel et al. May 2003 B2
6563106 Bowers et al. May 2003 B1
6572606 Kliewer et al. Jun 2003 B2
6583117 Owen et al. Jun 2003 B2
6583772 Lewis et al. Jun 2003 B1
6585642 Christopher Jul 2003 B2
6603552 Cline et al. Aug 2003 B1
6608297 Neukermans et al. Aug 2003 B2
6639570 Furness, III et al. Oct 2003 B2
6639719 Tegreene et al. Oct 2003 B2
6650877 Tarbouriech et al. Nov 2003 B1
6653621 Wine et al. Nov 2003 B2
6654158 Helsel et al. Nov 2003 B2
6661393 Tegreene et al. Dec 2003 B2
6674993 Tarbouriech Jan 2004 B1
6685804 Ikeda et al. Feb 2004 B1
6687034 Wine et al. Feb 2004 B2
6689056 Kilcoyne et al. Feb 2004 B1
6699170 Crocker et al. Mar 2004 B1
6700552 Kollin et al. Mar 2004 B2
6714331 Lewis et al. Mar 2004 B2
6734835 Tidwell et al. May 2004 B2
6736511 Plummer et al. May 2004 B2
6741884 Freeman et al. May 2004 B1
6749346 Dickensheets et al. Jun 2004 B1
6755536 Tegreene et al. Jun 2004 B2
6762867 Lippert et al. Jul 2004 B2
6768588 Urey Jul 2004 B2
6771001 Mao et al. Aug 2004 B2
6782748 Weber et al. Aug 2004 B2
6786382 Hoffman Sep 2004 B1
6795221 Urey Sep 2004 B1
6802809 Okada Oct 2004 B2
6803561 Dunfield Oct 2004 B2
6821245 Cline et al. Nov 2004 B2
6826424 Zeng et al. Nov 2004 B1
6845190 Smithwick et al. Jan 2005 B1
6856436 Brukilacchio et al. Feb 2005 B2
6856712 Fauver et al. Feb 2005 B2
6879428 Massieu Apr 2005 B2
6888552 Debevec et al. May 2005 B2
6894823 Taylor et al. May 2005 B2
6899675 Cline et al. May 2005 B2
6902527 Doguchi et al. Jun 2005 B1
6905057 Swayze et al. Jun 2005 B2
6939364 Soltz et al. Sep 2005 B1
6957898 Yu Oct 2005 B2
6967757 Allen et al. Nov 2005 B1
6974472 Hong et al. Dec 2005 B2
6975898 Seibel et al. Dec 2005 B2
6976994 Ballou et al. Dec 2005 B2
6978921 Shelton, IV et al. Dec 2005 B2
6985271 Yazdi et al. Jan 2006 B2
6991602 Nakazawa et al. Jan 2006 B2
7005195 Cheng et al. Feb 2006 B2
7009634 Iddan et al. Mar 2006 B2
7013730 Malametz Mar 2006 B2
7015956 Luo et al. Mar 2006 B2
7018401 Hyodoh et al. Mar 2006 B1
7023402 Lewis et al. Apr 2006 B2
7025777 Moore Apr 2006 B2
7033348 Alfano et al. Apr 2006 B2
7035299 Hori et al. Apr 2006 B2
7035777 Araki et al. Apr 2006 B2
7061450 Bright et al. Jun 2006 B2
7065301 Shastri et al. Jun 2006 B2
7066879 Fowler et al. Jun 2006 B2
7071594 Yan et al. Jul 2006 B1
7071931 Tegreene et al. Jul 2006 B2
7078378 Owen et al. Jul 2006 B1
7108656 Fujikawa et al. Sep 2006 B2
7112302 Yoshimi et al. Sep 2006 B2
7126903 Feenstra et al. Oct 2006 B2
7189961 Johnston et al. Mar 2007 B2
7190329 Lewis et al. Mar 2007 B2
7232071 Lewis et al. Jun 2007 B2
7271383 Chee Sep 2007 B2
7391013 Johnston et al. Jun 2008 B2
20010055462 Seibel Dec 2001 A1
20020015724 Yang et al. Feb 2002 A1
20020024495 Lippert et al. Feb 2002 A1
20020050956 Gerhard et al. May 2002 A1
20020075284 Rabb, III Jun 2002 A1
20020088925 Nestorovic et al. Jul 2002 A1
20020115922 Waner et al. Aug 2002 A1
20020141026 Wiklof et al. Oct 2002 A1
20020158814 Bright et al. Oct 2002 A1
20020163484 Furness, III et al. Nov 2002 A1
20020167462 Lewis et al. Nov 2002 A1
20020171776 Tegreene et al. Nov 2002 A1
20020171937 Tegreene et al. Nov 2002 A1
20030016187 Melville et al. Jan 2003 A1
20030030753 Kondo et al. Feb 2003 A1
20030032143 Neff et al. Feb 2003 A1
20030034709 Jerman Feb 2003 A1
20030058190 Lewis et al. Mar 2003 A1
20030086172 Urey May 2003 A1
20030092995 Thompson May 2003 A1
20030130562 Barbato et al. Jul 2003 A1
20030142934 Pan et al. Jul 2003 A1
20030159447 Sergio et al. Aug 2003 A1
20030214460 Kovacs Nov 2003 A1
20030216729 Marchitto et al. Nov 2003 A1
20040004585 Brown et al. Jan 2004 A1
20040057103 Bernstein Mar 2004 A1
20040075624 Tegreene et al. Apr 2004 A1
20040076390 Dong Yang et al. Apr 2004 A1
20040085261 Lewis et al. May 2004 A1
20040085617 Helsel et al. May 2004 A1
20040087844 Yen May 2004 A1
20040101822 Wiesner et al. May 2004 A1
20040113059 Kawano et al. Jun 2004 A1
20040118821 Han et al. Jun 2004 A1
20040119004 Wine et al. Jun 2004 A1
20040122328 Wang et al. Jun 2004 A1
20040133786 Tarbouriech Jul 2004 A1
20040151466 Crossman-Bosworth et al. Aug 2004 A1
20040155186 Nestorovic et al. Aug 2004 A1
20040155834 Wit et al. Aug 2004 A1
20040179254 Lewis et al. Sep 2004 A1
20040186351 Imaizumi et al. Sep 2004 A1
20040196518 Wine et al. Oct 2004 A1
20040223202 Lippert et al. Nov 2004 A1
20040225222 Zeng et al. Nov 2004 A1
20040236371 McNally-Heintzelman et al. Nov 2004 A1
20040240866 Ramsbottom Dec 2004 A1
20040252377 Urey Dec 2004 A1
20040254474 Seibel et al. Dec 2004 A1
20050010787 Tarbouriech Jan 2005 A1
20050014995 Amundson et al. Jan 2005 A1
20050020877 Ishihara et al. Jan 2005 A1
20050020926 Wiklof et al. Jan 2005 A1
20050023356 Wiklof et al. Feb 2005 A1
20050030305 Brown et al. Feb 2005 A1
20050038322 Banik Feb 2005 A1
20050116038 Lewis et al. Jun 2005 A1
20050162762 Novak Jul 2005 A1
20050187441 Kawasaki et al. Aug 2005 A1
20050203343 Kang et al. Sep 2005 A1
20050240147 Makower et al. Oct 2005 A1
20060010985 Schneider Jan 2006 A1
20060084867 Tremblay et al. Apr 2006 A1
20060164330 Bright et al. Jul 2006 A1
20060183246 Wiesner et al. Aug 2006 A1
20060195014 Seibel et al. Aug 2006 A1
20060238774 Lindner et al. Oct 2006 A1
20060245971 Burns et al. Nov 2006 A1
20060284790 Tegreene et al. Dec 2006 A1
20070038119 Chen et al. Feb 2007 A1
20070046778 Ishihara et al. Mar 2007 A1
20070135770 Hunt et al. Jun 2007 A1
20070156021 Morse et al. Jul 2007 A1
20070161876 Bambot et al. Jul 2007 A1
20070162093 Porter et al. Jul 2007 A1
20070167681 Gill et al. Jul 2007 A1
20070173707 Mitra Jul 2007 A1
20070179366 Pewzner et al. Aug 2007 A1
20070197874 Ishihara Aug 2007 A1
20070197875 Osaka Aug 2007 A1
20070203413 Frangioni Aug 2007 A1
20070213588 Morishita et al. Sep 2007 A1
20070213618 Li et al. Sep 2007 A1
20070225695 Mayer et al. Sep 2007 A1
20070238930 Wiklof et al. Oct 2007 A1
20070244365 Wiklof Oct 2007 A1
20070260121 Bakos et al. Nov 2007 A1
20070260273 Cropper et al. Nov 2007 A1
20080058629 Seibel et al. Mar 2008 A1
Foreign Referenced Citations (25)
Number Date Country
3837248 May 1990 DE
1139141 Oct 2001 EP
1716802 Nov 2006 EP
1747751 Jan 2007 EP
1797813 Jun 2007 EP
2007-244590 Sep 2007 JP
2007-244680 Sep 2007 JP
WO 9813720 Apr 1998 WO
WO 9918456 Apr 1999 WO
9958930 Nov 1999 WO
0013210 Mar 2000 WO
0110322 Feb 2001 WO
0160274 Aug 2001 WO
02062239 Aug 2002 WO
WO 03069380 Aug 2003 WO
03088643 Oct 2003 WO
03098918 Nov 2003 WO
03101287 Nov 2003 WO
2006020605 Feb 2006 WO
WO 2006049787 May 2006 WO
WO 2006055733 May 2006 WO
2007041542 Apr 2007 WO
2007070831 Jun 2007 WO
WO 2007067163 Jun 2007 WO
WO 2007084915 Jul 2007 WO
Non-Patent Literature Citations (36)
Entry
Kiang, M-H et al., “Surface-Micromachined Electrostatic-Comb Driven Scanning Micromirrors for Barcode Scanners” (date of first publication unknown).
Lewis, J.R. et al., “Scanned beam medical imager,” MOEMS Display and Imaging Systems II, Proceedings of SPIE vol. 5348, pp. 40-51 (2004).
James, R. et al., “Update on MEMS-based Scanned Beam Imager” (date of first publication unknown).
Wiklof, C., “Display technology spawns laser camera,” Laser Focus World (Dec. 2004).
“Press Information—Phillips' Fluid Lenses Bring Things into Focus,” http://www.newscenter.philips.com (Mar. 3, 2004).
Lettice, J., “The $5 ‘no moving parts’ fluid zoom lens—twice,” The Register (Mar. 15, 2004).
“Volcano Products—IVUS Imaging Visions® PV018,” http://www.volcanotherapeutics.com (date of first publication unknown).
Barhoum, E.S. et al., “Optical modeling of an ultrathin scanning fiber endoscope, a preliminary study of confocal versus non-confocal detection,” Optics Express, vol. 13, No. 19, pp. 7548-7652 (Sep. 19, 2005).
“Crystalplex Technology—PlxBead™ Superior Qualities,” http:www.crystalplex.com (date of first publication unknown).
“Microvision [illuminating information] Products/Overview, Corporate Overview Presentation 2006” (2006).
“Holographic Beam Combiner for Ladar, Printer, Fiber Optics, and Cancer Treatment,” by Digital Optics Technologies, Inc., http://www.mdatechnology.net (date of first publication unknown).
Brown, D.M., Abstract from SPIE Digital Library for “High-power laser diode beam combiner,” Optical Engineering, vol. 42, Issue 11 (2003).
Literature entitled “All fiber beam combiner from Point Source” (Oct. 13, 2006).
“Custom Polarzing Cube Beamsplitters,” from GlobalSpec The Engineering Search Engine, http://www.globalspec.com (date of first publication unknown).
Literature entitled “Dallas Semiconductor MAXIM—Visible-Laser Driver has Digitally Controlled Power Modulation,” by Maxim Integrated Products, http://www.maxim-ic.com (Jul. 1, 2001).
“SCAN Mode Strategies for SCUBA-2” (May 25, 2005).
Seifert, M. et al., “High Power Diode Laser Beam Scanning in Multi-Kilowatt Range,” Proceedings of the 23rd International Congress on Applications of Lasers and Electro-Optics (2004).
Jutzi, B. et al., “Sub-Pixel Edge Localization Based on Laser Waveform Analysis,” ISPRS WG III/3, III/4, V/3 Workshop “Laser scanning 2005,” Enschede, the Netherlands (Sep. 12-14, 2005).
“Bladeless Trocars,” by Johnson & Johnson, http://www.jnjgateway.com (date of first publication unknown).
Yeh, R. et al., “Microelectromechanical Components for Articulated Microrobots” (date of first publication unknown).
Xu, Q. et al., “Micrometre-scale silicon electro-optic modulator,” Nature, vol. 435, pp. 325-327 (May 19, 2005).
Park, H. et al., “Development of Double-Sided Silicon Strip Position Sensor,” 2005 IEEE Nuclear Science Symposium Conference Record, pp. 781-785 (2005).
Hammond, S.W., “Architecture and Operation of a Systolic Sparse Matrix Engine,” Proceedings of the 3rd SIAM Conference on Parallel Processing for Scientific Computing, pp. 419-423 (1987).
Ra, H. et al., “Biomedical Optics & Medical Imaging—Microtechnology enables endoscopic confocal microscopy,” SPIE (http://spie.org) (2007).
Invitation to Pay Additional Fees with Partial International Search Report, PCT/US2008/074275 (Jan. 16, 2009).
Invitation to Pay Additional Fees with Partial International Search Report, PCT/US2008/074273 (Dec. 30, 2008).
International Search Report issued regarding International Application No. PCT/US2007/078868 (Mar. 28, 2008).
PCT, International Search Report, PCT/US2008/056589 (Jul. 30, 2008).
PCT, International Search Report, PCT/US2008/059231 (Jul. 4, 2008).
PCT, International Search Report, PCT/US2007/087923 (May 21, 2008).
PCT, International Search Report, PCT/US2008/056596 (Jun. 23, 2008).
PCT, International Search Report, PCT/US2008/059235 (Jul. 14, 2008).
PCT, International Search Report, PCT/US2007/087930 (Jul. 3, 2008).
PCT, International Search Report, PCT/US2008/051274 (Jul. 18, 2008).
Barhoum, E.S. et al., “Optical Modeling of an Ultrathin Scanning Fiber Endoscope, a Preliminary Study of Confocal Versus Non-Confocal Detection,” Optics Express, vol. 13, No. 19 (Sep. 2005).
PCT, International Search Report, PCT/US2008/066552 (Oct. 23, 2008).
Related Publications (1)
Number Date Country
20080255458 A1 Oct 2008 US