Certain implementations pertain generally to photoacoustic imaging, and more specifically, to photoacoustic spectroscopic and imaging systems and methods with enhanced-resolution.
Photoacoustic imaging is based on the photoacoustic effect where pulsed or modulated radiation is delivered to a sample and some of the delivered energy is absorbed and converted into heat, leading to transient thermoelastic expansion generating ultrasonic emissions. The ultrasonic emissions can be detected by an ultrasonic transducer device and analyzed to produce photoacoustic images. A photoacoustic image depends on the optical absorption properties of the sample being imaged. As a consequence, it offers greater molecular specificity than conventional ultrasound imaging with the ability to detect hemoglobin, lipids, water and other light-absorbing chromophores, but with greater penetration depth than pure optical imaging modalities that rely on ballistic photons. These attributes lend photoacoustic imaging to a wide variety of applications in clinical medicine, preclinical research and basic biology for studying cancer, cardiovascular disease, abnormalities of the microcirculation and other conditions.
Certain aspects pertain to an apparatus for measuring infrared absorption of a sample during operation. In some aspects, the apparatus includes a first radiation source configured to emit pulses of infrared radiation and a second radiation source configured to emit pulses with shorter wavelength than the pulses of infrared radiation emitted from the first radiation source. The apparatus also includes one or more optical elements configured to deliver of pulses of infrared radiation (e.g., mid-infrared radiation) to a region of the sample and to the deliver pulses from the second radiation source to a sub-region within the region. In addition, the apparatus also includes an ultrasonic transducer acoustically coupled to the sample to detect photoacoustic signals induced by at least one of the radiation sources and one or more processors and memory configured to analyze one or more properties of the detected photoacoustic signals to create a signal indicative of infrared absorption of the sub-region of the sample. In one aspect, the one or more processors and memory are further configured to create an infrared image of the sample using the one or more analyzed properties of the detected photoacoustic signals. In one aspect, the second radiation source is configured to emit ultraviolet radiation pulses. In one aspect, the second radiation source is configured to emit pulses with a wavelength between about 100 nm and about 2000 nm. In one aspect, the one or more processors and memory are configured to analyze the infrared absorption of the sub-region of the sample by calculating a difference in amplitude between a first photoacoustic signal induced by a radiation pulse from the second radiation source and a second photoacoustic signal induced by another radiation pulse from the second radiation source.
In some aspects, an apparatus for measuring infrared absorption of a sample during operation includes a first radiation source configured to emit mid-infrared radiation pulses. In one aspect, the apparatus is further configured to deliver: (i) a first ultraviolet radiation pulse to the sub-region, the first ultraviolet radiation pulse inducing a first photoacoustic signal; (ii) a mid-infrared radiation pulse to the region of the sample; and (iii) a second ultraviolet radiation pulse to the sub-region of the sample the second ultraviolet radiation pulse inducing a second photoacoustic signal. In this aspect, the one or more processors and memory may be optionally further configured to calculate a difference between the first and second photoacoustic signals, the difference being indicative of an infrared absorption property of the sub-region of the sample.
In one aspect, an apparatus also includes a pulser configured to generate trigger pulses, at least one of which is configured to trigger the second radiation source to emit a first ultraviolet radiation pulse at a first time before or after the first radiation source is triggered to emit a first infrared radiation pulse, and wherein at least one of the trigger pulses is configured to trigger the second radiation source to emit a second ultraviolet radiation pulse at a second time after the first radiation source is triggered to emit the first infrared radiation pulse. Optionally, the one or more processors and memory are configured to analyze the infrared absorption of the sub-region of the sample by calculating a difference in amplitudes of a first photoacoustic signal induced by the first ultraviolet radiation pulse and a second photoacoustic signal induced by the second ultraviolet radiation pulse.
In one aspect of an apparatus for measuring infrared absorption of a sample during operation, the apparatus also includes a tunable infrared radiation source that may optionally include at least one of an optical parametric oscillator and a quantum cascade laser.
In one aspect of an apparatus for measuring infrared absorption of a sample during operation, the apparatus also includes a broadband infrared radiation source or a fixed wavelength radiation source optically coupled to the one or more optical elements and configured to emit the infrared radiation pulses.
In one aspect of an apparatus for measuring infrared absorption of a sample during operation, the one or more processors and memory are configured to measure the signal indicative of infrared absorption of the sub-region with a spatial resolution of less than 1,000 nm. In another aspect, the one or more processors and memory are configured to measure the signal indicative of infrared absorption of the sub-region with a spatial resolution of less than 500 nm.
In one aspect of the apparatus for measuring infrared absorption of a sample during operation, the apparatus further includes a photodiode configured to measure an intensity of pulses emitted from the second radiation source. In this aspect, the one or more processors and memory may be optionally configured to normalize the photoacoustic signals by compensating for variations in pulse energy from pulses emitted from the second radiation source using measurements from the photodiode.
In one aspect of an apparatus for measuring infrared absorption of a sample during operation, the apparatus further includes a scanning mechanism configured to move at least one of the sample or one or more of the optical elements such that the infrared radiation pulse is scanned to a plurality of regions in a field-of-view of the sample and the first and second ultraviolet radiation pulses are scanned to one or more sub-regions within each region of the plurality of regions. Optionally, the one or more processors and the memory are further configured to use the signal indicative of infrared absorption of the sub-region in each of the plurality of regions to determine an infrared image of the sample.
In one aspect of the apparatus for measuring infrared absorption of a sample during operation, the signal indicative of infrared radiation is measured at a plurality of wavelengths of the first radiation source to construct a spectrum of infrared absorption of the sub-region.
In one aspect of an apparatus for measuring infrared absorption of a sample during operation, the apparatus further comprises a microlens array to generate an array of infrared radiation pulses and an array of additional radiation pulses, wherein the one or more optical elements further are configured to deliver the array of infrared radiation pulses and the array of additional pulses to a plurality of regions of the sample.
In one aspect of an apparatus for measuring infrared absorption of a sample during operation, the first radiation source is configured to emit pulses with wavelengths between about 3,000 and about 8,000 nanometers, between about 5,800 and about 6,200 nanometers, and the second radiation source is configured to emit pulses with wavelengths between about 200 and about 300 nanometers.
Certain aspects pertain to a method for measuring infrared absorption of a sample. In some aspect, the method includes: (i) initiating delivery of a first radiation pulse of shorter wavelength than infrared radiation to a sub-region of a region of a sample; (ii) initiating delivery of an infrared radiation pulse to the region of the sample; (iii) initiating delivery of a second radiation pulse of shorter wavelength than infrared radiation to the sub-region of the sample, wherein the second radiation pulse is initiated at a first delay time after (ii); (iv) receiving, from an ultrasonic transducer acoustically coupled to the sample, photoacoustic signals induced by the first radiation pulse and the second radiation pulse; and (v) analyzing one or more properties of the detected photoacoustic signals to determine a signal indicative of infrared absorption of the sub-region of the sample.
In one aspect, the first radiation pulse is initiated before (ii) or at a second delay time after (iii). In one aspect, operation (v) comprises determining the signal indicative of infrared absorption of the sub-region of the sample by calculating a difference in amplitudes of photoacoustic signals induced by the first and second radiation pulses.
In one aspect of a method for measuring infrared absorption of a sample, the method further comprises scanning relative positions of the infrared radiation pulse, the first radiation pulse, and the second radiation pulse to a plurality of regions of the sample.
In one aspect of a method for measuring infrared absorption of a sample, the first radiation pulse and the second radiation pulse have wavelength between about 100 nm and about 2000 nm.
In one aspect of a method for measuring infrared absorption of a sample, the first radiation pulse and the second radiation pulse are ultraviolet radiation pulses and the infrared radiation pulse is a mid-infrared radiation pulse.
In one aspect of a method for measuring infrared absorption of a sample, the first delay time is less than about 1,000 nanoseconds or less than about 500 nanoseconds. In another aspect, the first delay time is between about 100 nanoseconds and about 500 nanoseconds.
In one aspect of a method for measuring infrared absorption of a sample, the method further comprises initiating delivery of one or more additional radiation pulses of shorter wavelength than infrared radiation to additional sub-regions of the illuminated region, wherein the additional radiation pulses are initiated within a the first delay time after (ii). Optionally, the first delay time is less than or equal to a thermal confinement period of the sample and/or between about 100 nanoseconds and about 500 nanoseconds after (ii).
In one aspect of a method for measuring infrared absorption of a sample, (ii) further comprises tuning a tunable infrared radiation source to generate infrared radiation pulses at a plurality of infrared wavelengths.
In one aspect of a method for measuring infrared absorption of a sample, (i) comprises initiating delivery of a first ultraviolet radiation pulse to the sub-region, the first ultraviolet radiation pulse inducing a first photoacoustic signal; and (iii) comprises initiating delivery of a second ultraviolet radiation pulse to the sub-region during the first delay time after (ii), the second ultraviolet radiation pulse inducing a second photoacoustic signal. Optionally the method further includes measuring, using a photosensor, an amplitude of the first ultraviolet radiation pulse; measuring, using the photosensor, an amplitude of the second ultraviolet radiation pulse; and normalizing the amplitudes of the first and second photoacoustic signals based on the measured amplitudes of the first and second ultraviolet radiation pulses.
In some aspects, a method for measuring infrared absorption of a sample further comprises creating an infrared image of the sample using the one or more analyzed properties of the detected photoacoustic signals. In one aspect, the infrared image has a spatial resolution of less than 1,000 nm. In another aspect, the infrared image has a spatial resolution of less than 500 nm. In another aspect, the infrared image has a spatial resolution finer than one-tenth of a wavelength of the infrared radiation pulse.
In one aspect, a method for measuring infrared absorption of a sample further comprises, before (v), normalizing the photoacoustic signals by compensating for variations in the first and second radiation pulses using measured amplitudes of the first and second radiation pulses.
In one aspect, a method for measuring infrared absorption of a sample further comprises scanning the infrared radiation pulse, the first radiation pulse, and the second radiation pulse to a plurality of regions of the sample.
In one aspect of a method for measuring infrared absorption of a sample, the signal indicative of infrared radiation is measured at a plurality of wavelengths of the first radiation source to construct a spectrum of infrared absorption of the sub-region.
These and other features are described in more detail below with reference to the associated drawings.
These and other features are described in more detail below with reference to the associated drawings.
Different aspects are described below with reference to the accompanying drawings. The features illustrated in the drawings may not be to scale. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the presented embodiments. The disclosed embodiments may be practiced without one or more of these specific details. In other instances, well-known operations have not been described in detail to avoid unnecessarily obscuring the disclosed embodiments. While the disclosed embodiments will be described in conjunction with the specific embodiments, it will be understood that it is not intended to limit the disclosed embodiments.
Mid-infrared (MIR) microscopy has been exploited for applications ranging from material characterization to label-free histologic analysis. Examples of material characterization with MIR microscopy are described by Wetzel, D. L. & LeVine, S. M., “Imaging molecular chemistry with infrared microscopy,” Science 285, 1224-1225 (1999); Koenig, J. L., “Microspectroscopic Imaging of Polymers,” American Chemical Society, (1998); and Prati, S., Joseph, E., Sciutto, G. & Mazzeo, R., “New advances in the application of FTIR microscopy and spectroscopy for the characterization of artistic materials,” Acc. Chem. Res. 43, 792-801 (2010), which are hereby incorporated by reference in their entireties. Examples of label-free histologic analysis with MIR microscopy are described by Diem, M., Romeo, M., Boydston-White, S., Miljkovic, M. & Matthaus, C., “A decade of vibrational micro-spectroscopy of human cells and tissue,” (1994-2004). Analyst 129, 880-885 (2004); Fernandez, D. C., Bhargava, R., Hewitt, S. M. & Levin, I. W., “Infrared spectroscopic imaging for histopathologic recognition,” Nat. Biotechnol. 23, 469-474 (2005); Baker, M. J. et al., “Using Fourier transform IR spectroscopy to analyze biological materials,” Nat. Protoc. 9, 1771-1791 (2014); and Diem, M. et al., “Molecular pathology via IR and Raman spectral imaging.” J. Biophoton. 6, 855-886 (2013), which are hereby incorporated by reference in their entireties.
In the last two decades, the sensitivity and speed of MIR microscopy have been significantly improved. Examples of improvements in the sensitivity and speed of MIR microscopy are described by Griffiths, P., “Fourier transform infrared spectrometry,” Science 21, 297-302 (1983); Lewis, E. N. et al., “Fourier transform spectroscopic imaging using an infrared focal-Plane array detector,” Anal. Chem. 67, 3377-3381 (1995); Miller, L. M., Smith, G. D. & Carr, G. L., “Synchrotron-based biological microspectroscopy: From the mid-infrared through the far-infrared regimes,” Journal of Biological Physics 29, 219-230 (2003); Nasse, M. J. et al., “High-resolution Fourier-transform infrared chemical imaging with multiple synchrotron beams,” Nat. Methods 8, 413-416 (2011); Kole, M. R., Reddy, R. K., Schulmerich, M. V., Gelber, M. K. & Bhargava, R., “Discrete frequency infrared microspectroscopy and imaging with a tunable quantum cascade laser,” Anal. Chem. 84, 10366-10372 (2012); and Haas, J. & Mizaikoff, B., “Advances in mid-infrared spectroscopy for chemical analysis,” Annu. Rev. Anal. Chem. 9, 45-68 (2016), which are hereby incorporated by reference in their entireties.
Despite the aforementioned improvements in MIR microscopy, there are still various limitations to MIR microscopy in biomedical and other applications. As a first example, conventional transmission MIR microscopy can image only dried or thin samples (See Wetzel, D. L. & LeVine, S. M., “Imaging molecular chemistry with infrared microscopy,” Science 285, 1224-1225 (1999)), which requires complicated and time-consuming sample preparation (See Baker, M. J. et al., “Using Fourier transform IR spectroscopy to analyze biological materials,” Nat. Protoc. 9, 1771-1791 (2014)). In addition, the lateral resolution of MIR microscopy is diffraction limited to approximately the long MIR wavelength at a typically used numerical aperture (˜0.5). Furthermore, for fresh biological samples, the broadband and strong MIR absorption of water creates a huge background, compromising imaging contrast and interfering with molecular analysis.
As described below, many techniques have improved MIR microscopy by addressing one or two of the above limitations, yet there are still various limitations to MIR microscopy in biomedical and other applications.
Attenuated total reflection-Fourier transform infrared (ATR-FTIR) microspectroscopic imaging can measure fresh samples in reflection mode with improved spatial resolution, but its penetration depth—due to the use of evanescent waves—is limited to only 1-2 μm. Examples of ATF-FTIR imaging are described by Sommer, A. J., Marcott, C., Story, G. M. & Tisinger, L. G., “Attenuated total internal reflection infrared mapping microspectroscopy using an imaging microscope,” Appl. Spectrosc. 55, 252-256 (2001) and Chan, K. L. A. & Kazarian, S. G., “New opportunities in micro- and macro-attenuated total reflection infrared spectroscopic imaging: spatial resolution and sampling versatility,” Appl. Spectrosc. 57, 381-389 (2003), which are hereby incorporated by reference in their entireties.
Atomic force microscopy (AFM) has achieved nanoscale resolution by detecting thermal expansion, light scattering, or force induced by MIR laser absorption; however, the surface contact or near-field detection poses challenges in scanning fresh biological samples. Examples of AFM involving detection of thermal expansion are described by Dazzi, A., Prazeres, R., Glotin, F. & Ortega, J. M., “Local infrared microspectroscopy with subwavelength spatial resolution with an atomic force microscope tip used as a photothermal sensor,” Opt. Lett. 30, 2388-2390 (2005); Lu, F., Jin, M. & Belkin, M. A., “Tip-enhanced infrared nanospectroscopy via molecular expansion force detection,” Nat. Photon. 8, 307-312 (2014); and Dazzi, A. & Prater, C. B., “AFM-IR: technology and applications in nanoscale infrared spectroscopy and chemical imaging,” Chem. Rev. 117, 5146-5173 (2017), which are hereby incorporated by reference in their entireties. Examples of AFM involving detection of light scattering are described by Knoll, B. & Keilmann, F., “Near-field probing of vibrational absorption for chemical microscopy,” Nature 399, 134-137 (1999), which is hereby incorporated by reference in its entirety. Examples of AFM involving detection of force are described by Nowak, D. et al., “Nanoscale chemical imaging by photoinduced force microscopy,” Sci. Adv. 2, e1501571 (2016), which is hereby incorporated by reference in its entirety.
Photothermal MIR imaging, which employs a continuous-wave visible or near-IR laser beam to detect the MIR thermal lensing effect, greatly improves the resolution and somewhat reduces the water background, but the scattering-based detection method restricts its applications to only translucent samples. Examples of photothermal MIR imaging are described by Furstenberg, R., Kendziora, C. A., Papantonakis, M. R., Nguyen, V. & McGill, R. A., “Chemical imaging using infrared photothermal microspectroscopy.” In Proceedings of SPIE Defense, Security, and Sensing (eds Druy, M. A. & Crocombe, R. A.) 837411 (SPIE, 2012); Li, Z., Kuno, M. & Hartland, G., “Super-resolution imaging with mid-IR photothermal microscopy on the single particle level,” In Proceedings of SPIE Physical Chemistry of Interfaces and Nano-materials XIV (eds Hayes, S. C. & Bittner, E. R.) 954912 (International Society for Optics and Photonics, 2015); Zhang, D. et al., “Depth-resolved mid-infrared photothermal imaging of living cells and organisms with submicrometer spatial resolution,” Sci. Adv. 2, e1600521 (2016); and Li, Z., Aleshire, K., Kuno, M. & Hartland, G. V., “Super-resolution far-field infrared imaging by photothermal heterodyne imaging,” J. Phys. Chem. B 121, 8838-8846 (2017), which are hereby incorporated by reference in their entireties.
Stimulated Raman scattering (SRS) imaging has demonstrated label-free chemical mapping of biological cells and tissues at high spatial resolution and contrast. Examples of SRS imaging are described by Lu, F.-K. et al., “Label-free DNA imaging in vivo with stimulated Raman scattering microscopy,” Proc. Natl Acad. Sci. USA 112, 11624-11629 (2015); Cheng, J.-X. & Xie, X. S., “Vibrational spectroscopic imaging of living systems: an emerging platform for biology and medicine,” Science 350, aaa8870 (2015); and Ji, M. et al., “Detection of human brain tumor infiltration with quantitative stimulated Raman scattering microscopy,” Sci. Transl. Med. 7, 309ra163 (2015), which are hereby incorporated by reference in their entireties.
Far-field super resolution has been achieved using stimulated emission depletion. Examples of which are described by Gong, L. & Wang, H., “Breaking the diffraction limit by saturation in stimulated-Raman-scattering microscopy: a theoretical study,” Phys. Rev. A 90, 13818 (2014) and Ruchira Silva, W., Graefa, C. T. & Frontiera, R. R., “Toward label-free super-resolution microscopy,” ACS Photon. 3, 79-86 (2016), which are hereby incorporated by reference in their entireties.
Photoacoustic infrared (PAIR) detection is capable of spectroscopy and sensing of totally opaque or highly light-scattering materials. Examples of PAIR detection are described by Rockley, M. G., “Fourier-transformed infrared photoacoustic spectroscopy of polystyrene film,” Chem. Phys. Lett. 68, 455-456 (1979); Patel, C. K. N. & Tam, A. C., “Pulsed optoacoustic spectroscopy of condensed matter,” Rev. Mod. Phys. 53, 517-550 (1981); Tam, A. C., “Applications of photoacoustic sensing techniques,” Rev. Mod. Phys. 58, 381-431 (1986); and Michaelian, K. H., Photoacoustic Infrared Spectroscopy (Wiley, 2003), which are hereby incorporated by reference in their entireties. PAIR detection has also been demonstrated for imaging thick and scattering fresh biological samples without thin slicing, examples of which are described by Sim, J. Y., Ahn, C.-G., Jeong, E.-J. & Kim, B. K., “In vivo microscopic photoacoustic spectroscopy for non-invasive glucose monitoring invulnerable to skin secretion products,” Sci. Rep. 8, 1059 (2018), which is hereby incorporated by reference in its entirety. However, PAIR detection does not address the drawbacks on spatial resolution and water background.
Various aspects disclosed herein relate to systems and methods of ultraviolet-localized mid-infrared photoacoustic microscopy and/or spectroscopy (ULM-PAM). In some aspects, these ULM-PAM techniques can be used to achieve high-resolution and water-background—free mid-infrared (MIR) imaging of fresh biological samples. In at least some of the disclosed aspects, a pulsed mid-infrared laser thermally excites a sample at a focal spot, and a pulsed ultraviolet (UV) laser photoacoustically detects the resulting transient temperature rise, thereby enabling measurement of the intensity of the MIR absorption by the sample (e.g., enabling measurement of an absorption coefficient of the sample at the wavelength of the MIR laser). This detection and measurement scheme is based on the fact that a temperature rise in a sample enhances photoacoustic signals, a phenomenon called the Grüneisen relaxation effect. Examples of the Grüneisen relaxation effect are described by Wang, L., Zhang, C. & Wang, L. V., “Grueneisen relaxation photoacoustic microscopy,” Phys. Rev. Lett. 113, 174301 (2014), Lai, P., Wang, L., Tay, J. W. & Wang, L. V., “Photoacoustically guided wavefront shaping for enhanced optical focusing in scattering media,” Nat. Photon. 9, 126-132 (2015), and U.S. published patent application US2016/0305914, published on Oct. 20, 2016, which are hereby incorporated by reference in their entireties.
While the ULM-PAM imaging methods disclosed herein reveal MIR absorption contrast, the lateral resolution is not determined by the MIR wavelength but is determined by the UV wavelength, which is one order of magnitude or more shorter than the MIR wavelength. In addition, UV laser pulses in the range of 200-300 nm and especially 200- 230 nm are highly absorbed by most biomolecules, such as lipids, proteins, and nucleic acids. Examples of UV absorption in biomolecules and water are described by Kunitz, M., “Crystalline desoxyribonuclease; isolation and general properties; spectrophotometric method for the measurement of desoxyribonuclease activity,” J. Gen. Physiol. 33, 349-362 (1950); Beaven, G. H. & Holiday, E. R., “Ultraviolet absorption spectra of proteins and amino acids,” Adv. Protein Chem 7, 319-386 (1952); Yao, D.-K., Maslov, K. I., Wang, L. V., Chen, R. & Zhou, Q., “Optimal ultraviolet wavelength for in vivo photoacoustic imaging of cell nuclei,” J. Biomed. Opt. 17, 056004 (2012); and Quickenden, T. I. & Irvin, J. A., “The ultraviolet absorption spectrum of liquid water,” J. Chem. Phys. 72, 4416-4428 (1980), which are hereby incorporated by reference in their entireties. Water, however, is highly transmissive in the UV wavelength range, thus by using UV light to detect IR absorption, the strong water background of MIR absorption is suppressed in the disclosed ULM-PAM aspects. Therefore, ULM-PAM enables high-resolution and photoacoustic MIR imaging of fresh thick and scattering biological samples with little or no water background. By combining the UV and MIR spectral regimes, the ULM-PAM imaging methods described herein provide high-resolution and water-background—free photoacoustic MIR imaging of fresh biological samples.
Furthermore, ultraviolet light can penetrate up to 100 μm or more, which is generally greater than MIR penetration in fresh specimens, and the photoacoustic signal can propagate in biological tissues with negligible scattering. Examples of the penetration depth of ultraviolet light and mid-infrared light are described in Wong, T. T. W. et al., “Fast label-free multilayered histology-like imaging of human breast cancer by photoacoustic microscopy,” Sci. Adv. 3, e1602168 (2017) and Zhang, D. et al., “Depth-resolved mid-infrared photothermal imaging of living cells and organisms with submicrometer spatial resolution,” Sci. Adv. 2, e1600521 (2016), which are hereby incorporated by reference in their entireties.
The generation of photoacoustic signals by a sample depends on both the optical absorption coefficient (of the sample at the wavelength being observed) as well as the temperature of the sample prior to photo-stimulation (e.g., the pre-laser-pulse temperature). When an object absorbs a short laser pulse, thermal expansion causes it to emit a photoacoustic signal. The amplitude of the photoacoustic signal is proportional to the absorbed optical energy, with a coefficient called the Grüneisen parameter (I′), which depends on the expansion coefficient and the speed of sound, both of which are temperature-dependent and quasi-linearly proportional to the pre-pulse temperature. As a result, in the physiological temperature range (e.g., between approximately 10° C. and 50° C.), the Grüneisen parameter depends substantially linearly on the pre-pulse temperature (T). Near 20° C. and for water-rich soft biological tissues, the change in the Grüneisen parameter (e.g., ΔI′) can be determined using the equation ΔI′/I′≈0.04 ΔT (wherein Δ denotes a small change). Examples of temperature variations of the Grüneisen parameter are described in Danielli, A. et al., “Label-free photoacoustic nanoscopy,” J. Biomed. Opt. 19, 086006 (2014) and Xu, S., Scherer, G. W., Mahadevan, T. S. & Garofalini, S. H., “Thermal expansion of confined water,” Langmuir 25, 5076-5083 (2009), which are hereby incorporated by reference in their entireties. Therefore, a pre-pulse temperature rise of 1° C. can enhance the photoacoustic signal by ˜4%. This Grüneisen-based change in photoacoustic signal effect is relatively large effect and is highly advantageous as it permits infrared analysis of biological and other materials with minimal increases in the temperature in the specimen. This is a significant advantage compared photothermal techniques in which the relative signal change is of order 10−4/° C. To achieve a 4% change in a conventional photothermal measurement would require sufficient absorption of infrared radiation to raise the temperature of the specimen by 400° C. which would cause damage to most specimens under study. By comparison, the 1° C. change need to achieve a 4% change photoacoustic signal is readily tolerated by most samples.
This relationship has been used to photo-acoustically measure temperature in tissues as described by Larina, I. V. Latin, K. V. & Esenaliev, R. O., “Real-time optoacoustic monitoring of temperature in tissues,” J. Phys. D 38, 2633-2639 (2005); Shah, J. et al., “Photoacoustic imaging and temperature measurement for photothermal cancer therapy,” J. Biomed. Opt. 13, 034024 (2008); and Yao, J., Ke, H., Tai, S., Zhou, Y. & Wang, L. V., “Absolute photoacoustic thermometry in deep tissue,” Opt. Lett. 38, 5228-5231 (2013), which are hereby incorporated by reference in their entireties. When a pulsed laser induces a local transient temperature rise in a sample, the local Grüneisen parameter of the sample increases within the thermal confinement time (that is, the time before the local heat diffuses away), which is termed the Grüneisen relaxation effect. Examples of the Grüneisen relaxation effect are described in Wang, L., Zhang, C. & Wang, L. V., “Grueneisen relaxation photoacoustic microscopy,” Phys. Rev. Lett. 113, 174301 (2014) and Lai, P., Wang, L., Tay, J. W. & Wang, L. V., “Photoacoustically guided wavefront shaping for enhanced optical focusing in scattering media,” Nat. Photon. 9, 126-132 (2015).
ULM-PAM imaging and spectroscopic analysis may be realized as a two-step measuring scheme, as illustrated in
As shown in the top-down view of
In
At another point in time, such as time t2, a MIR heating pulse 120 is generated by a second radiation source and focused on the sample. Shortly thereafter at time t3, a UV probing pulse 130 is generated by the first radiation source and focused on the sample, which in turn emits a second photoacoustic signal 132 (PAUV2). The MIR heating pulse 120 induces a local temperature rise in the sample and the UV probing pulse 130 illuminates the sample before the local temperature rise has had a chance to dissipate. In one embodiment, the time interval (Δt) between the MIR heating pulse 120 and the UV probing pulse 130 is chosen to be a very short delay time after the MIR heating pulse, for example a sub-microsecond time delay that may be on the scale of picoseconds to hundreds of nanoseconds. The advantage of this approach are twofold: (1) the second UV pulse can be timed to be close in time to the maximum temperature rise of the sample; and (2) the delay can be chosen to be shorter than the thermal confinement time (or thermal diffusion time) of the sample. The latter ensures that the technique can achieve high spatial resolution as it ensures that the IR absorption profile of the sample is measured before the heat has substantially spread and diffused.
The local temperature rise (ΔT) induced by the MIR laser pulse is approximately proportional to the MIR absorption coefficient. Because the local temperature rise increases the local Grüneisen parameter, the second photoacoustic signal 132 (PAUV2) is stronger than the first photoacoustic signal 112 (PAUV1). In particular, the second photoacoustic signal 132 (PAUV2) has a larger amplitude 134 than the amplitude 114 of the first photoacoustic signal 112 (PAUV1). Note that amplitudes 114 and 134 can be measured in any number of ways, for example the peak to peak amplitude (as illustrated), the half amplitude, the curve may be rectified and the total integrated area measured, or an appropriate transform may be applied (e.g. Fourier transform or wavelet transform) and the amplitude of one of more of the transform components could be used. It is also possible to employ a lock-in amplifier and use a lock-in amplitude at the pulse repetition rate or any harmonic thereof. Any similar analysis that produces a signal indicative of the strength of the photoacoustic response may be suitable.
The fractional change in photoacoustic amplitude, % ΔPA (defined as ΔPA/PAUV1, where ΔPA=PAUV2−PAUV1), is proportional to ΔT, which is proportional to the absorption coefficient at the MIR wavelength (of the MIR heating pulse 120). However, the ultraviolet wavelength may be a magnitude shorter than the MIR wavelength and the spatial resolution is mainly determined by the focal diameter of the ultraviolet laser beam (See e.g., the UV focal spot 14 of
While
In some aspects, a single MIR heating pulse may be followed, within the thermal relaxation time, by multiple UV probing pulses. The multiple UV probing pulses may, in some aspects, be focused on the same UV focal spot (to obtain multiple measurements for averaging purposes, as an example). In other aspects, such as in the example shown in
In certain implementations, the UV source 410 can be a diode laser, a diode pumped solid state laser, an optical parametric oscillator, a nanosecond, picosecond, and/or femtosecond laser. The UV source 410 can be a fixed wavelength source, a tunable wavelength source, and/or a radiation source that emits a range of wavelengths simultaneously. The UV source 410 will have a shorter wavelength than the mid-infrared light source 412, such that the UV source 410 can be focused to a smaller spot size, thus illuminating a smaller sub-region of the region that the infrared radiation illuminates. The smaller focused spot size of the UV source 410 of radiation can result in an improvement in spatial resolution in the measurement of infrared absorption of the sample.
The ULM-PAM system 400 also includes a second radiation source 412, for example mid-infrared light source (e.g., a pulsed laser or other suitable mid-infrared source). In one aspect, the mid-infrared light source 412 is a pulsed optical parametric oscillator (OPO) tunable between 2,500 and 12,000 nanometers with a pulse duration of approximately 10.0 ns. Alternately, the mid IR light source can be a quantum cascade laser for example tunable in the range of 750-1900 cm−1 (or narrower or wider depending on the application need) with pulse durations in the range of 50 nsec to 1000 nsec or more. The first radiation source can also be a combination of multiple mid-IR sources, for example an OPO in combination with a QCL.
By tuning the wavelength mid-infrared light source 412, the ULM-PAM system 400 can measure a signal indicative of the absorption coefficient of a sample at multiple mid-infrared wavelengths. Thus, the ULM-PAM system 400 can obtain spectroscopic measurements (e.g. an infrared absorption spectrum) and images indicative of variations in the absorption coefficient of the sample as a function of wavelength/wavenumber and/or as a function of position within the sample.
In certain implementations, the mid-infrared light source 412 can be a tunable narrow band laser source, such as a quantum cascade laser, interband cascade laser, an optical parametric oscillator, or any other source of infrared radiation that can tuned over a plurality of wavelengths. MIR source 412 could also be a broadband laser source that simultaneously emits a range of wavelengths, for example a super-continuum source, a femtosecond laser, a frequency comb, or a thermal source (e.g. a “globar”). In these implementations, the first radiation source 412 may be a pulsed laser source that emits pulses, for example, with pulse durations in the microsecond, nanosecond or picosecond range. It may also be a continuous wave (CW) laser source that is chopped, modulated and/or gated.
In
In particular, the delay generator 415 may ensure that each probing ultraviolet pulse follows a mid-infrared pulse by less than the thermal confinement time (thermal diffusion time) of the sample 10. In the case of hydrated biological samples, typical thermal confinement times may be between approximately 100 nanoseconds and 500 nanoseconds, but can be longer for thick samples and/or those with low thermal conductivity. As a result, the delay generator 415 may be configured to delay probing ultrasonic pulses to impinge upon sample 10 between 0-500 ns after a corresponding mid-infrared pulse. In some embodiments, the delay generator 415 may begin a delay period upon generation of a mid-infrared pulse by mid-infrared light source 412 and, at the end of the delay period, the delay generator 415 may trigger ultraviolet light source 410 to emit an ultraviolet probing pulse. In various aspects, the delay added by delay generator 415 can be adjusted (e.g., by a user, by processor(s) 482, etc.), which may assist in adjusting for different types of samples 10 (having different thermal relaxation times) or lasers with different performance characteristics.
In
The ULM-PAM system 400 also includes an ultrasonic transducer 440 (e.g., an ultrasonic receiver) coupled to or otherwise in acoustic communication with sample 10 to detect photoacoustic signals from the illuminated regions of the sample 10. The ultrasonic transducer 440 may be acoustically coupled to sample 10 by an acoustic medium 12. The acoustic medium may be an acoustic gel, water, or other suitable medium capable of conveying ultrasound pulses from sample 10 to transducer 440. If desired, the acoustic medium 12 may be omitted. In some embodiments, the ultrasonic transducer 440 is a single element transducer. In other embodiments, the ultrasonic transducer 440 may be an array of transducers and, if desired, may be a steerable phased array with receive focusing capabilities. In some aspects, the ultrasonic transducer 440 may be an array of transducers that enable the collection of multiple photoacoustic signals in parallel, to enable faster imaging and spectroscopic analysis across an area of the sample 10.
The ULM-PAM system 400 may also include a scanning mechanism 430 coupled to one or more elements of the optical system 420. Optionally (denoted by a dotted line) the scanning mechanism 430 is coupled to the sample 10, in addition to or in the alternative to, the one or more elements of the optical system 420. The scanning mechanism 430 is coupled to one or more components of the ULM-PAM system 400 to be able to move the focal spots of the illumination beams (e.g., the MIR focal spot 13 and the UV focal spot 14 of
In
Returning to
In some implementations, the ULM-PAM system includes one or more communication interfaces (e.g., a universal serial bus (USB) interface). Communication interfaces can be used, for example, to connect various peripherals and input/output (I/O) devices such as a wired keyboard or mouse or to connect a dongle for use in wirelessly connecting various wireless-enabled peripherals. Such additional interfaces also can include serial interfaces such as, for example, an interface to connect to a ribbon cable. It should also be appreciated that the various system components can be electrically coupled to communicate with various components over one or more of a variety of suitable interfaces and cables such as, for example, USB interfaces and cables, ribbon cables, Ethernet cables, among other suitable interfaces and cables.
In
It would be understood that electrical communication between components of the various ULM-PAM systems described herein can be in wired or wireless form or a combination thereof. For simplicity, the sample 10 is illustrated as a block, it would be understood that the sample 10 can be in a variety of shapes and may have one or more objects of interest. Various blocks can also be combined within a single functional unit, for example the data acquisition unit 460 may be integrated with the computing device 480, for example as a data acquisition card in an expansion slot in a personal computer. The computing device 480 may also comprise a distributed system, for example including separate processors (CPU, digital signal processors, field programmable gate arrays, embedded controllers, single board computers, etc. that may be housed together and/or in separate enclosures.
During a data acquisition phase of an imaging process of the ULM-PAM system 400 according to one implementation, the processor(s) 482 executes instructions that send control signals to the ultraviolet laser 410 to deliver pulses of UV radiation to the sample 10, control signals to the mid-infrared light source 412 to deliver pulses of MIR radiation to the sample 10, control signals to the scanning mechanism 430 to scan the UV and MIR focal spots across (and/or through) the sample 10, control signals to the digitizer 462 to record photoacoustic signals received from the ultrasonic transducer device 440. The digitizer 462 records photoacoustic signals induced by the UV radiation pulses for each of the locations of the UV focal spots in sub-regions of the field-of-view of the sample 10 being imaged. During an image construction phase, the processor(s) 482 executes instructions to perform operations to construct a photoacoustic image, a spectroscopic image, or other information from the data in the photoacoustic signals.
The first radiation source 509 is capable of producing shorter wavelengths than the second (IR) radiation source. In one aspect the first radiation source 509 emits light in the ultraviolet range, but more broadly it can be of a broader range, for example within the wavelength range of 100-2000 nm (e.g. X-ray to near-IR).
One or both of the radiation sources 509 and 511 may be tunable to varying the wavelengths of the MIR or UV pulses. In such embodiments, computing device 580 may provide control signals to the radiation sources 509 and 511 to tune their wavelengths. Computing device 580 may be in one or more of the forms of computing device 480 as described associated with
In the example of
In the example of
The optical paths between sample 10 and the radiation sources 509 and 511 may be combined at a beam combiner 522, for example germanium dichroic mirror. Beam combiner 522 may be transmissive to IR and reflective to UV as in the configuration shown or the reverse (reflective to IR and transmissive to UV). The combined IR and UV beams are reflected by mirror 524 and then delivered to sample 10 through an objective 526. Objective 526 may for example be a reflective objective of a Schwarzschild (Cassegrain configuration). It may also be an off-axis parabolic mirror, and/or other mirror combination configured to focus the IR and UV pulses to focal spots on sample 10. Mirror arrangements can be optimal because they are generally wavelength independent, but it is possible to employ refractive approaches as well. It is also not necessary that the IR and UV beams be combined collinearly. It is possible to use two separate focusing elements to deliver the UV and IR beams separately, in which case the optics can be separately optimized for the respective wavelength ranges.
Pulses from both the UV and MIR lasers 509 and 511 are focused on the sample 10, which may be mounted on an IR transparent window (e.g. CaF2, ZnSe, ZnS, BaF2 or various other materials) attached to the bottom of a sample holder 510. Sample holder 510 optionally also serves as a reservoir (e.g., tank or liquid cell) to hold acoustic coupling fluid, for example water, buffer solution, acoustic gel or any other suitable coupling fluid. Configured in transmission mode, an ultrasonic transducer 540, which in one aspect has a 25 MHz center frequency, is configured to collect the photoacoustic signals generated by the UV and MIR lasers 509 and 511. Ultrasonic transducer 540 may optionally include a focusing element in which case it may be confocally aligned with the MIR and UV spots, i.e. the foci of the ultrasonic transducer 540 and the objective 526 are substantially aligned. Signals collected by transducer 540 may be optionally amplified by pre-amplifier 550 and then digitized by data acquisition system 560. Data acquisition system 560 may also include channels for collecting and digitizing signals from photodiodes 570 and 572 and may include trigger inputs and/or outputs to synchronize data acquisition with the radiation pulses from radiation sources 509 and/or 511.
In the example of
In some implementations, computer 580 may direct the components of system 500 to photoacoustically scan sample 10 along a x-axis line, translate the sample (or optics), and then scan sample 10 along a new x-axis line, repeating that process to form a two-dimensional (2D) image. If desired, the photoacoustic scanning may be repeated across a number of z-axis positions, to form a three-dimensional (3D) image. If desired, a 2D image may be formed that extends in the z-axis direction and one of the x-axis or y-axis directions.
In some embodiments, ULM-PAM imaging systems may be configured to operate in a transmission mode. An example of components of a ULM-PAM system 600 in a transmission mode configuration is shown in
In some other embodiments, ULM-PAM imaging systems may be configured to operate in a reflection mode. Examples of reflection mode configurations are shown in
At operation 910, the ULM-PAM system focuses one or more first ultraviolet pulses to one or more regions of a sample respectively. In one aspect, the ULM-PAM system focuses one first ultraviolet pulse to a region of the sample to induce a baseline photoacoustic signal (PAUV1) at operation 910. The ultrasonic transducer collects a baseline photoacoustic signal at a single position within the sample (e.g., a single UV focal spot). In another aspect, operation 910 involves delivering one or more first ultraviolet pulses to multiple regions respectively of the sample. In this aspect, the ultrasonic transducer detects one or more baseline photoacoustic signals (PAUV1) from different locations within the sample (e.g., a microlens array and ultrasound array as discussed in connection with
At operation 910, the ultraviolet light source generating the ultraviolet pulse(s) is either (i) triggered at a first time before the infrared light source is triggered at operation 912 to generate the infrared pulse(s) or (ii) triggered at a second delay time after the infrared light source is triggered in operation 912.
At operation 912, according to one aspect, the ULM-PAM system focuses a mid-infrared heating pulse to a focal spot at a region on the sample, resulting in localized heating of the sample at the focal spot of the MIR pulse in regions of the sample that absorb IR light at the selected wavelength of the MIR pulses. In another aspect, operation 912 involves delivering multiple MIR pulses to multiple regions of the sample simultaneously resulting in localized heating at the plurality of focal spots and/or simultaneously illuminating a large area of the sample with MIR light, e.g. though a large focused IR spot size. The amount of heating in the sample will vary depending on the absorption coefficient of the sample at the MIR wavelength (which is tunable). Thus it is possible to probe the samples IR absorption properties by measuring the relative amount of local sample heating due to IR absorption. The amount of heating is also dependent on the strength of the MIR pulse. In one embodiment, the strength of the MIR pulse used to heat the sample may be measured using photodiode 472 (or other device), to enable compensation for variations strength between different MIR pulses and variation in MIR pulse energy as a function of the MIR wavelength.
At operation 914, the ULM-PAM system focuses one or more second ultraviolet pulses on the sample. In one aspect, the ULM-PAM system focuses an ultraviolet pulse to a sub-region within the region heated by the infrared heating pulse in operation 912. The ultraviolet pulse induces a probing photoacoustic signal (PAUV2). The probing photoacoustic signal is from the sub-region of the sample heated in operation 912. In another aspect, the ULM-PAM system focuses multiple ultraviolet pulses to multiple sub-regions within the region heated by the infrared heating pulse in operation 912 and the ultraviolet pulses induce a plurality of probing photoacoustic signals (PAUV2) from the sub-regions. In yet another aspect, the ULM-PAM system focuses a plurality of first ultraviolet pulses to a plurality of sub-regions, each sub-region in a region heated by an infrared heating pulse in operation 912 and the second ultraviolet pulses induce a plurality of probing photoacoustic signals (PAUV2) from sub-regions in the plurality of regions.
The ULM-PAM system triggers an ultraviolet light source to generate the one or more second ultraviolet pulses in operation 914 within a predetermined period from the triggering of the infrared light source in operation 912. In most cases, the predetermined period is the thermal relaxation time (also referred to as thermal confinement time) of the sample (e.g., the duration before the heated region has substantially cooled or reached thermal equilibrium with the rest of the sample). In the case of hydrated biological samples, typical thermal confinement times may be between approximately 100 nanoseconds and 500 nanoseconds. Thus, when the sample is a hydrated biological sample, operation 914 may be performed within 100 nanoseconds, within 200 nanoseconds, within 250 nanoseconds, within 300 nanoseconds, within 400 nanoseconds, or within 500 nanoseconds of the triggering of the ultraviolet light source in operation 912.
Operation 914 also involves detecting a photoacoustic signal from a single position within the sample (e.g., a single UV focal spot) or collecting photoacoustic signals from a plurality of positions within the sample (e.g., a microlens array and ultrasound array as discussed in connection with
At operation 916, the ULM-PAM system determines if the desired field-of-view (of the sample) has been fully scanned. If the field-of-view is not fully scanned, the ULM-PAM system performs operation 917 by moving components of the system to move the focal spots of the light sources to a new region or new regions of the field-of-view. For example, operation 916 may involve processors(s) that send control commands to a scanning mechanism (e.g., scanning mechanism 430) to shift the UV and/or MIR focal spots to another region(s) of the field-of-view. Afterwards, the ULM-PAM method repeats operations 910, 912, and 914.
If the field-of-view is fully scanned, the ULM-PAM method performs operation 919 if spectroscopic measurements or images are desired. At operation 919, the ULM-PAM system tunes or adjusts the frequency (i.e. wavelength) of the infrared light source. As an example, operation 919 may involve processor(s) sending control commands to a tunable mid-infrared light source to re-tune to a new infrared frequency. Afterwards, the ULM-PAM system repeats operations 910, 912, and 914. With arrangements of this type, the ULM-PAM system can measure a signal indicative of the IR absorption coefficient at a plurality of infrared wavelengths to obtain spectroscopic information about the sample, e.g. an infrared absorption spectrum. Operation 919 may be performed repeatedly in combination with operations 910, 912, 914, and 916 as indicated by the arrows in which case a hyperspectral data cube will be created, i.e. a signal indicative of IR absorption is created at a multidimensional array of sample positions and IR wavelengths. It is also possible to perform these measurements at any subset of spatial or spectral dimensions. For example it is possible to obtain IR absorption measurements at a plurality of XY locations, but fixed MIR wavelength to produce a map of IR absorption for example at a single IR absorption band. It is also possible to remain at a single location on the sample and rapidly sweep the IR laser frequency (wavelength) to obtain an IR absorption spectrum at a single location. It is also possible to create IR absorption spectra at a pre-programmed array of points on the sample (e.g. a line array) and/or at discrete locations selected by a user.
After or concurrently with collecting the baseline and probing photoacoustic signals, the ULM-PAM system may perform normalization operation 922. At operation 922, the ULM-PAM system normalizes the collected photoacoustic signals. As an example, the ULM-PAM system may analyze the collected photodiode measurements indicative of the pulse energies of the IR and or UV pulses and scale the measured response by the strength of the IR/UV pulses. This may be performed in real-time, e.g., by simultaneously measuring the IR and/or UV pulse energy during the measurement of the ultrasonic responses, and/or it may be performed before or after. For example it is possible to separately measure the IR pulse energy as a function an IR frequency (wavelength) and use this as a normalization curve for the measured data. It is also possible to perform a reference measurement on a sample with either flat or known IR absorption properties and use the reference measurement to normalize the photoacoustic responses. This normalization step 922 can also follow rather than precede operation 924 below.
At operation 924, the ULM-PAM system analyzes the detected (and optionally normalized) amplitudes of the photoacoustic signals and identifies fractional changes resulting from the MIR pulse heating. As an example, the system may determine the change in amplitudes of the photoacoustic signals for each sub-region location (e.g., pixel) scanned within the sample and optionally for each MIR wavelength in the target spectrum, calculated as:
ΔPA=PAUV2−PAUV1 (Eqn. 1)
wherein PAUV1 is a baseline photoacoustic signal obtained before or after MIR heating and PAUV2 is a probing photoacoustic signal obtained synchronous with or following MIR heating but preferably within the thermal relaxation time of the sample (i.e. before the IR induced temperature increase has dissipated and/or the spatial resolution has been adversely affected due to spreading of heat).
As previously noted, the generation of photoacoustic signals by a sample depends on both the optical absorption coefficient (of the sample at the wavelength being observed, e.g., at the UV wavelength) as well as the temperature of the sample prior to photo-stimulation (e.g., the pre-laser-pulse temperature). Since each pair of baseline and probing photoacoustic pulses are collected using UV pulses at the same wavelength focused on the same portion of the sample, any differences in PAUV1 and PAUV2 results from the localized heating from the MIR pulse. The ULM-PAM system is able to use the differences in photoacoustic signals (each pair being associated with a particular focal position at sub-region and a particular MIR wavelength) to measure the amount of heating resulting from the MIR pulse. The temperature change resulting from each MIR pulse depends upon the strength of the MIR pulse as well as the absorption coefficient of the sample at the scan location. Thus, by measuring the amount of heating resulting from the MIR pulse, the ULM-PAM system is able to measure the absorption coefficient of the sample. Operation 924 may involve using feedback from photodiode 472 to compensate for variations in the strength of the MIR pulse such as by dividing every differential photoacoustic signal (ΔPA) by a signal representative of the strength of the MIR and/or UV pulses. In the description above the differencing operation 924 was described as operating between alternating pulse pairs. Note that it is also possible to obtain a plurality of baseline pulses (step 910) then a plurality of IR and second UV pulses (steps 912 and 914) and then perform the difference calculation (step 924) on the plurality of baseline and 2nd UV pulses.
At operation 926, the ULM-PAM system may construct an output from the differential photoacoustic signal(s) (ΔPA). As examples, the ULM-PAM system may construct a spectroscopic measurement (e.g., an absorption coefficient for a particular MIR wavelength at a single position in the sample) or a graph or image (e.g., a 1-D line graph, 2-D image, a 3-D image, or a 4-D image showing absorption coefficients of the sample as a function of at least one of MIR wavelength, x-position, y-position, and z-position within the sample).
To demonstrate the capabilities of ULM-PAM systems, a ULM-PAM system was used to obtain ULM-PAM measurements and imagery of various test samples. Various alternative systems were used to obtain alternative measurements of the test samples for the sake of comparison with the ULM-PAM results. As examples, a pure mid-infrared photoacoustic microscopy (MIR-PAM) system and an attenuated total reflection-Fourier transform infrared microscopy (ATR-FTIR) system were used to obtain comparison measurements.
The resolution of the ULM-PAM system was further demonstrated by imaging a carbon-nanotube (CNT) pattern deposited on an MgF2 substrate, which was developed as a broad-spectral resolution target for photoacoustic imaging.
As further demonstration investigating subcellular imaging, a ULM-PAM system was used to image the lipid and protein composition in freshly fixed 3T3 mouse fibroblast cells. The ULM-PAM UV wavelength was tuned to 224 nm, where almost all proteins, lipids, and nucleic acids have strong absorption. For lipid imaging, the MIR wavelength was set to the absorption peak at 3,420 nm (2924 cm−1), corresponding to the asymmetric stretching mode of the CH2 group—the dominant constituent of lipids. The ULM-PAM image of lipids in
In contrast, the MIR-PAM images of lipids (
Four line-profiles taken from
The ULM-PAM system was also used to image cells at different stages of their lifecycle.
Another major application of ULM-PAM systems is the label-free photoacoustic histology of thick tissue slices. Since the study of nerve fibers is important in brain science, and myelin is one of the main chemical components of nerves, a ULM-PAM system was used to study the structural distribution of myelin in the mouse brain ex vivo. A microtome sliced a coronal cerebrum section and a horizontal cerebellum section, both 300 μm thick, from a freshly fixed mouse brain. In the beginning, myelin images of these two sections (
To overcome the MIR-PAM limitations, a ULM-PAM system, configured with a UV wavelength of 224 nm and an MIR wavelength of 3,420 nm, was used to achieve higher-resolution and water-background—free MIR imaging of myelin. A MIR-PAM system was used to scan a small area of interest and the results are illustrated in the image of
The ULM-PAM image of myelin (
A similar set of images were obtained on another region of interest, this time within the cerebellum section of the brain (e.g., region 1202 in
Details of the systems used in obtaining the ULM-PAM, MIR-PAM, ATR-FTIR, and other sample images (of
The ULM-PAM system utilized an OPO mid-MIR laser (a NT242-SH, made by EKSPLA) and an OPO UV laser (a NT270, made by EKSPLA). The wavelength of the selected OPO mid-MIR laser was tunable from 2.5 to 12 μm (from 4,000 to 833 cm−1), with a pulse duration of about 10 ns, and an output pulse energy that varied from 10 to 100 μJ depending on the selected wavelength. For imaging lipids and proteins using ULM-PAM, the UV laser was tuned to 224 nm; for imaging nucleic acids using UV-PAM, it was set to 250 nm. Both the MIR and UV beams, with diameters of about 4 mm, were reflected by several UV-enhanced aluminum coated mirrors (PF10-03-F01, made by Thorlabs), and focused to a sample mounted on a CaF2 window through a 36× reflective objective (a 50102-02, made by Newport). Photoacoustic signals were detected in transmission mode by a focused ultrasonic transducer having a 25 MHz center frequency (a V324-SM, made by Olympus), which has an acoustic focal length of 12.7 mm and an element diameter of 6 mm. The acoustic coupling medium was de-ionized water. Photoacoustic signals were amplified by ˜50 dB using two low-noise amplifiers (a ZFL-500LN+, made by Mini-circuits), and then acquired by a DAQ card (a Razor 14, made by Gage) at 14 bits and 200 MS/s.
ULM-PAM images of the sample at selected wavelengths were obtained by raster scanning using two motorized stages (a PLS-85, made by PI miCos) coupled to the sample holder. To drive the scanning stages at high precision (e.g., a 50 nm step size) with minimal low-frequency vibration, two five-phase stepper motors (PKP546MN18B, made by Oriental Motor) and the associated drivers (CVD518-K, made by Oriental Motor) were used. Line scans along the x-axis were averaged to compensate for UV laser inter-pulse fluctuations. The laser tuning, data acquisition, and scanning systems were synchronized by a central computer via micro-controllers, using LabVIEW.
Note that all of the above system configuration information is provided as an illustrative example only. The ULM-PAM system can also be operated with many other alternative components, for example alternative MIR and UV laser sources described elsewhere herein, alternative data acquisition and computation arrangements, alternative scanning mechanisms, etc.
The scan step size varied for different samples. The point spread function of a 50-nm—diameter carbon nanobead was measured using a 50 nm step size. Imaging cells was done with a 200 nm step size. For imaging brain slices, to compensate for the slow laser repetition rates of the lasers, the UV beam was shrunk to reduce the effective NA to 0.16, which worsened the resolution to some extent, but accelerated the scanning with a larger step size (500 nm) and effectively extended the focal depth to accommodate uneven sample surfaces.
All ATR-FTIR spectra were measured on an ATR-FTIR spectrometer (a Nicolet 6700, made by Thermo) in the Molecular Materials Research Center at California Institute of Technology. The baseline was calibrated by measuring a blank sample.
Mouse embryonic fibroblast cells (NIH/3T3) were obtained from American Type Culture Collection (ATCC, Manassas, Va.) and maintained at 37° C. and 5% CO2 in Dulbecco's modified Eagle's medium (Invitrogen brand) supplemented with 10% fetal bovine serum (Invitrogen) and 1% penicillin-streptomycin (P/S, Invitrogen). The cells were seeded onto 1-mm—thick CaF2 substrates, grown for about two days, and then fixed in 3.7% formalin solution and washed with phosphate buffered saline.
The brain was extracted from Swiss Webster mice (Hsd: ND4, Harlan Laboratories), and fixed in 3.7% formalin solution at room temperature. Afterwards, the fixed brain was embedded in 4% agarose and then sectioned by a microtome (VT1200 S, Leica) into slices 300 μm thick. All experimental animal procedures were carried out in conformity with a laboratory animal protocol approved by the Animal Studies Committee of California Institute of Technology. After they are imaged by ULM-PAM, the thick slices underwent standard procedures for histological staining (including paraffinization, slicing into 10 μm in thickness, and staining), and were finally imaged in a digital pathology system (VENTANA iScan HT, Roche). It should be noted that some samples were fragmented and slightly distorted during the thin-slicing procedure, which however did not affect the comparison.
ULM-PAM provides a new high-resolution and water-background—free MIR microscopy modality capable of imaging fresh biological samples without staining. For cells, ULM-PAM provides sub-cellular MIR imaging of lipids and proteins with high contrast without a strong obscuring water background. For tissue slices, ULM-PAM produces label-free PA-histologic images without requiring thinly slicing and drying samples, unlike conventional MIR imaging. The ULM-PAM system can cover the full MIR spectral range, allowing exploration of a variety of molecules of interest. Among the existing far-field MIR imaging approaches, ULM-PAM is believed to have achieved the highest imaging resolution at 250 nm, which can be further improved by using a higher-NA objective lens and a shorter UV wavelength (as examples). In addition, ULM-PAM can potentially bridge the resolution gap from 100 nm to 400 nm in materials science studies between AFM-MIR and other MIR modalities, such as ATR-FTIR and photothermal MIR.
The ULM-PAM can be further improved in some aspects. As an example, although the signal-to-noise ratios of raw photoacoustic signals are high, their fractional changes can be noisy because they are derived from two successive but non-identical UV laser pulses. Thus, selection of stable UV and MIR lasers, with low pulse-to-pulse variations, is beneficial to a ULM-PAM system. Alternately, however, the ULM-PAM design disclosed herein can be modified such that a single UV pulse is replicated into first and second parts, the first part serving as a baseline UV pulse, and the second part passing through a long optical fiber delay line to delay the second part to just after a MIR pulse such that the second part serves as a probing UV pulse (thus reducing or avoiding inter-pulse fluctuations). As another example, the imaging speed can be limited when the selected UV and MIR lasers have low pulse repetition rates. For example, if the lasers both have a pulse repetition rate that maxes out at 1 kHz, it could take over two hours to scan a 1 mm by 1 mm area with a 500 nm step size. Thus it can be desirable to use IR and UV sources with higher repetition rates. For example commercially available OPO and QCL IR sources can have repetition rates as high as 1 MHz or higher, up to 100× faster than the Ekspla OPOs described above. Frequency quadrupled Nd-YAG lasers can also operate at rates of 100 kHz or higher. Femtosecond broadband sources can operate with pulse repletion rates as high as tens of MHz and can produce MIR or UV pulses or in some cases both. As another example, multiple scans may be need to be collected and averaged together, to compensate for inter-pulse fluctuations and other noise sources, further slowing imaging speed. However, multi-focal photoacoustic imaging using a linear array of ultrasonic transducers can improve the imaging speed significantly, even more than 100 times faster. Additional aspects of multi-focal embodiments are described and disclosed in connection with
Two conventional vibrational imaging microscopies provide far-field and label-free imaging at sub-cellular resolution: Raman scattering microscopy and photothermal MIR microscopy. Examples of Raman scattering microscopy are described by Evans, C. L. & Xie, X. S., “Coherent anti-Stokes Raman scattering microscopy: chemical imaging for biology and medicine,” Annu. Rev. Anal. Chem. 1, 883-909 (2008) and Zhang, C., Zhang, D. & Cheng, J.-X., “Coherent Raman scattering microscopy in biology and medicine,” Annu. Rev. Biomed. Eng. 17, 415-445 (2015), which are hereby incorporated by reference in their entireties. Examples of photothermal MIR microscopy are described by Furstenberg, R., Kendziora, C. A., Papantonakis, M. R., Nguyen, V. & McGill, “R. A. Chemical imaging using infrared photothermal microspectroscopy,” In Proceedings of SPIE Defense, Security, and Sensing (eds Druy, M. A. & Crocombe, R. A.) 837411 (SPIE, 2012) and Zhang, D. et al., “Depth-resolved mid-infrared photothermal imaging of living cells and organisms with submicrometer spatial resolution,” Sci. Adv. 2, e1600521 (2016), which are hereby incorporated by reference in their entireties.
Compared with Raman scattering microscopy, the detection sensitivity of the ULM-PAM system, determined by direct MIR photon absorption, is much higher, since the fundamental MIR cross-section is several orders of magnitude larger than that of the Raman scattering cross-section. In addition, this method not only exhibits the same features as Raman scattering microscopy, such as high resolution and low water background, but also enables the direct imaging of various vibrational bonds in the mid-MIR spectral range. Compared with photothermal MIR microscopy, this method is essentially a new way to exploit the MIR photothermal effect, but photoacoustic detection is used instead to retrieve the MIR-absorption induced local temperature rise, enabling MIR imaging in thick, highly optically absorbing and scattering biological samples. Perhaps more importantly, photoacoustic temperature sensing is based on the Grüneisen relaxation effect, which gives a photoacoustic signal change of about 3%/° C. in the physiological temperature range. This change is two orders of magnitude greater than the photothermally induced refractive index change (˜10−4/° C.), making ULM-PAM more sensitive than photothermal MIR microscopy. Furthermore, since water is almost transparent at UV wavelengths from 200 nm to 300 nm (see
If desired, the ULM-PAM system can be modified to attain nanoscale far-field chemical imaging by shortening the wavelength of the probe beam (e.g., laser 410) to the X-ray wavelength regime. Current X-ray microscopy for biological samples operates either in the soft X-ray regime for water transparency (2.33-4.40 nm) or the hard X-ray regime, using imaging contrast arising from natural X-ray absorption, to provide nanometer scale resolution. Imaging specific chemicals or structures inside biological samples requires exogenous labeling, e.g., silver-enhanced immunogold labeling. X-ray acoustic imaging has also been demonstrated with a pulsed X-ray source as described, for example, by Lasch, P., Boese, M., Pacifico, A. & Diem, M., “FT-IR spectroscopic investigations of single cells on the subcellular level,” Vibr. Spectrosc. 28, 147-157 (2002), which is hereby incorporated by reference in its entirety. By combining the MIR-absorption induced Grüneisen relaxation effect and X-ray-acoustic imaging, the ULM-PAM system can achieve X-ray-acoustic imaging with MIR-absorption contrast, utilizing acoustic signals generated by pulsed X-rays to report MIR absorption contrast in materials, thereby achieving far- field and label-free imaging at nanometer scale resolution.
In some embodiments, the ULM-PAM system 400 can scan and collect photoacoustic measurements from multiple locations within a sample 10 simultaneously, e.g., in order to speed up imaging and spectroscopic operations. As an example, the ULM-PAM system 400 can include one or more optical components that spread the pulses from ultraviolet light source 410 and mid-infrared light source 412 into sheet-like beams and a microlens array, where each microlens focuses a portion of the laser light onto a corresponding portion of the (such as along a scan axis, which is aligned with the x-axis in the example of
Although some examples of ULM-PAM systems and methods describe a two-step measuring scheme with a first step of initiating (e.g., triggering by a pulser) delivery of a first ultraviolet laser pulse to a sub-region within a region to generate a first (baseline) photoacoustic signal and a second step of initiating delivery of a UV probing pulse to the region, followed by initiating delivery of a second ultraviolet laser pulse to the sub-region to generate a second photoacoustic signal, it would be understood that the order of these steps can be reversed according to another aspect. For example, according to one aspect, the technique initiates delivery of the first ultraviolet laser pulse to a sub-region within a region to generate a first (baseline) photoacoustic signal where the initiation (e.g., triggering) occurs after (e.g., a predetermined time period after the initiation of the delivery of the first ultraviolet laser pulse) the step of initiating delivery of a UV probing pulse to the region, followed by initiating delivery of a second ultraviolet laser pulse to the sub-region.
Modifications, additions, or omissions may be made to any of the above-described embodiments without departing from the scope of the disclosure. Any of the embodiments described above may include more, fewer, or other features without departing from the scope of the disclosure. Additionally, the steps of the described features may be performed in any suitable order without departing from the scope of the disclosure.
It should be understood that the present invention as described above can be implemented in the form of control logic using computer software in a modular or integrated manner. Based on the disclosure and teachings provided herein, a person of ordinary skill in the art will know and appreciate other ways and/or methods to implement the present invention using hardware and a combination of hardware and software.
Any of the software components or functions described in this application, may be implemented as software code using any suitable computer language and/or computational software such as, for example, Java, C, C#, C++ or Python, LabVIEW, Mathematica, or other suitable language/computational software, including low level code, including code written for field programmable gate arrays, for example in VHDL. The code may include software libraries for functions like data acquisition and control, motion control, image acquisition and display, etc. Some or all of the code may also run on a personal computer, single board computer, embedded controller, microcontroller, digital signal processor, field programmable gate array and/or any combination thereof or any similar computation device and/or logic device(s). The software code may be stored as a series of instructions, or commands on a CRM such as a random access memory (RAM), a read only memory (ROM), a magnetic medium such as a hard-drive or a floppy disk, or an optical medium such as a CD-ROM, or solid stage storage such as a solid state hard drive or removable flash memory device or any suitable storage device. Any such CRM may reside on or within a single computational apparatus, and may be present on or within different computational apparatuses within a system or network.
Although the foregoing disclosed embodiments have been described in some detail to facilitate understanding, the described embodiments are to be considered illustrative and not limiting. It will be apparent to one of ordinary skill in the art that certain changes and modifications can be practiced within the scope of the appended claims.
One or more features from any embodiment may be combined with one or more features of any other embodiment without departing from the scope of the disclosure. Further, modifications, additions, or omissions may be made to any embodiment without departing from the scope of the disclosure. The components of any embodiment may be integrated or separated according to particular needs without departing from the scope of the disclosure.
This application claims priority to and benefit of U.S. Provisional Patent Application No. 62/726,860, titled “High-Resolution, High-Contrast Mid-Infrared Imaging Of Fresh Biological Samples With Ultraviolet-Localized Photoacoustic Microscopy” and filed on Sep. 4, 2018, which is hereby incorporated by reference in its entirety and for all purposes.
This invention was made with government support under Grant No(s) CA186567, EB016986, NS090579 and NS099717 awarded by the National Institutes of Health. The government has certain rights in the invention.
Number | Name | Date | Kind |
---|---|---|---|
4029756 | Gaafar | Jun 1977 | A |
4127318 | Determann et al. | Nov 1978 | A |
4255971 | Rosencwaig | Mar 1981 | A |
4267732 | Quate | May 1981 | A |
4284324 | Huignard et al. | Aug 1981 | A |
4375818 | Suwaki et al. | Mar 1983 | A |
4385634 | Bowen | May 1983 | A |
4430897 | Quate | Feb 1984 | A |
4430987 | Heller | Feb 1984 | A |
4462255 | Guess et al. | Jul 1984 | A |
4468136 | Murphy et al. | Aug 1984 | A |
4489727 | Matsuo et al. | Dec 1984 | A |
4546771 | Eggleton et al. | Oct 1985 | A |
4596254 | Adrian et al. | Jun 1986 | A |
4687304 | Piller et al. | Aug 1987 | A |
4740081 | Martens et al. | Apr 1988 | A |
4802461 | Cho | Feb 1989 | A |
4802487 | Martin et al. | Feb 1989 | A |
4809703 | Ishikawa et al. | Mar 1989 | A |
4850363 | Yanagawa | Jul 1989 | A |
4860758 | Yanagawa et al. | Aug 1989 | A |
4869256 | Kanno et al. | Sep 1989 | A |
4872758 | Miyazaki et al. | Oct 1989 | A |
4921333 | Brody et al. | May 1990 | A |
4929951 | Small | May 1990 | A |
4995396 | Inaba et al. | Feb 1991 | A |
5070455 | Singer et al. | Dec 1991 | A |
5083549 | Cho et al. | Jan 1992 | A |
5107844 | Kami et al. | Apr 1992 | A |
5115814 | Griffith et al. | May 1992 | A |
5125410 | Misono et al. | Jun 1992 | A |
5140463 | Yoo et al. | Aug 1992 | A |
5170793 | Takano et al. | Dec 1992 | A |
5194723 | Cates et al. | Mar 1993 | A |
5207672 | Roth et al. | May 1993 | A |
5227912 | Ho et al. | Jul 1993 | A |
5305759 | Kaneko et al. | Apr 1994 | A |
5321501 | Swanson et al. | Jun 1994 | A |
5329817 | Garlick et al. | Jul 1994 | A |
5331466 | Van Saarloos | Jul 1994 | A |
5345938 | Nishiki et al. | Sep 1994 | A |
5373845 | Gardineer et al. | Dec 1994 | A |
5414623 | Lu et al. | May 1995 | A |
5445155 | Sieben | Aug 1995 | A |
5465722 | Fort et al. | Nov 1995 | A |
5546187 | Pepper et al. | Aug 1996 | A |
5546947 | Yagami et al. | Aug 1996 | A |
5546948 | Hamm et al. | Aug 1996 | A |
5606975 | Liang et al. | Mar 1997 | A |
5615675 | O'Donnell et al. | Apr 1997 | A |
5635784 | Seale | Jun 1997 | A |
5651366 | Liang et al. | Jul 1997 | A |
5713356 | Kruger | Feb 1998 | A |
5718231 | Dewhurst et al. | Feb 1998 | A |
5781294 | Nakato et al. | Jul 1998 | A |
5836872 | Kenet et al. | Nov 1998 | A |
5840023 | Oraevsky et al. | Nov 1998 | A |
5860934 | Sarvazyan | Jan 1999 | A |
5913234 | Julliard et al. | Jun 1999 | A |
5971998 | Russell et al. | Oct 1999 | A |
5977538 | Unger et al. | Nov 1999 | A |
5991697 | Nelson et al. | Nov 1999 | A |
6055097 | Lanni et al. | Apr 2000 | A |
6102857 | Kruger | Aug 2000 | A |
6104942 | Kruger | Aug 2000 | A |
6108576 | Alfano et al. | Aug 2000 | A |
6111645 | Tearney et al. | Aug 2000 | A |
6134003 | Tearney et al. | Oct 2000 | A |
6216025 | Kruger | Apr 2001 | B1 |
6233055 | Mandella et al. | May 2001 | B1 |
6282011 | Tearney et al. | Aug 2001 | B1 |
6292682 | Kruger | Sep 2001 | B1 |
6309352 | Oraevsky et al. | Oct 2001 | B1 |
6341036 | Tearney et al. | Jan 2002 | B1 |
6379325 | William et al. | Apr 2002 | B1 |
6405069 | Oraevsky et al. | Jun 2002 | B1 |
6413228 | Hung et al. | Jul 2002 | B1 |
6421164 | Tearney et al. | Jul 2002 | B2 |
6432067 | Martin et al. | Aug 2002 | B1 |
6466806 | Geva et al. | Oct 2002 | B1 |
6485413 | Boppart et al. | Nov 2002 | B1 |
6490470 | Kruger | Dec 2002 | B1 |
6498942 | Esenaliev et al. | Dec 2002 | B1 |
6498945 | Alfheim et al. | Dec 2002 | B1 |
6501551 | Tearney et al. | Dec 2002 | B1 |
6545264 | Stem | Apr 2003 | B1 |
6564087 | Pitris et al. | May 2003 | B1 |
6567688 | Wang | May 2003 | B1 |
6590830 | Garlick et al. | Jul 2003 | B1 |
6626834 | Dunnie et al. | Sep 2003 | B2 |
6628404 | Kelley et al. | Sep 2003 | B1 |
6633774 | Kruger | Oct 2003 | B2 |
6654630 | Zuluaga et al. | Nov 2003 | B2 |
6658279 | Swanson et al. | Dec 2003 | B2 |
6694173 | Bende et al. | Feb 2004 | B1 |
6701181 | Tang et al. | Mar 2004 | B2 |
6751490 | Esenaliev et al. | Jun 2004 | B2 |
6764450 | Yock | Jul 2004 | B2 |
6831781 | Tearney et al. | Dec 2004 | B2 |
6833540 | MacKenzie et al. | Dec 2004 | B2 |
6839496 | Mills et al. | Jan 2005 | B1 |
6846288 | Nagar et al. | Jan 2005 | B2 |
6853446 | Almogy et al. | Feb 2005 | B1 |
6877894 | Vona et al. | Apr 2005 | B2 |
6937886 | Zavislan | Aug 2005 | B2 |
6956650 | Boas et al. | Oct 2005 | B2 |
7072045 | Chen et al. | Jul 2006 | B2 |
7198778 | Achilefu et al. | Apr 2007 | B2 |
7231243 | Tearney et al. | Jun 2007 | B2 |
7245789 | Bates et al. | Jul 2007 | B2 |
7266407 | Li et al. | Sep 2007 | B2 |
7322972 | Viator et al. | Jan 2008 | B2 |
7357029 | Falk | Apr 2008 | B2 |
7382949 | Bouma et al. | Jun 2008 | B2 |
7541602 | Metzger et al. | Jun 2009 | B2 |
7610080 | Winchester, Jr. et al. | Oct 2009 | B1 |
7917312 | Wang et al. | Mar 2011 | B2 |
8016419 | Zhang et al. | Sep 2011 | B2 |
8025406 | Zhang et al. | Sep 2011 | B2 |
8143605 | Metzger et al. | Mar 2012 | B2 |
8397573 | Kobayashi | Mar 2013 | B2 |
8416421 | Wang et al. | Apr 2013 | B2 |
8454512 | Wang et al. | Jun 2013 | B2 |
8891088 | Goldschmidt et al. | Nov 2014 | B2 |
8997572 | Wang et al. | Apr 2015 | B2 |
9086365 | Wang | Jul 2015 | B2 |
9096365 | Kim | Aug 2015 | B2 |
9220415 | Mandelis et al. | Dec 2015 | B2 |
9226666 | Wang | Jan 2016 | B2 |
9234841 | Wang et al. | Jan 2016 | B2 |
9335605 | Wang et al. | May 2016 | B2 |
9528966 | Wang et al. | Dec 2016 | B2 |
9618445 | Sun et al. | Apr 2017 | B2 |
10285595 | Zalev | May 2019 | B2 |
10359400 | Wang et al. | Jul 2019 | B2 |
10433733 | Wang et al. | Oct 2019 | B2 |
10448850 | Wang et al. | Oct 2019 | B2 |
11020006 | Wang et al. | Jun 2021 | B2 |
11029287 | Wang et al. | Jun 2021 | B2 |
11135375 | Brady et al. | Oct 2021 | B2 |
11137375 | Wang et al. | Oct 2021 | B2 |
11369280 | Wang et al. | Jun 2022 | B2 |
11530979 | Wang et al. | Dec 2022 | B2 |
20010052979 | Treado et al. | Dec 2001 | A1 |
20020093637 | Yuan et al. | Jul 2002 | A1 |
20020173780 | Altshuler et al. | Nov 2002 | A1 |
20020176092 | Deck | Nov 2002 | A1 |
20030097066 | Shelby et al. | May 2003 | A1 |
20030160957 | Oldham et al. | Aug 2003 | A1 |
20030160967 | Houston et al. | Aug 2003 | A1 |
20040030255 | Alfano et al. | Feb 2004 | A1 |
20040039379 | Viator et al. | Feb 2004 | A1 |
20040082070 | Jones et al. | Apr 2004 | A1 |
20040254474 | Seibel et al. | Dec 2004 | A1 |
20050015002 | Dixon et al. | Jan 2005 | A1 |
20050028482 | Cable et al. | Feb 2005 | A1 |
20050085725 | Nagar et al. | Apr 2005 | A1 |
20050143664 | Chen et al. | Jun 2005 | A1 |
20050154313 | Desilets et al. | Jul 2005 | A1 |
20050168749 | Ye et al. | Aug 2005 | A1 |
20050217381 | Falk | Oct 2005 | A1 |
20050234315 | Mayevsky et al. | Oct 2005 | A1 |
20050277824 | Aubry et al. | Dec 2005 | A1 |
20060055936 | Yun et al. | Mar 2006 | A1 |
20060058614 | Tsujita | Mar 2006 | A1 |
20060122516 | Schmidt et al. | Jun 2006 | A1 |
20060181791 | Van Beek et al. | Aug 2006 | A1 |
20060184042 | Wang et al. | Aug 2006 | A1 |
20060235299 | Martinelli | Oct 2006 | A1 |
20060247510 | Wiemker et al. | Nov 2006 | A1 |
20060264717 | Pesach et al. | Nov 2006 | A1 |
20070075063 | Wilbanks et al. | Apr 2007 | A1 |
20070088206 | Peyman et al. | Apr 2007 | A1 |
20070093702 | Yu et al. | Apr 2007 | A1 |
20070213590 | Squicciarini | Sep 2007 | A1 |
20070213618 | Li et al. | Sep 2007 | A1 |
20070213693 | Plunkett | Sep 2007 | A1 |
20070282200 | Johnson et al. | Dec 2007 | A1 |
20070299341 | Wang et al. | Dec 2007 | A1 |
20080029711 | Viellerobe et al. | Feb 2008 | A1 |
20080037367 | Gross et al. | Feb 2008 | A1 |
20080088838 | Raicu et al. | Apr 2008 | A1 |
20080123083 | Wang et al. | May 2008 | A1 |
20080173093 | Wang et al. | Jul 2008 | A1 |
20080230717 | Ashkenazi et al. | Sep 2008 | A1 |
20090051900 | Moon et al. | Feb 2009 | A1 |
20090054763 | Wang et al. | Feb 2009 | A1 |
20090088631 | Dietz et al. | Apr 2009 | A1 |
20090116518 | Patel et al. | May 2009 | A1 |
20090138215 | Wang et al. | May 2009 | A1 |
20090185191 | Boppart et al. | Jul 2009 | A1 |
20090227997 | Wang et al. | Sep 2009 | A1 |
20100079768 | Wang et al. | Apr 2010 | A1 |
20100134793 | Krishnamachari et al. | Jun 2010 | A1 |
20100245766 | Zhang et al. | Sep 2010 | A1 |
20100245769 | Zhang et al. | Sep 2010 | A1 |
20100245770 | Zhang et al. | Sep 2010 | A1 |
20100249562 | Zhang et al. | Sep 2010 | A1 |
20100268042 | Wang et al. | Oct 2010 | A1 |
20100285518 | Viator et al. | Nov 2010 | A1 |
20100309466 | Lucassen et al. | Dec 2010 | A1 |
20100322497 | Dempsey et al. | Dec 2010 | A1 |
20110071402 | Masumura | Mar 2011 | A1 |
20110122416 | Yang et al. | May 2011 | A1 |
20110201914 | Wang et al. | Aug 2011 | A1 |
20110251515 | Leuthardt et al. | Oct 2011 | A1 |
20110275890 | Wang et al. | Nov 2011 | A1 |
20110282181 | Wang et al. | Nov 2011 | A1 |
20110282192 | Axelrod et al. | Nov 2011 | A1 |
20120065490 | Zharov et al. | Mar 2012 | A1 |
20120070817 | Wang et al. | Mar 2012 | A1 |
20120074294 | Streuber et al. | Mar 2012 | A1 |
20120118052 | O'Donnell et al. | May 2012 | A1 |
20120204648 | Wang et al. | Aug 2012 | A1 |
20120275262 | Song et al. | Nov 2012 | A1 |
20120307250 | Wang | Dec 2012 | A1 |
20130151188 | Rokni et al. | Jun 2013 | A1 |
20130199299 | Wang et al. | Aug 2013 | A1 |
20130218002 | Kiraly | Aug 2013 | A1 |
20130245406 | Wang et al. | Sep 2013 | A1 |
20140009808 | Wang et al. | Jan 2014 | A1 |
20140029829 | Jiang et al. | Jan 2014 | A1 |
20140142404 | Wang et al. | May 2014 | A1 |
20140356897 | Wang et al. | Dec 2014 | A1 |
20150005613 | Kim et al. | Jan 2015 | A1 |
20150178959 | Huang et al. | Jun 2015 | A1 |
20150185187 | Wang et al. | Jul 2015 | A1 |
20150245771 | Wang et al. | Sep 2015 | A1 |
20150272444 | Maslov et al. | Oct 2015 | A1 |
20150272446 | Wang et al. | Oct 2015 | A1 |
20150316510 | Fukushima et al. | Nov 2015 | A1 |
20160081558 | Wang et al. | Mar 2016 | A1 |
20160235305 | Wang et al. | Aug 2016 | A1 |
20160242651 | Wang et al. | Aug 2016 | A1 |
20160249812 | Wang et al. | Sep 2016 | A1 |
20160262628 | Wang et al. | Sep 2016 | A1 |
20160305914 | Wang et al. | Oct 2016 | A1 |
20160310083 | Wang et al. | Oct 2016 | A1 |
20160345886 | Wang et al. | Dec 2016 | A1 |
20170065182 | Wang et al. | Mar 2017 | A1 |
20170105636 | Wang et al. | Apr 2017 | A1 |
20170367586 | Wang et al. | Dec 2017 | A9 |
20180020920 | Ermilov et al. | Jan 2018 | A1 |
20180088041 | Zhang et al. | Mar 2018 | A1 |
20180132728 | Wang et al. | May 2018 | A1 |
20180177407 | Hashimoto et al. | Jun 2018 | A1 |
20190008444 | Wang et al. | Jan 2019 | A1 |
20190125583 | Wang et al. | May 2019 | A1 |
20190227038 | Wang et al. | Jul 2019 | A1 |
20190307334 | Wang et al. | Oct 2019 | A1 |
20200056986 | Wang et al. | Feb 2020 | A1 |
20200073103 | Wang et al. | Mar 2020 | A1 |
20200268253 | Wang et al. | Aug 2020 | A1 |
20200275846 | Wang et al. | Sep 2020 | A1 |
20200397523 | Gao et al. | Dec 2020 | A1 |
20210010976 | Wang et al. | Jan 2021 | A1 |
20210132005 | Wang et al. | May 2021 | A1 |
20210321874 | Wang et al. | Oct 2021 | A1 |
20210333241 | Wang et al. | Oct 2021 | A1 |
Number | Date | Country |
---|---|---|
1883379 | Dec 2006 | CN |
106338473 | Jan 2017 | CN |
0012262 | Jun 1980 | EP |
0919180 | Jun 1999 | EP |
1493380 | Jan 2005 | EP |
05-126725 | May 1993 | JP |
2000292416 | Oct 2000 | JP |
2009068977 | Apr 2009 | JP |
2010017426 | Jan 2010 | JP |
2010040161 | Feb 2010 | JP |
2012143384 | Aug 2012 | JP |
2013244122 | Dec 2013 | JP |
2014124242 | Jul 2014 | JP |
2014224806 | Dec 2014 | JP |
2016-101260 | Jun 2016 | JP |
6086718 | Mar 2017 | JP |
100946550 | Mar 2010 | KR |
20160091059 | Aug 2016 | KR |
2017-0006470 | Jan 2017 | KR |
WO2006111929 | Oct 2006 | WO |
WO2007088709 | Aug 2007 | WO |
WO2007148239 | Dec 2007 | WO |
WO2008062354 | May 2008 | WO |
WO2008100386 | Aug 2008 | WO |
WO2009055705 | Apr 2009 | WO |
WO2010048258 | Apr 2010 | WO |
WO2010080991 | Jul 2010 | WO |
WO2011060101 | May 2011 | WO |
WO2011091360 | Jul 2011 | WO |
WO2011127428 | Oct 2011 | WO |
WO201203 5472 | Mar 2012 | WO |
WO2013086293 | Jun 2013 | WO |
WO2015118881 | Aug 2015 | WO |
WO2018102446 | Jun 2018 | WO |
WO-2018102467 | Jun 2018 | WO |
WO2018209046 | Nov 2018 | WO |
Entry |
---|
Office Action from related U.S. Appl. No. 11/625,099, dated Nov. 1, 2010. |
Final Office Action from related U.S. Appl. No. 11/625,099, dated Apr. 20, 2010. |
Office Action from related U.S. Appl. No. 12/254,643, dated Aug. 6, 2010. |
Notice of Allowance from related U.S. Appl. No. 12/254,643, dated Nov. 22, 2010. |
Office Action from related U.S. Appl. No. 12/568,069, dated Dec. 21, 2012. |
Office Action from related U.S. Appl. No. 12/568,069, dated Mar. 29, 2012. |
Final Office Action from related U.S. Appl. No. 12/568,069, dated Sep. 18, 2012. |
Notice of Allowance from related U.S. Appl. No. 12/568,069, dated Feb. 22, 2013. |
Office Action from related U.S. Appl. No. 12/739,589, dated Jul. 19, 2012. |
Notice of Allowance from related U.S. Appl. No. 12/739,589, dated Feb. 5, 2013. |
Office Action from related U.S. Appl. No. 13/125,522, dated Jan. 22, 2013. |
Final Office Action from related U.S. Appl. No. 13/125,522, dated May 23, 2013. |
Office Action from related U.S. Appl. No. 13/125,522, dated Jul. 17, 2014. |
Final Office Action from related U.S. Appl. No. 13/125,522, dated Oct. 29, 2014. |
Office Action dated Aug. 26, 2015 issued in U.S. Appl. No. 13/125,522. |
Final Office Action dated Mar. 3, 2016 issued in U.S. Appl. No. 13/125,522. |
Notice of Allowance dated Sep. 19, 2016 issued in U.S. Appl. No. 13/125,522. |
Office Action from related U.S. Appl. No. 13/143,832, dated Apr. 18, 2014. |
Office Action from related U.S. Appl. No. 13/369,558, dated Jun. 20, 2014. |
Notice of Allowance from related U.S. Appl. No. 13/369,558, dated Jul. 29, 2014. |
Office Action from related U.S. Appl. No. 13/450,793, dated Jun. 5, 2013. |
Final Office Action from related U.S. Appl. No. 13/450,793, dated Nov. 22, 2013. |
Office Action from related U.S. Appl. No. 13/450,793, dated Mar. 24, 2014 (22 pages). |
Office Action from related U.S. Appl. No. 13/450,793, dated Aug. 1, 2014 (21 pages). |
Office Action from related U.S. Appl. No. 13/574,994, dated Mar. 17, 2014. |
Final Office Action from related U.S. Appl. No. 13/574,994, dated Aug. 26, 2014. |
Notice of Allowance dated Nov. 17, 2015 from U.S. Appl. No. 13/574,994. |
Office Action dated Jan. 20, 2015, from U.S. Appl. No. 14/026,577. |
Final Office Action dated Sep. 30, 2015, from U.S. Appl. No. 14/026,577. |
Notice of Allowance dated Jan. 5, 2016, from U.S. Appl. No. 14/026,577. |
Office Action dated Nov. 13, 2017, from U.S. Appl. No. 15/148,685. |
Final Office Action dated Sep. 24, 2018, from U.S. Appl. No. 15/148,685. |
Notice of Allowance dated May 16, 2019, from U.S. Appl. No. 15/148,685. |
Office Action from related U.S. Appl. No. 13/637,897, dated Aug. 1, 2014 (7 pages). |
Office Action from related U.S. Appl. No. 14/164,117, dated Dec. 11, 2015 (18 pages). |
Office Action dated Dec. 13, 2019 issued in U.S. Appl. No. 15/037,468. |
Notice of Allowance dated Mar. 23, 2020 issued in U.S. Appl. No. 15/037,468. |
Amendment and Request for Continued Examination dated Nov. 25, 2019 in U.S. Appl. No. 14/436,581. |
Final Office Action dated May 24, 2019 issued in U.S. Appl. No. 14/436,581. |
Office Action dated Apr. 3, 2020 issued in U.S. Appl. No. 14/436,581. |
The International Search Report and Written Opinion dated Mar. 27, 2014 issued in Application No. PCT/US2013/065594. |
The International Search Report and The Written Opinion of the International Searching Authority, or the Declaration, for PCT/US2009/061435, dated Mar. 29, 2010, 6 pages. |
The International Search Report and The Written Opinion of the International Searching Authority, dated Sep. 22, 2011 , from related application No. PCT/US2011/022253, 6 pgs. |
International Search Report of International Application No. PCT/US2014/066437, dated Feb. 26, 2015, 3 pages. |
Partial European Search Report issued for European Application No. 17159220.7, dated Aug. 23, 2017 (9 pages). |
International Search Report and Written Opinion dated Apr. 22, 2009, from Application No. PCT/US2008/081167 (7 pages). |
International Search Report and Written Opinion from Application Serial No. PCT/US2010/020488, dated Aug. 31, 2010 (10 pages). |
International Search Report and Written Opinion from Application Serial No. PCT/US2011/031823, dated Dec. 26, 2011 (8 pages). |
International Search Report and Written Opinion from Application Serial No. PCT1US2012/068403, dated Mar. 19, 2013 (10 pages). |
Extended European Search Report from European Application Serial No. 08842292.8, dated Dec. 17, 2013 (8 pages). |
Final Office Action from related Japanese Patent Application No. JP 2010-531281 , dated Mar. 11, 2014, (5 pages). |
International Search Report and Written Opinion dated Dec. 2, 2019, issued in Application No. PCT/US2019/046574. |
International Search Report and Written Opinion dated Dec. 23, 2019, issued in Application No. PCT/US2019/049594. |
Al, et al., “Spectral-domain optical coherence tomography: Removal of autocorrelation using an optical switch,” Applied Physics Letters, (Mar. 15, 2006), 88(11): pp. 111115-1-111115-3. <doi:10.1063/1.2186520>. |
Allen, et al. “Pulsed Near-Infrared Laser Diode Excitation System for Biomedical Photoacoustic Imaging,” Optics Letters, Optical Society of America, USA., vol. 31 , No. 23, Dec. 1, 2006, pp. 3462-3464. |
Aubry J.-F. , et al. , “Experimental demonstration of noninvasive transskull adaptive focusing based on prior computed tomography scans,” J. Acoust. Soc. Am. 113(1), 84-93 (2003). (Year: 2003). |
Baker, M. J. et al., “Using Fourier transform IR spectroscopy to analyze biological materials,” Nat. Protoc. 9, 1771-1791 (2014). |
Beaven, G. H. & Holiday, E. R., “Ultraviolet absorption spectra of proteins and amino acids,” Adv. Protein Chem 7, 319-386 (1952). |
Bell, A.G., “On the Production and Reproduction of Sound by Light,” American Journal of Sciences, Oct. 1880, pp. 305-324, Third Series, vol. XX, USA. |
Bioucas-Dias, J.M. and Figueiredo, M.A.T. “A new TwIST: two-step iterative shrinkage/thresholding algorithms for image restoration,” IEEE Trans. Image Process. 16, 2992-3004 (Dec. 2007). |
Calasso et al., “Photoacoustic Point Source,” Physical Review Letters, vol. 86, No. 16, Apr. 16, 2001, pp. 3550-3553. |
Cannata et al., “Development of a 35-MHz Piezo-Composite Ultrasound Array for Medical Imaging,” IEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 53(1): pp. 224-236 (2006). |
Chan, et al., “New opportunities in micro- and macro-attenuated total reflection infrared spectroscopic imaging: spatial resolution and sampling versatility,” Appl. Spectrosc. 57, 381-389 (2003). |
Cheng, J.-X. et al., “Vibrational spectroscopic imaging ofliving systems: an emerging platform for biology and medicine,” Science, vol. 350 aaa8870, No. 6264, Nov. 27, 2015, pp. 1054-1063. |
Cheong, et al., “A review of the optical properties of biological tissues,” IEEE J. Quantum Electronics, 26(12): pp. 2166-2185 (1980). |
Cox, B., Beard, P., “Photoacoustic tomography with a single detector in a reverberant cavity” J. Acoust. Soc. Am. 125, 1426 (Mar. 2009). |
De Boer, et al., “Improved signal-to-noise ratio in spectral-domain compared with time-domain optical coherence tomography” Optics Letters, vol. 28, No. 21, Nov. 1, 2003, pp. 2067-2069. |
D'Andrea, et al., “Time-resolved optical imaging through turbid media using a fast data acquisition system based on a gated CCD camera” Journal of Physics D: Applied Physics, vol. 36, No. 14, Jul. 1, 2003, pp. 1675-1681. |
Danielli, et al., “Label-free photoacoustic nanoscopy,” Journal of Biomedical Optics, vol. 19, No. 8, Aug. 2014, pp. 086006-1-086006-10. |
Dazzi, A. et al., “AFM-IR: technology and applications in nanoscale infrared spectroscopy and chemical imaging,” Chem. Rev. 117, 5146-5173 (2017). |
Dazzi, A., et al., “Local infrared microspectroscopy with subwavelength spatial resolution with an atomic force microscope tip used as a photothermal sensor,” Optics Letters, vol. 30, No. 18, Sep. 15, 2005, pp. 2388-2390. |
Diebold, et al., “Photoacoustic Monopole Radiation in One, Two and Three Dimensions,” Physical Review Letters, Figs. 1 and 2, vol. 67, No. 24, Dec. 9, 1991 , pp. 3384-3387. |
Diebold, et al., “Photoacoustic Signature of Particulate Matter: Optical Production of 9 Acoustic Monopole Radiation,” Science New Series, Oct. 5, 1990, pp. 101-104, vol. 250, No. 4977, pp. 101-104. |
Diem, M. et al., “Molecular pathology via IR and Raman spectral imaging.” Journal of Biophotonics, vol. 6, No. 11-12 (2013) pp. 855-886. <doi:10.1002/jbio.201300131>. |
Diem, M., et al., “A decade of vibrational micro-spectroscopy of human cells and tissue (1994-2004)†,” Analyst, Oct. 2004, vol. 129, No. 10, pp. 880-885. <doi:10.1039/b408952a>. |
Draeger, C., Fink, M., “One-channel time reversal of elastic waves in a chaotic 2D-silicon cavity,” Phys. Rev. Lett. 79, 407-410 (Jul. 21, 1997). |
Dunn, et al., “Transport-based image reconstruction in turbid media with small source-detector separations,” Optics Letters, vol. 25, No. 24, Dec. 15, 2000, pp. 1777-1779. |
Ermilov et al., “Laser optoacoustic imaging system for detection of breast cancer,” Journal of Biomedical Optics, vol. 14 No. 2, p. 24007-024007-14 (2009). |
Erpelding et al., “Sentinel Lymph Nodes in the Rat: Noninvasive Photoacoustic and US Imaging with a Clinical US System,” Radiology, 256(1): 102-110 (2010). |
Evans, et al., “Coherent Anti-Stokes Raman Scattering Microscopy: Chemical Imaging for Biology and Medicine,” Annual Review of Analytical Chemistry l, (2008), pp. 883-909. |
Fan, et al., “Development of a Laser Photothermoacoustic Frequency-Swept System for Subsurface Imaging: Theory and Experiment,” J. Acoust. Soc. Am., vol. 116 (6), Dec. 2004, pp. 3523-3533. |
Fang, et al., “Photoacoustic Doppler effect from flowing small light-absorbing particles,” Physical Review Letters 99(18) 184501-(1-4) (Nov. 2, 2007). |
Fercher, et al., “Measurement of Intraocular Distances by Backscattering Spectral Interferometry,” Optics Communications, 1995, vol. 117, pp. 43-48. |
Fernandez, D. C., Bhargava, R., Hewitt, S. M. & Levin, I. W., “Infrared spectroscopic imaging for histopathologic recognition,” Nat. Biotechnol. 23, 469-474 (2005). |
Foster, et al., “Advances in ultrasound biomicroscopy” Ultrasound in Medicine & Biology, vol. 26, No. 1, Jan. 2000, pp. 1-27. |
Fujita, K., et al., “Confocal multipoint multiphoton excitation microscope with microlens and pinhole arrays,” Opt. Comm. 174, 7-12 (Jan. 15, 2000). |
Furstenberg, et. al., “Chemical Imaging using Infrared Photo-thermal Microspectroscopy,” In Proceedings of SPIE Defense, Security, and Sensing (eds Druy, M.A. & Crocombe, R. A.) 837411 (SPIE, 2012). |
Gao, L.; Liang, J.]; Li, C.; Wang, L. V.; “Single-shot compressed ultrafast photography at one hundred billion frames per second,” Nature 516(7529) 74-77 (Dec. 4, 2014). |
Gibson, et al., “Recent advances in diffuse optical imaging” Physics in Medicine and Biology 50, 2005, pp. R1-R43, Inslilule of Physics Publishing, UK. |
Gong, L. et al., “Breaking the diffraction limit by saturation in stimulated-Raman-scattering microscopy: a theoretical study,” Phys. Rev. A 90, 13818 (2014). |
Griffiths, P., “Fourier transform infrared spectrometry,” Science 21, 297-302 (1983). |
Guggenheim, et al., “Ultrasensitive planoconcave optical microresonators for ultrasound sensing”, Nat. Photon. 11, 714-721 (2017). |
Guittet C, et al., “In vivo high-frequency ultrasonic characterization of human dermis” IEEE Transactions on Bio-medical Engineering. Jun. 1999;46(6):740-746. <doi:10.1109/10.764950>. |
Guo, et al., “Calibration-free absolute quantification of optical absorption coefficients using acoustic spectra in three-dimensional photoacoustic microscopy of biological tissue” Opt Lett. 2010 ; 35(12): 2067-2069. <doi:10.1364/OL.35.002067>. |
Haas, J. et al., “Advances in Mid-Infrared Spectroscopy for Chemical Analysis,” Annu. Rev. Anal. Chem. 9 (2016) pp. 45-68. |
Hai, J. Yao, K.I. Maslov, Y. Zhou, and L.V. Wang, “Near-infrared optical-resolution photoacoustic microscopy”, Opt. Lett. 39, 5192-5195 (Sep. 1, 2014). |
Hai, P.; Imai, T.]; Xu, S.; Zhang, R.; Aft, R. L.; Zou, J.; Wang, L. V.; “High-throughput, label-free, single-cell photoacoustic microscopy of intratumoral metabolic heterogeneity,” Nature Biomedical Engineering 3(5) 381-391 (May 2019). |
Hebden et al., “Enhanced time-resolved imaging with a diffusion model of photon transport” Optics Letters, vol. 19, No. 5, 1994, pp. 311-313. |
Hee, et al., “Femtosecond transillumination tomography in thick tissues” Optics Letters, vol. 18, No. 13, 1993, pp. 1107-1109. |
Hillman, et al., “Laminar optical tomography: demonstration of millimeter-scale depth-resolved imaging in turbid media,” Optics Letters, vol. 29, No. 14, Jul. 15, 2004, pp. 1650-1652. |
Hoelen, et al., “Three Dimensional Photoacoustic Imaging of Blood Vessels in Tissue” Optics Letters, 1998, pp. 648-650, vol. 23, No. 8, Optical Society of America, USA. |
Hu, S. et al., “Three-dimensional optical-resolution photoacoustic microscopy,” Journal of Visualized Experiments 51 (2011). |
Hu, S., et al., “Label-free Photoacoustic Ophthalmic Angiography” Optics Letters, 35(1), Jan. 1, 2010, pp. 1-3. |
Huang, et al., “Aberration correction for transcranial photoacoustic tomography of primates employing adjunct image data,” Journal of Biomedical Optics, vol. 17, No. 6, Jun. 2012, pp. 066016-1 to 066016-8. |
Huang, et al., “Optical Coherence Tomography,” Science, New Series, vol. 254, No. 5035, Nov. 22, 1991 , pp. 1178-1181. |
Huber, et al., “Three-Dimensional and C-Mode 6 OCT Imaging with a Compact, Frequency Swept Laser Source at 1300 nn” Optics Express, vol. 13, No. 26, Dec. 26, 2005, pp. 10523-10526. |
Imai, T. et al., “High-throughput ultraviolet photoacoustic microscopy with multifocal excitation,” Journal of Biomedical Optics, 23(3), (2018) pp. 036007-1-036007-6. <doi: 10.1117/1.JB0.23.3.036007>. |
Ing, R. K., Quieffin, N., Catheline, S., Fink, M., “In solid localization of finger impacts using acoustic time-reversal process,” Appl. Phys. Lett. 87, 204104 (Nov. 14, 2005). |
Ji, M. et al., “Detection of human brain tumor infiltration with quantitative stimulated Raman scattering microscopy,” Sci. Transl. Med 7, 309ra163 (2015). |
Karamata, et al., “Multiple Scattering in Optical Coherence Tomography I Investigation and Modeling” Journal of Optical Society of America, vol. 22, No. 7 (2005) pp. 1369-1379. |
Karamata, et al., “Multiple scattering in optical coherence tomography. II. Experimental and theoretical investigation of cross talk in wide-field optical coherence tomography” J. Opt. Soc. Am. A/vol. 22, No. 7/Jul. 2005, pp. 1380-1388. |
Kim, C. et al., “In vivo molecular photoacoustic tomography of melanomas targeted by bio-conjugated gold nanocages” ACS Nano, 2010; 4(8), pp. 4559-4564. <doi:10.1021/nn100736c>. |
Knoll, B. & Keilmann, F., “Near-field probing of vibrational absorption for chemical microscopy,” Nature 399, 134-137 (1999). |
Kole, M. R., et al., “Discrete frequency infrared microspectroscopy and imaging with a tunable quantum cascade laser,” Anal. Chem. 84, 10366-10372 (2012). |
Kolkman, et al., “In Vivo Photoacoustic Imaging of Blood Vessels Using an Extreme-Narrow Aperture Sensor” IEEE Journal of Selected Topics in Quantum Electronics, vol. 9, No. 2, Mar.-Apr. 2003, pp. 343-346. |
Kruger et al., “Photoacoustic Ultrasound (PAUS)-Reconstruction Tomography” Med. Phys., Oct. 1995, vol. 22 (10) Am. Assoc. Phys. Med., USA, pp. 1605-1609. |
Kruger, et al., “Thermoacoustic computed tomography—technical considerations” Medical Physics, 26(9): 1832-1837 (1999). |
Kruger et al., “Thermoacoustic computed tomography using a conventional linear transducer array,” Medical Physics, 30(5): 856-860 (2003). |
Kruger, et al., “Thermoacoustic Molecular Imaging of Small Animals,” Molecular Imaging, 2(2): 113-123 (2003). |
Kruger, et al., “Breast Cancer in Vivo: Contrast Enhancement with Thermoacoustic CT at 434 MHz—Feasibility Study,” Radiology, 216(1): 279-283 (2000). |
Ku and Wang, “Scanning thermoacoustic tomography in biological tissue.” Medical physics 27.5 (2000): 1195-1202. |
Ku and Wang, “Scanning microwave-induced thermoacoustic tomography: Signal, resolution, and contrast,” Medical Physics, 28(1): 4-10 (2001). |
Ku, G. et al., “Multiple-bandwidth photoacoustic tomography,” Physics in Medicine & Biology, 49(7): 1329-1338 (2004). |
Ku and Wang, “Deeply penetrating photoacoustic tomography in biological tissues enhanced with an optical contrast agent,” Optics Letters, 30(5): 507-509 (2005). |
Ku, et al., “Imaging of tumor angiogenesis in rat brains in vivo by photoacoustic tomography,” Applied Optics, 44(5): 770-775 (2005). |
Ku, et al., “Thermoacoustic and Photoacoustic Tomography of Thick Biological Tissues Toward Breast Imaging,” Technology in Cancer Research & Treatment, 4(5): 559-566 (2005). |
Kunitz, M., “Crystalline desoxyribonuclease; isolation and general properties; spectrophotometric method for the measurement of desoxyribonuclease activity,” The Journal General Physiology, vol. 33, Mar. 20, 1950, pp. 349-362. <URL:http://doi.org./10.1085/jgp.33.4.349>. |
Lai, P. et al., “Photoacoustically guided wavefront shaping for enhanced optical focusing in scattering media,” Nature Photonics 9 126-132 (Jan. 19, 2015). |
Larina, et al., Real-time optoacoustic monitoring of temperature in tissues: Journal of Physics D: Applied Physics, vol. 38, (2005) pp. 2633-2639. |
Lasch, et al., “FT-IR spectroscopic investigations of single cells on the subcellular level,” Vibr. Spectrosc. 28, 147-157 (2002). |
Laser Institute of America, “American National Standard for the safe use of lasers,” American National Standard Institute (ANSI Z136.1-2007 Revision of ANSI Z136.1-2000). |
Lewis, E. N. et al., “Fourier transform spectroscopic imaging using an infrared focal-Plane array detector,” Anal. Chem. 67, 3377-3381 (1995). |
Leitgeb, et al., “Performance of fourier domain vs. time domain optical coherence tomography,” Optical Express, vol. 11, No. 8, Apr. 21, 2003, pp. 889-894. |
Li, G., et al., “Reflection-mode multifocal optical-resolution photoacoustic microscopy,” J. Biomed. Opt. 18, 030501 (Feb. 12, 2013). |
Li, L., et al., “Small near-infrared photochromic protein for photoacoustic multi-contrast imaging and detection of protein interactions in vivo,” Nature Communications 9(1) 2734 (Jul. 16, 2018). |
Li, L . . . , et al., “Single-impulse panoramic photoacoustic computed tomography of small-animal whole-body dynamics at high spatiotemporal resolution,” Nature Biomedical Engineering 1 0071 (May 10, 2017). |
Li, L . . . , et al., “Simultaneous Molecular and Hypoxia Imaging of Brain Tumors in Vivo Using Spectroscopic Photoacoustic Tomography,” Proceedings of the IEEE, 96(3): 481-489 (2008). |
Li, Y. et al., “Multifocal photoacoustic microscopy through an ergodic relay (Conference Presentation)”, Proc. SPIE 10878, Photons Plus Ultrasound: Imaging and Sensing 2019, 108781C, presented Feb. 4, 2019, published Mar. 4, 2019, https://doi.org/10.1117/12.2513502. |
Li, et al., “Optical Coherence Computed Tomography,” Applied Physics Letters, vol. 91, American Institute of Physics, 2007, pp. 141107-1-141107-3. |
Li, Y., et al., “Snapshot photoacoustic topography through an ergodic relay for high-throughput imaging of optical absorption,” Nature Photonics, Jan. 20, 2020. <URL:https://doi.org/10.1038/s41566-019-0576-2>. |
Li, Z., et al., “Super-resolution far-field infrared imaging by photothermal heterodyne imaging,” The Journal of Physical Chemistry B, vol. 121 (2017) pp. 8838-8846. |
Li, Z., et al., “Super-resolution imaging with mid-IR photothermal microscopy on the single particle level,” In Proceedings of SPIE Physical Chemistry of Interfaces and Nano-materials XIV, vol. 9549, Aug. 20, 2015, pp. 954912-1-954912-8. |
Liang, et al., “Single-shot real-time femtosecond imaging of temporal focusing,” Light-Science & Applications 7(1) 42 (Aug. 8, 2018). |
Liang, et al., “Single-shot real-time video recording of a photonic Mach cone induced by a scattered light pulse,” Science Advances 3(1) e1601814 (Jan. 20, 2017). |
Liang, et al., “Single-shot ultrafast optical imaging,” Optica 5(9) 1113-1127 (Sep. 2018). |
Lin, et al., “Single-breath-hold photoacoustic computed tomography of the breast,” Nature Communications 9(1) 2352 (Jun. 15, 2018). |
Liu, et al., “Optical focusing deep inside dynamic scattering media with near-infrared time-reversed ultrasonically encoded (TRUE) light,” Nature Communications 6 5409 (Jan. 5, 2015). |
Lovell, et al., “Porphysome nanovesicles generated by porphyrin bilayers for use as multimodal biophotonic contrast agents,” Nature Materials 10(4) 324-32 (Mar. 20, 2011). |
Lu, F., et al., “Tip-enhanced infrared nanospectroscopy via molecular expansion force detection,” Nat. Photon. 8, 307-312 (2014). |
Lu, F.-K. et al., “Label-free DNA imaging in vivo with stimulated Raman scattering microscopy,” Proc. Natl Acad Sci. USA 112, 11624-11629 (2015). |
Ma, et al., “Time-reversed adapted-perturbation (TRAP) optical focusing onto dynamic objects inside scattering media,” Nature Photonics 8(12) 931-936 (Nov. 2, 2014). |
Manohar, et al., “Initial results of in vivo non-invasive cancer imaging in the human breast using near-infrared photoacoustics,” Optics Express, 15(19): 12277-12285 (2007). |
Maslov, et al., “In vivo dark-field reflection-mode photoacoustic microscopy,” Optics Letters 30(6), Mar. 15, 2005, pp. 625-627. |
Maslov, et al., “Optical-resolution photoacoustic microscropy for in vivo imaging of single capillaries,” Optical Letters, 33(9): 929-931 (2008). |
Maslov, et al., “Photoacoustic Imaging of biological tissue with Intensity-Modulated Continuous-Wave Laser” Journal of Biomedical Optics, 2008, pp. 024006 1-5, vol. 13(2), SPIE, USA. |
Michaelian, Kirk H. Photoacoustic IR spectroscopy: instrumentation, applications and data analysis. Pub: John Wiley & Sons; Dec. 1, 2010. <Preface Only>. |
Miller, et al., “Synchrotron-based biological microspectroscopy: From the mid-infrared through the far-infrared regimes,” Journal of Biological Physics 29, 219-230 (2003). |
Mishra et al., “Development and comparison of the DTM, the DOM and the FVM formulations for the short-pulse laser transport through a participating medium” International Journal of Heat and Mass Transfer, vol. 49 (2006) pp. 1820-1832. |
Montaldo, et al., “Building three-dimensional images using time-reversal chaotic cavity”, IEEE Trans. Ultrason. Ferroelectr. Freq. Control 52, pp. 1489-1497 (2005). |
Morgner et al., “Spectroscopic optical coherence tomography,” Optics Letters, vol. 25, No. 2, Jan. 15, 2000, pp. 111-113. |
Murray et al., “High-Sensitivity Laser-Based Acoustic Microscopy Using a Modulated Excitation Source,” Applied Physics Letters, vol. 85, No. 14, American Institute of Physics, USA., Oct. 4, 2004, pp. 2974-2976. |
Nakajima, et al., “Three-dimensional analysis and classification of arteries in the skin and subcutaneous adipofascial tissue by computer graphics imaging,” Plastic and Reconstructive Surgery, 102(3): 748-760 (1998). |
Nasiriavanaki, et al., “High-resolution photoacoustic tomography of resting-state functional connectivity in the mouse brain,” Proceedings of the National Academy of Sciences 111(1) 21-26 (Jan. 7, 2014). |
Nasse, M. J. et al., “High-resolution Fourier-transform infrared chemical imaging with multiple synchrotron beams,” Nat. Methods 8, 413-416 (2011). |
Nelson et al., “Imaging Glioblastoma Multiforme,” The Cancer Journal vol. 9, No. 2, Mar.-Apr. 2003, pp. 134-145. |
Niederhauser et al., “Combined Ultrasound and Optoacoustic System for Real-Time High-Contrast Vascular imaging in Vivo,” IEEE Transactions on Medicallmaging, 24(4): 436-440 (2005). |
Nowak, D. et al., “Nanoscale chemical imaging by photoinduced force microscopy,” Sci. Adv. 2, Mar. 25, 2016, e1501571, pp. 1-9. |
Oraevsky et al., “Optoacoustic Tomography,” Biomedical Photonics Handbook, 2003, chapter 34: pp. 931-964, CRC Press LLC, USA. |
Oraevsky et al., “Ultimate Sensitivity of Time-Resolved Opto-Acoustic Detection,” Biomedical Optoacoustics, 2000, pp. 228-239, vol. 3916, SPIE, USA. |
Oraevsky et al., “Laser Optoacoustic Tomography of Layered Tissues: Signal Processing” Proceedings of SPIE, 2979: 59-70 (1997). |
Oraevsky et al.,, “Laser opto-acoustic imaging of the breast: Detection of cancer angiogenesis” Proceedings of SPIE, 3597: 352-363 (1999). |
Patel, et al., “Pulsed optoacoustic spectroscopy of condensed matter,” Rev. Mod. Phys., vol. 53 (1981) pp. 517-550. |
Petrov, et al., “Optoacoustic, Noninvasive, Real-Time, Continuous Monitoring of Cerebral Blood Oxygenation: An In Vivo Study in Sheep” Anesthesiology, vol. 102, No. 1, Jan. 2005, pp. 69-75. |
Potter, et al., “Capillary diameter and geometry in cardiac and skeletal muscle studied by means of corrosion casts” Microvascular Research, 25(1): 68-84 (1983). |
Prati, et al., “New advances in the application of FTIR microscopy and spectroscopy for the characterization of artistic materials,” Accounts of Chemical Research, vol. 43, (2010) pp. 792-801. |
Prevedel, et al., “Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy,” Nat. Methods 11, 727-730 (Jul. 2014). |
Quickenden, et al., “The ultraviolet absorption spectrum ofliquid water,” J Chem. Phys. 72, 4416-4428 (1980). |
Robert et al., “Fabrication of Focused Poly (Vinylidene Fluoride-Trifluoroethylene) P19 (VDF-TrFE) Copolymer 40-50 MHz Ultrasound Transducers on Curved Surfaces,” Journal of Applied Physics, vol. 96, No. 1. Jul. 1, 2004, pp. 252-256. |
Rockley, M.G., “Fourier-transformed infrared photoacoustic spectroscopy of polystyrene film,” Chem. Phys. Lett. 68, 455-456 (1979). |
Saager et al., “Direct characterization and removal of interfering absorption trends in two-layer turbid media” J. Opt. Soc. Am. A, vol. 22, No. 9, Sep. 2005, pp. 1874-1882. |
Sakadzic, et al., “Correlation transfer and diffusion of ultrasound-modulated multiply scattered light,” Physical Review Letters 96(16) 163902-(1-4) (Apr. 28, 2006). |
Savateeva, et al., “Noninvasive detection and staging or oral cancer in vivo with confocal opto-acoustic tomography” Biomedical Optoacoustics, vol. 3916, International Society for Optics and Photonics 2000, pp. 55-66. |
Schmidt, et al., “A 32-Channel Time Resolved Instrument for Medical Optical Tomography” Review of Scientific Instruments, vol. 71, No. 1, Jan. 2000, pp. 256-265. |
Schroeter, et al., “Spontaneous slow hemodynamic oscillations are impaired in cerebral microangiopathy,” Journal of Cerebral Blood Flow & Metabolism (2005) 25, pp. 1675-1684. |
Sethuraman et al., “Development of a combined intravascular ultrasound and photoacoustic imaging system” Proceedings of SPIE, 6086: 60860F.1-60860F.10 (2006). |
Sethuraman et al., “Intravascular photoacoustic imaging of atherosclerotic plaques: Ex vivo study using a rabbit model of atherosclerosis” Proceedings of SPIE, 6437: 643729.1-643729.9 (2007). |
Shah, J. et al, “Photoacoustic imaging and temperature measurement for photothermal cancer therapy,” Journal of Biomedical Optics, vol. 13, No. 3, (May-Jun. 2008) pp. 034024-1-034024-9. |
Sheth, et al., “Columnar Specificity of Microvascular Oxygenation and Volume Responses: Implications for Functional Brain Mapping,” The Journal of Neuroscience, vol. 24, No. 3, Jan. 21, 2004, pp. 634-641. |
Shi, J., et al., “High-resolution, high-contrast mid-infrared imaging of fresh biological samples with ultraviolet-localized photoacoustic microscopy,” Nature Photonics 13 609-615 (May 2019). |
Shmueli, et al., “Low Frequency Fluctuations in the Cardiac Rate as a Source of Variance in the Resting-State fMRI BOLD Signal,” Neuroimage, vol. 38, No. 2, Nov. 1, 2007, pp. 306-320. |
Silva, et al., “Toward Label-Free Super-Resolution Microscopy,” ACS Photon. 3, 79-86 (2016). |
Sim, et al., “In vivo Microscopic Photoacoustic Spectroscopy for Non-Invasive Glucose Monitoring Invulnerable to Skin Secretion Products,” Sci. Rep. 8, 1059 (2018). |
Siphanto et al., “Imaging of Small Vessels Using Photoacoustics: an in Vivo Study,” Lasers in Surgery and Medicince, vol. 35, Wiley-Liss, Inc., Netherlands, Dec. 20, 2004, pp. 354-362. |
Sommer, A. J., et al., “Attenuated total internal reflection infrared mapping microspectroscopy using an imaging microscope,” Appl. Spectrosc. 55, 252-256 (2001). |
Song, et al., “Fast 3-D dark-field reflection-mode photoacoustic microscopy in vivo with a 30-MHz ultrasound linear array” Journal of Biomedical Optics, 13(5): 054028.1-054028.5 (2008). |
Song et al., “Multi-focal optical-resolution photoacoustic microscopy in vivo.” NIH Public Access Author Manuscript, May 13, 2011. pp. 1-7. |
Song, et al., “Section-illumination photoacoustic microscopy for dynamic 3D imaging of microcirculation in vivo” Optics Letters, 35(9): 1482-1484 (2010). |
Steinbrink, et al., “Illuminating the BOLD signal: combined fMRI-fNIRS studies” Magnetic Resonance Imaging, vol. 24, No. 4, May 2006, pp. 495-505. |
Stern, MD., “In vivo evaluation of microcirculation by coherent light scattering,” Nature, 254(5495): 56-58 (1975). |
Tam, A. C., “Applications of photoacoustic sensing techniques,” Reviews of Modern Physics, vol. 58, No. 2, Apr. 1986, pp. 381-431. |
Tearney, et al., “Scanning single-mode fiber optic catheter-endos cope for optical coherence tomography” Optics Letters, 21(7): 543-545 (1996). |
Tran, et al., “In vivo endoscopic optical coherence tomography by use of a rotational microelectromechanical system probe” Optics Letters, 29(11): 1236-1238 (2004). |
Treeby B. E. , Zhang E. Z. , Cox B. T. , “Photoacoustic tomography in absorbing acoustic media using time reversal ,” Inverse Probl. 26(11) , (2010)(Year: 2010). |
Van Essen, et al., “An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex” Journal of the American Medical Informatics Association, vol. 8, No. 5, Sep.-Oct. 2001, pp. 443-459. |
Viator et al., “Design testing of an endoscopic photoacoustic probe for determination of treatment depth after photodynamic therapy” Proceedings of SPIE in Biomedical Optoacoustics II, 4256: 16-27 (2001). |
Wang, et al., “Ballistic 2-D Imaging Through Scattering Walls Using an Ultrafast Optical Kerr Gale,” Science, vol. 253, Aug. 16, 1991, pp. 769-771. |
Wang, et al., “Biomedical Optics, Principles and Imaging,” Wiley-Interscience, A John Wiley & Sons, Inc., (2007) p. 7. |
Wang, L. et al., “Grueneisen relaxation photoacoustic microscopy,” Physical Review Letters 113 174301 (Oct. 24, 2014). |
Wang, L. V & Yao, J., “A practical guide to photoacoustic tomography in the life sciences,” Nat. Methods 13, 627-638 ( Jul. 28, 2016). |
Wang, L. V., “Multiscale photoacoustic microscopy and computed tomography,” Nat. Photon. 3, 503-509 (Aug. 29, 2009). |
Wang, L. V.; “Mechanisms of ultrasonic modulation of multiply scattered coherent light: an analytic model,” Physical Review Letters 87(4) 043903-(1-4) (Jul. 23, 2001). |
Wang, L. V.; “Prospects of photoacoustic tomography,” Medical Physics 35(12), Nov. 19, 2008, pp. 5758-5767. |
Wang, L., et al., “Single-cell label-free photoacoustic flowoxigraphy in vivo,” Proceedings of the National Academy of Sciences 110(15) 5759-5764 (Apr. 9, 2013). |
Wang, L., et al., “Ultrasonically encoded photoacoustic flowgraphy in biological tissue,” Physical Review Letters 111 204301 (Nov. 15, 2013). |
Wang, L.V., Hu, S. “Photoacoustic Tomography: in vivo imaging from organelles to organs,” Science 335, 1458-1462 (Mar. 23, 2012). |
Wang, X. D., et al., “Noninvasive laser-induced photoacoustic tomography for structural and functional in vivo imaging of the brain,” Nature Biotechnology 21(7) 803-806 (Jul. 2003). |
Wang, et al., “MCMT—Monte Carlo modeling of light transport in multi-layered tissues” Computer Methods and Programs in Biomedicine, vol. 47, No. 2, Jul. 1995, pp. 131-146. |
Wang et al., “Three-dimensional laser-induced photoacoustic tomography of mouse brain with the skin and skull intact,” Optics Letters, 28(19): 1739-1741 (2003). |
Wang et al., “Noninvasive photoacoustic angiography of animal brains in vivo with near-infrared light and an optical contrast agent” Optics Letters, 29(7): 730-732 (2004). |
Wang, et al., “Intravascular Photoacoustic Imaging” IEEE J Quantum Electronics, 16(3): 588-599 (2010). |
Wetzel, et al., “Imaging molecular chemistry with infrared microscopy,” Science, New Series, vol. 285, No. 5431, Aug. 20, 1999, pp. 1224-1225. |
Wong, T. et al., “Fast label-free multilayered histology-like imaging of human breast cancer by photoacoustic microscopy,” Sci. Adv. 3, 1602168 (May 17, 2017). |
Wong, T. et al., “Label-free automated three-dimensional imaging of whole organ by microtomy-assisted photoacoustic microscopy,” Nat. Comm. 8, (Nov. 9, 2017). |
Wu, Z., et al., “A microrobotic system guided by photoacoustic computed tomography for targeted navigation in intestines in vivo,” Science Robotics 4(32) eaax0613 (Jul. 24, 2019). |
Xia, J., et al., “Photoacoustic tomography: principles and advances,” Electromagn. Waves 147, 1 (2014; available in PMC Jan. 30, 2015). |
Xia, J., et al., “Wide-field two-dimensional multifocal optical-resolution photoacoustic-computed microscopy,” Opt. Lett. 38(24), 5236-5239 (Dec. 15, 2013). |
Xu, et al., “Photoacoustic Imaging in Biomedicine,” Review of Scientific Instruments, American Institute of Physics, vol. 77 (2006) pp. 041101 1-22. |
Xu, M. H.; Wang, L. V.; “Time-domain reconstruction for thermoacoustic tomography in a spherical geometry,” IEEE Transactions on Medical Imaging 21(7) 814-822 (Jul. 2002). |
Xu, M. H.; Wang, L. V.; “Universal back-projection algorithm for photoacoustic computed tomography,” Physical Review E 71(1) 016706-(1-7) (Jan. 19, 2005). |
Xu, S., et al., “Thermal expansion of confined water,” Langmuir 25, 5076-5083 (2009). |
Xu, X. et al., “Time-reversed ultrasonically encoded optical focusing into scattering media,” Nature Photonics 5(3) 154-157 (Jan. 16, 2011). |
Xu, Y.; Wang, L. V.; “Time reversal and its application to tomography with diffracting sources,” Physical Review Letters 92(3) 033902-(1-4) (Jan. 23, 2004). |
Xu et al . . . “Time Reversal Ultrasound Modulated Optical Tomography Using a BSO Phase Conjugate Mirror,” poster presented at SIPE Conference 7177 on Jan. 26, 2009 (1 page). |
Yadlowsky, et al., “Multiple scattering in optical coherence microscopy” Applied Optics, vol. 34, No. 25 (1995) pp. 5699-5707. <doi.org/10.1364/AO.34.005699>. |
Yang, “Optical coherence and Doppler tomography for monitoring tissue changes induced by laser thermal therapy—An in vivo feasibility study” Review of Scientific Instruments , vol. 74, No. 1, Jan. 2003, p. 437-440. |
Yang, J. M. et al., “Simultaneous functional photoacoustic and ultrasonic endoscopy of internal organs in vivo,” Nature Medicine 18(8) 1297-1303 (Aug. 2012). |
Yang, J., et al., “Motionless volumetric photoacoustic microscopy with spatially invariant resolution,” Nature Communications 8(1) 780 (Oct. 3, 2017). |
Yang, et al., “Novel biomedical imaging that combines intravascular ultrasound (IVUS) and optical coherence tomography (OCT)” IEEE International Ultrasonics Symposium, Beijing, China, Nov. 2-5, 2008, pp. 1769-1772. |
Yang, et al., “Time-reversed ultrasonically encoded optical focusing using two ultrasonic transducers for improved ultrasonic axial resolution” Journal of Biomedical Optics 18(11), 110502 (Nov. 2013) pp. 110502-1-110502-4. |
Yao, et al., “Monte Carlo simulation of an optical coherence tomography signal in homogeneous turbid media” Phys. Med. Biol. 44(9), Jul. 8, 1999, pp. 2307-2320. |
Yao, et al., “Absolute photoacoustic thermometry in deep tissue,” Opt. Lett. 38, 5228-5231 (2013). |
Yao, et al., “In vivo label-free photoacoustic microscopy of cell nuclei by excitation of DNA and RNA,” Opt. Lett. 35, 4139-4141 (2010). |
Yao, et al., “Optimal ultraviolet wavelength for in vivo photoacoustic imaging of cell nuclei,” J Biomed. Opt. 17, 056004 (2012). |
Yao, et al., “Photoimprint photoacoustic microscopy for three-dimensional label-free sub-diffraction imaging,” Physical Review Letters 112(1) 014302 (Jan. 10, 2014). |
Yao, L. et al., “Multiscale photoacoustic tomography using reversibly switchable bacterial phytochrome as near-infrared photochromic probe,” Nature Methods 13(1) 67-73 (Jan. 2016). |
Yao, L. et al., “High-speed label-free functional photoacoustic microscopy of mouse brain in action,” Nat. Methods 12(5), 407-410 (May 12, 2015). |
Yao, L. et al., “Photoacoustic microscopy: superdepth, superresolution, and superb contrast”, IEEE Pulse 6, 34-7 (May 13, 2015). |
Yaqoob, et al., “Methods and application areas of endoscopic optical coherence tomography” Journal of Biomedical Optics, 11(6): 063001.1-063001.19 (2006). |
Yavuz, M. S., et al., “Gold nanocages covered by smart polymers for controlled release with near-infrared light,” Nature Materials 8(12) 935-939 (Nov. 1, 2009). |
Yodh et al., “Functional Imaging with Diffusing Light” Biomedical Photonics Handbook, 2003, Ch. 21 , pp. 45, CRC Press, Boca Raton. |
Yodh, et al. “Spectroscopy and Imaging with Diffusing Light” Physics Today 48(3), Mar. 1995, pp. 34-40. |
Zeff, et al., “Retinotopic mapping of adult human visual cortex with high-density diffuse optical tomography” PNAS, vol. 104, No. 29, Jul. 17, 2007, pp. 12169-12174. |
Zemp, et al., “Realtime photoacoustic microscopy in vivo with a 30MHZ ultrasonic array transducer” Optics Express, 16(11): 7915-7928 (2008). |
Zhang, C., et al., “Coherent Raman scattering microscopy in biology and medicine,” Annu. Rev. Biomed. Eng. 17, 415-445 (2015). |
Zhang, D. et al., “Depth-resolved mid-infrared photothermal imaging of living cells and organisms with submicrometer spatial resolution,” Sci. Adv. 2, el600521 (2016). |
Zhang, H. F. et al., “Functional photoacoustic microscopy for high-resolution and noninvasive in vivo imaging,” Nature Biotechnology 24(7) 848-851 (Jul. 2006). |
Zhang, H. F. et al., “In vivo imaging of subcutaneous structures using functional photoacoustic microscopy,” Nature Protocols 2(4) 797-804 (Apr. 5, 2007). |
Zhang, et al., “Intrinsic Functional Relations Between Human Cerebral Cortex and Thalamus” Journal of Neurophysiology, vol. 100, No. 4, Oct. 2008, pp. 1740-1748. |
Zharov, et al., “In vivo photoacoustic flow cytometry for monitor of circulating single cancer cells and contrast agents,” Optics Letters, 31(24): 3623-3625 (2006). |
Zou, et al., “BOLD responses to visual stimulation in survivors of childhood cancer” NeuroImage, vol. 24, No. 1, Jan. 1, 2005, pp. 61-69. |
Imai, et al., “High-throughput ultraviolet photoacoustic microscopy with multifocal excitation,” J. Biomed. Opt. 23(3), (2018) pp. 036007-1-036007-6. <doi: 10.1117/1.JBO.23.3.036007>. |
Liu, et al., “Label-free cell nuclear imaging by Grüneisen relaxation photoacoustic microscopy” Opt Lett. Feb. 15, 2018; 43(4), (2018) pp. 947-950. |
Velasco, E., “Ultrafast Camera Takes 1 Trillion Frames Per Second of Transparent Objects and Phenomena” [Webpage] Caltech, California Institute of Technology, Jan. 17, 2020, pp. 1-2. <URL:https://www.eurekalert.org/pub_releases/2020-01/ciot-uct012120.php>. |
Gao, et al., “A review of snapshot multidimensional optical imaging: measuring photon tags in parallel” Phys Rep. 616, Feb. 29, 2016, pp. 1-37. <doi:10.1016/j.physrep.2015.12.004>. |
U.S. Appl. No. 16/798,204, filed Feb. 21, 2020, Wang et al. |
U.S. Appl. No. 16/806,796, filed Mar. 2, 2020, Wang et al. |
U.S. Appl. No. 16/946,496, filed Jun. 24, 2020, Gao et al. |
Notice of Allowance dated Oct. 28, 2020 issued in U.S. Appl. No. 15/037,468. |
Notice of Allowance dated Jun. 23, 2021 issued in U.S. Appl. No. 15/037,468. |
Office Action dated Oct. 3, 2018 issued in U.S. Appl. No. 14/436,581. |
Notice of Allowance dated Jan. 26, 2021 issued in U.S. Appl. No. 14/436,581. |
Notice of Allowance dated Dec. 5, 2014 issued in U.S. Appl. No. 13/369,558. |
Office Action dated Apr. 21, 2017 issued in U.S. Appl. No. 14/639,676. |
Final Office Action dated Nov. 15, 2017 issued in U.S. Appl. No. 14/639,676. |
Office Action dated May 31, 2018 issued in U.S. Appl. No. 14/639,676. |
Notice of Allowance dated Dec. 12, 2018 issued in U.S. Appl. No. 14/639,676. |
Office Action dated Feb. 28, 2020 issued in U.S. Appl. No. 16/372,597. |
Office Action dated Aug. 19, 2019 issued in U.S. Appl. No. 16/372,597. |
Office Action dated Oct. 8, 2020 issued in U.S. Appl. No. 16/372,597. |
Notice of Allowance dated Feb. 2, 2021 issued in U.S. Appl. No. 16/372,597. |
International Preliminary Report on Patentability dated Feb. 25, 2021, issued in Application No. PCT/US2019/046574. |
International Preliminary Report on Patentability dated Mar. 18, 2021, issued in Application No. PCT/US2019/049594. |
International Search Report and Written Opinion dated Aug. 31, 2020, issued in Application No. PCT/US2020/019368. |
International Preliminary Report on Patentability dated Sep. 2, 2021, issued in Application No. PCT/US2020/019368. |
International Search Report and Written Opinion dated Oct. 14, 2020, issued in Application No. PCT/US2020/07174. |
International Search Report and Written Opinion dated Aug. 9, 2018 issued in Application No. PCT/US2018/032007. |
International Preliminary Report on Patentability dated Nov. 12, 2019 issued in PCT/US2018/032007. |
International Search Report and Written Opinion dated Mar. 2, 2021 issued in PCT/US2020/059214. |
Abdelmohsen, et al., “Micro- and nano-motors for biomedical applications,” J. Mater. Chem. B 2, (2014) pp. 2395-2408. |
Alomair, et al., “In vivo high angular resolution diffusion-weighted imaging of mouse brain at 16.4 Tesla,” PLoS One 10, Jun. 25, 2015, e0130133, pp. 1-17. |
Arridge, et al., “Accelerated high-resolution photoacoustic tomography via compressed sensing,” ArXiv Prepr. ArXiv160500133, 2016, pp. 8908-8940. |
Baheiraei, et al., “Investigation of magnesium incorporation within gelatin/calcium phosphate nanocomposite scaffold for bone tissue engineering,” Int. J. Appl. Ceram. Technol. 12, (2015) pp. 245-253. |
Bansil, et al., “The biology of mucus: Composition, synthesis and organization” Adv. Drug Deliv. Rev. 124, (2018) pp. 3-15. |
Bellinger, et al., “Oral, ultra-long-lasting drug delivery: Application toward malaria elimination goals” Sci Transl. Med. 8(365), Nov. 16, 2016, 365ra157, pp. 1-25. <doi:10.1126/scitranslmed.aag2374>. |
Brenner, et al., “Computed Tomography—An Increasing Source of Radiation Exposure” N. Engl. J. Med 357;22, Nov. 29, 2007, pp. 2277-2284. |
Celli, J. P., et al., “Helicobacter pylori moves through mucus by reducing mucin viscoelasticity,” Proc. Natl. Acad. Sci. U. S. A. 106, (2009) pp. 14321-14326. |
Chourasia, et al., “Design and Development of Multiparticulate System for Targeted Drug Delivery to Colon,” Drug Delivery, 11:3, (2004) pp. 201-207. |
Cox, et al., “Artifact trapping during time reversal photoacoustic imaging for acoustically heterogeneous media,” IEEE Trans. Med. Imaging, vol. 29, No. 2, (2010) pp. 387-396. |
Cui, Y., et al. “Transferring-conjugated magnetic silica PLGA nanoparticles loaded with doxorubicin and paclitaxel for brain glioma treatment,” Biomaterials 34, (2013) pp. 8511-8520. |
De Avila, et al., “Micromotor-enabled active drug delivery for in vivo treatment of stomach infection” Nat. Commun. 8: 272, (2017) pp. 1-9. |
De Zerda, et al., “Family of enhanced photoacoustic imaging agents for high-sensitivity and multiplexing studies in living mice,” ACS Nano 6(6), Jun. 26, 2012, pp. 4694-4701. |
Deán-Ben, et al., “Functional optoacoustic neuro-tomography for scalable whole-brain monitoring of calcium indicators,” Light Sci. Appl., vol. 5, No. 12, p. el6201, 2016, pp. 1-7. |
Deáan-Ben, et al., “Portable spherical array probe for volumetric real-time optoacoustic imaging at centimeter-scale depths,” Opt. Express, vol. 21, No. 23, 2013, pp. 28062-28071. |
Deserno, M., “How to generate equidistributed points on the surface of a sphere,” Polym. Ed, p. 99, 2004, p. 1. |
Eghtedari, et al., “High Sensitivity of In Vivo Detection of Gold Nanorods Using a Laser Optoacoustic Imaging System,” Nano Letters, vol. 7, No. 7, 2007, pp. 1914-1918. |
Fan, et al., “Sub-Cellular Resolution Delivery of a Cytokine via Precisely Manipulated Nanowires” Nat. Nanotechnol. 5(7), Jul. 2010, 545-551. <doi:10.1038/nnano.2010.104>. |
Gaihre, et al., “Gelatin-coated magnetic iron oxide nanoparticles as carrier system: Drug loading and in vitro drug release study,” Int. J. Pharm. 365, (2009) pp. 180-189. |
Gao, et al., “Artificial micromotors in the mouse's stomach: A step toward in vivo use of synthetic motors,”ACS Nano 9, (2015) pp. 117-123. |
Guo, et al., “CsxWO3 nanorods coated with polyelectrolyte multilayers as a multifunctional nanomaterial for bimodal imaging-guided photothermal/photodynamic cancer treatment,” Adv. Mater. 29, 1604157 (2017). |
Han, Y. et al., “Three-dimensional optoacoustic reconstruction using fast sparse representation,” Opt. Lett., vol. 42, No. 5, (2017) pp. 979-982. |
Han, et al., “Optoacoustic image reconstruction and system analysis for finite-aperture detectors under the wavelet-packet framework,” J. Biomed. Opt., vol. 21, No. 1, Jan. 2016, pp. 016002-1-016002-9. |
Hong, et al., “Simple Method to Produce Janus Colloidal Particles in Large Quantity” Langmuir 22, (2006) pp. 9495-9499. |
Hu, C., et al., “Soft Micro- and Nanorobotics,” Annu. Rev. Control. Robot. Auton. Syst. 1, (2018) pp. 53-75. |
Hu, W., et al., “Small-scale soft-bodied robot with multimodal locomotion,” Nature 554, 81-85, (2018). |
Huang, et al., “Full-wave iterative image reconstruction in photoacoustic tomography with acoustically inhomogeneous media,” IEEE Trans. Med. Imaging, vol. 32, No. 6, Jun. 2013, pp. 1097-1110. |
Ji, T. et al. “Preparation, Characterization, and Application of Au-Shell/Polystyrene Beads and Au-hell/Magnetic Beads” Adv. Mater. 13(16), Aug. 2001, pp. 1253-1256. |
Karshalev, E. et al., “Micromotor Pills as a Dynamic Oral Delivery Platform” American Chemical Society Nano, 2018, vol. 12, No. 8, pp. 8397-8405 <DOI: 10.1021/acsnano.8b03760>. |
Kirch, J., et al., “Optical tweezers reveal relationship between microstructure and nanoparticle penetration of pulmonary mucus,” Proc. Natl. Acad. Sci. 109, (2012) pp. 18355-18360. |
Koziolek, et al., “Navigating the human gastrointestinal tract for oral drug delivery: Uncharted waters and new frontiers,” Adv. Drug Delivery Rev. 101, (2016) pp. 75-88. |
R. A. Kruger, et al., “Dedicated 3D photoacoustic breast imaging,” Med. Phys., vol. 40, No. 11, 2013, pp. 113301-1-113301-8. |
Kruger, et al., “Thermoacoustic CT: imaging principles,” Proc. SPIE 3916, (2000) pp. 150-160. |
Kuppusami, S. et al., “Parylene Coatings in Medical Devices and Implants: A Review” Universal Journal of Biomedical Engineering, 2015, vol. 3, No. 2, pp. 9-14 <DOI: 10.13189/ujbe.2015.030201>. |
Lai, S. et al., “Mucus-penetrating nanoparticles for drug and gene delivery to mucosal tissues,” Adv. Drug Deliv. Rev. 61(2), Feb. 27, 2009, pp. 158-171. <doi:10.1016/j.addr.2008.11.002>. |
Lai, P. et al., “Dependence of optical scattering from Intralipid in gelatin-gel based tissue-mimicking phantoms on mixing temperature and time” Journal of Biomedical Optics, vol. 19, No. 3, Mar. 2014, pp. 035002-1-035002-6. |
Leal, et al., “Physicochemical properties of mucus and their impact on transmucosal drug delivery,” Int. J. Pharm. 532, (2017) pp. 555-572. |
Li, et al., “An Enteric Micromotor Can Selectively Position and Spontaneously Propel in the Gastrointestinal Tract,” ACS Nano. 10(10), Oct. 25, 2016, pp. 9536-9542. <doi:10.1021/acsnano.6b04795>. |
Li, et al., “Autonomous Collision-Free Navigation of Microvehicles in Complex and Dynamically Changing Environments” ACS Nano, 11, (2017) pp. 9268-9275. |
Li, J. et al., “Micromotors Spontaneously Neutralize Gastric Acid for pH-Responsive Payload Release” Angewandte Chemie International Edition, vol. 5 6, No. 8, 2017, pp. 2156-2161. <DOI: 10.1002/anie.201611774>. |
Li, J. et al., “Micro/Nanorobots for Biomedicine: Delivery, Surgery, Sensing, and Detoxification” Sci Robot, 2(4), Mar. 15, 2017, pp. 1-20. <doi:10.1126/scirobotics.aam6431>. |
Matthews, et al., “Parameterized Joint Reconstruction of the Initial Pressure and Sound Speed Distributions for Photoacoustic Computed Tomography,” SIAM J. Imaging Sci., vol. 11, No. 2, (2018) pp. 1560-1588. |
Matsumoto, et al., “Label-free photoacoustic imaging of human palmar vessels: a structural morphological analysis,” Sci. Rep., vol. 8, No. 1, (2018) p. 786. |
Medina-Sanchez, et al., “Medical microbots need better imaging and control,” Nature 545, (2017) pp. 406-408. |
Mitsuhashi, et al., “A forward-adjoint operator pair based on the elastic wave equation for use in transcranial photoacoustic computed tomography,” SIAM J. Imaging Sci., vol. 10, No. 4, 2017, pp. 2022-2048. |
Mitsuhashi, et al., “Investigation of the far-field approximation for modeling a transducer's spatial impulse response in photoacoustic computed tomography,” Photoacoustics, vol. 2, No. 1, 2014, pp. 21-32. |
Ntziachristos, V., “Going deeper than microscopy: the optical imaging frontier in biology” Nature Methods vol. 7, No. 8, Aug. 2010, pp. 603-614. |
Ogunlade, et al., “In vivo three-dimensional photoacoustic imaging of the renal vasculature in preclinical rodent models,” Am. J. Physiol.-Ren. Physiol., vol. 314, No. 6, (2018) pp. F1145-F1153. |
Paxton, et al., “Catalytic nanomotors: Autonomous movement of striped nanorods,” J. Am. Chem. Soc. 126, 13424-13431 (2004). |
Pramanik, M., “Improving tangential resolution with a modified delayand-sum reconstruction algorithm in photoacoustic and thermoacoustic tomography,” JOSA A, vol. 31, No. 3, (2014) pp. 621-627. |
Razansky, et al., “Multispectral opto-acoustic tomography of deep-seated fluorescent proteins in vivo,” Nature Photonics 3, (2009) pp. 412-417. |
Rosenblum, et al., “Progress and challenges towards targeted delivery of cancer therapeutics” Nat. Commun. 9, (2018) 1410, pp. 1-12. |
Sanchez, et al., “Chemically powered micro- and nanomotors,” Angew. Chem. Int. Ed. 54, (2015) pp. 1414-1444. |
Schambach, et al., “Application of micro-CT in small animal imaging” Methods, vol. 50, No. 1, Jan. 2010, pp. 2-13. |
Scholte, et al., “On spatial sampling and aliasing in acoustic imaging” 12th Intern. congress on sound and vibration, Lisbon, Portugal (2005) pp. 1-8. |
Schoeder, et al., “Optoacoustic image reconstruction: the full inverse problem with variable bases,” Proc. R. Soc. A, vol. 474, No. 2219, (2018) pp. 1-20. |
Servant, et al., “Controlled In Vivo Swimming of a Swarm of Bacteria-Like Microrobotic Flagella” Advanced Materials 27, (2015) pp. 2981-2988. |
Sezer, et al., “Review of magnesium-based biomaterials and their applications,” J. Magnesium Alloys 6, (2018) pp. 23-43. |
Sitti, M., “Miniature soft robots—road to the clinic,” Nat. Rev. Mater, 3, (2018) pp. 74-75. |
Smith, et al., “Beyond C, H, O, and Ni analysis of the elemental composition of U.S. FDA approved drug architectures,” J. Med. Chem. 57, pp. 9764-9773 (2014). |
Soppimath, et al., “Microspheres as floating drug-delivery systems to increase gastric retention of drugs” Drug Metab. Rev. 33, (2001) pp. 149-160. |
Tay, et al., “Magnetic Particle Imaging Guided Heating In Vivo using Gradient Fields For Arbitrary Localization of Magnetic Hyperthermia Therapy” ACS Nano. 12(4), Apr. 24, 2018, pp. 3699-3713. <doi:10.1021/acsnano.8b00893>. |
Treeby, et al., “k-Wave: MATLAB toolbox for the simulation and reconstruction of photoacoustic wave fields,” J. Biomed. Opt., vol. 15, No. 2, Mar.-Apr. 2010, pp. 021314. |
Treeby, et al., “Advanced photoacoustic image reconstruction using the k-Wave toolbox,” in Photons Plus Ultrasound: Imaging and Sensing 2016, 2016, vol. 9708, p. 97082P. |
Tu, et al., “Self-propelled supramolecular nanomotors with temperature-responsive speed regulation,” Nat. Chem. 9, 480 (2016). |
Tzoumas, et al., “Eigenspectra optoacoustic tomography achieves quantitative blood oxygenation imaging deep in tissues,” Nat. Commun., vol. 7, 2016, pp. 1-10. |
Vilela, et al., “Medical imaging for the tracking of micromotors,” ACS Nano 12, (2018) pp. 1220-1227. |
Wang et al., “Biomedical optics: principles and imaging,” Section 12.5; Photoacoustic Tomography, John Wiley & Sons (2012) pp. 288-290. |
Wang, et al., “Fabrication of micro/nanoscale motors” Chem. Rev. 115, (2015) pp. 8704-8735. |
Wang, B. et al., “Recent progress on micro- and nano-robots: towards in vivo tracking and localization” Quantitative Imaging in Medicine and Surgery, 2018, vol. 8, No. 5, pp. 461-479. <DOI: 10.21037/qims.2018.06.07>. |
Wang, et al., “Nano/microscale motors: biomedical opportunities and challenges,” ACS Nano 6, (2012) pp. 5745-5751. |
Wang, K. et al., “Investigation of iterative image reconstruction in three-dimensional optoacoustic tomography,” Phys. Med. Biol., vol. 57, No. 17, 2012, p. 5399-5423. |
Wu, D., et al., “In vivo Mapping of Macroscopic Neuronal Projections in the Mouse Hippocampus using High-resolution Diffusion MRI,” Neuroimage 125, Jan. 15, 2016, pp. 84-93. |
Xu, et al., “Exact frequency-domain reconstruction for thermoacoustic tomography—II: Cylindrical geometry,” IEEE Trans. Med. Imaging, vol. 21, No. 7, (2002) pp. 829-833. |
Xu, et al., “Rhesus monkey brain imaging through intact skull with thermoacoustic tomography,” IEEE Trans. Ultrason. Ferroelectr. Freq. Control, vol. 53, No. 3, Mar. 2006, pp. 542-548. |
Yan, et al., “Multifunctional biohybrid magnetite microrobots for imaging-guided therapy” Yan et al., Sci. Robot. 2, eaaq1155, Nov. 22, 2017, pp. 1-14. |
Yang, et al., “The grand challenges of science robotics,” Science Robotics 3, Jan. 31, 2018, eaar7650, pp. 1-14. |
Yang, J.M., et al., “Focusing light inside live tissue using reversibly switchable bacterial phytochrome as a genetically encoded photochromic guide star” Science Advances 5(12) (2019) pp. 1-9. |
Yin, et al., “Agarose particle-templated porous bacterial cellulose and its application in cartilage growth in vitro” Acta Biomater. 12, Jan. 2015, pp. 129-138. <doi:10.1016/j.actbio.2014.10.019>. |
Zhou, et al., “Tutorial on photoacoustic tomography,” J. Biomed. Opt., vol. 21, No. 6, Jun. 2016, pp. 061007-1-061007-14. |
Duan, T. et al., “Hybrid Multi-wavelength Photoacoustic Imaging”, 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Jul. 18, 2018, pp. 4804-4807. |
EP Office Action dated May 11, 2022, in Application No. EP19849860.2. |
Extended European Search Report dated Apr. 22, 2022, in Application No. 19849860.2. |
Extended European search report dated May 23, 2022, in Application No. EP19857631.6. |
International Preliminary Report on Patentability dated Jan. 6, 2022 in PCT Application No. PCT/US2020/070174. |
International Preliminary Report on Patentability dated May 19, 2022, in PCT Application No. PCT/US2020/059214. |
Li, Y. et al., “Multifocal Photoacoustic Microscopy Using a Single-element Ultrasonic Transducer Through an Ergodic Relay”, Light: Science & Applications, Jul. 31, 2020, vol. 9, No. 135, pp. 1-7. |
Notice of Allowance dated Jan. 5, 2022 issued in U.S. Appl. No. 16/540,936. |
U.S. Corrected Notice of Allowance dated Apr. 27, 2022 in U.S. Appl. No. 16/540,936. |
U.S. Corrected Notice of Allowance dated Jun. 2, 2022 In U.S. Appl. No. 16/806,796. |
U.S. Ex Parte Quayle Action dated Dec. 13, 2021 in U.S. Appl. No. 16/611,939. |
U.S. Non-Final Office Action dated May 2, 2022 in U.S. Appl. No. 16/798,204. |
U.S Notice of Allowance dated Apr. 19, 2022 in U.S. Appl. No. 16/540,936. |
U.S. Notice of Allowance dated Aug. 5, 2022 in U.S. Appl. No. 16/540,936. |
U.S. Notice of Allowance dated Feb. 23, 2022 in U.S. Appl. No. 16/806,796. |
Yao, J. et al., “Double-illumination Photoacoustic Microscopy”, Optics Letters, Feb. 15, 2012, vol. 37, No. 4, pp. 659-661. |
U.S. Notice of Allowance dated Sep. 7, 2022 in U.S. Appl. No. 16/611,939. |
U.S. Non Final Office Action dated Aug. 26, 2022 in U.S. Appl. No. 17/302,313. |
U.S. Corrected Notice of Allowance dated Nov. 14, 2022 in U.S. Appl. No. 16/540,936. |
U.S. Non-Final office Action dated Dec. 21, 2022 in U.S. Appl. No. 17/090,752. |
U.S. Notice of Allowance dated Dec. 22, 2022 in U.S. Appl. No. 16/611,939. |
U.S. Restriction Requirement dated Dec. 15, 2022 in U.S. Appl. No. 17/302,041. |
Number | Date | Country | |
---|---|---|---|
20200073103 A1 | Mar 2020 | US |
Number | Date | Country | |
---|---|---|---|
62726860 | Sep 2018 | US |