The present invention relates generally to fluorescence measurements in animals. More specifically, it relates to methods for concurrent fluorescence measurements of multiple biological parameters in mammals.
Recent strides in bioengineering of genetically encoded fluorescent indicators (GEFI) are now providing biologists with hundreds of spectrally separable sensors to monitor, in living animals, a wide range of biological phenomenon (transmembrane voltage, ions, neurotransmitters, neuromodulators, opioids, pH). To significantly advance our understanding of complex, multicellular biological systems it is critically important to decipher the precise temporal relationship of many physiological processes simultaneously.
Fiber photometry, a measurement technique that aggregates fluorescence signals using a fiber optic, is a highly pervasive approach in the field of systems neuroscience to study in vivo brain tissue dynamics during ecologically relevant behavior. A complementary technique that is becoming increasingly popular in neuroscience labs is aggregate, population level fluorescence imaging of brain dynamics in head-fixed awake animals. Recent studies have used this technique to image voltage, calcium, or neuromodulator dynamics.
However, none of the state-of-the art fiber photometry devices or 1-photon epifluorescence mesoscope systems are capable of imaging more than one biological parameter at once with low biological noise. Indeed, until now there has not been a suitable method to account for various biological artifacts while imaging two spectrally orthogonal fluorescent proteins that capture two independent biological parameters. All those limitations stifle the field from gaining new and accurate insight into the inner functioning of the brain. Accurate biological interpretation of data will be achieved if, and only if, unwanted biological artifacts are precisely monitored using a robust reference channel.
Here, we introduce a new molecular strategy that relies on long Stokes shift fluorescent compounds. We also offer two implementations of this technique, using fiber photometry and mesoscope imaging. While the former relies on a lock-in amplification technique, the latter relies on precise control over the illumination activation and imaging frame acquisition. Our molecular solution can be used with any fiber photometry systems (used in freely behaving animals) or 1-photon epifluorescence imaging techniques (used in head-fixed animals or miniscope design used in freely moving animals) to probe the dynamics of multiple molecular phenomena concurrently in live animals. In the illustrative embodiment, we reduced this idea to practice by demonstrating artifact-free fluorescent sensing of the membrane voltage dynamic of two genetically identified neuron types in awake mice, either freely behaving using a fiber photometry system or head-restrained using a mesoscope imaging system.
This strategy is universally applicable to any fluorescent reporter compounds, from genetically encoded fluorescent proteins to synthetic dyes and nanoparticles. This strategy will reduce by 50% the cost of instrumentations used for fluorescence multiplexing of dynamic processes.
In addition to use in neuroscience labs, this technique is useful in various other areas where fluorescence sensing is used (e.g., analytical chemistry, drug screening). It could also be used for assessing the biological process dynamic of patient-derived pluripotent stem cells that recapitulate the full complexity of each patient's genetic background. An additional potential application pertains to drug discovery, as fiber optic and mesoscope systems will be able to assess the potency of a pharmacological compound on a given biological process, in vitro or in vivo.
This molecular approach provides for the first time measurement of simultaneous multiple biological parameters in a freely and head-restrained behaving animal while safeguarding against instrumental and/or biological artifacts. None of the existing technologies offers the experimental flexibility to combine multiple fluorescence sensors and monitor those signals.
For studies with two biological parameters measured in the visible range, an infrared reference fluorophore does not work because of the wavelength-dependence of hemoglobin absorption and light scattering, an infrared fluorophore poorly tracked the artifacts affecting visible fluorescence. Instead, in one implementation, we combined spectrally orthogonal green and red fluorescent proteins with a long Stokes-shift fluorescent protein with an absorption spectrum overlapping that of the green GEVI and an emission spectrum overlapping that of the red GEVI. This approach allows unambiguous detection of signals from the three fluorophores with only two illumination sources and two fluorescence detection channels. Using a NIR fluorophore would have required three illumination sources and three detection channels (and all additional opto-mechanical and electronic equipment). Our strategy reduces the overall cost of the optical system by 50%. Thus, this technology provides a cost-effective method to multiplex fluorescence signals that uses a long Stokes shift fluorescent protein to reference the biological parameter under investigation. We provide a practical implementation for fiber photometry systems that have at least two illumination sources and two photodetectors (PD, APD, PMTs or camera array sensors). We also provide a practical implementation for 1-photon epifluorescence imaging systems that have at least two illumination sources and two camera array sensors.
In one aspect, the invention provides a method for concurrently measuring multiple biological parameters in an animal, the method comprising: a) illuminating using multiple illumination sources a region-of-interest of the animal that expresses a first genetically encoded fluorescent indicators (GEFI), a second GEFI, and a long-Stokes-shift (LSS) fluorescent compound that is insensitive to the multiple biological parameters, wherein an absorption spectrum of the first GEFI is distinct from an absorption spectrum of the second GEFI, wherein the illuminating excites the first GEFI, the second GEFI, and the LSS fluorescent protein, wherein an absorption spectrum of the LSS fluorescent compound overlaps the absorption spectrum of the first GEFI, wherein an emission spectrum of the LSS fluorescent protein overlaps with an emission spectrum of the second GEFI; b) concurrently detecting fluorescence signals from the first GEFI, the second GEFI, and the LSS fluorescent compound using a multi-channel fluorescence sensing optical system; and c) processing the detected fluorescence signals to determine values of the multiple biological parameters, wherein the processing reduces instrument and/or biological artifacts in the values of the multiple biological parameters.
The multiple biological parameters may comprise transmembrane potentials of different cell-types of a brain, using genetically encoded voltage indicators (GEVIs). The LSS fluorescent compound may be, for example, a genetically-encoded protein, a dye or a nanoparticle.
In some embodiments, illuminating using the multiple illumination sources comprises illuminating using two light sources that are amplitude modulated, and wherein concurrently detecting fluorescence signals uses phase-sensitive detection. In some embodiments, illuminating using the multiple illumination sources comprises illuminating using two light sources that are sequentially activated, and wherein concurrently detecting fluorescence signals uses array detectors.
In some embodiments, the processing comprises filtering instrumental and biological noise sources, for example, using linear regression, convolutional filtering, independent component analysis, or singular value decomposition.
In some embodiments, the multi-channel fluorescence sensing optical system comprises a fiber photometry system. Concurrently detecting the fluorescence signals may comprise aggregating the fluorescence signals via an optical fiber positioned in the region of interest. The fiber photometry system may comprise two illumination sources and two detectors. Concurrently detecting fluorescence signals may use phase-sensitive detection. The fiber photometry system may comprise two illumination sources and two sCMOS array detectors. The fiber photometry system may comprise two illumination sources, wherein illuminating using multiple illumination sources comprises modulating the two illumination sources at two different frequencies. The fiber photometry system may comprise APD detectors.
In some embodiments, the multi-channel fluorescence sensing optical system comprises a 1-photon epifluorescence mesoscope, and wherein concurrently detecting the fluorescence signals comprises measuring spatiotemporal dynamics of multiple signals.
In some embodiments, the multi-channel fluorescence sensing optical system comprises a microscope imaging device. The microscope imaging device may comprise two illumination sources and two sCMOS array detectors. The microscope imaging device may comprise two light sources having two different emission wavelengths, wherein illuminating using multiple illumination sources comprises modulating the two light sources in pulsed mode to emit signals interleaved in time. Illuminating using multiple illumination sources may comprise intensity modulating signals from the multiple illumination sources, wherein the microscope imaging device comprises two sCMOS cameras, wherein detecting the multiple fluorescence signals comprises operating the two sCMOS cameras in rolling shutter mode synchronized with the intensity modulated signals from the multiple illumination sources.
To enable studies that dissect how different neuron classes contribute to high-frequency oscillations and waves, here we disclose techniques based on the Transmembrane Electrical Measurement Performed Optically (TEMPO) approach which captures the aggregate, population-level voltage dynamics of specific neuron-types in behaving mammals. The motivation for such measurements is that, just as in electrophysiology, optical studies of neural population dynamics can reveal collective activity patterns that may not be discernible from single-cell activity traces.
TEMPO has four basic ingredients: (1) Use of one or more GEVIs to track voltage activity in chosen neuron-types, which may be targeted using viruses, transgenic animals, or other means of selective labeling; (2) Use of a reference fluorophore that is not voltage-sensitive to track hemodynamic, brain motion and other artifacts that impact the detection of voltage-sensitive fluorescence signals; (3) Use of a dual-color fluorescence measurement apparatus; and (4) Computational unmixing of the artifactual signals from the records of neural voltage activity.
The molecular strategy of the present invention is compatible with any dual-channel optical instrument comprising two independent pairs of light sources and detectors. We illustrate the method as embodied in two instruments: an ultrasensitive form of fiber-optic TEMPO (uSMAART) for use in freely moving animals and a TEMPO mesoscope for voltage-imaging over tissue areas in head-fixed behaving animals. Both instruments can track high-frequency neural voltage oscillations (up to ˜100 Hz) without trial-averaging. Other dual-channel optical instruments can be used, such as camera-based fiber photometry systems or one-photon miniaturized microscope for studies in freely moving animals. We also describe a method relying on convolutional filtering to unmix biological artifacts and noise from voltage signals while preserving the fidelity of photon shot noise-limited, high-frequency voltage dynamics. Other unmixing algorithms can be used, such as linear regression, independent component analysis or singular value decomposition.
The molecular strategy, implemented with uSMAART, TEMPO mesoscope, or other suitable instrument, is compatible with any genetically-encoded fluorescent indicators beyond GEVIs, such as Ca2+, neuromodulator, neuropeptide or neurotransmitter indicators. While Ca2+-related fluorescence signals usually have high dynamic range, neuromodulator and neuropeptide indicators often produce smaller signals; thus, studies with the latter should benefit greatly from the instruments and unmixing methods introduced here.
TEMPO measurements involve cell-type specific expression of one or more GEVIs, a reference fluorophore to track biological and instrumentation artifacts, a dual-channel fluorescence sensing apparatus, and analytics to unmix artifact and GEVI signals. This provides voltage-sensing and -imaging systems capable of detecting high-frequency voltage dynamics of targeted neural populations in freely moving and head-fixed behaving animals, and in real-time without trial-averaging. This yielded the first recordings of beta and gamma rhythms in genetically targeted neuron-types, opening the door to mechanistic dissections of different cell-types' contributions to the generation of these oscillations.
A key facet of our TEMPO technique is the capability for dual cell-type recordings. Studies of excitatory (E) and inhibitory (I) neurons via electrical recordings often rely on classifying cell-types by their distinct spike rates, action potential waveforms, and refractory periods. However, differentiating neural subclasses (e.g. subtypes of inhibitory cells) is usually infeasible with electrical recordings alone. Although subtype identification during extracellular electrode recordings can be done via optogenetic activation, this method neither generalizes easily to more than one cell-type at once nor reports subthreshold voltage dynamics. TEMPO measurements offer these benefits and can thereby yield unique insights.
To enable concurrent measurement of multiple cell-types, TEMPO uses a spectrally separable, non-functional fluorophore as a reference. For dual cell-type TEMPO, we created a new reference approach using a long Stokes-shift fluorophore.
The expression of the fluorophores to specific cell-types is achieved using various known methods for introducing them into target tissues, such as using viral transduction or genetically modified transgenic animals that recapitulate the labeling strategy. For example, retro-orbital injection of three PHP.eB adeno-associated viruses into PV-Cre mice enables expression of Cre-dependent ASAP3 in PV interneurons, Varnam2 in pyramidal cells, and cyOFP (a reference fluorophore) in all neuron-types. The tuning of the viral titers ensures balanced fluorescence signals.
In step 100, multiple illumination sources are used to illuminate a region-of-interest of the animal that expresses a first genetically encoded fluorescent indicators (GEFI), a second GEFI, and a long-Stokes-shift (LSS) fluorescent protein that is insensitive to the multiple biological parameters. The LSS fluorescent protein may be, for example, cyOFP. The illuminating excites the first GEFI, the second GEFI, and the LSS fluorescent protein. In step 102, fluorescence signals from the first GEFI, the second GEFI, and the LSS fluorescent protein are concurrently detected using a multi-channel fluorescence sensing optical system. In step 104, the detected fluorescence signals are processed to determine values of the multiple biological parameters. The processing reduces instrument and/or biological artifacts in the values of the multiple biological parameters.
A key feature of the approach is the selection of the absorption and emission spectra of the GEFIs and the LSS fluorescent protein. In particular, the absorption spectrum of the first GEFI is distinct from an absorption spectrum of the second GEFI, wherein an absorption spectrum of the LSS fluorescent protein overlaps the absorption spectrum of the first GEFI, wherein an emission spectrum of the LSS fluorescent protein overlaps with an emission spectrum of the second GEFI. Here, two spectra are considered distinct if the wavelengths where each spectrum exceeds 50% of its maximum intensity do not overlap. Conversely, two spectra are considered overlapping if there are any common wavelengths where both spectra exceed 50% of their respective maximum intensities. However, to further prevent cross-talk in multiplexed measurements, a more conservative threshold higher than 50% would guarantee a more precise spectral separation. As an illustration,
The method of the invention may be implemented in various types of devices. A schematic representation of a device for implementing the method of the invention is illustrated in
For illustrative purposes, we now will describe in detail two specific instruments which implement the method of the invention. In one illustrative embodiment, the method of the invention is implemented in a fiber-optic photometry apparatus, called ultra-Sensitive Measurement of Aggregate Activity in Restricted cell-Types (uSMAART). The other illustrative apparatus is a TEMPO mesoscope to image the population voltage dynamics of two neuron-types at once in head-restrained mice.
A decoherence module 204 coupled to the illumination module 200 via optical fiber 202 has illumination path optical elements that transmit the light. The decoherence module including an axicon lens to homogenize photon density and directionality, a dual static/dynamic diffuser to reduce speckle noise by dynamically diffusing the laser beam using a circular oscillation of the diffuser in x-direction and y-direction, and an FC/PC (physical contact fiber connector). The decoherence module 204 is coupled via an optical fiber 206 to a low-noise fluorescence sensing module 208 that transmits the illumination light into a mandrel wrap 210 flexible optical fiber for propagating the excitation photons into an animal 216 such as a mouse. The flexible optical fiber 210 also receives the emission photons from fluorescent indicators excited by the illumination light and transmits the emission light back to the low-noise fluorescence sensing module 208. The flexible optical fiber 210 has an autofluorescence signal of less than 10 pW, or more preferably less than 1 pW. The low-noise fluorescence sensing module 208 includes detection path optical elements, and a photodetector adapted to detect the fluorescence signal at the modulation frequency. A signal processor is electrically connected to the photodetector and is adapted to process signals indicative of the detected fluorescence signal.
The illumination module 200 includes blue and green solid state lasers modulated at distinct frequencies (50 and 75 kHz, respectively) to generate excitation light signals which pass through two Faraday isolators and are then split by 90:10 beam splitters to allow them to be individually monitored with photodiodes. The main portions of the light signals are combined in dichroic mirror (DM) to form a combined beam that is directed through a lens to couple the light into a fiber connector.
The excitation light from the illumination module enters the decoherence module 204 where it passes through an axicon lens and a free-space, dual-stage optical diffuser before it is coupled back into an optical fiber. The decoherence module breaks the coherence between light in different spatial modes, rendering the illumination pattern and power impervious to fiber motion.
The fluorescence sensing module 208 includes a pair of avalanche photodiodes (APDs), a combination of dichroic mirrors (DMs), and bandpass filters (BPFs) that reduce crosstalk between fluorescence channels. One dichroic mirror allows the excitation light to pass through the module into a mandrel wrap, while directing the sensed fluorescence light to two detectors. The fluorescence collection pathway has two spectral detection channels, and a single-band dichroic mirror and two bandpass filters to separate and steer green and red signals to two separate photodetectors.
A pair of lock-in amplifiers (LIA) were used for the two illumination paths to provide phase-sensitive demodulation. We amplitude-modulated the 488 nm and 561 nm lasers with analogue sinusoidal oscillations at 75 kHz and 50 kHz respectively, with 0 V to 4 V peak-to-peak amplitudes. One LIA is used to demodulate signals from the photodiode measuring 488 nm laser power fluctuations and from the APD measuring green fluorescence signals. The other LIA was used to demodulate signals from the photodiode measuring 561 nm laser power fluctuations and from the APD detecting the red fluorescence. Signals were demodulated using a linear-phase finite impulse response (FIR) filter, which is specifically designed for digital signal processing applications and allows low-pass filtering of signals with a frequency range that depends on the demodulation frequency. The low-pass filter used for demodulation was set to have a 0.1 ms time-constant and 48 dB/octave roll-off, enabling a measurement bandwidth of 0-500 Hz.
The raw, unfiltered data was analyzed by first applying a notch bandstop filter to remove the artifacts induced by the dynamic diffuser from the decoherence stage. We applied this filter to the voltage and reference traces. To remove the photobleaching dynamics, we then detrended the fluorescence signals by normalizing the trace by the time-varying baseline fluorescence, F0, as estimated using a temporal low-pass filter. Finally, to remove the contributions of non-voltage dependent artifacts and noise sources to the fluorescence voltage trace, we unmixed the voltage and reference channel traces using a convolutional unmixing algorithm. In dual cell-type TEMPO studies, prior to the convolutional unmixing step, we included a decrosstalking step to correct for fluorescence crosstalk between the demodulated cyOFP and Varnam2 time traces. To perform the decrosstalking, we regressed the demodulated cyOFP trace against the demodulated Varnam2 trace, using bandpass-filtered versions of both traces centered on the relevant frequency band (3rd-order Butterworth filter with cut-off frequencies set at 3-7 Hz for visual cortical studies and 5-9 Hz for hippocampal studies), which contains well-characterized voltage dynamics and is generally free of artifacts. We weighted the unfiltered Varnam2 trace by the value of the regression coefficient and subtracted the resultant from the unfiltered cyOFP trace, which was then used as one of the inputs to the convolutional filter. This fluorescence decrosstalking step ensures that the subsequent convolutional filtering algorithm does not unmix or alter the voltage signals within the Varnam2 trace.
A schematic diagram of a mesoscope apparatus is shown in
The LED illumination module 300 uses low-noise LEDs for dual-color fluorescence excitation of two GEVIs plus a reference fluorophore in the specimen. A pair of low-noise light-emitting diodes provides two-color illumination; a corresponding pair of photodiodes monitors their emission powers for synchronization with the cameras. The illumination module provides high-power, high-stability incoherent illumination across the absorption spectrum of our green and red fluorescent GEVIs. Illumination from two LEDs (UHP-T-475-SR and UHP-T-545-SR both with low-noise and detached-fan options, Prizmatix) was combined using a dichroic beam combiner (T505LPXR, Chroma) installed in a beam combiner module (Prizmatix). The combined light then passed through a dual-bandpass clean-up filter (FF01-482_563, Semrock). The illumination then reflects off a dual-band dichroic mirror (70 mm×100 mm) into the objective lens. The dual-band dichroic (488/568-Di, Alluxa) both reflects illumination from both LEDs and transmits the fluorescence. The LED illumination module 300 has two LEDs that are pulsed and used in an alternating manner. Each LED is designed to emit optical excitation signals within specific spectral bands, tailored to match the fluorescence characteristics of the specimens being studied. Preferred emission bands for these LEDs include a range of 470-500 nm (blue) and 540-560 nm (green) to excite fluorescence within the specimen. This precise band matching enhances the detection sensitivity and specificity of fluorescence signals.
The optical excitation signals generated by the LED illumination module 300 are directed through the objective lens 302. This lens focuses the excitation light onto the specimen 304, ensuring proper illumination and maximizing the efficiency and uniformity of fluorescence excitation. The objective lens 302 also collects emitted fluorescence from the specimen and channels it towards the transmission module 306. The specimen 304 is aligned with the focal plane of the objective lens. This is where fluorescence occurs upon interaction with the optical excitation signals. The properties of the specimen influence the type and intensity of the emitted fluorescence. The objective lens 302 is a low-aberration, high numerical aperture (NA) macro-objective lens that images a field-of-view (FOV) of the specimen up to 8 mm wide (˜50 mm2). Fluorescence light returns through the objective lens, passes through the dual-band dichroic mirror and into the transmission module.
The transmission module 306 plays a critical role in directing and filtering the emitted fluorescence. It includes two dichroic mirror filters that separate fluorescence emissions based on their spectral properties. The configuration ensures that specific fluorescence wavelengths are selectively transmitted toward the sensing module 308. This aids in distinguishing between different fluorescent markers in the specimen. The optical transmission module 306 for the emission path preferably includes a 550 nm short-pass dichroic mirror placed on a super-flat substrate. The short-pass dichroic mirror (70 mm×100 mm) splits the fluorescence into two detection channels.
The sensing module 308 is composed of scientific grade sCMOS cameras and tube lenses optimized for concurrently capturing fluorescence signals. After passing through the bandpass filter, fluorescence light in each channel passes through a tube lens (85 mm effective focal length) to be focused on the cameras in the sensing module. The current embodiment employs the Orca Fusion camera paired with a Canon F1.2 USM lens. The cameras within this module are equipped with additional bandpass filters matched to the emission spectrum of the fluorescent markers being detected. This ensures that only relevant fluorescence wavelengths reach the camera sensors. The bandpass filters are a 520/41 nm for Ace-mNeon and ASAP3, and a 609/62 nm for VARNAM2. With these filters, only 0.1% of the fluorescence collected from the red fluorophore (either mRuby or Varnam) enters the green fluorescence detection channel. Whereas ˜7% of the fluorescence collected from green fluorescent ASAP3 (˜9.5% for Ace-mNeon1) enters the red fluorescence detection channel. The bandpass filters in the sensing module are designed to align with the emission properties of specific fluorophores, such as cyOFP. The red channel captures fluorescence emissions from markers like cyOFP, which are routed for processing in module 310.
The processing and system control module 310 processes and analyzes the detected fluorescence signals from the cameras to produce signals representative of multiple biological parameters of the specimen. The cameras ran in external trigger mode. Each of the two sCMOS cameras (Orca Fusion; Hamamatsu) streams image frame data to respective frame grabbers. The control module produces signals to control the camera input and output triggers as well as the LED pulsing protocol.
We precisely trigger the LED pulses within the time period when all camera rows are simultaneously illuminated. For dual cell-type TEMPO mesoscope recordings, real-time TTL pulses controlled the LEDs based on the global exposure of the cameras operating in rolling shutter mode.
The control module also generates a camera trigger signal and creates an interleaved pulse sequence that matches the camera exposure precisely. To ensure uniform illumination, the signals trigger either the green or blue LED, using every other pulse from the global exposure signal provided by the camera.
The processing module 310 processes detected fluorescence signals from the sensing module 308. It acquires and processes these signals to extract relevant information about the fluorescence characteristics of the specimen. The data analysis performed by the processing module allows for the quantification and characterization of the fluorescent markers detected within the specimen.
In operation, the imaging system begins by pulsing the LED illumination module 300 to emit excitation light. The objective lens 302 directs this light to the specimen 304, where fluorescence occurs. The emitted fluorescence is collected by the objective lens 302 and transmitted through the transmission module 306. The dichroic mirror filters within the transmission module ensure the separation of fluorescence signals based on their wavelengths. The filtered fluorescence signals are captured by the sensing module 308, which uses cameras equipped with bandpass filters to isolate specific fluorescence bands. The processing module 310 then receives these detected signals and processes them to generate data, which can be used for analysis and further applications. The emission bands of the LEDs (e.g. 470-490 nm blue, 540-560 nm green) and the bandpass filters in the transmission and sensing modules are crucial for matching with the respective fluorophore's excitation and emission spectra. The use of high-sensitivity cameras (Orca Fusion) and high-aperture lenses (Canon F1.2 USM) allows for precise and efficient capture of low-light fluorescence signals. The red channel in the sensing module is specifically adapted to capture fluorescence from markers like mRuby and cyOFP, ensuring that these markers' emission spectra are effectively processed.
To track the emissions of three different fluorophores, we created a protocol based on the interleaving of illumination from the two different LEDs and our use of two spectrally distinct GEVIs plus a long Stokes-shift reference channel (cyOFP) (
In
Panel 320 represents the “2-GEVIs full exposure control” embodiment, where the system enables full control over the exposure settings of two individual cameras, Camera 1 and Camera 2. This embodiment assumes an external triggering mechanism where each frame waits for an incoming trigger signal before initiating. Camera 1 and Camera 2 have separate exposure signals labeled as Row 1 to Row n exposure, with their respective readout periods following the exposure. The exposure signals demonstrate the rolling shutter effect, where rows are exposed sequentially with some overlap during readout. The Camera 1 Trigger In and Camera 2 Trigger In signals mark the initiation of the exposure sequence for each respective camera, ensuring synchronized operation between them. Global Exposure 1 and Global Exposure 2 signals indicate periods where all rows of each respective camera are uniformly exposed. The VSYNC 1 and VSYNC 2 signals are aligned to the end of Row 1 exposure for Cameras 1 and 2, respectively. Readout signals (Readout 1 and Readout 2) correspond to the logical end of exposure for any row and indicate when data readout occurs. The LED Blue and LED Green signals are synchronized with their respective global exposure signals, alternating illumination between frames. This alternation is controlled by an FPGA module that counts the rising edges of the Global Exposure 1 signal, although other signals can be used as long as their rising edges precede the expected LED pulse initiation. Logic can be implemented in the FPGA module to reroute and generate the Trigger In signals for comprehensive control of the sequence.
Panel 322 of
Artifact removal from GEVI traces can be achieved using several algorithms designed to isolate voltage signals from reference signals or other sources of noise. These methods include: (1) Linear regression, which estimates the correlation coefficient through least-squares optimization and subtracts the reference signal, scaled by this coefficient, from the voltage trace. This process effectively minimizes shared variance, isolating voltage-specific dynamics; (2) Independent component analysis (ICA), which separates signals by minimizing mutual information between the voltage and reference channels, thereby achieving statistical independence of sources; and (3) Singular value decomposition (SVD) or Principal Component Analysis (PCA), which identifies the primary components capturing both voltage and artifact dynamics. By projecting the data onto the component corresponding to the voltage signal, this approach preserves the voltage signal while filtering out artifact contributions. Another approach uses a convolutional filtering method to unmix artifacts in a frequency-dependent manner; this approach accounts for the variable impact of different noise sources on the GEVI channel and thereby avoids adding reference channel noise into the GEVI traces. The convolutional filtering approach is designed to remove biological and instrumentation artifacts from neural voltage signals in a frequency-dependent way. The technique first estimates a linear filter that describes the frequency-dependent manner in which artifacts in the reference channel affect the GEVI channel. It then convolves this filter with the reference channel trace to obtain an estimate of the non-voltage signals in the GEVI channel. Lastly, it subtracts this estimate from the GEVI channel trace to estimate the true voltage signals. This convolutional unmixing preserves high-frequency voltage signals, and is applicable to both fiber-optic and imaging TEMPO data.
Here, we describe the algorithm for the case in which there is one GEVI. In studies with two GEVIs, we unmixed the reference channel content from each voltage channel individually. We treat the case in which one detection channel collects fluorescence from a GEVI (e.g., ASAP3 or Varnam2) and the other collects emissions from a reference fluorophore (e.g., mRuby2 or cyOFP). The data generally have 5 notable characteristics: (1) the GEVI channel contains a mixture of neural voltage-dependent and -independent signals, whereas the reference channel only contains signals of the latter type, i.e., that are independent of neural membrane potentials and thus are artifacts for the purposes of voltage imaging; (2) the biological artifacts (e.g., hemodynamics and brain motion) and instrumentation noise (e.g., illumination fluctuations) generally have intrinsic temporal frequency signatures; (3) oscillatory hemodynamic signals are generally the artifacts of the greatest magnitude and have characteristic frequencies concentrated around that of the heartbeat and its harmonics; (4) hemodynamic oscillations are present in the same frequency bands and are generally coherent between the two channels, but do not always oscillate with the same phase in the two channels; (5) the spatial distribution of hemodynamic artifacts is non-uniform across the field-of-view.
We implemented our unmixing algorithm using the assumption that the signals in the GEVI channel, G(t), are a sum of the voltage signals, V(t), plus a voltage-independent component, H(t):
Based on above observations (1-5), we formulated the problem of estimating the non-voltage signals, H(t), as a Wiener filter estimation problem in which we seek a filter, F(t) such that the convolution of the reference channel trace, R(t), with the filter, F(t), yields H(t):
Our physiological intuition for why this formulation makes sense is that H(t) predominantly arises from changes in the optical properties of the tissue, due to time-variations in oxygenated (HbO) and deoxygenated (Hb) hemoglobin content. These two forms of hemoglobin will have distinct influences on the GEVI and reference fluorescence signals, but these influences are not independent. A simplified way of depicting the dynamics relating the concentrations of Hb and HbO is to represent them as a linear dynamical system, which implies a linear dynamical relationship between R(t) and H(t) that can be represented as a convolution in the time-domain. With this framework, the main steps of the technique are as follows:
1. We split the traces from the GEVI, Gk(t), and reference channels, Rk(t), into N temporal segments of duration τ (typically 0.5-2 s) indexed by the variable k=0, 1, . . . N, and with fractional overlap 1−γ∈[0,1] (typically 0.75)
We compute the corresponding Fourier transforms gk(ω) and rk(ω):
where F{⋅} denotes a Fourier transform and w(t) is a windowing function (e.g., a Hann window).
2. We estimate the Wiener filter in the frequency domain, f(ω), by concurrently fitting a complex coefficient fk(ω) for every frequency ω to approximate the GEVI channel signal gk(w) with the reference channel signal rk(ω) for all N segments:
where r* is the complex conjugate of r and ⋅
k denotes averaging over the N segments. We limit the upper bound of the filter amplitude relative to the amplitude of the linear regression estimated at the heartbeat frequency ω0, with α>0 (typically 1.1)
If ω0 is the fundamental harmonic of the heartbeat frequency, the amplitude |f(ω0)| can be interpreted as a linear regression coefficient between the channels filtered at the heartbeat frequency. We set the spectral amplitude limit for the filter to α|f(ω0)|, thus explicitly prohibiting unbounded amplification.
3. We apply an inverse Fourier transform to find the time-domain representation of the filter F(t):
We convolve F(t) and R(t) in the time-domain to estimate the non-neuronal contribution H(t), (Eq. 2), and subtract H(t) from the GEVI signal G(t) to recover the unmixed voltage signal V(t):
The above technique can be interpreted as a rank-constrained linear regression in the frequency domain. We fit a complex-valued scaling coefficient fk(ω) for every frequency ω to simultaneously approximate the voltage channel signal gk(ω) with the reference channel signal rk(ω) for all segments, k. The rank of the regression (i.e., the number of free parameters or the number of points in the filter) is equivalent to the filter length, t, and thus inversely proportional to the spectral resolution.
We determined the appropriate segment length τ (usually 1.0-1.5 s) and optimal relative spectral limit, α (1.0-1.3) by splitting the data in half into train and test segments and minimizing the remaining signal in the test movie segment after unmixing with respect to the parameters t and a. The unmixing procedure is robust with regard to minor changes in the values of these parameters. Larger segment lengths allow for greater spectral resolution of the filter, whereas smaller segment lengths result in more robust estimation in low SNR recordings.
In some recordings, the noise floor in the reference channel was higher than that in the GEVI channel. In such recordings, unmixing would lead to masking of high-frequency signals underneath a noise floor inherited from the reference channel. Therefore, we performed a pre-filtering step that involved estimating Havg(t) using a spatially averaged reference movie, Ravg(t), and then removing Havg(t) at the single pixel level:
Then, we performed a second convolutional filtering at the single pixel level between signals in the reference channel, R(t), and those in the voltage channel, Vres(t). The pre-filtering step is reasonable because, as non-neural activity generally does not travel spatially, it boosts the SNR of Ravg(t). The suitable scale of spatial averaging depends on the relative noise levels between the two channels and was usually set to be ˜0.5-1.5 mm. Although more spatial averaging leads to improved SNR values, reduced spatial averaging allows the spatial variations of the hemodynamics to be captured at higher accuracy. Overall, compared to a simple (i.e., frequency independent) regression, this unmixing method better removed broad- and narrow-band artifacts and did not transfer noise from the reference to the GEVI channel, which was critical for detecting high-frequency activity with high sensitivity.
This application claims priority from U.S. Provisional Patent Application 63/598,081 filed Nov. 11, 2023, which is incorporated herein by reference. This application is a continuation-in-part of U.S. patent application Ser. No. 18/749,313 filed Jun. 20, 2024, which claims priority from U.S. Provisional Patent Application 63/522,044 filed Jun. 20, 2023, which are both incorporated herein by reference.
This invention was made with Government support under contract NS104590, NS107610, and NS120822 awarded by the National Institutes of Health, and under contract DBI-1707261 awarded by the National Science Foundation. The Government has certain rights in the invention.
| Number | Date | Country | |
|---|---|---|---|
| 63522044 | Jun 2023 | US | |
| 63598081 | Nov 2023 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 18749313 | Jun 2024 | US |
| Child | 18943587 | US |