The present disclosure relates broadly to methods and systems for distinguishing between more than one fluorescent species present in a fluorescence microscopy sample. More particularly, the disclosure relates to novel methods which may be used to enhance multiplexing capability of methods for distinguishing fluorescent species based on their spectral emissions or can be used independently thereof.
Fluorescence microscopy is widely used in biological and clinical research for high contrast imaging. Fluorescence microscopy enables the study of properties of organic and inorganic substances using fluorescence instead of, or in addition to reflection and absorption properties. Fluorescent molecules known as fluorophores will emit a particular colour of light when illuminated with a light source. The colour of light emitted by a particular fluorophore is dependent on the chemical structure of the fluorescent molecule. Different species of fluorophores are comprised of different combinations of aromatic groups, or plane or cyclic molecules with several covalent bonds. The colour of light emitted by a fluorophore upon excitation is significant because it can be used to distinguish between different fluorescent species.
In fluorescence microscopy, typically two to three types of cellular structures or proteins are each labelled using a fluorescent species having a distinct spectral emission. Combinations of different light or excitation sources together with excitation filters are employed together with various spectral emission filters to provide spectral contrast between the particular fluorescent species used to label structures or proteins in a particular experiment. Each excitation and emission filter will only transmit light of a certain colour. This enables fluorescent species which emit or absorb light of a particular colour to be distinguished. The ultimate objective of quantitative fluorescence microscopy is to provide a relative measure of the concentration or abundance of a designated or given fluorescent species at a designated or given spatial location, thereby identifying particular cellular structures or proteins in the sample.
In practice, since fluorophores emit over a finite bandwidth when excited, inevitable mixing between fluorescent channels will occur. That is, fluorescent emissions from a particular fluorescent species may contribute to the signal recorded in multiple emission channels. This phenomena referred to as spectral “bleed-through” can be significant when using more than three fluorescent species, requiring the application of unmixing algorithms to distinguish between the fluorescent species. Generally, spectral unmixing procedures are effective, however it is not possible to distinguish more fluorescent species than the number of available spectral channels.
Certain known spectral excitation and emission filter based fluorescence microscopes have at most, four excitation/emission filter combinations and are therefore equipped to spectrally separate a maximum of four fluorescent species. Achieving more than four spectral is challenging since a clear separation of fluorophore signals typically requires the respective emission filters to be separated by more than 60 nm in wavelength.
The visible colour spectrum is roughly 300 nm wide, from 400 to 700 nm. Each fluorescent species emits over roughly 30 to 40 nm. See for example,
A significant library of fluorescent markers and proteins is available for use. However, certain fluorescent species are suited to certain targets, and many laboratories develop protocols for working with some families of fluorophores and not others. For example, DAPI is commonly used to highlight cell nuclei and is not considered appropriate for highlighting other cellular structures. Accordingly, the DAPI emission spectrum (typically observed from 400 to 460 nm) is typically reserved for nucleus staining. As a result, limitations relating to the selection of fluorescent species which emit in a designated or given colour region can restrict the total number of fluorophore types that can be used in an experiment.
In light of the foregoing issues, there is a practical upper limit to the total number of fluorescent species that can be used to mark structures and/or proteins in any given experiment. Accordingly, it would be desirable to provide another parameter for distinguishing between fluorescent species.
According to an aspect of the present disclosure, there is provided a method for distinguishing between more than one fluorescent species present in a sample in fluorescence microscopy, the method including the following steps: illuminating the sample with at least one light source; recording more than two images of the illuminated sample over a period of time, each image comprising a plurality of pixels, wherein each pixel corresponds to a location in the sample and records a degree of fluorescence at the location in the sample at a particular point in time; and determining a photostability characteristic of the degree of fluorescence at each pixel over the period of time over which the more than two images were recorded; wherein the photostability characteristic of the degree of fluorescence at each pixel is used to distinguish between the more than one fluorescent species present in the sample.
That is, the method provided by the disclosure in accordance with various embodiments enables discrimination of fluorescent species based on a photostability characteristic which may relate to either a decrease or decay in photo intensity, i.e. a photostability characteristic, and/or a photo recovery characteristic, i.e. based on an increase in photo intensity.
Using the photostability characteristic of the degree of fluorescence at each pixel to distinguish between the more than one fluorescent species present in the sample may further include determining a photostability characteristic of the degree of fluorescence for each fluorescent species present in the sample.
The more than one fluorescent species present in the sample may be at least three fluorescent species. Five fluorescent species can be readily distinguished using the method of the present disclosure as demonstrated by way of various examples which are not intended to be regarded as limiting.
In certain embodiments, using the photostability characteristic of the degree of fluorescence to distinguish between the more than one fluorescent species present in the sample further includes determining an abundance of each fluorescent species present in the sample.
The abundance of each fluorescent species present at each pixel over the period of time over which the more than two images were recorded may be determined by applying an unmixing algorithm.
The unmixing algorithm may be a singular value decomposition (SVD) or a non-negative least squares algorithm (NNLS).
The photostability characteristic of the degree of fluorescence at each pixel over the period of time over which the more than two images were recorded may be determined by applying an unmixing algorithm.
The unmixing algorithm may be a non-negative matrix factorisation algorithm (NMF). In some embodiments, the unmixing algorithm is a non-increasing non-negative matrix factorisation algorithm (NI-NMF).
In certain embodiments, the sample is illuminated with radiation of a particular wavelength.
In another embodiment, the sample is illuminated by more than one light source, each light source being configured to emit radiation at a particular wavelength.
In certain embodiments, the method further includes the following steps: illuminating the sample with at least one light source; applying at least one spectral filter on an emission or excitation side of the sample; recording one image of the illuminated sample for each spectral filter, each image comprising a plurality of pixels, wherein each pixel corresponds to a location within the sample and records a degree of fluorescence at the location in the sample; and determining a degree of fluorescence at each pixel for within two or more spectral bands; wherein the degree of fluorescence at each pixel within the two or more spectral bands is used to distinguish between the more than one fluorescent species present in the sample. That is, by using two parameters to distinguish between fluorescent species, i.e. the photostability characteristic of the degree of fluorescence and the degree of fluorescence, higher fidelity results are achievable.
In one particular embodiment, two or more spectral filters are applied on the emission side of the sample, and each of the two or more spectral bands is associated with one of the two or more spectral filters.
In another embodiment, more than one light source is used to illuminate the sample and a single spectral filter is applied on the emission side of the sample, such that the two or more spectral bands are acquired by varying the light source.
According to another embodiment, there is provided a system configured to distinguish between more than one fluorescent species present in a sample in fluorescence microscopy, the system including: at least one light source configured to illuminate the sample; an image recording device configured to record more than two images of the illuminated sample over a period of time, each of the more than two images comprising a plurality of pixels, wherein each pixel corresponds to a location in the sample and records a degree of fluorescence at the location in the sample at a particular point in time; a processor configured to determine a photostability characteristic of the degree of fluorescence at each pixel over the period of time over which the more than two images were recorded; and a display configured to present to a user the relative abundance of each fluorescent species in the sample at each pixel based on the photostability characteristic of the degree of fluorescence at each pixel.
The processor may determine a photostability characteristic of the degree of fluorescence for each fluorescent species present in the sample prior to determining the photostability characteristic of the degree of fluorescence at each pixel over the period of time over which the more than two images were recorded as an indicator of the relative abundance of each fluorescent species in the sample at each pixel.
The processor may apply an unmixing algorithm to determine the relative abundance of more than one fluorescent species at each pixel.
The unmixing algorithm may be singular value decomposition (SVD) or a non-negative least squares algorithm (NNLS).
The processor may apply an unmixing algorithm to determine the photostability characteristic of the degree of fluorescence at each pixel over the period of time over which more than two images were recorded.
The unmixing algorithm may be a non-negative matrix factorisation (NMF). In some embodiments, the unmixing algorithm may be a non-increasing non-negative matrix factorisation (NI-NMF).
In certain embodiments, each light source is configured to emit radiation at a particular wavelength.
According to another embodiment, there is provided computer program code for configuring a processor to implement a method for distinguishing between more than one fluorescent species present in a sample in fluorescence microscopy, the processor being configured to: cause the sample to be illuminated with at least one light source; record more than two images of the illuminated sample over a period of time, each image comprising a plurality of pixels, wherein each pixel corresponds to a location in the sample and records a degree of fluorescence at the location in the sample at a particular point in time; and determine a photostability characteristic of the degree of fluorescence at each pixel over the period of time over which the more than two images were recorded; and generate a relative abundance map for each fluorescent species in the sample at each pixel based on the photostability characteristic of the degree of fluorescence at each pixel for display to a user.
Additional features are described in, and will be apparent from the following Detailed Description and the figures.
It will be convenient to hereinafter describe the disclosure in greater detail by reference to the accompanying figures which facilitate understanding of the method according to this disclosure. The particularity of the figures and the related description is not to be understood as superseding the generality of the broad identification of the disclosure as given in the attached claims.
Fluorescence photo bleaching is a phenomenon causing a decrease in the emission intensity of an illuminated fluorescent sample over time. The decrease in emission intensity is the result of chemical reactions between the excited fluorescent molecules and the surrounding medium. Photo bleached fluorophores are effectively irreversibly “switched off” and are no longer able to emit light. Theoretically, the emission intensity (I) of a group of fluorescent molecules decreases exponentially over time (t) according to I(t)=I(0)e−kt. The bleaching constant k depends on various experimental and environmental parameters in addition to the structure of the fluorescent molecule itself. For example, the wavelength of the illuminating light source, excitation power, oxygen concentration, and the fluorescent molecule's energy level structure will all affect its bleaching rate. As a result, spectrally identical fluorophores can have different photo bleaching rates.
Photo bleaching is an unavoidable property of fluorophores which is commonly considered to be detrimental to experimental outcomes. However, in accordance with the method and system of the present disclosure, this unfavourable property of fluorophores is exploited to distinguish between different fluorescent species.
In conventional fluorescence microscopy, only a single fluorescent species can be separated for each spectral channel observed. Observation of photo bleaching or photo recovery characteristics in accordance with aspects of the present disclosure, provides an alternative avenue of distinguishing the fluorescent species present in a sample, or in some embodiments, provides an additional dimension of observation, making it possible to at least double the number of resolvable fluorescent species within a sample when compared with observation of spectral characteristics alone. The inventor has been able to triple the number of resolvable species using the method described herein. Moreover, observation of photo bleaching and/or photo recovery behaviour enables distinction between fluorophores having substantially identical emission spectra, which is impossible using spectral information alone.
Accordingly, the present disclosure provides a way for exploiting the photo bleaching, photo recovery or photo switching (i.e. reversible photo bleaching) behaviour of fluorescent species as an identifying characteristic, which may be used separately from or in combination with spectral signatures. The term “photostability characteristic” will therefore be understood to refer to either a decrease or decay in photo intensity, i.e. a photostability characteristic, and/or a photo recovery characteristic, i.e. based on an increase in photo intensity.
In embodiments where a decay or photo bleaching characteristic is used as the photostability characteristic, the technique is referred to as “bleaching-assisted multichannel microscopy” or BAMM. In embodiments where the photo recovery or photo switching characteristic is used as the distinguishing photostability characteristic, the technique is referred to as “reverse bleaching-assisted multichannel microscopy” or Reverse BAMM.
Referring firstly to
Assuming that several fluorescent species are present in a sample, they will potentially collectively contribute to the signal collected at any given pixel. In principle, determining the relative abundance of each fluorescent species using photo bleaching can be achieved by fitting the amplitudes of a multi-exponential decay at each pixel. A wide range of computational approaches can be applied to this problem, including maximum likelihood estimation, the method of least-squares, the method of moments, the Gardner Transform, singular value decomposition (SVD), non-negative least squares algorithm (NNLS) or non-negative matrix factorisation (NNMF).
The photostability characteristic of the degree of fluorescence for each fluorescent species represented in the sample is extracted from the dataset sample itself either by a user assisted unmixing approach or via NMF. Example 1 demonstrates the user assisted approach, while the automated method using NMF is described in Examples 2 and 3. In the user assisted approached, the user has at least some knowledge about the composition of the sample and uses this knowledge to manually identify N=5 pixels as shown for example in
The least-square solution to the following equation:
where {right arrow over (I)}(x, y; z) is the (measured) intensity at pixel (x, y) and at concatenated frame index k, ai(x, y) 0 is the relative scalar abundance of fluorophore i at pixel (x, y) and {right arrow over (v)}i(k) is the 60-element spectral-bleaching fingerprint (i.e. a vector) for fluorophore type i. That is, the photostability characteristic of the degree of fluorescence for that particular fluorescent species. The non-negative prior for ai prevents the unmixed abundances from reaching non-physical negative values and improves unmixing fidelity. Its implementation requires an iterative approach.
The constrained least-squares solution to Equation (1) above yields an N-channel image. The ith image, i.e. the abundance map of fluorophore type i, is given by ai(x, y) and contains only signal from the ith fluorescent species. The image of
Although the example illustrated in
Referring now to
The proposed unmixing methods are also capable of separating spatially overlapping objects as are commonly encountered in biological samples. For example, imaging embryonic cells derived from mouse blastocysts labelled with DAPI (the cell nuclei) and AlexaFluor 594 (the bulk of the blastocyst). The signals from these two spectral emission channels were collected simultaneously by two detectors, and summed in MATLAB to produce a single channel 20-frame bleaching time lapse data set. The first frame of the monochromatic image series is shown in
Referring now to
Fluorophores are typically engineered to maximise photostability. However, many biomolecules are naturally fluorescent due to a phenomenon called auto fluorescence. In contrast to commercial dyes, such auto fluorescent molecules are not designed for photostability or multichannel imaging, and therefore will tend to have substantially overlapping spectral profiles and display a wide range of photo bleaching behaviours. The former makes them particularly hard to unmix, whilst the latter makes them suitable for identification using the method of the present disclosure.
Referring now to
Referring now to
Referring now to
The method of the present disclosure has been shown to work well with widefield and laser scanning confocal microscopes. An even illumination profile is critical for the present method since the photo bleaching rate is determined as a function of excitation intensity. Two fluorescent species located at different locations in the field-of-view may experience the same photo bleaching rate, if they are subject to different excitation intensities. This spatial variation in the photo bleaching rate has the potential to undermine the unmixing process.
If the illumination profile of the microscope is known a priori, the effect can be mitigated by adjusting the temporal binning at each pixel to compensate for the spatially dependent excitation dose. An alternative approach is to crop the field of view so that the illumination profile is uniform within a smaller region. Widefield illumination has the advantage that all fluorophores in a weakly absorbing 3D sample receive the same peak excitation dose. In a confocal microscope this is not the case as the excitation intensity is highest in the centre of the focal spot. Fluorophores above and below the focal plane accumulate the same total dose during image acquisition, but experience a smaller peak excitation power. If non-linear photo bleaching effects are large, this can cause a height dependent photo bleaching response. However, this effect is mitigated by the confocal aperture, which blocks most out-of-plane emission from reaching the detector.
In summary, the method of the present disclosure provides a novel microscopy method that employs photo bleaching as a contrast mechanism. Though photo bleaching is usually thought of as being detrimental to fluorescence microscopy, in accordance with the proposed method, this effect is exploited to extract more data from a sample. The method of the present disclosure makes use of a fundamentally different property of fluorophores (i.e. their photostability) than standard spectrally based fluorescence microscopy. As such, the method of the present disclosure can distinguish multiple fluorescent species using only a single emission channel, as well as separating spectrally identical fluorescent species. Using photo bleaching information according to some embodiments, it is possible to extract up to five fluorescent channels using only two spectral emission channels, to provide a 2.5× increase beyond what is possible using only spectral information. According to other embodiments. It is possible to extract up to three fluorescent channels using only a single spectral channel, to provide a 3× increase beyond what is possible using only spectral information.
Moreover, the use of more than two frames recorded in the time lapse recording decreases the signal to noise ratio delivering superior results to previously implemented methods. By recording more than two images during illumination of the sample with the light source to capture more data, more definitive results are obtained in which the user can have a higher degree of confidence.
Advantageously, the method of the present disclosure can be implemented using any digital fluorescence microscope, making it an attractive way to enhance the capabilities of existing microscopy suites.
The method of the present disclosure provides the distinctive advantage that it can separate spectrally identical fluorophores, provided they display variance in photostability under a designated or given set of imaging conditions.
Where the terms “comprise”, “comprises” “comprised” or “comprising” are used in this specification (including the claims), they are to be interpreted as specifying the presence of stated features, integers, steps or components referred to, but not preclude the presence of one or more other feature, integer, step, component or group thereof.
While the disclosure has been described in conjunction with a limited number of embodiments, it will be appreciated by those skilled in the art that many alternative, modifications and variations in light of the foregoing description are possible. Accordingly, the present disclosure is intended to embrace all such alternative, modifications and variations as may fall within the spirit and scope of the disclosure as disclosed.
The present application may be used as a basis or priority in respect of one or more future applications and the claims of any such future application may be directed to any one feature or combination of features that are described in the present application. Any such future application may include one or more of the following claims, which are given by way of example and are non-limiting in regard to what may be claimed in any future application.
Number | Date | Country | Kind |
---|---|---|---|
2016903051 | Aug 2016 | AU | national |
This application is a national stage application of PCT/AU2017/050816, filed on Aug. 3, 2017, which claims the benefit of and priority to Australian Patent Application No. 2016903051, filed on Aug. 3, 2016, the entire contents of which are each incorporated by reference herein.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/AU2017/050816 | 8/3/2017 | WO | 00 |