The present invention relates to a method for automatically measuring the development of a microbial biofilm using a confocal imaging system and to methods for determining the effect of test chemicals on microbial gene expression and biofilm development.
Microbial biofilms consist of homogeneous or heterogeneous microbial populations adhering to surfaces or interfaces, usually embedded in an extracellular matrix of polysaccharides (Costerton et al., 1995, Annual Review of Microbiology, 41, 435-464). These biofilms can form rapidly on almost any wet surface and represent the normal mode of colonisation of microbes in the environment (Wood et al., 2000, Journal of Dental Research, 79, 21-27). Although bacteria are frequently associated with biofilm development, many microbes including fungi and algae also form biofilms.
Microbial biofilms cause widespread problems in industry, fouling machinery, clogging piping and adhering to the hulls of marine equipment and shipping. Biofilms are also a significant problem in medicine, being implicated in a large number of human infections such as dental caries, periodontitis and cystic fibrosis pneumonia (Costerton et al., 1999, Science, 284, 1318-1322). Infections arising from contamination of medical equipment are often due to bacteria present as biofilms (Gornan et al., 1994, Epidemiological Journal, 112, 551-559).
Bacteria in biofilms often display markedly different phenotypes compared to their free-swimming planktonic counterparts which can give rise to serious problems in industry and medicine. Of greatest significance is their increased tolerance to antibiotic treatment. Soukos et al. (Pharmaceutical Research, 2000, 17, 405-409) report that bacteria within biofilms can be 1500-fold less sensitive to antibiotic treatment compared to planktonic cells of the same species.
Recent research has shown that molecules, termed ‘quorum-sensing signals’, are constantly secreted by microbes and activate genes involved in the production of the extracellular matrix and biofilm formation (Chicurel, 2000, Nature, 408,284-286). Efforts have now been directed into producing molecular mimics of these naturally occurring signals to bind to the microbial receptor sites and thus control biofilm formation (Costerton & Stewart, 2001, Scientific American, July, 61-65).
The control of microbial biofilms thus poses significant challenges for many industries, including the food, health, consumer products, engineering and pharmaceutical industries. In the last decade considerable efforts have been marshalled to address this issue but attempts to discover and develop novel antimicrobial agents effective against biofilms have been hampered by a lack of a suitable screening assay. While planktonic microbes are readily amenable to high throughput screening technologies, the growth and assessment of biofilm sensitivity to inhibitors, quorum-sensing signal mimics or agonists is laborious, time consuming and beset with technical difficulties.
Any assay or method to determine the effect that an agent has upon the growth and development of a biofilm, by necessity, involves an assessment of its development and architecture. Electron microscopy has traditionally been the method of choice for studying biofilm composition and structure because of its high resolution (Listgarten, 1976, Journal of Periodontology, 47, 1-18). However, this technique is time consuming, can cause structural distortions through the preparation process and is not amenable to high throughput screening.
Many of the above problems associated with electron microscopy have been addressed by the advent of laser-scanning confocal microscopy (LSCM) which enables biofilm structure to be studied in its natural state without any requirement for dehydration, fixation or staining. The optical sectioning properties of LSCM enables very thin optical sections (approximately 0.3 μm) to be taken at increasing depths throughout the biofilm, free from out-of-focus blurring. Intrinsically fluorescent molecules (e.g. green fluorescent proteins) or fluorescently labelled probes are excited and the resulting fluorescence detected by photomultiplier tubes to produce a digital image. The digitised data can then be reassembled to provide three-dimensional (3D) information on the structure. Confocal microscopy has now been used to investigate biofilm structure (Wood et al., 2000, Journal of Dental Research 79, 21-27), physiology and biochemistry (Palmer & Stemberg, 1999, Current Opinion in Biotechnology 10, 263-268). However, such studies are time consuming and have been highly specific in nature, concentrating on only one or two specialised biofilm structures.
While LSCM provides an excellent tool for investigating biofilm morphology, structure and composition, it is not an obvious choice as a platform for high throughput screening because the imaging and data capture process is very slow. Kuehn et al. (Applied and Environmental Microbiology, 1998, 64, 4115-4127) report an ‘automated’ LSCM for analysing biofilms, the hub of the invention being a computer program for semi-automated image analysis. This system is based upon a point scan detection method and involves ‘off-line’ semi-automated image analysis requiring user input/intervention. These data capture and analytical methods, together with the use of ‘glass flow cells’ for biofilm growth, severely limit the applicability of this approach to automation and high throughput screening. Other screening methods for assessing the effects of test agents on biofilms are disclosed in U.S. Pat. No. 6,326,190, wherein a variety of methods such as colony counting and vital staining are used to determine biofilm growth. Of particular note, however, are the problems highlighted in automating any assay using confocal microscopy.
The present invention addresses the above mentioned problems associated with providing a LSCM-based method for analysing biofilm development which is amenable to automation. Furthermore, the method of the present invention can provide a platform for high throughput screening for novel modulators of biofilm growth and development. In contrast to the autofocus methods based upon image content analysis described in the literature (e.g. WO 96/01438), the present invention utilises a position sensing analysis.
WO 99/47963 discloses a ‘Confocal Microscopy Imaging System’ for identifying pharmacological agents useful for the diagnosis and treatment of disease by performing a variety of assays on cell extracts, cells or tissues of higher organisms using the line-scan confocal imaging system and associated data processing routines. The imaging system can be used to perform multi-parameter fluorescence imaging on single cells and populations in a manner that is sufficiently rapid for compound screening. The system is capable of determining the presence of fluorophores with high resolution. However, nowhere within this application is there any disclosure of the use of the system to characterise microbiological populations, to create 3D images thereof, or to analyse biofilm development. Furthermore, the image analysis algorithms described in WO 99/47963 are only suitable for analysing data from a single plane and not a plurality of planes.
The Applicants have found that confocal imaging systems, such as that described in WO 99/47963, when used in combination with the image analytical methods of the present invention, can be used to characterise biofilms and to act as a platform for high throughput screening for compounds which modulate biofilm development. The IN Cell Analyzer and its use in high throughput screening applications is reported by Goodyer et al.,2001, Society for Biomolecular Screening, 7th Annual Conference and Exhibition, Baltimore, USA Screening and signalling events in live cells using novel GFP redistribution assays.
According to a first aspect of the present invention, there is provided an automated method for measuring the development of a biofilm on a plurality of surfaces using a confocal imaging system, the confocal imaging system comprising:
Biofilms are dynamic structures which are responsive to their environment (Watnick & Kolter, 2000, Journal of Bacteriology, 182, 2675-2679). In the context of the present invention, the word ‘development’, when used in relation to a biofilm, is to be construed to describe the growth, stasis or the deterioration of the biofilm.
In a preferred embodiment, as a means for increasing speed of data acquisition:
Preferably, the method additionally comprises the step of restoring each image prior to carrying out the image analysis. Image restoration refers to the problem of recovering an image from its blurred and noisy observation for the purpose of improving its quality or obtaining information that is not readily available from the observed image. Factors influencing the spatial resolution are mainly scattering of the emitted photons and aberrations and distortions introduced by the imaging system. If the object to be imaged is small compared to the source-to-collimator distance, this degradation phenomenon may be considered to be approximately shift-invariant and, neglecting noise, can be modelled by a convolution process between the undistorted image and the transfer function of the imaging system. Many types of image restoration have been reported in the literature. For example, Wiener filter, wavelet-based regularisation, supervised deconvolution methods, iterative blind deconvolution methods, etc. For a comparison between the different methods see, for example, Lixin Shen, 2002, Journal of Electronic Inaging, 11, 5-10 or Mignotte et al., 2002, Journal of Electronic Imaging (2002), 11, 11-24.
Suitably, the beam of electromagnetic radiation produced comprises one or more wavelengths in the range of 350 to 700 nm. Preferred ranges in wavelength include 354 to 374 nm, 403 to 423 nm, 478 to 498 mn, 560 to 580 nm, 637 to 657 nm and 680 to 700 nm. Preferred wavelengths include 364 nm, 413 nm, 488 nm, 570 nm, 647 nm and 690 nm.
Suitably, the fluorescent moiety is an inherent characteristic of the microbe within the biofilm.
Preferably, the fluorescent moiety is the product of a gene that is expressed by the microbe within the biofilm. For example, the microbe may have been genetically transformed to express the gene in a constitutive or an inducible manner. More preferably, the gene may contain codons that have been altered to optimise expression of the fluorescent moiety in the microbe.
Preferably, the gene encodes a fluorescent protein. Fluorescent proteins and fluorescent protein derivatives of chromoproteins have been isolated from a wide variety of organisms, including Aequoria victoria, Anemonia species such as A. majano and A. sulcata, Renilla species, Ptilosarcus species, Discosoma species, Claularia species, Dendronephthyla species, Ricordia species, Scolymia species, Zoanthus species, Montastraea species, Heteractis species, Conylactis species and Goniopara species.
The use of Green Fluorescent Protein (GFP) derived from Aequorea victoria has revolutionised research into many cellular and molecular-biological processes. However, as the fluorescence characteristics of wild type (native) GFP (wtGFP) are not ideally suited for use as a cellular reporter, significant effort has been expended to produce variant mutated forms of GFP with properties more suitable for use as an intracellular reporter (Heim et al., 1994, Proceedings of the National Academy of Sciences (USA), 91, 12501;. Ehrig et al., 1995, FEBS Letters, 367,163-6; WO96/27675; Crameri, A. et al., 1996, Nature Biotechnology, 14, 315-9; U.S. Pat. No. 6,172,188; Cormack, B. P. et al., 1996, Gene, 173, 33-38; U.S. Pat. No. 6,194,548; U.S. Pat. No. 6,077,707 and GB Patent Application Number 0109858.1 (‘Amersham Pharmacia Biotech UK Ltd.’). Preferred embodiments disclosed in GB Patent Application No 0109858.1 comprise GFP derivatives selected from the group consisting of: F64L-V163A-E222G-GFP, F64L-S 175G-E222G-GFP, F64L-S65T-S 175G-GFP and F64L-S65T-V163A-GFP.
Preferably, the fluorescent protein is a modified GFP having one or more mutations selected from the group consisting of Y66H, Y66W, Y66F, S65T, S65A, V68L, Q69K, Q69M, S72A, T2031, E222G, V163A, I167T, S175G, F99S, M153T, V163A, F64L, Y145F, N149K, T203Y, T203Y, T203H, S202F and L236R. Most preferably, the fluorescent protein is a modified GFP having three mutations selected from the group consisting of F64L-V163A-E222G, F64L-S175G-E222G, F64L-S65T-S175G and F64L-S65T-V163.
Preferably, the fluorescent moiety is a biosensor capable of monitoring environmental change or enzyme activity within the biofilm. For example, the moiety may be a fluorescent biosensing protein that is responsive to pH changes (e.g., Llopsis et al., 1998, Proceedings of the National Academy of Sciences (USA) 95, 6803-6808) or may be sensitive to specific ion concentrations, such as calcium ions, within the biofilm.
Optionally, the fluorescent moiety is produced by the action of an enzyme on a compound. Preferably, the enzyme is selected from the group consisting of β-galactosidase, nitroreductase, alkaline phosphatase and β-lactamase. The enzyme may be inherently expressed by the micro-organism or the micro-organism may have been genetically transformed to express the enzyme in an inducible or constitutive manner.
In a preferred embodiment, the method additionally comprises adding a fluorescent compound to the biofilm before carrying out the detection step.
Preferably, the fluorescent compound is selected from the group consisting of Hoechst 33342, Cy2, Cy3, Cy5, CytoCyS, CypHer, coumarin, FITC, DAPI, Alexa 633 DRAQ5, Alexa 488, acridone, quinacrodone, fluorescently labelled protein, fluorescently labelled lectin and fluorescently labelled antibody. By ‘acridone’ and ‘quinacridone’ is meant those fluorescent compounds disclosed in WO 02/099424 and 02/099432, respectively. Optionally, unbound fluorescent compound can be removed from each container prior to carrying out the detection step.
Preferably, the fluorescent compound can be used to monitor environmental changes present throughout the biofilm. Thus, for example, the redox potential and pH of the microbial biofllm are subject to local environmental changes which can be measured using the present invention. pH sensitive dyes, such as the CyDye ‘CypHer’ (cf. Amersham Biosciences, reference PA15405), can be used to determine changes in pH within the biofilm. For example, in comparison with Cy5, CypHer has 95% fluorescence at pH 5.0 but only 5% fluorescence at pH 7.4, thereby allowing quantitative measurement of variations in local pH within the biofilm.
Optionally, the fluorescent compound can be used to measure the concentration of a chemical within or surrounding the biofilm, such as the concentration of oxygen or calcium, or of a specific protein or nucleic acid.
Preferably, the surfaces are in the form of a container. More preferably, the container is a microtitre plate. The microtitre plate may comprise 24, 96, 384 or higher densities of wells e.g. 864 or 1536 wells. Preferably the microtitre plates have a transparent base as imaging of the biofilm is conducted through the base (Gilbert et al., 2001, Journal of Applied Microbiology, 91, 248-254) Suitably, the method is capable of determining the size of microbial clusters within the biofilm by means of optically and confocally sectioning the biofilm followed by 3D volume analysis.
Suitably, the method is capable of determining the 3D structure of the biofilm by means of optically and confocally sectioning the biofilm followed by 3D volume analysis.
Suitably, the method is capable of determining the distribution of distances between microbial clusters within the biofilm by means of optically and confocally sectioning the biofilm followed by 3D volume analysis.
Suitably, the method is capable of determining the orientation of microbial clusters within the structure of the biofilm. The orientation of the clusters may be influenced by external forces such as fluid flow, gravity, electric field, etc.
Suitably, the method is capable of determining the presence of and the size of any channel within the structure of the biofilm. Such channels provide access routes for nutrients into, and exit routes for noxious waste from, the biofilm.
Thus, for example, channels can be readily identified in the biofilm structure, as can be seen from
A biofilm can be thought of as a porous medium, in which different molecules can diffuse in the network of channels between the clusters of micro-organism. It is important to be able to relate the geometrical structure of the network with the diffision properties through the network as this will give an indication of the ease with which nutrients, oxygen, antibiotic agents or other molecules can move inside the biofilm. A porous medium is a material randomly multi-connected in which channels are randomly blocked. The fraction of free space occupied by these channels is called the porosity. The Darcy permeability of the channel network is the equivalent of the conductivity of a network of resistors; it describes how easily a liquid can flow through the network. Above a value of the porosity called the critical porosity Ccr, there is a continuous path through the network and the molecules can diffuse from one end of the network to the other. If the distribution of the channels is random and the long distance correlations are negligible, the permeability follows a universal power law close to Ccr, that does not depend on the microscopic details, nature of the connections, etc. The flow of liquid through the network is linked to the permeability of the network, therefore ultimately at the global geometry of the network. In many cases, the geometry of the network can be described as a fractal and a fractal dimension can be defined for the network. At the critical value, the average mass of the channel included in a sphere of radius R is proportional to RD, with D<3. The network can thus be thought of as a porous structure that fills the 3 dimensional space less efficiently than a usual three dimensional solid and it could be said the network has a fractal dimension, which is less than the usual Euclidian dimension. In summary, determining the fractal dimension gives a description of the geometry of the network and therefore gives an indicator on the porosity of the biofilm. For more details see, for example, Gouyet, Physique et Structure Fractales, Publisher Mason, 1992, Chapter 3.
In another embodiment, the biofilm comprises optically distinguishable microbial populations. These populations may, for example, comprise the same or different microbial species which may be differentiated on the basis of different labelling patterns on treatment with a fluorescent label. Preferably, the method is capable of determining the spatial distribution of said populations.
In a further embodiment, the biofilm comprises genetically distinguishable microbial populations. These populations may comprise different strains or species; for example, the population may consist of a wild type and a genetically engineered bacterial strain that constitutively expresses GFP, or consist of two or more strains or species that express optically distinct fluorescent reporter genes in an inducible or constitutive manner. Preferably, the method is capable of determining the spatial distribution of gene expression and the populations.
According to a second aspect of the present invention, there is provided a method for screening a test agent whose effect upon the development of a biofilm is to be determined, the method comprising the steps of:
Preferably the known value is stored upon an optical or electronic database. Optionally, the value may be normalised (for example, to represent 100% development of the biofilm) and compared to the normalised development of the biofilm in the presence of the test agent. In this way, only test agents affecting biofilm development by a certain minimum amount will be selected for further evaluation.
In a third aspect of the present invention, there is provided a method for screening a test agent whose effect upon the development of a biofilm is to be determined, the method comprising the steps of:
Thus, for example, antibiotics such as tetracycline, ampicillin and chloramphenicol can be shown to differentially inhibit biofilm development (see
Preferably, the difference in the development of the biofilm in the absence and in the presence of the test agent is normalised, stored optically or electronically and compared with a value of a reference compound. Thus, for example, the difference in development may be stored as a percentage inhibition (or percentage stimulation) on an electronic database and this value compared to the corresponding value for a standard inhibitor of the biofilm in question. In this way, only test agents meeting a certain predetermined threshold (e.g. as being as effective as or more effective than the reference compound) may be selected as being of interest for further testing.
Suitably, the test agent affects gene expression within the biofilm. Preferably, the test agent affects gene expression of specific microbial populations within the biofilm.
Suitably, the test agent inhibits biofilm development.
Suitably, the test agent promotes the development of the biofilm. Such compounds would be of particular interest for industries such as the water treatment and sewage industries.
Preferably, the test agent is a physical agent selected from the group consisting of electromagnetic radiation, ionising radiation, electric field, sound energy and abrasion. Suitable forms of electromagnetic radiation would include ultra violet radiation, while suitable forms of ionising radiation would include α-, β- and γ-radiation. Abrasion would involve physically rubbing or scraping a physical entity, in the form of a mechanical object such as a brush or particulate material, against the surface of the biofilm.
Preferably, the test agent is a fluorescent compound or is a fluorescently labelled compound thereby facilitating measurement of its distribution throughout the biofilm. More preferably, the test agent is selected from the group consisting of organic compound, inorganic compound, peptide, protein, carbohydrate, lipid, nucleic acid, polynucleotide and protein nucleic acid.
According to a fourth aspect of the present invention, there is provided the use of a confocal imaging system as herein described to measure the development of a biofilm.
According to a fifth aspect of the invention there is provided a method of analysing the three dimensional structure of an object scanned using a fluorescence imaging system including:
the method comprising processing said image data to determine data relating to a three dimensional structure of the object, the method including an automated image data thresholding step, said thresholding step comprising:
The automated determination of a threshold for each of a plurality of different images enables a high throughput image analysis system for analysing three dimensional structures in image data produced by a fluorescence imaging system. This aspect in particular but not exclusively applies to biofilms. By automated thresholding on a per-image basis, or for each of a set of images taken of a biofilm in different planes, it is possible to overcome problems including: a variation in an average image intensity for different samples of the biofilm with for example, different experimental parameters such as a different dye concentration, a different laser power or a different camera exposure time; a variation in an image intensity for images of different planes of the biofilm sample due to a difference in depth of the planes within the sample; and a regional intensity variation of an image due to for example, a non uniform illumination of a sample or a non uniform variation of the sample thickness or density.
According to sixth and seventh aspects of the present invention, there is provided computer software and a data carrier storing such computer software, respectively, for carrying out the method of the invention as described herein.
The invention is further described with reference to the following drawings in which:
FIGS. 2(a) and 2(b) are, respectively, a top view and a side view of the ray path of a multicolour embodiment of the present invention, without a scanning mirror.
FIGS. 3(a) and 3(b) are, respectively, a top view and a side view of the ray path of the multicolour embodiment of the present invention with the scanning mirror.
FIGS. 5(a) to 5(c) illustrate the rectangular CCD camera and readout register.
FIGS. 9(a) and 10(a) each illustrate an image of a plane of a biofilm scanned in a different colour channel.
FIGS. 9(b) and 10(b) each illustrate an intensity histogram for the image of the plane of the biofilm of FIGS. 9(a) and 10(a).
FIGS. 9(c) and 10(c) each illustrate a binarised image of the plane of the biofilm of FIGS. 9(a), 9(b), 10(a) and 10(b).
FIGS. 16A-D represent a 3D analysis of a GFP expressing biofilm;
The present invention can image fluorescent signals from the confocal plane of biofilm cells in the presence of unbound fluorophore or in the presence of intrinsically fluorescent chemical compounds, including potential drug candidates. These assays may make use of any known fluorophore or fluorescent label including but not limited to fluorescein, rhodamine, Texas Red, Amersham Biosciences stains Cy3, Cy5, Cy5.5 and Cy7, Hoechst's nuclear stains and Coumarin stains. (cf. Haugland R. P. Handbook of Fluorescent Probes and Research Chemicals Ed., 1996, Molecular Probes, Inc., Eugene, Oreg.).
Optical Configuration
The slit mask 130 is depicted in an image plane of the optical system that is in a plane conjugate to the object plane. The illumination stripe formed by the aperture 132 in the slit mask 130 is relayed by lens 140, dichroic mirror 150 and objective lens 170 onto a microtitre plate 180 which contains a two-dimensional array of sample wells 182. For convenience of illustration, the optical elements of
In an alternative embodiment, the slit mask 130 resides in a Fourier plane of the optical system that is in a plane conjugate to the objective back focal plane (BFP) 160.
In this case the aperture 132 lies in the plane of the figure, the lens 140 relays the illumination stripe formed by the aperture 132 onto the back focal plane 160 of the objective 170 which transforms it into a line 184 in the object plane perpendicular to the plane of
In an additional alternative embodiment the slit mask 130 is removed entirely. According to this embodiment, the illumination source is the laser 110, the light from which is focused into the back focal plane 160 of the objective 170. This can be accomplished by the combination of the cylindrical lens 120 and the spherical lens 140 as shown in
An image of the sample area, for example a sample in a sample well 182, is obtained by projecting the line of illumination onto a plane within the sample, imaging the fluorescence emission therefrom onto a detector 220 and moving the plate 180 in a direction perpendicular to the line of illumination, synchronously with the reading of the detector 220. In the embodiment depicted in
The detector 220 illustratively is a camera and may be either one dimensional or two dimensional. If a one dimensional detector is used, slit mask 210 is not needed. The illumination, detection and translation procedures are continued until the prescribed area has been imaged. Mechanical motion is simplified if the sample is translated at a continuous rate. Continuous motion is most useful if the camera read-time is small compared to the exposure-time. In a preferred embodiment, the camera is read continuously. The displacement d of the sample during the combined exposure-time and read- time may be greater than or less than the width of the illumination line W, for example 0.5W≦d≦5W. All of the wells of a multiwell plate can be imaged in a similar manner.
Alternatively, the microscope can be configured to focus a line of illumination across a number of adjacent wells, limited primarily by the field-of-view of the optical system. Finally, more than one microscope can be used simultaneously. The size and shape of the illumination stripe 184 is determined by the width and length of the Fourier transform stripe in the objective lens back focal plane 160. For example, the length of the line 184 is determined by the width of the line in 160 and conversely the width in 184 is determined by the length in 160. For diffraction-limited performance, the length of the illumination stripe at 160 is chosen to overfill the objective back aperture. It will be evident to one skilled in the art that the size and shape of the illumination stripe 184 can be controlled by the combination of the focal length of the cylindrical lens 120 and the beam size at 120, that is by the effective numerical aperture in each dimension, within the restrictions imposed by aberrations in the objective, and the objective field of view.
The dimensions of the line of illumination 184 are chosen to optimise the signal to noise ratio. Consequently, they are sample dependent. Depending on the assay, the resolution may be varied between diffraction-limited and approximately 5 μm. The beam length is preferably determined by the objective field of view, exemplarily between 0.5 and 1.5 mm. A Nikon ELWD, 0.6 NA, 40× objectives, for example, has a field of view of approximately 0.75 mm. The diffraction-limited resolution for 633 nm radiation with this objective is approximately 0.6 μm, or approximately 1100 resolution elements.
The effective depth resolution is determined principally by the width of aperture 212 in slit mask 210 or the width of the one dimensional detector and the image magnification created by the combination of the objective lens 170 and lens 190. The best axial resolution of a confocal microscope approaches 1 μm. The Confocal Handbook (J. B. Pawley, Editor, Handbook of Biological Confocal Microscopy, 2nd Edition, Plenum, New York, 1995) gives several expressions for the axial resolution, dz, but two in particular are most relevant:
where λ is the wavelength of the light, NA is the numerical aperture of the microscope objective, n is the refractive index of the medium and a refers to the angle used to compute the NA. Both formulas assume ideal or zero-size pinholes. The first equation applies the Rayleigh criterion along the optic axis (this direction is generally referred to as the z-direction, while the plane perpendicular to the optic axis is the x-y plane). A microscope objective focused in air will produce a 3D diffraction-limited spot with an Airy disk cross-section at the focal point in the x-y plane and another distribution along the x-z or y-z plane. This equation best describes the axial resolution in photoluminescence imaging. The second equation is derived using paraxial (small angle) theory assuming the object being viewed is a perfect planar mirror. At low NA the first equation agrees with the second equation except for a factor of two due to specular reflection. These equations should be considered only approximations which in some circumstances will fail to predict resolutions accurately.
It is usually preferable to determine the effective depth resolution experimentally. For example, it can be done by using as a sample a fluorescent polystyrene bead with a diameter smaller than the resolution limit of the microscope. The image of the this object obtained by stepping the focal plane through the bead is therefore the image of a sub-resolution object and can be used as a definition of the Point Spread Function of the optical system. The full width at half maximum in the Z direction (axial direction) is the used as a definition of the axial resolution of the optical system.
The effective numerical aperture (“NA”) of the illumination is less than the NA of the objective. The fluorescence emission is, however, collected with the full NA of the objective lens. The width of aperture 212 must be increased so as to detect emission from the larger illumination volume. At an aperture width a few times larger than the diffraction limit, geometrical optics provides an adequate approximation for the size of the detection-volume element:
Lateral Width: ad=dd/m,
Axial Width: zd,=√2ad/tan α,
where m is the magnification, dd is the width of aperture 212 and α is the half-angle subtended by the objective 170. It is an important part of the present invention that the illumination aperture 132 or its equivalent in the embodiment having no aperture and the detection aperture 212 be independently controllable.
Multi-Wavelength Configuration
An embodiment enabling multi-wavelength fluorescence imaging is preferred for certain types of assays. It is generally advantageous and often necessary that two or more measurements be made simultaneously since one important parameter in a biological response is time.
The number of independent wavelengths or colours will depend on the specific assay being performed. In one embodiment three illumination wavelengths are used. FIGS. 2(a) and 2(b) depict the ray paths in a three-colour line- scan confocal imaging system, from a top view and a side view respectively. In general, the system comprises several sources Sn of electromagnetic radiation, collimating lenses Ln, and mirrors Mn for producing a collimated beam that is focused by cylindrical lines CL into an elongated beam at first spatial filter SF1, a confocal microscope between first spatial filter SF1, and second spatial filter SF2 and an imaging lens IL, beamsplitters DM1, and DM2 and detectors Dn for separating and detecting the different wavelength components of fluorescent radiation from the sample. Spatial filters SF1 and SF2, preferably are slit masks.
In particular,
Referring to
Herein, δλ1 will be defined to be the fluorescence emission excited by λ1. This will, in general, be a distribution of wavelengths somewhat longer than λ1, and δλ2 and δλ3 are defined analogously. DM3 preferentially reflects λn, and preferentially transmits δλn where n=1,2,3. The light transmitted by SF2 is imaged onto the detection devices, which reside in planes conjugate to the primary image plane. In
Autofocus
According to this embodiment of present invention, the sample lies in each of a plurality of planes which can be moved, by a scanning mechanism, into the object plane of an imaging system. Accordingly, the invention provides an autofocus mechanism that maintains the currently selected plane of the sample in the field-of-view of the imaging system within the object plane of that system. The precision of planarity is determined by the depth-of-field of the system. In a preferred embodiment, the depth-of-field is approximately 10 μm and the field-of-view is approximately 1 μmm2.
The autofocus system allows precise movement of the objective and thus the focal plane. The autofocus system operates with negligible delay, that is, the response time is short relative to the image acquisition-time, for example 0.01-0.1 s. In addition, the autofocus light source is independent of the illumination light sources and the sample properties. Among other advantages, this configuration permits the position of the sample carrier along the optical axis of the imaging system to be determined independent of the position of the object plane.
One embodiment of a single-beam autofocus is provided in
For use with a microtitre plate having a biofilm residing on the well bottom, the servo loop must, however, be broken to move between wells. This can result in substantial time delays because of the need to refocus each time the illumination is moved to another well.
Continuous closed-loop control of the relative position of the sample plane and the object plane is provided in a preferred embodiment of the present invention, depicted in
The beam of wavelength 5 is collimated by L5, apertured by iris I5, and focused onto the continuous surface by the lens CFL in conjunction with the objective lens OL. The reflected light is focused onto the detectors D4 and D5, by the lenses IL4 and IL5, respectively. The partially transmitting, partially reflecting mirror, DM4 is preferentially dichroic, reflecting λ4 and λ5 and transmitting λn and δλn, where n=1,2,3. The mirrors, M4, M5 and M6, are partially transmitting, partially reflecting. In the case that λ4 and λ5 are distinct, M6 is preferentially dichroic.
According to the embodiment wherein the biofilm resides in a microtitre plate, λ4 is focused onto the well bottom. The object plane can be offset from the well bottom by a variable distance. This is accomplished by adjusting L4 or alternatively by an offset adjustment in the servo control loop. For convenience of description, it will be assumed that λ4 focuses in the object plane.
The operation of the autofocus system is as follows. If the bottom of the sample well is not in the focal plane of objective lens OL, detector D4 generates an error signal that is supplied through switch SW to the Z control. The Z control controls a motor (not shown) for moving the microtitre plate toward or away from the objective lens.
Pseudo-closed loop control is provided in the preferred embodiment of single-beam autofocus which operates as follows. At the end of a scan the computer terminal operates SW to switch control to a sample-and-hold device which maintains the Z control output at a constant level while the plate is moved on to the next well after which SW is switched back to D4.
Detection Devices
A feature of the disclosed apparatus is the use of a detection device having manifold, independent detection elements in a plane conjugate to the object plane. As discussed above, line illumination is advantageous principally in applications requiring rapid imaging. The potential speed increase inherent in the parallelism of line illumination as compared to point illumination is, however, only realised if the imaging system is capable of detecting the light emitted from each point of the sample along the illumination line, simultaneously.
One embodiment uses a continuous-read line-camera, and in a preferred embodiment a rectangular CCD is used as a line-camera. Both embodiments have no dead-time between lines within an image or between images. An additional advantage of the present invention is that a larger effective field-of-view is achievable in the stage- scanning embodiment, discussed below.
The properties required of the detection device can be further clarified by considering the following preferred embodiment. The resolution limit of the objective lens is <1 μm, typically ˜0.5 μm, and the detector comprises an array of ˜1000 independent elements. Resolution, field-of-view (FOV) and image acquisition-rate are not independent variables, necessitating compromise among these performance parameters. In general, the magnification of the optical system is set so as to image as large a FOV as possible without sacrificing resolution. For example, a ˜1 mm field-of-view could be imaged onto a 1000-element array at 1 μm pixelation. If the detection elements are 20 μm square, then the system magnification would be set to 20×. Note that this will not result in 1 μm resolution.
Pixelation is not equivalent to resolution. If, for example, the inherent resolution limit of the objective lens is 0.5 μm and each 0.5 μm×0.5 μm region in the object plane is mapped onto a pixel, the true resolution of the resulting digital image is not 0.5 μm. To achieve true 0.5 μm resolution, the pixelation would need to correspond to a region ˜0.2 μm×0.2 in the object plane. In one preferred embodiment, the magnification of the imaging system is set to achieve the true resolution of the optics.
Preferably, for high detection efficiency, low noise and sufficient read-out speed, the detectors used are CCD cameras. In
In principle, one could set the magnification of the optical system so that the height of the image of the slit SF2 on the CCD camera is one pixel, as depicted in
In practice, it is difficult to maintain perfect alignment between the illumination line and the camera row-axis, and even more difficult to maintain alignment among three cameras and the illumination in the multi-wavelength embodiment as exemplified in
An additional advantage of the preferred embodiment having one or more rectangular CCD cameras as detection devices in conjunction with a variable-width detection spatial filter, SF2 in
h≦d≦10h.
The detectors in the illuminated columns of the camera are binned, prior to reading, which is an operation that requires a negligible time compared to the exposure- and read-times.
In one preferred embodiment, the cameras are Princeton Instruments NTE/CCD-1340/100-EMD. The read-rate in a preferred embodiment is 1 MHz at a few electrons of read-noise. The pixel format is 1340×100, and the camera can be wired to shift the majority of the rows (80%) away from the region of interest, making the camera effectively 1340×20.
In addition to the above mentioned advantage of a continuous read camera, namely the absence of dead-time between successive acquisitions, an additional advantage is that it permits the acquisition of rectangular images having a length limited only by the extent of the sample. The length is determined by the lesser of the camera width and the extent of the line illumination. In a preferred embodiment the attached biofilm is disposed on the bottom of a well in a 96-well microtitre plate, the diameter of which is 7 mm. A strip 1 μm×1 mm is illuminated and the radiation emitted from the illuminated area is imaged onto the detection device. The optical train is designed such that the field-of-view is ˜1 mm2. An image of the well-bottom can be generated at 1 μm pixelation over a 1×7 mm field.
Environmental Control
In an embodiment of the present invention, assays are performed on a living biofilm. Live-cell assays frequently require a reasonable approximation to physiological conditions to run properly. Among the important parameters is temperature. It is desirable to incorporate a means to raise and lower the temperature, in particular, to maintain the temperature of the sample at 37° C. In another embodiment, control over relative humidity, and/or CO2 and/or O2 is necessary to maintain the viability of the living biofilm. In addition, controlling humidity to minimise evaporation is important for small sample volumes.
Three embodiments providing a microtitre plate at an elevated temperature, preferably 37° C., compatible with the confocal imaging system follow.
The imaging system preferably resides within a light-proof enclosure. In a first embodiment, the sample plate is maintained at the desired temperature by maintaining the entire interior of the enclosure at that temperature. At 37° C., however, unless elevated humidity is purposefully maintained, evaporation cooling will reduce the sample volume limiting the assay duration.
A second embodiment provides a heated cover for the microwell plate which allows the plate to move under the stationary cover. The cover has a single opening above the well aligned with the optical axis of the microscope. This opening permits dispensing into the active well while maintaining heating and limited circulation to the remainder of the plate. A space between the heated cover plate and microwell plate of approximately 0.5 mm allows free movement of the microwell plate and minimises evaporation. As the contents of the interrogated well are exposed to ambient conditions though the dispenser opening for at most a few seconds, said contents suffer no significant temperature change during the measurement.
In a third embodiment, a thin, heated sapphire window is used as a plate bottom enclosure. A pattern of resistive heaters along the well separators maintain the window temperature at the desired level.
In additional embodiments, the three disclosed methods can be variously combined.
Integrated Dispenser
One embodiment of the present invention provides an integrated dispenser. For assays run in 96- or 384-well plates, addition volumes in this range 20-100 μL are desirable A single head dispenser, as is appropriate, for example, to the addition of an agonist of ion-channel activity, is the IVEK Dispense 2000. Comparable units are available from CAVRO. More generally, it is desirable to be able to dispense a unique compound into each well. One embodiment provides a single head dispenser on a robotic motion device that shuttles the dispense head between the analysis station, the source plate containing the unique compounds and the tip cleansing station. The latter is a wash station for a fixed tip dispenser and a tip changing station for a disposable tip dispenser. This system provides the desired functionality relatively inexpensively, but it is low throughput, requiring approximately 30 seconds per compound aspiration-dispense-cleanse cycle. An alternative embodiment is provided by integrating a multi-head dispenser such as the Hamilton Microlab MPH-96 into the confocal imaging system. The MPH-96 consists of 96 independent fixed tip dispensers mounted to a robotic motion device capable of executing the aspirate-dispense-wash cycle described above.
In an additional preferred embodiment of the invention, employed in automated screening assays, the imaging system is integrated with plate-handling robots, such as the Zymark Twister.
Assays
Numerous variations of the assay methods described below in Examples 1-3 can be practised in accordance with the invention. In general, a characteristic intensity, and/or spatial distribution, and/or temporal distribution of one or more fluorescently-labelled species are used to quantify the assay.
Data Processing System
The performance of an assay using the confocal microscope 400 is controlled using control application 418, and the image data are acquired. After the end of acquisition of image data for at least one well in a microtiter plate by at least one detector D1, D2, D3, the image data are transmitted to the computer 405 and stored in the database 422 on the computer terminal hard drive 412, at which point the image data can be processed using the image processing and analysis application 416, as will be described in greater detail below.
Data Analysis
In general the acquisition and analysis of the data comprises a number of discrete steps. The fluorescence is converted into one or more digital images in which the digital values are proportional to the intensity of the fluorescent radiation incident on each pixel of the detection device. Within this step a correction is made for the non-uniform response of the imaging system across the field of view wherein the background-subtracted data are divided by a so-called flat-field file.
Data analysis is performed as described in FIGS. 7 to 14 by the image processing and analysis application (416).
Secondly, each image is thresholded in an image data thresholding step of the image data processing algorithm. In this embodiment the thresholding step involves binarising each image (process (551), (552) and (553)) in order to convert the grey scale image into a binary image where, for example, 1 represents image pixels occupied by micro-organisms in the biofilm and 0 represents image pixels occupied by free space between micro-organisms. In this embodiment of the invention, the value of the binarisation threshold is determined without user intervention. The value of the binarisation threshold is determined for each image separately. Alternatively, a single threshold may be calculated and applied to all the images in each well, namely the stack of images in different planes, for each of the colour channels separately.
The red image (614) is then binarised (608) using the threshold (TR) to produce a binary image. In the mask, any pixel of the red image (614) having an intensity greater than the threshold (TR) is set to 1 and any pixel of the red image (614) having an intensity equal to or lower than the threshold (TR) is set to 0. A pixel set to 1 generally corresponds to an element of a bacterium in the red image (614) and a pixel set to 0 corresponds to a background element in the red image (614).
In a similar manner to the application of the binarising step to the red (R) colour plane image (614) as described above, both the green (G) and the blue (B) colour plane images are binarised (552, 553) to form green and blue binary images, using the same predetermined quantile to set the thresholding level.
In the alternative binarising process, one pixel of the image, for example of the red (R) colour plane image (614), is selected (630). A square with a fixed area is centred about the selected pixel and thus selects (632) a local area of the pixel of the image. The area of the square is determined prior to scanning of the sample. For the local area of the selected pixel both an average intensity (Al) is computed (634) and a standard deviation (SD) of the intensity (636) are computed. A pixel binarisation threshold TP is then computed (638). The pixel binarisation threshold (TP) is computed as follows:
TP=AI+(M×SD)
where M is a constant with a preferred value in the range of 0.2 to 4, preferably in the range of 0.5 to 3 and more preferably approximately 1. The value of M is initially the same when the binarising process is applied to other images, for example the green and blue colour plane images.
Next, the selected pixel is binarised (640). If the intensity of the selected pixel has an intensity greater than the pixel threshold (TP) the pixel is set to 1. If the intensity of the selected pixel has an intensity less than the pixel threshold (TP) the pixel is set to 0. A check (642) is performed to determine if there are other pixels of the image (614) which have not been binarised. If there are further pixels which have not been binarised, the thresholding step is repeated by selecting a further, different, pixel of the image plane (630). Following the binarising of every pixel of the image plane, the binarising step ends (644) yielding a binary image.
Thirdly, in the analysis algorithm the shot noise is removed from the images (processes (561), (562) and (563)) by using any of the well known techniques of image analysis (e.g. erosion-dilation, filtering using for example a Gaussian filter). Fourthly, the processed images of the three colour planes are stored in the memory (572), (573),(574). The images for all the colour planes for every Z-plane for a single well are kept in order to do the 3D analysis at a later stage (see processes (581) to (584)). The images are also used as input for the sub-routine (570). The sub-routine (570) determines the volume of the biofilm in each colour plane and the volume of the overlap between colour planes.
The flow chart for this subroutine is shown in
Tenthly, all the results for this well are displayed on screen (590) and are stored on disk (591). Prior to displaying the results on the screen (590), the results are validated in a validation process to determine a quality and therefore a success of the binarisation processes (551, 552, 553) and to ensure that pixels of the images have generally not been incorrectly set to 1 or 0. This could occur if for example the binarisation threshold was not correctly optimised for the image or if further image processing of the binarised images, for example removing shot noise (561, 562, 563), removed in error relatively large numbers of pixels set to 1.
If the validation process determines the binarisation of an image to have been of a poor quality and therefore unsuccessful, the analysis algorithm is repeated for the image. In this repetition of the analysis algorithm the binarisation threshold is varied. Therefore, for the embodiment where the a predetermined quantile is used to determine the binarisation threshold, the percentage of the quantile is modified by a stepwise increase or decrease as desired. For the alternative binarising step, the value of the constant M is similarly modified in the repeat analysis. Following the repetition of the analysis algorithm, the results are again validated by the validation process to determine the success of the binarisation. If the results of the binarisation are again considered to be of a poor quality and therefore unsuccessful the analysis algorithm is again repeated, with a further modification of the percentage of the quantile, or the value of M, as appropriate. Once the validation process considers the results of the binarisation to have been successful, the results are displayed on the screen (590).
The validation process may involve one or more steps, which will be described below. An example of a step which may be carried out in the validation process involves checking a that no greater than a predetermined proportion, for example approximately 80%, of pixels of the final processed image of the analysis algorithm that are set to 1. If greater than the predetermined proportion of the pixels are set to 1, the validation process indicates that the threshold value was set too low. Consequently the results are considered unsuccessful and the analysis algorithm is repeated for the image with a higher threshold value. In the case where the binarisation threshold was set using the 90% quantile (Q90) it was described that therefore approximately 90% of the pixels having the lowest intensities of the image would be set to 0. Further processing of the binarised image, including removing shot noise, would set a small proportion of pixels from 1 to 0 and therefore it would be expected that a proportion somewhat less than approximately 10% of the pixels would be set to 1. If in the validation process it is found that greater than approximately 80% of the pixels are set to 1 then this identifies that the binarisation threshold value should be modified and the analysis algorithm of the image repeated.
A further example of a step which may be carried out in the validation process involves checking whether less than a predetermined proportion of pixels of the processed image have been set to 1, for example approximately 9%. If less than 9% of the pixels have been set to 1, the validation process indicates that the threshold value was set too high. Consequently the results are considered unsuccessful and the analysis algorithm is repeated for the image with a lower threshold value.
A yet further example of a step which may be carried out in the validation process involves comparing a proportion of pixels set to 1 of an image for one plane of the sample with a proportion of pixels set to 1 of a second, different, plane of the sample. It is unlikely that there will be a significant difference between these two proportions. If the difference when compared with a predetermined difference value, is determined to be statistically significant, the analysis algorithm is then repeated for the images with an appropriately modified value of the threshold to obtain successful results.
Another example of a step which may be carried out in the validation process involves counting a number of isolated pixels set to 1. By isolated it is meant that the pixel is entirely surrounded by pixels set to 0. If this number is higher than a predetermined value, then the validation process indicates that pixels corresponding to background noise of the image have been incorrectly set to 1 and that the analysis algorithm should be repeated for the image with an increased threshold value.
In a further example of a step which may be carried out in the validation process a statistical property, for example an average size or a most probable size, of an identified bacterium of the processed image is compared with a predetermined and expected value for this property. If there is a significant difference between these values, the validation process indicates that the value of the binarisation threshold should be modified and the analysis algorithm repeated. A modified form of this example of the validation process involves comparing the statistical property of an identified bacterium for one image plane of the sample with the statistical property of an identified bacterium for a second, different, image plane of the sample to check for a similarity.
Next, the program determines whether there is another well to process (592). If there is another well, the whole process is started again from process (510), using the first Z-plane (Z=1) of the next well (i=i+1). If there are no other wells to process, the program is finished (593).
Finally the RGO database, the RBO database and the GBO database are given as output from the process (590).
Visualisation of Bacterial Biofilm by Fluorescence Staining
A non-fluorescent strain of Escherichia coli (E. coli, JM109) was allowed to adhere to the wells of a Packard microtitre plate (cf Packard catalogue number 6005182) at 37° C. for 3 hours. Unattached bacteria were removed by washing and the attached cells allowed to grow overnight at 37° C. in standard Luria media (Amersham Biosciences). The bacteria were then visualised by the addition of the fluorescent DNA stain Hoechst 33342 (1 μM; Sigma). On visualisation in the imaging system, the bacteria showed a dense, but not uniform, pattern of staining indicative of growing in patches (see
3D Visualisation of Adhered Population of E. coli Constitutively Expressing GFP
A second experiment was conducted growing E. coli in a microtitre plate as in Example 1 above, except that the E. coli JM 109 constitutively expresses a GFP, having the GFP-F64L-S175G-E222G mutation. After removal of unattached cells by washing, the remaining cells were incubated for approximately 10 hours at 37° C. with no agitation. A well-developed biofilm, that was neither over-grown nor only one-cell thick, was scanned as it was considered representative of a typical sample. Scanning was conducted at 488 mn to visualise the GFP.
The images shown in FIGS. 16A-D cover an area of 0.75×0.75 mm. Depth information was obtained by moving the focal plane of the instrument into the biofilm in 1 μm steps. The three images shown in
Differential 3D Analysis of Adhered E. coli Cultures
E. coli CL182 possesses a low copy number vector (pGEX-6P-1) that confers ampicillin resistance and expresses the GFP (F64L, S175G, E222G) from the IPTG responsive tac promoter. E. coli XL1-blue is a standard strain that possesses transposon 10, conferring tetracycline resistance. The strains were mixed and grown in the presence of selective antibiotics (tetracycline, ampicillin or chloramphenicol) and the effects were visualised using the IN Cell Analyzer.
E. coli cultures were grown in batch culture at 37° C. for 16 hours under selective pressure. Cells were pelleted by centrifugation, washed and resuspended in cold PBS. OD600 mn was normalised (to 1) for both cultures and solutions were diluted ten fold in cold PBS. Cells (100 μl) were allowed to settle and adhere to the surface of a Packard microtitre plate (Packard #6005182) at 4° C. for 1 hour. Adhered E. coli were washed twice with PBS (100 μl). Luria broth (100 μl) with or without IPTG (0.2 μM), and ampicillin (100 μg/ml), tetracycline (10 μg/ml) and chloramphenicol (34 μg/ml) were added to adhered cells and incubated at 37° C. for 4 hours and 16 hours. Cells were washed twice with PBS and incubated for 10 minutes in Hoechst 33342 (0.1 μM in PBS). Cells were washed in PBS and imaged sequentially using the UV (365 nm) and blue (488 nm) laser lines to excite Hoechst 33342 and GFP respectively. Emission light was captured using the 450BP65 and 565BP50 filters and collected as 12 bit images; 24 slices were acquired per condition with 1 μm spacing between them.
The images were then analysed using the algorithms described in FIGS. 7 to 14. The voxel dimensions were established prior to conducting the experiment using sub-resolution and super-resolution beads. The analysis thus provides data on the amount of biofilm in both colour planes in three dimensions as described previously. In addition, the overlap between green and blue fluorescent biofilm was calculated in 3D.
Differential inhibition of growth of XL1-blue and CL182 cells was clearly demonstrated and quantified using ampicillin and tetracycline (
When CL182 cells were incubated in the presence of LB+IPTG the volume of green and blue emission pixels was equal, suggesting that all cells within the adhered biomass volume are expressing GFP (green:blue=9.72:9.71). This was confirmed by further analysis that showed that virtually all pixels that are blue are also green (
The above embodiments are to be understood as illustrative examples of the invention. Further embodiments of the invention are envisaged. It is to be understood that any feature described in relation to any one embodiment may be used alone, or in combination with other features described, and may also be used in combination with one or more features of any other of the embodiments, or any combination of any other of the embodiments. Furthermore, equivalents and modifications not described above may also be employed without departing from the scope of the invention, which is defined in the accompanying claims.
Number | Date | Country | Kind |
---|---|---|---|
0211068.2 | May 2002 | GB | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/GB03/01816 | 4/28/2003 | WO | 5/9/2005 |