The instant invention relates to light imaging apparatus, systems and methods.
Imaging apparatus have been long known and used for their ability to obtain information related to an imaged sample. For volumetric samples, three-dimensional imaging has proven a very effective tool, since it provides three dimensional images, which mimic the three-dimensional shape of the sample itself. Because most sensing techniques involve bi-dimensional sensors, some three-dimensional imaging methods require a plurality of bi-dimensional images to be taken along different lines of sights, and calculation to be performed from these 2D images.
An example can, for example, be found in U.S. Pat. No. 7,113,217 where successive images are taken of luminescent light emitted from within a sample along different lines of sight. It is necessary to displace the sample with respect to the detector between two acquisitions. In other words, at a first step, luminescent light is detected from the top of the sample. Then the sample is moved in a position where one of its sides can be imaged, and another image is obtained at this position. These steps are repeated until a sufficient number of images have been taken from different lines of sight all around the sample.
However, the three-dimensional image obtained from these bi-dimensional images could be inaccurate, since the bi-dimensional images are taken one after the other. Inaccuracy could occur for example because the sample is moving between two images, because the signal to be detected is a transient signal which does not allow the time-consuming operation of displacing the sample between two acquisitions, because the operating state of the detector can not be maintained sufficiently constant for a time sufficient for acquiring all the images, or for many other reasons.
The instant invention has notably for object to mitigate those drawbacks.
To this aim, it is provided an imaging apparatus comprising a light-tight enclosure in which are enclosed:
With these features, simultaneous acquisitions from most of the sample can be obtained. These simultaneous images can be used for accurate 3D reconstruction, as detailed above, or for any other suitable purposes. Indeed, the simultaneous images can carry enough relevant information by themselves not to require an additional 3D reconstruction.
In some embodiments, one might also use one or more of the features as defined in the dependant apparatus and system claims.
According to another aspect, the invention relates to a light imaging method comprising
the fourth portion of the detector being adapted to detect a light signal emitted from the fourth portion of the sample without reflection on the first or second portions of the reflecting device.
In some embodiments, one might also use one or more of the features as defined in the dependent method claims.
Other characteristics and advantages of the invention appear from the following description of six embodiments thereof given by way of non-limiting example, and with reference to the accompanying drawings.
In the drawings:
a and 5b are schematic views obtained at the detector;
a and 6b are views corresponding to
In the various figures, like references designate elements that are identical or similar.
The imaging apparatus described herein is a luminescence imaging apparatus, e.g. bioluminescence or fluorescence imaging apparatus, i.e. designed to take an image of a sample 2, such as, in particular, a small laboratory animal, e.g. a mammal, emitting light from inside its body. By light, it is understood an electro-magnetic radiation having a wavelength between 300 nm and 1300 nm, and preferably between 400 and 900 nm.
For example, said light is generated due to a chemical reaction inside the body of the small animal. In order to obtain the chemical reaction, it is possible, for example, to use a small laboratory animal that has been genetically modified to include a gene encoding for a protein that presents the particularity of emitting light, the gene being expressed under the control of a suitable promoter upon an event.
Before placing the laboratory animal 2 in the imaging apparatus 1, the event is generated. The quantity of light given off locally is representative of the quantity of produced protein, and thus makes it possible to locally measure the level of expression of the gene.
In particular, if it is desired to check whether the gene in question is expressed particularly in response to a given event, it is possible to implement the measurement explained above firstly for a small laboratory animal 2 for which the event has been triggered, and secondly for a small laboratory animal 2 for which the event has not been triggered, in order to compare the signals emitted by the two animals.
Alternatively, the experiment in question can, for example, consist in measuring the muscular activity generated by an event in a laboratory animal, by detecting the quantity of light emitted by the coelenterazine-aequorin substrate-photoprotein pair which reacts with a given complementary chemical entity. For example, the entity in question is calcium arriving in the proximity of the photoprotein at the axons.
Since such events have a very fast time signature, it is useful to obtain information relating to the reaction rate rapidly.
According to a possible embodiment, the present method is used when imaging a moving animal. A moving animal can be either awake and running in the imaging apparatus, or still (for example anesthetized). In this latter case, the animal's movement is mainly due to breath.
The apparatus described herein can also be used to implement a method of performing imaging by delayed luminescence or phosphorescence. During such a method, a molecule adapted to emit light by phosphorescence for a time that is sufficiently long, of the order of a few minutes, is illuminated ex-vivo in order to trigger said phosphorescence. The molecule is then introduced into a small laboratory animal and can be used as a light tracer. The concentration of the molecule in a location of the organism, e.g. because a certain reaction takes place at that location, and because the molecule in question participates in said reaction, is detectable by the apparatus described below and makes it possible to characterize the reaction in question quantitatively or qualitatively.
The apparatus and method described herein can also be used when light is emitted by fluorescence from inside the sample or the animal. Such emission can be obtained for example by exciting fluorescence probes contained inside the sample or the animal.
As shown in
Due to the above-described reaction, the small laboratory animal 2 naturally emits a luminescence signal that carries information relating to the luminescence of the small animal. In addition, due to the illumination generated by the light source 8, a positioning light signal, corresponding substantially to the incident illumination 8 being reflected by the small laboratory animal 2 is also emitted in the enclosure 5. The positioning light signal can also include a portion corresponding to the autofluorescence of the sample 2 due to the illumination by the light source 8.
The luminescent and positioning light signals combine to form a combined light signal arriving at the detecting device 9 shown outlined in dashed lines in
With reference to
Further, the enclosure 5 contains a reflecting device 23 which will be described in more details below. The sample 2, the detectors 10, 11 and the reflecting device 23 are so placed that, if the detectors 10, 11 face the top of the sample 2, the reflecting device 23 faces the bottom of the sample 2. By “facing”, it is understood that two parts are considered “facing” if they are in optical relationship, even if this optical relationship is performed by way of intermediate light-reflecting or deviating devices.
In the example shown, the light source 8 emits incident illumination continuously towards the stage so that the combined light signal corresponds to a spectral combination of the luminescence light signal (carrying the luminescence information) and of the positioning light signal. The combined light signal is separated by a separator plate 12, which separates the signals on the basis of their wavelengths. For example, such a separator plate is a dichroic mirror or a mirror of the “hot mirror” type that separates visible from infrared. The luminescence light signal carrying the luminescence information is transmitted substantially in full towards the first detector 10, whereas the second light signal is transmitted substantially in full to the second detector 11.
In order to be sure that only the signal carrying the luminescence information reaches the first detector 10, it is also possible to dispose a filter 13 at the inlet of the first detector 10, which filter is adapted to prevent the wavelengths that do not correspond to that signal from reaching the first detector 10.
In practice, in order to be certain that the signal reaching the first detector 10 corresponds only to the luminescence from the inside of the sample 2, provision is made for the autofluorescence signal emitted by the sample 2 under the effect of the light source 8 to present a wavelength that is different from the wavelength of the signal in question. To this end, it is possible to choose to work with a light source 8 that emits incident illumination presenting an adapted spectrum, distributed beyond the range of wavelengths emitted by luminescence. For example, it is possible to use infrared illumination centered on a wavelength substantially equal to 800 nanometers (nm) when the luminescence spectrum presents a longest wavelength of 700 nm or shorter.
Other variations are possible, for example where the illumination is synchronized with the acquisition of the light-emission images by periodically shuttering the luminescent light-emission detecting camera, or where the detectors 10 and 11 are provided on the same wall of the enclosure, and the acquired data treated to be expressed in the same frame of reference, such as described in WO 2007/042641, which is hereby incorporated by reference in its entirely for all purposes, or using only the sensitive first detector 10 to acquire both the luminescence signal and the positioning signal one after the other, possibly in a repetitive fashion.
As shown in
In similar manner, at the start of each time frame, the signal generated by the first detector 10 is stored in a first memory 20 as are the co-ordinates relating to each pixel. A processor unit 15 is adapted to read the data stored in the first and second memories 20, 21, so as store it and/or so as to display the corresponding images on the display 4. The components described on
However, it can happen that it is preferable not to read the data measured at the first detector 10 for each time frame, but rather once every n time frames, where n is greater than 1, in order to allow the light-emission signal to accumulate to improve the signal-to-noise ratio.
Of course, the imaging apparatus could also be used in a “static” non-live mode, where data is accumulated at the luminescence detector for a long time (minutes, hours, . . . ).
The sample 2 can arbitrarily be divided in four separate portions: a first portion S1 faces the first mirror 24; a second portion S2 faces the second mirror 25; a fourth portion S4 faces the detector 10; and a third portion S3 is provided opposite the fourth portion S4, between the first S1 and second S2 portions, facing both the first 24 and second 25 mirrors.
Similarly, the detector 10 can be divided in four portions which, from left right on
The detecting portions D1, D4, D3 and D2 are parts of a single planar detector.
A first light signal LS1 is emitted by the first portion S1 of the sample 2 and reflected by the first mirror 24 to reach the first portion D1 at the detector, where it is detected. A second light signal LS2 is emitted by the second portion S2 of the sample 2, is reflected by the second mirror 25 and reaches the second portion D2 of the detector where it is detected.
A third light signal LS3 is emitted by the third portion S3 of the sample 2, is reflected both by the first mirror 24 and the second mirror 25 and reaches the third portion D3 of the detector where it is detected. As it is apparent from
A fourth light signal LS4 emitted from the fourth portion S4 of the sample 2 reaches the fourth portion D4 of the detector without any reflection on the first mirror 24 nor the second mirror 25.
It is also apparent from
Stated otherwise, the first portion D1 of the detector detects the reflection R1 of the sample 2 by the first mirror 24, the second portion D2 of the detector detects a reflection R2 of the sample 2 by the second mirror 25; the third portion D3 of the detector detects the reflection R3 of the sample 2 by both the first 24 and second 25 mirrors, whereas the fourth portion D4 of the detector 10 obtains a direct image of the sample 2.
As an example, the dimensions of the system are as follows. The floor of the enclosure is about 180 mm wide. The mirrors are placed above the floor, the junction point of the mirrors being 5 mm away from the floor. The mirrors each form an angle αg, αd of 45 degrees with the floor and have a length of 126.71 mm. The sample support is placed 83.06 mm above the floor, and the center of the sample receiving area is located about 25 mm from the central plane P of the imaging apparatus. The distance between the sample support and the detector is 445 mm.
Although
According to an embodiment, it can be useful to apply a suitable processing to the detected data, in order to account for the fact that the optical distances between the detector and the various parts of the sample are different. For example, with the above described geometry, the images detected by portions D1 and D2 of the detector are of only about 90% of the size of the image detected by the fourth portion D4. Further, the image detected by the third portion D3 is about 80% of the size of the image detected by the fourth portion D4.
Thus, a suitable partial enlargement is performed to the images detected by both cameras, so that all four images are sized as if having been detected from a single virtual plane. This is shown on
The homothetic factors are obtained from an evaluation of the optical path of the light signal reaching the respective detector portions. These factors can be embedded into the computerized system, or calculated periodically from the known positions of the detector(s), the support 7 and of the reflecting device 24, 25, in particular if the support 7 is movable vertically inside the enclosure. A shown on
Further, as shown on
Of course, this superimposition could be performed directly on the data detected, such as shown on
Next, an example of a method for obtaining three dimensional luminescent data, either surfacic or volumic, is described in relation to
The marking device 100 is for example an electronically controlled printing device comprising a support 101 adapted to receive the animal 2, for example previously anesthetized. A module 102 comprising a printing head 103 and an imaging camera 104 is carried at the end of an arm 105 movable with respect to the support 101 along two displacement axis X, Y in a plane parallel to the support above the animal 2. The printing head is in a fluid communication with an ink tank 106 providing ink to the printing head. A computerized control unit 107 controls the displacement of the arm 105 in the X-Y plane and the emission of an ink drop in suitable locations of the animal 2. Suitable locations are for example determined by an user having on a display screen the output of the imaging camera 104, and determining the locations of the ink drops.
Of course, the landmarks could be of any suitable shape, such as regularly spaced dots, lines, or any other suitable patterns. Further, the arm 105 could be made to move vertically out of the X-Y plane, for example keeping constant the printing head to animal distance.
Further, it should be noted that other embodiments of marking devices are possible.
The images from both positioning detector portions D1 and D4 are shown on the left of
By a suitable data processing method, contours 16A, 16B can be extracted for each image from both detector portions. Further, the points M1,i and M4,j corresponding to the images by the first and fourth portions of the landmarks Mi and Mj, respectively, are extracted on the positioning images.
The three-dimensional position, in the frame of reference U, V, W of the enclosure for each of the points Mi of the animal's surface is calculated from the detected bi-dimensional position on both image portions obtained respectively from both detector portions. Knowing the geographical position of the positioning detector in the enclosure, the three-dimensional coordinates of the points can be stereoscopically determined from the offset, between the two image portions, of the points on the two image portions, such as applying one of the methods described in “Structure from stereo- a review”, Dhond and al., IEEE Transactions on Systems, Man and Cybernetics, Nov/Dec 1989, Volume 19, Issue 6, pp 1489-1510.
This calculation enables to roughly obtain the three-dimensional outer surface of the animal as shown on the right side of
The light emission signal as detected by the luminescent detector 10 is projected onto the external surface as shown on the right side of
The resulting three-dimensional surfacic representation of the animal and three-dimensional surfacic light-emission image can be displayed superimposed as shown on
If this is of interest, the 3D position of a light source inside the sample could be calculated from the 3D envelope and the detected luminescence data.
Knowing the distribution of light at each zone corresponding to the surface of the small laboratory animal 7, the computer can also be adapted to determine the locations of the light sources within the sample. During this step, it is desired to associate each internal zone of the volume of the small laboratory animal with a value for the luminescence emitted by said zone. For example, it is possible to implement a method whereby a plurality of virtual zones are defined inside the volume, and given knowledge of the distribution of soft tissue in the animal, e.g. obtained by earlier magnetic resonance imaging or computer tomography of the small laboratory animal, and consequently knowledge of the optical characteristics of each zone, it is possible by solving diffusion equations of light inside the sample, to determine the most likely disposition of the sources within the small animal that would lead to the surface distribution of light.
In a variant, the distribution of soft tissue is known from a generic model for the volume of a small laboratory animal, which model is deformed so as to be made to correspond with the locating data concerning the animal being subjected to detection, or by any other suitable method.
Although, in the present example, a two-stage calculation is implemented for determining the surface distribution of light at the surface of the sample from the acquired luminescence image, and then from said surface distribution the position and the intensity of light sources inside the sample, it would be entirely possible to implement a single calculation step during which the volume distribution of sources inside the sample is calculated directly from the luminescence signal detected by the detector without passing via the intermediate calculation of the surface distribution of light.
The above-mentioned detection and 3D surfacic or volumic calculations could be performed repeatedly for each time of an observation period, or for one time only.
For the first reflecting portion 24, which is the one closest to the sample, the first reflecting portion 24 extends continuously from the junction point 26 to an end point M′, with the outer portion 24b forming a non-zero angle with respect to the central portion 24a at point P′. Point P′ is for example level with the support 7 in a plane perpendicular to the plane (P). For example, the outer end of the support 7 is received in the first reflecting portion at point P′, as shown on
As can be seen on
Forming a non-zero angle between the central 24a and outer 24b portions of the first portion 24 of the reflecting device enables to obtain, at the first portion of the detector, a view which is closer to a purely lateral view (of course depending on the size and position of the imaged sample).
As can be seen on
It will be appreciated that, depending on the imaging application, only the first or the second reflecting portion might be provided with such an angle discontinuity, the other of said reflecting portions being planar.
Compared to the second embodiment, the third embodiment is different in that the first reflecting portion 24 is made discontinuous, i.e., segmented, between the central 24a and the outer 24b portions. This gap 27 is provided so that a direct image of the support 7 through reflection by the central portion 24a of the first reflecting portion is not visible by the detectors 10, 11. Hence, for example, compared to
Alternatively or in addition, the second reflecting portion 25 can also be segmented, as shown by the gap 28 on the right hand side of
According to a variant embodiment of
Obviously, for the embodiment of
A benefit from this configuration is that the angular portion by which the first and second portions of the sample are viewed (lateral views) are equal in this configuration, which makes following signal handling easier (for example for the 3D reconstruction software).
According to a fifth embodiment, as shown on
In the fifth embodiment, the head portion 29b is shifted upwards, but not sideways, with respect to the body portion 29a. Hence, the junction line 26 and the junction line 32 between the mirrors 30 and 31 extend both in a plane normal to the detector plane. As shown on the embodiment of
As shown on
For the fifth and sixth embodiments, the magnification factor provided by the head portion 29b is different from that of the body portion 29a. If necessary, the computer system 22 is adapted to apply different geometrical corrections to data obtained from signals detected by different detector portions (in particular, ‘body’ portions of the detectors facing the body portion 29a of the reflecting device, and ‘head’ portions 10b, 11b, of the detectors facing the head portion 29b of the reflecting device), based on pre-defined calibration factors determined based on the geometric relationship between the head and body portions of the reflecting device.
Other geometries can be derived from the above geometries, for example in an attempt to bring the mirrors as close as possible to the imaged sample, while still imaging most (preferably all) of the sample circumference simultaneously.
Number | Date | Country | Kind |
---|---|---|---|
08305218.3 | May 2008 | EP | regional |
The present application is the United States National Stage of PCT/EP2009/056653, filed May 29, 2009, and claims priority to European patent application 08305218.3, filed May 30, 2008, the entirety of both of which is incorporated herein by reference.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP09/56653 | 5/29/2009 | WO | 00 | 5/27/2011 |