Systems and methods for illumination and imaging of a target

Description

TECHNICAL FIELD

The present disclosure relates generally to the field of illumination and imaging. More specifically, the disclosure relates to illumination and imaging of a target material.

BACKGROUND

Illumination is an important component of imaging systems such as, for example, broadband imaging systems with self-contained illumination. In many applications of imaging systems, such as in medical imaging, it may be challenging to achieve even, full field illumination of the imaging field of view, and also to provide a sufficient intensity of illumination to yield a sufficiently strong imaging signal. Conforming the illumination profile to match the imaging field of view is one method of conserving illumination power, while multiple illumination ports may be used to provide even illumination across the field of view. Conventional illumination projection in imaging systems may feature anamorphic projection to match the imaging field of view, but typically only feature a single illumination port and are not configured for close working distances. Single port illumination systems result in substantial shadowed regions obscuring vision when illuminating complex topography such as, for example, human anatomical structures or other biological materials. Existing designs for field surgical imaging and illumination devices may make use of multiple illumination ports to minimize shadowed regions, such as a ring light surrounding the imaging optics, but these designs waste excess illumination outside of the field of view and fail to achieve even illumination of the field of view over a range of working distances.

SUMMARY

One or more embodiments are directed to an illumination module for use in an imaging system having an imaging field of view for imaging a target, the illumination module including a first illumination port to output a first light beam having a first illumination distribution at the target to illuminate the target and a second illumination port to output a second light beam having a second illumination distribution at the target to illuminate the target. The second illumination distribution may be substantially similar to the first illumination distribution at the target, the second illumination port being spaced apart from the first illumination port, the first and second illumination distributions being simultaneously provided to the target and overlapping at the target, wherein the illumination from the first and second ports is matched to a same aspect ratio and field of view coverage as the imaging field of view.

Light from the first and second illumination ports may respectively overlap to provide uniform illumination over a target field of view.

The illumination module may include a steering driver to simultaneously steer the first and second illumination ports through different fields of view.

Each of the first and second illumination ports may include a lens module having at least one fixed lens, a steerable housing, and at least one lens mounted in the steerable housing, the steerable housing being in communication with the steering driver.

The illumination module may include an enclosure, the enclosure housing the first and second illumination ports and the steering driver.

The enclosure may be a hand held enclosure and may include a control surface including activation devices to control the steering driver.

Each of the first and second illumination distributions may be a rectangular illumination distribution.

Each of the first and second illumination ports may include a lens module having two pairs of cylindrical lenses.

The first and second illumination ports may be symmetrically offset from a long dimension midline of the rectangular illumination distribution.

One or more embodiments are directed to an imaging device having an imaging field of view, the imaging device including a first illumination port to output first light having a first illumination distribution at a target to illuminate the target, a second illumination port to output second light having a second illumination distribution at the target to illuminate the target, the second illumination distribution being substantially similar to the first illumination distribution at the target, the second illumination port being spaced apart from the first illumination port, the first and second illumination distributions being simultaneously provided to the target and overlapping at the target, wherein the illumination from the first and second ports is matched to a same aspect ratio and field of view coverage as the imaging field of view, and a sensor to detect light from the target.

The imaging device may include an enclosure, the enclosure housing the first and second illumination ports, and the sensor.

The imaging device may include a steering driver to simultaneously steer the first and second illumination ports through different fields of view.

The imaging device may include an imaging element to focus light onto the sensor, wherein the steering driver is to move the imaging element in synchrony with steering of the first and second illumination ports.

The steering driver may be in the enclosure and the enclosure may include a control surface including activation devices to control the steering driver.

The enclosure may have a hand held enclosure having a form factor that allows a single hand to control the control surface and illumination of the target from multiple orientations.

The imaging device may include an illumination source to output light to the first and second illumination ports, the illumination source being outside the enclosure.

The illumination source may output visible light and/or excitation light to the first and second illumination ports.

The sensor may be a single sensor that is to detect light from the target resulting from illumination by visible light and excitation light.

The imaging device may include a wavelength-dependent aperture upstream of the sensor, the wavelength-dependent aperture to block visible light outside a central region.

The imaging device may include a video processor box, the video processor box being outside the enclosure.

The illumination source may be integral with the video processor box.

One or more embodiments are directed to a method of examining a target, the method including simultaneously illuminating the target with a first light output having a first illumination distribution at the target and with a second light output having a second illumination distribution at the target, the second illumination distribution being substantially similar to the first illumination distribution, the first and second illumination distributions overlapping at the target, wherein the illumination on the target is matched to the same aspect ratio and field of view coverage as an imaging field of view.

The method may include simultaneously steering the first and second light outputs through different fields of view.

The method may include receiving light from the target and focusing light onto a sensor using an imaging element, the imaging element being moved in synchrony with simultaneous steering of the first and second light outputs.

One or more embodiments are directed to a drape for use with an imaging device, the drape including a barrier material enveloping the imaging device, a drape window frame defining an opening in the barrier material, a drape lens in the opening in the barrier material, and an interface integral with the drape window frame to secure the drape lens to a window frame of the imaging device.

The drape may be insertable into the window frame of the imaging device.

The interface may include two clamps integrated symmetrically on respective opposing sides of the drape window frame.

The two clamps are on a top and a bottom of the drape window frame.

One or more embodiments are directed to a processor to image a target, the processor to, within a period, turn on an excitation light source to generate an excitation pulse to illuminate the target, turn on a white light source to generate a white pulse to illuminate the target such that the white pulse does not overlap the excitation pulse and the white pulse is generated at least twice within the period, expose an image sensor for a fluorescent exposure time during the excitation pulse, expose the image sensor for a visible exposure time during at least one white pulse, detect outputs from the image sensor, compensate for ambient light, and output a resultant image.

To compensate for ambient light, the processor may expose a first set of sensor pixel rows of the image sensor for a fraction of the fluorescent exposure time for a first set of sensor pixel rows; and expose a second set of sensor pixel rows of the image sensor for all of the fluorescent exposure time, the first and second sets to detect at least one different color from the other.

The fraction may be ½.

The processor may determine the fluorescent signal F using the following equation:

F=2*Exp2−Exp1,

where Exp1 is a signal output during the fraction of fluorescent exposure time and Exp2 is a signal output during all of the fluorescent exposure time.

The fraction of the exposure time may equal a width of the excitation pulse.

The visible exposure time may be longer than a width of the at least one white pulse.

The visible exposure time may be for one white pulse within the period.

The visible exposure time may be for two white pulses within the period.

To compensate for ambient light, the processor may expose the image sensor for background exposure time when target is not illuminated at least once within the period.

One or more embodiments are directed a method for imaging a target, within a period, the method including generating an excitation pulse to illuminate the target, generating a white pulse to illuminate the target such that the white pulse does not overlap the excitation pulse and the white pulse is generated at least twice within the period, exposing an image sensor for a fluorescent exposure time during the excitation pulse, exposing the image sensor for a visible exposure time during at least one white pulse, detecting outputs from the image sensor, compensating for ambient light, and outputting a resultant image.

Compensating for ambient light may include exposing a first set of sensor pixel rows of the image sensor for a fraction of the fluorescent exposure time and exposing a second set of sensor pixel rows of the image sensor for all of the fluorescent exposure time, the first and second sets to detect at least one different color from the other.

Compensating for ambient light may include exposing the image sensor for a background exposure time when target is not illuminated at least once within the period.

Generating the excitation pulse may include providing uniform, anamorphic illumination to the target.

Providing uniform, anamorphic illumination to the target includes overlapping illumination from at least two illumination ports.

One or more embodiments are directed to a method of displaying fluorescence intensity in an image, the method including displaying a target reticle covering a region of the image, calculating a normalized fluorescence intensity within the target reticle, and displaying the normalized fluorescence intensity in a display region associated with the target.

The display region may be projected onto the target.

The normalized fluorescence intensity may include a single numerical value and/or a historical plot of normalized fluorescence intensities.

One or more embodiments are directed to a kit, including an illumination module including at least two illumination ports spaced apart from one another, first and second illumination distributions to being simultaneously provided to a target and to overlap at the target, and an imaging module including a sensor to detect light from the target.

The kit may include an enclosure to enclose the illumination module and the imaging module.

One or more embodiments are directed to a fluorescence imaging agent for use in the imaging device and methods as described herein. In one or more embodiments, the use may comprise blood flow imaging, tissue perfusion imaging, lymphatic imaging, or a combination thereof, which may occur during an invasive surgical procedure, a minimally invasive surgical procedure, a non-invasive surgical procedure, or a combination thereof. The fluorescence agent may be included in the kit described herein.

In one or more embodiments, the invasive surgical procedure may comprise a cardiac-related surgical procedure or a reconstructive surgical procedure. The cardiac-related surgical procedure may comprise a cardiac coronary artery bypass graft (CABG) procedure which may be on pump and/or off pump.

In one or more embodiments, the minimally invasive or the non-invasive surgical procedure may comprise a wound care procedure.

In one or more embodiments, the lymphatic imaging may comprise identification of a lymph node, lymph node drainage, lymphatic mapping, or a combination thereof. The lymphatic imaging may relate to the female reproductive system.

BRIEF DESCRIPTION OF THE DRAWINGS

The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawings(s) will be provided by the Office upon request and payment of the necessary fee. Features will become apparent to those of ordinary skill in the art by describing in detail exemplary embodiments with reference to the attached drawings in which:

FIG. 1 illustrates a schematic view of a system for illumination and imaging according to an embodiment;

FIG. 2 illustrates a schematic view of an illumination module according to an embodiment;

FIGS. 3A and 3B illustrate schematic side view and plan view, respectively, of an exemplary lens module in a steerable housing according to an embodiment;

FIG. 4A illustrates a schematic view of a linkage for synchronous focusing of the imaging system and steering of the illumination system according to embodiments;

FIGS. 4B and 4C illustrate a bottom view and a top view, respectively, of a linkage for synchronous focusing of the imaging system and steering of the illumination system according to embodiments;

FIGS. 5A and 5B illustrate bottom views of the linkage at a far working distance and a near working distance, respectively, according to an embodiment;

FIGS. 6A and 6B illustrate a perspective top view and a perspective bottom view of an illumination and imaging system according to an embodiment;

FIG. 7 illustrates an enclosure according to an embodiment;

FIGS. 8A and 8B illustrate perspective views of different exemplary positions in which the system may be used;

FIG. 9 illustrates a drape for use with the system according to an embodiment;

FIGS. 10A to 10C illustrate illumination distributions for different illumination configurations;

FIG. 11A illustrates a timing diagram for visible and excitation illumination according to an embodiment;

FIG. 11B illustrates a timing diagram for visible and excitation illumination according to an embodiment;

FIG. 11C illustrates a timing diagram for visible and excitation illumination according to an embodiment;

FIG. 11D illustrates a timing diagram for visible and excitation illumination according to an embodiment;

FIGS. 12A to 12C illustrate pixel layout and an interpolation scheme according to an embodiment;

FIGS. 13A to 13C illustrate diagrams of an embodiment of a display method output when a target reticle is placed over regions of no normalized fluorescence intensity, high relative normalized fluorescence intensity, and moderate relative normalized fluorescence intensity, respectively;

FIG. 13D illustrates a diagram of an embodiment of a display method output that includes a signal time history plot of normalized fluorescence intensity values on the display;

FIG. 14 illustrates a recorded image of an anatomical fluorescence imaging phantom, featuring an embodiment of a display method output that displays normalized fluorescence intensity;

FIG. 15 illustrates an exemplary light source of an exemplary illumination source of the system for illumination shown in FIG. 1; and

FIG. 16 illustrates an exemplary imaging module of the fluorescence imaging system in FIG. 1, the imaging module comprising a camera module.

DETAILED DESCRIPTION

Example embodiments will now be described more fully hereinafter with reference to the accompanying drawings; however, they may be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey exemplary implementations to those skilled in the art. Various devices, systems, methods, processors, kits and imaging agents are described herein. Although at least two variations of the devices, systems, methods, processors, kits and imaging agents are described, other variations may include aspects of the devices, systems, methods, processors, kits and imaging agents described herein combined in any suitable manner having combinations of all or some of the aspects described.

Generally, corresponding or similar reference numbers will be used, when possible, throughout the drawings to refer to the same or corresponding parts.

Spatially relative terms, such as “beneath”, “below”, “lower”, “above”, “upper”, and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as “below” or “beneath” other elements or features would then be oriented “above” the other elements or features. Thus, the exemplary term “below” can encompass both an orientation of above and below. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.

FIG. 1 illustrates a schematic view of an illumination and imaging system 10 according to an embodiment. As may be seen therein, the system 10 may include an illumination module 11, an imaging module 13, and a video processor/illuminator (VPI) 14. The VPI 14 may include an illumination source 15 to provide illumination to the illumination module 11 and a processor assembly 16 to send control signals and to receive data about light detected by the imaging module 13 from a target 12 illuminated by light output by the illumination module 11. The illumination source 15 may output light at different waveband regions, e.g., white (RGB) light, excitation light to induce fluorescence in the target 12, and so forth, depending on characteristics to be examined and the material of the target 12. Light at different wavebands may be output by the illumination source simultaneously or sequentially. The illumination and imaging system 10 may be used, for example, to facilitate a surgical procedure. The target 12 may be a topographically complex target, e.g., a biological material including tissue, an anatomical structure, other objects with contours and shapes resulting in shadowing when illuminated, and so forth. The VPI 14 may record, process, display, and so forth, the resulting images and associated information.

FIG. 2 illustrates a schematic perspective view of the illumination module 11 of FIG. 1 according to an embodiment. As may be seen therein, the illumination module 11 may include at least two illumination ports directing illumination from an illumination source 23, which may be included in the VPI box 14, to for example a rectangular target field 24. Each illumination port is to provide illumination over the target field 24, such that the light overlaps, e.g., substantially or completely, at the target material 12 (shown in FIG. 1). More than two illumination ports may be used. The illumination distributions are substantially similar and substantially overlap at the target 12 to provide uniform illumination of the target 12. The use of at least two illumination ports reduces the effect of shadowing due to anatomical topography, and aids in providing uniform illumination over the target field 24. Directing illumination from the illumination module 11 to a rectangular target field 24 allows matching the region of illumination to a rectangular imaging field of view, which aids in providing uniform illumination and enhances efficiency of the illumination module by reducing extraneous illumination. Matching the illumination field to the imaging field of view also provides a useful indication of the location and extent of the anatomical region currently being imaged.

In some embodiments, a light pipe may be used to achieve mixing of the illumination light in order to yield a uniform illumination profile. Mixing of the illumination light by a light pipe may remove the influence of the structure of the light source on the illumination profile, which could otherwise adversely affect uniformity of the illumination profile. For example, using a light pipe to mix the illumination light output from a fiber optic light guide may remove images of the structure of the individual optical fibers from the illumination profile. In some embodiments, a rectangular light pipe may be used to conserve illumination power while matching the illumination profile to a rectangular imaging field of view. In some embodiments, a light pipe material with a high index of refraction for both visible light and near infrared light, such as optical glass material N-SF11, may be used for high efficiency of illumination power transmission.

According to some embodiments, a rectangular light pipe with an aspect ratio matching the aspect ratio of the imaging field of view (e.g., both aspect ratios being 16:9) may be used in conjunction with rotationally symmetric illumination optic elements.

According to some embodiments, a rectangular light pipe with a different aspect ratio than the imaging field of view (e.g., a square light pipe along with a 16:9 imaging field of view aspect ratio) may be used in conjunction with cylindrical illumination optic elements. Cylindrical optic elements may be used to separately conform one or both dimensions of the rectangular illumination profile to match the aspect ratio of the imaging field of view.

Depending on the desired system requirements for range of working distance and illumination uniformity various approaches may be used for matching the illumination to a rectangular imaging field of view. For example, applications with high requirements for range working distance and illumination uniformity may necessitate use of illumination optics that are steered dynamically to adequately match the illumination to the imaging field of view, while applications with lower requirements may be served with fixed illumination optics to match the illumination to the field of view.

In some embodiments, one or more illumination optic elements may be rotated by a driver in order to steer the illumination.

In some embodiments, one or more illumination optic elements may be translated perpendicular to the imaging optic axis by a driver in order to steer the illumination.

In some embodiments, one or more illumination optic elements may be configured to provide some distortion in the illumination profile, in order to account for distortion inherent to the accompanying imaging system.

In some embodiments, uniform illumination of the imaging field of view over a specified range of working distances may be achieved with a fixed location and orientation of the illumination optics. The offset distance of the illumination optics from the imaging optic axis may be configured, along with the orientation of the of the illumination optics, in order to optimize matching of the illumination profile to the imaging field of view at a working distance within the specified range of working distances while also maintaining substantial matching of the illumination profile to the imaging field of view at other working distances within the specified range.

As is illustrated in FIG. 2, each illumination port may include a lens module 20, a connecting cable 22 connected to the illumination light source 23, and a light pipe 21 adapting a high numerical aperture of the connecting cable 22 to a lower numerical aperture of the lens module 20. The lens module 20 may be steerable, as described in detail below. In some scenarios, acceptable performance may be achievable without steering. In other words, an illumination module, and imaging device having the same, that provides a illumination having a rectangular form factor that matches the field of view of the imaging system using at least two illumination ports in which each port produces a gradient of illumination such that the sum illumination flux in the object plane is reasonably the same at each point in the illumination field, e.g., provides uniform illumination over the imaging field of view, alone may be sufficient.

FIGS. 3A and 3B illustrate a side view and a plan view, respectively, of the lens module 20. The lens module 20 may include lenses mounted in a steerable lens housing 30. As used herein, a lens is any optical element having optical power, whether implemented by a refractive or diffractive element. Other elements not essential to understanding, such as a cover enclosing the lens module (see FIG. 2), are not shown for ease of illustration.

In the particular example shown herein, the lenses may include a pair of horizontal-axis cylindrical lenses 31-32 and a pair of vertical-axis cylindrical lenses 33-34. A prism element 35 is also shown which may align illumination light with the intended outgoing optical axis. In particular, the prism element 35 corrects for an angle introduced by the light pipe 21 for increased device compactness in accordance with an embodiment. The mounting design for each lens element 31-35 may allow for tuning of the magnification and focus of the illumination optical system. In accordance with this embodiment, the steerable lens housing 30 encloses and steers three of the cylindrical lenses 31, 33, 34 and the prism lens element 35, e.g., collectively as a group. This example of lenses is merely illustrative, and the lenses in the lens module 20 may be modified as appropriate.

In this particular embodiment, a base portion of the steerable housing 30 is pinned, e.g., using a pin 46 (see FIG. 6B) inserted into housing hole 37, about a pivot point 36, respectively to a fixed chassis frame 90 (see FIG. 6A) and a mechanical linkage 40 (see FIGS. 4A to 4C) described in detail below, while lens 32 is rigidly connected the chassis 90, i.e. not to the housing 30 (see FIG. 6B).

FIG. 4A illustrates a schematic view showing directions of motion provided by various components of the linkage 40. The linkage 40 may include a drive cam 41, illumination cams 45a, 45b (one for each illumination port), and an imaging cam 43. The drive cam 41 receives an input from a user (see FIG. 6), and translates that to synchronous motion of the lens module 20a, 20b, attached to a corresponding illumination cam 45a, 45b, via a respective housing 30 and a pin 46, and an imaging lens 51 and an imaging sensor 52 (see FIGS. 5A and 5B), attached to the imaging cam 43 via cam follower pins. Here, the imaging lens 51 is shown as a single field lens, but additional and/or alternative lenses for focusing light from the target 20 onto the imaging sensor 52 may be employed. Each port has its own associated illumination cam 45A and 45B, here shown as being to a left and right of an input window to receive light from the target 12.

In particular, translation of the drive cam 41 may translate the imaging cam 43 along the x-axis, which, in turn, may result in the imaging cam 43 to translate the imaging lens 51 and the imaging sensor 52 along the z-axis, as well as translate the illumination cams 45a, 45b, which, in turn, simultaneously steer corresponding lens modules 20a, 20b about respective pivot points 36, such that steering of the lens modules 20a, 20b is synchronously performed with the position adjustment of the imaging lens 51 and the imaging sensor 52 to insure proper focus of light from the target onto the sensor 52. Alternatively, the imaging cam 43 may translate only the imaging lens 51 along the z-axis, or any other combination of imaging optical elements in order to insure proper focus of light from the target onto the sensor 52.

FIG. 4B illustrates a bottom view and FIG. 4C illustrates a top view of the linkage 40 according to an embodiment. The drive cam 41 may include two drive parts 41a and 41b, and, if steering is included, a third drive part 41c, all of which are shown here as being rigidly attached to form a rigid drive cam 41. Similarly, the imaging cam 43 may include two imaging parts 43a and 43b. The drive cam 41 receives the input from a user (via control surface 62) via the first drive part 41a and translates the imaging cam 43 via a cam follower pin in drive part 41b, resulting in the imaging cam part 43a translating the sensor 52 and the imaging cam part 43b translating the imaging lens 51. If steering is included in the linkage, the third drive part 41c simultaneously steers (rotates) the lens modules 20a, 20b using the pin 46 (see FIG. 6B) associated with each of the illumination cam parts 45a and 45b, by translating the illumination cam parts 45a and 45b. The pin 46 may be inserted through a through a slot 49 in each of the illumination cams 45a, 45b and the corresponding housing hole 37 in the lens modules 20a, 20b. The drive part 41c steers the lens modules 20a, 20b simultaneously such that they both still illuminate a same field of view as one another at the target field of view of the target 12.

FIGS. 5A and 5B illustrate bottom views of the linkage combined with the lens modules 20a, 20b, the imaging field lens 51, and the sensor 52, at a far working distance and a near working distance, respectively, according to an embodiment. As can be seen therein, the linkage 40 synchronizes steering of the illumination sources with focusing of the imaging system at two sample working distance illumination steering settings. FIGS. 5A-5B show the positions of lens modules 20a, 20b (rotated about the pivot pint 37) and the lens 51 and sensor 52 (translated along an optical axis 55 of the imaging system and along the x-axis) at two focus positions resulting from user input.

As illustrated in FIGS. 5A and 5B, each part that moves axially within the linkage mechanism 40 may be guided by two fixed rolling elements 47, and one spring-loaded rolling element 48, in order to reduce or minimize friction during motion. The linkage 40 also may include a drive cam input connection point 42.

FIGS. 6A and 6B illustrate a perspective top view and a perspective bottom top view of the device 10 in accordance with an embodiment. In FIGS. 6A and 6B, the illumination module 11 and the imaging module 13 are mounted on the chassis 90, the top portion of which is removed in for clarity. Also, a focus actuation mechanism 70 is illustrated, which translates motion from user input to motion of the drive cam 41 via the drive cam input connection point 42.

As can be seen in FIG. 6A, an optical axis 55 of the imaging module 13 runs through a center of the imaging module, with the lens modules 20a, 20b being arranged symmetrically relative to the imaging optical axis 55. The light to be imaged from the target 12 travels along the optical axis 55 to be incident on the lens 51 and sensor 52. A wavelength-dependent aperture 53 that includes a smaller central aperture that permits transmission of all visible and fluoresced light, e.g., near infrared (NIR) light, and a surrounding larger aperture that blocks visible light but permits transmission of fluoresced light, may be provided upstream of the lens 51.

Referring to FIGS. 6B and 4A-4B, the pin 46 connects the lens module 20, via the housing hole 37 in the housing 30, slot 49 of the linkage 40. Also, a pivot point pin 44 connects the lens module 20 to the chassis 90.

FIG. 7 illustrates an embodiment of an ergonomic enclosure 60 enclosing the illumination module 11 and the imaging module 13. The ergonomic enclosure 60 is designed to be held in different use-modes/configurations, for example, a pistol-style grip for forward imaging in a scanning-imaging orientation (FIG. 8A), and a vertical-orientation grip for use when imaging downward in an overhead imaging orientation (FIG. 8B). As may be seen in FIG. 7, the enclosure 60 includes a control surface 62, a grip detail 64, a window frame 68 and a nosepiece 66. The ergonomic enclosure 60 is connectable to the VPI box 14 via a light guide cable 67, through which the light is provided to the illumination ports 20a, 20b, and a data cable 65 that transmits power, sensor data, and any other (non-light) connections.

The control surface 62 includes focus buttons 63a (decreasing the working distance) and 63b (increasing the working distance) that control the linkage 40. Other buttons on the control surface 62 may be programmable and may be used for various other functions, e.g., excitation laser power on/off, display mode selection, white light imaging white balance, saving a screenshot, and so forth. Alternatively or additionally to the focus buttons, a proximity sensor may be provided on the enclosure and may be employed to automatically adjust the linkage 40.

As can be seen in FIG. 8A, when the enclosure 60 is held with the imaging window facing forward, the thumb rests on the control surface 62 while the other fingers on the operator's hand are wrapped loosely around the bottom of the grip detail 64. As can be seen in FIG. 8B, when the enclosure 60 is held with the imaging window facing downward, the grip detail 64 is between the thumb and index finger and the fingers are wrapped around to access the control buttons or switches on the control surface 62. The grip detail 64 is sculpted so as to provide for partial support of the device weight on the top of the wrist in the vertical-orientation grip, such that the enclosure 60 can hang loosely and without the need for a tight grip of the enclosure 60. Thus, the enclosure 60 may be operated by a single hand in multiple orientations. In various other embodiments, the enclosure 60 may be supported on a support (e.g., a moveable support).

The window frame 68 (see also FIG. 9), defines the different windows for the enclosure 60. In other words, the window frame 68 defines windows 68a and 68b, corresponding to the two lens modules 20a and 20b, as well as window 68c, which serves as an input window for light from the target to be incident on the sensor 52.

As illustrated in FIG. 9, the enclosure 60 may be used in concert with a drape 80. The drape 80 may be a surgical drape suitable for use during a surgical procedure. The drape includes drape material 81, a drape lens 82, a drape window frame 83 surrounding the drape lens, and an interlock interface 84 that is integral with the drape window frame 83. The drape material 81 is to envelope the device in the enclosure 60, as well as to cover anything else as required. The drape window frame 83 may follow a shape of the enclosure nosepiece 66 such that the drape window frame 83 may be inserted therein without obstructing the windows 68a to 68c. The drape 80 is designed to minimize reflections and imaging ghosting by ensuring the drape lens 82 is flush, e.g., to within 0.5 mm, with the imaging and illumination window frame 68. The drape 80 may use the interlock interface 84, which may fit into a recess on the inner surface of the enclosure nosepiece 66, to be secured flush thereto.

One or more interlock interfaces 84 may be used on the inner or outer surface of the enclosure nosepiece 66, in order to ensure a secure and close fit of the drape lens 82 against the window frame 68. In the particular embodiment shown, two interfaces 84, here one on the top and one on the bottom of the drape window frame 83 to engage with an inner surface of the enclosure nosepiece 66, are used.

FIGS. 10A to 10C illustrate typical illumination distributions (fill) relative to a rectangular imaging field of view (outline) for an illumination ring (FIG. 10A), a pair of fixed anamorphic projection illumination sources (FIG. 10B), and a pair of steered anamorphic projection illumination sources in accordance with an embodiment (FIG. 10C) at working distances of 10 cm (left column), 15 cm (center column), and 20 cm (right column). FIG. 10A illustrates use of a ring of illumination ports to minimize shadowing, but does not match illumination to the imaging field of view and may not provide even illumination at all working distances (e.g. varied distributions in accordance with distance). FIG. 10B illustrates anamorphic projection from two illumination sources (using, e.g., an illumination lens arrangement featuring cylindrical lenses or an engineered diffuser) that are fixed, thus they are well calibrated for even illumination that matches the imaging field of view at a fixed working distance, e.g., 15 cm, but not as even or well matched at other distances, whether smaller or greater. As noted above, such illumination is often acceptable on its own. FIG. 10C illustrates the ability to better maintain even illumination and constrain illumination to the field of view by steering illumination when changing the working distance (and imaging focus) in accordance with an embodiment.

As noted above, the illumination used may include both white light and fluorescence excitation illumination, e.g., from a laser, to excite near infrared (NIR) light from the target. However, ambient light may interfere with the light from the target.

FIG. 11A illustrates a timing diagram for white light (RGB) and fluorescence excitation (Laser) illumination, and visible (VIS) and NIR fluorescence (FL) imaging sensor exposures configured to allow ambient room light subtraction from the fluorescence signal with a single sensor. As used herein, a white pulse will indicate that the white light (RGB) is illuminating the target and an excitation pulse will indicate that the laser is illuminating the target.

Exposures of even (Exp 1) and odd (Exp 2) sensor pixel rows are shown interleaved with differing exposure times to facilitate isolation of an estimate of the ambient room light signal component. Such an interleaved exposure read-out mode is offered on some imaging sensors, such as the ‘High Dynamic Range Interleaved Read-out’ mode offered on the CMOSIS CMV2000 sensor.

Pulsing the white light illumination at 80 Hz brings the frequency of the flashing light above that which is perceptible by the human eye or which may trigger epileptic seizures. The visible light image exposure may be longer than, e.g., twice, the RGB illumination to ensure overlap between the 60 Hz exposure frame rate and the 80 Hz RGB illumination pulse. Extra ambient light captured during the visible exposure may be ignored, due to the much greater intensity of the RGB illumination pulse and signal from the target 12.

By setting the NIR fluorescence image exposure times Exp 1 and Exp 2 to acquire for one half frame and one quarter frame periods, respectively, while running the excitation laser only in the last one quarter of every third frame, the even rows (Exp 1) record one half frame of ambient room light in addition to one quarter frame of NIR fluorescence, while the odd rows (Exp 2) record one quarter frame of ambient room light plus one quarter frame of NIR fluorescence. Performing these fractional exposures within each visible or NIR fluorescence frame minimizes motion artifacts which would otherwise be caused by inserting additional exposure frames into the frame sequence for the purpose of ambient room light subtraction.

With such an acquisition design, an estimate of the ambient room light contribution to the image signals can be isolated by subtracting the Exp 2 sensor rows of the NIR fluorescence image from the Exp 1 sensor rows (interpolated to match Exp 2 pixel positions), yielding an estimate of one quarter frame of ambient room light signal. The estimate of one quarter frame of ambient room light signal can then be subtracted from the Exp 2 sensor rows of the NIR fluorescence image to yield an estimate of the NIR fluorescence signal with the one quarter frame of ambient room light removed. The control of the illumination and the exposure may be performed by the VPI box 14.

In one embodiment, the above room light subtraction method may be altered in order to accommodate use of a Bayer-pattern color sensor. FIG. 12A illustrates a Bayer pattern arrangement of colored sensor pixels, wherein the even sensor rows and odd sensor rows have different filter arrangements (e.g., no red pixels in the even sensor rows and no blue pixels in the odd sensor rows), so the ambient light recorded on even rows will not be a good estimate of what reached the odd rows over the same period. However, every row does include green pixel signals, which are also sensitive to NIR fluorescence. Using only the green pixels, and performing a two-dimensional interpolation from the green pixel signals to the other pixel locations can yield an estimate of the ambient light signal component, and thus also of the NIR fluorescence or visible light components for the NIR and visible light images, respectively.

In order to calculate the NIR signal value at a given location, calculate the Exp 1 (even row) and Exp 2 (odd row) green pixel values near that location, with one or both of those values needing to be interpolated. FIG. 12B demonstrates an example wherein at a red pixel location, the best estimate of the Exp 1 (even row) green value is the average of the immediately neighboring green values above and below, while the best estimate of the Exp 2 (odd row) green value is the average of the immediately neighboring green values to the left and right.

The following mathematical example serves to illustrate an embodiment of the ambient room light subtraction method. If A=ambient light incident in one quarter frame period, and F=fluorescence incident in one quarter frame period, then:

Exp 1=2A+F
Exp 2=A+F

Solving for F yields:

F=2*Exp2−Exp1

In the particular example illustrated in FIG. 11A, a period for the sensing is three frames, the white light pulse and the excitation pulse have a same duration or width, but different frequencies, the visible light is sensed during two frames, e.g., the first two frames, and the fluorescence is sensed for during one frame, e.g., the third or final frame, for two different exposure times. As shown therein, the visible exposure time may be twice the duration of the white light pulse, a first fluorescent exposure times may be equal to the duration of the excitation pulse, and a second fluorescent exposure time may be pulse longer, e.g., twice, than the excitation pulse. Further, the visible exposure may have a different frequency than the white light pulse, e.g., visible exposure does not occur with every white light pulse, while the fluorescent exposure may have a same frequency as the excitation pulse.

Alternative timing and exposure diagrams are discussed below, in which a sensor having rows that are all active for a common exposure duration may be used while still compensating for ambient light using a single sensor. For example, background light may be directly detected by the sensor when the target is not illuminated. Other variations on pulsing, exposing, and sensing may be apparent to those of skill in the art.

FIG. 11B illustrates an alternative timing diagram for white light (RGB) and fluorescence excitation (Laser) illumination, and visible (VIS) and NIR fluorescence (FL) imaging sensor exposures configured to allow ambient room light subtraction from the fluorescence signal with a single sensor. Exposures for visible light and for fluorescence are shown in sequence along with an exposure to capture the background (BG) image signal due to ambient light. The white light illumination may be pulsed at 80 Hz as described above. The fluorescence excitation illumination may be pulsed at 20 Hz and the pulse duration or width may be increased, e.g., up to double the white light pulse duration, to enable a longer corresponding fluorescence exposure. If using an imaging sensor with a global shutter, each sensor exposure must terminate with the read-out period at the end of an imaging frame. An exposure to capture the ambient light background image signal may be performed at the end portion of a frame in the absence of any pulsed white light or excitation light. In the case of acquiring video at a frame rate of 60 Hz, as shown in the example in FIG. 11B, a white light illumination pulse width of one quarter frame duration may be used, along with a one quarter frame duration visible light exposure occurring in frames when the end of a white light illumination pulse is aligned with the end of the frame.

A scaled image signal recorded during one or more background exposures can be subtracted from each fluorescence exposure image to remove the contribution of ambient light from the fluorescence image. For example, the image signal from a one quarter frame duration background exposure may be scaled up by two times and subtracted from a subsequent image signal from a one half frame duration fluorescence exposure. As another example, a one quarter frame duration background exposure image signal prior to a one half frame duration fluorescence exposure image signal, and a second one quarter frame background image signal subsequent to the fluorescence exposure, may both be subtracted from the fluorescence image signal. Scaling of the image signals from a first and a second background exposure can include interpolation of pixel values from the first exposure time point and the second exposure time point to estimate pixel values corresponding to an intermediate time point.

Use of an imaging sensor with high speed read-out that enables higher video frame acquisition rates may allow for additional exposure periods to be allocated within an illumination and exposure timing scheme for a given white light pulse frequency. For example, maintaining an 80 Hz white light illumination pulse as above and using a sensor with a higher video frame acquisition rate such as 120 Hz may allow additional white light, ambient background, or fluorescence exposures within a given time period, compared to when using a slower video frame acquisition rate such as 60 Hz.

In the particular example illustrated in FIG. 11B, a period for the sensing is three frames, the excitation pulse has twice the width of the white light pulse, the visible light is sensed during one frame, e.g., the first frame, the background light is sensed during one frame, e.g., the second frame, and the fluorescence is sensed during one frame, e.g., the third or final frame. Here, a visible exposure time may be equal to the duration of the white light pulse, the background exposure time may be equal to the duration of the white light pulse, and the fluorescence exposure time may be equal to the duration of the excitation pulse. Further, the visible exposure may have a different frequency than the white light pulse, e.g., visible exposure does not occur with every white light pulse, while the fluorescent exposure may have a same frequency as the excitation pulse. Finally, the background exposure may occur only once within the period.

FIG. 11C illustrates an alternative timing diagram for white light (RGB) and fluorescence excitation (Laser) illumination, and visible (VIS) and NIR fluorescence (FL) imaging sensor exposures configured to allow ambient room light subtraction from the fluorescence signal with a single sensor with a 120 Hz video frame acquisition rate. A white light pulse frequency of 80 Hz is used, and a white light illumination pulse width of one half frame duration may be used, along with a one half frame duration visible light exposure occurring in frames when the end of a white light illumination pulse is aligned with the end of the frame. The fluorescence excitation illumination is shown pulsed at 40 Hz with a pulse duration of one frame, to enable a higher frequency of corresponding fluorescence exposures. An exposure to capture the ambient light background image signal may be performed at the end portion of a frame in the absence of any pulsed white light or excitation light, such as an exposure of one half frame duration occurring in the frame between a fluorescence exposure and a successive white light exposure as shown in this example embodiment.

In the particular example illustrated in FIG. 11C, a period for the sensing is three frames, the excitation pulse has twice the width of the white light pulse, the visible light is sensed during one frame, e.g., the second frame, the background light is sensed during one frame, e.g., the first frame, and the fluorescence is sensed during one frame, e.g., the third or final frame. Here, a visible exposure time may be equal to the duration of the white light pulse, the background exposure time may be equal to the duration of the white light pulse, and the fluorescence exposure time may be equal to the duration of the excitation pulse. Further, the visible exposure may have a different frequency than the white light pulse, e.g., visible exposure does not occur with every white light pulse, while the fluorescent exposure may have a same frequency as the excitation pulse. Finally, the background exposure may occur only once within the period.

Depending on the intensity of the fluorescence excitation light used, there may be safety considerations limiting the duration and frequency of excitation light pulses. One approach to reduce the excitation light intensity applied is to reduce the duration of the excitation light pulses and the corresponding fluorescence exposures. Additionally or alternatively, the frequency of excitation light pulses (and corresponding fluorescence exposures) may be reduced, and the read-out periods which could otherwise be used for fluorescence exposures may instead be used for background exposures to improve measurement of the ambient light.

FIG. 11D illustrates an alternative timing diagram for white light (RGB) and fluorescence excitation (Laser) illumination, and visible (VIS) and NIR fluorescence (FL) imaging sensor exposures configured to allow ambient room light subtraction from the fluorescence signal with a single sensor with a 120 Hz video frame acquisition rate. A white light pulse frequency of 80 Hz is used, and a white light illumination pulse width of one half frame duration may be used, along with a one half frame duration visible light exposure occurring in frames when the end of a white light illumination pulse is aligned with the end of the frame. The fluorescence excitation illumination is shown pulsed at 20 Hz with a pulse duration of one frame. An exposure to capture the ambient light background image signal may be performed at the end portion of a frame in the absence of any pulsed white light or excitation light, such as a background exposure of one half frame duration occurring in the frame between a fluorescence exposure and a successive first white light exposure, and a first background exposure of one frame duration and a second background exposure of one half frame duration both occurring in the frames between the first white light exposure and a successive second white light exposure, as shown in this example embodiment.

In the particular example illustrated in FIG. 11D, a period for the sensing is six frames, the excitation pulse has twice the width of the white light pulse, the visible light is sensed during two frames, e.g., the second and fifth frames, the background light is sensed during three frames, e.g., the first, third, and fourth frames, and the fluorescence is sensed for during one frame, e.g., the sixth or final frame. Here, a visible exposure time may be equal to the duration of the white light pulse, the background exposure time may be equal to or twice the duration of the white light pulse, and the fluorescence exposure time may be equal to the duration of the excitation pulse. Further, the visible exposure may have a different frequency than the white light pulse, e.g., visible exposure does not occur with every white light pulse, e.g., only twice within the period, while the fluorescent exposure may have a same frequency as the excitation pulse. Finally, the background exposure may occur three times within the period for a total duration equal to four times the duration of the white light pulse.

To improve performance of such ambient room light compensation methods as described above, a wavelength-dependent aperture (e.g., element 55 in FIG. 6A) may be used that includes a smaller central aperture that permits transmission of all visible and NIR light, and a surrounding larger aperture that blocks visible light but permits transmission of NIR light. Use of such a wavelength-dependent aperture allows a larger proportion of NIR signal to be collected relative to the visible light signal, which improves performance of the image signal subtraction for estimation and removal of the ambient room light component. A wavelength-dependent aperture may also feature a third, larger aperture, surrounding the other smaller apertures, that blocks both visible and NIR light. As an example, a wavelength-dependent aperture may comprise a film aperture, wherein a film (e.g., a plastic or glass film) of material that blocks transmission of visible light but permits transmission of NIR light has a central opening (e.g., a hole) that permits transmission of both visible and NIR light. Such a film aperture may comprise material that blocks transmission of visible light through reflection and/or material that blocks transmission of visible light through absorption. As another example, a wavelength-dependent aperture may comprise a dichroic aperture which is formed by masked thin-film deposition on a single substrate, wherein a thin-film that permits transmission of visible and NIR light is deposited on a smaller central aperture, and a second thin-film that blocks transmission of visible light but permits transmission of NIR light is deposited on a surrounding larger aperture. The respective aperture sizes of the smaller central aperture and the surrounding larger aperture of a wavelength-dependent aperture may be set in order to make the depth of field for visible light and for NIR light appear substantially similar when imaged by the imaging system. One or more wavelength-dependent filters may be placed in different positions throughout the device, where rejection of the visible and passage of the NIR signal may be optimized. For example, such a wavelength-dependent filter may be positioned just before the lens 51. As another example, one or more wavelength-dependent filters may be placed in a pupil plane of the imaging lens.

It may be useful, e.g., to facilitate comparison of the fluorescence signal of different regions, to display a target reticle around a region within the imaged field of view, and to calculate and display the normalized fluorescence intensity within that region. Normalization of the measured fluorescence intensity values may allow for meaningful comparison of multiple images and corresponding values. To correct for the variation of measured fluorescence intensity with working distance (e.g., distance of the imaging system to the imaged anatomy), normalized fluorescence intensity values may be based on a ratio between the measured fluorescence intensity values and a reflected light value within the target reticle region.

A numerical representation of the normalized fluorescence intensity value within the target reticle region may be displayed on or near the image frame, to facilitate comparing values when aiming the target reticle at different locations on the imaged anatomy. For example, the numerical representation may be the mean value of the normalized fluorescence intensity values for all of the image pixels in the target reticle region.

Additionally or alternatively, a time history plot of the numerical representation of the normalized fluorescence intensity value within the target reticle region may be displayed on or near the image frame, to facilitate comparing values when aiming the target reticle at different locations on the imaged anatomy or at the same location over a series of time points. Such a time history plot may further assist the user in assessing the fluorescence profile in the imaged tissue surface by scanning across the anatomy region of interest and viewing the relative normalized fluorescence intensity profile plot.

FIG. 13A illustrates a diagram of a sample display output from an embodiment of the display method, wherein the target reticle 125 is positioned over a region of no fluorescence intensity 122 on the imaged anatomy 120, and the numerical representation of the fluorescence intensity 126 is displayed near the target reticle 125. FIG. 13B illustrates a diagram of another sample display output, wherein the target reticle 125 is positioned over a region of high relative normalized fluorescence intensity 124, and showing a corresponding numerical representation 126 of relatively high fluorescence intensity. FIG. 13C illustrates a diagram of another sample display output, wherein the target reticle 125 is positioned over a region of moderate relative normalized fluorescence intensity 124, and showing a corresponding numerical representation 126 of relatively moderate fluorescence intensity. FIG. 13D illustrates a diagram of a sample display output, wherein the target reticle 125 is positioned over a region of moderate relative normalized fluorescence intensity 124, and showing a time history plot 128 of the numerical representation of normalized fluorescence intensity that would be consistent with sequential imaging of regions of zero, high, and moderate relative normalized fluorescence intensity. Alternatively or additionally to displaying the numerical representation and/or historical plot on the target, a display region associated with the target reticle, e.g., on the device itself or some other display, may display this information.

FIG. 14 illustrates a recorded image of an anatomical fluorescence imaging phantom, featuring an embodiment of a display method output that displays normalized fluorescence intensity. In particular, a target 110 is illuminated by excitation light in accordance with an embodiment and a target reticle 115 is positioned over a region of fluorescence intensity 112. A numerical representation of the target reticle 115 is displayed in a region 116 associated with the target reticle 115. A time history plot 118 of the numerical representation of normalized fluorescence intensity due to imaging of different positions of the reticle 115 may be displayed.

Such a display method may be useful for a variety of fluorescence imaging systems, including an endoscopic or laparoscopic fluorescence imaging system, an open field fluorescence imaging system, or a combination thereof. Such normalization and display of the fluorescence intensity values can allow useful quantitative comparisons of relative fluorescence intensity between image data from various time points within an imaging session. Combined with appropriate standardized fluorescent agent administration and imaging protocols, and standardized calibration of imaging devices, such normalization and display of the fluorescence intensity values can further allow useful quantitative comparisons of relative fluorescence intensity between image data from different imaging sessions.

Examples

A Fluorescence Medical Imaging System for Acquisition of Image Data

In some embodiments, a system for illumination and imaging of a subject may be used with or as a component of a medical imaging system such as, for example, a fluorescence medical imaging system for acquiring fluorescence medical image data. An example of such a fluorescence medical imaging system is the fluorescence imaging system 10 schematically illustrated in FIG. 1. In this embodiment, the fluorescence imaging system 10 is configured to acquire a time series of fluorescence signal intensity data (e.g., images, video) capturing the transit of a fluorescence imaging agent through the tissue.

The fluorescence imaging system 10 (FIG. 1) comprises an illumination source 15 and illumination module 11 to illuminate the tissue of the subject to induce fluorescence emission from a fluorescence imaging agent 17 in the tissue of the subject (e.g., in blood), an imaging module 13 configured to acquire the time series of fluorescence images from the fluorescence emission, and a processor assembly 16 configured to utilize the acquired time series of fluorescence images (fluorescence signal intensity data) according to the various embodiments described herein.

In various embodiments, the illumination source 15 (FIG. 1) comprises, for example, a light source 200 (FIG. 15) comprising a fluorescence excitation source configured to generate an excitation light having a suitable intensity and a suitable wavelength for exciting the fluorescence imaging agent 17. The light source 200 in FIG. 15 comprises a laser diode 202 (e.g., which may comprise, for example, one or more fiber-coupled diode lasers) configured to provide excitation light to excite the fluorescence imaging agent 17 (not shown). Examples of other sources of the excitation light which may be used in various embodiments include one or more LEDs, arc lamps, or other illuminant technologies of sufficient intensity and appropriate wavelength to excite the fluorescence imaging agent 17 in the tissue (e.g., in blood). For example, excitation of the fluorescence imaging agent 17 in blood, wherein the fluorescence imaging agent 17 is a fluorescent dye with near infra-red excitation characteristics, may be performed using one or more 793 nm, conduction-cooled, single bar, fiber-coupled laser diode modules from DILAS Diode Laser Co, Germany.

In various embodiments, the light output from the light source 200 in FIG. 15 may be projected through an optical element (e.g., one or more optical elements) to shape and guide the output being used to illuminate the tissue area of interest. The shaping optics may consist of one or more lenses, light guides, and/or diffractive elements so as to ensure a flat field over substantially the entire field of view of the imaging module 13. In particular embodiments, the fluorescence excitation source is selected to emit at a wavelength close to the absorption maximum of the fluorescence imaging agent 17 (e.g., ICG). For example, referring to the embodiment of the light source 200 in FIG. 15, the output 204 from the laser diode 202 is passed through one or more focusing lenses 206, and then through a homogenizing light pipe 208 such as, for example, light pipes commonly available from Newport Corporation, USA. Finally, the light is passed through an optical diffractive element 214 (e.g., one or more optical diffusers) such as, for example, ground glass diffractive elements also available from Newport Corporation, USA. Power to the laser diode 202 itself is provided by, for example, a high-current laser driver such as those available from Lumina Power Inc. USA. The laser may optionally be operated in a pulsed mode during the image acquisition process. In this embodiment, an optical sensor such as a solid state photodiode 212 is incorporated into the light source 200 and samples the illumination intensity produced by the light source 200 via scattered or diffuse reflections from the various optical elements. In various embodiments, additional illumination sources may be used to provide guidance when aligning and positioning the module over the area of interest. In various embodiments, at least one of the components of light source 200 depicted in FIG. 15 may be components comprising the illumination source 15 and/or comprising the illumination module 11.

Referring back to FIG. 1, in various embodiments, the imaging module 13 may be a component of, for example, the fluorescence imaging system 10 configured to acquire the time series of fluorescence images (e.g., video) from the fluorescence emission from the fluorescence imaging agent 17. Referring to FIG. 16, there is shown an exemplary embodiment of an imaging module 13 comprising a camera module 250. As is shown in FIG. 16, the camera module 250 acquires images of the fluorescence emission 252 from the fluorescence imaging agent 17 in the tissue (e.g., in blood) (not shown) by using a system of imaging optics (e.g., front element 254, rejection filter 256, dichroic 260 and rear element 262) to collect and focus the fluorescence emission onto an image sensor assembly 264 comprising at least one 2D solid state image sensor. A rejection filter 256 may be, for example, a notch filter used to reject a band of wavelengths corresponding to the excitation light. A dichroic 260 may be, for example, a dichroic mirror used to selectively pass one subset of the incoming light wavelength spectrum and redirect remaining wavelengths off of the optical path for rejection or towards a separate image sensor. The solid state image sensor may be a charge coupled device (CCD), a CMOS sensor, a CID or similar 2D sensor technology. The charge that results from the optical signal transduced by the image sensor assembly 264 is converted to an electrical video signal, which includes both digital and analog video signals, by the appropriate read-out and amplification electronics in the camera module 250.

According to some embodiments, excitation wavelength of about 800 nm+/−10 nm and emission wavelengths of >820 nm are used along with NIR compatible optics for ICG fluorescence imaging. A skilled person will appreciate that other excitation and emission wavelengths may be used for other imaging agents.

Referring back to FIG. 1, in various embodiments, the processor assembly 16 comprises, for example,

- a processor module (not shown) configured to perform various processing operations, including executing instructions stored on computer-readable medium, wherein the instructions cause one or more of the systems described herein to execute the methods and techniques described herein, and
- a data storage module (not shown) to record and store the data from the operations, as well as to store, in some embodiments, instructions executable by the processor module to implement the methods and techniques disclosed herein.

In various embodiments, the processor module comprises any computer or computing means such as, for example, a tablet, laptop, desktop, networked computer, or dedicated standalone microprocessor. Inputs are taken, for example, from the image sensor 264 of the camera module 250 shown in FIG. 16, from the solid state photodiode in the light source 200 in FIG. 15, and from any external control hardware such as a footswitch or remote-control. Output is provided to the laser diode driver, and optical alignment aids. In various embodiments, the processor assembly 16 (FIG. 1) may have a data storage module with the capability to save the time series of input data (e.g., image data) to a tangible non-transitory computer readable medium such as, for example, internal memory (e.g. a hard disk or flash memory), so as to enable recording and processing of data. In various embodiments, the processor module may have an internal clock to enable control of the various elements and ensure correct timing of illumination and sensor shutters. In various other embodiments, the processor module may also provide user input and graphical display of outputs. The fluorescence imaging system may optionally be configured with a video display (not shown) to display the images as they are being acquired or played back after recording, or further to visualize the data generated at various stages of the method as was described above.

In operation, and with continuing reference to the exemplary embodiments in FIGS. 1, 15 and 16, the subject is in a position for imaging where the anatomical area of interest of the subject is located beneath both the illumination module 11 and the imaging module 13 such that a substantially uniform field of illumination is produced across substantially the entire area of interest. In various embodiments, prior to the administration of the fluorescence imaging agent 17 to the subject, an image may be acquired of the area of interest for the purposes of background deduction. For example, in order to do this, the operator of the fluorescence imaging system 10 in FIG. 1 may initiate the acquisition of the time series of fluorescence images (e.g., video) by depressing a remote switch or foot-control, or via a keyboard (not shown) connected to the processor assembly 16. As a result, the illumination source 15 is turned on and the processor assembly 16 begins recording the fluorescence image data provided by the image acquisition assembly 13. In lieu of the pulsed mode discussed above, it will be understood that, in some embodiments, the illumination source 15 can comprise an emission source which is continuously on during the image acquisition sequence. When operating in the pulsed mode of the embodiment, the image sensor 264 in the camera module 250 (FIG. 16) is synchronized to collect fluorescence emission following the laser pulse produced by the diode laser 202 in the light source 200 (FIG. 15). In this way, maximum fluorescence emission intensity is recorded, and signal-to-noise ratio is optimized. In this embodiment, the fluorescence imaging agent 17 is administered to the subject and delivered to the area of interest via arterial flow. Acquisition of the time series of fluorescence images is initiated, for example, shortly after administration of the fluorescence imaging agent 17, and the time series of fluorescence images from substantially the entire area of interest are acquired throughout the ingress of the fluorescence imaging agent 17. The fluorescence emission from the region of interest is collected by the collection optics of the camera module 250. Residual ambient and reflected excitation light is attenuated by subsequent optical elements (e.g., optical element 256 in FIG. 16 which may be a filter) in the camera module 250 so that the fluorescence emission can be acquired by the image sensor assembly 264 with minimal interference by light from other sources.

In various embodiments, the processor is in communication with the imaging system or is a component of the imaging system. The program code or other computer-readable instructions, according to the various embodiments, can be written and/or stored in any appropriate programming language and delivered to the processor in various forms, including, for example, but not limited to information permanently stored on non-writeable storage media (e.g., read-only memory devices such as ROMs or CD-ROM disks), information alterably stored on writeable storage media (e.g., hard drives), information conveyed to the processor via transitory mediums (e.g., signals), information conveyed to the processor through communication media, such as a local area network, a public network such as the Internet, or any type of media suitable for storing electronic instruction. In various embodiments, the tangible non-transitory computer readable medium comprises all computer-readable media. In some embodiments, computer-readable instructions for performing one or more of the methods or techniques discussed herein may be stored solely on non-transitory computer readable media.

In some embodiments, the illumination and imaging system may be a component of a medical imaging system such as the fluorescence medical imaging system 10, which acquires medical image data. In embodiments where the illumination and imaging system is a component of the imaging system, such as the fluorescence imaging system described above, the light source, illumination module, imaging module and the processor of the medical imaging system may function as the camera assembly and the processor of the illumination and imaging system. A skilled person will appreciate that imaging systems other than fluorescence imaging systems may be employed for use with illumination and/or imaging systems such as those described herein, depending on the type of imaging being performed.

Example Imaging Agents for Use in Generating Image Data

According to some embodiments, in fluorescence medical imaging applications, the imaging agent is a fluorescence imaging agent such as, for example, indocyanine green (ICG) dye. ICG, when administered to the subject, binds with blood proteins and circulates with the blood in the tissue. The fluorescence imaging agent (e.g., ICG) may be administered to the subject as a bolus injection (e.g., into a vein or an artery) in a concentration suitable for imaging such that the bolus circulates in the vasculature and traverses the microvasculature. In other embodiments in which multiple fluorescence imaging agents are used, such agents may be administered simultaneously, e.g. in a single bolus, or sequentially in separate boluses. In some embodiments, the fluorescence imaging agent may be administered by a catheter. In certain embodiments, the fluorescence imaging agent may be administered less than an hour in advance of performing the measurement of signal intensity arising from the fluorescence imaging agent. For example, the fluorescence imaging agent may be administered to the subject less than 30 minutes in advance of the measurement. In yet other embodiments, the fluorescence imaging agent may be administered at least 30 seconds in advance of performing the measurement. In still other embodiments, the fluorescence imaging agent may be administered contemporaneously with performing the measurement.

According to some embodiments, the fluorescence imaging agent may be administered in various concentrations to achieve a desired circulating concentration in the blood. For example, in embodiments where the fluorescence imaging agent is ICG, it may be administered at a concentration of about 2.5 mg/mL to achieve a circulating concentration of about 5 μM to about 10 μM in blood. In various embodiments, the upper concentration limit for the administration of the fluorescence imaging agent is the concentration at which the fluorescence imaging agent becomes clinically toxic in circulating blood, and the lower concentration limit is the instrumental limit for acquiring the signal intensity data arising from the fluorescence imaging agent circulating with blood to detect the fluorescence imaging agent. In various other embodiments, the upper concentration limit for the administration of the fluorescence imaging agent is the concentration at which the fluorescence imaging agent becomes self-quenching. For example, the circulating concentration of ICG may range from about 2 μM to about 10 mM. Thus, in one aspect, the method comprises the step of administration of the imaging agent (e.g., a fluorescence imaging agent) to the subject and acquisition of the signal intensity data (e.g., video) prior to processing the signal intensity data according to the various embodiments. In another aspect, the method excludes any step of administering the imaging agent to the subject.

According to some embodiments, a suitable fluorescence imaging agent for use in fluorescence imaging applications to generate fluorescence image data is an imaging agent which can circulate with the blood (e.g., a fluorescence dye which can circulate with, for example, a component of the blood such as lipoproteins or serum plasma in the blood) and transit vasculature of the tissue (i.e., large vessels and microvasculature), and from which a signal intensity arises when the imaging agent is exposed to appropriate light energy (e.g., excitation light energy, or absorption light energy). In various embodiments, the fluorescence imaging agent comprises a fluorescence dye, an analogue thereof, a derivative thereof, or a combination of these. A fluorescence dye includes any non-toxic fluorescence dye. In certain embodiments, the fluorescence dye optimally emits fluorescence in the near-infrared spectrum. In certain embodiments, the fluorescence dye is or comprises a tricarbocyanine dye. In certain embodiments, the fluorescence dye is or comprises indocyanine green (ICG), methylene blue, or a combination thereof. In other embodiments, the fluorescence dye is or comprises fluorescein isothiocyanate, rhodamine, phycoerythrin, phycocyanin, allophycocyanin, o-phthaldehyde, fluorescamine, rose Bengal, trypan blue, fluoro-gold, or a combination thereof, excitable using excitation light wavelengths appropriate to each dye. In some embodiments, an analogue or a derivative of the fluorescence dye may be used. For example, a fluorescence dye analog or a derivative includes a fluorescence dye that has been chemically modified, but still retains its ability to fluoresce when exposed to light energy of an appropriate wavelength.

In various embodiments, the fluorescence imaging agent may be provided as a lyophilized powder, solid, or liquid. In certain embodiments, the fluorescence imaging agent may be provided in a vial (e.g., a sterile vial), which may permit reconstitution to a suitable concentration by administering a sterile fluid with a sterile syringe. Reconstitution may be performed using any appropriate carrier or diluent. For example, the fluorescence imaging agent may be reconstituted with an aqueous diluent immediately before administration. In various embodiments, any diluent or carrier which will maintain the fluorescence imaging agent in solution may be used. As an example, ICG may be reconstituted with water. In some embodiments, once the fluorescence imaging agent is reconstituted, it may be mixed with additional diluents and carriers. In some embodiments, the fluorescence imaging agent may be conjugated to another molecule, such as a protein, a peptide, an amino acid, a synthetic polymer, or a sugar, for example to enhance solubility, stability, imaging properties, or a combination thereof. Additional buffering agents may optionally be added including Tris, HCl, NaOH, phosphate buffer, and/or HEPES.

A person of skill in the art will appreciate that, although a fluorescence imaging agent was described above in detail, other imaging agents may be used in connection with the systems, methods, and techniques described herein, depending on the optical imaging modality.

In some embodiments, the fluorescence imaging agent used in combination with the methods and systems described herein may be used for blood flow imaging, tissue perfusion imaging, lymphatic imaging, or a combination thereof, which may performed during an invasive surgical procedure, a minimally invasive surgical procedure, a non-invasive surgical procedure, or a combination thereof. Examples of invasive surgical procedure which may involve blood flow and tissue perfusion include a cardiac-related surgical procedure (e.g., CABG on pump or off pump) or a reconstructive surgical procedure. An example of a non-invasive or minimally invasive procedure includes wound (e.g., chronic wound such as for example pressure ulcers) treatment and/or management. Examples of lymphatic imaging include identification of one or more lymph nodes, lymph node drainage, lymphatic mapping, or a combination thereof. In some variations such lymphatic imaging may relate to the female reproductive system (e.g., uterus, cervix, vulva). In some embodiments, the fluorescence imaging agent may be administered in sufficient concentrations and in a suitable manner so as to effect lymphatic imaging.

Tissue perfusion relates to the microcirculatory flow of blood per unit tissue volume in which oxygen and nutrients are provided to and waste is removed from the capillary bed of the tissue being perfused. Tissue perfusion is a phenomenon related to but also distinct from blood flow in vessels. Quantified blood flow through blood vessels may be expressed in terms that define flow (i.e., volume/time), or that define speed (i.e., distance/time). Tissue blood perfusion defines movement of blood through micro-vasculature, such as arterioles, capillaries, or venules, within a tissue volume. Quantified tissue blood perfusion may be expressed in terms of blood flow through tissue volume, namely, that of blood volume/time/tissue volume (or tissue mass). Perfusion is associated with nutritive blood vessels (e.g., micro-vessels known as capillaries) that comprise the vessels associated with exchange of metabolites between blood and tissue, rather than larger-diameter non-nutritive vessels. In some embodiments, quantification of a target tissue may include calculating or determining a parameter or an amount related to the target tissue, such as a rate, size volume, time, distance/time, and/or volume/time, and/or an amount of change as it relates to any one or more of the preceding parameters or amounts. However, compared to blood movement through the larger diameter blood vessels, blood movement through individual capillaries can be highly erratic, principally due to vasomotion, wherein spontaneous oscillation in blood vessel tone manifests as pulsation in erythrocyte movement.

By way of summation and review, one or more embodiments may accommodate varied working distances while providing a flat illumination field and matching an illumination field to a target imaging field, thus allowing accurate quantitative imaging applications. An imaging element that focuses light from a target onto a sensor may be moved in synchrony with steering of the illumination field. Additionally or alternatively, a drape may be used that insures a close fit between a drape lens and a window frame of the device. Additionally or alternatively, one or more embodiments may allow ambient light to be subtracted from light to be imaged using a single sensor and controlled timing of illumination and exposure or detection. Additionally or alternatively, one or more embodiments may allow the display of a normalized fluorescence intensity measured within a target reticle region of an image frame.

In contrast, when illumination and imaging devices do not conform illumination to the target imaging field of view or provide a flat, i.e., even or substantially uniform, illumination field, illumination and image quality may suffer. An uneven illumination field can cause distracting and inaccurate imaging artifacts, especially for hand held imaging devices and when used at varied working distances, while excess light outside the imaging field of view reduces device efficiency and can distract the user when positioning the device.

The methods and processes described herein may be performed by code or instructions to be executed by a computer, processor, manager, or controller, or in hardware or other circuitry. Because the algorithms that form the basis of the methods (or operations of the computer, processor, or controller) are described in detail, the code or instructions for implementing the operations of the method embodiments may transform the computer, processor, or controller into a special-purpose processor for performing the methods described herein.

Also, another embodiment may include a computer-readable medium, e.g., a non-transitory computer-readable medium, for storing the code or instructions described above. The computer-readable medium may be a volatile or non-volatile memory or other storage device, which may be removably or fixedly coupled to the computer, processor, or controller which is to execute the code or instructions for performing the method embodiments described herein.

Example embodiments have been disclosed herein, and although specific terms are employed, they are used and are to be interpreted in a generic and descriptive sense only and not for purpose of limitation. In some instances, as would be apparent to one of ordinary skill in the art as of the filing of the present application, features, characteristics, and/or elements described in connection with a particular embodiment may be used singly or in combination with features, characteristics, and/or elements described in connection with other embodiments unless otherwise specifically indicated. Accordingly, it will be understood by those of skill in the art that various changes in form and details may be made without departing from the spirit and scope of the present invention as set forth in the following.

While the present disclosure has been illustrated and described in connection with various embodiments shown and described in detail, it is not intended to be limited to the details shown, since various modifications and structural changes may be made without departing in any way from the scope of the present disclosure. Various modifications of form, arrangement of components, steps, details and order of operations of the embodiments illustrated, as well as other embodiments of the disclosure may be made without departing in any way from the scope of the present disclosure, and will be apparent to a person of skill in the art upon reference to this description. It is therefore contemplated that the appended claims will cover such modifications and embodiments as they fall within the true scope of the disclosure. For the purpose of clarity and a concise description, features are described herein as part of the same or separate embodiments, however, it will be appreciated that the scope of the disclosure includes embodiments having combinations of all or some of the features described. For the terms “for example” and “such as,” and grammatical equivalences thereof, the phrase “and without limitation” is understood to follow unless explicitly stated otherwise. As used herein, the singular forms “a”, “an”, and “the” include plural referents unless the context clearly dictates otherwise.

Claims

1. A method of displaying fluorescence intensity for imaged anatomy, the method comprising: displaying images of the anatomy captured by an optical imaging device being aimed at the anatomy;displaying a target reticle on the displayed images around a region of a field of view of the imaging device;calculating a representation of normalized fluorescence intensity within the target reticle based on normalized fluorescence intensity values for a plurality of pixels within the target reticle;displaying the representation of normalized fluorescence intensity in a display region associated with the target reticle;moving the field of view of the imaging device and the target reticle relative to the imaged anatomy; andupdating the calculated and displayed representation of the normalized fluorescence intensity within the target reticle as the imaging device is aimed at different locations on the imaged anatomy.
2. The method of claim 1, wherein the display region is projected onto the target reticle.
3. The method of claim 1, wherein the normalized fluorescence intensity includes a single numerical value.
4. The method of claim 1, wherein the representation of the normalized fluorescence intensity includes a historical plot of normalized fluorescence intensities.
5. The method of claim 4, further comprising updating the historical plot while moving the field of view of the imaging device and the target reticle relative to the imaged anatomy.
6. The method of claim 5, wherein the historical plot shows changes in the normalized fluorescence intensity as the field of view of the imaging device and the target reticle is moved relative to the imaged anatomy.
7. The method of claim 1, wherein the normalized fluorescence intensity value is based on a ratio between a measured fluorescence intensity value and a reflected light value within the target reticle.
8. The method of claim 1, comprising comparing normalized fluorescence intensity values associated with the different locations on the imaged anatomy.
9. A system comprising a display, one or more processors, memory, and one or more programs stored in the memory for execution by the one or more processors, the one or more programs including instructions for: displaying, on the display, images of anatomy captured by an optical imaging device being aimed at the anatomy;displaying, on the display, a target reticle on the displayed images around a region of a field of view of the imaging device;calculating a representation of normalized fluorescence intensity within the target reticle based on normalized fluorescence intensity values for a plurality of pixels within the target reticle;displaying, on the display, the representation of normalized fluorescence intensity in a display region associated with the target reticle;moving the field of view of the imaging device and the target reticle relative to the imaged anatomy; andupdating the calculated and displayed representation of the normalized fluorescence intensity within the target reticle as the imaging device is aimed at different locations on the imaged anatomy.
10. The system of claim 9, wherein the one or more programs include instructions for projecting the display region onto the target reticle.
11. The system of claim 9, wherein the normalized fluorescence intensity includes a single numerical value.
12. The system of claim 9, wherein the representation of the normalized fluorescence intensity includes a historical plot of normalized fluorescence intensities.
13. The system of claim 12, the one or more programs including instructions for updating the historical plot while moving the field of view of the imaging device and the target reticle relative to the imaged anatomy.
14. The system of claim 9, wherein the normalized fluorescence intensity value is based on a ratio between a measured fluorescence intensity value and a reflected light value within the target reticle.
15. The system of claim 13, wherein the historical plot shows changes in the normalized fluorescence intensity as the field of view of the imaging device and the target reticle is moved relative to the imaged anatomy.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 16/441,493, filed Jun. 14, 2019, which is a divisional of U.S. patent application Ser. No. 15/348,664, filed Nov. 10, 2016, now U.S. Pat. No. 10,356,334, which claims the benefit of U.S. Provisional Application No. 62/255,024, filed Nov. 13, 2015, the entire contents of each of which are incorporated by reference herein.

US Referenced Citations (413)

Number	Name	Date	Kind
1290744	Hollander	Jan 1919	A
2453336	Orser	Nov 1948	A
2857523	Corso	Oct 1958	A
3215029	Woodcock	Nov 1965	A
3582178	Boughton et al.	Jun 1971	A
3671098	Rotter	Jun 1972	A
3749494	Hodges	Jul 1973	A
3790248	Kellow	Feb 1974	A
3931593	Marshall	Jan 1976	A
3970373	Pledger	Jul 1976	A
3971068	Gerhardt et al.	Jul 1976	A
4037866	Price	Jul 1977	A
4066330	Jones	Jan 1978	A
4115812	Akatsu	Sep 1978	A
4149190	Wessler et al.	Apr 1979	A
4158504	de Ponteves et al.	Jun 1979	A
4200801	Schuresko	Apr 1980	A
4260217	Traeger et al.	Apr 1981	A
4318395	Tawara	Mar 1982	A
4355325	Nakamura et al.	Oct 1982	A
4378571	Handy	Mar 1983	A
4449535	Renault	May 1984	A
4471766	Terayama	Sep 1984	A
4532918	Wheeler	Aug 1985	A
4556057	Hiruma et al.	Dec 1985	A
4575632	Lange	Mar 1986	A
4597630	Brandstetter et al.	Jul 1986	A
4611888	Prenovitz et al.	Sep 1986	A
4638365	Kato	Jan 1987	A
4656508	Yokota	Apr 1987	A
4660982	Okada	Apr 1987	A
4688905	Okamura	Aug 1987	A
4717952	Kohayakawa et al.	Jan 1988	A
4742388	Cooper et al.	May 1988	A
4768513	Suzuki	Sep 1988	A
4786813	Svanberg et al.	Nov 1988	A
4799104	Hosoya et al.	Jan 1989	A
4806005	Schneider et al.	Feb 1989	A
4821117	Sekiguchi	Apr 1989	A
4837625	Douziech et al.	Jun 1989	A
4852985	Fujihara et al.	Aug 1989	A
4856495	Tohjoh et al.	Aug 1989	A
4885634	Yabe	Dec 1989	A
4895145	Joffe et al.	Jan 1990	A
4930516	Alfano et al.	Jun 1990	A
4930883	Salzman	Jun 1990	A
4951135	Sasagawa et al.	Aug 1990	A
4953539	Nakamura et al.	Sep 1990	A
4954897	Ejima et al.	Sep 1990	A
4974936	Ams et al.	Dec 1990	A
5001556	Nakamura et al.	Mar 1991	A
5007408	Ieoka	Apr 1991	A
5028128	Onuki	Jul 1991	A
5034888	Uehara et al.	Jul 1991	A
5041852	Misawa et al.	Aug 1991	A
5115308	Onuki	May 1992	A
5121220	Nakamoto	Jun 1992	A
5128803	Sprafke	Jul 1992	A
5132837	Kitajima	Jul 1992	A
5134662	Bacus et al.	Jul 1992	A
5159398	Maekewa et al.	Oct 1992	A
5165079	Schulz-Hennig	Nov 1992	A
5205280	Dennison, Jr. et al.	Apr 1993	A
5208651	Buican	May 1993	A
5214503	Chiu et al.	May 1993	A
5225883	Carter et al.	Jul 1993	A
5255087	Nakamura et al.	Oct 1993	A
5278642	Danna et al.	Jan 1994	A
5282082	Espie et al.	Jan 1994	A
5295017	Brown	Mar 1994	A
RE34622	Ledley	May 1994	E
5365057	Morley et al.	Nov 1994	A
5371355	Wodecki	Dec 1994	A
5377686	O'Rourke et al.	Jan 1995	A
5379756	Pileski et al.	Jan 1995	A
5408263	Kikuchi et al.	Apr 1995	A
5410363	Capen et al.	Apr 1995	A
5419323	Kittrell et al.	May 1995	A
5420628	Poulsen et al.	May 1995	A
5421337	Richards-Kortum et al.	Jun 1995	A
5424841	Van Gelder et al.	Jun 1995	A
5426530	Copenhaver et al.	Jun 1995	A
5430476	Häfele et al.	Jul 1995	A
5481401	Kita et al.	Jan 1996	A
5485203	Nakamura et al.	Jan 1996	A
5490015	Umeyama et al.	Feb 1996	A
5507287	Palcic et al.	Apr 1996	A
5515449	Tsuruoka et al.	May 1996	A
5535052	Jörgens	Jul 1996	A
5536236	Yabe et al.	Jul 1996	A
5557451	Copenhaver et al.	Sep 1996	A
5582168	Samuels	Dec 1996	A
5585846	Kim	Dec 1996	A
5590660	MacAulay et al.	Jan 1997	A
5596654	Tanaka	Jan 1997	A
5646680	Yajima	Jul 1997	A
5647368	Zeng et al.	Jul 1997	A
5647840	D'Amelio et al.	Jul 1997	A
5667472	Finn et al.	Sep 1997	A
5677724	Takizawa et al.	Oct 1997	A
5682567	Spruck et al.	Oct 1997	A
5689354	Orino	Nov 1997	A
5695049	Bauman	Dec 1997	A
5697373	Richards-Kortum et al.	Dec 1997	A
5713364	DeBaryshe et al.	Feb 1998	A
5729382	Morita et al.	Mar 1998	A
5749830	Kaneko et al.	May 1998	A
5769792	Palcic et al.	Jun 1998	A
5772355	Ross et al.	Jun 1998	A
5772580	Utsui et al.	Jun 1998	A
5827190	Palcic et al.	Oct 1998	A
5833617	Hayashi	Nov 1998	A
5838001	Minakuchi et al.	Nov 1998	A
5840017	Furuswaba et al.	Nov 1998	A
5852498	Youvan et al.	Dec 1998	A
5891016	Utsui et al.	Apr 1999	A
5897269	Ross et al.	Apr 1999	A
5971918	Zanger	Oct 1999	A
5973315	Saldana et al.	Oct 1999	A
5984861	Crowley	Nov 1999	A
5986271	Lazarev et al.	Nov 1999	A
5986642	Ueda et al.	Nov 1999	A
5990996	Sharp	Nov 1999	A
5999240	Sharp et al.	Dec 1999	A
6002137	Hayashi	Dec 1999	A
6004263	Nakaichi et al.	Dec 1999	A
6008889	Zeng et al.	Dec 1999	A
6021344	Lui et al.	Feb 2000	A
6028622	Suzuki	Feb 2000	A
6030339	Tatsuno et al.	Feb 2000	A
6059719	Yamamoto et al.	May 2000	A
6059720	Furusawa et al.	May 2000	A
6061591	Freitag et al.	May 2000	A
6069689	Zeng et al.	May 2000	A
6070096	Hayashi	May 2000	A
6095982	Richards-Kortum et al.	Aug 2000	A
6099466	Sano et al.	Aug 2000	A
6110106	MacKinnon et al.	Aug 2000	A
6120435	Eino	Sep 2000	A
6147705	Krauter et al.	Nov 2000	A
6148227	Wagnières et al.	Nov 2000	A
6161035	Furusawa	Dec 2000	A
6181414	Raz et al.	Jan 2001	B1
6192267	Scherninski et al.	Feb 2001	B1
6212425	Irion et al.	Apr 2001	B1
6226126	Conemac	May 2001	B1
6258576	Richards-Kortum et al.	Jul 2001	B1
6280378	Kazuhiro et al.	Aug 2001	B1
6293911	Imaizumi et al.	Sep 2001	B1
6315712	Rovegno	Nov 2001	B1
6332092	Deckert et al.	Dec 2001	B1
6364829	Fulghum	Apr 2002	B1
6364831	Crowley	Apr 2002	B1
6377842	Pogue	Apr 2002	B1
6419628	Rudischhauser et al.	Jul 2002	B1
6422994	Kaneko et al.	Jul 2002	B1
6462770	Cline et al.	Oct 2002	B1
6510338	Irion et al.	Jan 2003	B1
6526213	Ilenda et al.	Feb 2003	B1
6529239	Dyck et al.	Mar 2003	B1
6529768	Hakamata	Mar 2003	B1
6537211	Wang et al.	Mar 2003	B1
6544102	Schäfer et al.	Apr 2003	B2
6571119	Hayashi	May 2003	B2
6596996	Stone et al.	Jul 2003	B1
6603552	Cline et al.	Aug 2003	B1
6639664	Haan et al.	Oct 2003	B2
6652452	Seifert et al.	Nov 2003	B1
6750971	Overbeck et al.	Jun 2004	B2
6772003	Kaneko et al.	Aug 2004	B2
6773392	Kikuchi et al.	Aug 2004	B2
6786865	Dhindsa	Sep 2004	B2
6821245	Cline et al.	Nov 2004	B2
6826424	Zeng et al.	Nov 2004	B1
6898458	Zeng et al.	May 2005	B2
6899675	Cline et al.	May 2005	B2
6922583	Perelman et al.	Jul 2005	B1
6958862	Joseph	Oct 2005	B1
6960165	Ueno et al.	Nov 2005	B2
7043291	Sendai	May 2006	B2
7150552	Weidel	Dec 2006	B2
7179222	Imaizumi et al.	Feb 2007	B2
7235045	Wang et al.	Jun 2007	B2
7236815	Richards-Kortum et al.	Jun 2007	B2
7253894	Zeng et al.	Aug 2007	B2
7324674	Ozawa et al.	Jan 2008	B2
7333270	Pochapsky et al.	Feb 2008	B1
7341557	Cline et al.	Mar 2008	B2
7385772	Forkey et al.	Jun 2008	B2
7420151	Fengler et al.	Sep 2008	B2
7479990	Imaizumi et al.	Jan 2009	B2
7697975	Zeng	Apr 2010	B2
7704206	Suzuki et al.	Apr 2010	B2
7722534	Cline et al.	May 2010	B2
7777191	Olcott et al.	Aug 2010	B2
7798955	Ishihara et al.	Sep 2010	B2
7811229	Sugimoto	Oct 2010	B2
7928352	Toda	Apr 2011	B2
8035067	Toda	Oct 2011	B2
8140147	Maynard et al.	Mar 2012	B2
8285015	Demos	Oct 2012	B2
8337400	Mizuyoshi	Dec 2012	B2
8361775	Flower	Jan 2013	B2
8408269	Fengler et al.	Apr 2013	B2
8408772	Li	Apr 2013	B2
8448867	Liu et al.	May 2013	B2
8473035	Frangioni	Jun 2013	B2
8498695	Westwick et al.	Jul 2013	B2
8630698	Fengler et al.	Jan 2014	B2
8721532	Takei et al.	May 2014	B2
8736748	Takita	May 2014	B2
8759243	Coffy et al.	Jun 2014	B2
8773756	Tesar et al.	Jul 2014	B2
8790253	Sunagawa et al.	Jul 2014	B2
8796699	So et al.	Aug 2014	B2
8830339	Velarde et al.	Sep 2014	B2
8849380	Patwardhan	Sep 2014	B2
8961403	Cline et al.	Feb 2015	B2
8979301	Moore	Mar 2015	B2
9125552	Dunki-Jacobs et al.	Sep 2015	B2
9143746	Westwick et al.	Sep 2015	B2
9173554	Fengler et al.	Nov 2015	B2
9282305	Kikuchi	Mar 2016	B2
9294691	Ooki	Mar 2016	B2
9295392	Douplik et al.	Mar 2016	B2
9357931	Nahm	Jun 2016	B2
9386909	Fengler et al.	Jul 2016	B2
9407838	Butte et al.	Aug 2016	B2
9435496	Moore	Sep 2016	B2
9577012	Ooki	Feb 2017	B2
9642532	Fengler et al.	May 2017	B2
9814378	Moore	Nov 2017	B2
10134815	So et al.	Nov 2018	B2
10694151	Westwick et al.	Jun 2020	B2
10694152	Westwick et al.	Jun 2020	B2
10779734	Fengler et al.	Sep 2020	B2
10869645	Fengler et al.	Dec 2020	B2
10980420	Fengler et al.	Apr 2021	B2
10992848	Murray et al.	Apr 2021	B2
11025867	Westwick et al.	Jun 2021	B2
11298024	Fengler et al.	Apr 2022	B2
20010016679	Futatsugi et al.	Aug 2001	A1
20010028458	Xiao	Oct 2001	A1
20010049473	Hayashi	Dec 2001	A1
20020013937	Ostanevich et al.	Jan 2002	A1
20020016533	Marchitto et al.	Feb 2002	A1
20020021355	Utsui et al.	Feb 2002	A1
20020035330	Cline et al.	Mar 2002	A1
20020076480	Hsieh et al.	Jun 2002	A1
20020138008	Tsujita et al.	Sep 2002	A1
20020143243	Geordakoudi et al.	Oct 2002	A1
20020155619	Kurihara et al.	Oct 2002	A1
20020156380	Feld et al.	Oct 2002	A1
20020161282	Fulghum	Oct 2002	A1
20020161283	Sendai	Oct 2002	A1
20020161284	Tanaka	Oct 2002	A1
20020168096	Hakamata et al.	Nov 2002	A1
20020175993	Ueno et al.	Nov 2002	A1
20020177778	Averback et al.	Nov 2002	A1
20020186478	Watanabe et al.	Dec 2002	A1
20020196335	Ozawa	Dec 2002	A1
20030001951	Tsujita	Jan 2003	A1
20030002036	Haan et al.	Jan 2003	A1
20030042493	Kazakevich	Mar 2003	A1
20030063398	Abe et al.	Apr 2003	A1
20030080193	Ryan et al.	May 2003	A1
20030117491	Avni et al.	Jun 2003	A1
20030135092	Cline et al.	Jul 2003	A1
20030153811	Muckner	Aug 2003	A1
20030158470	Wolters et al.	Aug 2003	A1
20030191368	Wang et al.	Oct 2003	A1
20030216626	Tsujita	Nov 2003	A1
20030229270	Suzuki et al.	Dec 2003	A1
20040006276	Demos et al.	Jan 2004	A1
20040010183	Dhindsa	Jan 2004	A1
20040021859	Cunningham	Feb 2004	A1
20040037454	Ozawa et al.	Feb 2004	A1
20040044275	Hakamata	Mar 2004	A1
20040046865	Ueno et al.	Mar 2004	A1
20040133073	Berci et al.	Jul 2004	A1
20040143162	Krattiger et al.	Jul 2004	A1
20040148141	Tsujita et al.	Jul 2004	A1
20040149998	Henson et al.	Aug 2004	A1
20040156124	Okada	Aug 2004	A1
20040186351	Imaizumi et al.	Sep 2004	A1
20040218115	Kawana et al.	Nov 2004	A1
20040225222	Zeng et al.	Nov 2004	A1
20040245350	Zeng	Dec 2004	A1
20040263643	Imaizumi et al.	Dec 2004	A1
20050011954	Hennick et al.	Jan 2005	A1
20050027166	Matsumoto et al.	Feb 2005	A1
20050096505	Imaizumi et al.	May 2005	A1
20050140270	Henson et al.	Jun 2005	A1
20050143627	Cline et al.	Jun 2005	A1
20050154319	Cline et al.	Jul 2005	A1
20050171440	Maki et al.	Aug 2005	A1
20050182291	Hirata	Aug 2005	A1
20050182321	Frangioni	Aug 2005	A1
20050203421	Zeng et al.	Sep 2005	A1
20050225656	Ihama	Oct 2005	A1
20050256373	Bar-Or et al.	Nov 2005	A1
20050273011	Hattery et al.	Dec 2005	A1
20050280783	Yamasaki et al.	Dec 2005	A1
20050288593	Geordakoudi et al.	Dec 2005	A1
20060002141	Ouderkirk et al.	Jan 2006	A1
20060004292	Beylin	Jan 2006	A1
20060017913	Kawamata et al.	Jan 2006	A1
20060089554	Ishihara et al.	Apr 2006	A1
20060094109	Trainer	May 2006	A1
20060108509	Franigioni et al.	May 2006	A1
20060146322	Komachi et al.	Jul 2006	A1
20060149133	Sugimoto et al.	Jul 2006	A1
20060155166	Takahashi et al.	Jul 2006	A1
20060211915	Takeuchi et al.	Sep 2006	A1
20060215406	Thrailkill	Sep 2006	A1
20060217594	Ferguson	Sep 2006	A1
20060241496	Fengler et al.	Oct 2006	A1
20060247537	Matsumoto	Nov 2006	A1
20060250696	McGuire	Nov 2006	A1
20060258910	Stefanchik et al.	Nov 2006	A1
20070041195	Chen	Feb 2007	A1
20070091634	Sakurada	Apr 2007	A1
20070152161	Olcott et al.	Jul 2007	A1
20070177152	Tearney et al.	Aug 2007	A1
20070203413	Frangioni	Aug 2007	A1
20070213593	Nakaoka	Sep 2007	A1
20070229309	Tomita et al.	Oct 2007	A1
20070276236	Jong	Nov 2007	A1
20080019615	Schnee et al.	Jan 2008	A1
20080021274	Bayer et al.	Jan 2008	A1
20080024868	Okamura	Jan 2008	A1
20080027280	Fengler et al.	Jan 2008	A1
20080039697	Morishita	Feb 2008	A1
20080064925	Gill et al.	Mar 2008	A1
20080074752	Chaves et al.	Mar 2008	A1
20080177140	Cline et al.	Jul 2008	A1
20080208006	Farr	Aug 2008	A1
20080246920	Buczek et al.	Oct 2008	A1
20090012361	MacKinnon et al.	Jan 2009	A1
20090021739	Tsujita et al.	Jan 2009	A1
20090036734	Dunki-Jacobs et al.	Feb 2009	A1
20090040754	Brukilacchio et al.	Feb 2009	A1
20090052185	Toriyama et al.	Feb 2009	A1
20090114799	Maeda	May 2009	A1
20090114803	Yamaguchi	May 2009	A1
20090122135	Matsui	May 2009	A1
20090122152	Yamaguchi et al.	May 2009	A1
20090124854	Yamaguchi et al.	May 2009	A1
20090153797	Allon et al.	Jun 2009	A1
20090181339	Liang et al.	Jul 2009	A1
20090201577	LaPlante et al.	Aug 2009	A1
20090236541	Lommes et al.	Sep 2009	A1
20090285762	Flower	Nov 2009	A1
20090290149	Roth	Nov 2009	A1
20100061604	Nahm	Mar 2010	A1
20100065641	Liu et al.	Mar 2010	A1
20100087741	Douplik et al.	Apr 2010	A1
20100094136	Nakaoka et al.	Apr 2010	A1
20100110168	Avni et al.	May 2010	A1
20100110393	Chen et al.	May 2010	A1
20100121146	Sugimoto	May 2010	A1
20100125164	LaBombard	May 2010	A1
20100155487	Liu et al.	Jun 2010	A1
20100157039	Sugai	Jun 2010	A1
20100168588	Matsumoto et al.	Jul 2010	A1
20100198010	Cline et al.	Aug 2010	A1
20100208487	Li	Aug 2010	A1
20100277817	Durell	Nov 2010	A1
20110019992	Orf	Jan 2011	A1
20110032350	Kikuchi et al.	Feb 2011	A1
20110071403	Sevick-Muraca et al.	Mar 2011	A1
20110073658	Vassura et al.	Mar 2011	A1
20110158914	Yamada et al.	Jun 2011	A1
20110235017	Iwasaki	Sep 2011	A1
20110270092	Kang et al.	Nov 2011	A1
20110279679	Samuel et al.	Nov 2011	A1
20110306877	Dvorsky	Dec 2011	A1
20110309275	Azimi et al.	Dec 2011	A1
20120013773	Yoshino	Jan 2012	A1
20120026325	Bunker et al.	Feb 2012	A1
20120044462	Kaji	Feb 2012	A1
20120150046	Watson et al.	Jun 2012	A1
20120292530	Ono	Nov 2012	A1
20130237762	Fengler et al.	Sep 2013	A1
20140071328	Miesak	Mar 2014	A1
20140078378	Demers et al.	Mar 2014	A1
20140139893	Sugiyama et al.	May 2014	A1
20140184769	Ishihara	Jul 2014	A1
20140186351	Britta et al.	Jul 2014	A1
20140187967	Wood et al.	Jul 2014	A1
20140192258	Yang et al.	Jul 2014	A1
20140194687	Fengler et al.	Jul 2014	A1
20150083932	Rizo et al.	Mar 2015	A1
20150230698	Cline et al.	Aug 2015	A1
20150320296	Morita	Nov 2015	A1
20150341551	Perrin et al.	Nov 2015	A1
20150381909	Butte et al.	Dec 2015	A1
20160035104	Bigioi et al.	Feb 2016	A1
20160041098	Hirawake et al.	Feb 2016	A1
20160044253	Dainty et al.	Feb 2016	A1
20160100763	Fengler et al.	Apr 2016	A1
20160173802	Matsuo et al.	Jun 2016	A1
20160249019	Westwick et al.	Aug 2016	A1
20160360956	Moore	Dec 2016	A1
20170064257	Westwick et al.	Mar 2017	A1
20170064258	Westwick et al.	Mar 2017	A1
20170167980	Dimitriadis et al.	Jun 2017	A1
20170196527	Kokubun	Jul 2017	A1
20170245803	Ahmed et al.	Aug 2017	A1
20180234603	Moore et al.	Aug 2018	A1
20210166806	Fengler et al.	Jun 2021	A1
20210274131	Westwick et al.	Sep 2021	A1
20220030149	Moore et al.	Jan 2022	A1

Foreign Referenced Citations (135)

Number	Date	Country
2076516	May 1991	CN
101726980	Jun 2010	CN
101828139	Sep 2010	CN
102026668	Apr 2011	CN
201974160	Sep 2011	CN
102257510	Nov 2011	CN
103543609	Jan 2014	CN
19535114	Mar 1996	DE
19608027	Sep 1996	DE
10028233	Jan 2002	DE
0512965	Nov 1992	EP
0672379	Sep 1995	EP
0774865	May 1997	EP
0792618	Sep 1997	EP
0671706	Jun 1999	EP
1374755	Jan 2004	EP
1 496 690	Jan 2005	EP
2859837	Apr 2015	EP
2 988 654	Jun 2020	EP
2671405	Jul 1992	FR
S60-246733	Dec 1985	JP
S61-159936	Jul 1986	JP
H1-13549	May 1989	JP
3-97439	Apr 1991	JP
03-97441	Apr 1991	JP
03-97442	Apr 1991	JP
05-115435	May 1993	JP
6-125911	May 1994	JP
H7-155285	Jun 1995	JP
H7-155286	Jun 1995	JP
H7-155290	Jun 1995	JP
H7-155291	Jun 1995	JP
H7-155292	Jun 1995	JP
H7-204156	Aug 1995	JP
H7-222712	Aug 1995	JP
H7-250804	Oct 1995	JP
H7-250812	Oct 1995	JP
H7-327913	Dec 1995	JP
H8-126605	May 1996	JP
H8-140928	Jun 1996	JP
H8-140929	Jun 1996	JP
H8-224208	Sep 1996	JP
H8-224209	Sep 1996	JP
H8-224210	Sep 1996	JP
H8-224240	Sep 1996	JP
H8-252218	Oct 1996	JP
H9-19408	Jan 1997	JP
H9-66023	Mar 1997	JP
H9-70384	Mar 1997	JP
H10-127563	May 1998	JP
H10-15104	Jun 1998	JP
H10-201700	Aug 1998	JP
H10-201707	Aug 1998	JP
H10-225426	Aug 1998	JP
H10-225427	Aug 1998	JP
H10-243915	Sep 1998	JP
H10-243920	Sep 1998	JP
H10-308114	Nov 1998	JP
H10-309281	Nov 1998	JP
H10-309282	Nov 1998	JP
H10-321005	Dec 1998	JP
H10-328129	Dec 1998	JP
H11-47079	Feb 1999	JP
H11-89789	Apr 1999	JP
H11-104059	Apr 1999	JP
H11-104060	Apr 1999	JP
H11-104061	Apr 1999	JP
H11-104070	Apr 1999	JP
H11-113839	Apr 1999	JP
H11-155812	Jun 1999	JP
H11-244220	Sep 1999	JP
H11-332819	Dec 1999	JP
2000-504968	Apr 2000	JP
2000-230903	Aug 2000	JP
2000-245693	Sep 2000	JP
2000-354583	Dec 2000	JP
2001-78205	Mar 2001	JP
2002-560	Jan 2002	JP
2002-49302	Feb 2002	JP
2002-244122	Aug 2002	JP
2003-45210	Feb 2003	JP
2004-24611	Jan 2004	JP
2004-94043	Mar 2004	JP
2004-163902	Jun 2004	JP
2004-520105	Jul 2004	JP
2004-247156	Sep 2004	JP
2004-289545	Oct 2004	JP
2004-292722	Oct 2004	JP
2005-10315	Jan 2005	JP
2005-58618	Mar 2005	JP
2005-58619	Mar 2005	JP
2005-58620	Mar 2005	JP
2005-80819	Mar 2005	JP
2005-81079	Mar 2005	JP
2005-149996	Jun 2005	JP
2005-292404	Oct 2005	JP
2006-3103	Jan 2006	JP
2006-73767	Mar 2006	JP
2006-87764	Apr 2006	JP
2006-525494	Nov 2006	JP
2007-29453	Feb 2007	JP
2007-72392	Mar 2007	JP
2007-89840	Apr 2007	JP
2009-259703	Nov 2009	JP
2010-107751	May 2010	JP
2010-117442	May 2010	JP
2010-524194	Jul 2010	JP
2011-500921	Jan 2011	JP
2011-72424	Apr 2011	JP
2011-169819	Sep 2011	JP
2011-528918	Dec 2011	JP
5231625	Jul 2013	JP
2014-123941	Jul 2014	JP
5859578	Feb 2016	JP
99592	Nov 2010	RU
WO-199304648	Mar 1993	WO
WO-199413191	Jun 1994	WO
WO-199526673	Oct 1995	WO
WO-199824360	Jun 1998	WO
WO-199901749	Jan 1999	WO
WO-199953832	Oct 1999	WO
WO-200042910	Jul 2000	WO
WO-200054652	Sep 2000	WO
WO-2002007587	Jan 2002	WO
WO-2002050518	Jun 2002	WO
WO-2003059159	Jul 2003	WO
WO-2006116847	Nov 2006	WO
WO-2007081707	Jul 2007	WO
WO-2008011722	Jan 2008	WO
WO-2008071240	Jun 2008	WO
WO-2009033021	Mar 2009	WO
WO-2013160279	Oct 2013	WO
WO-2014176375	Oct 2014	WO
WO-2015164774	Oct 2015	WO
WO-2016055837	Apr 2016	WO

Non-Patent Literature Citations (149)

Entry
US 6,692,429 B1, 02/2004, Imaizumi et al. (withdrawn)
Alfano, R.R. et al. (Oct. 1987). “Fluorescence Spectra From Cancerous and Normal Human Breast and Lung Tissues,” IEEE Journal of Quantum Electronics QE-23(10):1806-1811.
Andersson-Engels, S. et al. (Mar. 1989). “Tissue Diagnostics Using Laser Induced Fluorescence,” Ber. Bunsenges Physical Chemistry 93(3):335-342.
Australian Notice of Acceptance for Patent Application dated Jun. 26, 2019 for Patent Application No. 2016351730 filed on Nov. 10, 2016, three pages.
Australian Office Action dated Jun. 28, 2018 for Australian Patent Application No. 2016351730 filed on Nov. 10, 2016, five pages.
Australian Office Action dated May 10, 2019 for Australian Patent Application No. 2016351730 filed on Nov. 10, 2016, ten pages.
Bhunchet, E. et al. (Apr. 2002). “Fluorescein Electronic Endoscopy: A Novel Method for Detection of Early Stage Gastric Cancer Not Evident to Routine Endoscopy,” Gastrointestinal Endoscopy 55(4):562-571.
Brazilian Office Action dated Aug. 5, 2019, for Patent Application No. BR112013022997-7, filed Mar. 8, 2012, 4 pages.
Canadian Office Action dated Feb. 1, 2017 for Canadian Patent Application No. 171282, filed on Oct. 27, 2016, two pages.
Canadian Office Action dated Feb. 19, 2019 for CA Patent Application No. 2,998,920 filed on Mar. 16, 2018, four pages.
Canadian Office Action dated Nov. 5, 2019, for Canadian Patent Application No. 3,027,592, filed on Jun. 14, 2017, four pages.
Chinese Notice of Allowance dated Jun. 19, 2017 for Chinese Patent Application No. 201280022284.3, filed on Nov. 7, 2013, four pages.
Chinese Office Action dated Jul. 29, 2016 for Chinese Patent Application No. 201280022284.3 filed on Mar. 8, 2012, eight pages.
Chinese Office Action dated Mar. 14, 2017 for Chinese Patent Application No. 201280022284.3, filed on Nov. 7, 2013, seven pages.
Chinese Office Action dated Nov. 24, 2015 for Chinese Patent Application No. 201280022284.3 filed on Mar. 8, 2012, sixteen pages.
Chinese Office Action dated Sep. 26, 2018 for Chinese Patent Application No. 2018092001857100, filed on Sep. 4, 2017, nineteen pages.
Dawson, J.B. et al. (Jul. 1980). “A Theoretical and Experimental Study of Light Absorption and Scattering by In Vivo Skin,” Phys. Med. Biol. 25(4): 695-709.
Decision to Grant a Patent dated Jun. 29, 2020, directed to JP Application No. 2018-516161; 6 pages.
Decision to Grant a Patent dated Jul. 16, 2021, directed to JP Application No. 2019-540067; 6 pages.
Decision to Grant dated Jul. 18, 2019, directed to EP Application No. 09819758.5; 2 pages.
European Extended Search Report dated Jan. 14, 2020, for Patent Application No. 17812362.6, filed Jun. 14, 2017, 8 pages.
European Extended Search Report dated May 7, 2019, for Patent Application No. 16 863 277.6, filed Nov. 10, 2016, seven pages.
European Extended Search Report dated Oct. 16, 2019, for Patent Application No. 17743524.5, filed Jan. 26, 2017, four pages.
European Notice of Allowance mailed on Feb. 28, 2018 for EP Patent Application No. 12754208.2 filed Oct. 4, 2013, six pages.
European Notice of Allowance mailed on Jul. 12, 2018 for EP Patent Application No. 12754208.2 filed Oct. 4, 2013, two pages.
European Notice of Allowance mailed on Jun. 22, 2017 for EP Patent Application No. 08706262.6 filed on Aug. 21, 2009, two pages.
European Notice of Allowance mailed on Mar. 18, 2019 for EP Patent Application No. 09819758.5, filed on May 4, 2011, seven pages.
European Notice of Allowance mailed on Mar. 6, 2018 for EP Patent Application No. 13180297.7 filed Aug. 13, 2013, seven pages.
European Notice of Allowance mailed on May 25, 2018 for EP Patent Application No. 13180297.7 filed Aug. 13, 2013, two pages.
European Notice of Allowance mailed on Nov. 25, 2016 for EP Patent Application No. 08706262.6 filed on Aug. 21, 2009, eight pages.
European Office Action mailed on Apr. 13, 2017, for EP Patent Application No. 12754208.2 filed on Oct. 4, 2013, five pages.
European Office Action mailed on Apr. 6, 2017, for EP Patent Application No. 09819758.5, filed on May 4, 2011, five pages.
European Office Action mailed on Dec. 3, 2015 for EP Patent Application No. 08706262.6 filed on Jan. 23, 2008, fifteen pages.
European Office Action mailed on Jan. 23, 2017 for EP Patent Application No. 16186321.2 filed on Aug. 30, 2016, two pages.
European Office Action mailed on Nov. 19, 2015 for EP Patent Application No. 07 785 001.4, filed on Jul. 30, 2007, four pages.
European Office Action mailed on Nov. 3, 2015 for EP Patent Application No. 12754208.2 filed Oct. 4, 2013, four pages.
European Office Action mailed on Sep. 29, 2015, for EP Patent Application No. 09721252.6 filed Mar. 18, 2009; five pages.
European Search Report dated Dec. 21, 2016 for EP Patent Application No. 16186321.2 filed on Aug. 30, 2016, nine pages.
European Search Report dated Feb. 18, 2019 for EP Patent Application No. 18178620.3 filed on Jun. 19, 2018, eight pages.
European Search Report dated Jan. 24, 2012 for EP Patent Application No. 07785001.4 filed on Jul. 30, 2007, seven pages.
European Search Report dated Jul. 17, 2014 for EP Patent Application No. 09721252.6 filed Mar. 18, 2009, eleven pages.
European Search Report dated Oct. 1, 2014 for EP Patent Application No. 12754208.2 filed on Mar. 8, 2012, five pages.
European Search Report dated Oct. 9, 2013, for European Patent Application No. 06721854.5, filed on May 4, 2005, seven pages.
European Search Report dated Sep. 20, 2013 for EP Patent Application No. 08706262.6 filed on Jan. 23, 2008, five pages.
Extended European Search Report dated Oct. 14, 2020, directed to EP Application No. 17895908.6; 8 pages.
Fengler et al., U.S. Advisory Action dated Dec. 20, 2019, directed to U.S. Appl. No. 15/416,876; 5 pages.
Fengler et al., U.S. Advisory Action dated Nov. 2, 2020, directed to U.S. Appl. No. 15/416,876; 5 pages.
Fengler et al., U.S. Notice of Allowance and Fee(s) Due dated Aug. 18, 2020, directed to U.S. Appl. No. 15/623,100; 7 pages.
Fengler et al., U.S. Notice of Allowance and Fee(s) Due dated Dec. 2, 2021, directed to U.S. Appl. No. 17/234,461; 8 pages.
Fengler et al., U.S. Notice of Allowance and Fee(s) Due dated Dec. 4, 2020, directed to U.S. Appl. No. 15/416,876; 9 pages.
Fengler et al., U.S. Office Action dated Feb. 24, 2022, directed to U.S. Appl. No. 16/951,684; 12 pages.
Fengler et al., U.S. Office Action dated Jul. 15, 2020, directed to U.S. Appl. No. 15/416,876; 20 pages.
Fengler et al., U.S. Restriction Requirement dated Oct. 13, 2021, directed to U.S. Appl. No. 16/951,684; 7 pages.
Fengler et al., U.S. Restriction Requirement dated Oct. 17, 2018, directed to U.S. Appl. No. 15/623,100; 7 pages.
Georgakoudi, I et al. (2003). “Quantitative Characterization of Biological Tissue Using Optical Spectroscopy,” in Chapter 31 of Biomedical Photonics Handbook, Tuan Vo-Dinh (ed.), CRC Press, New York, thirty three pages.
Georgakoudi, I et al. (Apr. 2005). “Characterization of Dysplastic Tissue Morphology and Biochemistry in Barrett's Esophagus using Diffuse Reflectance and Light Scattering Spectroscopy,” Techniques in Gastrointestinal Endoscopy 7(2):100-105.
Hubel, P.M. et al. (2004). “Spatial Frequency Response of Color Image Sensors: Bayer Color Filters and Foveon X3,” Proceedings of SPIE 5301:402-406.
Hung, J. et al. (1991). “Autofluorescence of Normal and Malignant Bronchial Tissue,” Lasers in Surgery and Medicine 11(2):99-105.
Indian Office Action dated Jan. 31, 2018 for Indian Patent Application No. 6532/DELNP/2010 filed on Sep. 16, 2010, five pages.
Intention to Grant dated Feb. 25, 2022, directed to EP Application No. 17 743 524.5; 7 pages.
Intention to Grant dated May 17, 2021, directed to EP Application No. 16 186 321.2; 7 pages.
International Preliminary Report on Patentability dated Dec. 27, 2018 for International Patent Application No. PCT/CA2017/050734 filed on Jun. 14, 2017, six pages.
International Preliminary Report on Patentability dated May 24, 2018 for International Patent Application No. PCT/CA2016/051315 filed on Nov. 10, 2016, nine pages.
International Preliminary Report on Patentability dated Sep. 21, 2010 for International Patent Application No. PCT/US2009/037506, filed on Mar. 18, 2009, seven pages.
International Search Report and Written Opinion dated Sep. 18, 2017 for International Patent Application No. PCT/CA2017/050734, filed on Jun. 14, 2017, eight pages.
International Search Report dated Oct. 24, 2017, for Patent Application No. PCT/CA2017/050564, mailed May 10, 2017, six pages.
International Search Report dated Aug. 3, 2006, for International Patent Application No. PCT/CA2006/000669, filed on Apr. 27, 2006, three pages.
International Search Report dated Aug. 3, 2012, for International Patent Application No. PCT/IB2012/000601, filed on Mar. 8, 2012, three pages.
International Search Report dated Dec. 7, 2007, for International Patent Application No. PCT/CA2007/001335, filed on Jul. 30, 2007, two pages.
International Search Report dated Jan. 21, 2002 for International Patent Application No. PCT/US2001/022198, filed on Jul. 13, 2001, three pages.
International Search Report dated Jul. 22, 2009 for International Patent Application No. PCT/US09/37506, filed on Mar. 18, 2009, two pages.
International Search Report dated May 13, 2008 for Intentional Patent Application No. PCT/CA2008/00015, filed on Jan. 8, 2008, one page.
Invitation to Pay additional Fees and, where Applicable, Protest Fee, mailed Jul. 4, 2017, for Patent Application No. PCT/CA2017/050564, filed May 10, 2017, two pages.
Invitation to Pay additional Fees and, where Applicable, Protest Fee, mailed on Dec. 22, 2016 for International Patent Application No. PCT/CA2016/051315, filed on Nov. 10, 2016, two pages.
Japanese Final Office Action dated Aug. 2, 2013 for Japanese Application No. 2008-509275, filed on Apr. 27, 2006, four pages.
Japanese Notice of Allowance dated Apr. 2, 2018 for Japanese Patent Application No. 2017-018858 filed on Feb. 3, 2017, six pages.
Japanese Notice of Allowance dated Jan. 5, 2017 for Japanese Patent Application No. 2015-238784, filed on Dec. 7, 2015, six pages.
Japanese Notice of Allowance dated Nov. 17, 2017 for Japanese Application No. 2016-253736 filed on Dec. 27, 2016, six pages.
Japanese Notice of Allowance dated Nov. 28, 2016 for Japanese Patent Application No. 2015-245598, filed on Mar. 8, 2012, six pages.
Japanese Office Action dated Apr. 20, 2012 for Japanese Patent Application No. 2011-500921, filed Mar. 18, 2009, four pages.
Japanese Office Action dated Apr. 3, 2015 for Japanese Patent Application No. 2013-058356, filed Mar. 18, 2009, four pages.
Japanese Office Action dated Dec. 8, 2017 for Japanese Patent Application No. 2017-018858 filed on Feb. 3, 2017, six pages.
Japanese Office Action dated Feb. 17, 2012 for Japanese Application No. 2008-509275, filed on Apr. 27, 2006, six pages.
Japanese Office Action dated Jul. 22, 2014 for Japanese Patent Application No. 2013-557187 filed Mar. 8, 2012, seven pages.
Japanese Office Action dated Mar. 9, 2015 for Japanese Patent Application No. 2013-557187, filed Mar. 8, 2012, five pages.
Japanese Office Action dated May 26, 2014 in Japanese Patent Application No. 2013-058356, filed on Mar. 18, 2009, three pages.
Japanese Office Action dated Nov. 11, 2011 for Japanese Application No. 2009-521077, filed on Jul. 30, 2007, four pages.
Japanese Office Action dated Sep. 14, 2012 for Japanese Application No. 2008-509275, filed on Apr. 27, 2006, seven pages.
Japanese Office Action dated Sep. 19, 2014 for Japanese Application No. 2013-246636, filed on Apr. 27, 2006, six pages.
Japanese Office dated Dec. 26, 2012 for Japanese Patent Application No. 2011-500921, filed on Mar. 18, 2009, two pages.
Korean Notice of Allowance mailed on Dec. 13, 2017 for Korean Patent Application No. 10-2017-7008654, filed on Mar. 29, 2017, three pages.
Korean Office Action dated Aug. 20, 2015 for Korean Patent Application No. 2013-7026479 filed on Mar. 8, 2012, three pages.
Korean Office Action dated Dec. 8, 2015 for Korean Patent Application No. 20157033310 filed on Mar. 8, 2012, seven pages.
Moore et al., U.S. Advisory Action dated May 19, 2020, directed to U.S. Appl. No. 15/591,909; 3 pages.
Moore et al., U.S. Notice of Allowance and Fee(s) due dated Jun. 1, 2021, directed to U.S. Appl. No. 15/591,909; 6 pages.
Moore et al., U.S. Notice of Allowance and Fee(s) due dated Mar. 5, 2019, directed to U.S. Appl. No. 15/348,664; 10 pages.
Moore et al., U.S. Office Action dated Nov. 19, 2020, directed to U.S. Appl. No. 15/591,909; 13 pages.
Moore et al., U.S. Office Action dated Oct. 17, 2019, directed to U.S. Appl. No. 16/441,493; 8 pages.
Murray et al., U.S. Office Action dated Aug. 31, 2020, directed to U.S. Appl. No. 16/746,539; 16 pages.
Murray et al., U.S. Notice of Allowance and Fee(s) Due dated Dec. 22, 2020, directed to U.S. Appl. No. 16/746,539; 7 pages.
Notice of Allowance dated Jan. 13, 2020, directed to CN Application No. ZL201710785223.7, 6 pages.
Notice of Allowance dated Oct. 29, 2019, directed to CA Application No. 2,998,920,1 page.
Notification to Grant Patent Right for Invention dated Mar. 31, 2021, directed to CN Application No. 201680066060.0; 8 pages.
Notification to Pay Restoration Fee for Unity dated Apr. 7, 2020, directed to CN Application No. 201680066060.0, 2 pages.
Office Action dated Feb. 25, 2022, directed to EP Application No. 18 178 620.3; 4 pages.
Office Action dated Jan. 10, 2020, directed to JP Application No. 2018-516161; 5 pages.
Office Action dated Jul. 2, 2020, directed to CN Application No. 201680066060.0; 30 pages.
Office Action dated Jul. 6, 2020, directed to CA Application No. 3,009,419; 3 pages.
Office Action dated Jun. 16, 2021, directed to EP Application No. 16 863 277.6; 5 pages.
Office Action dated Mar. 16, 2020, directed to BR Application No. 112013022997-7, 6 pages.
Office Action dated Nov. 18, 2020, directed to CA Application No. 3,027,592; 3 pages.
Office Action dated Oct. 1, 2021, directed to EP Application No. 17 895 908.6; 4 pages.
Office Action dated Sep. 16, 2020, directed to EP Application No. 16 186 321.2; 4 pages.
Sensitization (photography), definition from Wikipedia, original language German, 6 pages.
U.S. Ex Parte Quayle Action dated Mar. 23, 2020, directed to U.S. Appl. No. 15/584,405; 5 pages.
U.S. Final Office Action dated Feb. 4, 2020, directed to U.S. Appl. No. 15/591,909; 13 pages.
U.S. Final Office Action dated Feb. 7, 2020, directed to U.S. Appl. No. 15/343,038; 16 pages.
U.S. Final Office Action dated Apr. 24, 2015 for U.S. Appl. No. 12/933,512, filed Nov. 24, 2010, nineteen pages.
U.S. Final Office Action dated Aug. 10, 2017 for U.S. Appl. No. 15/343,034, filed Nov. 3, 2016, twelve pages.
U.S. Final Office Action dated Aug. 11, 2017 for U.S. Appl. No. 14/860,687, filed Sep. 21, 2015, seventeen pages.
U.S. Final Office Action dated Aug. 7, 2017 for U.S. Appl. No. 15/343,038, filed Nov. 3, 2016, eleven pages.
U.S. Final Office Action dated Dec. 14, 2018 for U.S. Appl. No. 15/584,405, filed May 2, 2017, seven pages.
U.S. Final Office Action dated Jul. 23, 2008 for U.S. Appl. No. 11/122,267, filed May 4, 2016, six pages.
U.S. Final Office Action dated Jul. 25, 2019, directed to U.S. Appl. No. 15/416,876; 13 pages.
U.S. Final Office Action dated Jun. 18, 2015 for U.S. Appl. No. 14/154,177, filed Jan. 13, 2014, eight pages.
U.S. Final Office Action dated May 11, 2011 for U.S. Appl. No. 11/412,715, filed Apr. 26, 2006, eight pages.
U.S. Non-Final Office Action dated Aug. 15, 2018 for U.S. Appl. No. 15/348,664, filed Nov. 10, 2016, twelve pages.
U.S. Non-Final Office Action dated Aug. 16, 2013 for U.S. Appl. No. 12/761,462, filed Apr. 16, 2010, ten pages.
U.S. Non-Final Office Action dated Aug. 2, 2019 for U.S. Appl. No. 15/623,100, filed Jun. 14, 2017, twelve pages.
U.S. Non-Final Office Action dated Aug. 21, 2019 for U.S. Appl. No. 15/584,405, filed May 2, 2017, six pages.
U.S. Non-Final Office Action dated Aug. 23, 2019 for U.S. Appl. No. 15/343,034, filed Nov. 3, 2016, eighteen pages.
U.S. Non-Final Office Action dated Aug. 6, 2019, for U.S. Appl. No. 15/591,909, filed May 10, 2017, 9 pages.
U.S. Non-Final Office Action dated Feb. 1, 2017 for U.S. Appl. No. 14/860,687, filed Sep. 21, 2015, fifteen pages.
U.S. Non-Final Office Action dated Jan. 16, 2020, for U.S. Appl. No. 15/416,876, filed Jan. 26, 2017, thirteen pages.
U.S. Non-Final Office Action dated Jan. 2, 2008 for U.S. Appl. No. 11/122,267, filed May 4, 2005, five pages.
U.S. Non-Final Office Action dated Jun. 27, 2014 for U.S. Appl. No. 13/415,561, filed Mar. 3, 2012, fourteen pages.
U.S. Non-Final Office Action dated Jun. 8, 2018 for U.S. Appl. No. 15/584,405, filed May 2, 2017, eight pages.
U.S. Notice of Allowance dated Mar. 10, 2005 for U.S. Appl. No. 10/050,601, filed Jan. 15, 2002, five pages.
U.S. Notice of Allowance dated Mar. 12, 2020, for U.S. Appl. No. 16/441,493, filed Jun. 14, 2019, 8 pages.
U.S. Notice of Allowance dated Mar. 28, 2016 for U.S. Appl. No. 13/853,656, filed Mar. 29, 2013, eight pages.
U.S. Notice of Allowance dated May 18, 2015 for U.S. Appl. No. 13/930,225, filed Jun. 28, 2013, nine pages.
U.S. Office Action dated Apr. 3, 2020, directed to U.S. Appl. No. 16/746,539; 15 pages.
U.S. Appl. No. 15/810,911, filed Nov. 13, 2017. (the U.S. Patent Application is not submitted herewith pursuant to the waiver of 37 C.F.R. § 1.98(a)(2)(iii) issued by the Office on Sep. 21, 2004.).
U.S. Restriction Requirement dated Jan. 17, 2019, for U.S. Appl. No. 15/591,909, filed May 10, 2017, 7 pages.
Westwick et al., U.S. Office Action dated Aug. 27, 2020, directed to U.S. Appl. No. 15/343,038; 16 pages.
Westwick et al., U.S. Office Action dated Dec. 16, 2021, directed to U.S. Appl. No. 17/243,002; 19 pages.
Written Opinion of the International Searching Authority dated Aug. 3, 2006 for International Patent Application No. PCT/CA2006/000669, filed on Apr. 27, 2006, eight pages.
Written Opinion of the International Searching Authority dated Dec. 7, 2007 for International Patent Application No. PCT/CA2007/001335, filed on Jul. 30, 2007, four pages.
Moore et al., U.S. Restriction Requirement dated May 3, 2018, directed to U.S. Appl. No. 15/348,664; 5 pages.

Related Publications (1)

	Number	Date	Country
	20210105393 A1	Apr 2021	US

Provisional Applications (1)

	Number	Date	Country
	62255024	Nov 2015	US

Divisions (1)

	Number	Date	Country
Parent	15348664	Nov 2016	US
Child	16441493		US

Continuations (1)

	Number	Date	Country
Parent	16441493	Jun 2019	US
Child	16933900		US

Systems and methods for illumination and imaging of a target

Information

Patent Number

Date Filed

Date Issued

Inventors

Original Assignees

Examiners

Agents

CPC

Field of Search

CPC

International Classifications

Abstract