The present disclosure relates generally to apparatus and method for spectrally encoded endoscopy and, more particularly to, e.g., apparatus and methods for color imaging using spectrally encoded endoscopy techniques.
Spectrally encoded endoscopy (“SEE”) is a technique that uses wavelength to encode spatial information on a sample, thereby allowing high-resolution imaging to be conducted through small diameter endoscopic probes. SEE can be accomplished using a quasimonochromatic or broad bandwidth light input into a single optical fiber. At the distal end of the fiber, a diffractive or dispersive optic disperses the light across the sample, which is reflected and returns back through the optic and optical fiber. Light from the optical fiber is detected by a wavelength detecting apparatus, such as a spectrometer. By detecting the light intensity as a function of wavelength, the image may be reconstructed. SEE techniques have been described in, e.g., U.S. Patent Publication Nos. 2007/0233396 and 2008/0013960.
Conventional endoscopy uses RGB color information as cues to diagnosis. By using wavelength information to encode spatial location, SEE images utilize much of the color information to encode spatial location and therefore important color information may be lost. Accordingly, there may be a need to address and/or overcome at least some of the deficiencies described herein above.
According to exemplary embodiments of the present disclosure, it is possible to provide apparatus and methods for color imaging using spectrally encoded endoscopy techniques, and which can retain color information including, e.g., a conventional red-green-blue color space.
Thus, exemplary embodiments of apparatus and method according to the present disclosure can be provided. For example, an apparatus for providing electromagnetic radiation to a structure can be provided. The exemplary apparatus can include a first arrangement having at least two wave-guides which can be configured to provide there through at least two respective electro-magnetic radiations with at least partially different wavelengths from one another. The exemplary apparatus can also include a dispersive second arrangement structured to receive the electro-magnetic radiations and forward at least two dispersed radiations associated with the respective electro-magnetic radiations to at least one section of the structure. The wave-guide(s) can be structured and/or spatially arranged with respect to the dispersive arrangement to facilitate at least partially overlap of the dispersed radiations on the structure.
For example, the wave-guides can be spatially arranged by being spatially offset from one another. Such wave-guides can also be structured such that the respective electro-magnetic radiations exiting the wave-guides are at different angles from one another. The dispersive arrangement can include a grism, a grating and/or a lens. At least one of the wave-guides or the dispersive arrangement can be configured to rotate with respect to the structure. Further, at least one of the wave-guides can be (i) a single mode fiber, (ii) a multi-mode fiber, (iii) a multi-clad fiber, and/or (iv) a fiber within a fiber bundle.
In addition, according to another exemplary embodiment of the present disclosure, a third arrangement can be provided which is configured to receive further electro-magnetic radiations provided from the structure through the dispersive second arrangement. Third arrangement can include further wave-guides to receive the further radiations, and the further radiations can be associated with the dispersed radiations. At least one of the further wave-guides can be (i) a single mode fiber, (ii) a multi-mode fiber, (iii) a multi-clad fiber, and/or (iv) a fiber within a fiber bundle. Further, the dispersive second arrangement can be structured to generate further respective electro-magnetic radiations based on the received electro-magnetic radiations. A particular arrangement can be provided which can include at least further two wave-guides which are configured to receive the second electro-magnetic radiations. For example, each of the further wave-guides can be structured or spatially arranged with respect to the dispersive second arrangement to facilitate a receipt of a different one of the further respective electro-magnetic radiations as a function of wavelengths thereof.
According to still another exemplary embodiment of the present disclosure, an apparatus for obtaining information for a structure can be provided. For example, the apparatus can include a dispersive first arrangement structured to receive at least two first electro-magnetic radiations that have at least partially different wavelengths from one another, and which are associated with particular radiations impacting and at least partially overlapping on at least one region of the structure. The dispersive first arrangement can be structured to generate second respective electro-magnetic radiations based on the received first electro-magnetic radiations. The apparatus can also include a second arrangement which can have at least two wave-guides which are configured to receive the second electro-magnetic radiations. Each of the wave-guides can be structured and/or spatially arranged with respect to the dispersive arrangement to facilitate a receipt of a different one of the second respective electro-magnetic radiations as a function of wavelengths thereof.
In addition, the apparatus can include a third arrangement configured to receive further electro-magnetic radiations provided from the structure through the dispersive second arrangement. The third arrangement can include additional wave-guides to receive the further radiations, and the further radiations can be associated with the second electro-magnetic radiations. At least one of the additional wave-guides can be (i) a single mode fiber, (ii) a multi-mode fiber, (iii) a multi-clad fiber, and/or (iv) a fiber within a fiber bundle.
According to a further exemplary embodiment of the present disclosure, another arrangement can be provided which is configured to transmit the particular radiations to the structure. For example, such arrangement can include particular wave-guides to provide the particular radiations. At least one of the particular wave-guides can be (i) a single mode fiber, (ii) a multi-mode fiber, (iii) a multi-clad fiber, and/or (iv) a fiber within a fiber bundle. The exemplary apparatus can include yet another a fourth arrangement which is configured to generate at least one image for at least one portion of the structure as a function of the second electro-magnetic radiations.
Such exemplary arrangement can include a charged-coupled device (CCD), linear array of detectors, a single detector, and/or at least one dispersive structure. This exemplary arrangement can be further configured to process data associated with the second electro-magnetic radiations to generate at least one color image of at least one portion of the structure, obtain image information associated with the structure, and/or to generate the at least one image based on the image information and the second electro-magnetic radiations. The structure can have uniform reflectance characteristics and the image(s) can include color information. This arrangement can also be configured to (i) generate data for the at least one portion of the structure based on the second electro-magnetic radiations, and (ii) perform a gamma correction procedure on the data to generate the image(s).
Further, such further arrangement can comprise only one charged-coupled device (CCD) to generate data for the portion(s) of the structure based on the second electro-magnetic radiations. This exemplary arrangement can also be configured to separate the data into at least two further data. Each of the further data can correspond to different colors associated with the portion(s) of the structure.
These and other objects, features and advantages of the exemplary embodiment of the present disclosure will become apparent upon reading the following detailed description of the exemplary embodiments of the present disclosure, when taken in conjunction with the appended claims.
Further objects, features and advantages of the present disclosure will become apparent from the following detailed description taken in conjunction with the accompanying figures showing illustrative embodiments of the present disclosure, in which
Throughout the figures, the same reference numerals and characters, unless otherwise stated, are used to denote like features, elements, components or portions of the illustrated embodiments. Moreover, while the subject disclosure will now be described in detail with reference to the figures, it is done so in connection with the illustrative embodiments. It is intended that changes and modifications can be made to the described exemplary embodiments without departing from the true scope and spirit of the subject disclosure as defined by the appended claims.
A schematic diagram of an exemplary embodiment of a monochromatic SEE apparatus is shown in
As shown in
In one exemplary embodiment of the present disclosure, these bands can be spatially separated in free space, and in another exemplary embodiment, the electro-magnetic radiation (e.g., light) from these wavelength bands may be separated into different waveguiding channels, such as, e.g., optical fibers. In the exemplary embodiment where the light is separated in free space, the bands can be transmitted as shown in
Light reflected from the sample 370 is either transmitted back through the same optical system to a multiple of different channels or can be transmitted to a separate channel for detection. One or more spectrometers configured to receive and detect the spectra from each of the bands. In one exemplary embodiment of the present disclosure where the bands span red, green and blue wavelengths, an RGB line of an image can be created or provided by registering light from such bands and correcting for white balance. The other dimension or remainder of the image can be obtained by acquiring spectrally-encoded lines as the grating or probe is scanned in another direction that is different from the direction of the wavelength-encoded lines.
Another exemplary embodiment of the present disclosure includes at least some of the exemplary features described herein above in an optical probe or miniature endoscope. For example, as shown in
In another exemplary embodiment, the probe can be configured for forward color spectrally-encoded imaging. In this exemplary embodiment as shown in
Further details of one exemplary embodiment of the DP-GRISM is shown in
Turning again to
In order to provide an endoscope probe with different fiber channels, several different configurations can be implemented.
For example,
In a further exemplary embodiment of the present disclosure as shown in
In order to rotate an endoscope probe with more than one fiber, several different configurations can be utilized. For example,
Such three subsets output from the spectrum non-uniformity compensation step 1120 can then be gamma-corrected 1130. The gamma value g used for the correction 1130 can be determined by the characteristic gamma values of the detector or the detector array. The three gamma-corrected subsets can be multiplied by, e.g., a constant scalar value k in a scaling step 1140. The constant value k can be determined based on the color bit depth of a color image 1160 and desired brightness of the color image 1160. For example, k may be set to be 255 if the final color image 1160 of the reference sample that has been used in generating the reference data 1110 should be saturated for, e.g., 24-bit color depth. The three scaled subsets are then merged 1150 into the color image 1160.
With one exemplary implementation, a line-scan camera can generate, e.g., two-dimensional 10-bit monochromatic images (e.g., about 2048 by 500 pixels/image). Pixel intensities at or below the dark current noise level can first be set to zero. Then, the raw image can be divided into three monochromatic images (500 by 500 pixels/image) representing red, green, and blue colors. Each spectrally-encoded line can be compensated for the non-uniformity of the light source and the light throughput variation of the optical components, and can be gamma-corrected by the following procedure. The 10-bit grayscale intensity I at the i'th pixel on a spectrally-encoded line of a segmented image for color C (C can be red, green or blue) can be converted into the 8-bit grayscale value p by:
p(i,C)=pw[I(i,C)/Iw(i,C)]1/2.2
where pw is a reference 8-bit grayscale value for a white reference card (e.g., Gretag Macbeth® Color Checker® White balance card, X-Rite, Inc, MI; OD=0.05); and Iw is the 10-bit grayscale intensity measured for the white reference card. The reference spectrum, Iw, can be acquired by imaging the white reference card beforehand, and pw can be set as 243 to match the reference value provided from the manufacturer. The three processed 8-bit grayscale images can then be combined to form a 24-bit color image by merging red, green and blue channels.
The exemplary procedures described herein can be executed on and/or by or under the control of a processing arrangement (e.g., one or more micro-processors or a collection thereof) executing one or more executable instructions stored on a computer-accessible medium. For example, when the processing arrangement accesses the computer-accessible medium, it retrieves executable instructions therefrom and then executes the executable instructions. In addition or alternatively, a software arrangement can be provided separately from the computer-accessible medium, which can provide the instructions to the processing arrangement so as to configure the processing arrangement to execute the above-described procedures.
In addition, exemplary embodiments of computer-accessible medium can be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, and as indicated to some extent herein above, such computer-accessible medium can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code means in the form of computer-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer. When information is transferred or provided over a network or another communications link or connection (either hardwired, wireless, or a combination of hardwired or wireless) to a computer, the computer properly views the connection as a computer-accessible medium. Thus, any such a connection can be properly termed a computer-accessible medium. Combinations of the above should also be included within the scope of computer-accessible medium.
The foregoing merely illustrates the principles of the invention. Various modifications and alterations to the described embodiments will be apparent to those skilled in the art in view of the teachings herein. Indeed, the arrangements, systems and methods according to the exemplary embodiments of the present invention can be used with and/or implement any OCT system, OFDI system, SD-OCT system or other imaging systems, and for example with those described in International Patent Application PCT/US2004/029148, filed Sep. 8, 2004 which published as International Patent Publication No. WO 2005/047813 on May 26, 2005, U.S. patent application Ser. No. 11/266,779, filed Nov. 2, 2005 which published as U.S. Patent Publication No. 2006/0093276 on May 4, 2006, and U.S. patent application Ser. No. 10/501,276, filed Jul. 9, 2004 which published as U.S. Patent Publication No. 20050018201 on Jan. 27, 2005, the disclosures of which are incorporated by reference herein in their entireties. It will thus be appreciated that those skilled in the art will be able to devise numerous systems, arrangements and methods which, although not explicitly shown or described herein, embody the principles of the invention and are thus within the spirit and scope of the present invention. In addition, to the extent that the prior art knowledge has not been explicitly incorporated by reference herein above, it is explicitly being incorporated herein in its entirety. All publications referenced herein above are incorporated herein by reference in their entireties.
The present application is a continuation of U.S. application Ser. No. 13/054,015 filed on Jun. 8, 2011, and also relates to and claims the benefit of priority from International Patent Application No. PCT/US2009/050553 filed Jul. 14, 2009, and from U.S. Provisional Patent Application Ser. No. 61/080,534 filed Jul. 14, 2008. Thus, the entire disclosures of these applications are incorporated herein by reference.
“This invention was made with Government support under Grant Number EB007718 awarded by the National Institutes of Health. The Government has certain rights in this invention.”
Number | Date | Country | |
---|---|---|---|
61080534 | Jul 2008 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13054015 | Jun 2011 | US |
Child | 15000824 | US |