The present disclosure relates to microscopic imaging, and more particularly to exemplary embodiments of method and apparatus for recording microscopic images from within a living person or organism using an implantable device.
An application of optical imaging in biomedicine can be limited primarily by an inability of visible or near-infrared light to penetrate most tissue types. Imaging resolution from optical techniques can be typically largely superior to currently available diagnostic medical imaging techniques including magnetic resonance imaging (MRI), x-ray, x-ray computed tomography (CT), positron emission tomography (PET), single-photon emission computed tomography (SPECT), and ultrasound (US), which all lack the resolving power to distinguish individual cells within the body. The availability of cellular resolution imaging for diagnostic imaging would have extraordinary impact on medicine, as many pathologies are observable only through the examination of cellular structure.
However, high-resolution optical imaging may be available only for skin-deep external imaging or endoscopes that can probe luminal organs such as airways, blood vessels, and the reproductive and gastrointestinal tracts through tethered devices. The vast majority of organs within the body remain inaccessible to high-resolution optical imaging.
Accordingly, there may be a need to overcome at least some of the issues and/or deficiencies described herein above.
To address and/or overcome the above-described problems and/or deficiencies, exemplary embodiments of method and apparatus for recording microscopic images from within a living person or organism using an implantable device can be provided.
To that end, according to an exemplary embodiment of the present disclosure, it is possible to utilize an implantable self-contained device that can contain an entire microscope apparatus that can be attached and/or inserted into a target organ through surgical access, and allowed to remain implanted to facilitate a long-term monitoring. For example, images or videos can be transmitted wirelessly to a receiving station for storage, display, or transmission via the Internet. A physician located many miles away would be able to directly view the cells in his or her patient, and make adjustments to treatment or diagnose the condition.
Further exemplary apparatus and method can be provided according to an exemplary embodiment of the present disclosure. For example, using at least one light source first arrangement, it is possible to provide pulses of light to at least one portion of a biological structure. At least one detector second arrangement can be used to detect images from the portion(s) based on the pulses, and provide data based on the detection. With at least one configuration, it is possible prevent and/or reduce a movement of the apparatus within at least one anatomical body (i) is a particular surface of the apparatus, (ii) covers at least one portion of the surface, and/or (iii) extends from the surface.
In addition or alternatively, with at least one computer third arrangement, it is possible to receive the data, and control a timing of at least one of activation or deactivation of at least one portion of the first arrangement based on the data.
For example, the control of the timing can be based on a frame-by-frame scheme associated with the images. A transmitter fourth arrangement can be connected to the second arrangement, whereas the second arrangement can be further configured to forward additional data to the fourth arrangement to be transmitted wirelessly to an external device that is outside the apparatus. The wireless transmission can include a radio frequency transmission. The fourth arrangement can include a further light source which is configured to wirelessly transmit the additional data by modulating light emission therefrom. Further, the fourth arrangement can be configured to wirelessly transmit the additional data by modulating the first arrangement.
According to another exemplary embodiment of the present disclosure, in operation, the apparatus can solely wirelessly communicate with an external device. Further, the third arrangement can be further configured to receive further data from the second arrangement which can include image data, and process the further data to generate information associated with microscopic data regarding the portion(s). At least one energy providing arrangement can be provided which can be configured to power the first, second and third arrangement. In addition, at least one magnetically-actuated switching arrangement can be provided which can be configured to actuate the energy providing arrangement within at least one biological sample when a magnetic arrangement is provided in or removed from a vicinity thereof. The energy providing arrangement can be recharged by the magnetic arrangement and/or a further induction arrangement. The third arrangement can be further configured to control the activation and/or the deactivation of the energy providing arrangement.
In yet another exemplary embodiment of the present disclosure, the first arrangement can include (i) at least two light-emitting diodes, (ii) at least one laser, and/or (iii) at least two super-luminescent diodes. For example, the illuminating laser diodes can provide the pulses that are passed through an oscillatory mechanism that is configured to reduce time-integrated laser speckle. The fourth arrangement can be further configured to receive additional data from the external device, and the third arrangement can be further configured to control at least one part of the first arrangement based on the additional data. The configuration(s) can be or include a photo-activatable coating. In addition, diffusive light guides can be provided into the outer housing of the apparatus to distribute the light output from a curing light source in order to evenly cure a photo-activatable coating on all surfaces of the device, including those not directly visible to the curing light source during implantation. The configuration(s) can include protrusions extending from the surface that are optical elements. Further, an optical arrangement can be provided which can be coupled to the detector arrangement, and which can include at least one liquid lens.
In still another exemplary embodiment, a power switch arrangement can be provided that is controlled by the third arrangement so as to actuate the power switch arrangement. For example, the third arrangement can include a further detector which detects a magnetic field strength from a source external from the biological structure, and the third arrangement can utilize information regarding the magnetic field strength to control the power switch arrangement. The combination of the first and second arrangement can perform an oblique back-illumination microscopy (OBM), a reflectance confocal microscopy (RCM), a widefield fluorescence microscopy, a fluorescence confocal microscopy (FCM), a spectrally encoded confocal microscopy (SECM), an optical coherence tomography (OCT), and/or a full-field optical coherence microscopy (FF-OCM).
Exemplary Video Processing and Wireless Activation/Communication
The exemplary implantable device according to an exemplary embodiment of the present disclosure can output exemplary microscopy images that can be transferred to an external station. The image data can take or have the form of analog video signals, such as, e.g., National Television System Committee (NTSC), sequential couleur à mémoire (SECAM), or Phase-Alternating Line (PAL), or can be in the form of digital signals. Since some exemplary camera modules can be self-contained and provide only analog outputs with no frame trigger input, it may be important to facilitate the camera's native frame timing to act as the master clock for other modules in the implantable apparatus. According to one exemplary embodiment of the present disclosure, for the exemplary OBM procedure(s), illumination source(s) from alternating directions can be switched on and off with a reliable frame synchronization.
In one exemplary embodiment of the present disclosure, the electronics module arrangement(s) (such as processor 615 of
According to the exemplary embodiment of the present disclosure, the exemplary implantable device can also include a mechanism using which it is possible to transfer the imaging data to the external station for viewing, storage, and/or retransmission. In one exemplary embodiment of the device, exemplary analog video signals from the camera module can be modulated on a radio frequency by the wireless transmitter, transmitted via an antenna, e.g., attached to or contained within the implantable device, received on a remote antenna attached to the external station, and/or demodulated by the electronics of the external station. Further, miniaturization can be achieved by providing an RF antenna into the inner surface of the device's housing using, for example, three-dimensional printing technology. An analog-to-digital converter (e.g., a “frame-grabber”) can then be used to adapt the analog signal for digital processing and display.
In yet another exemplary embodiment of the present disclosure, the exemplary implantable device can include circuitry to process the camera output according to the exemplary OBM procedure(s) to generate phase-sensitive images as an intermediate substep before a wireless transmission. Because several raw frames are typically utilized to produce one or more processed frames, pre-processing the images within the exemplary implantable device before the transmission can reduce the transmission bandwidth requirement. Additionally, because compression artifacts in raw frames are amplified in the exemplary OBM procedure(s) (which amplifies low-contrast differences between raw images), a lossy image compression is not generally advantageous for raw image transmission, while can be acceptable and/or utilized for the exemplary processed images in a further reduction of bandwidth.
In still another exemplary embodiment of the present disclosure, the exemplary implantable device can also directly convert the camera output to a digital signal, which can then be encoded as a wireless transmission, or processed on-board the implantable device as described herein above.
In a further exemplary embodiment of the present disclosure, the wireless transmission between the exemplary implantable device and the external station can utilize a non-radio frequency transmission. For example, red light and/or infrared light can be modulated with an encoded signal for one-way and/or two-way communication, since such wavelengths can be weakly absorbed by typical tissue, and provide a window for optical communication.
For example, the modulated light source used for one- and/or two-way communication can be provided by, e.g., distinct and separate illumination source(s) from the primary light source used to illuminate the biological structure. In this exemplary case, the light sources can be distinguished by wavelength multiplexing (e.g., the area sensor can be made sensitive to the primary light source and not the communication light source using a color filter) or by time multiplexing (i.e. the primary light source is activated and the communication light source is deactivated during a first duration while image data can be acquired; subsequently the primary light source can be deactivated and the communication light source can be activated during a second duration while the image data is transmitted to a separate light receptor and demodulator positioned outside of the biological structure). This two-phase procedure can then continue in a cyclical manner for continuous imaging.
Further miniaturization and electrical power efficiency can be achieved by modulating the primary light source for communication during the image data acquisition time period. In this single-phase procedure, image data from a single frame is stored in a temporary data storage device (e.g. flash memory or a secondary pixel layer in a frame-transfer area sensor). For example, when a subsequent frame is acquired, the first data from the data storage device can be communicated outside the body simultaneously by modulating the intensity of the primary light source. The modulation frequency for communication should be higher (e.g., greater than one order of magnitude higher in temporal frequency) than the inverse of the exposure time to ensure no temporal flickering artifact is observed in the current image acquisition. Furthermore, the modulation scheme can be, utilize and/or include a constant envelope to provide temporally stable illumination for the current image acquisition and promote efficient electrical power consumption. Exemplary modulation schemes, such as phase-shift keying (PSK) or frequency-shift keying (FSK) feature, can effectuate such exemplary constant envelope modulation. Differential phase-shift keying (DPSK) schemes can be compatible with the exemplary method and system according to various exemplary embodiments as no secondary reference modulation is required for the receiver and demodulation apparatus.
In yet another exemplary embodiment of the present disclosure, a transmitter module can be provided that designed to modulate the analog video into an analog television channel. In this exemplary case, because television channel transmitters and receivers can be configured for a synchronized broadcast of both video and audio, and the implantable microscopy system according to an exemplary embodiment of the present disclosure can produce, e.g., soundless images, the audio channel corresponding to the analog television video channel selected for microscopy image transmission is available for the transmission of additional data, which can include exposure parameters, power supply status, and/or (with the inclusion of additional sensor module(s)) device localization.
Exemplary Power Supply for Exemplary Implantable Device
According an exemplary embodiment of the present disclosure, the power supply for the implantable device is entirely encased within the housing of the apparatus. Additional miniaturization of the exemplary apparatus can be achieved by providing a battery into the housing material in a three-dimensional shape such that volume not occupied by other optical, electrical, or mechanical components of the apparatus can be filled with battery components. Such exemplary three-dimensional batteries can be provided into the inner surface of the housing using three-dimensional printing technologies. Several high-density electrochemical storage densities can be available, and may be appropriate for the exemplary implantable device, included lithium ion, lithium polymer, and silver oxide. High capacitance devices, such as supercapacitors, can also serve as power sources.
Because the power source(s) can be physically confined and isolated by the implantable device housing, traditional charging via physical contact of electrical wires is not appropriate for the intended application of the invention. Therefore, in another exemplary embodiment of the present disclosure, the exemplary implantable device can include one or more mechanisms for replenishing the electrical power supply through one or more implementations of wireless charging. One exemplary implementation can be an inductive charging, whereby an externally-driven oscillating magnetic field induces current flow through an inductive coil within the implantable device, which can then be used to charge the battery or another power source.
These and other objects, features and advantages of the exemplary embodiments of the present disclosure will become apparent upon reading the following detailed description of the exemplary embodiments of the present disclosure, when taken in conjunction with the appended claims.
Further objects, features and advantages of the present disclosure will become apparent from the following detailed description taken in conjunction with the accompanying drawings showing illustrative embodiments of the present disclosure, in which:
Throughout the figures, the same reference numerals and characters, unless otherwise stated, are used to denote like features, elements, components or portions of the illustrated embodiments. Moreover, while the subject description will now be described in detail with reference to the figures, it is done so in connection with the illustrative embodiments. It is intended that changes and modifications can be made to the described embodiments without departing from the true scope and spirit of the subject disclosure and appended claims.
Exemplary Implantable Capsules
Various exemplary embodiments of the present disclosure is based on a concept of, e.g., a self-contained device which can be implanted within or upon an organ that captures high-resolution optical images, and transmits the images to a recording and display system located external to the body. An exemplary arrangement of components is shown in an exemplary embodiment of such exemplary system as illustrated in
In various embodiments the apparatus may include a processor which is configured to receive the data 1801, and control a timing of at least one of activation or deactivation of at least one portion of the at least one light source based on the data 1802 (
Exemplary Implantation and Organ Monitoring Method
According to an exemplary embodiment of the present disclosure, a self-contained device may be used which can have a package sized that is similar to approximately a grain of rice (˜1 mm in diameter and 5 mm in length). As illustrated in
Exemplary Implantable Capsule with Tethered Sub-Modules
According to another exemplary embodiment of the present disclosure, the self-contained system does not have to be a single solid apparatus, and can be divided into sub-modules that can interface with a central implanted module, as illustrated in
Exemplary Implantable Capsule Interfaces with Organs
Exemplary Implantable Capsules
This exemplary embodiment can include (i) one or more electronics modules 601, 608 that can have multiple components for interfacing and controlling the other modules of the exemplary device, (ii) one or more lens modules 602, 607 which can be used to image a region of the sample outside the capsule/device to one or more camera module(s) 603, 610, and (iii) one or more transmitters 605, 611 which can be configured to transmit exemplary images to and/or receive instructions/data/signals from an external station. A computer arrangement or processor 615 is also provided and configured to control a timing of at least one of activation or deactivation of at least one portion of the at least one light source to synchronize between an exposure time and a readout time. The exemplary electronic components of the device shown in
As shown in
Exemplary Implantable Capsule Microscope Modalities
The exemplary arrangement providing the OBM that is one of the exemplary technologies is illustrated in
For example, using such exemplary configuration, a compact optical system can be provided, which may be further miniaturized, for example, with custom aspheric micro-optics 925 made in-house, using, e.g. a diamond turning lathe and injection molding equipment. A multiple-pixel area sensor 906 can be used to detect return radiation originating from each of the light sources 901, 902.
As illustrated in
Similarly to the previously described exemplary configuration for SECM of
Exemplary Implantable Capsules Using Oblique Back-Illumination Microscopy
Exemplary Microscopy Modalities Images
Exemplary Implantable Oblique Back-Illumination Microscope Image Processing
In a further exemplary embodiment of the present disclosure, images obtained from disparately oblique illumination directions can be acquired by selectively activating a subset of the illumination sources in a sequence of exposures.
Exemplary Implantable SECM Microscope Image Processing
Exemplary Implantable Device Utilization Workflow
As shown in
At the conclusion of this imaging session, the magnetic/proximity switch returns the device to its off or standby state (procedure 1770). During the time between this and any other image session, inductive, kinetic, or solar charging may be utilized to replenish the power level stored in the device's on-board battery or of another power source arrangement (procedure 1775). When the microscopic image monitoring of the organ tissue is no longer needed, the exemplary device may be removed surgically from the body and/or may remain implanted in an inert power-off state (procedure 1780).
The foregoing merely illustrates the principles of the disclosure. Various modifications and alterations to the described embodiments will be apparent to those skilled in the art in view of the teachings herein. Indeed, the arrangements, systems and methods according to the exemplary embodiments of the present disclosure can be used with and/or implement any OCT system, OFDI system, SD-OCT system or other imaging systems, and for example with those described in International Patent Application PCT/US2004/029148, filed Sep. 8, 2004 which published as International Patent Publication No. WO 2005/047813 on May 26, 2005, U.S. patent application Ser. No. 11/266,779, filed Nov. 2, 2005 which published as U.S. Patent Publication No. 2006/0093276 on May 4, 2006, and U.S. patent application Ser. No. 10/501,276, filed Jul. 9, 2004 which published as U.S. Patent Publication No. 2005/0018201 on Jan. 27, 2005, and U.S. Patent Publication No. 2002/0122246, published on May 9, 2002, the disclosures of which are incorporated by reference herein in their entireties. It will thus be appreciated that those skilled in the art will be able to devise numerous systems, arrangements, and procedures which, although not explicitly shown or described herein, embody the principles of the disclosure and can be thus within the spirit and scope of the disclosure. In addition, all publications and references referred to above can be incorporated herein by reference in their entireties. It should be understood that the exemplary procedures described herein can be stored on any computer accessible medium, including a hard drive, RAM, ROM, removable disks, CD-ROM, memory sticks, etc., and executed by a processing arrangement and/or computing arrangement which can be and/or include a hardware processors, microprocessor, mini, macro, mainframe, etc., including a plurality and/or combination thereof. In addition, certain terms used in the present disclosure, including the specification, drawings and claims thereof, can be used synonymously in certain instances, including, but not limited to, e.g., data and information. It should be understood that, while these words, and/or other words that can be synonymous to one another, can be used synonymously herein, that there can be instances when such words can be intended to not be used synonymously. Further, to the extent that the prior art knowledge has not been explicitly incorporated by reference herein above, it can be explicitly being incorporated herein in its entirety. All publications referenced above can be incorporated herein by reference in their entireties.
The present application relates to and claims the benefit and priority from International Patent Application No. PCT/US2015/010445 filed Jan. 7, 2015, which claims the benefit and priority from U.S. Patent Application No. 61/924,574 filed on Jan. 7, 2014, the entire disclosures of which are incorporated herein by reference in their entireties.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2015/010445 | 1/7/2015 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2015/105850 | 7/16/2015 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
7534207 | Shehada | May 2009 | B2 |
20030018280 | Lewkowicz | Jan 2003 | A1 |
20050004474 | Iddan | Jan 2005 | A1 |
20050259487 | Glukhovsky | Nov 2005 | A1 |
20050261552 | Mori et al. | Nov 2005 | A1 |
20060178557 | Mintchev et al. | Aug 2006 | A1 |
20060210603 | Williams et al. | Sep 2006 | A1 |
20080140341 | Ralston et al. | Jun 2008 | A1 |
20080304128 | Busker et al. | Dec 2008 | A1 |
20090093728 | Hyde | Apr 2009 | A1 |
20090177033 | Hendriks et al. | Jul 2009 | A1 |
20110001789 | Wilson | Jan 2011 | A1 |
20110306897 | Imran | Dec 2011 | A1 |
20120050888 | Dai | Mar 2012 | A1 |
20120071710 | Gazdzinski | Mar 2012 | A1 |
20120320184 | Seyfried | Dec 2012 | A1 |
20120325003 | Berger et al. | Dec 2012 | A1 |
20130060085 | Anglopoulou et al. | Mar 2013 | A1 |
20130310643 | Gora et al. | Nov 2013 | A1 |
20150234155 | Lin | Aug 2015 | A1 |
Number | Date | Country |
---|---|---|
WO 2013148360 | Oct 2013 | WO |
Entry |
---|
Michael W. Davidson, “Resolution”, MicroscopyU, Nikon. |
Brian O. Flynn and Michael W. Davidson, “CCD Resolution for Optical Microscopy”, MicroscopyU, Nikon. |
Ford, Tim N, Chu, Kengyeh K, Mertz, Jerome, Phase-gradient microscopy in thick tissue with oblique back-illumination, Oct. 28, 2012 online, Nature Methods, vol. 9 (Year: 2012). |
Written Opinion of the International Search Authority for PCT/US2015/010445 dated Apr. 13, 2015. |
International Search Report from the International Search Authority for PCT/US2015/010445 dated Apr. 13, 2015. |
Number | Date | Country | |
---|---|---|---|
20160331209 A1 | Nov 2016 | US |
Number | Date | Country | |
---|---|---|---|
61924574 | Jan 2014 | US |