The present disclosure relates to exemplary embodiments of medical endoscopic imaging apparatus and method used to improve, e.g., the field of view, speed and efficiency of diagnostic endoscopic procedure, therapeutic endoscopic procedure, and other industrial inspection endoscopic procedures. The exemplary apparatus and method can be utilized and/or performed in conjunction with any endoscope.
Endoscopic arrangements generally use a rigid or flexible endoscope with accessory channel(s) to aid diagnosis, carry out treatment or inspection. The endoscope can be inserted into animal or human body in medical applications, including gastrointestinal tract, respiratory tract, and other internal organs, or other environments with special interests or under extreme conditions. The field of view of current endoscopic arrangement is generally limited by its configuration or light delivery and lens system, which only allows forward or another single directional field of view. The limitation of current endoscopic and laparoscopic devices to provide only one field of view typically decreases the diagnostic accuracy, and can cause various lesions to be missed.
One method for visualizing the backwards field of view can include inserting a separate backwards viewing endoscope through the accessory port of another endoscope. While this method provides backwards viewing, it can prevent the use of the accessory port while the backwards viewing endoscope is inserted therein. The backwards viewing endoscope should be withdrawn prior to biopsy acquisition, suction, and flushing, which can increase the time and cost of the procedure. A separate endoscope typically is furthermore sterilized following use, which can again increase the complexity of the procedure. The use of multiple endoscopes may also require multiple connections to an imaging console, which can further complicate the procedure. The additional complexity and cost of utilizing a separate endoscope can make it inconvenient to see in multiple directions, which may result in a decreased adoption of multiple endoscopes for obtaining images of additional fields of view.
The application of conventional forward viewing Endoscopy is limited primarily by the viewing angle of the instruments. Although large field of view endoscope is available, in many circumstances, there are considerable missed detections of important areas of interest, which could cause potential calamity without prompt treatment.
There may therefore be a need for addressing at least some of the issues and/or deficiencies identified above. To that end, it may be beneficial to provide an endoscopic or laparoscopic imaging system configuration that can facilitate multiple fields of view, including side and backwards fields. In addition, there may be a need to provide an imaging system for multidirectional fields of view endoscopy, in which the movement of the imaging system can be fully controlled and the diagnostic and therapeutic endoscopy can be performed in single procedure, if necessary.
Thus, apparatus and method according to an exemplary embodiment of the present disclosure can be provided that facilitates additional fields of view in a more beneficial device that does not remove the functionality of the endoscope's accessory port during the imaging procedure.
In various exemplary embodiments according to the present disclosure, exemplary configurations for the acquisition of multidirectional viewing during endoscopic examination can be provided. Exemplary applications can be utilized, in which increasing the field of view while using endoscopic systems can be improved with the exemplary embodiments of the apparatus and method of continuous and simultaneous forward and multidirectional views during a colonoscopic, baroscopic, laparoscopic, angioscopic, or other endoscopic procedures.
Multiple wavelengths illumination, fluorescence detection, 3D surface measurement, signal detector configuration, power management, image device clean mechanism, multiple sensors for measurement of temperature, blood pressure, positions, pH value, and heart rate, etc., can be configured into this image device to be used as a multifunctional and multidirectional fields of view device in cooperated with conventional endoscopy to provide controllable and effective diagnostic and therapeutic procedures.
In an exemplary embodiment of the present disclosure, an exemplary device/apparatus providing the multidirectional fields of view can be attached to the endoscope, which does not generally affect the normal function of the Endoscope, such as the accessory port and angulations. The exemplary apparatus can provide continuous and simultaneous forward and multidirectional views during a colonoscopic, baroscopic, laparoscopic, angioscopic, or other endoscopic procedures. Exemplary embodiments of the present disclosure can be applied to rigid, flexible, wireless or telescoping endoscope to provide, e.g., continuous multidirectional views of animate and inanimate hollow spaces. The dimensions of the exemplary apparatus may be scaled to fit specific scope sizes.
Exemplary embodiments of the present disclosure can relate generally to exemplary configuration of optical and electronic elements, and to the application(s) thereof in exemplary endoscopic imaging systems which can be used with medical and industrial applications to improve the field of view, speed and efficiency of an endoscopic procedure.
According to another exemplary embodiment of the present disclosure, the exemplary device/apparatus can include a video/analog/digital image sensor/camera and/or signal detectors and sensors that can be embedded in a cap that can be attached to the part of the endoscope. In a further exemplary embodiment of the present disclosure, multiple configurations of signals and/or images sensors/detectors can be contained within the cap.
In a further exemplary embodiment of the present disclosure, compressive imaging can be implemented to acquire the images. According to still another exemplary embodiment of the present disclosure, images can be detected by photodetectors, such as photodiodes, photocathodes, photomultiplier tubes, photoconductive cells, photovoltaic cells, photoresistors, phototransistors, cryogenic detectors, or single pixel CCD or single pixel CMOS sensors. According to another exemplary embodiment of the present disclosure, multiple pixels CCD and CMOS sensors can be used. For example, random and/or pseudorandom binary patterns and/or masks can be used to reconstruct the images of the subjects under examination. The patterns and/or masks can be generated by spatial light modulators, digital micromirror array, spinning disk of random patterns and/or masks. The masks can be implemented by using a set of light attenuating layers to modulate the light. The masks can also be implemented by using array of aperture elements, like liquid crystal display (LCD), of which each element can be controlled independently. For example, scanning mirrors, spatial light modulators, digital micromirror array, and/or array of aperture elements can be used to control the direction of the light illumination, so that images of the subjects under examination can be reconstructed.
According to yet another exemplary embodiment of the present disclosure, multiple configurations of light illumination can be included in the cap so as to illuminate the additional fields of view and provide multi wavelengths illumination and tissue fluorescence images. Multi wavelengths can be different colors, including red, green, blue, and/or white color, to provide multi bands imaging and different contrast for the tissue imaging, such as narrow band imaging used frequently in endoscopy. Fluorescence images include tissue autofluorescence images and exogenous fluorescence images by using exogenous fluorescent contrast agents.
In still a further exemplary embodiment of the present disclosure, switchable different wavelengths and/or color filters can be put in front of the light illumination sources to provide different illuminations. For example, switchable different wavelengths and/or color filters can be put in front of the image sensors, and/or signal detectors to filter different signals associated with different wavelengths.
According to yet another exemplary embodiment of the present disclosure, the imaging cap can be rotated, so that any particular area of interest can be accessed by the imaging device. A mechanical motor can be controlled by the imaging device and rotate the imaging cap around the endoscope.
In yet a further exemplary embodiment of the present disclosure, a three-dimensional structure can be measured by the imaging device by using passive stereo vision, by using multiple camera and/or image sensors, and/or detectors. For example, a three-dimensional structure can be measured by the imaging device by using active stereo vision, by using structured illumination, laser structured light, and/or scanned light beams.
According to yet another exemplary embodiment of the present disclosure, the signals and/or images can be transmitted remotely via a wireless transmitter. In addition or as an alternative, a battery source can be contained within the cap that can power the signals and/or images sensors/detectors and illumination sources without requiring an external connection.
In yet another exemplary embodiment of the present disclosure, the wireless transmission method includes radio frequency (RF) wireless technology and optical transmission of the signals using light wavelengths that penetrate the body effectively. For example, the light source can be light emitting diode (LED), laser diode (LD), and/or superluminescent diode (SLD). The wavelength can be in the visible range, near infra red, and/or infra red. The light source emits light modulated by the signals or the images. Two-way communication can be implemented. A signal receiver within the device can be used to receive commands from outside of the subject and send the commands to central processing unit in the device to function accordingly.
According to yet another exemplary embodiment of the present disclosure, the signals and/or images can be transmitted via one or more electrical wires that can be attached to the cap, and extend outside alongside the primary endoscope or probe device to an external signal/image processor. In yet another exemplary embodiment, power can be provided by electrical wires that can be attached to the cap, and extend outside alongside the primary endoscope or probe device with an external power supply.
In an additional exemplary embodiment of the present disclosure, the power can be provided by wirelessly and externally. Inductive coupling can be used to provide the power of the imaging device. According to yet another exemplary embodiment of the present disclosure, an ultrasonic transducer can be used to convert ultrasonic energy into an electrical energy and provide power of the imaging device.
Further, an exemplary apparatus can include an endoscopic first arrangement, a radiation source second arrangement which can provide at least one electro-magnetic radiation, a detector third arrangement, a signals/images transmission fourth arrangement, a power supply fifth arrangement and multifunctional sensors sixth arrangement. For example, the second to sixth arrangements can be attached to at least one portion of the endoscopic arrangement.
An exemplary detector arrangement can be provided, whereas the endoscopic arrangement can be associated with the radiation source arrangement, the signals/images transmission arrangement, the power supply arrangement, multifunctional sensors and/or the detector arrangement. The radiation can be directed in a backward direction or a side direction with illuminating 360 degrees of azimuth angle or any other degrees of angles with respect to the forward direction of the endoscopic first arrangement. Further, an electronic arrangement can be provided which can be configured to regulate and/or synchronize the radiation source arrangement, the detector arrangement, the signals/images transmission arrangement, the power supply arrangement, and the multifunctional sensors arrangement. As an alternative or in addition, the electronic arrangement can be configured to (i) synchronize the signals/images transmission arrangement and the detector arrangement, (ii) control the detector arrangement to detect signals from the anatomical or physical structure(s) illuminated by the radiation source, (iii) separate the signals from each detector based the synchronization with the signals/images transmission arrangement, (iv) manage the power for the electronic elements, (v) control the multifunctional sensors, and (vi) control the mechanical motors to position the imaging cap, light illumination, the supportive balloon and projections, etc.
According to yet another exemplary embodiment of the present disclosure, the imaging cap can be put on endoscopes by universal fit. Memory foam and/or silicone gel can be used as the inner tube materials. The materials will provide sufficient friction to grab the endoscopes and prevent the cap to fall off. For example, clamps can be used to grip tightly the imaging cap, and/or flexible connection segment between the battery housing and cap, with the endoscope. The cap can fit to the endoscope by use of a compression coupling arrangement in which the cap rotates in one direction on itself to increase the internal diameter for accepting the endoscope and rotates in the opposite direction on itself to reduce the internal diameter and temporarily fasten to the endoscope.
In yet a further another exemplary embodiment of the present disclosure, the transparent window of the imaging cap can be cleaned by water or air nozzle, which is connected by small hoses and/or ducts with the water or air nozzles of the endoscope. The imaging cap can be rotated, so that a window shield can be used to scrub the imaging window to keep it clean. Further or alternatively, the imaging window can be coated with materials (e.g. hydrophobic coatings) to prevent mucus and other environmental fluids to stain the imaging window so to keep it clean.
According to yet another exemplary embodiment of the present disclosure, the imaging cap may be constructed such that the outer covering material of the cap is designed to be disposable, while the internal optics and electronics are designed to be reusable. The cap covering material would be designed such that it may be sterilized. Once sterile, it would be opened by a person in the sterile field, while the non-sterile internal optics and electronics would be placed inside. Once the electronics and optics are inserted, the cap would be closed by the person in the sterile field and the procedure would continue.
In one exemplary embodiment of the present disclosure, an exemplary apparatus for coupling to a probe and providing information regarding at least one structure can be provided. For example, the apparatus can include an electronics arrangement which is configured to obtain the information and transmit the information wirelessly, and a structural connection configuration which is structured and configured to be attached to the probe.
For example, the probe can include an endoscope. The structural connection configuration can be structured to be connected to the probe at or near a distal end thereof. The information can be regarding at least one portion of the structure(s) that is different from further information regarding the structure(s) obtained separately by the probe. The electronics arrangement can be configured to obtain the information from a first direction, and the probe can be configured to obtain the further information from a second direction, which is approximately either opposite or perpendicular to the first direction.
According to an exemplary variant, the electronics arrangement can include a first illumination arrangement which can be structured and positioned to illuminate the structure(s) in a first direction, and the probe can include a second illumination arrangement which can be structured and positioned to illuminate the structure(s) in a second direction, which is approximately either opposite or perpendicular to the first direction. Further or in addition, the electronics arrangement can include a portable power arrangement which can be configured to provide power to at least one component of the electronics arrangement.
An inductive arrangement can also be provided which can be configured to recharge the power arrangement. A portable power arrangement can also be provided which can be coupled, in a wired configuration, to a housing of the electronics arrangement, and configured to provide power to at least one component of the electronics arrangement. In addition, a housing can be provided that at least partially encloses the electronics arrangement, where a total length of the housing that extends along an extension of the probe can be at most 35 mm and at least 25 mm. A total thickness of a wall of the housing that extends radially from the probe can be at most 2 mm and at least 1 mm.
In yet another exemplary embodiment of the present disclosure, the electronics arrangement can include a radiation-providing arrangement which can be configured to forward multiple radiations at different respective wavelengths to at least one portion of the sample (s). The electronics arrangement can further include a detector arrangement which is configured to detect image information regarding the portion(s) based on the wavelengths. The detector arrangement can include a single pixel detector and/or a multi-pixel detector. The detector arrangement can also include multiple detectors detecting return radiations from different respective portions of the sample(s). A computer arrangement can also be provided which is configured to generate further information based on the image information as a function of the wavelengths. The multiple radiations being provided by the radiation-providing arrangement can include predetermined patterns of light radiations A detector arrangement can also be provided which is configured to detect at least one return radiation from at least one portion of at least one sample based on the predetermined patterns, and provide the data for the portion(s) based on the return radiation(s). In addition, a computer arrangement can be provided which is configured to generate the information with includes image data for the portion(s) as a function of the data and prior knowledge of the predetermined patterns.
According to still another exemplary embodiment of the present disclosure, an apparatus for coupling to a probe and providing image information regarding at least one structure can be provided. For example, the apparatus can include a light-providing arrangement which is configured to forward predetermined patterns of light radiation to the structure(s), and a detector arrangement which can be configured to detect at least one return radiation from at least one portion of the structure based on the predetermined patterns, and provide the data for the portion(s) based on the return radiation(s). Further, a computer arrangement can be provided which is configured to generate the image information for the portion(s) as a function of the data and prior knowledge of the predetermined patterns. A structural connection configuration can further be provided which is structured and configured to be attached to the probe, and connected to the detector arrangement.
For example, the detector arrangement can include a single pixel detector, a multi-pixel detector, and/or multiple detectors detecting return radiations from different respective portions of the sample(s). The light-providing arrangement can include a source arrangement. The probe can include an endoscope. The detector and the computer arrangement can be part of an electronics arrangement which can be configured to transmit the image information wirelessly. A first fluid transmitting arrangement can be coupled to a second fluid transmitting arrangement of the probe.
In still a further exemplary embodiment of the present disclosure, an apparatus for coupling to a probe and providing information regarding at least one structure can be provided. The exemplary apparatus can include an electronics arrangement which is configured to obtain the information, a structural connection configuration which is structured and configured to be attached to the probe, and a first fluid transmitting arrangement coupled to a second fluid transmitting arrangement of the probe. For example, the first fluid transmitting arrangement can be configured to transmit a fluid thereof to an external portion of the apparatus. The fluid can be a gas and/or a liquid. The apparatus can also include a light-providing arrangement which is configured to forward predetermined patterns of light radiation to the structure(s), and a detector arrangement which is configured to detect at least one return radiation from at least one portion of the structure(s) based on the predetermined patterns, and provide the data for the portion(s) based on the return radiation(s). A computer arrangement can also be provided which is configured to generate the information for the portion(s) as a function of the data and prior knowledge of the predetermined patterns. The electronics arrangement can be configured to transmit the information wirelessly.
These and other objects, features and advantages of the exemplary embodiments of the present disclosure can become apparent upon reading the following detailed description of the exemplary embodiments of the present disclosure, when taken in conjunction with the appended claims.
Further objects, features and advantages of the present disclosure can become apparent from the following detailed description taken in conjunction with the accompanying Figures showing illustrative embodiments of the present disclosure, in which:
Throughout the drawings, the same reference numerals and characters, unless otherwise stated, are used to denote like features, elements, components, or portions of the illustrated embodiments. Moreover, while the present disclosure will now be described in detail with reference to the figures, it is done so in connection with the illustrative embodiments and is not limited by the particular embodiments illustrated in the figures, or the appended claims.
Using the exemplary embodiments of the apparatus, system and method of the present disclosure, it is possible to facilitate a visualization of a plurality of fields of view, and monitor plurality of indicators of diagnostic and therapeutic procedures, e.g., at a plurality of angles with respect to the long axis of the endoscope by multiplexing image fields of view, and multiple functional sensors by using an optical and electronic apparatus. In one exemplary embodiment of the present disclosure, an optical and electronic apparatus can be provided in which multiple miniature image sensors, signal detectors, lenses, and light emitting diodes (LEDs) are mounted at certain positions such that certain radiations are directed to and/or received from different field angles and therefore illuminate and/or receive different fields of view. Further, multiple sensors can be attached at certain positions to monitor temperature, blood pressure, positions, pH value, and heart rate, etc. In one exemplary embodiment of the present disclosure, a battery (e.g., 170) and wireless transmitters (e.g., 151) can be attached to provide power and transmit the captured images and acquired signals to a wireless receiver outside the subject under examination.
According to an exemplary embodiment of the present disclosure, as shown in
In yet another exemplary embodiment of the present disclosure, as shown in
According to another exemplary embodiment of the present disclosure, as shown in
Traditional imaging using a camera can be replaced with the procedure of, e.g., compressive imaging according to an exemplary embodiment of the present disclosure. For example, a single detector, in addition to a suitable scanning mechanism, can be used to acquire the images of the subject under examination. According to still another exemplary embodiment of the present disclosure, as shown in
In an alternative exemplary embodiment of the present disclosure, three-dimensional structures can be measured by the imaging device by using passive stereo vision, using, e.g., multiple camera and/or image sensors, and/or detectors 146. According to yet another exemplary embodiment of the present disclosure, three-dimensional structure can be measured by the imaging device using active stereo vision, e.g., using structured illumination, laser structured light, and/or scanned light beams 146.
In a still further exemplary embodiment of the present disclosure, the imaging cap 105 can be rotated, such that the imaging device can access any particular area of interest.
Furthermore, in one exemplary embodiment of the present disclosure, power can be provided wirelessly, e.g., via an inductive coupling. As shown in
According to yet another exemplary embodiment of the present disclosure, as shown in
According to a further exemplary embodiment of the present disclosure, switchable different wavelengths and/or color filters can be put in front of the light illumination sources (see components 154-157) to provide different illuminations. For example, switchable different wavelengths and/or color filters can be put in front of the image sensors, sources, and/or signal detectors (see, e.g., components 141, 142) to filter different signals associated with different wavelengths.
Furthermore, in one exemplary embodiment of the present disclosure, wireless transceivers can be attached to two-way communications with the wireless transceiver outside the subject under examination, to provide a fully functional management and control, such as, e.g., power management and regulation. For example, power can be turn on and off to save energy; light illumination modulation: the wavelength of the illumination source can be specifically chosen; and the positions of the camera can be rotated to provide maximum coverage of the area under examination.
In one exemplary embodiment of the present disclosure, to regulate power, the power supply (e.g., the battery 170) can be turned on/off and controlled by sensors of environmental indicators, such as the subject temperature, and/or pulse/heart rate. According to a particular exemplary embodiment of the present disclosure, the power supply (e.g., the battery 170) can also be turned on/off via a radio frequency (RF) wireless technology and/or optical transmission of the signals using light wavelengths that can penetrate the body effectively.
According to a further exemplary embodiment of the present disclosure, the apparatus is disposable, e.g., with only one time usage or after certain times of usages. In one exemplary embodiment of the present disclosure, a control circuit can be provided to allow the imaging device to turn on and off only a certain number of times. In addition or alternatively, the imaging device can be controlled or otherwise made to stop working after sterilization.
For example, to prevent an inappropriate operation of the imaging device, in one exemplary embodiment of the present disclosure, a sensor can be provided in the device, such as heat and/or tension sensor, that can detect if there is any external force attempting to break or otherwise damage the imaging cap. If the external force is applied (up to a certain amount), the imaging device can stop working immediately.
In yet another exemplary embodiment of the present disclosure, the imaging cap 105 can be placed on endoscopes via a universal fit. According to yet another exemplary embodiment of the present disclosure, memory foam and/or silicone gel can be used as the inner tube materials. The materials can provide sufficient friction to grab the endoscope and prevent the cap 105 from falling off. Further, clamps can be used to tightly grip the imaging cap 105, and/or a flexible connection segment can be provided between the battery housing 170 and the cap 105, with the endoscope 100.
According to yet another exemplary embodiment of the present disclosure, as shown in
In still another exemplary embodiment of the present disclosure, the whole or part of the imaging cap 105 can be transparent. A first electro-magnetic radiation, and a second electro-magnetic radiation from at least one anatomical structure that based on the first electro-magnetic radiation can pass through the imaging window.
According to yet another exemplary embodiment of the present disclosure, as shown in
In an additional exemplary embodiment of the present disclosure, as shown in
In order to facilitate an accurate localization of target lesions or regions of interest obtained with the exemplary imaging system, an exemplary procedure (which can be used to program a processing hardware arrangement, such as, e.g., a computer) can be used to reconstruct the three-dimensional positions of the target lesions and/or regions of interest.
According to yet another exemplary embodiment of the present disclosure, the imaging device (e.g., the imaging cap 105) can provide position information of the target lesions or regions of interest. In a further another exemplary embodiment of the present disclosure, the imaging device (e.g., the imaging cap 105) can mark the anatomical structure by ablation the tissue using heat or laser. According to still another exemplary embodiment of the present disclosure, the imaging device (e.g., the imaging cap 105) has position sensor which can provide three dimensional positions of the imaging device relative to a fix position outside the subject, such as the operation bed.
According to a further exemplary embodiment of the present disclosure, as shown in
The foregoing merely illustrates the principles of the disclosure. Various modifications and alterations to the described embodiments can be apparent to those skilled in the art in view of the teachings herein. Indeed, the arrangements, systems and methods according to the exemplary embodiments of the present disclosure can be used with and/or implement any OCT system, OFDI system, SD-OCT system or other imaging systems including second or higher order harmonic microscopy, sum/difference frequency fluorescence microscopy (one-photon or multi-photon fluorescence), and Raman microscopy (CARS, SRS), and for example with those described in International Patent Application PCT/US2004/029148, filed Sep. 8, 2004 which published as International Patent Publication No. WO 2005/047813 on May 26, 2005, U.S. patent application Ser. No. 11/266,779, filed Nov. 2, 2005 which published as U.S. Patent Publication No. 2006/0093276 on May 4, 2006, and U.S. patent application Ser. No. 10/501,276, filed Jul. 9, 2004 which published as U.S. Patent Publication No. 2005/0018201 on Jan. 27, 2005, and U.S. Patent Publication No. 2002/0122246, published on May 9, 2002, the disclosures of which are incorporated by reference herein in their entireties. It will thus be appreciated that those skilled in the art can be able to devise numerous systems, arrangements, and procedures which, although not explicitly shown or described herein, embody the principles of the disclosure and can be thus within the spirit and scope of the disclosure. In addition, all publications and references referred to above can be incorporated herein by reference in their entireties. It should be understood that the exemplary procedures described herein can be stored on any computer accessible medium, including a hard drive, RAM, ROM, removable disks, CD-ROM, memory sticks, etc., and executed by a processing arrangement and/or computing arrangement which can be and/or include a hardware processors, microprocessor, mini, macro, mainframe, etc., including a plurality and/or combination thereof. In addition, certain terms used in the present disclosure, including the specification, drawings and claims thereof, can be used synonymously in certain instances, including, but not limited to, e.g., data and information. It should be understood that, while these words, and/or other words that can be synonymous to one another, can be used synonymously herein, that there can be instances when such words can be intended to not be used synonymously. Further, to the extent that the prior art knowledge has not been explicitly incorporated by reference herein above, it can be explicitly being incorporated herein in its entirety. All publications referenced above can be incorporated herein by reference in their entireties.
The present application relates to U.S. Patent Application Ser. No. 61/856,152, filed Jul. 19, 2013, and U.S. Patent Application Ser. No. 61/985,824, filed Apr. 29, 2014, the entire disclosures of which are incorporated herein by reference.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2014/047034 | 7/17/2014 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
61856152 | Jul 2013 | US | |
61985824 | Apr 2014 | US |