The present invention relates to diagnostic imaging inside the human body using a capsule camera device. In particular, the present invention relates to capturing images in the human gastrointestinal track using multi-spectral light sources.
Devices for imaging body cavities or passages in vivo are known in the art and include endoscopes and autonomous encapsulated cameras. Endoscopes are flexible or rigid tubes that pass into the body through an orifice or surgical opening, typically into the esophagus via the mouth or into the colon via the rectum. An image is formed at the distal end using a lens and transmitted to the proximal end, outside the body, either by a lens-relay system or by a coherent fiber-optic bundle. A conceptually similar instrument might record an image electronically at the distal end, for example using a CCD or CMOS array, and transfer the image data as an electrical signal to the proximal end through a cable. Because of the difficulty traversing a convoluted passage, endoscopes cannot reach the majority of the small intestine and special techniques and precautions, that add cost, are required to reach the entirety of the colon. An alternative in vivo image sensor that addresses many of these problems is capsule endoscope. A camera is housed in a swallowable capsule, along with a radio transmitter for transmitting data, primarily comprising images recorded by the digital camera, to a base-station receiver or transceiver and data recorder outside the body. Another autonomous capsule camera system with on-board data storage was disclosed in the U.S. patent application Ser. No. 11/533,304, filed on Sep. 19, 2006.
It is known that different anatomical structure and tissue characteristics may respond to specific light spectrum differently. For example, blood vessels absorb visible light with a principle peak around the 415 nm (i.e., blue light). This makes the blood vessels seen clearly under light with this short wavelength. Accordingly, narrow band imaging has been used for various endoscopic applications such as to detect the hypervascular locations that often characterize the malignancy of precursor of malignancy. It is also known that cancer lesion has higher concentration of certain substances that have different spectrum responses from the nearby tissues. Therefore, relevance between anatomical structure/tissue characteristics and their responses to specific light spectrum can be utilized to detect the existence of possible malignancy or precursor of malignancy.
However, in the capsule endoscope application, when these special light sources are applied in conjunction with its normal light source, it may substantially increase the power consumption due to the additional light sources and corresponding images captured. Usually a white light source is used as the normal light source to illuminate the gastrointestinal tract during image capture. For capsule applications, the capsule camera is powered by small batteries with limited power budget. The batteries are expected to last for hours or even beyond ten hours after the capsule is swallowed. The target areas to be imaged may be the pharynx, esophagus, stomach, small bowel, colon or the entire gastrointestinal tract. The target areas may be a combination of two or more different areas such as the small bowel and colon. The total number of images to be captured may be as many as tens of thousands. The use of multiple spectral light sources may cause a power budget issue and it is desirable to overcome the issue without the need to substantially increase the battery capacity or to lower image quality and/or the number of captured images.
A capsule camera device is disclosed, where the capsule camera device comprises multiple light sources with different spectral characteristics for illuminating lumen walls selectively based on a determined capsule location in the gastrointestinal (GI) tract. The capsule camera device includes two or more light sources, an image sensor, a battery, a control module and a housing to enclose the above components in a sealed environment. The control module is used to select one or more selected light sources from said at least two light sources depending on a determined capsule location in the GI tract. Only the selected light source or light sources will be used for illumination in the determined capsule location.
One aspect of the present invention addresses the multiple light sources with different spectral characteristics. The light sources may comprise a white light source and a blue light source, where the white light source has a light spectrum that substantially covers visible lights and the blue light source has a high spectral concentration at about 415 nm. The light sources may comprise an additional light source having high spectral concentration substantially different from 415 nm. The light sources may also comprise two light sources, where one has a high spectral concentration at about 415 nm and the other has a high spectral concentration substantially different from 415 nm. The selected light sources may be used one at a time in turn for illumination in the determined capsule location. The selected light sources may also be used at the same time for illumination in the determined capsule location.
Another aspect of the present invention addresses the determining means to determine the determined capsule location. In one embodiment, the determined capsule location is determined based on expected transit times of the capsule camera using a timing device inside the capsule camera device. In another embodiment, a processing module is used to determine the determined capsule location based on the images captured by the capsule camera device. The processing module can be configured to determine the determined capsule location based on multiple frames of the images captured by the capsule camera device. A determining process for determining the determined capsule location may use a training procedure by correlating said determining the determined capsule location with visual location determination based on the images captured by the capsule camera device. The processing module may be configured to determine the determined capsule location according to color characteristics of the images captured by the capsule camera device. The processing module may be configured to determine the determined capsule location by comparing emitted light intensities by the selected light sources and pixel intensities of the images captured by the capsule camera device. The processing module may be inside the capsule camera device. The processing module may also be in an external device, and the capsule camera device and the external device communicate wirelessly. The determined capsule location may be determined by disposing a location marking device at an intended location on the torso of a patient near the capsule location to be determined in the GI tract. A magnet can be used as the location marking device. The determined capsule location in the GI tract may correspond to the pharynx, esophagus, stomach, small bowel or colon.
In one application, the capsule camera device comprises on-board memory to store the images captured by the capsule camera device. In another application, the capsule camera device comprises a wireless transmitter to transmit the images captured by the capsule camera device to an external receiver.
It will be readily understood that the components of the present invention, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following more detailed description of the embodiments of the systems and methods of the present invention, as represented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention.
Reference throughout this specification to “one embodiment,” “an embodiment,” or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment may he included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. One skilled in the relevant art will recognize, however, that the invention can be practiced without one or more of the specific details, or with other methods, components, etc. In other instances, well-known structures, or operations are not shown or described in detail to avoid obscuring aspects of the invention.
The illustrated embodiments of the invention will be best understood by reference to the drawings, wherein like parts are designated by like numerals throughout. The following description is intended only by way of example, and simply illustrates certain selected embodiments of apparatus and methods that are consistent with the invention as claimed herein.
The use of he special spectrum light source or a second light source is targeted for a certain type of lesion, cancerous, pre-cancerous, or otherwise abnormal condition. Therefore, the use of the special spectrum light source or a second light source should be limited to the intended sections of the gastrointestinal (GI) tract. For example, a patient has certain symptoms indicative of a certain section with pathologies or a patient has familial inheritance of a certain disease that normally exists in a certain section of the GI tract. In another example, a patient has some particular habits such as smoke or volume alcohol consumption that may result in certain section in the GI tract in need of special attention. In yet another example, a patient may have a certain pre-exiting condition such as GERD (Gastroesophageal reflux disease), helicobacter pylori or previous colon polyp removal, which makes this patient a higher risk of malignancy in the esophagus, stomach or colon respectively. In yet another example, a certain section of the GI tract has higher dangerous pathologies than the other sections, such as the colon has higher likelihood of cancer growth than the small bowel.
Furthermore, the lesion in different sections of the GI tract may have different spectral response characteristics. Therefore, different light sources or different groups of light sources may be needed for each section. According to the present invention, different light sources having different spectral contents are applied to different sections of the GI tract. This may result in images more clearly indicative of pathologic significance and can also achieve substantial power saving compared to the case of using all light sources indiscriminately.
White light is usually used for standard endoscopy, where the light source has a light spectrum that covers substantially all visible lights. Therefore, white light endoscope can produce images similar to visual inspection of the mucosa with the naked eye. The LED light is typically used for the capsule application due to its compactness and low power consumption.
In one embodiment, images for an intended area of the GI tract may be taken under more than one light source, where each light source has a certain spectral characteristics. For example, a certain cancer lesion has different spectral responses. The images with combined light sources may reveal all features that are visible under lights with respective spectral responses. In another example, a section of the GI tract with two types of lesions having different spectral responses may take advantage of light sources with different corresponding spectral characteristics to reveal possible lesion in the images. In this case, light sources with different corresponding spectral characteristics are applied to the section of the GI tract where the two types of lesion are prone to occur. In yet another example, different images may be taken with one or more white light sources, one or more first special light sources with first spectral characteristic, and one or more second special light sources with second spectral characteristic for that section. The white light sources, the first special light sources and the second special sources are applied in turn to illuminate the lumen during image capture. For example, the white light sources may be applied to capture the first images the first special light sources may be used next to capture the second image; and then the second special light sources may be used to capture the third image for a substantially same scene. While the different types of light sources may be used in turn, these light sources may also be applied in a combined fashion. For example, the white light sources and the first special light sources may be used at the same time to illuminate a particular section of the GI tract. The white light sources and the second special light sources may be used at the same time to illuminate another particular section of the GI tract.
The capsule travels through the entire GI tract in a certain definitive order from the mouth into the pharynx, through the esophagus, then into the stomach, through the small intestine and finally through colon, before excretion. There is a wide variation of transit time in each section within population. For example, the length of time for the capsule to stay in the stomach before exiting from it may take hours. It may take 2 to 10 hours to travel through the small intestine depending on the motility of each individual. Even for a given individual, the transit time may vary significantly from day to day. For vast majority of patients, it usually takes no more than 5 minutes for the capsule to pass through the pharynx and esophagus and 2 hours to exit the stomach, and 12 hours to pass through the small bowel. Accordingly, one embodiment of the present invention utilizes an internal timing scheme to schedule the usage of a corresponding light source, a set of corresponding light sources among multiple light sources, or multiple sets of light sources for a respective target area of the GI tract. Each of the multiple light sources or multiple sets of light sources has a specific light spectral characteristics intended for revealing specific tissue characteristics. The target area may correspond to a GI section such as the pharynx, esophagus, stomach, small intestine or colon. The target area may also correspond to a transitional area such as the pylorus at the bottom end of the stomach toward the small bowel. The multiple light sources or multiple sets of light sources according to the present invention are carefully chosen to match the intended diagnosis. For example, a light source with high spectral concentration at about 415 nm is selected for imaging in the pharynx, esophagus and colon. When a scheduled light source selection is used, the light source with high 415 nm concentration can be selected for imaging from 1 to 5 minutes and from 2 hours after the capsule is swallowed. If the stomach is the target area to be imaged, a corresponding light source or a set of light sources can he selected in the first hour to examine stomach effectively.
In order to adapt to the transit time variation, another embodiment of the present invention utilizes image-based location determination to determine the arrival of capsule in a designated section in the GI tract. The images captured by the capsule camera may be indicative of the capsule location. For example, the size of the lumen can be judged by comparing the light intensity emitted from the light sources and the pixel intensities of the captured images. When the ratio of light intensity to the received image pixel intensity decreases noticeably, the capsule has presumably left the more spacious lumen (e.g., the stomach) and gone into a narrow lumen (e.g., the small bowel). For more accurate estimation, the process can be performed over a number of images. Color characteristic may also be used for making such an informed judgment. To deal with inter-person difference in GI color, in one embodiment of using color characteristic to determine the location, the color change from previous images of recent images within the same video of the procedure is used to determine the arrival of a new anatomical section in GI. The image-based location determination can be implemented using software, hardware modules, or a combination of software and hardware. The image-based location determination process can he performed using computational resources within the capsule. In one embodiment, a location determination algorithm is developed or fine-tuned with the help of accurate determination of the capsule location inside the GI tract. For example, a training procedure may be used to adjust the location determination algorithm by correlating the results from the algorithm and the result from an accurate location determination mechanism. For example, a human expert may visually examine the captured image and make more accurate location determination. The location determination algorithm may be realized in software program or programmable processor. For a capsule equipped with a wireless communication link between the capsule and a receiving station external to the human body, the required computation to determine the arrival of the capsule at a designated section of the GI tract can be performed externally. The capsule can be configured accordingly to use a desired light source or a set of light sources by the transmission from an external device of a determined location or a control signal back to the capsule.
In yet another embodiment, one or more location marking device can be placed external to human body at the proper location or locations. The capsule can be configured to detect the arrival at the pre-determined location or locations. Upon the detection of the pre-determined location or locations, the capsule can select a particular light source or a particular group of light sources to illuminate the lumen. For example, a magnet can be used as the location marking device and placed on the abdomen corresponding to the transition between the small bowel and the colon. When the capsule comes to the proximity of the magnet, the capsule may sense the existence of the magnet and select a desirable light source or a desirable set of light sources. Alternatively, an external device for location determining can be used to detect the capsule arrival in a certain location. Upon the detection of capsule arrival at the designated location, the external device can transmit a signal to the capsule wirelessly to cause the capsule to select a desirable light source or a desirable set of light sources.
Narrow band imaging (NBI) has been found useful to improve detection of cancerous tissue. For example, in a study by Emura, et al., (“The pharynx: examination of an area too often ignored during upper endoscopy”, published in GASTROINTESTINAL ENDOSCOPY, 2013, Vol. 78, No. 1, pages 143-149), NBI has been shown to be able to facilitate the detection of pharyngeal cancers. The use of NBI has remarkably improved visualization of superficial vessels over the conventional white-light endoscopy, allowing easier identification of hypervascular sites and early cancers. The NBI technique is also applicable to improve detection of cancer in other parts of the GI tract such as the esophagus, stomach, small bowel and colon.
In the field of endoscopy, there is a technique for discriminating between normal and adenomatous tissues based on autofluorescence excitation-emission matrix (EEM). In autofluorescence EEM, the emission spectrum at one or more certain excitation wavelengths may be used to illuminate the underlying tissues. The captured images can be examined in reference to the spectra of the excitation light to determine possible adenomatous. For example, in a study by Li, et al., (“Autofluorescence excitation-emission matrices for diagnosis of colonic cancer”, published in World Journal of Gastroenterology, July 2005, Vol. 11, No. 25, pages 3931-3934), the spectral response of images with any excitation wavelength higher than 380 nm illustrates very distinct characteristics between a normal tissue and a cancerous tissue. Accordingly, one or more corresponding light sources (e.g., one with 460 nm and one with 540 nm wavelengths) may be used to illuminate the colon. The autofluorescence EEM technique can also be applied to detect anomaly in other parts of the GI tract such as the pharynx, esophagus or small bowel with a respective light source or a set of light sources. Under a similar principle to the autofluorescence EEM, light sources with high spectral concentration at selected wavelengths can be used to illuminate a particular section of the GI track. The autofluorescence EEM can be obtained from the captured images and the known spectral characteristics of the light sources. Consequently, the present invention is also applicable to the autofluorescence EEM application.
According to the present invention, multiple light sources or multiple sets of light sources are used in the capsule camera, where the light sources are selected based on the capsule location in the GI tract.
Multiple spectral light sources may be arranged as a multiple spectral light module. A lighting arrangement may use multiple modules. For example,
In the example of
In another embodiment, each LED could be driven individually for different light intensity and/or duration of On time, where the abovementioned Off state is synonymous to driving strength is substantially zero or the driving duration is substantially zero.
While
The invention may he embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is therefore indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US13/77899 | 12/27/2013 | WO | 00 |