1. Field of the Invention
The present invention relates to an endoscope system that observes the inside of a body cavity using special light having a specific wavelength, a processor device of the endoscope system, and an image display method.
2. Description Related to the Prior Art
In a current medical field, a cancer diagnosis using an endoscope is widely carried out. In this endoscopic cancer diagnosis, an insert section of the endoscope is introduced into a human body cavity. While illumination light having a predetermined wavelength is applied from a distal portion of the insert section to an observation object, the observation object is imaged by an imaging device provided at the distal portion to obtain an image in which various types of biological information appearing in the observation object are reflected. For example, according to US Patent Application Publication No. 2008/0294105 (corresponding to Japanese Patent No. 3559755), an image in which superficial blood vessels and a superficial fine structure are emphasized, though which are inconspicuous under broad band illumination light such as white light, is obtained by using narrow band light having a specific wavelength as the illumination light. Performing a diagnosis using such an image, which clearly shows the superficial blood vessels and the superficial fine structure, makes it possible not only to distinguish a cancer but also to estimate the stage of the cancer.
Also, according to Japanese Patent No. 2648494, an oxygen saturation level of hemoglobin in blood is imaged by using light having a wavelength band in which a light absorption coefficient is different between oxyhemoglobin and deoxyhemoglobin as the illumination light. For example, a cancer having a certain extent shows a hypoxic state at its center, while showing a hyperoxic state at its periphery. Thus, using an image of the oxygen saturation level, as described above, facilitates grasping the condition of a cancer intuitively.
In the case of performing the cancer diagnosis based on the superficial fine blood vessels and the like shown with emphasis, as described in the US Patent Application Publication No. 2008/0294105, it is required to have knowledge of a blood vessel pattern and the like specific to a cancer in advance. Also, to estimate the stage of the cancer from the blood vessel pattern, considerable knowledge and experience are required. On the other hand, in the case of performing the cancer diagnosis using the image of the oxygen saturation level, as described in the Japanese Patent No. 2648494, a cancer is easily distinguishable. However, as for the detailed cancer diagnosis of the stage of the cancer and the like, the information of a blood vessel shape including a pattern of the superficial fine blood vessels is required in addition to the information of the oxygen saturation level.
The present invention aims at providing an endoscope system that can grasp both blood vessel shape information of superficial fine blood vessels and the like and an oxygen saturation level of hemoglobin in blood, which are used for diagnosing a lesion such as a cancer, a processor device of the endoscope system, and an image display method.
To achieve the above object, an endoscope system according to the present invention includes a lighting section, an image signal obtaining section, an image generating section, and a display section. The lighting section sequentially applies to an observation object, first illumination light in a wavelength band having a high light absorption coefficient of hemoglobin and second illumination light in a wavelength band in which oxyhemoglobin and deoxyhemoglobin have different light absorption coefficients, out of light in a wavelength band penetrating to a depth of a specific layer in living body tissue. The image signal obtaining section obtains a first image signal by imaging the observation object under irradiation with the first illumination light and obtains a second image signal by imaging the observation object under irradiation with the second illumination light. The image generating section produces a first object image based on only the first image signal and produces a second object image based on the second image signal. The display section displays the first and second object images.
The image signal obtaining section preferably includes a positioning unit for performing positioning of an object image between the first and second image signals.
It is preferable that the image signal obtaining section further includes a structure enhancing unit for applying a structure enhancing process to the first and second image signals to enhance a structure of the observation object, and the positioning unit performs positioning of the object image between the first and second image signals after being subjected to the structure enhancing process. The structure of the observation object preferably includes a blood vessel structure.
The lighting section may include a broad band light source for emitting broad band light in a broad wavelength band and a rotary filter for sequentially transmitting the first and second illumination light out of the broad band light. The lighting section may include a plurality of semiconductor light sources for emitting the first and second illumination light.
The first illumination light contains at least blue narrow band light having a wavelength band in a blue region and green narrow band light having a wavelength band in a green region. The second illumination light contains at least narrow band light having two non-isosbestic wavelengths at which a magnitude relation of a light absorption coefficient between the oxyhemoglobin and the deoxyhemoglobin differs from each other, and narrow band light having an isosbestic wavelength at which the oxyhemoglobin and the deoxyhemoglobin have the same light absorption coefficient. The first object image is a blood vessel enhanced image in which a superficial blood vessel and a middle to deep-layer blood vessel are enhanced. The second object image is an oxygen saturation image, which images an oxygen saturation level of hemoglobin in blood.
It is preferable that the blue narrow band light is in a wavelength band of 410±10 nm, the narrow band light having the two non-isosbestic wavelengths is in wavelength bands of 440±10 nm and 470±10 nm, and the green narrow band light and the narrow band light of the isosbestic wavelength are in a wavelength band of 540±10 nm.
It is preferable that the second illumination light further includes narrow band light in a wavelength band of 650±10 nm and narrow band light in a wavelength band of 910±10 nm, as the narrow band light having the non-isosbestic wavelengths.
A processor device of an endoscope system according to the present invention includes an image signal obtaining section and an image generating section. The image signal obtaining section obtains a first image signal, which is obtained by imaging an observation object by an endoscope device under irradiation with first illumination light in a wavelength band having a high light absorption coefficient of hemoglobin out of light penetrating to a depth of a specific layer in living body tissue, and a second image signal, which is obtained by imaging the observation object by the endoscope device under irradiation with second illumination light in a wavelength band in which oxyhemoglobin and deoxyhemoglobin have different light absorption coefficients. The image generating section receives the first and second image signals, and produces a first object image based on only the first image signal and produces a second object image based on the second image signal.
An image display method according to the present invention includes an image signal obtaining step, an image generating step, and a display step. In the image signal obtaining step, a first image signal is obtained by imaging an observation object by an endoscope device under irradiation with first illumination light in a wavelength band having a high light absorption coefficient of hemoglobin out of light penetrating to a depth of a specific layer in living body tissue, and a second image signal is obtained by imaging the observation object by the endoscope device under irradiation with second illumination light in a wavelength band in which oxyhemoglobin and deoxyhemoglobin have different light absorption coefficients. In the image generating step, a first object image is produced based on only the first image signal and a second object image is produced based on the second image signal by an image generating section that receives the first and second image signals. In the display step, the first and second object images are displayed on a display section.
According to the present invention, the first object image and the second object image are obtained. The first object image is produced with irradiation with the first illumination light in a wavelength band having a high light absorption coefficient of hemoglobin, out of the light in a wavelength band penetrating to a specific depth in living body tissue. The second object image is produced with irradiation with the second illumination light in a wavelength band in which oxyhemoglobin and deoxyhemoglobin have different light absorption coefficients. By displaying the first and second object images on the display section, it is possible to grasp information about the shape of a blood vessel including superficial capillary vessels and the like from the first object image, and grasp the oxygen saturation level of hemoglobin in blood from the second object image.
In the case of sequentially applying at least the first illumination light and the second illumination light, the positioning of the object image is performed between the first image signal obtained by imaging the observation object under irradiation with the first illumination light and the second image signal obtained by imaging the observation object under irradiation with the second illumination light. Therefore, it is possible to obtain the first and second object images of high quality without occurrence of artifact and the like.
For more complete understanding of the present invention, and the advantage thereof, reference is now made to the subsequent descriptions taken in conj unction with the accompanying drawings, in which:
As shown in
This endoscope system 10 is switchable between a normal observation mode using light having a wavelength band extending from blue to red as illumination light of an observation object and a special observation mode using narrow band light having a wavelength limited within a specific band as the illumination light. The switching between these modes is performed with a mode switch SW 20 provided on the electronic endoscope 11.
The electronic endoscope 11 includes a flexible insert section 16 to be introduced into the body cavity, a handling section 17 provided on a proximal end portion of the insert section 16, and a universal cord 18 for connecting the handling section 17 to the processor device 12 and to the light source device 13.
The insert section 16 has at its distal end a bending portion 19 that is composed of a train of joint pieces. The bending portion 19 flexibly bends up and down and from side to side in response to an operation of an angle knob 21 provided on the handling section 17. The bending portion 19 is provided with a distal end portion 16a, which contains an optical system and the like used for imaging the inside of the body cavity. The distal end portion 16a is aimed at a desired direction by a bending operation of the bending portion 19.
A connector 24 is attached to the universal cord 18 on the side of the processor device 12 and the light source device 13. The connector 24 is a complex type connector including a communication connector and a light source connector. The electronic endoscope 11 is detachably connected to the processor device 12 and the light source device 13 through this connector 24.
As shown in
In the normal observation mode, the rotary filter 31 for normal observation is set in an optical path of the broad band light source 30 by the filter switch 34. As shown in
In the special observation mode, the rotary filter 32 for special observation is set in the optical path of the broad band light source 30 by the filter switch 34. As shown in
As shown in
The CCD 44 receives the incident light from the condenser lens 51 at its imaging surface 44a, and accumulates signal charge that is obtained by photoelectric conversion of the received light. The accumulated signal charge is read out as an imaging signal. The read imaging signal is transmitted to the AFE 45. The AFE 45 includes a correlated double sampling circuit (CDS) for applying a correlated double sampling process to the imaging signal from the CCD 44, an automatic gain control circuit (AGC) for amplifying the imaging signal after noise reduction by the CDS, and an analog-to-digital converter (A/D) for converting the imaging signal amplified by the AGC into a digital imaging signal having a predetermined bit number and inputting the digital imaging signal to the processor device 12 (none is shown in the drawing) . Note that, a monochrome CCD, which does not have a color separation filter (for example, an RGB filter) is used as the CCD 44.
The imaging controller 46 is connected to a controller 59 of the processor device 12, and transmits a drive signal to the CCD 44 upon a command from the controller 59. The CCD 44 outputs the imaging signal to the AFE 45 at a predetermined frame rate based on the drive signal from the imaging controller 46.
The imaging controller 46 performs different control operations between in the normal observation mode and in the special observation mode. In the normal observation mode, as shown in
On the other hand, in the special observation mode, as shown in
As shown in
The observation image generator 57 includes a normal image generator 60 and a special image generator 61. The normal image generator 60 produces a normal image in which the blue image is assigned to a B channel of a display, the green image is assigned to a G channel, and the red image is assigned to a red channel. The display control circuit 58 displays the produced normal image on the monitor 14.
The special image generator 61 includes a blood vessel enhancing unit 62, a positioning unit 63, a blood vessel enhanced image generating unit 64, and an oxygen saturation image generating unit 65. The blood vessel enhancing unit 62 enhances a blood vessel portion in the first to fourth narrow band images by a frequency filtering process. In enhancing the blood vessel portion, a superficial blood vessel is enhanced in the first and second narrow band images, both the superficial blood vessel and a middle-layer blood vessel are enhanced in the third narrow band image, and the middle-layer blood vessel is enhanced in the fourth narrow band image, in consideration of the difference in a hemoglobin light absorption property and a light scattering property of digestive mucosa among the first to fourth narrow band light used for obtaining the first to fourth narrow band images. These enhanced first to fourth narrow band images in which the predetermined blood vessels are enhanced are stored to the frame memory 56.
Note that, for example, a predetermined two dimensional filter is used for blood vessel enhancement of each layer. To produce the two dimensional filter, a frequency corresponding to a blood vessel of each layer in an image is first obtained based on the assumption of the distance between the distal portion 16a of the electronic endoscope 11 and an observation area and a magnification thereof. Next, a filter that enhances only that frequency band is designed in frequency space, and the filter is subjected to Fourier transform so as to correspond to real space. Here, it is required to adjust the property of the two dimensional filter in the frequency space such that the size of the two dimensional filter is set within a realistic size of the order of 5×5, for example.
The positioning unit 63 performs positioning among the enhanced first to fourth narrow band images based on the enhanced first to fourth narrow band images. As shown in
As a method for the positioning among the enhanced first to third narrow band images, the enhanced first narrow band image is shifted up and down and right and left by a few pixels, and a difference from the enhanced second narrow band image is obtained. By repeating this step for a plurality of times, a shift amount that minimizes a sum of an absolute value of a differential signal of each pixel is obtained. Then, the enhanced first narrow band image is shifted by this shift amount. Thus, the positioning of the enhanced first narrow band image is completed. Also as for the enhanced third narrow band image, the same procedure as that of the enhanced first narrow band image is performed. Note that, the positioning between the enhanced third narrow band image and the enhanced fourth narrow band image is performed in a like manner.
The blood vessel enhanced image generating unit 64 produces a blood vessel enhanced image by assigning the enhanced and positioned first narrow band image to the B and G channels for display and assigning the enhanced and positioned fourth narrow band image to the R channel for display. The oxygen saturation image generating unit 65 produces an oxygen saturation image by assigning the enhanced and positioned third narrow band image to the B channel for display, and assigning the enhanced and positioned fourth narrow band image to the G channel for display, and assigning the enhanced and positioned second narrow band image to the R channel for display. The display control circuit 58 displays the produced blood vessel enhanced image and the oxygen saturation image side by side on the monitor 14 as shown in
In the blood vessel enhanced image displayed on the monitor 14, the superficial blood vessel is enhanced by the first narrow band light N1 penetrating to the depth of the superficial blood vessel, and the middle-layer blood vessel is enhanced by the fourth narrow band light N4 penetrating to the depth of the middle-layer blood vessel. This is because, as shown in
In the oxygen saturation image shown on the monitor 14, a portion having a high oxygen saturation level is colored red rather than blue, and a portion having a low oxygen saturation level is colored blue rather than red. This is because, as shown in
The operation of the present invention will be described in accordance with a flowchart of
The CCD 44 provided in the electronic endoscope 11 images the observation object irradiated with the first narrow band light N1, and output the first narrow band imaging signal. In a like manner, the CCD 44 images the observation object irradiated with the second narrow band light N2 and outputs the second narrow band imaging signal. The CCD 44 images the observation object irradiated with the third narrow band light N3 and outputs the third narrow band imaging signal. The CCD 44 images the observation object irradiated with the fourth narrow band light N4 and outputs the fourth narrow band imaging signal.
The DSP 55 provided in the processor device 12 applies various types of processes to the obtained first to fourth narrow band imaging signals. The processed first to fourth narrow band imaging signals are stored to the frame memory 56 as the first to fourth narrow band images. After that, the blood vessel enhancing unit 62 applies the blood vessel enhancing process to the first to fourth narrow band images. Since the first to third narrow band images are produced using the first to third narrow band light N1 to N3 in the blue region that penetrates to the depth of the superficial blood vessel, the frequency filtering process is applied thereto to enhance the superficial blood vessel. On the other hand, since the third and fourth narrow band images are produced using the third and fourth narrow band light N3 and N4 in the blue to green region that penetrates to the depth of the middle-layer blood vessel, the filtering process for enhancing the middle-layer blood vessel is applied thereto. Therefore, the enhanced first to fourth narrow band images are obtained.
Next, the positioning unit 63 performs positioning of the object image among the enhanced first to fourth narrow band images. The positioning unit 63 shifts a narrow band image to be positioned up and down and right and left by a few pixels, and calculates a difference from a narrow band image to be a reference. By repeating this step for a plurality of times, a shift amount that minimizes an absolute value of the difference is obtained. Then, the narrow band image to be positioned is shifted by this shift amount. Thus, the positioning of the narrow band image is completed. The enhanced first to fourth narrow band images after the positioning are stored to the frame memory 56 again.
Then, the blood vessel enhanced image is produced based on the enhanced and positioned first to fourth narrow band images, and the oxygen saturation image is produced based on the enhanced and positioned second to fourth narrow band images. The produced blood vessel enhanced image and oxygen saturation image are displayed side by side on the monitor 14. The operation flow described above is repeated during the special observation mode.
Note that, the rotary filter 32 for special observation, which sequentially transmits the first to fourth narrow band light N1 to N4, is used in the above first embodiment. Instead of this, as shown in
The blood vessel enhancing unit 62 applies the blood vessel enhancing process to fifth and sixth narrow band images obtained using the fifth and sixth narrow band light N5 and N6, as with the other images, to produce fifth and sixth narrow band images.
Since the fifth and sixth narrow band light N5 and N6 penetrates to the depth of a deep-layer blood vessel, the fifth and sixth narrow band images are preferably subjected to a deep-layer blood vessel enhancing process. In addition to this, the fifth and sixth narrow band images are preferably subjected to the middle-layer blood vessel enhancing process for the purpose of facilitating positioning with the fourth narrow band image. After that, the positioning between the enhanced fifth and sixth narrow band images and the other enhanced first to fourth narrow band images is performed. A positioning method is the same as that of the above first embodiment.
To produce the oxygen saturation image, as with the above first embodiment, a first oxygen saturation image is produced based on the second to fourth narrow band light N2 to N4, and a second oxygen saturation image is produced based on fourth to sixth narrow band light N4 to N6. The first oxygen saturation image is assigned to the RGB channels for display in the same manner as the above first embodiment. As for the second oxygen saturation image, on the other hand, the enhanced and positioned sixth narrow band image is assigned to the B channel for display, the enhanced and positioned fourth narrow band image is assigned to the G channel for display, and the enhanced and positioned fifth narrow band image is assigned to the R channel for display.
The produced blood vessel enhanced image, the first oxygen saturation image, and the second oxygen saturation image are displayed side by side on the monitor 14. The distribution of the oxygen saturation level of the superficial blood vessel is precisely reflected in the first oxygen saturation image. The distribution of the oxygen saturation level of the middle to deep-layer blood vessels is precisely reflected in the second oxygen saturation image. Thus, using the first and second oxygen saturation images makes it possible to observe an oxygen saturation state of living body tissue in a depth direction.
As shown in
The light source device 101 is provided with a first semiconductor light source 102 for emitting first narrow band light N1 having a wavelength band of 410±10 nm, a second semiconductor light source 103 for emitting second narrow band light N2 having a wavelength band of 440±10 nm, a third semiconductor light source 104 for emitting third narrow band light N3 having a wavelength band of 470±10 nm, and a fourth semiconductor light source 105 for emitting fourth narrow band light N4 having a wavelength band of 540±10 nm, and a light source controller 106 for controlling the operation of the first to fourth semiconductor light sources 102 to 105, in addition to the broad band light source 30, which is identical to that of the first embodiment.
The broad band light BB from the broad band light source 30 is incident upon an optical fiber 30a through the condenser lens 39. On the other hand, the first to fourth narrow band light N1 to N4 from the first to fourth semiconductor light sources 102 to 105 is incident upon optical fibers 102a to 105a, respectively. These optical fibers 30a and 102a to 105a are coupled to the light guide 43 via a coupler 110. Thus, the light led through each of the optical fibers 30a and 102a to 105a enters the light guide 43 through the coupler 110. The light source device 101 has a shutter 112, which is shiftable between a position inserted into the optical path of the broad band light source 30 to block the entrance of the broad band light BB to the optical fiber 30a and a position retracted from the optical path to allow the entrance of the broad band light BB to the optical fiber 30a. Note that, it is unnecessary to provide the shutter 112 if the broad band light source 30 uses a light source that can instantaneously switchable between ON and OFF such as a white LED.
In the second embodiment, the shutter 112 is set in the retracted position in the normal observation mode. At this time, the first to fourth semiconductor light sources 102 to 105 are always turned off . Thus, only the broad band light BB is applied to the observation object, and a normal image is produced based on the broad band light BB. In the special observation mode, on the other hand, while the shutter 112 is set in the inserted position, the first to fourth semiconductor light sources 102 to 105 are sequentially turned on. Thus, the first to fourth narrow band light N1 to N4 is sequentially applied to the observation object, while the broad band light BB is blocked.
Note that, the oxygen saturation level is imaged in the above first and second embodiments, but an oxyhemoglobin index calculated by “blood volume (the sum of oxyhemoglobin and deoxyhemoglobin)×oxygen saturation level (%)” or a deoxyhemoglobin index calculated by “blood volume×(100−oxygen saturation level) (%)” may be calculated instead of or in addition to this.
Note that, in the above first and second embodiments, the blood vessel enhancing process is applied in order to increase precision in the positioning of a blood vessel between images. However, if the positioning is performed based on various types of structure, an outline, and the like of the observation object such as an edge of mucosa, other than the blood vessel, an enhancing process may be applied to the various types of structure and the outline.
Although the present invention has been fully described by the way of the preferred embodiment thereof with reference to the accompanying drawings, various changes and modifications will be apparent to those having skill in this field. Therefore, unless otherwise these changes and modifications depart from the scope of the present invention, they should be construed as included therein.
Number | Date | Country | Kind |
---|---|---|---|
2011-149994 | Jul 2011 | JP | national |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2012/064974 | Jun 2012 | US |
Child | 14104509 | US |