1. Field of the Invention
The present invention relates to an endoscope system capable of clearly observing a microstructure such as a pit pattern or an irregular pattern such as hypertrophy, which is formed on body tissue, and an image generation method
2. Description of the Related Art
In recent medical treatment, diagnosis or the like using an endoscope apparatus has been widely performed. In this endoscopic diagnosis, not only normal light observation, in which white light of broadband light is used as illumination light within the subject, but also special light observation, in which a lesion, such as cancer, is made clearer than other parts or the position or the size of the lesion is easily intuitively grasped by using the special light having a specific wavelength as illumination light, is performed.
For example, in JP2001-170009A, using the fact that the degree of penetration in the depth direction of the body tissue and the absorption characteristics of hemoglobin in the blood have a wavelength dependency, a microstructure such as a pit pattern or a microvessel formed in a body tissue surface layer is made clear with blue narrow-band light having a short wavelength, and a thick blood vessel located in a medium-deep layer of the body tissue is made clear with green narrow-band light having a longer wavelength than that of the blue narrow-band light Blood vessels or superficial microstructures of the surface to medium-deep layers are important clues at the time of differential diagnosis of cancer or degree-of-penetration diagnosis Therefore, it is possible to greatly improve the accuracy of differentiation and the like by making the blood vessels or the superficial microstructures of the surface to medium-deep layers clear using blue narrow-band light or green narrow-band light.
In addition, in JP1996-252218A (JP-H08-252218A), a boundary between a lesion part and a normal part is made clear by using the characteristic that the amount of auto-fluorescence emitted from the lesion part, which is thickened due to the lesion such as cancer, is less than the amount of auto-fluorescence from the normal part, which is not thickened, when irradiating the body tissue with excitation light for exciting the auto-fluorescence. By making the boundary between the lesion part and the normal part clear as described above, it becomes easy to grasp the position or the size of the lesion part when performing observation from a distant-view state as at the time of screening.
In recent years, there are various kinds of cancer differentiation methods or methods for degree-of-penetration diagnosis. Accordingly, there is not only a case where cancer diagnosis is performed from both a blood vessel pattern, such as a superficial microvessel or a medium-deep layer blood vessel, and an irregular pattern, such as a superficial microstructure or hypertrophy, but also a case where diagnosis is performed by focusing only on the irregular pattern. When performing diagnosis by focusing only on the irregular pattern as described above, it is necessary to reduce the visibility of the blood vessel pattern while improving the visibility of the irregular pattern.
For making only the irregular pattern clear, there is no description and suggestion in JP2001-170009A. In addition, according to JP1996-252218A (JP-H08-252218A), it is possible to make the hypertrophy of the irregular pattern clear. However, auto-fluorescence used to detect the hypertrophy is weak. Therefore, in order to capture the auto-fluorescence with good sensitivity, a high-sensitivity imaging device such as an EMCCD is separately required.
It is an object of the present invention to provide an endoscope system and an image generation method capable of improving the visibility of irregularities on body tissue, such as a superficial microstructure or a hypertrophy.
An endoscope system of the present invention includes: an illumination unit that irradiates a subject with illumination light; an image signal acquisition unit that acquires an image signal by capturing image light of reflected light from the subject; and an irregularity image generation unit that generates an irregularity image, in which visibility of irregularities on body tissue is relatively improved, by suppressing display of blood vessels in the subject based on the image signal.
Preferably, the irregularity image generation unit includes a microstructure image generation section that generates a microstructure image, in which visibility of superficial microstructures is relatively improved, by suppressing display of blood vessels based on a signal obtained by removing a component of a first high absorption wavelength band, in which an absorption coefficient of hemoglobin in blood is high, in a blue wavelength band from the image signal. It is preferable that the first high absorption wavelength band be 400 nm to 450 nm.
Preferably, the irregularity image generation unit includes a microstructure image generation section that generates a microstructure image, in which visibility of hypertrophy is relatively improved, by suppressing display of blood vessels based on a signal obtained by removing a component of a second high absorption wavelength band, in which an absorption coefficient of hemoglobin in blood is high, in a green wavelength band from the image signal. It is preferable that the second high absorption wavelength band be 520 nm to 580 nm.
In addition, in the present invention, preferably, the illumination unit includes a high absorption wavelength rejection filter that removes a component of a high absorption wavelength band, in which an absorption coefficient of hemoglobin in blood is high, from the illumination light, and the image signal acquisition unit captures image light of reflected light from the subject, from which the component of the high absorption wavelength band has been removed by the high absorption wavelength rejection filter. Preferably, imaging of the subject is performed by a color imaging device having pixels of a plurality of colors for which respective color separation filters are provided. Preferably, the illumination unit irradiates the subject sequentially with light beams of a plurality of colors, and imaging of the subject is performed by a monochrome imaging device whenever the light beams of the plurality of colors are sequentially irradiated to the subject.
Preferably, the illumination unit sequentially irradiates illumination light for a surface layer obtained by removing a component of a first high absorption wavelength band, in which an absorption coefficient of hemoglobin in blood is high, in a blue wavelength band and illumination light for a medium-deep layer obtained by removing a component of a first high absorption wavelength band, in which an absorption coefficient of hemoglobin in blood is high, in a green wavelength band, and imaging of the subject is performed whenever sequential irradiation is performed by the illumination unit.
Preferably, the irregularity image generation unit includes an image generation section that acquires a spectral image of a wavelength component other than a wavelength component, in which an absorption coefficient of hemoglobin in blood is high, of the reflected light by spectral estimation based on the image signal and generates the irregularity image based on the spectral image. It is preferable to further include display unit for displaying the irregularity image.
An image generation method of the present invention includes: irradiating a subject with illumination light using illumination unit; acquiring an image signal by capturing image light of reflected light from the subject using image signal acquisition unit; and generating an irregularity image, in which visibility of irregularities on body tissue is relatively improved, by suppressing display of blood vessels in the subject based on the image signal using irregularity image generation unit.
According to the present invention, in the irregularity image acquired by the irregularity image generation unit, the visibility of irregularities on the body tissue is relatively improved by suppressing the display of blood vessels in the subject.
As shown in
The electronic endoscope 11 includes a flexible insertion unit 16 that is inserted into the subject, an operating unit 17 provided at the proximal end of the insertion unit 16, and a universal code 18 that makes a connection between the operating unit 17 and the processor device 12 and the light source device 13. A curved portion 19 obtained by connecting a plurality of curved pieces is formed at the distal end of the insertion unit 16. The curved portion 19 is curved in the horizontal and vertical directions by operating an angle knob 21 of the operating unit 17. A distal portion 16a including an optical system for imaging the body cavity and the like is provided at the distal end of the curved portion 19. The distal portion 16a is directed in a desired direction within the subject by the bending operation of the curved portion 19.
In addition, a mode switch SW 15 for switching to various modes is provided in the operating unit 17. The modes include a total of four modes of a normal observation mode in which a normal light image obtained by imaging a subject illuminated with white light is displayed on the monitor 14, a microstructure observation mode in which a microstructure enhancement image emphasizing the microstructure formed on the surface layer of body tissue is displayed on the monitor 14, a hypertrophy observation mode in which a hypertrophy enhancement image that emphasizes a hypertrophy having a thickness from the surface layer to the medium-deep layer in body tissue is displayed, and a microstructure and hypertrophy observation mode in which a microstructure and hypertrophy enhancement image emphasizing both the microstructure and the hypertrophy is displayed on the monitor 14.
A connector 24 is attached to the universal code 18 on the side of the processor device 12 and the light source device 13. The connector 24 is a composite connector including a communication connector and a light source connector, and the electronic endoscope 11 is detachably connected to the processor device 12 and the light source device 13 through the connector 24.
As shown in
The filter insertion and removal unit 32 moves the high absorption wavelength rejection filter 33 between an insertion position, at which the high absorption wavelength rejection filter 33 is inserted in the optical path Lw of the white light W, and a retraction position, at which the high absorption wavelength rejection filter 33 is retracted from the optical path Lw, according to the mode that is set. When the normal observation mode is set, the high absorption wavelength rejection filter 33 is set at the retraction position. Accordingly, the white light W is incident on the light guide 43 through a condensing lens 34. On the other hand, when the microstructure observation mode, the hypertrophy observation mode, and the microstructure and hypertrophy observation mode are set, the high absorption wavelength rejection filter 33 is set at the insertion position. Therefore, high absorption wavelength cut light Wcut obtained by cutting light in a wavelength band (refer to
As shown in
The reason why the light in the high absorption wavelength bands A1 and A2 is cut as described above is as follows. As shown in
As shown in
An actuator 48c to move the zoom lens 48a in the optical axis direction is attached to the zoom lens 48a. The driving of the actuator 48c is controlled by the magnification control unit 47 connected to the controller 59. The magnification control unit 47 controls the actuator 48c so that the zoom lens 48a moves to a position corresponding to the magnification set by a zoom operation unit 20. When it is necessary to observe the overall condition in the subject, for example, at the time of screening, the zoom lens 48a is set to a wide-angle position so that a non-enlarged image shown in
In the normal observation mode and the hypertrophy observation mode, the overall condition in the subject is observed in many cases. Therefore, the zoom lens 48a is set to the wide-angle position in many cases. On the other hand, in the microstructure observation mode, an object to be observed is enlarged and observed in many cases. Therefore, the zoom lens 48a is set to the telephoto position in many cases.
The CCD 44 has an imaging surface 44a to receive incident light, and performs photoelectric conversion on the imaging surface 44a and accumulates the signal charges. The accumulated signal charges are read as an imaging signal, and the imaging signal is transmitted to the AFE 45. The CCD 44 is a color CCD, and many pixels of three colors of a B pixel in which a B filter 44b of B color is provided, a G pixel in which a G filter 44g of G color is provided, and an R pixel in which an R filter 44r of R color is provided are arrayed on the imaging surface 44a, as shown in
Since the light received by the CCD 44 changes with a mode that is set, wavelength components received by the filters 44b, 44g, and 44r are also different. When the normal observation mode is set, the white light W is incident on the pixel of each color of the CCD 44. Accordingly, a wavelength component of the white light W included in the B transmission region 52 is incident on the B pixel, a wavelength component of the white light W included in the G transmission region 53 is incident on the G pixel, and a wavelength component of the white light W included in the R transmission region 54 is incident on the R pixel.
On the other hand, when the microstructure observation mode, the hypertrophy observation mode, and the microstructure and hypertrophy observation mode are set, the high absorption wavelength cut light Wcut is incident on the pixel of each color of the CCD 44. Accordingly, as shown in
As shown in
As shown in
The imaging control unit 46 is connected to the controller 59 in the processor device 12, and transmits a driving signal to the CCD 44 when there is an instruction from the controller 59. The CCD 44 outputs an imaging signal to the AFE 45 at a predetermined frame rate based on the driving signal from the imaging control unit 46.
When the normal observation mode is set, as shown in
On the other hand, when the microstructure observation mode, the hypertrophy observation mode, and the microstructure and hypertrophy observation mode are set, as shown in
As shown in
The special light image generation unit 57 includes a microstructure image generation section 61, a hypertrophy image generation section 62, and a microstructure and hypertrophy image generation section 63. The microstructure image generation section 61 generates a microstructure image, in which the visibility of a superficial microstructure, such as a pit pattern, is improved, based on the blue signal Bp obtained in the microstructure observation mode. The generated microstructure image 68 is displayed on the monitor 14 by the display control circuit 58, as shown in
The hypertrophy image generation section 62 generates a hypertrophy image with improved visibility of hypertrophy based on the green signal Gp and the red signal Rp obtained in the hypertrophy observation mode. The generated hypertrophy image 78 is displayed on the monitor 14 by the display control circuit 58, as shown in
The microstructure and hypertrophy image generation section 63 generates a microstructure and hypertrophy image with improved visibility of both a microstructure and hypertrophy based on the blue signal Bp, the green signal Gp, and the red signal Rp obtained in the microstructure and hypertrophy observation mode. The generated microstructure and hypertrophy image is displayed on the monitor 14 by the display control circuit 58.
Next, a sequential flow in the microstructure observation mode will be described with reference to the flowchart shown in
When switching to the microstructure observation mode is performed by a mode switch SW 15, the high absorption wavelength rejection filter 33 is inserted in the optical path Lw of the white light W. Therefore, the high absorption wavelength cut light Wcut obtained by removing the wavelength components of the high absorption wavelength bands A1 and A2 from the white light W is emitted from the high absorption wavelength rejection filter 33. The transmitted high absorption wavelength cut light Wcut is irradiated to the subject through the condensing lens 34, the light guide 43, and the like.
Image light of the return light from the subject is captured by the color CCD 44. In this case, the blue signal Bp, the green signal Gp, and the red signal Rp are output from the B, G, and R pixels of the CCD 44, respectively. Based on the blue signal Bp of these signals, a microstructure image with improved visibility of the superficial microstructure is generated. The generated microstructure image is displayed on the monitor 14 by the display control circuit 58.
In the first embodiment, the white light W is generated by irradiating the phosphor 31 with the excitation light EL to excite and emit the fluorescence FL. Instead of this, however, as shown in
As shown in
The light source device 113 includes an excitation light source 30, a phosphor 31, an RGB rotary filter 134, a filter insertion and removal unit 32, and a high absorption wavelength rejection filter 33. Also in the second embodiment, the white light W is generated by the excitation light source 30 and the phosphor 31. As shown in
As shown in
As in the first embodiment, when the normal observation mode is set, the filter insertion and removal unit 32 sets the high absorption wavelength rejection filter 33 at the retraction position. Since the high absorption wavelength rejection filter 33 is set at the retraction position, the white light W from the phosphor 31 is incident on the RGB rotary filter 134 that is rotating, without being incident through the high absorption wavelength rejection filter 33. B light in the blue band of the white light W is transmitted when the B filter portion 134b of the RGB rotary filter 134 is inserted in the optical path Lw, G light in the green band of the white light W is transmitted when the G filter portion 134g of the RGB rotary filter 134 is inserted in the optical path Lw, and R light in the red band of the white light W is transmitted when the R filter portion 134r of the RGB rotary filter 134 is inserted in the optical path Lw. As a result, B light, G light, and R light are sequentially emitted from the RGB rotary filter 134. The B light, the G light, and the R light that are sequentially emitted are incident on the light guide 43 through the condensing lens 34 to irradiate the subject.
On the other hand, when the microstructure observation mode, the hypertrophy observation mode, and the microstructure and hypertrophy observation mode are set, the high absorption wavelength rejection filter 33 is set at the insertion position, as in the first embodiment. Since the high absorption wavelength rejection filter 33 is set at the insertion position, the white light W from the phosphor 31 is incident on the high absorption wavelength rejection filter 33. The high absorption wavelength rejection filter 33 is the same as that in the first embodiment, and transmits the high absorption wavelength cut light Wcut obtained by removing the wavelength components of the high absorption wavelength bands A1 and A2 from the white light W. The transmitted high absorption wavelength cut light Wcut is incident on the RGB rotary filter 134 that is rotating.
When the B filter portion 134b of the RGB rotary filter 134 is inserted in the optical path Lw, the first transmitted light included in the B transmission region of the high absorption wavelength cut light Wcut is transmitted. When the G filter portion 134g is inserted in the optical path Lw, the second transmitted light included in the G transmission region of the high absorption wavelength cut light Wcut is transmitted. When the R filter portion 134r is inserted in the optical path Lw, the third transmitted light included in the R transmission region of the high absorption wavelength cut light Wcut is transmitted. As a result, the first transmitted light, the second transmitted light, and the third transmitted light are sequentially emitted from the RGB rotary filter 134. The first transmitted light, the second transmitted light, and the third transmitted light that are sequentially emitted are incident on the light guide 43 through the condensing lens 34.
The imaging control unit 46 of the second embodiment controls the imaging of the monochrome CCD 144 as follows. In the normal observation mode, as shown in
In the microstructure observation mode, the hypertrophy observation mode, and the microstructure and hypertrophy observation mode, as shown in
As shown in
As shown in
As shown in
The white light W is transmitted as it is when the opening 234a of the rotary filter for special observation 234 is inserted in the optical path Lw, the illumination light for a surface layer of the white light W is transmitted when the first BPF 234b is inserted in the optical path Lw, and the illumination light for a medium-deep layer of the white light W is transmitted when the second BPF 234c is inserted in the optical path Lw. Therefore, the white light W, the illumination light for a surface layer, and the illumination light for a medium-deep layer are sequentially emitted from the rotary filter for special observation 234. The white light W, the illumination light for a surface layer, and the illumination light for a medium-deep layer that are sequentially emitted are incident on the light guide 43 through the condensing lens 34.
The imaging control unit 46 of the third embodiment controls the imaging of the color CCD 44 as follows. In the normal observation mode, as shown in
In the microstructure observation mode, as shown in
In the hypertrophy observation mode, as shown in
In the microstructure and hypertrophy observation mode, as shown in
In the microstructure observation mode, the hypertrophy observation mode, and the microstructure and hypertrophy observation mode, the accumulation of electric charges and the output of imaging signals may also be performed when the white light W is irradiated, so that a normal light image based on the imaging signal obtained from the output is generated. By adding the pixel value of the imaging signal B2 to the normal light image, a brighter microstructure image can be generated. In addition, by adding the pixel values of the imaging signals G3 and R3 to the normal light image, a brighter hypertrophy image can be generated.
As shown in
In a light source device 313 of the fourth embodiment, unlike the first embodiment, the white light W having a wavelength band of 380 nm to 700 nm is generated by a xenon lamp 314. The xenon lamp 314 is always lit. Accordingly, the white light W emitted from the xenon lamp 314 is always irradiated to the subject through the condensing lens 34 and the light guide 43. Then, similarly to the first embodiment, image light of the white light from the subject is captured by the color CCD 44. By this imaging, the blue signal B is output from the B pixel of the CCD 44, the green signal G is output from the G pixel, and the red signal R is output from the R pixel.
A spectral estimation section 301 in the special light image generation unit 57 generates a spectral image within 380 nm to 700 nm based on the signals B, G, and R. Spectral images are generated at intervals of 5 nm as a 380-nm image, a 385-nm image, and the like. The spectral estimation section 301 performs spectral estimation according to the following [Expression 1] using estimation matrix data stored in an internal memory (not shown).
In [Expression 1], pixel values of the signals B, G and R are expressed as B, G, and R, respectively. In addition, the estimation matrix data is configured to include 65 sets of wavelength band parameters obtained by dividing the wavelength band of 380 nm to 700 nm at intervals of 5 nm, and the respective wavelength band parameters are formed by coefficients knr, kng, and knb (n=1 to 65). By multiplying these wavelength band parameters by the pixel values of the signals B, G and R, pixel values qn (n=1 to 65) of spectral images from 380 nm to 700 nm are obtained. In addition, the method of generating a spectral image is disclosed in detail in JP2003-93336A.
When the microstructure observation mode is set, the spectral estimation section 301 acquires a spectral image of 380 nm to 400 nm and a spectral image of 450 nm to 500 nm. In addition, when the hypertrophy observation mode is set, a spectral image of 500 nm to 520 nm and a spectral image of 580 nm to 700 nm are acquired. When the microstructure and hypertrophy observation mode is set, a spectral image of 380 nm to 400 nm, a spectral image of 450 nm to 500 nm, a spectral image of 500 nm to 520 nm, and a spectral image of 580 nm to 700 nm are acquired.
As shown in
As shown in
The microstructure and hypertrophy generation section 63 of the fourth embodiment generates a microstructure and hypertrophy image based on the spectral image of 380 nm to 400 nm, the spectral image of 450 nm to 500 nm, the spectral image of 500 nm to 520 nm, and the spectral image of 580 nm to 700 nm obtained by the spectral estimation section 301. This microstructure and hypertrophy image also has the same wavelength components as in the microstructure and hypertrophy image of the first embodiment. Therefore, as in the first embodiment, the visibility of both the microstructure and the hypertrophy is improved.
Number | Date | Country | Kind |
---|---|---|---|
2011-225143 | Oct 2011 | JP | national |
2012-193908 | Sep 2012 | JP | national |
This application is a Continuation of PCT International Application No. PCT/JP2012/076291 filed on Oct. 11, 2012, which claims priority under 35 U.S C §119(a) to Patent Application No. 2011-225143 filed in Japan on Oct. 12, 2011 and Patent Application No. 2012-193908 filed in Japan on Sep. 4, 2012, all of which are hereby expressly incorporated by reference into the present application.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2012/076291 | Oct 2012 | US |
Child | 14251043 | US |