1. Field of the Invention
The presently disclosed subject matter relates to an endoscope apparatus, and more particularly to an image processing technique and a screen display technique for use in an endoscope apparatus for medical treatment and other purposes.
2. Description of the Related Art
The endoscope apparatus for medical treatment and other purposes includes an insertion portion inserted into an interior of body. The end of the insertion portion includes an illumination window and an imaging apparatus. Under illumination light emitted through the illumination window, the interior of the body is imaged by the imaging apparatus. An imaging signal obtained by the imaging apparatus undergoes a predetermined image processing to be displayed on a monitor as an imaged image. Thus, an operator can observe the interior of the body by viewing the image displayed on the monitor.
The endoscope apparatus is used for observation of a wide variety of regions. For example, an upper endoscope is used for observation of plurality of regions such as a region from esophagus to stomach, a region from stomach to duodenum, a region from duodenum to stomach, and a region from stomach to esophagus. In addition, the upper endoscope is used for various observation purposes. For example, screening is performed to determine whether there is a problem region or not by a distant observation (a wide range of observation) or an entire observation. Then, the problem region is diagnosed by a near observation or a magnified observation.
Further, there has been proposed an apparatus which emits light of a specific frequency (wavelength) band to a region to be observed for imaging, generates a spectral image corresponding to the frequency band from an imaging signal, and displays the spectral image on a display apparatus. The observation using the spectral image enables observation of a blood vessel which cannot be observed by a normal image.
In addition, a freeze operation also enables observation of a still image by terminating a moving image of the region displayed on the monitor. This still image can be stored in a predetermined memory by operating a release switch and can be hard-copied using a printer as well.
Japanese Patent Application Laid-Open No. 2002-95635 discloses an endoscope apparatus configured to be able to separately observe a body cavity tissue at a layer level using filters with different spectral properties to emit narrow-band light with a limited pass band.
Japanese Patent Application Laid-Open No. 2003-93336 discloses an electronic endoscope apparatus configured to emit light (white light) from an illumination light source to the interior of a body to be observed, obtain a color image signal by a solid-state imaging device, generate a spectral image from the color image signal, and display by switching the normal image and the spectral image on a display monitor. The electronic endoscope apparatus disclosed in Japanese Patent Application Laid-Open No. 2003-93336 is configured to estimate a signal reflected from a living body by matrix processing when light having a narrow-band wavelength is emitted.
Japanese Patent Application Laid-Open No. 2006-239206 discloses an endoscope apparatus having a color space conversion processing circuit forming a spectral image from matrix coefficients corresponding to RGB signals and λ1, λ2, and λ3 signals in the selected three wavelength ranges. The endoscope apparatus disclosed in Japanese Patent Application Laid-Open No. 2006-239206 is configured such that when a spectral image is displayed on a display apparatus, a plurality of wavelength sets (λ1, λ2, and λ3) of spectral wavelengths allocated to (Rs, Gs, and Bs) of the display apparatus is provided in advance; a plurality of spectral images corresponding to the plurality of wavelength sets is generated; the wavelength sets can be switched when an operator operates a selection switch; and the spectral image corresponding to the selected wavelength set can be cyclically switched.
Japanese Patent Application Laid-Open No. 2008-229205 discloses an electronic endoscope apparatus configured such that when an image is electronically enlarged on a parent screen by a zooming operation, a non-enlarged image is displayed on a child screen so as to well observe the states of an object to be observed.
The aforementioned endoscope apparatuses having a display apparatus capable of displaying a large amount of information on one screen are required to satisfy the needs for the operator to perform a wide variety of observations to suit his or her desire or purpose without doing frequent switching operations or cumbersome operations.
Unfortunately, Japanese Patent Application Laid-Open No. 2002-95635, Japanese Patent Application Laid-Open No. 2003-93336, and Japanese Patent Application Laid-Open No. 2006-239206 do not disclose a freeze operation. Thus, from the endoscope apparatuses (electronic endoscope apparatuses) disclosed in Japanese Patent Application Laid-Open No. 2002-95635, Japanese Patent Application Laid-Open No. 2003-93336, and Japanese Patent Application Laid-Open No. 2006-239206, it cannot be understood how to switch the screen display during freeze operation. The endoscope apparatus disclosed in Japanese Patent Application Laid-Open No. 2008-229205 solves the problem of difficulty in understanding the state in a wide range of the object to be observed during enlarged observation, but it is difficult to apply the endoscope apparatus to a wide variety of observations.
In view of such circumstances, it is an object of the presently disclosed subject matter to provide an endoscope apparatus satisfying the needs for a wide variety of observations while securing safety when a still image is displayed and when the still image is stored.
In order to achieve the above object, an endoscope apparatus according to the presently disclosed subject matter includes: an illumination device emitting light to an object; an imaging device generating a color imaging signal by imaging the light reflected from the object irradiated by light emitted from the illumination device; a normal image generation device generating a normal image by performing normal image processing on the imaging signal obtained by the imaging device; a spectral image generation device generating a spectral image corresponding to a preset optical narrow band by subjecting the imaging signal obtained by the imaging device to matrix processing using matrix data of the optical narrow band; a display device displaying a main screen region and a sub-screen region having a size less than the size of the main screen region; a display switching signal generation device generating a display switching signal for switching a display content of the main screen region and the sub-screen region; a still picture display switching signal generation device generating a still picture display switching signal for displaying a still image at a predetermined timing of a moving image instead of the moving image displayed in the main screen region in a state in which the moving image is displayed in the main screen region and the sub-screen region of the display device; and a display control device controlling a screen display of the display device such that the normal image is displayed in any one of the main screen region and the sub-screen region, while the spectral image is displayed in the other region; and based on the display switching signal generated by the display switching signal generation device, control is performed so as to selectively switch between a region for displaying the normal image and a region for displaying the spectral image, wherein when the moving image of the normal image is displayed in the main screen region and the moving image of the spectral image is displayed in the sub-screen region, based on the still picture display switching signal generated by the still picture display switching signal generation device, the display control device controls a screen display of the display device so as to switch the display of the main screen region from the moving image of the normal image to the still image of the normal image and at the same time to switch the display of the sub-screen region from the moving image of the spectral image to the moving image of the normal image.
According to the presently disclosed subject matter, when the moving image of the normal image is displayed in the main screen region and the moving image of the spectral image is displayed in the sub-screen region, based on the still picture display switching signal, the display of the main screen region is switched from the moving image of the normal image to the still image of the normal image and at the same time the display of the sub-screen region is switched from the moving image of the spectral image to the moving image of the normal image. Thus, the moving image of the normal image can be observed while the still image of the spectral image is observed, thereby securing safety during still image observation.
Now, preferred embodiments of the presently disclosed subject matter will be described in detail referring to the accompanying drawings.
The operation portion 10 of the electronic endoscope includes: a forceps inlet 12 for inserting a treatment instrument; an angle knob 14 operated to bend a distal end of the insertion portion 20 upward, downward, left, and right; an air/liquid feed button 16 operated to spray water or air from a nozzle (not illustrated in
The insertion portion 20 of the electronic endoscope has a predetermined diameter, has a substantially circular tube-like cross-section, and is integrally connected to a distal end of the operation portion 10. The insertion portion 20 includes: a flexible portion 22 having flexibility; a curvable curved portion 24 disposed at a distal end of the flexible portion 22; and a distal end hard portion 26 disposed at a distal end of the curved portion 24.
The flexible portion 22 of the electronic endoscope is made of a flexible tube and is integrally connected to the distal end of the operation portion 10. The flexible portion 22 occupies most of the insertion portion 20. The curved portion 24 is curvably configured and is integrally connected to the distal end of the flexible portion 22. The curved portion 24 is curved upward, downward, left, and right in conjunction with the operation of the angle knob 14 disposed in the operation portion 10. Thus, the distal end hard portion 26 can be oriented in a desired direction inside the body cavity by curving the curved portion 24 in a desired direction. The distal end hard portion 26 is made of a hard material such as a metal (e.g., stainless steel) into a cylindrical shape, and is integrally connected to the distal end of the curved portion 24.
The connection portion 30 of the electronic endoscope includes: a universal cord 32 continuously connected to the operation portion 10; and a plurality of connectors disposed in a distal end of the universal cord 32. The connector includes: a processor connector 34a for connecting to the processor apparatus 36; a light source connector 34b for connecting to the light source apparatus 38; and an air/liquid feed connector 34c for connecting to the air/liquid feed unit 40 disposed in a casing housing the processor apparatus 36 therein.
The observation monitor (display apparatus) 42 is a display device for displaying an object image of the interior of the body cavity. The operator performs screening while observing the image displayed on the observation monitor 42.
The nozzle 58 is arranged such that a spout (unillustrated) thereof is oriented toward the observation window 50. The forceps outlet 56 is arranged adjacent to the nozzle 58. An edge portion 26b in the outer periphery of the distal end face 26a is subjected to R-chamfering with a predetermined diameter.
The illumination optical system is arranged on a rear side of (inside) each of the pair of the illumination windows 52 and 54 illustrated in
The forceps outlet 56 illustrated in
The nozzle 58 is arranged so as to protrude from the distal end face 26a of the distal end hard portion 26 and has a spout (unillustrated) oriented toward the observation window 50. The spout is connected to the air/liquid feed unit 40 (see
A solid-state imaging device (CCD (charge-coupled device)) 66 having an RGB (primary color type; red, green and blue) or CMY (complementary color type; cyan, magenta and yellow) color filter on an imaging surface thereof is disposed at a focusing position of the object optical system 64. Light incident on the object optical system 64 passes through the illumination windows 52 and 54 (see
A joining tube 74 communicatively connected to the spout of the nozzle 58 (see
Now, an imaging unit and an image processing unit of the endoscope apparatus according to the present embodiment will be described in detail.
As illustrated in
The illumination optical system 103 is connected to a light source in the light source apparatus 38 through the light guide 112. The solid-state imaging device 66 is driven by the CCD drive unit 104 in response to a drive pulse generated based on a predetermined synchronization signal (clock) to output an imaging signal by converting the optical image of the observed region to an electrical signal.
The imaging signal obtained by the solid-state imaging device 66 is sampled at a predetermined sampling period by a correlated double sampling processing unit of the CDS/AGC unit 106 and is subjected to amplification processing by an automatic gain control processing unit thereof. Further, an analog imaging signal is converted to a digital imaging signal by an A/D conversion unit 108. Thus configured imaging unit 100 is integratedly controlled by a microcomputer 110. The microcomputer 110 disposed in the imaging unit 100 as well as the image processing unit 102 is integratedly controlled by a microcomputer 128 integratedly controlling the image processing unit 102.
The image processing unit 102 is a signal processing unit performing a predetermined image processing on an imaging signal received from the imaging unit 100 through a signal line 70. As illustrated in
The image processing unit 102 according to the present embodiment includes a normal image generation unit 102B generating a normal image (moving picture) and a spectral image generation unit 102A generating a spectral image (spectral moving picture). The image processing unit 102 is configured so as to simultaneously display the normal image and the spectral image on the observation monitor 42. The following description will focus on an embodiment of generating and displaying a normal image (normal moving picture) and a spectral moving picture, but apparently a normal still image (normal still picture) may be generated and displayed instead of the normal moving picture, and a spectral still picture may be generated and displayed instead. Note that the term “normal image” in the present description is a concept including a normal moving picture and a normal still picture, and the term “spectral image” is a concept including a spectral moving picture and a spectral still picture.
The Y signal, Cr signal, and Cb signal output from the DSP 120 are converted to RGB (or CMYK) signals by a first color conversion unit 122. Note that the DSP 120 is disposed in the image processing unit 102, but may be disposed in the imaging unit 100.
As illustrated in
A mode selector 126 disposed at a later stage of the spectral estimation matrix processing unit 124 selects either one of a spectral image (monochrome mode) of a certain wavelength range (narrow band) and a spectral image (three-color mode) including three wavelength ranges based on a control signal received from the microcomputer 128. More specifically, when an operator selects the monochrome mode using the operation portion 130, the selection information is sent to the mode selector 126 through the microcomputer 128. Then, the spectral estimation matrix processing unit 124 generates the spectral image signal (any one of λ1, λ2, and λ3) of the monochrome mode. When the operator selects the three-color mode using the operation portion 130, the selection information is sent to the mode selector 126 through the microcomputer 128. Then, the spectral estimation matrix processing unit 124 generates the spectral image signal λ1, λ2, and λ3) of the three-color mode.
The spectral image signal output from the spectral estimation matrix processing unit 124 enters a second color conversion circuit 132, in which the image signal (λ1, λ2, and λ3) of one wavelength range or three wavelength ranges is converted to a signal of Rs(=λ1), Gs(=λ2), and Bs(=λ3) for processing corresponding to a conventional ROB signal. Further, a signal processing unit 134 converts the Rs, Gs, Bs signal to a Y/C signal and performs other various signal processing (mirror image processing, mask generation, character generation, and the like). The spectral image signal output from the signal processing unit 134 enters a D/A conversion unit 136, in which the image signal is converted to an analog signal and sent to a screen display control unit 138. The first color conversion unit 122, the spectral estimation matrix processing unit 124, the mode selector 126, the second color conversion circuit 132, the signal processing unit 134, and the D/A conversion unit 136 function as the spectral image generation unit 102A.
Meanwhile, the Y signal, Cr signal, and Cb signal output from the DSP 120 is sent to a color signal processing unit 140. The color signal processing unit 140 generates a normal color moving picture (normal moving picture) signal based on the Y signal, Cr signal, and Cb signal output from the DSP 120. Then, the D/A conversion unit 142 converts the normal moving picture signal from digital to analog. Note that in an embodiment having a digital observation monitor 42, the D/A conversion units 136 and 142 are omitted. The color signal processing unit 140 and the D/A conversion unit 142 function as the normal image generation unit 102B.
The screen display control unit 138 controls the display format of the normal moving picture and the spectral moving picture based on a control signal received from the microcomputer 128. More specifically, when the operator operates the operation portion 130 for switching operation of the screen display format of the observation monitor 42, a control signal corresponding to the switching operation is sent from the microcomputer 128 to the screen display control unit 138. In response to the control signal, the screen display control unit 138 switches the screen display format of the observation monitor 42. Note that the detail about the switching control of the screen display format of the observation monitor 42 will be described later.
The operation portion 130 is used for switching the aforementioned spectral image, switching between a split screen display and a batch screen display described later, and selection of screen. The operation portion 130 may include at least one of a scope switch such as a button switch and a toggle switch, a pointing device such as a joystick and a mouse, and a touch panel. When the operation portion 130 is operated, an operation signal is sent to the microcomputer 128. In response to the operation signal, the microcomputer 128 sends a command signal to each unit corresponding to the operation signal.
Further, the operation portion 130 includes a freeze operation button for use in freeze operation described later. When the freeze operation button is operated, a normal still image (normal still picture) and a still image of the spectral image (spectral still picture) are stored in a predetermined memory at a timing when the freeze operation is effective. Either one of the normal still picture and the spectral still picture is displayed on the observation monitor 42 according to the screen display control during freeze operation.
The memory 143 includes a temporary storage memory as a work region for signal processing (image processing), a memory for storing various control parameters, and other memories. Writing to the memory 143 and reading from the memory 143 are controlled by the microcomputer 128. The memory 143 may be a semiconductor memory device such as a ROM (read-only memory) and a RAM (random access memory), or a magnetic memory device such as a hard disk drive.
Now, the matrix processing (spectral estimation matrix processing, hereinafter may be referred to as simply “matrix processing”) according to the present embodiment will be described. The following description will focus on generation of a spectral image in a three-color mode. As illustrated in
The matrix coefficient data illustrated in Table 1 includes 61 wavelength range parameters p1 to p61 obtained by dividing the wavelength range from 400 nm to 700 nm at an interval of 5 nm. The parameters p1 to p61 include coefficients kpr, kpg, and kpb (p corresponds to p1 to p61 in Table 1) for matrix processing. The spectral estimation matrix processing unit 124 illustrated in
For example, when parameters p21 (central wavelength of 500 nm), p45 (central wavelength of 620 nm), and p51 (central wavelength of 650 nm) is selected in Table 1, Expression 1 may be such that (−0.00119, 0.002346, 0.0016) of p21 is assigned to the coefficient (k1r, k1g, and k1b), (0.004022, 0.000068, −0.00097) of p45 is assigned to the coefficient (k2r, k2g, and k2b), and (0.005152, −0.00192, 0.000088) of p51 is assigned to the coefficient (k3r, k3g, and k3b).
Note that when the spectral image signal of the monochrome mode is generated, the spectral image signal is set to any one of the λ1, λ2, and λ3 in the Expression 1. The value may be a central wavelength or a maximum wavelength or a minimum wavelength. The image processing unit 102 according to the present embodiment is configured to be switchable between the monochrome mode and the three-color mode. Apparently, the image processing unit 102 may be fixed to either one of the monochrome mode and the three-color mode. The following description of the screen display switching will focus on an embodiment of generating a spectral moving picture in the three-color mode.
Now, the screen display control of the observation monitor 42 according to a first embodiment will be described in detail.
The sub-screen region 164 is a region for displaying an image of the normal moving picture or the spectral moving picture, whichever is not displayed on the main screen region 162, is arranged in any one of the four corners of the screen 160, has about one-eighth of the area of the main screen region 162, and has the same angle of view (field of view) as that of the main screen region 162. The sub-screen region 164 may be configured such that the size and the position thereof are variable. For example, the sub-screen region 164 may be arranged in a central portion of the screen 160 in up and down directions of the figure. Further, the sub-screen region 164 may be configured to be moved in up and down directions of the screen 160 in the figure by operating an operation member such as a joystick. Furthermore, the sub-screen region 164 may have a lower resolution than that of the main screen region 162. Still further, the size ratio between the sub-screen region 164 and the main screen region 162 may be increased to a degree to allow the operator to recognize. When the size ratio between the sub-screen region 164 and the main screen region 162 is increased, the resolution of the sub-screen region 164 may be lowered than that of the main screen region 162.
An about 20-inch liquid crystal display (screen size example: 408 mm×306 mm) may be applied to the observation monitor 42.
The screen display format in the initial state of the observation monitor 42 according to the present embodiment is such that a normal moving picture is displayed on the main screen region 162 and a spectral moving picture is displayed on the sub-screen region 164. The information region 166 displays the wavelength information, the scope name, the imaging condition, the date, and other related information. Note that the format of the information region 166 appropriately changes according to the position and the size of the sub-screen region 164. For example, when the position of the sub-screen region 164 is changed, the information region 166 may be moved to a position not overlapped with the sub-screen region 164 or may be displayed to be overlaid on the main screen region 162 or the sub-screen region 164. Further, the information region 166 may be hidden.
The screen display control of the observation monitor 42 according to the present embodiment allows the operator to selectively switch between an image displayed on the main screen region 162 and an image displayed on the sub-screen region 164. For example, when the screen display is switched using the operation portion 130 illustrated in
When the screen display is switched again, the image displayed on the main screen region 162 is switched to the image displayed on the sub-screen region 164. Note that when the screen display is switched, the resolution of the image displayed on the main screen region 162 is changed to a maximum resolution. Note also that the resolution of the image changed from the main screen region 162 to the sub-screen region 164 may be lowered.
If the screen display is switched in steps S18 and S20, and then, the screen display is switched again (Yes in step S26), the main screen region 162 is switched from the spectral moving picture to the normal moving picture (step S28), and the sub-screen region 164 is switched from the normal moving picture to the spectral moving picture (step S30). Then, the process returns to step S16. If a determination is made in step S26 that the screen display is not switched (No in step S26), the process moves to step S32, in which a determination is made as to whether the screen display control ends or not. If a determination is made in step S32 that the screen display control ends (Yes in step S32), the screen display control ends (step S24). If a determination is made in step S32 that the screen display control does not end (No in step S32), the process returns to step S26.
Thus, the main screen region 162 and the sub-screen region 164 are configured to be visually different in size, allowing the operator to clearly differentiate the main screen region 162 from the sub-screen region 164 and thereby exerting an effect of concentrating the operator's attention on one screen. Thus, this configuration can satisfy the operator's request to focus on one screen during scope operation or screening observation.
In a case in which the normal moving picture is displayed on the main screen region 162 and the spectral moving picture is displayed on the sub-screen region 164, the operator can use the normal moving picture to perform screening by observing the normal moving picture. If a close investigation using the spectral moving picture is required, the operator can perform switching operation to display the spectral moving picture on the main screen region 162 to observe the spectral moving picture. On doing such a switching operation, the operator can quickly look at the spectral moving picture displayed on the sub-screen region 164 to determine whether the close investigation is required or not. Thus, this configuration can satisfy the operator's request to minimize the number of switching operations.
In a case in which the spectral moving picture is displayed on the main screen region 162 and the normal moving picture is displayed on the sub-screen region 164, the operator can perform screening by observing the spectral moving picture. Since the normal moving picture is displayed on the sub-screen region 164, safety can be secured. Specifically, the spectral moving picture has missing information, but simultaneously displaying the normal moving picture on the sub-screen region 164 can exert an effect of improving safety.
Now, the screen display control of the observation monitor 42 according to a second embodiment will be described.
The screen 160 illustrated in the
In a case in which a spectral moving picture is displayed in the main screen region 162, when the display mode is switched to a divided display mode, four kinds of spectral moving pictures corresponding to a plurality of preset wavelength sets (a, b, c, and d) are displayed in the respective divided regions 162A, 162B, 162C, and 162D. The spectral moving picture displayed in a first main screen region 162A corresponds to a wavelength λ1a, λ2a, and λ3a). The spectral moving picture displayed in a second main screen region 162B corresponds to a wavelength (λ1b, λ2b, λ3b). The spectral moving picture displayed in a third main screen region 162C corresponds to a wavelength (λ1c, λ2c, and λ3c). The spectral moving picture displayed in a fourth main screen region 162D corresponds to a wavelength (λ1d, λ2d, and λ3d).
Specifically, four kinds of spectral images are generated according to the wavelength sets (a, b, c, and d) corresponding to the preset four wavelengths: a, b, c, and d. The matrix coefficient storage unit 144 illustrated in
For example, it is preferable that in a case in which the main screen region 162 is displayed as a single screen as illustrated in
Note that the main screen region 162 may be divided into more number of regions to be associated with more number of wavelength sets including more number of wavelengths. The number of divisions of the main screen region 162 is preferably 4, 9, and 16 so as to maintain the aspect ratio (size ratio in vertical and horizontal directions) of each region. Note also that each divided region of the main screen region 162 is preferably larger in size than the sub-screen region 164. Thus, from the point of view of this, the number of divisions of the main screen region 162 is more preferably 4.
If a determination is made in step S44 that the screen display mode is switched (Yes in step S44), the main screen region 162 is switched to a single screen display (step S46). Then, the process moves to step S22. Note that when the main screen region 162 is switched from the divided display to the single screen display, the spectral moving picture corresponding to the wavelength before being switched to the divided display is displayed. Apparently, after the main screen region 162 is switched from the divided display to the single screen display, the spectral images corresponding to the wavelength sets (a, b, c, and d) may be sequentially switched and displayed.
In step S22, a determination is made as to whether the screen display control ends or not. If a determination is made in step S22 that the screen display control ends (Yes in step S22), the screen display control ends (step S24). If a determination is made in step S22 that the screen display control does not end (No in step S22), the process returns to step S40, in which the processes in steps S40 to S46 and S22 are repeated.
The screen display switching according to the second embodiment enables a simultaneous and parallel display of a plurality of spectral images (special images) to minimize a risk of missing observation of the operator and enables a simultaneous application of a plurality of diagnostic methods during screening.
Now, the screen display control of the observation monitor 42 according to a third embodiment will be described.
A touch panel display apparatus may be applied to the observation monitor 42 as a device for selecting one of the first to fourth sub-screen regions 164A to 164D. Specifically, when an operator touches a desired image in the first to fourth sub-screen regions 164A to 164D (selection screen), the touched image is displayed in the main screen region 162. Note that the image displayed in the main screen region 162 may be displayed in the sub-screen region 164 as is, or the image displayed in the main screen region 162 may be deleted from the sub-screen region 164.
Then, the process moves to step S106. If the normal moving picture is selected (Yes in step S106), the normal moving picture is displayed in the main screen region 162 (step S108), but the display in the first to fourth sub-screen regions 164A to 164D remains unchanged. If the normal moving picture is not selected (No in step S106), the process moves to step S110. If a spectral moving picture corresponding to wavelength a is selected (Yes in step S110), the spectral moving picture corresponding to wavelength a is displayed in the main screen region 162 (step S112). If a spectral moving picture corresponding to wavelength a is not selected (No in step S110), the process moves to step S114.
If a spectral moving picture corresponding to wavelength b is selected (Yes in step S114), the spectral moving picture corresponding to wavelength b is displayed in the main screen region 162 (step S116). If a spectral moving picture corresponding to wavelength b is not selected (No in step S114), the process moves to step S118. If a spectral moving picture corresponding to wavelength c is selected (Yes in step S118), the spectral moving picture corresponding to wavelength c is displayed in the main screen region 162 (step S120). If a spectral moving picture corresponding to wavelength c is not selected (No in step S118), the process returns to step S106.
In step S122, a determination is made as to whether the screen display control ends or not. If a determination is made that the screen display control ends (Yes in step S122), the screen display control ends (step S124). If a determination is made that the screen display control does not end (No in step S122), the process returns to step S106, in which the processes in steps S106 to S122 are repeated. Thus, one image is selected from the images displayed in the sub-screen regions 164A to 164D (selection screens), and the selected image is displayed in the main screen region 162.
Even if a certain image is displayed in the main screen region 162, the image can be switched to another image selected in the selection screen. Thus, the image displayed in the main screen region 162 is switched for each selection. Note that preferably the thickness and the color of the outer frame of the selected image are changed, and a character display is used to emphasize the selected image.
According to the screen display switching according to the third embodiment, candidate images to be displayed in the main screen can be displayed in selection screens, thus allowing the operator to instinctively select a desired image. Note that the screen display switching according to the third embodiment may be applied only for displaying the spectral image in the main screen region 162. In such an embodiment, for example, any one of the four spectral images corresponding to the respective wavelength sets (a, b, c, and d) is displayed in the main screen region 162, and the other three spectral images are displayed in the respective sub-screen regions 164B to 164D. When any one of the spectral images displayed in the sub-screen regions 164B to 164D is selected, the display screen is switched from the spectral image displayed in the main screen region 162 to the selected spectral image.
Now, the screen display control during freeze operation will be described. The endoscope apparatus 1 according to the present embodiment is configured to display a still picture in the main screen region 162 when the freeze operation is performed to switch the screen display of the observation monitor 42 from moving picture display to still picture display.
For example, in a state in which a spectral moving picture is displayed in the main screen region 162 and a normal moving picture is displayed in the sub-screen region 164, when the freeze operation is performed on the screen 160 illustrated in
As illustrated in
If the freeze operation is not performed (No in step S200), the process returns to step S200, in which monitoring continues until the freeze operation is performed. If the freeze operation is released (Yes in step S206), the main screen region 162 is switched from the normal still picture to the normal moving picture (step S208), and the sub-screen region 164 is switched from the normal moving picture to the original spectral moving picture (step S210). Then, the process moves to step S22.
If the freeze operation is not released (No in step S206), the process returns to step S206, in which monitoring continues until the freeze operation is released. If a determination is made in step S22 that the screen display control ends (Yes in step S22), the screen display control ends (step S24). If a determination is made in step S22 that the screen display control does not end (No in step S22), the process returns to step S200, in which the processes in steps S200 to S210 and S22 are repeated.
As illustrated in
If the freeze operation is released (Yes in step S224), the main screen region 162 is switched to the spectral moving picture (step S226), and the sub-screen region 164 continues to display the normal moving picture. Then, the process moves to step S22. If the freeze operation is not released (No in step S224), the process returns to step S224, in which monitoring continues until the freeze operation is released. If a determination is made in step S22 that the screen display control ends (Yes in step S22), the screen display control ends (step S24). If a determination is made in step S22 that the screen display control does not end (No in step S22), the process returns to step S220, in which monitoring continues until the freeze operation is performed.
Thus, when the freeze operation is performed, the display of the main screen region 162 is switched from the normal moving picture to the normal still picture, and the spectral moving picture is switched to the spectral still picture, but the normal moving picture is always displayed in the sub-screen region 164, thereby securing the safety during freeze operation.
Further, the still picture observation and the moving picture observation can be easily alternately switched. Thus, the observation format can be appropriately changed according to the desire of the operator. Furthermore, the observation format can be changed by a button operation, and thus the observation format can be changed without cumbersome operations.
In the embodiment having a plurality of sub-screen regions 164A to 164D illustrated in
Alternatively, in a state in which a normal moving picture is displayed in the main screen region 162 and the normal moving picture is not displayed in the sub-screen region 164 (sub-screen region 164 is turned off), when the freeze operation is performed, the display of the main screen region 162 is switched from the normal moving picture to the normal still picture and the normal image is displayed in the sub-screen region 164A. Note that in response to the freeze operation, the display of the sub-screen regions 164B to 164D may be turned off and when the freeze operation is released, the display may return to the original screen display.
Specifically, a field mask having a round shape may be placed in the main screen region 162′ or the sub-screen region 164′ may be displayed as a PiP (picture in picture) image (display). Further, the above display format and a parallel display format of the main screen region 162′ and the sub-screen region 164′ may be configured to be selectively switchable.
The endoscope apparatus 1 according to the present embodiment is configured to be switchable between an isotropic mask display having a constant field of view and having the same vertical and horizontal sizes and an anisotropic mask display having the same field of view as that of the isotropic mask and having different vertical and horizontal sizes.
The description of the above embodiments has focused mainly on a medical endoscope, but the presently disclosed subject matter can be applied to a borehole observation apparatus for industrial purposes.
Hereinbefore, the endoscope apparatus according to the presently disclosed subject matter have been described in detail, but the presently disclosed subject matter is not limited to the above embodiments. It is apparent that various improvements and modifications may be made to the presently disclosed subject matter without departing from the spirit and scope of the presently disclosed subject matter.
As has become evident from the above detailed description of the embodiments of the presently disclosed subject matter, the present description includes disclosure of various technical ideas including at least the invention as follows.
(First Aspect):
An endoscope apparatus including: an illumination device emitting light to an object; an imaging device generating a color imaging signal by imaging the light reflected from the object irradiated by light emitted from the illumination device; a normal image generation device generating a normal image by performing normal image processing on the imaging signal obtained by the imaging device; a spectral image generation device generating a spectral image corresponding to a preset optical narrow band by subjecting the imaging signal obtained by the imaging device to matrix processing using matrix data of the optical narrow band; a display device displaying a main screen region and a sub-screen region having a size less than the size of the main screen region; a display switching signal generation device generating a display switching signal for switching a display content of the main screen region and the sub-screen region; a still picture display switching signal generation device generating a still picture display switching signal for displaying a still image at a predetermined timing of a moving image instead of the moving image displayed in the main screen region in a state in which the moving image is displayed in the main screen region and the sub-screen region of the display device; and a display control device controlling a screen display of the display device such that the normal image is displayed in any one of the main screen region and the sub-screen region, while the spectral image is displayed in the other region, and based on the display switching signal generated by the display switching signal generation device, control is performed so as to selectively switch between a region for displaying the normal image and a region for displaying the spectral image, wherein when the moving image of the normal image is displayed in the main screen region and the moving image of the spectral image is displayed in the sub-screen region, based on the still picture display switching signal generated by the still picture display switching signal generation device, the display control device controls a screen display of the display device so as to switch the display of the main screen region from the moving image of the normal image to the still image of the normal image and at the same time to switch the display of the sub-screen region from the moving image of the spectral image to the moving image of the normal image.
According to the presently disclosed subject matter, a moving image of the normal image is displayed in the main screen region and a moving image of the spectral image is displayed in the sub-screen region. In this state, based on a still picture display switching signal, the display of the main screen region can be switched from the normal moving picture display to the still picture display and at the same time the display of the sub-screen region can be switched from the moving image of the spectral image to the moving image of the normal image. Thus, the moving image of the normal image can be observed during observation of the still image of the spectral image, thereby securing the safety during the still image observation.
(Second Aspect):
The endoscope apparatus according to the first aspect, wherein the display control device controls the screen display of the display device such that when the moving image of the spectral image is displayed in the main screen region and the moving image of the normal image is displayed in the sub-screen region, based on a still picture display switching signal generated by the still picture display switching signal generation device, the display of the main screen region is switched from the moving image of the spectral image to the still image of the spectral image and the sub-screen region continues to display the moving image of the normal image.
According to the above aspect, even if the display of the main screen region is switched from the moving image of the spectral image to the still image of the spectral image, the sub-screen region continues to display the moving image of the normal image, thereby securing the safety during observation of the still image of the spectral image.
(Third Aspect):
The endoscope apparatus according to any one of the first and second aspects, further including a still picture display switching operation device operated when the display of the main screen region is switched from the moving image to the still image, wherein when the still picture display switching operation device is operated, the still picture display switching signal generation device generates the still picture display switching signal.
According to the above aspect, the main screen can be switched from the moving image display to the still image display by operating the still picture display switching operation device, thereby reducing cumbersome operations of an operator and assisting the operator in easy diagnosis.
Examples of the still picture display switching operation device according to the above aspect include a push-button switch (operation button).
(Fourth Aspect):
The endoscope apparatus according to any one of the first to third aspects, further including a still picture display release signal generation device generating a still picture display release signal for releasing the main screen region from the still image display and returning to the moving image display, wherein based on the still picture display release signal, the display control device controls the screen display of the display device so as to switch the display of the main screen region from the still image display to the moving image display.
According to the above aspect, the display of the main screen region can be returned from the still image display to the moving image display, and thus various observation needs can be satisfied.
(Fifth Aspect):
The endoscope apparatus according to the fourth aspect, wherein in a state in which a still image of the normal image is displayed in the main screen region and a moving image of the normal image is displayed in the sub-screen region, based on the still picture display release signal, the display control device controls the screen display of the display device so as to switch the screen display of the sub-screen region from the moving image of the normal image to the moving image of the spectral image.
According to the above aspect, based on the still picture display release signal, the display of the sub-screen region can be returned to the original display and thus the observation format can be appropriately changed by changing the display format.
(Sixth Aspect):
The endoscope apparatus according to one of the fourth and fifth aspects, further including a still picture display release operation device operated when the still image display of the main screen region is released and returned to the moving image display, wherein when the still picture display release operation device is operated, the still picture display release signal generation device generates the still picture display release signal.
According to the above aspect, based on the operation of the still picture display release operation device, the still image display of the main screen region is released and returned to the moving image display, thereby reducing cumbersome operations for the operator to switch the screen display.
(Seventh Aspect):
The endoscope apparatus according to any one of the first to sixth aspects, further including a still image storage device storing the still image displayed in the main screen region.
According to the above aspect, the safety when the still image displayed in the main screen region is stored is secured.
(Eighth Aspect):
The endoscope apparatus according to the seventh aspect, wherein when the still picture display switching operation device is operated, the still image storage device stores the still image displayed in the main screen region.
According to the above aspect, the still image is stored according to the operation when the display of the main screen region is switched to the still image, thereby reducing cumbersome operations of the operator when the still image is stored.
(Ninth Aspect):
The endoscope apparatus according to any one of the first to eighth aspects, wherein based on a spectral reflectance of the object, spectral properties of the illumination device, and spectral properties of the color filter of the imaging device, the spectral image generation device performs processing for estimating a reflected signal corresponding to an optical narrow band from the imaging signal corresponding to an optical wide band.
Number | Date | Country | Kind |
---|---|---|---|
2010-230068 | Oct 2010 | JP | national |