1. Field of the Invention
The present invention relates to an endoscope apparatus that generates an endoscope image by a signal processing using application software that runs on an operating system.
2. Description of the Related Art
In medical fields, observation has been widely performed using image pickup apparatuses such as an X-ray diagnostic apparatus, a CT, an MRI, an ultrasound observation apparatus, and an endoscope apparatus.
As an endoscope apparatus among the image pickup apparatuses, an electronic endoscope system is disclosed in, for example, Japanese Patent Application Laid-Open Publication No. 2001-218735.
The electronic endoscope system includes an insertion portion that can be inserted into a body cavity, and picks up an image of a target in the body cavity formed by an objective optical system placed in a distal end portion of the insertion portion, with an image pickup portion such as a solid-state image pickup device, and outputs the image as an image pickup signal.
The electronic endoscope system has a configuration and an operation for displaying an image of the target in the body cavity on a display portion such as a monitor on the basis of the image pickup signal. A user such as an operator observes, for example, an organ in the body cavity on the basis of the picked-up image of the inside of the body cavity displayed on the display portion such as the monitor.
As disclosed in the electronic endoscope system in the publication, the image pickup signal from the image pickup portion of the endoscope is subjected to a signal processing by a video processor, and then displayed on the monitor as an endoscope image.
Now, a conventional electronic endoscope system will be described with reference to
As shown in
The electronic endoscope 102 includes an image sensor (CCD, C-MOS sensor, or the like) 102a as an image pickup portion inside a distal end of an insertion portion that can be inserted into a lumen.
An image pickup signal from the image sensor 102a is inputted to a video signal pre-processing circuit 105 in the video processor 104. In the video signal pre-processing circuit 105, a signal processing portion 108 performs sampling, noise removal, white balance, and A/D conversion processings of the image pickup signal from the image sensor 102a.
The video signal pre-processing circuit 105 transmits the video signal processed by the signal processing portion 108 to a system and digital signal processing portion 106 in a post-stage while being electrically insulated by an insulating portion 109 constituted by, for example, a photocoupler.
The system and digital signal processing portion 106 is constituted by a general personal computer (PC) board, performs various digital processings such as color tone, enhancing, color conversion, or character superimposing processings of the digital video signal processed by the signal processing portion 108, and performs an image output processing for outputting a desired image to the monitor 103.
Software of the system and digital signal processing portion 106 has a hierarchical structure including a BIOS (Basic Input Output System) layer 106a, an OS (Operating System) layer 106b, an Application layer 106c and the like, as shown in
The Application layer 106c includes various application software portions 110 that perform various digital processings such as color tone, enhancing, color conversion, or character superimposing processings, and an image output portion 111 that performs the image output processing for outputting a desired image to the monitor 103.
However, in the video processor 104 in the conventional electronic endoscope system 101 in
Further, the image is outputted to the monitor 103 by the image output processing by the image output portion 111, and thus a predetermined sequence including the starts of the BIOS, OS and application needs to be passed to start display on the monitor 103.
The present invention is achieved in view of the above described circumstances, and has an object to provide an endoscope apparatus that can output an endoscope image based on an image pickup signal of an endoscope to a display device even if software is not started when a video signal is generated using the software.
An endoscope apparatus according to the present invention includes: a first video signal generating portion that generates a first video signal displayed on a display device as an endoscope image from an image pickup signal picked up by an image pickup device of an endoscope; a second video signal generating portion that performs a signal processing of the first video signal using application software that runs on an operating system and generates a second video signal;
a video signal selecting portion that selects one of the first video signal and the second video signal and outputs the video signal to the display device; and
a control portion that determines or estimates whether the second signal generating portion can output the second video signal, and applies a control signal so that the video signal selecting portion outputs the first video signal when determining or estimating that the second video signal generating portion cannot output the second video signal.
Now, embodiments of the present invention will be described with reference to the drawings.
As shown in
The electronic endoscope 2 includes an elongated insertion portion 2b that can be inserted into a body cavity of a patient, and an image sensor (CCD, C-MOS sensor, or the like) 2a as the image pickup device is provided in a distal end portion of the insertion portion 2b.
An image pickup signal picked up by the image sensor 2a is inputted to a video signal pre-processing circuit 5 as a first video signal generating portion in the video processor 4 that performs a signal processing for the image sensor 2a.
The video signal pre-processing circuit 5 includes a signal processing portion 8 and an insulating portion 9. The signal processing portion 8 includes a CDS circuit 8a that performs a correlative double sampling processing (abbreviated as CDS) of the image pickup signal from the image sensor 2a, and an A/D conversion circuit 8b and the like that perform noise removal, white balance, and A/D conversion processings of the image pickup signal from the image sensor 2a.
The signal processing portion 8 in the video signal pre-processing circuit 5 performs a basic signal processing of the image pickup signal corresponding to an image picked up by the image sensor 2a, the signal processing being required for displaying the image picked up by the image sensor 2a as an endoscope image on the monitor 3 as a display portion.
The signal processing portion 8 in the video signal pre-processing circuit 5 enters an operating state in a shorter time than a system and digital signal processing portion 6 described later and outputs a video signal when the electronic endoscope system 1 is powered on from off.
Then, the video signal is transmitted to the system and digital signal processing portion 6 as a second video signal generating portion in a post-stage via an insulating portion 9 constituted by, for example, a photocoupler. In this case, the insulating portion 9 electrically insulates the signal processing portion 8 electrically connected to the image sensor 2a inserted into a body of a patient, from the system and digital signal processing portion 6.
The system and digital signal processing portion 6 is constituted by a personal computer (PC) board including an MPU (microprocessor) 6d.
The system and digital signal processing portion 6 performs various digital signal processings (also referred to as digital processings) of a digital video signal generated by the basic signal processing by the signal processing portion 8 in a pre-stage.
Specifically, the system and digital signal processing portion 6 performs various digital processings such as color tone, enhancing, color conversion, scaling, or gamma correction processings of the digital video signal outputted from the video signal pre-processing circuit 5.
The system and digital signal processing portion 6 outputs the video signal (also referred to as an image signal) subjected to the various digital processings to the monitor 3 via an output image signal switching portion 7 as a video signal selecting portion.
The output image signal switching portion 7 selectively outputs, to the monitor 3, an image signal (hereinafter referred to as a processed image) subjected to the digital processing from the system and digital signal processing portion 6, and an image signal (hereinafter referred to as a through image) before the digital processing outputted from the insulating portion 9 in the video signal pre-processing circuit 5.
The output image signal switching portion 7 selects one of the processed image and the through image and outputs the image to the monitor 3 by a switching control signal from the system and digital signal processing portion 6.
The output image signal switching portion 7 selects and outputs the through image when the switching control signal from the system and digital signal processing portion 6 is, for example, a High level.
Software of the system and digital signal processing portion 6 has a hierarchical structure including a BIOS (Basic Input Output System) layer 6a, an OS (Operating System) layer 6b, and an Application layer 6c as shown in
The Application layer 6c includes an application software portion 15a that performs the digital processing of the through image from the insulating portion 9 in the video signal pre-processing circuit 5 and generates the processed image, an image output portion 15b that performs an image output processing for outputting the processed image to the monitor 3, and an image output state monitoring portion 15c as a processing state determination portion that monitors a processing state of the image output processing by the image output portion 15b and outputs the switching control signal to the output image signal switching portion 7.
The application software portion 15a includes an enhancing processing portion 15a1 that performs an enhancing processing, a color processing portion 15a2 that performs color tone and color conversion processings, a character superimposing portion 15a3 that performs a superimposing processing of character information, a contrast adjusting portion 15a4 that performs a contrast processing of the image, and a masking portion 15a5 that performs a masking processing of the image.
The application software portion 15a also includes a compression/decompression portion 15a6 that performs a digital compression processing of the image, records the image in the image recording portion 16, reads the image subjected to the digital compression processing from the image recording portion 16, and performs a digital decompression processing.
The image recording portion 16 may be placed inside or outside the system and digital signal processing portion 6.
The image output state monitoring portion 15c as the processing state determination portion determines whether the state of the processing by the image output processing portion 15b for outputting the processed image, which is a final digital processing for generating the processed image in the application software portion 15a, is a completed state.
When it is determined that the processing state is the completed state, the image output state monitoring portion 15c changes the switching control signal from a High level to a Low level, and switches the image from the through image to the processed image by the switching control signal at the Low level.
The embodiment having such a configuration includes the video signal pre-processing circuit 5 that generates a first video signal displayed as an endoscope image (through image) on the monitor 3 as a display device, and the system and digital signal processing portion 6 that performs a signal processing of the first video signal using application software that runs on an operating system, and generates a second video signal displayed as an endoscope image (processed image) on the monitor 3.
The image output state monitoring portion 15c monitors whether the system and digital signal processing portion 6 can output the processed image to the monitor 3, and controls the output image signal switching portion 7 by the switching control signal so as to output the through image to the monitor 3 when the system and digital signal processing portion 6 cannot output the processed image.
Thus, for example, even if the system and digital signal processing portion 6 has not entered a start state for performing the signal processing when the video processor 4 is powered on, the video processor 4 outputs the first video signal by the video signal pre-processing circuit 5 to the monitor 3. On the monitor 3, the through image corresponding to the image picked up by the image pickup device can be displayed.
Specifically, even if there is a period when the system and digital signal processing portion 6 cannot generate the processed image, the through image is displayed in the period. This nearly eliminates a period when no endoscope image is displayed on the monitor.
Next, an operation of the present embodiment will be described with reference to the flowchart in
As shown in
In the processing immediately after the electronic endoscope system 1 is powered on, that is, in Step S2, the system and digital signal processing portion 6 is in a state before a start of a BIOS. Then, the system and digital signal processing portion 6 outputs the switching control signal to the output image signal switching portion 7 as a default first status signal, for example, at a High level.
By the first status signal, the output image signal switching portion 7 outputs the through image from the insulating portion 9 in the video signal pre-processing circuit 5 to the monitor 3.
In this case, the image picked up by the image sensor 2a is displayed as an endoscope image. In this case, the masking processing by the masking portion 15a5 is not performed, and thus, for example, an image picked up by an image sensor 2a having a square image pickup surface is displayed as an endoscope image. Specifically, the endoscope image is displayed with an outline corresponding to an outline of the image pickup surface.
Next, the system and digital signal processing portion 6 in the video processor 4 performs a start processing of the BIOS in the BIOS (Basic Input Output System) layer 6a in Step S3, and performs a start processing of an OS in the OS (Operating System) layer 6b in Step S4. Further, the system and digital signal processing portion 6 starts various application software in the Application layer 6c in Step S5.
Then, in the system and digital signal processing portion 6, the image output state monitoring portion 15c in the Application layer 6c determines whether an application for the image output processing by the image output portion 15b is started in Step S6.
When the image output state monitoring portion 15c determines that the application for the image output processing by the image output portion 15b is started, the system and digital signal processing portion 6 outputs the switching control signal to the output image signal switching portion 7 as a second status signal, for example, at a Low level in Step S7.
Then, the output image signal switching portion 7 outputs the processed image subjected to the digital processing from the system and digital signal processing portion 6 to the monitor 3 by the first status signal in Step S8.
In this case, the masking processing by the masking portion 15a5 is performed, and thus, for example, four corners of the image picked up by the image sensor 2a having the square image pickup surface are masked, and an endoscope image having a substantially octagonal outline is displayed.
Then, the video processor 4 repeats the processing in Step S8 and continuously outputs the processed image subjected to the digital processing from the system and digital signal processing portion 6 to the monitor 3 until a finish of the endoscopy is confirmed in Step S9.
As such, in the present embodiment, as shown in
Then, after the start of the image output processing, the processed image subjected to the digital processing from the system and digital signal processing portion 6 is displayed on the monitor 3.
Thus, in the present embodiment, the through image can be displayed on the monitor 3 immediately after the electronic endoscope system 1 is powered on. Irrespective of the start state of a digital video processing circuit that generates the endoscope image by the digital processing, an operator can continuously observe the inside of the body cavity by an endoscope image (through image or processed image) as an observation image based on the image pickup signal of the endoscope.
In the present embodiment, the switching control signal is outputted to the output image signal switching portion 7 on the basis of a monitoring result of the image output state monitoring portion 15c, but not limited thereto.
For example, as shown in
In a period shorter than the time required until the start of the image output processing by the timer 15d, the timer 15d outputs a switching control signal as the first status signal to the output image signal switching portion 7.
On the other hand, the timer 15d may output a switching control signal as the second status signal to the output image signal switching portion 7 in a period longer than the time required until the start of the image output processing.
The timer 15d may be added to the configuration in
Specifically, when there is a possibility of delays in processed image generation, the timer 15d measures a margin period, and the image is switched from the through image to the processed image after the margin period, thereby allowing an observation image to be continuously displayed on the monitor 3.
In
However, not being limited thereto, as shown in
Specifically, the video signal pre-processing circuit 5, and the system and digital signal processing portion 6 and the output image signal switching portion 7 may be provided in separate casings.
As shown in
Similarly, as shown in
Also, as shown in
Specifically, in the configuration in
When it is determined that there is an abnormality in the system of the system and digital signal processing portion 6, the output image signal switching portion 7 outputs the through image from the insulating portion 9 in the video signal pre-processing circuit 5 to the monitor 3 in Step S22.
In this case, as in Step S23, the W.D.T. 12 may restart (reset) the system and digital signal processing portion 6. Then, the processing may be finished or return to Step S2.
Thus, with the configuration in
Embodiment 2 is substantially the same as Embodiment 1, and thus differences only will be described, and the same components are denoted by the same reference numerals and descriptions thereof will be omitted.
A system and digital signal processing portion 6 of the present embodiment includes, as shown in
In the present embodiment thus configured, as shown in
In Step S32, the video processor 4 read a suspended processing from the processing information stored in the storing portion 23, the resuming processing portion 22 returns the processing of the system and digital signal processing portion 6 to the processing before suspending, and the process proceeds to Step S5. Other operations are the same as in Embodiment 1.
Thus, in the present embodiment, in addition to the advantage of Embodiment 1, when the resuming processing portion 22 returns the suspended system and digital signal processing portion 6 to a normal processing state, a through image in a short time can be displayed on a monitor 3 as an observation image, and the observation image can be continuously and quickly switched to a processed image as shown in
The present invention is not limited to the above described embodiments, and various changes and modifications may be made without changing the gist of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
2006-247168 | Sep 2006 | JP | national |
This application is a continuation application of PCT/JP2007/061090 filed on May 31, 2007 and claims benefit of Japanese Application No. 2006-247168 filed in Japan on Sep. 12, 2006, the entire contents of which are incorporated herein by this reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2007/061090 | May 2007 | US |
Child | 12401092 | US |