This application claims benefit of Japanese application No. 2001-152916 filed on May 22, 2001, the contents of which are incorporated by this reference.
1. Field of the Invention
The present invention relates to an endoscope system whereby endoscopic examination is performed using an endoscope.
2. Description of the Related Art
U.S. Pat. No. 4,621,618 discloses an endoscope device arranged such that control can be performed using a centralized control device wherein a monitor, joystick and control buttons of various types are arranged in centralized fashion and arranged such that the endoscope can be easily controlled at a location remote from the main endoscope unit while viewing the monitor screen.
Also, in a fourth embodiment disclosed in Laid-open Japanese Patent publication No. 11-211997 there is disclosed an endoscope image observation device constituted by combining a control box and a personal computer.
However, the endoscope device of U.S. Pat. No. 4,621,618 is of very high cost, since the centralized control device is a special-purpose device used for its purpose. Furthermore it is of large size and considerable weight owing to the provision of a joystick and a large number of control buttons. It is therefore very inconvenient to move the centralized control device to a desired location where examination is to be performed.
Furthermore, although in recent years it has become common to save observation images obtained from an endoscope on a computer, with such an endoscope, a computer for this purpose must be separately provided and an operation of transferring the image data from the endoscope to the computer must be performed.
On the other hand, while the fourth embodiment of Laid-open Japanese Patent publication No. 11-211997 solves some of the above problems, it is of very high cost, since the control box is a special-purpose device used for its purpose.
In view of the above, an object of the present invention is to provide an endoscope system whereby display of a captured image can be achieved at low cost and wherein control such as curvature control can be achieved.
A further object is to provide an endoscope system wherein endoscopic examination can be performed with the location of examination changed and wherein substitution can easily be performed in cases where for example the control device used for control etc. of the endoscope has broken down.
An endoscope system according to the present invention comprises an endoscope and an image display section that displays the image of a subject that is captured by an image pick-up element provided in the endoscope. The endoscope comprises a connector that is detachably connected to a serial communication cable and a signal processing circuit that converts the image captured by the image pick-up element to a signal capable of being transferred via the serial communication cable. The image display section is a screen displayed on a display device of a terminal device connected to the serial communication cable; the screen comprises an image display region utilized for display of the image captured by the image pick-up element and a display region for control purposes whereby control of the endoscope is performed.
The above and other objects, features and advantages of the invention will become more clearly understood from the following description referring to the accompanying drawings.
An embodiment of the present invention is described below with reference to the drawings.
The endoscope system 1 according to the embodiment illustrated in
Rather than being of a special construction specific to this embodiment, the personal computer 3 is an ordinary personal computer such as is widely available commercially.
The endoscope 2 comprises an elongate insertion section 6 that is inserted in the direction of the part to be examined and a control section 7 provided at the proximal end of this insertion section 6.
The insertion section 6 comprises a hard tip section 8 provided at its tip, a curved section 9 that can be freely bent provided to the proximal end of this tip section 8, and a flexible section 10 having flexibility connected to the control section 7 from the proximal end of this curved section 9.
A light guide 11 whereby illuminating light is transferred is inserted into insertion section 6, the proximal end of light guide 11 being connected to a light source section 12 provided within control section 7. The light source section 12 has a lamp in its interior, the light generated by this lamp being incident on the end face of light guide 11 and transferred to the tip-side end face by means of this light guide 11.
The tip of the light guide 11 is mounted on an illuminating window of the tip section 8 so that the subject of image pick-up is an illuminated by this light being emitted forwards from the tip face and further passing through an illuminating lens 13. An observation window is provided adjacent to this illuminating window and the subject image is formed by an objective lens 14 mounted in the observation window. For example a CCD (charge coupled device) 15 constituting an image pick-up element is arranged at this position of image formation and photoelectric conversion is effected by this CCD 15.
This CCD 15 is connected to a signal processing unit 16 provided within the control section 7 by means of a signal line inserted into the insertion section 6. The CCD 15 is driven by this signal processing unit 16 and a video signal is generated by performing signal processing on its output signal. Also, the video signal is compressed to be converted to a signal capable and be transferred by the USB cable 4 constituting communication means having a transmission and receiving function.
The output signal of the signal processing unit 16 is transferred to the personal computer 3 through the USB cable 4. The USB cable 4 is provided at one end with a USB connector 18a connected to a USB connector socket 17 and at its other end is provided with a USB connector 18b connected to the personal computer 3.
The personal computer 3 returns the signal that is input by the USB connector 18b to the original video signal by performing signal processing and displays the image captured by the CCD 15 on the screen of an LCD monitor section 21 constituting a display device. This LCD monitor section 21, as will be described with reference to
This personal computer 3 comprises a keyboard section 22 that performs data input etc., a mouse 23 constituting a pointing device for performing designation operations of various types and the LCD monitor section 21 that performs display of images etc. Its internal structure will be described later with reference to
Also, a wire 24 for the bending curved section 9 is inserted within the insertion section 6 of the endoscope 2, the proximal end of the wire 24 being connected to a wire drive unit 25 within the control section 7. In addition, as will be described, it is arranged to be possible to bend the curved section 9 in any desired direction vertically or horizontally so that it can be inserted into a bent portion, or to effect observation etc. towards the direction of observation of the tip section 8 in a desired direction, by using the mouse 23 to perform an operation of selecting and designating a “bend” button displayed on the LCD monitor section 21 to drive a motor etc. in the interior of the wire drive unit 25 so as to pull on the wire 24.
A drive circuit 31 generates a signal for driving the CCD and a timing signal that is supplied to a video processing circuit 32. In response to application of the drive signal from the drive circuit 31, the CCD 15 outputs a cumulative signal obtained by photoelectric conversion and this output signal is input to the video processing circuit 32.
The video processing circuit 32 performs video processing on the captured signal that is sent from the CCD 15 to convert it to a video signal by amplification and color separation etc. and outputs the result to an AD conversion circuit 33; it is also capable of changing the brightness of the image by altering the gain. Alteration of the image brightness is performed in accordance with a control signal output from CPU (Central Processing Unit) 34.
The AD conversion circuit 33 converts the output signal of the video processing circuit 32, which is an analogue signal, into digital image data. Under the control of an instruction from the CPU 34, the AD conversion circuit 33 is capable of performing AD conversion of the output signal of the video processing circuit 32 over the entire period under the control of an instruction from the CPU 34, or of AD conversion of the signal of only part of the period of the output signal. In the latter case, only a partial region of the video captured by the CCD 15 is magnified and converted to image data.
The image data that is output by the AD conversion circuit 33 is input to a compression processing circuit 35; this compression processing circuit 35 compresses the image data using a compression method suited to the input image data. The compressed image data is written to storage means constituted by RAM 36, i.e., it is stored. An RAM (Random Access Memory) 36 is controlled by the CPU 34 so that image data written to this RAM 36 can be read by the CPU 34.
The CPU 34 sequentially sends the image data to a USB interface (abbreviated as USB I/F in
The image data is converted to a USB standard signal by the USB interface 37. The USB interface 37 is connected to the USB connector socket section 17 and sends image data to the personal computer 3 through the USB cable 4 whose USB connector 18a is connected to this USB connector socket section 17.
The above operation is repeated at the frame period of the television, i.e., every 1/30 second (in the case of an NTSC system) or every 1/25 second (in the case of a PAL system). The signal processing unit 16 is of very small size since it is constituted entirely of semiconductors. Consequently, the control section 7 of the endoscope 2 of
A CPU 41 that performs overall control of the personal computer 3 is connected to an internal bus 42. RAM 43 that is utilized as the working area etc. of the CPU 41, the USB interface 45 that is connected to the USB connector socket section 44 and the connector of mouse 23 are connected to this internal bus 42; a mouse interface 46 is connected to this internal bus 42 through the connector socket section.
In addition, the keyboard section 22, a hard disk (abbreviated to HD in the figures) drive 47, a flexible disk (abbreviated as FD) drive 48 for a floppy disk etc. and a CD-ROM drive 49 are connected to this internal bus 42 by means of respective interfaces 22a, 47a, 48a and 49a.
Also, the LCD monitor section 21 is connected to the internal bus 42 and a RAM 43 through a display control circuit 50 that performs display control.
The CPU 41 first of all reads a program stored on the hard disk drive 47 and writes this to a prescribed region in the RAM 43 after which it operates in accordance with this program. The program is constructed so as to display a prescribed screen on the LCD monitor section 21 of the personal computer 3.
The data for display on the screen is prepared by the CPU 41 in a prescribed region in the RAM 43. The display control circuit 50 repeatedly reads the data for display on the screen and continually converts it into a signal for display on the LCD monitor section 21. This signal is sent to the LCD monitor section 21, where it is displayed as the monitor screen.
The screen data sent to the personal computer 3 from the endoscope 2 is received by the USB interface 45 and read by the CPU 41 through the internal bus 42. The CPU 41 uses a program to restore this image data to the image data prior to compression before writing it to a prescribed region of the RAM 43 so that it can be displayed on the LCD monitor section 21. This operation is performed repeatedly every 1/30 second (more precisely, every 1/29.94 second) or every 1/25 second, i.e., the television frame period.
The endoscope system in this embodiment is so constructed that the endoscope 2 and the personal computer 3 are connected using the USB cable 4 so that the endoscope 2 is controlled by control instructions transferred from the personal computer 3 through the USB cable 4 and image data of the image captured by the endoscope 2 is transferred to the personal computer 3 through the USB cable 4 so that the image can be displayed on the LCD monitor section 21. By adopting such a construction, implementation at low cost can be achieved, as a special-purpose centralized control device is not required, since only a personal computer 3 such as is widely available commercially is employed as the centralized control device.
Also, since a personal computer 3 of the notebook type can be employed as the centralized control device, it can be conveniently moved, being of small size and light weight.
Since only a personal computer 3 such as is widely available commercially is employed as the centralized control device, even if this breaks down, endoscopic examination can still be performed by substituting various other personal computers.
Also, since the centralized control device itself consists of the personal computer 3, saving of the observation images produced by the endoscope 2 can be achieved without needing to prepare another computer for purposes of saving these and the task of handing over the images to the other computer is also made unnecessary.
Image data captured by the CCD 15 of the endoscope 2 is displayed in the central portion of a live image window 52 constituting an image display region. Specifically, the live image window 52 is a portion in which an observation image obtained by the endoscope 2 is displayed in the same way as with an ordinary television monitor.
Various buttons are displayed on a remote function panel section 53 in the monitor screen 51 constituting a display region for control purposes. The corresponding function is executed by clicking these buttons using the mouse 23 shown in
Specifically, the U, D, L, and R buttons constituting curvature buttons 53a are buttons for remotely producing bending upwards, downwards, leftwards or rightwards from the current direction of curved section 9 of the endoscope, respectively, and a central button C is a button for putting the curved section 9 into the centered position, i.e., the straightforward direction.
For example, when the mouse 23 is used to click the U button, this control operation is transmitted to the CPU 41 through a mouse interface 46 etc. shown in
The signal processing unit 16 of the endoscope 2 shown in
Also when the D, L and R buttons shown in
When a BRIGHT button 53b of
Also, if a TELE button 53d is clicked, an instruction to magnify the image is sent to the endoscope 2 from the personal computer 3. The CPU 34 of signal processing unit 16 of
A STORE button 53f of
When this STORE button 53f is clicked, the CPU 41 of personal computer 3 of
When the hard disk interface 47a receives this instruction, it writes the image data in the RAM 43 to the hard disk drive 47 as a file. After this, the CPU 41 reads and compresses the image data placed in the RAM 43 and writes this to a thumbnail region that is secured within the RAM 43.
This thumbnail region in the RAM 43 is constantly read by the display control circuit 50 of
When a VIEW button 55a of a general function panel 55 of
This image that has been read from the hard disk drive 47 is therefore displayed in the live image window 52 instead of the current endoscope observation image input from the USB interface 45. If the VIEW button 55a is again clicked, the CPU 41 stops this display and returns to the operation of displaying the current endoscope observation image that is input from the USB interface 45 as before.
An EXPORT button 55b is a button that is employed when it is desired that the image on the hard disk drive 47 corresponding to the thumbnail image 54a that was clicked is written to a flexible disc constituting a portable recording medium inserted into flexible disc drive 48. An EXIT button 55c is a button that is clicked to stop the program of personal computer 3 and terminate use of the endoscope system 1.
The instructions that are sent to the endoscope 2 from the personal computer 3 through the USB cable 4, such as instructions for alteration of the angle of curvature described above, are transmitted in an extremely short time, so they are transmitted in the intervals of the image data transmission described above performed from the endoscope 2 in respect of the personal computer 3 with the frame period of the television.
When the power source of the personal computer 3 is turned on, as shown in step S1, the CPU 41 reads the program from the hard disk drive 47 and stores it in the RAM 43.
Next, in accordance with this program, the CPU 41 displays all of the images saved on the hard disk drive 47 as the thumbnail images 54a in the thumbnail window 54.
Next, in step S3, the CPU 41 ascertains whether or not image data has arrived at the USB interface 45 from the endoscope 2. If no images have in fact arrived, processing then shifts to step S5. On the other hand, if an image has arrived, processing advances to the next step S4 in which restoration processing is performed on the incoming image data to reconstitute the endoscope image prior to compression; processing then advances to step S5 in which this endoscope image is displayed in the live image window 52.
In step S5, the CPU 41 ascertains whether or not a button has been clicked by the mouse 23; if it is ascertained that no button has been clicked, processing returns to step S3; if a button has been clicked, processing advances to step S6 in which it is further ascertained which button has been clicked.
If an EXIT button 55c is clicked, processing is terminated.
Also, as shown in step S7a, if any of the curvature buttons 53a (specifically, the U, D, L, R, or C button), the BRIGHT button 53b, the DARK button 53c, the TELE button 53d, or the WIDE button 53e has been clicked, the corresponding instruction is sent to the endoscope 2 through the USB interface 45, after which processing returns to step S3.
On the side of the endoscope 2, the CPU 34 decodes the incoming instructions and exercises control such that the corresponding action is performed in accordance with this decoding.
Also, if the STORE button 53f is clicked as shown in step S7b, the image displayed in the live image window 52 is saved on the hard disk drive 47, after which processing shifts to step S8b, in which thumbnail image data of the saved image is generated and the thumbnail image 54a is added to the thumbnail window 54; processing then returns to step 3.
Also, as shown in step S7c, if the VIEW button 55a is clicked, an image corresponding to the thumbnail image that was clicked beforehand is read from the hard disk drive 47 and displayed in the live image window 52; processing then returns to step 3 after waiting for the VIEW button 55a to be clicked again as shown in step S8c.
Also, when the EXPORT button 55b is clicked as shown in step S7d, an image corresponding to the thumbnail image that was previously clicked is read from the hard disk drive 47, output to the floppy disk drive 48 and written to the floppy disk, after which processing returns to step 3.
Next, the processing on the side of the endoscope 2 will be described referring to
When the power source on the endoscope 2 is turned on, the CPU 34 is operated in accordance with the program 38 stored in the ROM 38 and, in initial step S11, controls the wire drive unit 25 such that curved section 9 becomes straight.
Next, the CPU 34 waits for the lapse of 1/29.94 second (or 1/25 second) (step S12); the CPU 34 then reads the image data temporarily stored in the RAM 36 and transmits this (step S13) to the personal computer 3 through the USB interface 37.
After transmission of the image data, in the following step S14, this CPU 34 ascertains whether or not a control instruction has arrived through the USB interface 37; if no control instruction has arrived, it returns to step S12.
On the other hand, if a control instruction has arrived, the CPU 34 ascertains the identity of the control instruction (step S15).
If it then identifies an instruction to alter the angle of curvature, the CPU 34, as shown in step S16a, sends a signal in accordance with this instruction to the wire drive unit 25 to perform alteration of the angle of curvature; after this, it returns to step S12.
Also, if it then identifies an instruction to alter the brightness, the CPU 34, as shown in step S16b, sends a signal in accordance with this instruction to the video processing circuit 32 to alter the brightness of the image by altering the gain, after which it returns to step S12.
Also, if it is identified as an instruction to magnify or to stop magnification of the image, the CPU 34, as shown in step S16c, sends a signal in accordance with this instruction to the AD conversion circuit 33 to output image data wherein the image has been magnified or to perform control to return to normal, after which it returns to step S12.
This embodiment has the following benefits.
The endoscope 2 can be operated remotely. Also, since only a personal computer 3 such as is widely available commercially is employed as the device for operating the endoscope 2, the endoscope system 1 can be constructed with low cost.
Also, since a notebook-type personal computer 3 can be employed as the device for operating the endoscope 2, this can be conveniently moved about in view of its small size and light weight. Also, since only a personal computer 3 such as is widely available commercially is employed as the device for operating the endoscope 2, even if this breaks down, endoscopic examination can still be performed by substituting various other personal computers.
Also, since the device itself for operating the endoscope 2 is constituted by a personal computer 3, there is no need to provide another computer for saving the images and saving of images can be achieved without an operation to hand over the images.
Also, since the endoscope 2 and the personal computer 3 can be connected using only a single USB cable, the tasks of installation, moving or dismantling the endoscope system 1 are facilitated. Also, since no manual control means at all need be arranged on the control section 7 of the endoscope 2, the control section 7 can be made of small size, light weight and low cost and the degree of freedom regarding its location of installation can be increased.
Although, in the above description, the case was described in which manual control of the various functions were performed using the mouse 23, an identical control operation could be performed by allocating keys of the keyboard section 22 of the personal computer 3 to these respective functions and pressing these keys instead of using the mouse 23.
It should be noted that the personal computer 3 used to construct the endoscope system 1 by connection to the endoscope 2 by means of the USB cable 4 is not restricted to existing operating systems such as for example Microsoft Windows (R) 98 or 2000 etc. or Linux etc.
Also, the endoscope system 1 could be constituted by connecting a personal computer 3 operated by such an existing operating system, to the endoscope 2 by means of the USB cable 4.
In this case, operation as described above is performed by using a CD-ROM or flexible disk etc. to install a device driver enabling the personal computer 3 to recognize the endoscope 2 and/or an application program whereby the various types of centralized control described above are made possible on the personal computer 3. That is, an endoscope system 1 can be constructed whereby centralized control of the endoscope 2 is performed by the personal computer 3.
Thus, if this is done, even if the personal computer 3 used to construct the endoscope system 1 breaks down, a substitute endoscope system 1 can be constructed in a straightforward manner by installing the application program etc. on another personal computer 3.
Also, if this is done, the personal computer 3 may be moved together with the endoscope 2 to the location where the endoscope 2 is employed; however, even without moving the personal computer 3, the endoscope system 1 could be constructed utilizing a personal computer 3 at the moved destination.
Also, expansion of functions etc. can be achieved by arranging for alteration of the program on the endoscope 2 to be performed in a simple fashion from the personal computer 3 by constructing the ROM 38 on the endoscope 2 shown in
Also, by connecting a personal computer 3 operated by an existing operating system with the endoscope 2 by means of the USB cable 4, an endoscope system 1 in respect of an ordinary personal computer 3 can be constructed in a straightforward fashion by arranging to transfer the device driver and/or application software whereby the endoscope 2 is recognized and control of the endoscope 2 is made possible to personal computer 3 from the endoscope 2.
For this purpose, a data recording device recognized through the USB cable 4 in an existing operating system employed in a personal computer 3 may be provided at the endoscope 2 and the aforesaid device driver and/or application software programs may be stored on this data recording device.
As described above, according to this embodiment of the invention, an endoscope system comprises an endoscope and an image display section that displays the image of a subject captured by an image pick-up element provided in the endoscope. The endoscope comprises a connector that is detachably connected to a serial communication cable and a signal processing circuit that converts an image captured by the image pick-up element to a signal capable of being transmitted via the serial communication cable. The image display section is a screen displayed on a display device of a terminal device connected to the serial communication cable; the screen comprises an image display region utilized for display of the image captured by the image pick-up element and a display region for control purposes whereby control of the endoscope is performed. Consequently, the display section of the personal computer can be utilized for displaying the image without needing special-purpose image display means and the personal computer can be employed as control means that performs control of the endoscope, without requiring a special-purpose control device; thus an endoscope system can be constituted with low cost. Also, the location where endoscopic examination is performed can easily be changed.
Having described the preferred embodiments of the invention referring to the accompanying drawings, it should be understood that the present invention is not limited to those precise embodiments and various changes and modifications thereof could be made by one skilled in the art without departing from the spirit or scope of the invention as defined in the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
2001-152916 | May 2001 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
4621618 | Omagari | Nov 1986 | A |
4739521 | Akimoto | Apr 1988 | A |
5217003 | Wilk | Jun 1993 | A |
5249121 | Baum et al. | Sep 1993 | A |
5482029 | Sekiguchi et al. | Jan 1996 | A |
5609560 | Ichikawa et al. | Mar 1997 | A |
5622528 | Hamano et al. | Apr 1997 | A |
5701904 | Simmons et al. | Dec 1997 | A |
5894322 | Hamano et al. | Apr 1999 | A |
5896166 | D'Alfonso et al. | Apr 1999 | A |
6003808 | Nguyen et al. | Dec 1999 | A |
6006191 | DiRienzo | Dec 1999 | A |
6006755 | Edwards | Dec 1999 | A |
6086544 | Hibner et al. | Jul 2000 | A |
6120435 | Eino | Sep 2000 | A |
6223100 | Green | Apr 2001 | B1 |
6224542 | Chang et al. | May 2001 | B1 |
6259806 | Green | Jul 2001 | B1 |
6295082 | Dowdy et al. | Sep 2001 | B1 |
6393431 | Salvati et al. | May 2002 | B1 |
6396941 | Bacus et al. | May 2002 | B1 |
6413233 | Sites et al. | Jul 2002 | B1 |
6428470 | Thompson | Aug 2002 | B1 |
6436032 | Eto et al. | Aug 2002 | B1 |
6442417 | Shahidi et al. | Aug 2002 | B1 |
6490490 | Uchikubo et al. | Dec 2002 | B1 |
6569086 | Motoki et al. | May 2003 | B2 |
6574355 | Green | Jun 2003 | B2 |
6581117 | Klein et al. | Jun 2003 | B1 |
6652451 | Murata et al. | Nov 2003 | B2 |
6657884 | Bocian et al. | Dec 2003 | B2 |
6659939 | Moll et al. | Dec 2003 | B2 |
6681061 | Agata et al. | Jan 2004 | B2 |
6697764 | Corby et al. | Feb 2004 | B2 |
6791601 | Chang et al. | Sep 2004 | B1 |
20010012023 | Kobayashi et al. | Aug 2001 | A1 |
20010047213 | Sepe, Jr. | Nov 2001 | A1 |
20010051762 | Murata et al. | Dec 2001 | A1 |
20020016718 | Rothschild et al. | Feb 2002 | A1 |
20020026096 | Motoki et al. | Feb 2002 | A1 |
20020032365 | Hasegawa et al. | Mar 2002 | A1 |
20020044049 | Saito et al. | Apr 2002 | A1 |
20020087048 | Brock et al. | Jul 2002 | A1 |
20020087049 | Brock et al. | Jul 2002 | A1 |
20030004397 | Kameya et al. | Jan 2003 | A1 |
20030050733 | Wang et al. | Mar 2003 | A1 |
20030053433 | Chun | Mar 2003 | A1 |
20030228039 | Green | Dec 2003 | A1 |
20040131282 | Yoshida et al. | Jul 2004 | A1 |
20040151358 | Yanagita et al. | Aug 2004 | A1 |
Number | Date | Country |
---|---|---|
6-14867 | Jan 1994 | JP |
11-211997 | Aug 1999 | JP |
2000-245694 | Sep 2000 | JP |
Number | Date | Country | |
---|---|---|---|
20020175992 A1 | Nov 2002 | US |