The above objects and advantages of the present invention will become more apparent from the following detailed description when read in connection with the accompanying drawings, in which:
In
For the diagnosis, the human body 10 wears shielding clothes 8. A plurality of antennas 14 of the receiver 12 or communication interface are disposed on an inner surface of the shielding clothes 8. The receiver 12 wirelessly receives image data from the capsule endoscope 11 by use of the antennas 14. A data storage medium 48 of the receiver 12 in
The computer 13 as image processor has an input interface 17 such as a keyboard and mouse and a monitor display panel 18. When the diagnosis with the capsule endoscope 11 is completed, the computer 13 retrieves image data from the data storage medium 48 in the receiver 12 or communication interface, produces an object image, and causes the display panel 18 to display the object image.
An electric field strength detector 19 or electric field sensor is incorporated in the antennas 14. When radio wave 36 of
In
Various elements are contained in a space inside the front and rear casings 20 and 21, including a camera head or optical assembly 24 for imaging, a light source 25, a circuit board 26 and a button cell battery 27. The camera head 24 includes an objective optical system 22 for passing of object light from an object of the endoscopic imaging, and an image pickup device 23 such as a CCD, CMOS or other imaging element. The light source 25 is a white LED (light emitting diode) for illuminating the object. The circuit board 26 has a radio transmission unit 35 and a power source circuit 37 mounted thereon in
The objective optical system 22 includes an optical dome or transparent cover 22a, a lens holder 22b, and a lens 22c. The transparent cover 22a is disposed at a cover end of the transparent front casing 20 in a semi spherical shape. The lens holder 22b is secured to a rear end of the transparent cover 22a, and has a width decreasing in the backward direction. The lens 22c is supported in the lens holder 22b. There is an optical axis 29 of the objective optical system 22, which has a photographic field region of a view angle of 140-180 degrees. Image light of an image of an intraluminal object is retrieved in all directions in the field region.
In
A driver 32 is connected with the CPU 30. As image light is focused on a pickup surface of the image pickup device 23, the CPU 30 causes the driver 32 to output a pickup signal of pixels at a frame rate of 2 frames per second or the like.
An AFE (analog front end) 33 is controlled by use of the driver 32, and receives an image signal from the image pickup device 23. The AFE 33 processes the image signal according the correlated double sampling, amplification, and A/D conversion, and outputs a digital image data of 10 bits by conversion of the image signal.
A modulator 34 modulates the image data from the AFE 33 according to the digital quadrature modulation, and produces the RF signal. The radio transmission unit 35 transmits the radio wave 36 of the RF signal from the modulator 34 by use of the antenna 28 to the receiver 12 or communication interface.
The power source circuit 37 is caused by the CPU 30 to supply various elements of the capsule endoscope 11 with power from the button cell battery 27. An illumination driver 38 is controlled by the CPU 30, and turns on and off the light source 25.
The ROM 31 stores specific information of the capsule endoscope 11, such as the capsule type number of the capsule endoscope 11 for the large intestinal use, small intestinal use and other uses, and a production lot number of the capsule endoscope 11. When the power source of the capsule endoscope 11 is turned on, the CPU 30 reads the specific information from the ROM 31, and outputs the same to the radio transmission unit 35. The radio transmission unit 35 transmits the radio wave 36 of the specific information from the CPU 30 by use of the antenna 28 to the receiver 12.
In
A reception unit 42 amplifies an RF signal or a signal of the radio wave 36 received by the antennas 14. Also, the reception unit 42 receives the radio wave 36 of specific information upon turning on of the power of the capsule endoscope 11, and sends the specific information to the CPU 40.
The position detector 43 detects a position of the capsule endoscope 11 in the body 10 according to the measured electric field of the radio wave 36 detected by the electric field strength detector 19, and transmits the position information to the CPU 40. Specifically for the position detection of the capsule endoscope 11, for example, data of a data table is experimentally obtained and written in the ROM 41, the data table expressing a relationship between the electric field of the radio wave 36 at the antennas 14 and a position of the capsule endoscope 11 in the body 10. The ROM 41 is accessed to refer to the data table, for determining the position.
A demodulator 44 receives the RF signal in the form of the radio wave 36, and demodulates the RF signal according to the digital quadrature detection to obtain image data before demodulation in the capsule endoscope 11. A sync separator 45 is controlled by the CPU 40, separates the sync signal from the demodulated image data from the demodulator 44 according to the amplitude separation. Then the sync separator 45 separates horizontal sync signal and vertical sync signal of the image data according to the frequency separation.
A digital signal processor (DSP) 46 processes the demodulated image data from the demodulator 44 according to signal processing of gamma processing, Y/C processing and the like. A luminance signal and a chrominance signal in combination are transmitted to a memory control unit 47 as image data. The memory control unit 47 combines the specific information and position information with the image data output by the digital signal processor 46, and writes the combination of the data to the data storage medium 48. An example of the data storage medium 48 is a flash memory having a storage size as much as 1 Gb, and stores numerous image data output by the memory control unit 47.
A display driver 49 drives the LCD display panel 15 in a controlled manner. A connector 51 is connectable with a USB cable or the like. A communication interface port 50 sends data to or receives data from the computer 13 as image processor in connection with the connector 51. Image data read from the data storage medium 48 is transmitted by the interface port 50 to the computer 13.
In
An image processing program 66 and data of coefficient matrices 67 are stored in the HDD 64 together with programs and data required for operation of the computer 13 as image processor. Also, image data received through the communication interface 63 is stored in the HDD 64. The memory 65 for a temporary use stores data read from the HDD 64, intermediate data produced during the arithmetic operation, and the like.
When the image processing program 66 is run by operating the input interface 17, a working window of the image processing program 66 appears on the monitor display panel 18. The input interface 17 is operated by a user, to display or edit an object image. Also, an object image generator 68 for an object image and a spectral image generator 69 become ready for operation in the CPU 60 upon startup of the image processing program 66.
The object image generator 68 reads image data from the HDD 64, and generates normal image data or object image data according to the image data. Also, the spectral image generator 69 receives the image data, and produces spectral image data of a spectral image having a wavelength band. The wavelength band is changeable by operating the input interface 17.
A matrix operating unit 70 is incorporated in the spectral image generator 69. The matrix operating unit 70 reads the coefficient matrix 67 from the HDD 64, and carries out the matrix arithmetic operation to multiply the image data by the coefficient matrix 67. The arithmetic operation is expressed in the following equation
C A=C′
where C is a matrix of the image data, C′ is a matrix of the spectral image data, and A is a coefficient matrix.
Note that the coefficient matrix 67 is a group of predetermined coefficients for the purpose of converting image data into spectral image data of a predetermined wavelength band in accordance with the equation.
A=(tC C)−1 tC C′
where tC is a transposed matrix of the matrix C. As the coefficient matrix 67 depends upon characteristics of color filters of the image pickup device 23 or spectral characteristics of light from the light source 25, spectral reflection characteristics of objects to be imaged. The coefficient matrix 67 requires correcting for the purpose of optimizing a spectral image. Thus, the HDD 64 stores data table of various data including the capsule type number of the capsule endoscope 11 to express intracorporeal regions in the endoscopic use, the production lot number of the image pickup device 23 and the light source 25, and a plurality of the coefficient matrices 67 according to the intracorporeal regions. The matrix operating unit 70 reads the coefficient matrix 67 from the HDD 64 in association with specific information 72 such as a capsule type number and production lot number of the capsule endoscope 11 in association with the image data, and position information. The matrix operating unit 70 performs calculation for matrix operation by use of the coefficient matrix 67.
In
Operation of diagnosis by use of the capsule endoscope system 2 for endoscopic imaging is described now. At first, power starts being supplied to the capsule endoscope 11. The specific information 72 is read from the ROM 31 by the CPU 30, which sends the specific information 72 to the radio transmission unit 35. The radio transmission unit 35 transmits the radio wave 36 of the specific information 72 by use of the antenna 28 to the receiver 12 or communication interface.
The patient swallows the capsule endoscope 11 orally. An object in the body 10 is illuminated by the light source 25 in the digestive system, while the image pickup device 23 photographs the inner wall of the tract. Object light of the object becomes incident on the objective optical system 22, and is focused on a pickup surface of the image pickup device 23, to output an image signal from the image pickup device 23. The AFE 33 processes the image signal from the image pickup device 23 according the correlated double sampling, amplification, and A/D conversion, and outputs digital image data of 10 bits by conversion.
The digital image data from the AFE 33 is modulated by the digital quadrature modulation in the modulator 34, to generate an RF signal. The RF signal is amplified by the radio transmission unit 35 to transmit the radio wave 36 by use of the antenna 28.
When the antennas 14 of the receiver 12 or communication interface receive the radio wave 36 output by the antenna 28 of the capsule endoscope 11, the RF signal or the received radio wave is amplified by the reception unit 42. Also, the electric field of the radio wave 36 is measured by the electric field strength detector 19. An intracorporeal position of the capsule endoscope 11 is detected by the position detector 43 according to the output of the electric field strength detector 19, so as to send the position information to the CPU 40.
The RF signal amplified by the reception unit 42 is subjected by the demodulator 44 to digital quadrature detection, and is demodulated to a form of the image data before modulation in the capsule endoscope 11. The demodulated image data is subjected to sync separation by the sync separator 45 conditioned by the CPU 40. The signal is processed in the digital signal processor 46 in various steps of signal processing. Then the specific information 72 from the memory control unit 47 and the position information are assigned to the image data, and stored in the data storage medium 48.
After the diagnosis with the capsule endoscope 11, the receiver 12 or communication interface is connected to the computer 13 as image processor. Image data in the data storage medium 48 is transmitted by the interface port 50, the connector 51, the USB cable and the connector 62, and received by the communication interface 63 of the computer 13. The image data is written to the HDD 64.
When the image processing program 66 is run by operating the input interface 17, the monitor display panel 18 at the computer 13 as image processor displays a working window region for the image processing program 66. The object image generator 68 and the spectral image generator 69 are started up in the CPU 60. The object image generator 68 reads image data from the HDD 64, and produces object image data.
The spectral image generator 69 as specific information retriever reads the specific information 72 and the coefficient matrix 67 from the HDD 64, the specific information 72 being associated with the image data, the coefficient matrix 67 being associated with the position information. The specific information 72 and the coefficient matrix 67 are retrieved in the matrix operating unit 70. The matrix operating unit 70 processes the image data for arithmetic operation of the coefficient matrix 67 read from the HDD 64. The matrix operating unit 70 produces spectral image data. The object image data and the spectral image data are received by the display control unit 61 which causes the monitor display panel 18 to display the object image 81 and the spectral image 82.
Accordingly, a spectral image can be formed in the capsule endoscope system 2 for endoscopic imaging by the simplified construction without using plural light sources or plural filters of narrow bands, because the spectral image data is produced from image data by the spectral image generator 69.
To produce the spectral image, the coefficient matrix 67 of an optimized condition for the specific information 72 and the position information is used. Thus, a good spectral image can appear without differences of the capsule endoscope 11 between plural products, and without differences between objects of the diagnosis.
Also, the specific information 72 is automatically transmitted from the capsule endoscope 11 to the receiver 12 or communication interface wirelessly as soon as the power for the capsule endoscope 11 is turned on. This is effective in reducing the manufacturing cost because there is no keypad for an operator to operate to obtain the specific information 72.
In the above embodiment, the electric field strength detector 19 is used for position detection. In
In
In
In the above embodiment, various values of the coefficient matrices 67 are predetermined. However, the coefficient matrix 67 with a change may be corrected for compensation in view of a characteristic change with time after the shipment. Also, a new value of the coefficient matrix 67 may be determined according to such a characteristic change with time. In
In
Then the receiver 12 or communication interface is connected to the computer 13 as image processor, and is caused to send the test image data to the computer 13. The matrix determiner 114 receives the test image data, and corrects the coefficient matrix 67 by considering a change in the coefficient matrix 67 according to characteristic changes in the capsule endoscope 11 with time. It is also possible in the matrix determiner 114 to generate a new coefficient matrix according to changes with time. Various methods can be used for correction or renewal of a coefficient matrix. For example, reference test image data of the test image data is obtained experimentally with the test color chart 113 as test image before shipment of the product, and stored in the HDD 64. The test image data from the receiver 12 is compared with the reference test image data, to obtain difference data. The coefficient matrix 67 is corrected according to the difference data. Also, a new coefficient matrix may be obtained according to the difference data. Therefore, optimized spectral image data can be obtained even when a change occurs in the characteristic of the capsule endoscope 11 after the shipment.
In the above embodiment, both the specific information 72 and the position information are referred to for the purpose of producing a spectral image. However, only a selected one of the specific information 72 and the position information can be used for producing a spectral image.
In the above embodiment, the image processing program 66 is installed in the HDD 64 in the computer 13 as image processor, and is run to function the object image generator 68 and the spectral image generator 69 in the CPU 60. However, elements of the object image generator 68, the spectral image generator 69 and the like may be discrete circuits, FPGA (Field Programmable Gate Array), and other circuits of hardware.
In the above embodiment, the capsule endoscope 11 is a terminal device for use of only transmission without reception. However, the capsule endoscope 11 can be constructed for both transmission and reception of a signal or data. A power turning-on signal may be wirelessly sent to the capsule endoscope 11, so as to turn on the power source of the capsule endoscope 11.
Although the present invention has been fully described by way of the preferred embodiments thereof with reference to the accompanying drawings, various changes and modifications will be apparent to those having skill in this field. Therefore, unless otherwise these changes and modifications depart from the scope of the present invention, they should be construed as included therein.
Number | Date | Country | Kind |
---|---|---|---|
2006-153277 | Jun 2006 | JP | national |