Patent Application
20050049461
This application claims the benefit of priority of Japanese Patent Application No. 2003-180138 filed on Jun. 24, 2003, and the disclosure of which is incorporated herein by its entirely.
1) Field of the Invention
The present invention relates to a capsule endoscope and a capsule endoscope system.
2) Description of the Related Art
There is known a capsule endoscope (swallowable capsule endoscope for medical use) which is designed as to be swallowable through the mouth of a patient and which can take images of digestive systems, such as a stomach, to gather information on inside the celom of a living body. One capsule endoscope of this type proposed has a capsule which incorporates an illumination unit including an LED or the like, a solid-state imaging device including a CCD, CMOS or the like, and a power supply unit including a battery or the like for driving the illumination unit and solid-state imaging device.
Japanese Patent Application Laid-Open No. 2001-245844 discloses the technology of a capsule endoscope having a white balance capability. The publication describes that the capsule endoscope has an image sensor, a scan circuit thereof, and a signal processing circuit integrated on a same chip and the signal processing circuit has an automatic white balance capability.
If white balancing or the like is performed in the signal processing circuit in the capsule endoscope as done in the capsule endoscope described in Japanese Patent Application Laid-Open No. 2001-245844, however, the circuit scale of the internal circuits increases, thereby increasing the consumed current.
There are two power supply systems proposed for capsule endoscopes: a system which uses a battery and a system which supplies power wirelessly. In either system, the problem occurs if white balancing or the like is performed in the signal processing circuit in the capsule endoscope.
It is an object of the present invention to provide a capsule endoscope that performs signal processing specific to an imaging device with low power consumption without increasing the circuit scale of the internal circuits.
It is an object of the present invention to at least solve the problems in the conventional technology.
The present invention is characterized by including a storage unit that stores signal processing data necessary for signal processing specific to an imaging device of a capsule endoscope; and a transmitting unit that transmits the signal processing data stored in the storage unit.
In the capsule endoscope, the present invention is characterized in that the signal processing data is a value acquired before shipment of the capsule endoscope in advance.
In the capsule endoscope, the present invention is characterized in that the signal processing data is data of a white balance coefficient to be used when a white balancing process of the imaging device is performed.
In the capsule endoscope, the present invention is characterized in that the signal processing data is data of an image of a chart for color signal processing which is taken by the imaging device.
In the capsule endoscope, the present invention is characterized in that the signal processing data is data indicating an address of a defective pixel of the imaging device.
In the capsule endoscope, the present invention is characterized in that the signal processing data is data indicating an offset value of the photoelectric conversion characteristic of the imaging device.
In the capsule endoscope, the present invention is characterized in that the transmitting unit transmits the signal processing data together with imaged data taken by the imaging device.
In the capsule endoscope, the present invention is characterized in that the transmitting unit transmits the imaged data with at least a part of the signal processing data included in each frame to be a transmission unit at a time of transmitting the imaged data.
In the capsule endoscope, the present invention is characterized in that the signal processing data is added on an end side of the frame.
In the capsule endoscope, the present invention is characterized in that the signal processing data is added to a top end of the frame.
In the capsule endoscope, the present invention is characterized in that the transmitting unit transmits the signal processing data together with an error correction code of the signal processing data.
In the capsule endoscope, the present invention is characterized in that the error correction code is acquired before shipment of the capsule endoscope in advance, and data of the error correction code is stored in the storage unit.
The present invention is a capsule endoscope system that includes a capsule endoscope including a storage unit that stores signal processing data necessary for signal processing specific to an imaging device of the capsule endoscope; and a transmitting unit that transmits the signal processing data stored in the storage unit; and a receiver that receives the signal processing data transmitted from the transmitting unit, characterized in that the capsule endoscope does not perform signal processing specific to the imaging device but the receiver performs signal processing specific to the imaging device based on the received signal processing data.
In the capsule endoscope system, the present invention is characterized in that the signal processing data is a value acquired before shipment of the capsule endoscope in advance.
In the capsule endoscope system, the present invention is characterized in that the signal processing data is data of a white balance coefficient to be used when a white balancing process of the imaging device is performed.
In the capsule endoscope system, the present invention is characterized in that the signal processing data is data of an image of a chart for color signal processing which is taken by the imaging device.
In the capsule endoscope system, the present invention is characterized in that the signal processing data is data indicating an address of a defective pixel of the imaging device.
In the capsule endoscope system, the present invention is characterized in that the signal processing data is data indicating an offset value of the photoelectric conversion characteristic of the imaging device.
In the capsule endoscope system, the present invention is characterized in that the transmitting unit transmits the signal processing data together with imaged data taken by the imaging device.
In the capsule endoscope system, the present invention is characterized in that the transmitting unit transmits the imaged data with at least a part of the signal processing data included in each frame to be a transmission unit at a time of transmitting the imaged data.
In the capsule endoscope system, the present invention is characterized in that the signal processing data is added on an end side of the frame.
In the capsule endoscope system, the present invention is characterized in that the signal processing data is added to a top end of the frame.
In the capsule endoscope system, the present invention is characterized in that the transmitting unit transmits the signal processing data together with an error correction code of the signal processing data.
In the capsule endoscope system, the present invention is characterized in that the error correction code is acquired before shipment of the capsule endoscope in advance, and data of the error correction code is stored in the storage unit.
The other objects, features, and advantages of the present invention are specifically set forth in or will become apparent from the following detailed description of the invention when read in conjunction with the accompanying drawings.
Exemplary embodiments of the present invention will be explained in detail with reference to the accompanying drawings. However, the invention is not limited by the embodiments.
The general configuration of a capsule endoscope which is used in one embodiment of the present invention will now be explained with reference to
The capsule housing 14 includes a distal-end cover 120 which covers the imaging unit 111 and the illumination units 112a and 112b, and a capsule body 122 which is provided in a water-proof state with respect to the distal-end cover 120 via a seal member 121 and has the imaging unit 111 and the like disposed therein. A rear-end cover 123 may be provided separately from the capsule body 122 as needed. Although the rear-end cover 123 is provided integral with the capsule body 122 and has a flat shape in this embodiment, the shape is not restrictive and may be, for example, a dome shape.
The distal-end cover 120 may be configured to clearly distinguish an illumination window 120a, which transmits illumination light L from the illumination units 112a and 112b, from an imaging window 120b, which performs imaging in the illumination range. In this embodiment, the entire distal-end cover 120 is transparent and the areas of the illumination window 120a and the imaging window 120b partly overlap each other.
The imaging unit 111 is provided on an imaging board 124 and includes a solid-state imaging device 125 formed of, for example, a CCD, which performs imaging in the range that is illuminated with the illumination light L from the illumination units 112a and 112b, and an image forming lens 126 which includes a fixed lens 126a and a movable lens 126b and forms the image of a subject to the solid-state imaging device 125, and executes sharp image forming with a focus adjusting unit 128 including a fixed frame 128a which secures the fixed lens 126a and a movable frame 128b which holds the movable lens 126b.
The imaging unit 111 is not limited to the CCD but an imaging unit, such as a CMOS, may be used.
The illumination units 112a and 112b are provided on an illumination board 130 and each includes, for example, a light-emitting diode (LED). A plurality of illumination units 112a and 112b are laid out around the image forming lens 126 which constitutes the imaging unit 111. In this embodiment, a total of four illumination units are laid out around the image forming lens 126, above, below, right, and left of the image forming lens 126 respectively as one example.
The illumination units 112a and 112b are not limited to the LED but other illumination units may be used as well.
The power supply unit 113 is provided on a power supply board 132 provided with an internal switch 131, and uses, for example, a button type battery as a power supply 133. While a silver oxide cell, for example, is used as the battery in the power supply 133, it is not restrictive. For example, a chargeable battery, a dynamo type battery or the like may be used.
The internal switch 131 is provided to prevent unnecessary current from flowing from the power supply 133 before the capsule endoscope is used.
In this embodiment, a radio unit 142 for radio communication with outside is provided on a radio board 141 and communication with outside is carried out via the radio unit 142 as needed. The radio unit 142 has a transmitting unit 142a that amplifies a signal modulated by a modulator 211, and an antenna 142b, as shown in
A signal processing/control unit 143 that processes or controls the above individual units is provided on the imaging board 124 and executes various processing in the capsule endoscope 10. The signal processing/control unit 143 has an image processor 143a, a controller 143b, a driving unit 143c, and the modulator 211.
The image processor 143a has an image signal processing function of generating image data or the like consisting of, for example, correlation double sampling (generally including CDS), and a power supply controlling function of controlling power supply according to the ON/OFF state of the internal switch 131. The image processor 143a also has a parameter memory 208 which stores a parameter, such as a line frame, and a parameter, such as a white balance coefficient, and a multiplexer 209 that multiplexes the white balance coefficient and a video signal.
The controller 143b has a timing generator/sync generator 201 that generates various timing signals or a sync signal. The controller 143b controls the image processor 143a, the driving unit 143c, and the illumination units 112a and 112b based on the timing signals or the sync signal generated by the timing generator/sync generator 201. The illumination units 112a and 112b emit light at given timings in response to the timing signals or the sync signal from the controller 143b.
The driving unit 143c drives the CCD 125 based on the timing signals or the sync signal from the controller 143b.
The controller 143b performs control in such a way that the timing at which the CCD 125 is driven is synchronous with the timing at which the illumination units 112a and 112b emit light, and controls the number of shots taken by the CCD 125.
The modulator 211 has a modulation function of performing conversion to, for example, a PSK, MSK, GMSK, QMSK, ASK, AM, or FM system, and outputs a modulated signal to the transmitting unit 142a.
A capsule endoscope system according to the present embodiment is explained with reference to
A capsule endoscope system 1 according to the present embodiment includes the capsule endoscope 10 and its package 50, a jacket 3 which a patient or a subject 2 wears, a receiver 4 attachable to and detachable from the jacket 3, and a computer 5 as shown in
The jacket 3 is provided with antennas 31, 32, 33, and 34 that catch radio waves sent from the antenna 142b of the capsule endoscope 10 so as to ensure communication between the capsule endoscope 10 and the receiver 4 via the antennas 31, 32, 33, and 34. The number of antennas is not particularly limited to four but has only to be plural, so that radio waves according to positions of the capsule endoscope 10 moved can be received properly. The position of the capsule endoscope 10 in a celom can be detected according to the reception intensities of the individual antennas 31, 32, 33, and 34.
As shown in
The receiving unit 41 amplifies radio wave signals caught by the antennas 31 to 34, and outputs the signals to the demodulator 301.
The demodulator 301 demodulates the output of the receiving unit 41.
The image processor 300 includes a signal separator 302 that performs signal separation on the signals demodulated by the demodulator 301, and a parameter detector 304 that detects a parameter such as a white balance coefficient based on the result of signal separation. The image processor 300 performs white balancing on image data using the detected white balance coefficient.
The image compressor 306 compresses the image data undergone white balancing in the image processor 300.
The card interface 306a has a function of interfacing the input and output of image data between a CF memory card 44 as a large-capacity memory and the image compressor 306.
The CF memory card 44 is detachably mounted on the receiver 4 and stores image data compressed by the image compressor 306.
The receiver 4 is provided with a display unit (not shown) that displays information necessary for observation (examination) and an input unit (not shown) that inputs information necessary for observation (examination).
As shown in
With reference to
Then, the subject 2 swallows the capsule endoscope 10 with the internal switch 131 turned ON. Accordingly, the capsule endoscope 10 passes through the esophagus, moves inside the celom by peristalsis of the digestive tracts and takes images inside the celom one after another. The radio waves of the taken images are output via the radio unit 142 as needed or at any time for the imaging results, and are caught by the antennas 31, 32, 33, and 34 of the jacket 3. The signals of the caught radio waves are relayed to the receiver 4 from the antenna 31, 32, 33 or 34. At this time, the intensities of the received radio waves differ among the antennas 31, 32, 33, and 34 according to the position of the capsule endoscope 10.
In the receiver 4, white balancing is performed on taken image data which is received piece after piece, and the image data undergone white balancing is stored in the CF memory card 44. Data reception by the receiver 4 is not synchronous with the initiation of imaging by the capsule endoscope 10, and the start of reception and the end of reception are controlled by the manipulation of the input unit of the receiver 4.
When observation (examination) of the subject 2 by the capsule endoscope 10 is finished, the CF memory card 44 where the taken image data are stored is removed from the receiver 4 and is loaded into the memory card slot of the computer 5. The computer 5 reads the taken image data from the CF memory card 44 and stores the image data patient by patient.
With reference to
The image processor 143a has a CDS (Correlated Double Sampling) unit 203, an AMP unit 204, an A/D unit 205, the parameter memory 208, and the multiplexer 209.
The timing generator/sync generator 201 provides the CCD 125, at a given timing, with a pulse signal 202 for driving the CCD 125. The pulse (TG) signal 202 is a reference signal to the timing of the imaging system like the CCD 125.
According to the pulse signal 202, charges are read from the CCD 125 after signal conversion. The signals read from the CCD 125 are subjected to noise cancellation by correlated double sampling in the CDS unit 203, thereby generating image data. The image data is amplified by the AMP unit 204, is then subjected to AD conversion in the A/D unit 205, and is then sent to the multiplexer 209.
A white balance coefficient for correcting the white balance is stored in the parameter memory 208. Each capsule endoscope 10 is tested in the fabrication process to acquire a white balance coefficient unique to that capsule endoscope 10. (Acquisition method for the white balance coefficient will be explained later.) The white balance coefficient is written in the parameter memory 208 of each capsule endoscope 10, which is shipped with the unique white balance coefficient stored in the parameter memory 208 of the capsule endoscope 10.
In response to a timing signal 210 output from the timing generator/sync generator 201, the white balance coefficient is read out from the parameter memory 208. The timing (SG) signal 210 is a reference signal to the timing of the display system that constructs an image.
The read out white balance coefficient is superimposed (multiplexed) with the image signal output from the A/D unit 205 by the multiplexer 209, and is then modulated by the modulator 211. As shown in
Radio waves sent from the radio unit 142 of the capsule endoscope 10 are caught by the antennas 31 to 34. The radio signals are amplified by the receiving unit 41 and then demodulated by the demodulator 301. The signals demodulated by the demodulator 301 are subjected to signal separation in the signal separator 302. Image data is stored in the image memory 303 and the white balance coefficient is detected by the parameter detector 304.
The image signal processor 305 corrects the image data stored in the image memory 303 based on the parameter (white balance coefficient) detected by the parameter detector 304. That is, the image signal processor 305 takes the white balance of the image data based on the white balance coefficient detected by the parameter detector 304.
As apparent from the above, the parameter detected by the parameter detector 304 is a parameter stored in the parameter memory 208 and multiplexed with image data in the multiplexer 209.
The image signal processor 305 performs processing, such as contour enhancement, LPF, and gamma correction, in addition to the image processing for the white balance. The processing, such as contour enhancement, LPF, and gamma correction, unlike the white balancing process, are commonly executed in all the capsule endoscopes 10. Therefore, the parameter for the common processing need not be held in the parameter memory 208 of each capsule endoscope 10, but has only to be stored in the image signal processor 305 as common data to all the capsule endoscopes 10.
The image data corrected by the image signal processor 305 is compressed by the image compressor 306 and is then stored in the CF memory card 44.
As shown at step SA1, each capsule endoscope 10 images a white chart to be reference. Next, as shown at step SA2, the correction coefficient (white balance coefficient) is computed in such a way that R (Red) and B (Blue) outputs become specified values with G (Green) taken as a reference. Then, as shown at step SA3, the computed correction coefficient for R and B is recorded in the parameter memory 208.
As shown at step SA4, the correction coefficient recorded in the parameter memory 208 is verified. The verification is to read the correction coefficient from the parameter memory 208 and check if the read correction coefficient matches with the correction coefficient computed at step SA2.
If the verification result shows no problem (if both correction coefficients are identical), detection of the white balance coefficient is finished.
If the verification result shows some problem, it is determined whether the case with the problem (NG) has occurred a predetermined number of times (step SA5). As the case has not occurred a predetermined number of times (NO at SA5), the flow returns to step SA3.
When the occurrence of the case reaches a predetermined number of times at step SA5 (YES at SA5), the presence of an abnormality in the capsule endoscope 10 (particularly in the parameter memory 208) is displayed (step SA6). The capsule endoscope 10 determined as abnormal will not be shipped as it is.
As shown in
When receiving the horizontal ID data 406, the multiplexer 209 starts constructing a new transmission unit 405, has the horizontal ID data 406 and the white balance coefficient 402 for R as the components of the new transmission unit 405 in that order, and adds image data 407, input from the A/D unit 205 before the inputting of the horizontal ID data 406, as a component of the transmission unit 405 after the last component of the transmission unit 405.
The “image data 407, input from the A/D unit 205 before the inputting of the horizontal ID data 406” corresponds to one line of image data of the CCD 125 to whose horizontal shift register (not shown) charges of the CCD 125 are transferred in a horizontal retrace line period. In the transmission unit 405, the white balance coefficient 402 is added to a place corresponding to the time other than the effective imaging time in one line of the CCD 125.
When receiving next horizontal ID data 406, the multiplexer 209 starts constructing a new transmission unit 405, has the horizontal ID data 406 and the white balance coefficient 403 for B as the components of the new transmission unit 405 in that order, and adds image data 407, input from the A/D unit 205 before the inputting of the horizontal ID data 406, as a component of the transmission unit 405 after the last component of the transmission unit 405 (not shown).
As apparent from the above, each transmission unit 405 generated every time the horizontal sync signal 210 is generated is added with the white balance coefficient 402 or 403 alternately and is transmitted in that form to the receiver 4.
The horizontal sync signal 210 which indicates the head of the transmission unit 405 and the TG signal 202 which determines the timing for reading charges from the CCD 125 are generated by the timing generator/sync generator 201 synchronously in such a way that one line of image data 407 of the CCD 125 is sent to the multiplexer 209 at the read timing for the parameter 402 or 403 from the parameter memory 208.
In other words, the multiplexer 209 can detect the timing at which the horizontal ID data 406 is input from the parameter memory 208 as the break of the transmission unit 405, and puts image data which has been input from the A/D unit 205 up to the point of that detection as a component of the transmission unit 405 as one line of image data 407 of the CCD 125.
The multiplexed data shown in
When the receiver 4 receives data sent from the capsule endoscope 10 at step SB6 (YES at step SB11), image data and the white balance coefficient are separated and detected for each one line of image data of the CCD 125 (steps SB12 and SB13). When one line of image data is gathered, white balancing is executed using the white balance coefficient (steps SB14 and SB15). These operations are repeated until the operation of the receiver 4 is finished (step SB16).
Each transmission unit 405 includes the R or B correction coefficient 402 or 403 in the example above. Instead, each transmission unit 405 may consist of plural bits (for example, 8 bits) and contain one bit of the R or B correction coefficient 402 or 403. That is, each transmission unit 405 may be constructed in such a way that the R or B correction coefficient 402 or 403 is identified in plural bits (8 bits in this embodiment) over plural (8 in this embodiment) transmission units 405.
An example in which one transmission unit 405 of data to be transmitted from the capsule endoscope 10 corresponds to one line of image data of the CCD 125 is explained above. Instead of or in addition to the above example, data (frame) 400 which becomes one transmission unit when the data is transmitted from the capsule endoscope 10 can be so constructed as to correspond to one frame of image data of the CCD 125.
As shown in
When receiving the vertical ID data 401, the multiplexer 209 starts constructing a new transmission unit 400, has the vertical ID data 401, the white balance coefficient 402 for R and the white balance coefficient 403 for B as the components of the new transmission unit 400 in the order they are read from the parameter memory 208, and adds image data 404, output from the A/D unit 205 before the inputting of the vertical ID data 401, as a component of the transmission unit 400 after the last component of the transmission unit 400.
The “image data 404, output from the A/D unit 205 before the inputting of the vertical ID data 401” corresponds to one frame (the pixels of the CCD 125) of data of signal charges accumulated in the vertical shift register (not shown) of the CCD 125 in a vertical retrace line period. In the transmission unit 400, the white balance coefficients 402 and 403 are added to places corresponding to the time before the effective start line of the CCD 125.
The vertical sync signal 210 which indicates the head of the transmission unit 400 and the TG signal 202 which determines the timing for reading charges from the CCD 125 are generated by the timing generator/sync generator 201 synchronously in such a way that the image data 404 constituting one frame of the CCD 125 is sent to the multiplexer 209 from the A/D unit 205 at the timing at which the parameters 402 and 403 are read from the parameter memory 208.
In other words, the multiplexer 209 can detect the timing at which the vertical ID data 401 is input from the parameter memory 208 as the break of the transmission unit 400, and puts image data which has been input from the A/D unit 205 up to the point of that detection as a component of the transmission unit 400 as one frame of image data 404.
As apparent from the above, each transmission unit 400 generated every time the vertical sync signal 210 is generated is added with the white balance coefficients 402 and 403 and is transmitted in that form to the receiver 4.
Data about the white balance coefficients included in each transmission unit 400 is the R and B correction coefficients 402 and 403, whereas data about the white balance coefficients included in each transmission unit 405 is the R or B correction coefficient 402 or 403, or 1-bit data constituting the R or B correction coefficient 402 or 403. The reason why the amount of data about the white balance coefficients included in each transmission unit 405 is smaller than the amount of data about the white balance coefficients included in each transmission unit 400 is because the frequency of occurrence of the horizontal sync signal 210 is higher than the frequency of occurrence of the vertical sync signal 210. That is, even with a smaller amount of data about the white balance coefficients included in each transmission unit 405, each transmission unit 405 is generated at a relatively high frequency, so that the receiver 4 can acquire all the information about the white balance coefficients of the capsule endoscope 10 quickly based on each transmission unit 405.
As shown in
The white balance coefficient is however sent to the receiver 4 for each transmission unit 400, 405 in this embodiment to surely avoid the following. With the use of the method of sending the white balance coefficient to the receiver 4 only when the capsule endoscope 10 is activated, if the receiver 4 is not turned ON when the capsule endoscope 10 is activated, for example, the receiver 4 cannot receive the white balance coefficient followed by the display of an image which is not subjected to the white balancing process.
In the initialization, a detection number i is set equal to 0 in the parameter detector 304 (step SC1). When receiving data of the transmission unit 405 from the demodulator 301, the signal separator 302 of the receiver 4 detects the horizontal ID data 406 from the input data and detects the white balance coefficient 402 or 403 that comes immediately after the horizontal ID data 406. The signal separator 302 separates the horizontal ID data 406 and the white balance coefficient 402 or 403 from the image data 407, sends the image data 407 to the image memory 303, and sends the horizontal ID data 406 and the white balance coefficient 402 or 403 to the parameter detector 304.
The parameter detector 304 acquires the white balance coefficient 402 or 403 immediately following the horizontal ID data 406 and stores the acquired white balance coefficient 402 or 403 in a parameter memory area k(i) in the parameter detector 304 (step SC2). Then, the parameter detector 304 increments the detection number i by 1 (step SC3).
The steps SC2 and SC3 are repeated until the detection number i reaches a preset detection number n (NO at step SC4). The number n corresponds to the number of lines of the CCD 125. When the transmission unit 400 shown in
As the steps SC2 and SC3 are repeated until the detection number i reaches the detection number n and the white balance coefficient 402 or 403 is stored in n parameter memory areas k(n) in the parameter detector 304, the flow proceeds to step SC5 (YES at step SC4).
As apparent from step SC5, the parameter detector 304 uses data of the white balance coefficient 402 or 403 detected n times, whichever has a high frequency of occurrence, as a white balance coefficient RWB or BWB. This prevents the use of an erroneous white balance coefficient originated from a communication error.
As apparent from step SC6, the image signal processor 305 performs a white balancing process on the image data 407 based on the white balance coefficient RWB or BWB that has been used by the parameter detector 304 at step SC5. With regard to the R pixel, a value Rout obtained by multiplying input data Rin by the white balance coefficient RWB is the result of white balancing process. With regard to the B pixel, a value Bout obtained by multiplying input data Bin by the white balance coefficient BWB is the result of white balancing process.
The first embodiment demonstrates the following advantages.
Since the white balancing process need not be performed by the internal circuits of the capsule endoscope in this embodiment, the circuit scale of the internal circuits does not increase so that the power consumption does not increase. As the white balance coefficient has only to be stored in the parameter memory 208 in this embodiment, the circuit scale-of the internal circuits does not increase.
An example of a method in which a chart for white balance is imaged immediately after the capsule endoscope 10 is taken out of the package and is turned ON (before the capsule endoscope 10 is swallowed), an image of the imaged chart is transmitted to the receiver 4, and the receiver 4 acquires the white balance coefficient of the capsule endoscope 10 based on the received image of the chart will be explained. According to the method, when the receiver 4 cannot receive taken image data about the white balance coefficient when the chart is imaged (for example, when the receiver 4 has not been turned ON yet at that time), the image taken by the capsule endoscope 10 does not undergo the white balancing process if the subject 2 has swallowed the capsule endoscope 10 unnoticing the event, and the image taken by the capsule endoscope does not undergo the white balancing process.
According to this embodiment, by way of contrast, even when the receiver 4 cannot receive data sent from the capsule endoscope 10 before the capsule endoscope 10 is swallowed, the capsule endoscope 10 always sends data of the white balance coefficient RWB, BWB together with taken image data to the receiver 4 thereafter. Therefore even when the receiver 4 is turned ON even after the capsule endoscope 10 is swallowed, the taken image can undergo the white balancing process based; on the white balance coefficient RWB, BWB received later.
Modifications of the first embodiment will be explained below.
According to the first embodiment, the white balance coefficients RWB and BWB are stored in the parameter memory 208. In a first modification, an R image (Rdata) and a B image (Bdata) with a white chart taken in the fabrication process are stored directly in the parameter memory 208 instead. In this modification, the transmission unit 405, 400 is constructed in such a way that the R image (Rdata) and the B image (Bdata) are included at the place of the white balance coefficient 402 in
The receiver 4 has a constant Gr to be a reference for R and a constant Gb to be a reference for B, both of which are used in the white balancing process. The receiver 4 receives the R image (Rdata) or the B image (Bdata) and the image data 407 from the received transmission unit 405. The receiver 4 also receives the R image (Rdata) and the B image (Bdata) and the image data 404 from the received transmission unit 400.
In the white balancing process performed on the image data 407, 404 by the receiver 4, a value Rout which is obtained by multiplying data Rin of the image data 407, 404 by (Gr/Rdata) is the result of the white balancing process for the R pixel. Likewise, a value Bout which is obtained by multiplying data Bin of the image data 407, 404 by (Gb/Bdata) is the result of the white balancing process for the B pixel.
The constant Gr to be a reference for R and the constant Gb to be a reference for B can be changed for each location (hospital) where the capsule endoscope 10 is to be used. This can permit the result of the white balancing process to differ depending on the place of usage of the capsule endoscope 10. Even with the same usage place, the constant Gr and the constant Gb can be changed according to the portion of the organ that is imaged by the capsule endoscope 10. Accordingly, the original color of each organ or the color of the pathogenesis to be found in each organ can be reflected in changing the constant Gr and the constant Gb.
With reference to
The error correction code 408, 409 is stored together with the white balance coefficient RWB, BWB in the parameter memory 208 when the white balance coefficient RWB, BWB is stored therein in the fabrication process of the capsule endoscope 10. The configuration may be modified in such a way that only the white balance coefficient RWB, BWB is stored in the parameter memory 208 while the error correction code 408, 409 is computed in the capsule endoscope 10 based on the white balance coefficient RWB, BWB read from the parameter memory 208.
The receiver 4 can correct the R white balance coefficient 402 based on the error correction code 408 and can correct the B white balance coefficient 409 based on the error correction code 409.
Though not shown, an error correction code corresponding to the R white balance coefficient 402 can be added between the R white balance coefficient 402 in the transmission unit 405 in
According to the second modification, in the transmission unit 400, the error correction code 408, 409 is added, together with the white balance coefficient 402, 403, at a place corresponding to a time before the effective start line of the CCD 125. In the transmission unit 405, the error correction code is added, together with the white balance coefficient, at a place corresponding to a time other than the effective imaging time in one line of the CCD 125.
In the second modification, the correct white balance coefficients RWB and BWB can be acquired with a high accuracy even when a communication error occurs. Therefore, the correct white balance coefficients RWB and BWB can be acquired without any problem even when the value of n at step SC4 in
A second embodiment will be explained with reference to
According to the second embodiment, pixel defect address data indicating the address of a defective pixel is stored in the parameter memory 208 in addition to the white balance coefficient. Correction of a pixel defect is to correct a defective pixel present at the address of the defective pixel based on the pixel data that corresponds to the addresses around the address of the defective pixel.
The other configuration of the capsule endoscope 10 is the same as that of the first embodiment. The operation of the capsule endoscope 10 and the configuration and operation of the receiver 4 are basically the same as those of the first embodiment.
In the multiplexer 209, image data, the white balance coefficient, and the pixel defect address data are multiplexed and the resultant multiplexed data is sent out from the capsule endoscope 10 via the modulator 211 and the radio unit 142. In the receiver 4, the parameter detector 304 detects the white balance coefficient and the individual parameters of the pixel defect address data, and the image signal processor 305 performs the white balancing process on the image data based on the detected white balance coefficient and performs pixel defect correction based on the detected pixel defect address data. The image that has undergone the white balancing process and pixel defect correction is compressed by the image compressor 306 and the compressed image data is stored in the large-capacity memory 44.
A test is likewise conducted in the fabrication process for each capsule endoscope 10, as done for the white balance coefficient, to acquire the address of each defective pixel of that capsule endoscope 10. The pixel defect address data is written in the parameter memory 208 of each capsule endoscope 10, which is shipped with each pixel defect address data stored in the parameter memory 208 of the capsule endoscope 10.
Next, as shown at step SD6, the pixel defect address data recorded in the parameter memory 208 is verified. The verification is to read pixel defect address data from the parameter memory 208 and check if the read pixel defect address data matches with the address data of the defective pixel detected at step SD3 or SD5.
If the verification result shows no problem (if both addresses are identical), detection of the pixel defect address data is finished.
If the verification result shows some problem, it is determined whether the case with the problem (NG) has occurred a predetermined number of times (step SD7). As the case has not occurred the predetermined number of times (NO at SD7), the flow returns to step SD1.
When the occurrence of the case reaches the predetermined number of times as a result of step SD7 (YES at SD7), the presence of an abnormality in the capsule endoscope 10 (particularly in the parameter memory 208) is displayed (step SD8). The capsule endoscope 10 that has been determined as abnormal will not be shipped as it is.
The transmission unit 400′ contains pixel defect address data 410 in addition to the vertical ID data 401, the RWB correction coefficient 402, the BWB correction coefficient 403, and the image data 404.
Though not shown, pixel defect address data can be added between the R white balance coefficient 402 and the image data 407 in the transmission unit 405 in
In the second embodiment, in the transmission unit 400, pixel defect address data is added, together with the white balance coefficient 402, 403, at a place corresponding to a time before the effective start line of the CCD 125. In the transmission unit 405, pixel defect address data is added, together with the white balance coefficient, at a place corresponding to a time other than the effective imaging time in one line of the CCD 125.
According to the second embodiment, pixel defect correction of the CCD 125 can be executed.
Either the first modification or the second modification in the first embodiment or both can be adapted to the second embodiment.
Data for correcting a defect originating from a variation in the CCD 125 can be stored in the parameter memory 208. The white balance coefficient and pixel defect address data are one example of such data.
A third embodiment will be explained next.
Although the first embodiment explains the example where the CCD 125 is used in the capsule endoscope 10, a CMOS image sensor is used instead of the CCD 125 in the third embodiment. The offset value of the photoelectric conversion characteristic which is specific to each CMOS image sensor is stored in the parameter memory 208 of each capsule endoscope 10 of the third embodiment. The other configuration and operation of the capsule endoscope 10 and the structure and operation of the receiver 4 are basically the same as those of the first embodiment.
In the multiplexer 209, image data and the offset value of the photoelectric conversion characteristic are multiplexed and resultant multiplexed data is sent out from the capsule endoscope 10 via the modulator 211 and the radio unit 142. In the receiver 4, the parameter detector 304 detects the parameter of the offset value of the photoelectric conversion characteristic, and the image signal processor 305 corrects the photoelectric conversion characteristic with respect to the image data based on the detected offset value of the photoelectric conversion characteristic. The image whose photoelectric conversion characteristic has been corrected is compressed by the image compressor 306 and the compressed image data is stored in the large-capacity memory 44.
A test is conducted in the fabrication process for each capsule endoscope 10, as done for the white balance coefficient in the first embodiment, to acquire the offset value of the photoelectric conversion characteristic of that capsule endoscope 10. The offset value of the photoelectric conversion characteristic is written in the parameter memory 208 of each capsule endoscope 10, which is shipped with the offset value of each photoelectric conversion characteristic stored in the parameter memory 208 of the capsule endoscope 10.
According to the third embodiment, it is possible to correct the photoelectric conversion characteristic when an imaging device is used as the solid-state imaging device of the capsule endoscope 10.
Although added information such as the white balance coefficient 402, 403, the error correction code 408, 409, the pixel defect address data 410, or the offset value of the photoelectric conversion characteristic is added in front of the image data 404 before being sent out in any one of the first to the third embodiments, it is preferable to add the added information on the rear end side of the image data 404, and, it is more preferable to add the added information at the rear end of the image data 404.
A fourth embodiment will be explained next.
In the first embodiment, digital transmission is performed, whereas it is analog transmission in the fourth embodiment. Like elements explained in the first embodiment are designated by like reference signs and the explanations therefor are omitted.
As shown in
As shown in
For analog transmission, as apparent from the above, the sync signal SG1 output from the timing generator/sync generator 201 is superimposed directly with the image data by the multiplexer 209′ to thereby identify the break between images from a plurality of images contained in the image data.
As shown in
As shown in
In
The reason for the amount of data about the white balance coefficients which is to be superimposed on the horizontal sync signal 602 being smaller than the amount of data about the white balance coefficients to be superimposed on the vertical sync signal 603 is because the frequency of occurrence of the horizontal sync signal 602 is higher than the frequency of occurrence of the vertical sync signal 603 as mentioned above.
In
When the white balance coefficient to be superimposed on one horizontal sync signal 602 can not be read out in the receiver 4, the accurate white balance coefficient RWB or BWB cannot be acquired. In
As shown in
The clamp circuit 701 clamps an output signal from the demodulator 301 and detects the reference level 600 to separate the sync signal (horizontal sync signal 602 and vertical sync signal 603) SG1 and the video signal 601.
The sync-signal separator 702 separates the sync signal SG1 and outputs the video signal 601 to the. A/D converter 307. The sync signal SG1 is sent to the vertical-sync detector 703 and the horizontal-sync detector 704. The vertical-sync detector 703 detects the vertical sync signal 603, while the horizontal-sync detector 704 detects the horizontal sync signal 602. The detection result from each of the vertical-sync detector 703 and the horizontal-sync detector 704 is sent to the line-number detector 705.
It is known beforehand in the line-number detector 705 that the R white balance coefficient RWB is included at a point a predetermined clock after the horizontal sync signal 602 in the second line from the vertical sync signal 603 and the B white balance coefficient BWB is included at a point a predetermined clock after the horizontal sync signal 602 in the third line in the example in
The line-number detector 705 sends the parameter detector 304 a sampling phase output instructing a point a predetermined clock after the horizontal sync signal 602 in the second line from the vertical sync signal 603 and a point a predetermined clock after the horizontal sync signal 602 in the third line. The parameter detector 304 can acquire the white balance coefficients RWB and BWB from the sync signal SG1 based on the sampling phase output.
Modifications of the fourth embodiment will be explained with reference to
Although the white balance coefficients RWB and BWB are added in front of a series of video signals 601 or in a dispersed manner before being sent out in the fourth embodiment, it is preferable that the white balance coefficients RWB and BWB are added on the rear end of a series of video signals 601. It is more preferable that the white balance coefficients RWB and BWB are added at the rear end of a series of video signals 601.
A fifth embodiment will be explained with reference to
In the fifth embodiment, like elements explained in the first embodiment are designated by like reference signs and the explanations therefor are omitted. An example in which the capsule endoscope 10 performs analog transmission will be explained.
In the fifth embodiment, unlike the first embodiment, the white balance coefficient stored in the parameter memory 208 is modulated alone and transmitted without being multiplexed with an image signal, or an image signal is modulated alone and transmitted. The receiver 4 demodulates two modulated signals to acquire the white balance coefficient and an image signal.
As shown in
The modulator 211a modulates the white balance coefficient stored in the parameter memory 208 at a carrier frequency f1. The modulator 211 b modulates an image signal at a carrier frequency f2. The transmitting unit 142a amplifies the modulated signal of the white balance coefficient output from the modulator 211a and amplifies the modulated signal of the image signal output from the modulator 211b. The common antenna 142b transmits the modulated signals of different carrier frequencies f1 and f2, amplified by the transmitting unit 142a.
As shown in
The demodulator 301a demodulates the modulated signal of the carrier frequency f1 and sends the demodulated signal to the parameter detector 304. The parameter detector 304 detects the white balance coefficient based on the input signal.
The demodulator 301b demodulates the modulated signal of the carrier frequency f2 and sends the demodulated signal to the image processor 300. The signal separator 302 in the image processor 300 separates an image signal and a sync signal. By using the sync signal, the image processor 300 accesses the parameter detector 304 to acquire the white balance coefficient from the parameter detector 304. The image processor 300 performs the white balancing process on the image signal using the white balance coefficient.
Although an example of analog transmission is explained above, the fifth embodiment is feasible for digital transmission. In this instance, the operation of the capsule endoscope 10 and the operations of the components of the receiver 4 up to the demodulators 301a and 301b are the same in digital transmission. Since the image processor 300 of the receiver 4 in digital transmission need not separate an image signal and a sync signal, the signal separator 302 is unnecessary and the white balancing process should be performed on the image signal by using the white balance coefficient detected by the parameter detector 304.
The method of transmitting the white balance coefficient stored in the parameter memory 208 and an image signal separately without being multiplexed and demodulating the white balance coefficient and the image signal separately in the receiver 4 as done in the fifth embodiment can bring about advantages similar to those of the first embodiment.
The capsule endoscope according to the present invention has low power consumption in signal processing which is specific to an imaging device.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2003-180138 | Jun 2003 | JP | national |
