Patent Application
20230371785
The present disclosure relates to a medical endoscope device and a medical observation system.
In recent years, medical endoscope devices that enable observation targets such as affected areas to be enlarged and observed for performing endoscopic surgery have been used in medical sites. In this situation, technologies related to endoscope devices that wirelessly transmit images captured by imaging devices have been developed. As such a technology, for example, there is a technology disclosed in JP 2010-509990T.
An operator, or the like who uses a medical endoscope device, for example, performs medical practice while viewing a display screen on which a medical captured image captured by the medical endoscope device is displayed. Thus, when a situation in which image data indicating the medical captured image is compression-encoded and the compression-encoded image data is transmitted in wireless communication is assumed, transmitting the image data with low latency is advantageous.
The present disclosure proposes a novel and improved medical endoscope device and medical observation system that enable image data indicating a compression-encoded medical captured image to be transmitted with low latency. According to an embodiment of the present disclosure, there is provided a medical endoscope device including: an encoding processing unit configured to compression-encode RAW image data of a medical captured image of an observation target captured by an imaging device that is inserted into a body of a patient and captures an image of an inside of the body; and a transmission unit configured to wirelessly transmit the compression-encoded RAW image data.
In addition, according to an embodiment of the present disclosure, there is provided a medical reception device including: a reception unit configured to wirelessly receive compression-encoded RAW image data obtained by compression-encoding RAW image data of a medical captured image of an observation target captured by an imaging device that is inserted into a body of a patient and captures an image of an inside of the body; and a signal processing unit configured to process the received compression-encoded RAW image data.
In addition, according to an embodiment of the present disclosure, there is provided a medical observation system including: a medical endoscope device including an encoding processing unit configured to compression-encode RAW image data of a medical captured image of an observation target captured by an imaging device that is inserted into a body of a patient and captures an image of an inside of the body, and a transmission unit configured to wirelessly transmit the compression-encoded RAW image data; and a medical reception device including a reception unit configured to wirelessly receive the compression-encoded RAW image data, and a signal processing unit configured to process the received compression-encoded RAW image data.
According to an embodiment of the present disclosure, it is possible to transmit image data indicating a compression-encoded medical captured image with low latency.
Note that the effects described above are not necessarily limitative. With or in the place of the above effects, there may be achieved any one of the effects described in this specification or other effects that may be grasped from this specification.
Hereinafter, (a) preferred embodiment(s) of the present disclosure will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
In addition, description will be provided in the following order below.
Note that the medical observation system according to the present embodiment is not limited to the example illustrated in
The medical observation system according to the present embodiment may further have, for example, a control device (not illustrated) that controls various operations of the medical endoscope device 100. As the control device (not illustrated), for example, an arbitrary apparatus that can perform a process of a transmission method according to the present embodiment such as a “medical controller,” or a “computer such as a server” is exemplified. In addition, the control device (not illustrated) may be, for example, an integrated circuit (IC) that can be incorporated into the above-described apparatus.
In addition, the medical observation system according to the present embodiment may have a plurality of “medical endoscope devices 100 and medical reception devices 200” and display devices 300. In the case in which a plurality of “medical endoscope devices 100 and medical reception devices 200” are included, each of the “medical endoscope devices 100 and medical reception devices 200” performs transmission using a transmission method which will be described below. In addition, in a case in which the medical observation system according to the present embodiment has a plurality of “medical endoscope devices 100 and medical reception devices 200” and display devices 300, the “medical endoscope devices 100 and medical reception devices 200” and the display devices 300 may be associated with each other one to one, or a plurality of “medical endoscope devices 100 and medical reception devices 200” may be associated with one display device 300. In the case in which a plurality of “medical endoscope devices 100 and medical reception devices 200” are associated with one display device 300, the display device 300 can switch the medical endoscope device 100 that has captured an image to be displayed on a display screen by performing, for example, a switching operation or the like.
In addition, the medical observation system according to the present embodiment may have a plurality of medical endoscope devices 100 associated with one medical reception device 200. In the case in which a plurality of medical endoscope devices 100 are associated with one medical reception device 200, the medical reception device 200 may switch the medical endoscope device 100 to perform wireless transmission therewith by performing, for example, a switching operation or the like.
In addition, the medical observation system according to the present embodiment may not have the display device 300. Even in the case in which the medical observation system according to the present embodiment does not have the display device 300, the medical observation system according to the present embodiment can transmit image data indicating a compression-encoded medical captured image with low latency using a transmission method according to the present embodiment which will be described below.
The display device 300 is a display section of the medical observation system 1000, and corresponds to an external display device with respect to each of the medical endoscope device 100 and the medical reception device 200. The display device 300 displays various images, for example, medical captured images (moving images or a plurality of still images; the same applies below) captured by the medical endoscope device 100, images relating to a user interface, and the like. In addition, the display device 300 may be capable of performing 3D display. Display by the display device 300 is controlled by, for example, the medical endoscope device 100, the medical reception device 200, or the control device (not illustrated).
The display device 300 of the medical observation system 1000 is installed in an arbitrary place at which the display device can be visually recognized by a person relating to surgery such as an operator within an operating room, for example, a wall surface, a ceiling, a floor of the operating room. As the display device 300, for example, a liquid crystal display, an organic electro-luminescence (EL) display, a cathode ray tube (CRT) display, or the like is exemplified.
Note that the display device 300 is not limited to the above-described example.
The display device 300 may be an arbitrary wearable device worn on the body of an operator or the like for use, for example, a head-mounted display, an eyewear-type device, or the like.
The display device 300 is driven by, for example, power supplied from an internal power supply included in the display device 300 such as a battery, power supplied from a connected external power supply, or the like.
The medical endoscope device 100 is a medical apparatus to be used in endoscopic surgery. The medical endoscope device 100 has the function of an endoscope and at least a function of transmitting signals wirelessly. In addition, the medical reception device 200 has at least a function of receiving signals transmitted from the medical endoscope device 100 wirelessly.
In a case in which the medical endoscope device 100 is used during surgery, an operator (an example of a user of the medical endoscope device 100) observes an operative site while referring to a medical captured image captured by the medical endoscope device 100 and being displayed on the display screen of the display device 300, and performs various treatments such as a procedure appropriate for the surgery type on the operative site.
The medical endoscope device 100 includes, for example, an insertion member 102, and a camera head 104. The medical endoscope device 100 is driven by, for example, power supplied from an internal power supply included in the medical endoscope device 100 such as a battery, power supplied from a connected external power supply, or the like.
The insertion member 102 has an elongated shape and includes an optical system that collects incident light. In addition, in a case in which the medical endoscope device 100 has a function of capturing stereoscopic images (medical captured images for the right eye and medical captured images for the left eye), for example, the insertion member 102 may include an optical system for capturing medical captured images for the right eye and an optical system for capturing medical captured images for the left eye.
The tip of the insertion member 102 is inserted into, for example, a body cavity of a patient. The rear end of the insertion member 102 is detachably connected to the tip of the camera head 104. In addition, the insertion member 102 receives supply of light from, for example, a light source provided in the camera head 104 or an external light source. In the case in which light is supplied from an external light source, the insertion member 102 is connected to the external light source via a light guide and receives supply of light from the external light source via the light guide.
The insertion member 102 may have, for example, a material having no flexibility or of a material having flexibility. The medical endoscope device 100 can be called a rigid endoscope or a flexible endoscope depending on a material forming the insertion member 102.
Light supplied to the insertion member 102 is injected from the tip of the insertion member 102 and radiated to an observation target such as a tissue in a body cavity of a patient. In addition, light reflected from the observation target is collected by the optical system inside the insertion member 102.
The camera head 104 includes, for example, an image sensor and has a function of capturing observation targets. The insertion member 102 and the camera head 104 of the medical endoscope device 100 play a role of, for example, an “imaging device that is inserted into the body of a patient and captures an image of the inside of the body.”
In addition, the camera head 104 includes, for example, an encoding processing circuit and has a function of performing the processes of the transmission methods which will be described below.
In addition, the camera head 104 includes, for example, a transmitter and has at least a function of transmitting signals wirelessly. Note that the transmitter may be an external transmitter connected to the camera head 104.
A configuration example of the camera head 104 will be described below.
The medical endoscope device 100 has the function of an endoscope and at least the function of transmitting signals wirelessly since it includes, for example, the camera head 104 and the transmitter.
The medical reception device 200 includes, for example, a receiver and is a device having at least a function of receiving signals transmitted from the medical endoscope device 100 wirelessly.
In addition, the medical reception device 200 includes, for example, a signal processing circuit and has a function of processing signals received by the receiver. In one example of signal processing of the signal processing circuit, the signal processing circuit performs, for example, a decoding process of decoding compression-encoded image data. In addition, the signal processing circuit may perform various kinds of processing that can be performed on medical captured images, for example, a demosaic process for adjusting RAW image data (e.g., arbitrary processing for adjusting color, brightness, and the like based on RAW image data; the same applies below), enlargement or reduction of images relating to an electronic zoom function, inter-pixel correction, and the like.
In addition, the medical reception device 200 may include, for example, a communication device and have a function of controlling display of the display device 300. For example, the medical reception device 200 transmits image data processed by the signal processing circuit and a display control signal to the display device 300 through the communication device (not illustrated) and thereby controls display of the display device 300.
As the communication device included in the medical reception device 200, for example, an IEEE 802.15.1 port and a transmission/reception circuit (wireless communication), an IEEE 802.11 port and a transmission/reception circuit (wireless communication), a communication antenna and a radio frequency (RF) circuit (wireless communication), an optical communication device (wired communication or wireless communication), a local area network (LAN) terminal and a transmission/reception circuit (wired communication), or the like are exemplified. The communication device may be capable of communicating with one or two or more external devices using a plurality of communication methods.
Note that functions of the medical reception device 200 are not limited to the above-described examples. The medical reception device 200 can have various functions, for example, a function of recording a medical captured image based on image data processed by the signal processing circuit in an arbitrary recording medium, and the like.
An example of a configuration of the medical reception device 200 will be described below.
In medical endoscope devices of recent years, amounts of image data indicating medical captured images have tended to increase resulting from, for example, high resolution of imaging devices, high frame rates, stereoscopy, mounting of additional devices for observing special light incident on the imaging devices, and the like. Image data indicating a medical captured image may be simply referred to as “image data” below.
When amounts of image data increases as described above, power consumption of the medical endoscope device increases accordingly. In addition, since an amount of heat generation increases due to the increase of power consumption, the sizes of members (e.g., the size of the camera head constituting the endoscope device) constituting the medical observation device should be increased in order to deal with heat. Therefore, an increase in amounts of image data is disadvantageous for miniaturizing the medical endoscope device.
Here, as a first method of reducing amounts of image data, compression-encoding of the image data is conceivable.
In the case in which image data indicating a medical captured image is not compression-encoded, for example, the image data is transmitted from the transmitter to the receiver on a 4-lane communication path T as illustrated in
On the other hand, in a case in which image data indicating a medical captured image is compression-encoded at a compression ratio of 1/4, the compression-encoded image data is transmitted from the transmitter to the receiver on one lane of the communication path T, for example, as illustrated in
By compression-encoding the image data as illustrated in
In addition, as a second method of reducing amounts of image data, transmitting RAW image data of a medical captured image captured by an imaging device is conceivable. RAW image data according to the present embodiment is, for example, image data that has yet to undergo a demosaic process.
Here, as advantages of transmitting RAW image data, for example, advantages described in (A) and (B) below are exemplified.
A transmission amount can be reduced in a case in which RAW image data is transmitted more than in a case in which demosaic-processed image data is transmitted as will be shown in the following example. In addition, since an amount of RAW image data is smaller than when it has undergone a general demosaic process (YCbCr=4:2:2), a load of compression and transmission becomes smaller, and as a result, transmission with low latency occurs.
That is, when RAW data (in a Bayer array) is compared with general demosaic-processed data (with YCbCr=4:2:2), the RAW data (of the Bayer array) can have about half (about 0.5 times) the transmission rate thereof. Thus, when it is assumed that RAW image data (in a Bayer array) and general demosaic-processed image data (with YCbCr=4:2:2) are compressed and transmitted under a similar condition, the RAW image data (in Bayer array) can realize a lower transmission rate with higher image quality or higher quality.
Here, by realizing a lower transmission rate with higher image quality, for example, transmission with high image quality is possible even with devices of low transmission rates. In addition, by realizing a lower transmission rate with high quality, for example, the marginal portion of transmission can be redirected to stable wireless transmission (robust optimization).
RAW image data is image data of which information of light at the time of imaging is retained inside the imaging device as it is without adjustment, that is, pre-processed image data that has not undergone a demosaic process or the like. Thus, by transmitting RAW image data, a device on the reception side can perform adjustment of hue, brightness, and the like without degrading the image quality, and can adjust exposure and white balance later. In addition, the device on the reception side can perform an arbitrary demosaic process and processing on the RAW image data.
Thus, in the medical observation system 1000, the medical endoscope device 100 compression-encodes RAW image data indicating a medical captured image and wirelessly transmits the compression-encoded RAW image data. That is, in the medical observation system 1000, the medical endoscope device 100 performs compression-encoding on RAW image data without performing the demosaic process. In the medical observation system 1000, the demosaic process is performed by the medical reception device 200 as will be described below. RAW image data indicating a medical captured image is sometimes referred to simply as “RAW image data” below.
When compression-encoded RAW image data is transmitted wirelessly, both the effect exhibited by using the first method of reducing an amount of the image data and the effect exhibited by using the second method of reducing an amount of the image data are exhibited.
Thus, the medical observation system 1000 realizes transmission of compression-encoded image data indicating a medical captured image with lower latency.
Here, when compression-encoding RAW image data indicating a medical captured image and then transmitting the compression-encoded RAW image data in wireless communication is assumed, it may be necessary to further reduce the influence of an error caused by the compression-encoding.
Therefore, next, an example of a compression-encoding method according to the present embodiment to be applied to the medical endoscope device 100 will be described. Note that it is a matter of course that a compression-encoding method to be applied to the medical endoscope device 100 is not limited to the following example.
In the case in which the entire medical captured image is compression-encoded as illustrated in, for example,
Thus, the medical endoscope device 100 compression-encodes the RAW image data indicating a medical captured image by each predetermined unit that is smaller than the medical captured image.
As the predetermined unit according to the present embodiment, for example, the unit of a plurality of lines of the medical captured image, such as every 16 lines, is exemplified. Here, the predetermined unit may be a preset fixed unit or a variable unit that can be changed on the basis of an operation of a user using the medical observation system 1000, an operation state of a predetermined medical apparatus, or the like.
Note that the predetermined unit according to the present embodiment is not limited to a unit of a plurality of lines of a medical captured image. The predetermined unit according to the present embodiment may be, for example, a block unit that includes a plurality of pixels and is smaller than the entire medical captured image. Hereinbelow, a case in which the predetermined unit according to the present embodiment is a unit of a plurality of lines of a medical captured image will be exemplified. In addition, hereinbelow, the predetermined unit defined as a unit of a plurality of lines of a medical captured image may be indicated as a “slice unit.”
In a case in which a medical captured image is compression-encoded by a slice unit (an example of a predetermined unit), for example, as illustrated in
Therefore, the medical endoscope device 100 can reduce the amount of the RAW image data while further reducing the influence of the error caused by the compression-encoding by compression-encoding the RAW image data using the compression-encoding method according to the present embodiment.
In addition, in a case in which the medical captured image is compression-encoded by a smaller predetermined unit, for example, like the slice unit as illustrated in
Next, examples of configurations of the medical endoscope device and the medical reception device according to the present embodiment to which the above-described transmission methods according to the present embodiment can be applied will be described. Note that examples of configurations of the medical endoscope device and the medical reception device according to the present embodiment are not limited to the following examples. For example, each of the medical endoscope device and the medical reception device according to the present embodiment may also employ a configuration obtained by combining the following examples.
The camera head 104 included in the medical endoscope device 100 includes, for example, a sensor 110, an encoding processing circuit 112, a transmitter 114, a battery 116, and a light source 118.
In addition, the camera head 104 may further include, for example, a recording medium (not illustrated) on which data to be used by the encoding processing circuit 112 in processing is recorded. As the recording medium (not illustrated), for example, a flash memory, a read only memory (ROM), or the like is exemplified. Note that the recording medium (not illustrated) may be included in another constituent element included in the camera head 104, such as the encoding processing circuit 112. In addition, the recording medium (not illustrated) may be an external recording medium of the medical endoscope device 100.
Each of the sensor 110, the encoding processing circuit 112, the transmitter 114, and the light source 118 is electrically connected to the battery 116 (an example of an internal power supply) and operates with power supplied from the battery 116. As the battery 116, for example, a secondary battery such as a lithium-ion secondary battery or the like is exemplified.
The sensor 110 images an observation target by photoelectrically converting light reflected from the observation target collected by the insertion member 102 and transfers RAW image data obtained from the imaging (RAW image data indicating a medical captured image) to the encoding processing circuit 112. As the sensor 110, for example, an image sensor in which a plurality of image sensor elements such as complementary metal oxide semiconductors (CMOSs) or charge coupled devices (CCDs) are used is exemplified.
In addition, for example, in a case in which the insertion member 102 includes two optical systems (an optical system for capturing medical captured images for the right eye and an optical system for capturing medical captured images for the left eye), the sensor 110 transfers first RAW image data of a medical captured image for the right eye and second RAW image data of a medical captured image for the left eye to the encoding processing circuit 112.
The encoding processing circuit 112 is a circuit functioning as an encoding processing unit of the medical endoscope device 100 and compression-encodes RAW image data. The encoding processing circuit 112 performs, for example, a process of the compression-encoding method according to the present embodiment and compression-encodes RAW image data by each predetermined unit that is smaller than a medical captured image.
Note that a process of the encoding processing circuit 112 is not limited to the above example. The encoding processing circuit 112 may perform, for example, a process of a first example introduced in (1) and a process of a fifth example introduced in (5) below.
The encoding processing circuit 112 compression-encodes RAW image data at a plurality of different compression ratios. Since the encoding processing circuit 112 compression-encodes RAW image data at a plurality of different compression ratios, the medical endoscope device 100 obtains a plurality of pieces of RAW image data compressed at different compression ratios.
The encoding processing circuit 112 performs compression-encoding at a compression ratio corresponding to a state of electronic zoom of the imaging device.
Electronic zoom of the medical endoscope device 100 is a zoom method of changing a zoom magnification by performing image processing on a medical captured image, for example, without moving a lens included in the optical system of the insertion member 102. Image processing on medical captured images for electronic zoom, such as enlarging an image by appropriately performing various processes like an interpolation process, is performed by a reception side device, for example, the medical reception device 200, or the like.
In a case in which electronic zoom is performed, there is no need to physically move a zoom lens included in the optical system, unlike in a case in which optical zoom is performed, zoom magnifications are changed through image processing, and thus zoom magnifications are discontinuously changed. Thus, in the case in which electronic zoom is performed, there is an advantage that zoom can be discontinuously changed to a desired zoom magnification within a shorter time than in the case in which optical zoom is performed.
In the case in which electronic zoom is performed, the encoding processing circuit 112 cuts out a partial region of a medical captured image and then compression-encodes RAW image data corresponding to the cut-out region at a compression ratio corresponding to the state of electronic zoom.
A compression ratio corresponding to the state of electronic zoom is determined on the basis of, for example, one or both a size of the cut-out region and a magnification of the electronic zoom.
A size of the cut-out region and a magnification of the electronic zoom are acquired from an external device, for example, the medical reception device 200, an external operation device such as a remote controller, or the like. Data indicating a size of the cut-out region and data indicating a magnification of the electronic zoom can be received using, for example, a reception function of the transmitter 114, which will be described below. That is, the transmitter 114 can function also as a receiver for the camera head 104. Note that it is a matter of course that the camera head 104 may further include a receiver that can receive signals transmitted from the outside.
To exemplify a case in which a compression ratio is determined on the basis of a size of the cut-out region and a magnification of the electronic zoom, the encoding processing circuit 112 determines a compression ratio by referring to, for example, a “table (or database) in which sizes of cut-out regions, magnifications of electronic zoom, and compression ratios are associated with each other” which is stored in a recording medium (not illustrated). Note that the encoding processing circuit 112 may determine a compression ratio corresponding to one or both of a size of the cut-out region and a magnification of the electronic zoom by performing, for example, an arithmetic operation of an arbitrary algorithm with which a compression ratio can be determined in accordance with one or both of the size of the cut-out region and the magnification of the electronic zoom.
To give a specific example, the encoding processing circuit 112 compression-encodes RAW image data at a compression ratio of 1/4 since the data amount becomes 1/4 when the magnification of electronic zoom is two times. In addition, it is also possible for the encoding processing circuit 112 not to compression-encode RAW image data in accordance with a size of the cut-out region or a combination of a size of the cut-out region and a magnification of the electronic zoom.
In a case in which first RAW image data of a medical captured image for the right eye and second RAW image data of the medical captured image for the left eye are transferred from the sensor 110, the encoding processing circuit 112 compression-encodes each of the first RAW image data and the second RAW image data.
When a place in which the medical observation system 1000 is used, such as the field of surgery, is assumed, for example, wireless transmission states are likely to be affected by the following factors:
Thus, the encoding processing circuit 112 can change a way of compression-encoding of RAW image data on the basis of a wireless transmission state.
The following, for example, are examples of changing a way of compression-encoding by the encoding processing circuit 112. Note that it is a matter of course that examples of changing a way of compression-encoding by the encoding processing circuit 112 are not limited to the following examples.
The encoding processing circuit 112 specifies a way of compression-encoding in accordance with a wireless transmission state by referring to, for example, a “table (or database) in which wireless transmission states are associated with data indicating a way of compression-encoding” stored in a recording medium (not illustrated). In addition, the encoding processing circuit 112 may specify a way of compression-encoding in accordance with a wireless transmission state by performing, for example, an arithmetic operation of an arbitrary algorithm with which a way of compression-encoding can be determined in accordance with a wireless transmission state.
Then, the encoding processing circuit 112 compression-encodes RAW image data in the specified way of compression-encoding in accordance with the wireless transmission state.
By changing a way of compression-encoding in accordance with a wireless transmission state as described above, for example, switching to a way with stronger error resistance is realized while taking a transmission environment into account.
The encoding processing circuit 112 specifies a wireless transmission state, for example, on the basis of a result of bidirectional communication with the medical reception device 200 and thus changes a way of compression-encoding of RAW image data. Bidirectional communication with the medical reception device 200 is realized by, for example, the transmitter 114, which will be described below, having the reception function. Note that it is a matter of course that the camera head 104 may further include a receiver that can receive signals transmitted from the outside as described above.
To give a specific example, the encoding processing circuit 112 acquires a transmission amount (transmission speed) using a wireless transmission protocol (e.g., a transmission of a ping command, a response to a ping command, and the like) and specifies a transmission state corresponding to the transmission amount. Then, the encoding processing circuit 112 compression-encodes RAW image data in a way of compression-encoding in accordance with the specified wireless transmission state. A transmission state corresponding to the transmission amount is determined by referring to, for example, a “table (or database) in which transmission amounts are associated with compression ratios” stored in a recording medium (not illustrated). Note that the encoding processing circuit 112 may specify a transmission state corresponding to the transmission amount by performing, for example, an arithmetic operation of an arbitrary algorithm with which a transmission state can be determined in accordance with the transmission amount.
Note that a specification method for a wireless transmission state is not limited to the above-described example.
For example, the encoding processing circuit 112 can also specify a transmission state on the basis of the comparison result of a set reference value and an actual transmission value of the transmitter 114 and thus change a way of compression-encoding of RAW image data.
To give a specific example, when a reference value is set to a value a [bps] indicating a transmission speed and an actual transmission value is set to b [bps], the encoding processing circuit 112 obtains a transmission rate by performing an arithmetic operation using, for example, the following formula 1.
Transmission rate [%]=(b/a)×100 Formula 1
Then, the encoding processing circuit 112 changes a way of compression-encoding of RAW image data using the obtained transmission rate.
To give a specific example, in a case in which a=400 [Mbps] and b=100 [Mbps], the encoding processing circuit 112 obtains the transmission rate=25[%] through the above formula 1. Here, the transmission rate 25[%] means that the transmission speed is only a quarter of the expected value. Thus, the encoding processing circuit 112 can change a way of compression-encoding of RAW image data by setting, for example, the compression ratio to quadruple or the like.
The encoding processing circuit 112 may perform two or more processes to be combined among the process of the first example introduced in (1) to the process of the fourth example introduced in (4) above.
The transmitter 114 is a circuit that functions as a transmission unit in the medical endoscope device 100 and wirelessly transmits compression-encoded RAW image data transferred from the encoding processing circuit 112.
As the transmitter 114, a communication device compatible with wireless communication in an arbitrary communication method, for example, an IEEE 802.15.1 port and a transmission/reception circuit, an IEEE 802.11 port and a transmission/reception circuit, a communication antenna and an RF circuit, an optical communication device (for wireless communication), or the like is exemplified. The transmitter 114 can have the function of a receiver as described above. In addition, the transmitter 114 includes a processor, and also can perform a process relating to an operation, which will be described below, with the process.
Note that, the medical endoscope device 100 can also include a communication device compatible with wired communication in an arbitrary communication method such as an optical communication device (for wired communication) or a LAN terminal and a transmission/reception circuit, as will be described below.
Note that an operation of the transmitter 114 is not limited to the above-described example. The transmitter 114 may perform, for example, an operation of a first example introduced in (i) to an operation of a fifth example introduced in (v) below.
In a case in which the encoding processing circuit 112 performs the process of the first example introduced in (1) above, that is, in a case in which RAW image data is compression-encoded at a plurality of different compression ratios, the transmitter 114 transmits compression-encoded RAW image data corresponding to a wireless transmission state of the RAW image data compression-encoded at the plurality of compression ratios.
Through the operation of the first example performed by the transmitter 114, the medical endoscope device 100 realizes, for example, “transmission performed such that transmission of data with low compression is prioritized and it is switched to transmission of data with high compression when a wireless transmission state is bad. In addition, by switching from transmission of data with low compression into transmission of data with high compression in accordance with a wireless transmission state as described above, the medical observation system 1000 maintains the transmission state of RAW image data with low latency even in a case in which a transmission rate deteriorates.
Here, the wireless transmission state is specified by, for example, the encoding processing circuit 112 as described above. Note that the wireless transmission state may be specified by the transmitter 114.
In a case in which only compression-encoded RAW image data corresponding to the wireless transmission state of the RAW image data compression-encoded by the encoding processing circuit 112 at the plurality of compression ratios is transferred from the encoding processing circuit 112, for example, the transmitter 114 wirelessly transmits the compression-encoded RAW image data transferred from the encoding processing circuit 112.
In addition, in a case in which RAW image data compression-encoded at the plurality of compression ratios is transferred from the encoding processing circuit 112, the transmitter 114 selects compression-encoded RAW image data corresponding to the wireless transmission state from the transferred compression-encoded RAW image data and wirelessly transmits the selected compression-encoded RAW image data.
The transmitter 114 transmits compression-encoded RAW image data at different frequencies.
More specifically, the transmitter 114 transmits, for example, compression-encoded RAW image data at different frequencies at the same time. By transmitting compression-encoded RAW image data at different frequencies at the same time, a possibility of the medical reception device 200 being able to receive the compression-encoded RAW image data can be raised.
In addition, the transmitter 114 may transmit the compression-encoded RAW image data at, for example, any one frequency of the plurality of frequencies.
To give an example, the transmitter 114 transmits compression-encoded RAW image data at a frequency corresponding to a wireless transmission state. By transmitting compression-encoded RAW image data at a frequency corresponding to a wireless transmission state among a plurality of frequencies, the medical endoscope device 100 can transmit the compression-encoded RAW image data more stably while further reducing power consumption for the transmission of the compression-encoded RAW image data.
To give another example, the transmitter 114 can also transmit compression-encoded RAW image data at a frequency corresponding to an operation state of a predetermined medical apparatus. As a predetermined medical apparatus according to the present embodiment, for example, a treatment device such as an electrical scalpel or bipolar forceps is exemplified.
In a case in which a predetermined medical apparatus operates, there is a possibility of a generated electric field affecting communication between the transmitter 114 and a receiver (which will be described below) included in the medical reception device 200 depending on an operation state of the predetermined medical apparatus.
Thus, the transmitter 114 performs transmission at a frequency corresponding to an operation state of a predetermined medical apparatus. An operation state of a predetermined medical apparatus is acquired through, for example, communication with another predetermined medical apparatus (or a control device controlling the predetermined medical apparatus).
The transmitter 114 specifies a frequency for an operation state of the predetermined medical apparatus by referring to, for example, a “table (or database) in which operation states of predetermined medical apparatuses are associated with frequencies” stored in a recording medium (not illustrated). In addition, the transmitter 114 may specify a frequency for an operation state of the predetermined medical apparatus by performing, for example, an arithmetic operation of an arbitrary algorithm with which a frequency can be determined in accordance with an operation state of a predetermined medical apparatus.
By transmitting the compression-encoded RAW image data at a frequency corresponding to an operation state of the predetermined medical apparatus among the plurality of frequencies, the medical endoscope device 100 can transmit the compression-encoded RAW image data more stably while further reducing power consumption for the transmission of the compression-encoded RAW image data.
To give another example, the transmitter 114 can also transmit compression-encoded RAW image data at a frequency corresponding to a wireless transmission state and an operation state of a predetermined medical apparatus.
(iii) Third Example of Operation of Transmitter 114
In a case in which the encoding processing circuit 112 performs the process of the third example introduced in (3) described above, that is, “a case in which compression-encoded first RAW image data of a medical captured image for the right eye and compression-encoded second RAW image data of a medical captured image for the left eye are transferred from the encoding processing circuit 112,” the transmitter 114 wirelessly transmits each of the compression-encoded first RAW image data and the compression-encoded second RAW image data.
Note that an operation of the transmitter 114 in a case in which the encoding processing circuit 112 performs the process of the third example introduced in (3) above is not limited to the above-described example.
For example, the transmitter 114 may stop transmission of the compression-encoded first RAW image data or the compression-encoded second RAW image data on the basis of a wireless transmission state. When the transmitter 114 stops transmission of one of the compression-encoded first RAW image data and the compression-encoded second RAW image data on the basis of a wireless transmission state, the medical endoscope device 100 can transmit the compression-encoded RAW image data more stably.
The medical endoscope device 100 according to the first embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical endoscope device 100 according to the first embodiment is not limited to that illustrated in
For example, the transmitter 114 may be provided in the medical endoscope device 100 according to the first embodiment as a separate body from the camera head 104. By providing the transmitter 114 as a separate body from other constituent elements such as the camera head 104, substitution (so-called replacement) of the transmitter 114 can be easier. Thus, by providing the transmitter 114 as a separate body from other constituent elements, the medical endoscope device 100 can change, for example, reliability in communication, a communication distance, a transmission capacity (communication speed), an error correction method, a communication method, and the like more flexibly. That is, if the medical endoscope device 100 has a replaceable transmitter 114, for example, version upgrade for hardware relating to communication becomes easier, and thus the medical endoscope device 100 can respond to the evolution of communication more flexibly.
The medical reception device 200 includes, for example, a receiver 210 and a signal processing circuit 212.
In addition, the medical reception device 200 may further include, for example, a recording medium (not illustrated) on which data to be used by the signal processing circuit 212 in processes is recorded. As the recording medium (not illustrated), for example, a flash memory, a ROM, or the like is exemplified. Note that the recording medium (not illustrated) may be an external recording medium of the medical reception device 200.
The receiver 210 is a circuit that functions as a reception unit of the medical reception device 200 and wirelessly receives compression-encoded RAW image data.
As the receiver 210, for example, a communication device compatible with wireless communication of an arbitrary communication method corresponding to the transmitter 114 included in the medical endoscope device 100 is exemplified. Note that the medical reception device 200 can also include a communication device compatible with wired communication of an arbitrary communication method, such as an optical communication device (for wired communication) or a LAN terminal and a transmission/reception circuit, as will be described below.
The signal processing circuit 212 is a circuit that functions as a signal processing unit of the medical reception device 200 and processes received compression-encoded RAW image data.
The signal processing circuit 212 performs, for example, a decoding process of decoding compression-encoded RAW image data. In addition, the signal processing circuit 212 performs a demosaic process on decoded RAW image data. Furthermore, the signal processing circuit 212 may perform various processes that can be performed on medical captured images such as enlargement or reduction of images relating to the electronic zoom function and inter-pixel correction.
The medical reception device 200 according to the first embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical reception device 200 according to the first embodiment is not limited to the example illustrated in
The camera head 104 of the medical endoscope device 100 includes, for example, a sensor 110, an encoding processing circuit 112, transmitters 114A and 114B, a battery 116, and a light source 118.
When the camera head 104 illustrated in
The transmitter 114A is a circuit that functions as a transmission unit in the medical endoscope device 100 and wirelessly transmits compression-encoded RAW image data transferred from the encoding processing circuit 112, similarly to the transmitter 114 illustrated in
The transmitter 114B is another circuit that functions as a transmission unit in the medical endoscope device 100 and transmits additional information. As additional information according to present embodiment, arbitrary data other than RAW image data, for example, one or both of control information including control commands in accordance with operations with respect to an operation device (not illustrated) included in the medical endoscope device 100 and remaining amount information indicating a remaining amount of the battery 116, or the like is exemplified.
The medical endoscope device 100 according to the second embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical endoscope device 100 according to the second embodiment is not limited to the example illustrated in
For example, in the medical endoscope device 100 according to the second embodiment, one or both of the transmitters 114A and 114B may be provided as a separated body from the camera head 104, similarly to the medical endoscope device 100 according to the first embodiment.
In addition, the transmitter 114B may transmit additional information in wired communication of an arbitrary communication method.
The medical reception device 200 includes, for example, receivers 210A and 210B, and a signal processing circuit 212.
When the medical reception device 200 illustrated in
The receiver 210A is a circuit that functions as a reception unit in the medical reception device 200 and wirelessly receives compression-encoded RAW image data, similarly to the receiver 210 illustrated in
The receiver 210B is another circuit that functions as a reception unit in the medical reception device 200 and wirelessly receives additional information. As the receiver 210B, a communication device compatible with the transmitter 114B included in the medical endoscope device 100 is exemplified.
The medical reception device 200 according to the second embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical reception device 200 according to the second embodiment is not limited to the example illustrated in
The medical reception device 200 according to the second embodiment may further include, for example, a communication device for communicating with an external device such as the display device 300, similarly to the medical reception device 200 according to the first embodiment.
In addition, the transmitter 114B may receive, for example, additional information in wired communication of an arbitrary communication method.
The camera head 104 included in the medical endoscope device 100 illustrated in A of
In addition, the camera head 104 included in the medical endoscope device 100 illustrated in B of
When the camera heads 104 illustrated in A and B of
Each of the charging/feeding circuits 120A and 120B is a circuit with a function of charging the battery 116 with power supplied from an external power supply. The charging/feeding circuit 120A charges the battery 116 with power supplied from a wire-connected external power supply Po1. In addition, the charging/feeding circuit 120B charges the battery 116 with power supplied from a wirelessly connected external power supply Po2.
In addition, each of the charging/feeding circuits 120A and 120B may have a function of supplying power accumulated in the battery 116 to an external device.
The medical endoscope device 100 according to the third embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical endoscope device 100 according to the third embodiment is not limited to the example illustrated in
The medical reception devices 200 each include, for example, receivers 210 and signal processing circuits 212. Functions and configurations of the receivers 210 and the signal processing circuits 212 illustrated in
The medical reception device 200 according to the third embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical reception device 200 according to the third embodiment is not limited to the example of
The camera head 104 included in the medical endoscope device 100 includes, for example, a sensor 110, an encoding processing circuit 112, a transmitter 114, a battery 116, and a light source 118.
When the camera head 104 illustrated in
The medical endoscope device 100 according to the fourth embodiment has, for example, the configuration illustrated in
Note that, a configuration of the medical endoscope device 100 according to the fourth embodiment is not limited to the example illustrated in
The medical reception device 200 includes, for example, a receiver 210 and a signal processing circuit 212. Configurations and functions of the receiver 210 and the signal processing circuit 212 illustrated in
The medical reception device 200 according to the fourth embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical reception device 200 according to the fourth embodiment is not limited to the example illustrated in
The camera head 104 included in the medical endoscope device 100 includes, for example, a sensor 110, an encoding processing circuit 112, a transmitter 114, batteries 116A and 116B, and a light source 118.
When the camera head 104 illustrated in
The battery 116A is detachable from the camera head 104, similarly to the battery 116 included in the camera head 104 according to the fourth embodiment illustrated in
The battery 116B is a spare battery included in the camera head 104. Since the camera head 104 includes the battery 116B, the medical endoscope device 100 can replace a battery while operating. In addition, since the camera head 104 includes the battery 116B, a drive time of the medical endoscope device 100 can be extended.
The medical endoscope device 100 according to the fifth embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical endoscope device 100 according to the fifth embodiment is not limited to the example illustrated in
The medical reception device 200 includes, for example, a receiver 210 and a signal processing circuit 212. Configurations and functions of the receiver 210 and the signal processing circuit 212 illustrated in
The medical reception device 200 according to the fifth embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical reception device 200 according to the fifth embodiment is not limited to the example illustrated in
The camera head 104 included in the medical endoscope device 100 includes, for example, a sensor 110, an encoding processing circuit 112, transmitters 114A and 114B, a battery 116, and a light source 118.
When the camera head 104 illustrated in
The transmitter 114A is a circuit that functions as a transmission unit in the medical endoscope device 100, and wirelessly transmits compression-encoded RAW image data transferred from the encoding processing circuit 112, similarly to the transmitter 114 illustrated in
The transmitter 114B is another circuit that functions as a transmission unit in the medical endoscope device 100, and transmits compression-encoded RAW image data transferred from the encoding processing circuit 112 in a wired manner.
The medical endoscope device 100 according to the sixth embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical endoscope device 100 according to the sixth embodiment is not limited to the example illustrated in
The medical reception device 200 includes, for example, receivers 210A and 210B, and a signal processing circuit 214.
When the medical reception device 200 illustrated in
The receiver 210A is a circuit that functions as a reception unit in the medical reception device 200, and wirelessly receives compression-encoded RAW image data, similarly to the receiver 210 illustrated in
The receiver 210B is another circuit that functions as a reception unit in the medical reception device 200, and receives compression-encoded RAW image data in a wired manner. As the receiver 210B, a communication device corresponding to the transmitter 114B included in the medical endoscope device 100 is exemplified.
The signal processing circuit 214 processes compression-encoded RAW image data received by the receiver 210A or compression-encoded RAW image data received by the receiver 210B. The signal processing circuit 214 processes received compression-encoded RAW image data, similarly to the signal processing circuit 212 according to the first embodiment illustrated in
Here, the signal processing circuit 214 performs processes at each set predetermined period, for example. The predetermined period may be a preset fixed period or a variable period that can be changed in accordance with an operation with respect to an operation device such as a remote controller, or the like. In addition, the signal processing circuit 214 processes either RAW image data first transferred at a process start timing of compression-encoded RAW image data transferred from the receiver 210A and compression-encoded RAW image data transferred from the receiver 210B.
Note that an example of a process performed by the signal processing circuit 214 is not limited to the above-described example. For example, the signal processing circuit 214 may process RAW image data of the compression-encoded RAW image data transferred at the process start timing with a higher signal level.
The medical reception device 200 according to the sixth embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical reception device 200 according to the sixth embodiment is not limited to the example illustrated in
The camera head 104 included in the medical endoscope device 100 includes, for example, a sensor 110, an encoding processing circuit 112, a transmitter 114, a battery 116, and a light source 118.
Functions and configurations of the sensor 110, the encoding processing circuit 112, the transmitter 114, the battery 116, and the light source 118 illustrated in
The medical endoscope device 100 according to the seventh embodiment has, for example, the configuration illustrated in
Note that a configuration of the medical endoscope device 100 according to the seventh embodiment is not limited to the example illustrated in
The medical reception device 200 includes, for example, receivers 210A, . . . , and 210N, and a signal processing circuit 214.
When the medical reception device 200 illustrated in
Each of the receivers 210A, . . . , and 210N is a circuit that functions as a reception unit in the medical reception device 200 and wirelessly receives compression-encoded RAW image data, similarly to the receiver 210 illustrated in
The signal processing circuit 214 processes any RAW image data of compression-encoded RAW image data received by each of the receivers 210A, . . . , and 210N. The signal processing circuit 214 processes any RAW image data of compression-encoded RAW image data received by each of the receivers 210A, . . . , and 210N, for example, similarly to the signal processing circuit 214 according to the sixth embodiment illustrated in
The medical reception device 200 according to the seventh embodiment has, for example, the configuration illustrated in
Note that, a configuration of the medical reception device 200 according to the seventh embodiment is not limited to the example illustrated in
For example, the medical reception device 200 according to the seventh embodiment may further include a communication device for communicating with an external device such as the display device 300, similarly to the medical reception device 200 according to the first embodiment.
In addition, the medical reception device 200 according to the seventh embodiment may also can process compression-encoded RAW image data received using an external antenna. The signal processing circuit 214 processes, for example, compression-encoded RAW image data received using the included receivers or compression-encoded RAW image data received using an external antenna. In this case, the medical reception device 200 according to the seventh embodiment may not include a plurality of receivers.
External antennas can be provided in various places in the medical sites, for example, trocars, beds, shadowless light, and the like.
The following effects, for example, can be exhibited when the medical observation systems according to the present embodiments are used. Note that, it is a matter of course that effects to be exhibited when the medical observation systems according to the present embodiments are used are not limited to the following examples.
When a program for causing a computer to function as the medical endoscope device according to the present embodiments (e.g., a program for causing the computer to function as an encoding processing unit and a transmission unit, in other words, a program by which the processes of the transmission methods according to the present embodiments can be executed) is executed by a processor of the computer or the like, image data indicating a compression-encoded medical captured image can be transmitted with low latency.
In addition, when the program for causing a computer to function as the medical endoscope devices according to the present embodiments is executed by a processor of the computer or the like, effects exhibited by performing the processes of the above-described transmission methods according to the present embodiments can be exhibited.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
Although it has been described above that, for example, the program (computer program) for causing the computer to function as the medical endoscope devices according to the present embodiments is provided, the present embodiments can also provide a recording medium in which the program is stored therealong.
The above-described configurations are examples of the present embodiments, and of course belong to the technical scope of the present disclosure.
Further, the effects described in this specification are merely illustrative or exemplified effects, and are not limitative. That is, with or in the place of the above effects, the technology according to the present disclosure may achieve other effects that are clear to those skilled in the art from the description of this specification.
Additionally, the present technology may also be configured as below.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2017-234812 | Dec 2017 | JP | national |
This application is a continuation of U.S. application Ser. No. 17/488,323, filed Sep. 29, 2021, which is a continuation of U.S. application Ser. No. 16/180,406, filed Nov. 5, 2018 (now Abandoned), which claims priority to Japanese Patent Application No. 2017-234812, filed Dec. 7, 2017, the entire contents of each are incorporated herein by its reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17488323 | Sep 2021 | US |
| Child | 18364486 | US | |
| Parent | 16180406 | Nov 2018 | US |
| Child | 17488323 | US |
