The present invention relates to an endoscope system that presents an affected area to an operator and the like in an endoscopic operation, and to an endoscopic operation training system that trains the operator and the like for a variety of tasks in the endoscopic operation.
Heretofore, an endoscopic surgical operation (hereinafter, referred to as an endoscopic operation) has been a low-invasive operation that brings, to a patient, a great deal of merits that an operation wound pain is small, that early ambulation and discharge are possible, and that an excellent advantage is also obtained in terms of beauty treatment. An endoscope system that realizes this endoscopic operation includes: an endoscope device that images an affected area; and a monitor that displays a video taken by the endoscope device, and displays a state of the affected area on the monitor. In this state, forceps inserted toward the affected area are manipulated, and the operation is implemented for the affected area. A video display apparatus usable for the endoscopic operation as described above is described, for example, in Patent Citation (Japanese Patent Laid-Open Publication No. 2008-15470) or the like.
At a site of the above-mentioned endoscopic operation, viewpoint positions of an operator and an assistant for a video are restrained owing to arrangement of a display screen, a bed and a variety of instruments. In the case where the viewpoint positions are restrained as described above, when the operator changes the viewpoint position, there are apprehensions that the operator cannot look at a center of the video, and that the operator cannot see the whole of the video, resulting in a possibility to cause a stress to the operator.
Further, in the endoscopic operation, it is necessary that a single video be seen by a person who manipulates a camera and other assistants as well as the operator who manipulates the forceps. In this case, it becomes important to allow visual recognition of a clear stereoscopic video from whichever angle the video concerned may be seen.
In this connection, the present invention has been proposed in consideration of the above-mentioned actual circumstances. It is an object of the present invention to provide an endoscope system and an endoscopic operation training system, which are capable of always presenting the clear stereoscopic video to the operator in the endoscopic operation.
The present invention is concerned with an endoscopic system that acquires a video of an imaging target in a patient's body cavity at an operation site where an operation instrument inserted into the patient's body cavity is manipulated by a first operator at a first viewpoint position.
The present invention includes: an endoscope device that is manipulated by a second operator located at a second viewpoint position, and takes a video of a patient's affected area by allowing at least a part thereof to be inserted into the patient's body cavity; video projecting means for projecting video light indicating the video taken by the endoscope device; video displaying means having a shape of a projection surface that directs a concave surface toward the first operator and the second operator, in which the video light is projected onto the projection surface by the video projecting means; and video signal processing means for performing, based on a positional relationship between at least the first viewpoint position and the video displaying means and on the shape of the projection surface, distortion correction processing for a video signal inputted to the video projecting means so that the video can be displayed without distortion on the projection surface when seen from the first viewpoint position.
In order to solve the above-mentioned problem, in the video displaying means in the present invention, in a case where an axis that passes through a center of an opening surface serving as the concave surface and is perpendicular to the opening surface is defined as a first axis, a point where the first axis and the projection surface intersect each other is defined as a projection surface center, and an axis that connects the projection surface center and an edge portion of the projection surface to each other is defined as a second axis, and a tangential line of the edge portion of the projection surface composed of a part of a spherical shape of the video displaying means is defined as a third axis, then an angle made by the first axis and the third axis is an angle at which it is possible to observe a whole of the video from the first viewpoint position, and an angle made by the first axis and the second axis is an axis at which it is possible to observe the projection surface center from the second viewpoint position. Alternatively, in order to solve the above-mentioned problem, in the video displaying means in the present invention, in a case where an axis that passes through a center of an opening surface serving as the concave surface and is perpendicular to the opening surface is defined as a first axis, a point where the first axis and the projection surface intersect each other is defined as a projection surface center, and an axis that connects the projection surface center and an edge portion of the projection surface to each other is defined as a second axis, and a tangential line of the edge portion of the projection surface composed of a part of a spherical shape of the video displaying means is defined as a third axis, then an angle made by the first axis and the third axis is an angle at which it is possible to observe a whole of the video from both of the first viewpoint position and the second viewpoint position.
A description is made below of an embodiment of the present invention with reference to the drawings.
An endoscope system to which the present invention is applied acquires a video of an imaging target in a patient's body cavity in an endoscopic operation, and presents a stereoscopic video of the imaging target in the patient's body cavity to a plurality of persons including an operator (first operator) of the endoscopic operation. For this purpose, this endoscope system has, as an endoscopic operation-use display apparatus 1, a configuration including a dome type screen 11 composed of a part of a sphere, which is as shown in
First, a detailed description is made of the endoscopic operation-use display apparatus 1 in the endoscope system as described above with reference to
As shown in
In order to display the stereoscopic video on the dome type screen 11 by the endoscopic operation-use display apparatus 1, the endoscope device 2 includes a camera unit, which takes the video, in a main body portion 2a or tip end portion 2b thereof as shown in
This endoscopic operation-use display apparatus 1 includes: projectors 12 and 13 (video projecting means) which emit videos upon receiving video signals; a reflecting mirror 14 that reflects the videos emitted from the projectors 12 and 13; the dome type screen 11 (video displaying means) having a dome type projection surface 11a onto which the videos reflected by the reflecting mirror 14 are projected; a base portion 15 that supports the projectors 12 and 13, the reflecting mirror 14 and the dome type screen 11; and a lifting device 16 that moves the projectors 12 and 13, the reflecting mirror 14 and the dome type screen 11, which are integrated with one another, vertically with respect to the base portion 15.
As shown in
In order that a left eye-use video can be displayed on the dome type screen 11 without being distorted when seen from the first viewpoint position of the operator, the left eye-use video correction unit 3B refers to the distortion correction table for the left eye-use video signal, and performs distortion correction therefor based on the distortion correction table. Specifically, when two two-dimensional videos (non-stereoscopic videos) corresponding to right and left eyes are supplied to the video signal processing device 3 from the endoscope device 2, and the videos are projected onto the dome type screen 11 from the projector 13, the video signal processing device 3 performs coordinate conversion for the two-dimensional videos so that the videos cannot look distorted on the dome type screen 11 from the first viewpoint position of the operator P.
Note that, for this purpose, the distortion correction table that performs the coordinate conversion for the two-dimensional videos so that the videos cannot look distorted on the dome type screen 11 from the above-described first viewpoint position is created in advance by using correction parameters such as a relative positional relationship among the left eye-use projector 12, the reflecting mirror 14, the viewpoint position (first viewpoint position) of the operator and the dome type screen 11, a shape of the dome type screen 11, and projector characteristics including a specified projection angle and image angle of the left eye-use projector 12. The distortion correction table thus created is stored in advance in the distortion correction table storage unit 3D of the video signal processing device 3. Then, the distortion correction is performed in accordance with the distortion correction table. Moreover, in a similar way to the right eye-use video correction unit 3B, the right eye-use video correction unit 3C also performs the distortion correction in accordance with a distortion correction table created by using correction parameters such as a relative positional relationship among the right eye-use projector 13, the reflecting mirror 14, the viewpoint position of the operator and the dome type screen 11, the shape of the dome type screen 11, and projector characteristics including a specified projection angle and image angle of the right eye-use projector 13. In such a way, the video signal processing device 3 can project, from the projectors 12 and 13, the stereoscopic video having a predetermined parallax between the right eye-use video and the left eye-use video. Note that, in the case of not using the reflecting mirror 14, the distortion correction table is created by omitting a relative position of the reflecting mirror 14 and using correction parameters including a relative positional relationship among the left eye-use projector 12, the viewpoint position of the operator and the dome type screen 11.
Moreover, it is desirable that this endoscope system further include, though not shown, a living body information acquisition unit that acquires patient's living body information such as blood pressure necessary in the endoscopic operation and medical images (such as CT images and MRI images) acquired before and during the operation. Then, this endoscope system projects video light in which the living body information acquired by the living body information acquisition unit is superposed on a stereoscopic video of a patient's affected area. In such a way, the endoscope system allows the operator and the like to visually recognize a variety of information without changing attitudes thereof while seeing the video of the affected area, which is acquired by the endoscope device 2.
Furthermore, at the time when the two two-dimensional video signals corresponding to the left and right eyes and including the videos taken by the endoscope device 2 are inputted to the left eye-use video correction unit 3B and the right eye-use video correction unit 3C, this endoscope system may switch between the following two cases. In one of the cases, the two-dimensional video signal corresponding to the left eye is inputted to the left eye-use video correction unit 3B, and the two-dimensional video signal corresponding to the right eye is inputted to the right eye-use video correction unit 3C. In the other case, the video in either one of the two two-dimensional video signals is inputted to both of the left eye-use video correction unit 3B and the right eye-use video correction unit 3C. By such switching, the video signals corrected by the left eye-use video correction unit 3B and the right eye-use video correction unit 3C may be switched between the stereoscopic video signals and the non-stereoscopic video signals. In such a way, the videos projected from the left eye-use projector 12 and the right eye-use projector 13 can be switched between the non-stereoscopic video and the stereoscopic video. As a trigger of this switching, an arbitrary person may control an action of the video signal processing device 3, for example, in accordance with an instruction of the operator P. In such a way, a selection can be made between the following options. In one of the options, the stereoscopic video is displayed in the case where the endoscopic operation is performed while stereoscopically seeing the affected area, and in the other option, the non-stereoscopic video is displayed in the case where it is not necessary to perform the endoscopic operation while stereoscopically seeing the affected area intendedly. Moreover, a video that facilitates the operator P to perform the endoscopic operation can also be selected.
Still further, a configuration may be adopted, in which a two-dimensional video-use flat screen (not shown) is provided separately in addition to the dome type screen 11, and the dome type screen 11 and the two-dimensional video-use flat screen are switched, whereby the stereoscopic video and the two-dimensional video are switched.
The left eye-use projector 12 as one in the pair receives the left eye-use video signal corrected by the video signal processing device 3, and emits the left eye-use video from a lens 12a. The right eye-use projector 13 as the other in the pair receives the right eye-use video signal outputted from the right eye-use video correction unit and already subjected to the distortion correction, and emits the right eye-use video light from a lens 13a.
Note that this endoscope system adopts a polarization method as a method of allowing the plurality of persons including the operator P to visually recognize the stereoscopic video. Specifically, a left eye-use polarization filter 12b is attached to the lens 12a of the left eye-use projector 12. In a similar way, a right eye-use polarization filter 13b is attached to the lens 13a of the right eye-use projector 13. The left eye-polarization filter 12b and the right eye-use polarization filter 13b transmit therethrough circular polarizations different from each other. The left eye-use video emitted from the left eye-use projector 12 transmits through the left eye-use polarization filter 12b, and the right eye-use video emitted from the right eye-use projector 13 transmits through the right eye-use polarization filter 13b. Note that the respective polarization filters 12b and 13b are not limited to those which transmit the circular polarizations therethrough, and may be those which transmit linear polarizations therethrough. For example, the left eye-use polarization filter 12b may transmit a vertical linear polarization therethrough, and the right eye-use polarization filter 13b may transmit a horizontal linear polarization therethrough.
Meanwhile, at the time of seeing the dome type screen 11, the plurality of persons including the operator P and the assistants (second operators) wear stereoscopic glasses 5. Each pair of the stereoscopic glasses 5 has a polarization filter with the same polarization method as that of the left eye-use polarization filter 12b in a left eye portion thereof, and has a polarization filter with the same polarization method as that of the right eye-use polarization filter 13b in a right eye portion thereof. By seeing the video, which is displayed on the dome type screen 11, trough the stereoscopic glasses 5, the plurality of persons including the operator P can see, by the stereoscopic video, a situation including the affected area, forceps and the like in the patient's body.
The reflecting mirror 14 is installed above viewing fields when the plurality of persons including the operator P look at the center of the dome type screen 11. The reflecting mirror 14 reflects the left eye-use video light and the right eye-use video light, which are emitted from the left eye-use projector 12 and the right eye-use projector 13, toward the projection surface 11a of the dome type screen 11. The endoscopic operation-use display apparatus 1 includes the reflecting mirror 14, whereby it becomes unnecessary to install the projectors 12 and 13 and the dome type screen 11 in line with one another, and the whole of the apparatus can be miniaturized.
As mentioned above, the projection surface 11a of the dome type screen 11 is of the dome type, and is painted with paint, for example, such as a silver paint having a specular reflection effect. In general, this dome type screen 11 is called a silver screen. Note that a shape of the screen is not limited to the dome type, and for example, the screen may be a composite screen composed of a plane and a quadric surface. Even if the screen is the screen having such a shape, the endoscopic operation-use display apparatus 1 can switch the distortion correction table in the video signal processing unit 3, and can thereby switch the video created by the coordinate conversion, and can display, on the projection surface 11a, the video without distortion when seen from the first viewpoint position of the operator P.
Moreover, it is preferable that arithmetic mean roughness of a concave surface on the dome type screen 11 be set within a range where halation owing to inter-reflection is reduced while maintaining high resolution. The reason for the above is as follows. Specifically, in the case of projecting, onto the dome type screen 11, the videos from the respective projectors 12 and 13, then the video toward an end portion side of the dome type screen 11 is irradiated onto an opposite part of the dome type screen 11 owing to the inter-reflection as reflection equal to or more than secondary reflection, which is reflected on a surface irradiated with direct emission light from the projectors 12 and 13. In such a way, the halation occurs that the whole of the dome type screen 11 looks white like fogging. An occurrence degree of the halation owing to the inter-reflection is changed depending on brightness and contrast ratio of the projectors 12 and 13 and the shape of the dome type screen 11. This is because the halation owing to the inter-reflection is particularly prone to occur in the case where the dome type screen 11 is formed into a hemispherical or semicircular shape.
The dome type screen 11 in
Here, at a site of the endoscopic operation, the position of the dome type screen 11, the viewpoint position of the operator P and the viewpoint positions of the assistants are restrained, and under a condition where there is such a restraint, it is necessary to present a clear stereoscopic video without distortion to at least the operator P. Hence, in the endoscopic operation-use display apparatus 1 in the endoscope system to which the present invention is applied, the shape of the dome type screen 11 is designed so that at least the operator P of the endoscopic operation can see the whole of the projection surface 11a concerned. Still desirably, the shape of the dome type screen 11 may be designed so that not only the operator P but also the assistants and the like, of which viewpoint positions are different from that of the operator P, can see the whole of the projection surface 11a. The shape of the dome type screen 11 is decided by the viewpoint positions of the persons including the operator P and the assistants, and the like; however, details of the shape will be described later.
In the endoscopic operation-use display apparatus 1 as described above, the left eye-use projector 12, the right eye-use projector 13, the reflecting mirror 14 and the dome type screen 11 are assembled integrally with one another by using an attachment member 17, and compose one mobile body 18.
More specifically, the attachment member is formed of a metal plate into a substantially rectangular parallelepiped shape, includes a concave portion 19 on one surface on a front side (positive α-axis direction side in
The dome type screen 11 is fixed to the attachment member 17 in such a manner that the concave projection surface 11a is arranged on the concave portion 19 of the attachment member 17. When the dome type screen 11 is fixed to the attachment member 17, an opening surface of the dome type screen 11 and a front surface of the attachment member 17 become substantially flush with each other. The concave projection surface 11a is arranged on the concave portion 19, whereby the dome type screen 11 is prevented from protruding from the attachment member 17, and the miniaturization of the apparatus can be achieved.
The projector housing portion 20 for the projectors 12 and 13 has a box shape in which at least a side surface on the front side of endoscopic operation-use display apparatus 1 is opened. The projectors 12 and 13 are fixed to an inside of the projector housing portion 20, and the lenses 12a and 13a of the projectors 12 and 13 face to the outside from the side surface thus opened through the polarization filters 12b and 13b.
The reflecting mirror 14 is fixed to tip ends 21a of the pair of arms 21 at a predetermined angle.
The base portion 15 is formed of the into the substantially rectangular parallelepiped shape, includes, on a front side thereof, a box-shaped housing portion 22 in which an upper surface is opened, and includes a pair of leg portions 23 on a lower end thereof. In each of the leg portions 23, casters 24 are individually attached onto both ends thereof in a longitudinal direction. Moreover, handrails 25 are provided on both sides of a back surface 15a of the base portion 15.
A lower portion of the above-mentioned mobile body 18 is housed in the housing portion 22 so as to be freely movable up and down. The lower portion of the mobile body 18 is housed in the box-shaped housing portion 22, whereby the mobile body 18 can be stably maintained at a constant attitude.
Moreover, in the endoscopic operation-use display apparatus 1, the handrails 25 and the casters 24 are provided on the base portion 15. In such a way, the user grips the handrails 25 and pushes the base portion 15, and can thereby move the endoscopic operation-use display apparatus 1 concerned with ease.
Note that, on a side surface 17a of the attachment member 17 for the mobile body 18, a scale 17b is provided, and on a side surface 15b of the base portion 15, a triangle mark 15c is provided. This endoscopic operation-use display apparatus 1 can allow the user to measure a height of the mobile body 18 (screen) by means of the scale 17b and the triangle mark 15c.
The lifting device 16 has, for example, a hydraulic power generation mechanism, and lifts and lowers the mobile body 18. This lifting device 16 includes a drive portion 26, a raising step 27 and a lowering lever knob 28. The drive portion 26 is arranged on a lower surface 22a of the housing portion 22, and the mobile body 18 is fixed to and mounted on an upper surface 26a of the drive portion 26. The raising step 27 and the lowering lever knob 28 are provided on the back surface 15a side of the housing portion 22. When the user steps on the raising step 27 downward from above, the upper surface 26a of the drive portion 26 rises. When the user further steps on the raising step 27 many times, the upper surface 26a further rises. Meanwhile, when the user rotates the lowering lever knob 28 counterclockwise, the upper surface 26a of the drive portion 26 is lowered. When the user rotates the lowering lever knob 28 clockwise, such upward and downward motions of the upper surface 26a of the drive portion 26 are locked. In other words, this lifting device 16 can lift and lower the upper surface 26a of the drive portion 26 vertically with respect to the base portion 15 in such a manner that the user manipulates the raising step 27 and the lowering lever knob 28. In such a way, the mobile body 18 mounted on the upper surface 26a of the drive portion 26 can move vertically with respect to the base portion 15. Note that this lifting device 16 is not limited to the hydraulic one, and other mechanisms such as a spring may be adopted.
Here, in the endoscopic operation-use display apparatus 1, the projectors 12 and 13, the reflecting mirror 14 and the dome type screen 11 are assembled integrally with one another to compose the single mobile body 18. Therefore, even if the mobile body 18 is moved by the lifting device 16, the mutual positional relationship among the projectors 12 and 13, the reflecting mirror 14 and the dome type screen 11 remains fixed. Hence, regardless of the height of the mobile body 18, the video without distortion whenever seen from the first viewing point position of the operator P can be displayed on the dome type screen 11. Specifically, in the case where the projectors 12 and 13, the reflecting mirror 14 and the dome type screen 11 are not integrated with one another, when the height of the dome type screen 11 is changed, the mutual positional relationship among the projectors 12 and 13, the reflecting mirror 14 and the dome type screen 11 is changed, resulting in apprehensions that the video may not be displayed on the center of the dome type screen 11, and that the distorted video when seen from the first viewpoint position of the operator P may be displayed on the screen concerned. Therefore, every time when the height of the dome type screen 11 is changed, the positional relationship among the projectors 12 and 13, the reflecting mirror 14 and the dome type screen 11 must be adjusted, and enormous efforts are required for such position adjustment.
As opposed to the above, in this endoscopic operation-use display apparatus 1, the projectors 12 and 13, the reflecting mirror 14 and the dome type screen 11 are assembled with one another to compose the single mobile body 18, whereby the mutual positional relationship thereamong is fixed. In such a way, even if the height of the mobile body 18 is changed by the lifting device 16, the video without distortion whenever seen from the first viewpoint position of the operator P can be displayed on the dome type screen 11 without adjusting the positions of the projectors 12 and 13, the reflecting mirror 14 and the dome type screen 11.
Moreover, in this endoscopic operation-use display apparatus 1, the mobile body 18 is capable of being lifted and lowered, and accordingly, the dome type screen 11 can be adjusted to a height, at which it is easy to see the video, by the manipulation of the lifting device 16 by the user. At this time, the positional relationship among the projectors 12 and 13, the reflecting mirror 14 and the dome type screen 11 is fixed, and accordingly, even if the mobile body 18 is moved, the video without distortion whenever seen from the first viewpoint position of the operator P is displayed on the dome type screen 11. Moreover, this endoscopic operation-use display apparatus 1 includes the handrails 25 and the casters 24, and accordingly, can be easily moved, for example, from a room to another room by griping the handrails 25 and pushing the base portion 15. Furthermore, the endoscopic operation-use display apparatus 1 is facilitated to pass through, for example, a door of the room by lowering the height of the mobile body 18.
As described above, in response to a stature of the operator P, and the like, the endoscopic operation-use display apparatus 1 can adjust the height of the dome type screen 11, and moreover, can display the video without distortion whenever seen from the first viewpoint position of the operator P even if the height of the dome type screen 11 is changed.
Next, behavior of the endoscope system including the above-mentioned endoscopic operation-use display apparatus 1 are described while referring to
First, the endoscope device 2 images the patient B. The video signal supplied from the endoscope device 2 is inputted to the video signal processing device 3. This video signal is subjected to the distortion correction by the left eye-use video correction unit 3B and the right eye-use video correction unit 3C so that the videos can be displayed without being distorted when seen from the first viewpoint position of the operator P at the time of being projected onto the dome type screen 11. Such distortion correction processing is processing for converting coordinates of the respective pixels of the two-dimensional video by referring to the distortion correction table, which is stored in the distortion correction table storage unit 3D, in advance in the left eye-use video correction unit 3B and the right eye-use video correction unit 3C, and for thereby creating new videos (right eye-use video signals, left eye-use video signals). Note that, naturally, this distortion correction table is created based on the relative positional relationship among the left eye-use projector 12, the right eye-use projector 13, the reflecting mirror 14, the viewpoint position of the operator P and the dome type screen 11 and on the shape of the dome type screen 11 in order to show the videos without distortion when seen from the viewpoint position of the operator P, which will be described later.
The actions of the left eye-use video correction unit 3B and the right eye-use video correction unit 3C are synchronized with each other by the control unit 3A. The left eye-use video signal and the right eye-use video signal, which are subjected to the distortion correction, are outputted to the left eye-use projector 12 and the right eye-use projector 13, respectively. The left eye-use projector 12 and the right eye-use projector 13 receive the left eye-use video signal and the right eye-use video signal, respectively, and emit the left eye-use video light and the right eye-use video light, respectively.
The left eye-use video light and the right eye-use video light, which are emitted from the left eye-use projector 12 and the right eye-use projector, transmit through the left eye-use polarization filter 12b and the right eye-use polarization filter 13b, respectively, and are made incident onto the reflecting mirror 14. The reflecting mirror 14 reflects the left eye-use video light and the right eye-use video light, which are emitted from the left eye-use projector 12, and the right eye-use projector 13, and projects the left eye-use video light and the right eye-use video light onto the whole of the surface of the dome type screen 11.
The operators (persons) including the operator P wear the stereoscopic glasses 5 at the time of performing the endoscopic operation while seeing the stereoscopic video projected onto the dome type screen 11. Each pair of the stereoscopic glasses 5 has the polarization filter with the same polarization method as that of the left eye-use polarization filter 12b in the left eye portion thereof, and has the polarization filter with the same polarization method as that of the right eye-use polarization filter 13b in the right eye portion thereof. By seeing the video, which is displayed on the dome type screen 11, trough the stereoscopic glasses 5, the plurality of operators including the operator P can visually recognize the video, which is projected onto the dome type screen 11, stereoscopically.
As described above, the endoscope system can adjust the height of the dome type screen 11 in response to the statures of the operator P and the assistants, and the like, and further, can display the video without distortion whenever seen from the first viewpoint position of the operator P even if the height of the dome type screen 11 is changed.
Incidentally, in this embodiment, the videos outputted from the left eye-use projector 12 and the right eye-use projector 13 are reflected on the dome type screen 11 by using the reflecting mirror 14. The endoscopic operation-use display apparatus 1 includes the reflecting mirror 14, whereby it becomes unnecessary to install the left eye-use projector 12, the right eye-use projector 13 and the dome type screen 11 in line with one another, and the video display apparatus can be miniaturized.
However, in the case where the reflecting mirror 14 is provided, there is an apprehension that the reflecting mirror 14 may block the video since the reflecting mirror 14 comes within sights of such observers. Hence, as shown in
(yi−yo)xM−(xi−xo)yM≦xoyi−xiyo (Expression)
Here, xo and yo are an x and y coordinate of the preset viewpoint position of the operator P, the assistant or the like, and xi and yi are an x and y coordinate of a position of an upper end of the projection surface 11a of the dome type screen 11. Note that the coordinate (xi, yi) indicates the upper end of the projection surface 11a, and does not indicate an upper end of the collar portion 11b of the dome type screen 11. Specifically, the coordinate (xi, yi) indicates the upper end of such an effective projection surface of the dome type screen 11.
The above-described Expression represents a region where an angle θM at which the operator P looks up the lower end of the reflecting mirror 14 from the preset viewpoint position (xo, yo) becomes larger than an angle θI at which the operator P looks up the upper end of the projection surface 11a of the dome type screen 11 from the preset viewpoint position (xo, yo). Specifically, the above-described Expression indicates a region where the angle θM is equal to or larger than the angle θI (θM≧θI). Hence, in the case where a position (xM, yM) of the lower end of the reflecting mirror 14 satisfies the above-described Expression, the operator P can see the whole of the region of the projection surface 11a without receiving obstruction to the line of sight thereof from the reflecting mirror 14.
Note that, though the videos outputted by the left eye-use projector 12 and the right eye-use projector 13 are projected onto the dome type screen 11 through the reflecting mirror 14 in this embodiment, other configurations may be adopted. For example, the endoscopic operation-use display apparatus 1 may be configured so that the left eye-use projector 12 and the right eye-use projector 13 can be arranged on tip end sides of the arms 21 so as to be opposed to the dome type screen 11, and that the video light emitted from each of the left eye-use projector 12 and the right eye-use projector 13 can thereby be directly projected onto the dome type screen 11.
Specifically, the endoscopic operation-use display apparatus 1 may adopt a configuration of including the left eye-use projector 12, the right eye-use projector 13, the dome type screen 11, the video signal processing device 3, and the base portion 15 that supports the left eye-use projector 12, the right eye-use projector 13 and the dome type screen 11, in which the left eye-use projector 12, the right eye-use projector 13 and the dome-type screen 11 are assembled integrally with one another to compose a single mobile body (not shown), and the mobile body concerned is moved vertically by the lifting device 8. Configurations of the video signal processing device 3 and the base portion 15 are similar to those of the video display apparatus of
Even with such a configuration, in the endoscopic operation-use display apparatus 1, the mobile body becomes capable of being lifted and lowered. Hence, by manipulating the lifting device 8, the user can adjust the dome type screen 11 to the position where it is the easiest to see the video. Moreover, in the endoscopic operation-use display apparatus 1, the positional relationship among the left eye-use projector 12, the right eye-use projector 13 and the dome type screen 11 is fixed. Therefore, even if the mobile body is moved, the endoscopic operation-use display apparatus 1 can display, on the dome type screen 11, the video without distortion whenever seen from the first viewpoint position of the operator P. Note that, even in such a configuration, it is desirable that the dome type screen 11 be arranged on the concave portion 19 of the attachment member 17, and the attachment member be housed in the housing portion 22 so as to be freely movable up and down.
Next, a configuration in which the endoscopic operation-use display apparatus 1 is different in the endoscope system to which the present invention is applied is described with reference to
In this endoscopic operation-use display apparatus 1, in addition to be capable of moving vertically, the mobile body 18 is configured to be inclinable with respect to a base portion 15A about an axis perpendicular an up-and-down direction of the endoscopic operation-use display apparatus 1 and parallel to an opening surface of the projection surface 11a (that is, about a β-axis of
The base portion 15A of this endoscopic operation-use display apparatus 1 is formed into a box shape in which an upper surface is opened, and in a similar way to the endoscopic operation-use display apparatus 1 shown in
An attachment member of the endoscopic operation-use display apparatus 1 is composed of a lower attachment member 31, a center attachment member 32 and an upper attachment member 33. The lower attachment member 31 is formed, for example, of a metal plate into a box shape, and is housed in the base portion 15A so as to be capable of being lifted and lowered. Between the lower attachment member 31 and a bottom surface of the base portion 15A, the drive portion 26 of the lifting device 16 is arranged in a similar way to the endoscopic operation-use display apparatus 1 of
The center attachment member 32 is formed, for example, of a metal plate. The center attachment member 32 has a through hole 32a on a lower surface thereof, and is arranged on the lower attachment portion 31 so that the shaft portion 34 of the lower attachment member 31 can penetrate the through hole 32a. In such a way, the center attachment member 32 becomes rotatable with respect to the lower attachment member 31 in a direction of an arrow B of
The upper attachment member 33 is formed, for example, of a metal plate. On lower portions of both side surfaces of the upper attachment member 33 in the β-axis direction of
In the endoscopic operation-use display apparatus 1, there is formed a concave portion 36 for arranging the dome type screen 11 in a form of being laid astride a front surface (surface on a positive α-axis direction side in
In a similar way to the endoscopic operation-use display apparatus 1 of
In the endoscopic operation-use display apparatus 1 configured as described above, when the lifting device 16 lifts and lowers the lower attachment member 31, the mobile body 18 moves vertically with respect to the base portion 15A through the lower attachment member 31 and the center attachment member 32. Hence, by manipulating the lifting device 16, the user can move the mobile body 18 vertically with respect to the base portion 15A. Moreover, the upper attachment member 33 is inclined with respect to the center attachment member 32 manually or by electric power, whereby the mobile body 18 can be inclined with respect to the base portion 15A about the axis perpendicular to the up-and-down direction of the endoscopic operation-use display apparatus 1 and parallel to the opening surface of the projection surface 11a (that is, about the β-axis of
In this endoscopic operation-use display apparatus 1, the user can not only move the mobile body 18 vertically, but can also incline and rotate the mobile body 18 with respect to the base portion 15A. In such a way, in accordance with the endoscopic operation-use display apparatus 1, the height and angle of the dome type screen 11 can be adjusted more finely in response to the statures, standing positions and the like of the operator P and the like.
Note that, also in this endoscopic operation-use display apparatus 1, such a configuration may be adopted so that the left eye-use projector 12 and the right eye-use projector 13 can be arranged on the tip end sides of the arms 21 so as to be opposed to the dome type screen 11, and that the videos emitted from the left eye-use projector 12 and the right eye-use projector 13 can thereby be directly projected onto the dome type screen 11.
Next, still another configuration of the endoscopic operation-use display apparatus 1 is described with reference to
In a similar way to the endoscopic operation-use display apparatuses 1 shown in
With regard to a base portion 15B of this endoscopic operation-use display apparatus 1, one end thereof is fixed to the ground (not shown). Between the base portion 15B and the mobile body 18, there are provided: two rotation mechanisms, which are a first rotation mechanism 41 and a second rotation mechanism 42; a lifting mechanism 43; an inclination mechanism 44; an expansion mechanism 45.
The first rotation mechanism 41 is provided between the mobile body 18 and the lifting mechanism 43. This first rotation mechanism 41 can rotate the mobile body 18 with respect to the lifting mechanism 43 in a direction of θ1 of
The lifting mechanism 43 is provided between the first rotation mechanism 41 and the inclination mechanism 44. The lifting mechanism 43 can lift and lower the mobile body 18 with respect to the inclination mechanism 44 through the first rotation mechanism 41.
The inclination mechanism 44 is provided between the lifting mechanism 43 and the expansion mechanism 45. This inclination mechanism 44 can inline the mobile body 18 with respect to the expansion mechanism 45 in a direction of θ2 of
The expansion mechanism 45 is provided between the inclination mechanism 44 and the second rotation mechanism 42. This expansion mechanism 45 can move the mobile body 18 with respect to the second rotation mechanism in a direction along an α-axis of
The second rotation mechanism 42 is provided between the expansion mechanism 45 and one end of the base portion 15B. The second rotation mechanism 42 can rotate the mobile body 18 with respect to the one end of the base portion 15B in a direction of θ3 of
As described above, the endoscopic operation-use display apparatus 1 includes: the two rotation mechanisms 41 and 42; the lifting mechanism 43; the inclination mechanism 44; and the expansion mechanism 45. In such a way, with respect to the base portion 15B, the endoscopic operation-use display apparatus 1 can move the mobile body 18 vertically, can inline the mobile body 18, and can rotate the mobile body 18. No matter how the mobile body 18 may be moved, the left eye-use projector 12, the right eye-use projector 13, the reflecting mirror 14 and the dome type screen 11 are assembled integrally with one another, and the mutual positional relationship thereamong is fixed. Therefore, in accordance with the endoscopic operation-use display apparatus 1, the video without distortion whenever seen from the first viewpoint position of the operator P can be displayed on the dome type screen 11.
In this endoscopic operation-use display apparatus 1, the user can not only move the mobile body 18 vertically in a similar way to the endoscopic operation-use display apparatus 1 shown in
Note that a combination of the rotation mechanism, the inclination mechanism and the expansion mechanism is not limited to that shown in
The third rotation mechanism 51 is provided between the expansion mechanism 45 and the inclination mechanism 44. This third rotation mechanism 51 can rotate the inclination mechanism 44 with respect to the expansion mechanism 45 in a direction of θ4 of
The fourth rotation mechanism 52 is provided between the expansion mechanism 45 and the second rotation mechanism 42. This fourth rotation mechanism 52 can rotate the expansion mechanism 45 with respect to the second rotation mechanism 42 in a direction of θ5 of
This endoscopic operation-use display apparatus 1 can move the mobile body 18 vertically with respect to the base portion 15B by rotation of the fourth rotation mechanism 52 and by expansion and contraction of the expansion mechanism 45. Specifically, lifting means that can move the mobile body 18 vertically with respect to the base portion 15B is composed of the fourth rotation mechanism 52 and the expansion mechanism 45.
Moreover, in a similar way to the endoscopic operation-use display apparatus 1 shown in
Note that, also in this endoscopic operation-use display apparatus 1, such a configuration may be adopted so that the left eye-use projector 12 and the right eye-use projector 13 can be arranged so as to be opposed to the dome type screen 11, and that the video light emitted from each of the left eye-use projector 12 and the right eye-use projector 13 can thereby be directly projected onto the dome type screen 11.
The endoscope system as described above may include, as other forms, endoscopic operation-use display apparatuses 1 having configurations as shown in
Next, it is described that, in the endoscopic operation-use display apparatus 1 configured as mentioned above, the dome type screen 11 is configured so that at least the operator P can see the whole of the video on the projection surface 11a and at least the assistants A and B can look at the center of the projection surface 11a at the site of the endoscopic operation.
First, a description is made of positional restraint of the respective persons such as the operator P, the assistants and a cameraman with respect to the position of the dome type screen 11 in the endoscopic operation. In the endoscopic operation in which the above-mentioned endoscope system is used, as shown in
The light source 100 includes a lamp 100a and a filter 100b. This filter 100b transmits therethrough only a light component with a predetermined wavelength in lamp light emitted by the lamp 100a. This filter 100b is designed so as to transmit therethrough only such a light component that makes a tissue state of the affected area identifiable by emission of irradiation light onto a video imaging range defined by the endoscope device 2. The irradiation light emitted from this light source 100 is guided to the tip end portion 2b through a light introduction portion 2c of the endoscope device 2.
The tip end portion 2b of the endoscope device 2 allows incidence of reflected light in which the emitted irradiation light is reflected on the affected area. In this tip end portion 2b, there are provided: an emission-use lens that emits the irradiation light; and an incidence-use lens that allows the incidence of the reflected light. The reflected light made incident by the incidence-use lens is converted into a video signal by a photoelectric conversion element built in the main body portion 2a or tip end portion 2b of the endoscope device 2, and is supplied to the video signal processing device 3.
In the endoscopic operation using the endoscope device 2 as described above, as shown in
Under such an environment, it is necessary that the stereoscopic video of the affected area projected onto the dome type screen 11 be clearly seen from the plurality of viewpoint positions of the operator P, the assistants and the cameraman. In particular, it is necessary that the center of the dome type screen 11 be always seen from the operator P.
For this purpose, at the site of the endoscopic operation, as shown in
Moreover, at the site of the endoscopic operation, as shown in
As described above, in order to see the video on the projection surface 11a, a shape of the concave surface of the projection surface 11a is restricted. In this connection, in the endoscope system to which the present invention is applied, the shape of the projection surface 11a that directs the concave surface toward the operator P (first operator) and the assistants A and B (second operators) is made to satisfy an angle α as shown in
The angle α is adjusted to such an angle at which persons present in a range of the angle α concerned with respect to the dome type screen 11 can observe the center of the projection surface of the dome type screen 11. Meanwhile, the angle β is adjusted to such an angle at which persons present in a range of the angle β concerned with respect to the dome type screen 11 can observe the whole of the video of the dome type screen 11 concerned.
Here, in this endoscope system, a range where the viewpoint position of the operator P is present is determined, and a range where the viewpoint positions (second viewpoint positions) of the assistants A and B is determined. Hence, in the endoscope system to which the present invention is applied, the dome type screen 11 has such a shape that allows the viewpoint position of the operator P to remain with the range of the angle β and allows the viewpoint positions of the assistants A and B to remain within the angle α. Alternatively, in the endoscope system to which the present invention is applied, the dome type screen 11 has such a shape that allows both of the viewpoint positions of the operator P and the assistants A and B to remain within the angle β.
First, the angle α is described.
As shown in
Specifically, in order to make it possible to use the endoscopic operation-use display apparatus 1 at both of the site of the endoscopic operation as shown in
The projection surface 11a is configured as described above, whereby the assistants A and B can look at the center of the projection surface 11a if the second viewpoint positions of the assistants A and B are arranged within the range of the angle α as shown in
Specifically, if an opening diameter of the concave surface is set at 600 mm, and a depth from the opening surface of the concave surface concerned to the projection surface center point P1 is set at 46 mm, then the angle α from the perpendicular axis L1 to the center-edge connection axis L2 becomes 81.28 degrees. As another specific example, if the opening diameter of the concave surface is set at 600 mm, and the depth from the opening surface of the concave surface concerned to the projection surface center point P1 is set at 100 mm, then the angle α from the perpendicular axis L1 to the center-edge connection axis L2 becomes 71.57 degrees. As still another specific example, if the opening diameter of the concave surface is set at 600 mm, and the depth from the opening surface of the concave surface concerned to the projection surface center point P1 is set at 200 mm, then the angle α from the perpendicular axis L1 to the center-edge connection axis L2 becomes 56.31 degrees.
Based on the specific examples as described above, the maximum angle at which the projection surface 11a is recognizable as the concave surface, the maximum angle representing a range where it is possible to arrange the first viewpoint position of the operator P and the second viewpoint positions of the assistants A and B, from which the center of the projection surface 11a can be seen, is set at 82 degrees. Meanwhile, the minimum range where it is possible to arrange the first viewpoint position of the operator P and the second viewpoint positions of the assistants A aria B, from which the center of the projection surface 11a can be seen, is set at 11 degrees in the example of the site of the endoscopic operation shown in
In accordance with the endoscope system as described above, even if the viewpoint positions of the persons who see the stereoscopic video and the position of the dome type screen 11 are restrained, the shape of the projection surface 11a can be adjusted so that the viewpoint positions of the persons who see the stereoscopic video can be located within the range of the angle α between the perpendicular axis L1 and the center-edge connection axis L2. In such a way, if the viewpoint positions of the persons who see the stereoscopic video are determined to some extent, the endoscope system can allow the persons to certainly look at the center of the projection surface 11a.
Hence, in accordance with this endoscope system, even in the case where the position and the attitude, at which the dome type screen 11 can be arranged, and the arrangement of all the members including the operator P and the assistants A and B are restricted by the arrangement of the bed, the patient B and other instruments, which are as shown in
Moreover, in accordance with this endoscope system, the distortion correction table for performing the distortion correction processing based on the first viewpoint position of the operator P is stored in advance in the distortion correction table storage unit 3D, and the stereoscopic video is displayed after performing the distortion correction processing therefor. Accordingly, the center position of the video without distortion can be allowed to be certainly visually recognized from the first viewpoint position of the operator P. In such a way, the endoscope system removes such anxieties that the center of the projection surface 11a may become invisible from all the members including the operator P and the assistants A and B, and can reduce a stress in the endoscopic operation.
Next, the angle β is described.
In this endoscope system, as shown in
The projection surface 11a as described above is configured, whereby all the members who are the operator P and the assistants A and B can see the whole of the video on the projection surface 11a if the first viewpoint position of the operator P and the second viewpoint positions of the assistants A and B are arranged within a range of the angle β as shown in
Specifically, if the opening diameter of the concave surface is set at 600 mm, and the depth from the opening surface of the concave surface concerned to the projection surface center point P1 is set at 46 mm, then the angle β becomes 72.54 degrees. As another specific example, if the opening diameter of the concave surface is set at 600 mm, and the depth from the opening surface of the concave surface concerned to the projection surface center point P1 is set at 100 mm, then the angle β becomes 53.13 degrees. As still another specific example, if the opening diameter of the concave surface is set at 600 mm, and the depth from the opening surface of the concave surface concerned to the projection surface center point P1 is set at 200 mm, then the angle β becomes 22.62 degrees. Based on these matters, it is desirable that the projection surface 11a be configured so that the angle made by the perpendicular axis L1 (first axis) and the tangential line L3 (third axis) can be set within a range from 11 degrees to 73 degrees.
In accordance with the endoscope system as described above, even if the first viewpoint position of the operator P, the second viewpoint positions of the assistants A and B and the position of the dome type screen 11 are restrained, the shape of the projection surface 11a can be adjusted so that the first viewpoint position of the operator P and the second viewpoint positions of the assistants A and B can be located within the range of the angle β between the perpendicular axis L1 and the tangential line L3. In such a way, if the first viewpoint position of the operator P and the second viewpoint positions of the assistants A and B are determined to some extent, the endoscope system can allow these persons to certainly see the whole of the video on the projection surface 11a.
Hence, in accordance with this endoscope system, even in the case where the position and the attitude, at which the dome type screen 11 can be arranged, and the arrangement of all the members including the operator P and the assistants A and B are restricted by the arrangement of the bed, the patient B and the other instruments, which are as shown in
Moreover, in accordance with this endoscope system, the distortion correction table for performing the distortion correction processing based on the first viewpoint position of the operator P is stored in advance in the distortion correction table storage unit 3D, and the stereoscopic video is displayed after performing the distortion correction processing therefor. Accordingly, the whole of the video without distortion can be allowed to be certainly visually recognized from the first viewpoint position of the operator P.
Next, a description is made of a difference in effect, in the above-mentioned endoscope system, between the case of using a two-dimensional video (2D) as means for presenting the video by a general 20-inch Trinitron monitor and the case of using a three-dimensional video (3D) as the means for presenting the video by the dome type screen 11 in which the concave surface shape is adjusted as in the endoscopic operation-use display apparatus 1 to which the present invention is applied.
In this description of the effects, an endoscopic operation training system is used, in which, in place of the patient B shown in
As training to be performed by the endoscopic operation training system as described above, there are mentioned: first to fourth operation tasks as training for manipulating the forceps; and first to third recognition tasks for accurately recognizing a front and rear positional relationship between targets in the video displayed on the dome type screen 11. A description is made below of the respective tasks and the effects of the endoscope system.
For the first operation task, a simulation sample as shown in
As results of the first operation task,
Moreover, as shown in
Moreover, as shown in
For the second operation task, a simulation sample as shown in
As results of the second operation task,
As apparent from
For the third operation task, a simulation sample as shown in
As results of the third operation task,
As apparent from
For the fourth operation task, a simulation sample as shown in
As results of the predetermined fourth operation task,
As apparent from
For the first recognition task, a simulation sample as shown in
Training results of the first recognition task are obtained for both of the case where the two-dimensional video (2D) is displayed on the flat monitor and the case where the three-dimensional video (3D) is displayed on the above-mentioned dome type screen 11. Moreover, the training results of the first recognition task are obtained for the case (3DP) where the first recognition task is performed while displaying the stereoscopic video by using a monitor in which the display screen is flat and for the case (3DD) where the first recognition task is performed while displaying the stereoscopic video on the above-mentioned dome type screen 11. Note that, in all of the cases, the same simulation sample and the same endoscopic operation-use display apparatus 1 were used.
As results of the first recognition task,
When
For the second recognition task, a simulation sample as shown in
As results of this second recognition task,
When
When
In this second recognition task, even if the same stereoscopic video is displayed, a remarkably high effect is recognized by using the dome type screen 11 rather than the flat monitor.
For the third recognition task, a simulation sample as shown in
As results of this third recognition task,
When
When
In this third recognition task, even if the same stereoscopic video is displayed, a remarkably high effect is recognized by using the dome type screen 11 rather than the flat monitor.
Note that the above-described embodiment is merely an example of the present invention. Therefore, the present invention is not limited to the above-mentioned embodiment, and it is a matter of course that a variety of modifications from this embodiment are possible in response to design and the like without departing from the technical spirit according to the present invention.
In accordance with the present invention, the video displaying means is formed into such a shape that enables the observation of the whole of the video from the first viewpoint and the observation of the center of the projection surface from the second viewpoint positions, or that enables the observation of the whole of the video from both of the first viewpoint position and the second viewpoint positions. Accordingly, the operator at the first viewpoint position and the persons at the second viewpoint positions can be allowed to always see the clear stereoscopic video.
Number | Date | Country | Kind |
---|---|---|---|
2008-079193 | Mar 2008 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2008/068973 | 10/20/2008 | WO | 00 | 9/20/2010 |