Patent Application
20130321607
(a) Field
The subject matter disclosed generally relates to a monitoring system used in surgery rooms. More particularly, the subject matter relates to a monitoring system for remotely monitoring the proceedings of a surgery in a surgery room.
(b) Related Prior Art
Cameras used for the remote monitoring of objects are generally adapted to pan (rotate about a vertical axis) and tilt (rotate about a horizontal axis) to follow a certain target. These cameras are used in many fields including security, satellites, airplanes, medical systems etc.
To facilitate the panning and tilting of the camera head, two independently actuated motor mechanisms are usually employed. The first motor is known as the “pan motor,” which facilitates the panning of the camera head. The second motor is known as a “tilt motor,” which facilitates the tilting of the camera head.
Examples of these cameras are shown in
In existing systems, mechanical/optical zoom, focus, image processing (electronic zoom, image filtering etc.), and control of the pan and tilt commands are done by the same processor. Usually, this processor is provided in the camera, and gives the least priority to the processing of pan/tilt commands. Accordingly, the pan and tilt commands wait until a slot becomes available to be processed and sent for execution, which introduces delays in the panning and/or tilting of the camera head. The duration of these delays vary depending upon the busyness of the processor.
While undesirable, these delays do not create life threatening situations in the fields of security and airplanes, where the lost target may be found and followed again. However, loss of the view in a camera used in medical systems e.g. telepresence etc. is unacceptable, especially when the system is used to assist/perform a surgery remotely.
Accordingly, there is a need for a system which allows for adjusting the position of a camera remotely without delay, and without losing the target during the adjusting.
According to an embodiment, there is provided monitoring system in communication with a remote server for providing a remote viewer with visual access to a fixed target in a surgery room. The monitoring system comprises: a moving platform; a pan motor and a tilt motor; a camera rotatably attached to the moving platform using the pan motor and the tilt motor, the camera comprising an internal processor for processing images, the camera providing the visual access to the fixed target; an external processor dedicated for processing pan and tilt commands as soon as the commands are received from the remote server for controlling rotation of the pan motor and the tilt motor; wherein the pan and/or tilt commands are executed simultaneously as the moving platform is changing positions at a rotation speed that provides the visual access to the fixed target substantially un-interruptedly as the moving platform is moving.
According to another embodiment, the moving platform comprises: a first motor and a second motor; a first arm having a first end and a second end opposite the first end, the first arm rotatably attachable to a ceiling of the surgery room using the first motor provided at the first end of the first arm; a second arm having a first and a second end opposite the first end, the second arm rotatably attached at the first end thereof to the second end of the first arm, using the second motor; wherein the camera is attached to a second end of the second arm.
According to a further embodiment, the external processor is provided inside the second arm.
According to another embodiment, communication between the remote server on one side and the camera and the external processor on the other side are sent over a single communication link.
According to a further embodiment, communication between the remote server and the camera is effected using a first protocol, and communication between the remote server and the external processor is effected using a second protocol different from the first protocol.
According to another embodiment, the monitoring system further comprises an Ethernet switch for directing data between the remote server, the external processor and the camera based on which one of the first and second protocol of communication the data is encoded.
According to a further embodiment, the monitoring system further comprises a first limit switch dedicated to the pan motor, and a second limit switch dedicated to the tilt motor, the first limit switch and the second limit switch are for re-positioning the pan motor and the tilt motor to a reference point.
According to another embodiment, the pan motor and the tilt motor are step motors.
According to a further embodiment, the external processor keeps track of the position of each motor for processing of future commands.
According to another embodiment, the monitoring system further comprises an H-bridge for controlling the voltage applied on the pan motor and the tilt motor for rotating the pan motor and the tilt motor at desired speeds and directions.
According to an embodiment, there is provided a monitoring system in communication with a remote server for providing a remote physician with visual access to a patient in a surgery room. The monitoring system comprising: a moving platform defining a first arm for attachment to a ceiling and a second arm rotatably attached to the first arm; a pan motor and a tilt motor; a camera rotatably attached to the second arm using the pan motor and the tilt motor, the camera comprising an internal processor for processing images, the camera providing the visual access to the patient; an external processor provided in one of the first arm and second arm, the external processor being dedicated for processing pan and tilt commands received from the remote server independently of the processing of the images by the internal processor; wherein the pan and/or tilt commands are executed simultaneously as the platform is changing positions at a rotation speed that provides the visual access to the patient from different positions un-interruptedly and as the moving platform is moving.
According to an embodiment, there is provided a method for providing a remote viewer with visual access to a fixed target in a surgery room using a camera mounted on a moving platform using a pan motor and a tilt motor, the method comprising: processing images captured by the camera in an internal processor of the camera; receiving position commands for changing a position of the moving platform; receiving pan and/or tilt commands for changing an orientation of the camera; processing the pan and/or tilt commands in a an external processor independently of the processing of images; executing the pan and/or tilt commands simultaneously as the position commands are executed, at a rotation speed that provides the visual access to the fixed target un-interruptedly as the moving platform is moving.
According to another embodiment, the method further comprises providing the external processor in the moving platform.
According to a further embodiment, the method further comprises communicating with a remoter server by the external processor and the internal processor over a single communication link.
According to another embodiment, the method further comprises encoding data associated with the external processor using a first communication protocol; and encoding data associated with the internal processor using a second communication protocol different from the first communication protocol.
According to a further embodiment, the method further comprises: switching data received via the single communication link to one of the internal processor and external processor based on which one of the first and second protocol of communication the data is encoded.
According to another embodiment, the method further comprises: keeping track of a current position of the pan motor and the tilt motor; and implementing a shortest path algorithm in the external processor for executing future pan motor and tilt commands using the shortest path to a destination.
Features and advantages of the subject matter hereof will become more apparent in light of the following detailed description of selected embodiments, as illustrated in the accompanying figures. As will be realized, the subject matter disclosed and claimed is capable of modifications in various respects, all without departing from the scope of the claims. Accordingly, the drawings and the description are to be regarded as illustrative in nature and not as restrictive and the full scope of the subject matter is set forth in the claims.
Further features and advantages of the present disclosure will become apparent from the following detailed description, taken in combination with the appended drawings, in which:
a and 1b illustrates examples of conventional cameras which are equipped with pan/tilt functionalities;
It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
The present document describes a system for installing in an operation room for providing a remote viewer/doctor with continuous visual access to the proceedings of a surgery (as a fixed target). The system comprises a camera comprising an internal processor for the processing of images/video, a moving platform on which the camera is provided, and pan and tilt motors for moving the camera head. A remote server sends pan/tilt commands for the pan and tilt motors and position commands for the moving platform to change positions. An external processor is provided at the system, which is dedicated to the processing of the pan and tilt commands without delay for panning and/or tilting the camera as the moving platform is changing positions at a rotating speed that allows the remote viewer to have un-interrupted visual access to the proceedings of the surgery.
Cameras used in medical systems for telepresence or the like are often set to monitor a fixed target to allow a doctor to supervise and/or assist in performing the surgery remotely. To do so, the doctor supervising the surgery has to have un-interrupted (continuous) visual access to the proceedings of the surgery. However, the path is not always clear for the camera due to the movements of the nurses/doctors in the operation room. Therefore, when the view is blocked, the position of the camera needs to be changed in order to have a clear perspective of the patient.
An example of the existing systems used in controlling the position of the camera is described in U.S. Pat. No. 6,434,329 which is incorporated herein by reference in its entirety. In such system, processing of the images and the pan/tilt commands is performed by the processor of the camera. As discussed above, priority is given to the image processing and the pan/tilt commands are often delayed which introduces undesired visual interruptions to the remote viewer (doctor).
The following embodiments describe a system which allows for controlling the pan/tilt of a camera provided on a moving platform to continuously monitor a fixed object/target from different positions, and as the platform is moving without latency and without losing the line of sight. In an embodiment, the system reduces the delays in the processing of pan/tilt commands by processing the pan/tilt commands at least partially in parallel to and independently from the image processing. The pan and tilt motors execute the pan and tilt commands at a speed that compensates for the movements of the platform in real time so as to keep monitoring the same target even as the platform is changing positions.
In order to achieve this goal, there is a need for a camera system which can perform both 1) a fast processing of the pan and tilt commands to send these commands to the pan/tilt motors, and 2) a fast response by the pan/tilt motors in order to compensate for the movements of the platform.
In the example shown in
In an embodiment, control of the pan and tilt motors is effected remotely, whereby a remote device (computer) computes the direction of rotation and speed of each of the pan and tilt motors of the camera with respect to the movements of the platform so that the camera keeps monitoring the same target as the platform is moving. The remote device sends the rotation direction and rotation speed of each motor as pan and tilt commands to an electronic system in the surgery room for processing the commands and executing them in the motors.
Communication between the system 20 and the remote device may be effected over a communication network such as WAN, LAN, the internet, a wireless network, an optical network or any combination of the above.
In an embodiment, the system 20 comprises two limit switches 30 and 32 in communication with the external processor 24 for re-positioning the pan motor 26 and tilt motor 28 to a reference position when the system is turned off/on so that the motors start from the same position every time the system is powered on. In an embodiment, the switches may use an IR (Infra-Red) source for re-positioning the pan and tilt motors to the reference position.
Due to the fact that, in the existing systems, processing of the pan/tilt commands and the image processing are performed by the internal processor of the camera, only one communication link 34 exists between the camera in the surgery room and the remote device used for monitoring the proceedings of the surgery. Embodiments of the invention utilize the same communication link 34 to communicate with both the camera 22 and the external processor 24. In the present embodiment, a TCP/IP protocol is used to manage the communication between the remote device and each of the camera 22 and the external processor 24 using an Ethernet switch 36.
The Ethernet switch acts like a hub to redirect the messages received from the remote device to the external processor 24 and the internal processor camera 22 and vice versa. Every time a processor sends a message (command) on the communication link 34, it adds its own IP address as well as the destination IP address. This way, all the other processors connected on the communication link 34 can know if the message is for them and from whom it comes. In an embodiment, the external processor 24 comprises an IP stack and communicates with the remote device using a protocol 38 which is different from the protocol 40 used by the camera 22. Accordingly, the communication link 34 transmits information encoded in accordance with a first protocol 38 for communication with the external processor 24 and a second protocol 40 for communication with the camera 22.
In addition to the pan and tilt commands, the remote device sends to the external processor the Settings of TCP/IP of the board (DHCP vs. Static, IP address, Subnet and Gateway), desired velocity profile for Pan and Tilt motors, and desired current profile for Pan and Tilt motors. In addition to this information, the external processor may send to the remote device the Ethernet MAC address, Homing status (in progress, done, error), and ID and Version of the product.
The external processor 24 processes the PAN/TILT commands at least partially in parallel to the image processing performed by the internal processor of the camera 22. Whereby, the delay is substantially eliminated, and the camera 22 can keep on monitoring the same target without interruption even when the arms are moving. In an embodiment, an H-bridge is connected between the external processor 24 and the pan and tilt motors (26 and 28). The H-bridge enables a voltage to be applied across a load in either direction to allow the pan and tilt motors to run forwards and backwards.
In an embodiment, rotation of the pan motor 26 is endless, while rotation of the tilt motor 28 is limited to a rotation of 180°. In an embodiment, a shortest path algorithm is used in order to create shortcuts and rotate the camera to the desired position in less time. For example, if it is determined that the pan motor needs to make a rotation of 270° to the right, the algorithm, depending on the situation, may substitute the 270° rotation to the right by a rotation of 90° to the left to reach the desired destination.
In an embodiment, the pan motor and the tilt motor are step motors which may be controlled by a series of polarization sequences. Each sequence makes the motor move one step forward or backward. In an embodiment, the external processor keeps track of the position of each motor in order to determine whether the motor should move forward or backward to execute the commands received from the remote device. In an embodiment, the tilt motor 28 performs 960 ticks to rotate 180° and has a speed that varies between 38 and 199 degree/second. By contrast, the pan motor performs 1920 ticks to rotate 360°, and has a speed that varies between 38 and 398 degree/second. In an embodiment, the speed and current limit of the motors can be accelerated and decelerated between the start and end points.
According to an embodiment, the method 700 may further comprise a step of providing the external processor in the moving platform.
According to another embodiment, the method 700 may further comprise the step of connecting the external processor and the internal processor to a single communication link for communicating with the remote viewer.
According to a further embodiment, the method 700 may further comprises the steps of encoding data associated with the external processor using a first communication protocol; and of encoding data associated with the internal processor using a second communication protocol different from the first protocol.
According to another embodiment, the method 700 may further comprise the step of switching data received via the single communication link to one of the internal processor and external processor based on the protocol of communication with which the data is encoded.
According to a further embodiment, the method 700 may further comprise the steps of keeping track of the current position of the pan and tilt motors; and of implementing a shortest path algorithm in the external processor for executing future pan and tilt commands using the shortest path to a destination.
Embodiments can be implemented as a computer program product for use with a computer system. Such implementation may include a series of computer instructions fixed either on a tangible medium, such as a computer readable medium (e.g., a diskette, CD-ROM, ROM, or fixed disk) or transmittable to a computer system, via a modem or other interface device, such as a communications adapter connected to a network over a medium. The medium may be either a tangible medium (e.g., optical or electrical communications lines) or a medium implemented with wireless techniques (e.g., microwave, infrared or other transmission techniques). The series of computer instructions embodies all or part of the functionality previously described herein. Those skilled in the art should appreciate that such computer instructions can be written in a number of programming languages for use with many computer architectures or operating systems. Furthermore, such instructions may be stored in any memory device, such as semiconductor, magnetic, optical or other memory devices, and may be transmitted using any communications technology, such as optical, infrared, microwave, or other transmission technologies. It is expected that such a computer program product may be distributed as a removable medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server over the network (e.g., the Internet or World Wide Web). Of course, some embodiments of the invention may be implemented as a combination of both software (e.g., a computer program product) and hardware. Still other embodiments of the invention may be implemented as entirely hardware, or entirely software (e.g., a computer program product).
While embodiments have been described above and illustrated in the accompanying drawings, it will be evident to those skilled in the art that modifications may be made without departing from this disclosure. Such modifications are considered as possible variants comprised in the scope of the disclosure.
This application claims priority from U.S. provisional Application No. 61/437,206 filed on Jan. 28, 2011.
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/CA2012/000088 | 1/30/2012 | WO | 00 | 8/5/2013 |
| Number | Date | Country | |
|---|---|---|---|
| 61437206 | Jan 2011 | US |
