Patent Application
20210282871
The present disclosure is generally related to a robotic surgical system and, more particularly, to systems and methods for controlling a surgical robotic arm and a surgical instrument.
Surgical robotic systems are currently being used in medical procedures. Some surgical robotic systems include a surgical console controlling a surgical robotic arm and a surgical instrument coupled to and actuated by the robotic arm.
This disclosure generally relates to a surgical robotic system including user interface devices for controlling a surgical robotic arm and a surgical instrument.
In one aspect, the present disclosure provides a surgical robotic system including an image capturing device, a surgical console, a multi-directional indicator, a surgical instrument, and a control tower. The image capturing device is configured to capture an image of a surgical site. The surgical console includes a display configured to display the image of the surgical site. The multi-directional indicator is overlaid over the image of the surgical site on the display. The user input device is operably coupled to the surgical console and configured to receive a user input. The surgical instrument is coupled to a surgical robotic arm. The control tower is configured to receive user input from the user input device and control at least one of the surgical robotic arm or the surgical instrument and a position of the surgical instrument is identified on the multi-directional indicator.
In aspects, the control tower may be configured to transcervically manipulate the surgical instrument within a uterus based on the received user input.
In aspects, at least a portion of the surgical instrument within the uterus may not be visible on the image of the surgical site.
In aspects, the multi-directional indicator may include a center position indicator and at least one outer position indicator positioned radially-spaced from the center position indicator.
In aspects, the position of the surgical instrument may correspond to at least one outer position indicator of the at least one outer position indicators that is on the display.
In aspects, the user input device may be a key pad having a plurality of buttons, each button corresponding one of the indicators of the multi-directional indicator.
In aspects, the user input device is a key pad having a plurality of buttons, each button may be assigned a predetermined position of the surgical instrument.
In aspects, the user input device may be a simulated surgical instrument and the user input may be the movement of the simulated surgical instrument.
In aspects, the surgical instrument and the simulated surgical instrument may be uterine manipulators.
In another aspect, the disclosure provides a method of controlling a surgical instrument of a robotic surgical system. The method includes capturing, by an image capturing device, an image of the surgical site; displaying, on a display, the image of the surgical site; displaying, on the display, a multi-directional indicator overlaid over the image of the surgical site; receiving, from a user input device, a user input; transmitting the user input to a control tower of the robotic surgical system; controlling a surgical instrument of the robotic surgical system based on the user input; and identifying a position of the surgical instrument on the multi-directional indicator.
In aspects, controlling the surgical instrument may include transcervically manipulating the surgical instrument within a uterus.
In aspects, at least a portion of the surgical instrument may not be visible on the displayed image of the surgical site.
In aspects, the method may further include highlighting a position of the surgical instrument on the multi-directional indicator.
In aspects, the multi-directional indicator may include a center position indicator and at least one outer position indicator positioned radially-spaced from the center position indicator.
In aspects, the user input device may be a key pad having buttons corresponding to the multi-directional indicator and receiving the user input may include receiving an actuation signal from one of the buttons.
In aspects, the buttons of the key pad may be assigned predetermined positions of the surgical instrument and controlling the surgical instrument may include moving the surgical instrument to the predetermined position corresponding to the button from which the actuation signal is received.
In aspects, the user input device may be a simulated surgical instrument and receiving the user input may include receiving an input based upon movement of the simulated surgical instrument.
In aspects, the surgical instrument and the simulated surgical instrument may be uterine manipulators.
In another aspect, the disclosure provides a surgical robotic system including an image capturing device, a surgical console, a uterine manipulator, and a simulated uterine manipulator. The image capturing device is configured to capture an image of the surgical site. The surgical console includes a display configured to display the image of the surgical site. The uterine manipulator is coupled to a surgical robotic arm and configured to enable manipulation of a uterus. The simulated uterine manipulator is operably coupled to the surgical console and configured to transmit movement of the simulated uterine manipulator to a control tower such that the control tower causes movement of the uterine manipulator based on the received movement of the simulated uterine manipulator.
In aspects, the display may be further configured to overlay a multi-directional indicator over the image of the surgical site. The multi-directional indicator includes a center position indicator and at least one outer position indicator positioned radially-spaced from the center position indicator. The position of the uterine manipulator may be visually indicated on the multi-directional indicator by highlighting a corresponding one of the at least one outer position indicators of the multi-directional indicator.
The details of one or more aspects of the disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the techniques described in this disclosure will be apparent from the description and drawings, and from the claims.
The presently disclosed surgical robotic systems and methods are described in detail with reference to the drawings, in which like reference numerals designate identical or corresponding elements in each of the several views.
As used herein, the term “clinician” refers to a doctor, nurse, surgeon, or other care provider and may include support personnel.
The term “distal,” as used herein, refers to that portion of the surgical instrument or component thereof, farther from the clinician, while the term “proximal” refers to that portion of the surgical instrument, or component thereof, closer to the clinician.
As used herein, the term “network,” whether plural or singular, as used herein, denotes a data network, including, but not limited to, the Internet, Intranet, a wide area network, or a local area networks, and without limitation as to the full scope of the definition of communication networks as encompassed by the present disclosure. Suitable protocols include, but are not limited to, transmission control protocol/internet protocol (TCP/IP), datagram protocol/internet protocol (UDP/IP), and/or datagram congestion control protocol (DCCP). Wireless communication may be achieved via one or more wireless configurations, e.g., radio frequency, optical, Wi-Fi, Bluetooth (an open wireless protocol for exchanging data over short distances, using short length radio waves, from fixed and mobile devices, creating personal area networks (PANs), ZigBee® (a specification for a suite of high level communication protocols using small, low-power digital radios based on the IEEE 802.15.4-2003 standard for wireless personal area networks (WPANs)).
The present disclosure is directed to systems and methods for controlling a surgical robotic arm and a surgical instrument. More specifically, the present disclosure provides user interface devices of a robotic surgical system configured to manipulate a surgical instrument coupled to a robotic arm of the robotic surgical system.
Various surgical instruments utilized to perform transcervical diagnostic and/or therapeutic surgical tasks may benefit from being capable of attachment to a surgical robotic arm. Uterine manipulators, for example, are often utilized in laparoscopic hysterectomy procedures for, among other tasks, positioning the uterus such that a colpotomy can be performed and the uterus removed. Uterine manipulators are typically controlled manually at the bedside or between the patient's legs. Thus, when adapted for control by a clinician at a surgical console, the controls of the uterine manipulators must be adapted for use in robotic surgical systems.
Referring initially to
The surgical instrument 50 is configured for use during minimally invasive or open surgical procedures. The surgical instrument 51 may be a camera configured to capture video of the surgical site “S” (
The surgical console 30 includes a first display 32, which displays a video feed of the surgical site “S” provided by camera 51, and a second display device 34, which displays a user interface for controlling the surgical robotic system 10. Alternatively, the user interface and video feed may be displayed on the same display, e.g., using a split-screen, side-bar(s), overlay, etc. The surgical console 30 includes a plurality of user input devices e.g., user interface devices, such as foot pedals 36a and a pair of handle controllers 36b which are used by a clinician to remotely control or teleoperate the surgical instrument 100 and/or the robotic arms 40.
The control tower 20 includes a display 23, which may be a touchscreen, and outputs on the graphical user interfaces (GUIs). The control tower 20 also acts as an interface between the surgical console 30 and one or more robotic arms 40. In particular, the control tower 20 is configured to control the robotic arms 40, such as to move the robotic arms 40 and the corresponding surgical instruments 50, 51, based on a set of programmable instructions and/or input commands from the surgical console 30, in such a way that robotic arms 40 and the surgical instruments 50, 51 execute a desired movement sequence in response to input from the user interface devices, e.g., foot pedals 36a and the handle controllers 36b.
Each of the control tower 20, the surgical console 30, and the robotic arm 40 includes a respective computer 21, 31, 41. The computers 21, 31, 41 are interconnected to each other using any suitable communication network based on wired or wireless communication protocols. The computers 21, 31, 41 may include any suitable processor (not shown) operably connected to a memory (not shown), which may include one or more of volatile, non-volatile, magnetic, optical, or electrical media, such as read-only memory (ROM), random access memory (RAM), electrically-erasable programmable ROM (EEPROM), non-volatile RAM (NVRAM), or flash memory. The processor may be any suitable processor (e.g., control circuit) adapted to perform the operations, calculations, and/or set of instructions described in the present disclosure including, but not limited to, a hardware processor, a field programmable gate array (FPGA), a digital signal processor (DSP), a central processing unit (CPU), a microprocessor, and combinations thereof. Those skilled in the art will appreciate that the processor may be substituted for by using any logic processor (e.g., control circuit) adapted to execute algorithms, calculations, and/or set of instructions described herein.
Each of the computers 21, 31, 41 of the surgical robotic system 10 may include a plurality of controllers, which may be embodied in hardware and/or software. The computer 21 of the control tower 20 includes a controller (not shown) configured to receive data from the computer 31 of the surgical console 30 about the current position, orientation, and/or state of the interface devices e.g., the handle controllers 36b and the foot pedals 36a. The computer 21 processes these input positions to determine desired drive commands for each of the robotic arm 40 and/or the instrument drive unit 52 and communicates these to the computer 41 of the robotic arm 40. The computer 21 may also receive actual joint angles and uses the received actual joint angles to determine force feedback commands that are transmitted back to the computer 31 of the surgical console 30 to provide haptic feedback through the interface devices.
The computer 41 includes a plurality of controllers, namely, a main cart controller (not shown), a setup arm controller (not shown), a robotic arm controller (not shown), and an instrument drive unit (IDU) controller (not shown). The main cart controller receives and processes joint commands from the computer 21 and communicates them to the controllers of computer 41, namely the setup arm controller, the robotic arm controller, and the IDU controller. The main cart controller also manages instrument exchanges and the overall state of the movable cart 60, the robotic arm 40, and the instrument drive unit 52. The main cart controller also communicates actual joint angles back to the computer 21.
The setup arm controller controls the setup arm 62 and calculates desired motor movement commands (e.g., motor torque) for the pitch axis and controls the brakes. The robotic arm controller controls the robotic arm 40 and calculates desired motor torques required for gravity compensation, friction compensation, and closed loop position control of the robotic arm 40. The robotic arm controller calculates a movement command based on the calculated torque. The calculated motor commands are then communicated to one or more of the actuators in the robotic arm 40. The actual joint positions are then transmitted by the actuators back to the robotic arm controller.
The IDU controller receives desired joint angles for the surgical instrument 50, such as wrist and jaw angles, and computes desired currents for the motors in the instrument drive unit 52. The IDU controller calculates actual angles based on the motor positions and transmits the actual angles back to the main cart controller.
The robotic arm 40 is controlled as follows. Initially, a pose of the user interface device controlling the robotic arm 40, e.g., the handle controller 36b, is transformed into a desired pose of the robotic arm 40 through a hand eye transform function executed by the computer 21. The hand eye function, as well as other functions described herein, is/are embodied in software executable by the computer 21 or any other suitable controller described herein. The pose of one of the user interface devices may be embodied as a coordinate position and role-pitch-yaw (“RPY”) orientation relative to a coordinate reference frame, which is fixed to the surgical console 30. The desired pose of the surgical instruments 50, 51 are relative to fixed frames on the robotic arm 40. The pose of the user interface device is then scaled by a scaling function executed by the computer 21. In some instances, the coordinate position may be scaled down and the orientation may be scaled up by the scaling function. In addition, the computer 21 also executes a clutching function, which disengages the user interface device from the robotic arm 40. In particular, the main cart computer 21 stops transmitting movement commands from the user interface device to the robotic arm 40 if certain movement limits or other thresholds are exceeded and in essence acts like a virtual clutch mechanism, e.g., limits mechanical input from effecting mechanical output.
The desired pose of the robotic arm 40 is based on the pose of the user interface device and is then passed by an inverse kinematics function executed by the computer 21. The inverse kinematics function calculates angles for the joints of the robotic arm 40 that achieve the scaled and adjusted pose input by the user interface device. The calculated angles are then passed to the robotic arm controller, which includes a joint axis controller having a proportional-derivative (PD) controller, the friction estimator module, the gravity compensator module, and a two-sided saturation block, which is configured to limit the commanded torque of the motors of the joints of the robotic arm 40.
With reference to
The end effector 160 of the uterine manipulator 100 includes a stop 150, an elongated shaft 180, a balloon 184, and an aperture 188. The stop 150 is configured to abut a cervix (not shown) to stabilize the uterus (not shown), to define a maximum insertion depth of the uterine manipulator 100, and/or prevent the loss of insufflation gases from the uterus. The elongated shaft 180 defines an atraumatric distal tip 182 and is configured to facilitate insertion of the end effector assembly 160 through the cervix and into the uterus. The balloon 184 is supported on the elongated shaft 180 proximally spaced from the atraumatric distal tip 182 and adapted to connect to a fluid source (not shown) and aperture 188. The aperture 188 is in communication with the interior of the balloon 184 to enable selective inflation or deflation of the balloon 184. The inflation of the balloon 184 causes the balloon 184 to contact the interior wall of the uterus to stabilize the end effector assembly 160, thereby allowing manipulation of the end effector assembly 160 via the user interface devices and pivots 140, 145.
The uterine manipulator 100, as noted above, includes robotic arm interface housing 120 disposed at a proximal end portion 112 of the body 110. As also noted above, the uterine manipulator 100 includes proximal pivot 140 pivotably coupling the robotic arm interface housing 120 with the body 110 at the proximal end portion 112 of the body 110. The actuation linkage 135 may extend through the body 110 and operably couples robotic arm interface housing 120 with the distal connector 130 to enable pivoting of the distal connector 130 relative to the body 110. More specifically, the robotic arm interface housing 120 may be operably coupled to the robotic arm 40 and pivoting of the robotic arm interface housing 120 relative to the body 110 about the proximal pivot 140 correspondingly pivots the distal connector 130 relative to the body 110 about the distal pivot 145 according to drive commands from the computer 21 to the computer 41 of the robotic arm 40 based on user input from the user interface device.
With reference to
The computer 31 is further configured to identify the position of the uterine manipulator 100 and highlight on the first display 32 the center position indicator 210 or the relevant outer position indicator(s) 250 of the multi-directional configuration 200 corresponding to the position of the uterine manipulator 100. In this manner, even where the uterine manipulator 100 or portions thereof are not visible on the video feed of the surgical site “S,” the position and/or orientation thereof can be readily identified via the multi-directional configuration 200.
With reference to
Referring to
With reference to
Referring generally to
An image of the surgical site is captured by camera 51 and displayed on display 32. The multi-directional configuration 200 is displayed over the image of the surgical site provided on display 32, centering the center position indicator 210 of the multi-directional configuration 200 over the vagina (or other chosen central anatomy) in the image of the surgical site.
In order to perform a surgical task, the clinician manipulates the simulated uterine manipulator 300, the joystick 36d, the foot pedals 36a, and/or handles controller 36b in a desired angular direction, to thereby pivot the distal connector 130 of the uterine manipulator 100 relative to the body 110 such that the end effector assembly 160 is articulated in the desired angular direction causing the uterus to be moved in the desired angular direction, due to the stabilization of the end effector assembly 160 within the uterus. In some instances, the clinician actuates a button of the keypad 36e corresponding to a desired position of the uterine manipulator 100, to thereby articulate the end effector assembly 160 of the uterine manipulator 100 to the desired position indicated by the clinician.
Once the uterine manipulator 100 is actuated to the desired angular direction or desired position, the position or angular direction of the end effector 160 of the uterine manipulator 100 is identified and highlighted on the multi-directional configuration 200. In particular, the center position indicator 210 or outer position indicators 250 of the multi-direction configuration 200 is highlighted based on one or more of the actual position, the actual angular direction, or the pre-programmed position assigned by the clinician.
Persons skilled in the art will understand that the structures and methods specifically described herein and shown in the accompanying figures are non-limiting exemplary embodiments, and that the description, disclosure, and figures should be construed merely as exemplary of particular embodiments. It is to be understood, therefore, that the present disclosure is not limited to the precise embodiments described, and that various other changes and modifications may be effected by one skilled in the art without departing from the scope or spirit of the disclosure. Additionally, the elements and features shown or described in connection with certain embodiments may be combined with the elements and features of certain other embodiments without departing from the scope of the present disclosure, and that such modifications and variations are also included within the scope of the present disclosure. It should also be understood that, depending on the example, certain acts or events of any of the processes or methods described herein may be performed in a different sequence, may be added, merged, or left out altogether (e.g., all described acts or events may not be necessary to carry out the techniques). Accordingly, the subject matter of the present disclosure is not limited by what has been particularly shown and described.
This application claims the benefit of U.S. Provisional Application Ser. No. 62/987,812, filed Mar. 10, 2020, the entire contents of which are incorporated by reference herein.
| Number | Date | Country | |
|---|---|---|---|
| 62987812 | Mar 2020 | US |
