The present invention generally relates to transeesophageal echocardiography (“TEE”) probes. The present invention specifically relates to a remote robotic actuation of the TEE probe during an interventional procedure.
Transesophageal echocardiography is commonly used to visualize cardiac anatomy and interventional devices during treatment for structural heart disease (“SHD”).
In practice, the operating conditions of
The second challenge is x-ray exposure. Specifically, a length of TEE probe 14 results in the positioning of echocardiographer 13 in close proximity to the source of interventional x-ray system, thus maximizing the x-ray exposure of echocardiographer 13 over the course of the procedure.
The third challenge is communication and visualization. During certain phases of a procedure, cardiologist 15 and echocardiographer 13 must be in constant communication as cardiologist 15 instructs echocardiographer 13 as to which structure to visualize. Given the difficulty interpreting a 3D ultrasound volume, and the different co-ordinate systems displayed by the x-ray and ultrasound systems, it can be challenging for echocardiographer 13 to understand the intentions of cardiologist 15.
The present invention provides a remote robotic actuation system to address operational challenges associated with an interventional tool, particularly a TEE probe. Generally, as shown in
One form of the present invention is a replica control tool for remotely controlling a robotic actuator that robotically controls a control handle of an interventional tool (e.g., a probe, a catheter, flexible scopes, etc.), which in turn actuates a distal end of the interventional tool. The replica control tool employs a replica control handle substantially being a replica of a structural configuration of the control handle of the interventional tool, and a control input device (e.g., a joystick or a trackball) movable relative to the replica control handle. The replica control tool further employs a robotic actuator controller for remotely controlling a deflection of a distal end of the interventional tool by the robotic actuator responsive to any movement of the control device relative to the replica control handle. The replica control tool further employs an electromechanical device (e.g., an accelerometer) co-rotatable with the replica control handle whereby the robotic actuator controller further remotely controls a rotation of the distal end of the interventional tool by the robotic actuator in response to a co-rotation of the electromechanical device with the replica control handle.
For purposes of the present invention, the term “controller” broadly encompasses all structural configurations of an application specific main board or an application specific integrated circuit housed within or linked to a computer or another instruction execution device/system for controlling an application of various inventive principles of the present invention as subsequently described herein. The structural configuration of the application controller may include, but is not limited to, processor(s), computer-usable/computer readable storage medium(s), an operating system, peripheral device controller(s), slot(s) and port(s). Examples of a computer include, but are not limited to, a server computer, a client computer, a workstation and a tablet.
A second form of the present invention is a robotic actuation system employing the robotic actuator and the replica control tool.
The foregoing forms and other forms of the present invention as well as various features and advantages of the present invention will become further apparent from the following detailed description of various embodiments of the present invention read in conjunction with the accompanying drawings. The detailed description and drawings are merely illustrative of the present invention rather than limiting, the scope of the present invention being defined by the appended claims and equivalents thereof.
To facilitate an understanding of the present invention, exemplary embodiments of a robotic actuation system of the present invention and various components therefore will now be described in the context of a remote control actuation of a TEE probe as shown in
For purposes of the present invention, the terms of the art including, but not limited to, “deflection”, “joystick”, “accelerometer”, “light emitting diode”, “actuation”, “robotic”, “robotic actuator”, “workstation”, “input device” and “electromechanical device” are to be interpreted as known in the art of the present invention.
Referring to
A robotic actuator 50 as known in the art provides a mechanical control of yaw actuation dial 43 and pitch actuation dial 44 for deflecting the distal tip of probe 41 in an anterior direction, a posterior direction, a lateral left direction, a lateral right direction or a combination thereof.
Robotic actuator 50 as known in the art may further provide a mechanical control of a translation along and/or a rotation about a longitudinal axis of TEE probe 40 as symbolically shown by the dashed line extending through TEE probe 40.
A robotic workstation 62 as known in the art has controller(s) installed therein for communicating control commands to robotic actuator 50 via an operator's use of an interface platform 61. Typically, the operator will interact with interface platform 61 to strategically navigate probe 41 via selective deflections, translations and/or rotations of probe 41 within a patient as illustrated by on overlay of probe 41 on a x-ray image or other volume image displayed by a monitor 60.
The present invention provides a replica TEE control tool 70 having a replica control handle 71 substantially being a replica of a structural configuration of TEE control handle 42. In practice, replica control handle 71 may be constructed in the same manner as TEE control handle 42 with the inside of replica control handle 71 being hollowed out for placement of electronic, electromechanical, mechanical and/or other components for implementing the inventive principles of the present invention.
One such inventive principle of the present invention is the replacement of dials 43 and 44 with a control input device 72 including, but not limited to, duplicates of dials 43 and 44, a two-axis thumb joystick and/or a two-axis tracker ball. Control input device 72 allows for an easy and more intuitive control of probe 41. Specifically, lateral left-right motion of control input device 72 is mapped to a lateral left-right deflection of probe 41, and an up-down motion of control input device 72 is mapped to an anterior-posterior deflection of probe 41.
For example, referring to
Referring back to
Still referring to
An unlimited example of electromechanical device is a three-axis accelerometer whereby a rotation of replica control handle 71 may be calculated using the data obtained from the three-axis accelerometer. This calculation may happen either on a microcontroller (not shown) within replica control handle 71 or within the robotic workstation 62.
The present invention provides multiple rotation modes, three (3) of which are now described herein.
Vertical Base Mode.
If replica control handle 71 is rotated to a certain delineated angle to vertical (e.g., 90° as shown in
Fail Safe Mode.
To prevent an accidental rotation of replica control handle 71, a fail-safe (aka “dead man's switches”) may be integrated into delineated degree mode of replica control handle 71. In this mode, robotic actuator 50 does not rotate probe 41 until replica control handle 71 is rotated past the delineated threshold angle and the fail safe is activated.
Relative Roll Mode.
A rotation activation of replica control handle 71 records a current roll position of replica control handle 71, but probe 41 is not actuated at that time. After rotation activation, when replica control handle 71 is then rotated past a delineated threshold angle from that recorded roll angle (e.g., 30°), then robotic actuator 50 rotates probe 41 in the corresponding direction (clockwise or counter-clockwise).
To facilitate a further understanding of the present invention, embodiments 50a and 70a of respective robot actuator 50 and replica control tool 70 will now be described herein.
Referring to
Deflection actuator 51 is mechanically engaged as known in the art with dials 43 and 44 of TEE probe 40. Workstation 62 provides control commands to motor controller(s) (not shown) of deflection actuator 51 for actuating dials 43 and 44 to execute a deflection of a probe 41 (not shown) of TEE probe 40 corresponding to a mapped motion of control input device 72 of replica control tool 70.
Axial translation actuator 52 and axial rotation actuator 53 are mechanically coupled to deflection actuator 51.
Axial translation actuator 52 as known in the art may be actuated to translate TEE control handle 42 along its longitudinal axis. Workstation 62 provides control commands to a motor controller (not shown) of axial translation actuator 52 to actuate an axial translation of TEE control handle 42.
Axial rotation actuator 53 as known in the art may be actuated to rotate TEE control handle 42 along its longitudinal axis. Workstation 62 provides control commands to a motor controller (not shown) of axial rotation actuator 53 to execute a rotation of TEE control handle 42 corresponding to a mapped rotation of electromechanical device 73 of replica control tool 70.
Referring to
Lower half 71b contains cut-outs to house the electronics including a robotic actuator controller and a communication controller. Specifically, a printed circuit board (“PCB”) 75a holds thumb joystick 72 (e.g., a two axis 30KΩ potentiometer) and a three-axis accelerometer (not shown) (e.g., a three-axis accelerometer from STMicroelectronics). PCB 75a also contains a robotic actuator controller in the form of a microcontroller chip (e.g., microcontroller manufactured by Renesas) to interpret signals from thumb joystick 72 and the accelerometer and to output data in appropriate format for workstation 62 (e.g., an I2C format.) PCB 75a may be held securely in place by a PCB holder (not shown for clarity) that is inserted onto a keyed boss (not shown for clarity) on lower half 71b of replica control handle 70a. The PCB holder also holds two membrane switches 74a at a 90° angle from the joystick/accelerometer for use as buttons to replicate buttons 45 on TEE probe handle 42 (
A second area of lower half 71b houses a communication controller 76a (e.g., a Teensy 3.0 microcontroller board). Communication controller 76a processes the I2C input from the joystick, accelerometer, and buttons and output the data over a universal serial bus (“USB”) to workstation 62 either as a simulated serial port or as a game controller, the latter allowing for easy integration into any software application. A channel and hole (not shown) is cut out an end of lower half 71b to allow wires to pass from controller 76a to workstation 62 and to house a USB connector.
Alternatively, the communication between replica control handle 70a and workstation 62 occurs through a wireless communication instead of wired USB. In the wireless mode, communication controller 76 is implemented as a wireless module (e.g., Bluetooth or Wi-Fi) and a battery pack. This embodiment allows for more freedom of motion and positioning.
Also alternatively, communication controller 76a may be omitted and PCB 75a may be equipped with communication components, and the controllers may be installed within workstation 62.
In practice, bosses (not shown) may be utilized to properly align cover 71c with lower half 71b, which may be secured to lower half 71b via screws.
Also, upper half 71a of replica control handle 70a may be solid and integrated with lower half 71b, or may be hollow and directly attached to lower half 71b via a threaded screw connector (not shown). The hollow embodiment of upper half 71a prevents replica control handle 70a from being top heavy.
Further, an LED or laser 77 may be placed within a hollow upper half 71a (e.g., with in a screw connector) whereby LED or laser 77 lights up to indicate to the user a specific event has occurred. For example, the LED/laser 77 may light up when a button 74a is pressed. A multi-color LED may be used to indicate different events. For example, one color may be used to indicate a button 74a has been pressed and another color may indicate the delineated threshold angle has been surpassed and TEE probe 40 is being rotated.
Still further, a vibration mechanism (not shown) may be the assembly to give the clinician/technician haptic feedback. This feedback can be used when specific events are triggered. For example, the replica can be made to vibrate when a button 74a is pressed, TEE probe 40 is being actuated, or when the force measure on TEE probe 40 exceeds a chosen threshold. For this embodiment, force feedback requires a force sensing technique implement by TEE probe 40, either through physical force sensors or by estimation of current forces using the measured currents drawn by the actuating motors.
Referring to
Furthermore, as one having ordinary skill in the art will appreciate in view of the teachings provided herein, features, elements, components, etc. described in the present disclosure/specification and/or depicted in the
Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (e.g., any elements developed that can perform the same or substantially similar function, regardless of structure). Thus, for example, it will be appreciated by one having ordinary skill in the art in view of the teachings provided herein that any block diagrams presented herein can represent conceptual views of illustrative system components and/or circuitry embodying the principles of the invention. Similarly, one having ordinary skill in the art should appreciate in view of the teachings provided herein that any flow charts, flow diagrams and the like can represent various processes which can be substantially represented in computer readable storage media and so executed by a computer, processor or other device with processing capabilities, whether or not such computer or processor is explicitly shown.
Furthermore, exemplary embodiments of the present invention can take the form of a computer program product or application module accessible from a computer-usable and/or computer-readable storage medium providing program code and/or instructions for use by or in connection with, e.g., a computer or any instruction execution system. In accordance with the present disclosure, a computer-usable or computer readable storage medium can be any apparatus that can, e.g., include, store, communicate, propagate or transport the program for use by or in connection with the instruction execution system, apparatus or device. Such exemplary medium can be, e.g., an electronic, magnetic, optical, electromagnetic, infrared or semiconductor system (or apparatus or device) or a propagation medium. Examples of a computer-readable medium include, e.g., a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), flash (drive), a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk read only memory (CD-ROM), compact disk read/write (CD-R/W) and DVD. Further, it should be understood that any new computer-readable medium which may hereafter be developed should also be considered as computer-readable medium as may be used or referred to in accordance with exemplary embodiments of the present invention and disclosure.
Having described preferred and exemplary embodiments of novel and inventive replica control tools, (which embodiments are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons having ordinary skill in the art in light of the teachings provided herein, including the
Moreover, it is contemplated that corresponding and/or related systems incorporating and/or implementing the device or such as may be used/implemented in a device in accordance with the present disclosure are also contemplated and considered to be within the scope of the present invention. Further, corresponding and/or related method for manufacturing and/or using a device and/or system in accordance with the present disclosure are also contemplated and considered to be within the scope of the present invention.
This application is the U.S. National Phase application under 35 U.S.C. § 371 of International Application No. PCT/IB2015/059426, filed on Dec. 8, 2015, which claims the benefit of U.S. Provisional Patent Application No. 62/092,299, filed on Dec. 16, 2014. These applications are hereby incorporated by reference herein.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2015/059426 | 12/8/2015 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2016/097926 | 6/23/2016 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
6425865 | Salcudean | Jul 2002 | B1 |
6726675 | Beyar | Apr 2004 | B1 |
7641650 | Boese | Jan 2010 | B2 |
7753851 | Nilsson | Jul 2010 | B2 |
8257302 | Beyar | Sep 2012 | B2 |
8740840 | Foley | Jun 2014 | B2 |
8961533 | Stahler | Feb 2015 | B2 |
9265581 | Navve | Feb 2016 | B2 |
10010699 | Cohen | Apr 2018 | B2 |
20020177843 | Anderson | Nov 2002 | A1 |
20070043338 | Moll | Feb 2007 | A1 |
20070233044 | Wallace | Oct 2007 | A1 |
20080009791 | Cohen | Jan 2008 | A1 |
20120071752 | Sewell | Mar 2012 | A1 |
20120078080 | Foley | Mar 2012 | A1 |
20120143353 | Kishi | Jun 2012 | A1 |
20120184955 | Pivotto | Jul 2012 | A1 |
20130002895 | Mcclung | Jan 2013 | A1 |
20130172906 | Olson | Jul 2013 | A1 |
20140276392 | Wong | Sep 2014 | A1 |
20140316433 | Navve | Oct 2014 | A1 |
20150230697 | Phee | Aug 2015 | A1 |
20170157361 | Barrish | Jun 2017 | A1 |
Number | Date | Country |
---|---|---|
1782744 | May 2007 | EP |
H0288025 | Mar 1990 | JP |
2009120948 | Oct 2009 | WO |
2010078344 | Jul 2010 | WO |
Number | Date | Country | |
---|---|---|---|
20170360518 A1 | Dec 2017 | US |
Number | Date | Country | |
---|---|---|---|
62092299 | Dec 2014 | US |