System and method of automatic detection of obstructions for a robotic catheter system

Information

  • Patent Grant
  • 10426557
  • Patent Number
    10,426,557
  • Date Filed
    Monday, April 4, 2016
    8 years ago
  • Date Issued
    Tuesday, October 1, 2019
    5 years ago
Abstract
An obstruction detection system for a robotic catheter system including a robotic catheter manipulator assembly including one or more catheter manipulation bases and one or more sheath manipulation bases. Each manipulation base may be generally linearly movable on one or more tracks relative to the robotic catheter manipulator assembly. The obstruction detection system may include one or more obstruction detection sensors disposed on the track or on the manipulation bases to detect an obstruction along a path of motion of one or more manipulation bases. A software system may be provided for monitoring movement of the catheter and sheath manipulation bases, and/or a status of the obstruction detection sensors.
Description
BACKGROUND OF THE INVENTION

a. Field of the Invention


This invention relates to a robotic catheter system and method for automated control of a catheter and related components. In particular, the instant invention relates to a robotic catheter system including a system and method for detection of obstructions that may hinder or otherwise stop movement of catheter and/or sheath manipulation bases, and related components during operation of the robotic catheter system.


b. Background Art


Electrophysiology catheters are used in a variety of diagnostic and/or therapeutic medical procedures to correct conditions such as atrial arrhythmia, including for example, ectopic atrial tachycardia, atrial fibrillation, and atrial flutter. Arrhythmia can create a variety of dangerous conditions including irregular heart rates, loss of synchronous atrioventricular contractions and stasis of blood flow which can lead to a variety of ailments and even death.


Typically in a procedure, a catheter is manipulated through a patient's vasculature to, for example, a patient's heart, and carries one or more electrodes which may be used for mapping, ablation, diagnosis, or other treatments. Once at the intended site, treatment may include radio frequency (RF) ablation, cryoablation, lasers, chemicals, high-intensity focused ultrasound, etc. An ablation catheter imparts such ablative energy to cardiac tissue to create a lesion in the cardiac tissue. This lesion disrupts undesirable electrical pathways and thereby limits or prevents stray electrical signals that lead to arrhythmias. As readily apparent, such treatment requires precise control of the catheter during manipulation to and at the treatment site, which can invariably be a function of a user's skill level.


One method of minimizing invariability due to a user's skill level involves the use of robotic catheter systems, such as the robotic catheter system described in detail in commonly owned and copending application Ser. No. 12/347,811 titled “Robotic Catheter System”. As readily evident, such robotic catheter systems include a variety of safety concerns that must be addressed to prevent harm to a patient and the system operator. One such safety concern includes the possibility of an obstruction in the path of manipulation bases supporting the catheter and sheath cartridges, the layout and operation of which is also described in detail in the aforementioned “Robotic Catheter System” application.


The inventors herein have thus recognized the need for a system and method for detection of obstructions that may hinder or otherwise stop movement of manipulation bases and related components, and have further recognized the need for a system and method for controlling movement of the manipulation bases in a predetermined manner based on the type and location of an obstruction and other factors involving movement of the manipulation bases.


BRIEF SUMMARY OF THE INVENTION

An obstruction detection system for a robotic catheter system may include a robotic catheter manipulator assembly including one or more catheter and sheath manipulation bases, with each manipulation base being generally linearly movable on one or more tracks relative to the robotic catheter manipulator assembly. The obstruction detection system may include one or more obstruction detection sensors disposed on the track and/or on the manipulation bases to detect an obstruction along a path of motion of the manipulation bases.


For the obstruction detection system described above, in one embodiment, the obstruction detection sensors may be ultrasonic sensors or light-emitting sensors. In one embodiment, the obstruction detection system may include obstruction detection sensors located t both ends of the track. In another embodiment, the obstruction detection system may include obstruction detection sensors located at both longitudinal ends of the catheter and sheath manipulation bases. In one embodiment of the obstruction detection system) the obstruction detection sensors enable maintenance of a predetermined distance between the catheter and sheath manipulation bases.


For the obstruction detection system described above, in one embodiment, the system may include a software system for monitoring movement of the catheter and sheath manipulation bases, and/or a sensor status of one or more obstruction detection sensors. In one embodiment of the obstruction detection system, the software system may include code for determining if a relative distance between the catheter and sheath manipulation bases is less than a predetermined distance; if the relative distance is less than the predetermined distance, then indicating an obstruction status of the catheter and sheath manipulation bases as obstructed, and stopping motion of the catheter and sheath manipulation bases, and if the relative distance is greater than or equal to the predetermined distance, then indicating the obstruction status of the catheter and sheath manipulation bases as unobstructed, and allowing motion of the catheter and sheath manipulation bases. In another embodiment, the obstruction detection system may include LEDs, visual signals, audible signals, and/or haptic feedback to a user input device, for indicating the obstruction status of the catheter and sheath manipulation bases.


For the obstruction detection system described above, in one embodiment, the system may include code for determining a relative distance between the catheter and sheath manipulation bases by determining an amount of rotation of motors that drive the catheter and sheath manipulation bases. In one embodiment of the obstruction detection system, the software system may include code for stopping motion of the catheter and sheath manipulation bases if the sensor status of the obstruction detection sensors is obstructed, and allowing motion of the catheter and sheath manipulation bases if the sensor status of all obstruction detection sensors is unobstructed.


For the obstruction detection system described above, in one embodiment, the system may include code for determining a direction of travel of the catheter and sheath manipulation bases, and allowing motion of the catheter and sheath manipulation bases if the sensor status of one of the obstruction detection sensors is obstructed, only if the direction of travel is away from the obstruction. In one embodiment of the obstruction detection system, the software system may include code for determining a direction of travel of the catheter and sheath manipulation bases by determining a direction of rotation of motors that drive the catheter and sheath manipulation bases.


For the obstruction detection system described above, in one embodiment, the system may include LEDs, visual signals, audible signals, and/or haptic feedback to a user input device, for indicating the sensor status of the obstruction detection sensor. In one embodiment of the obstruction detection system, the software system may monitor the manipulation bases and the obstruction detection sensors by means of a CANOpen protocol standard.


The invention also provides an obstruction detection system for a robotic catheter system including a robotic catheter manipulator assembly including one or more catheter manipulation bases and one or more sheath manipulation bases, with each manipulation base being generally linearly movable on one or more tracks relative to the robotic catheter manipulator assembly. The obstruction detection system may include detection means disposed on the track or on the manipulation bases to detect an obstruction along a path of motion of the manipulation bases, and monitoring means for monitoring movement of the catheter and sheath manipulation bases, and/or a detection status of the detection means.


For the obstruction detection system described above, in one embodiment, the detection means may be an ultrasonic sensor or a light-emitting sensor. In one embodiment of the obstruction detection system, the detection means may include obstruction detection sensors located at both ends of the track, in another embodiment of the obstruction detection system, the detection means may include Obstruction detection sensors located at both longitudinal ends of the catheter and sheath manipulation bases. In one embodiment of the obstruction detection system, the obstruction detection sensors may enable maintenance of a predetermined distance between the catheter and sheath manipulation bases.


For the obstruction detection system described above, in one embodiment, the system may include monitoring means in the form of a software system including code for determining if a relative distance between the catheter and sheath manipulation bases is less than a predetermined distance; if the relative distance is less than the predetermined distance, then indicating an obstruction status of the catheter and sheath manipulation bases as obstructed, and stopping motion of the catheter and sheath manipulation bases, and if the relative distance is greater than or equal to the predetermined distance, then indicating the obstruction status of dm catheter and sheath manipulation bases as unobstructed, and allowing motion of the catheter and sheath manipulation base.


For the obstruction detection system described above, in one embodiment, the system may include meals for indicating the obstruction status of the catheter and sheath manipulation bases. In one embodiment of the obstruction detection system, the means for indicating may include LEDs, visual signals, audible signal, and/or haptic feedback a user input device.


For the obstruction detection system described above, in one embodiment, the system may include monitoring means in the form of a software system including code for determining a relative distance between the catheter and sheath manipulation bases by determining an amount of rotation of motors that drive the catheter and sheath manipulation bases.


For the obstruction detection system described above, in one embodiment, the system may include monitoring means in the form of a software system including code for stopping motion of the catheter and sheath manipulation bases if the detection status of the obstruction detection sensors is obstructed, and allowing motion of the catheter and sheath manipulation bases if the detection status of all obstruction detection sensors is unobstructed. In one embodiment of the obstruction detection system, the monitoring means may be a software system including code for determining a direction of travel of the catheter and sheath manipulation bases and allowing motion of the catheter and sheath manipulation bases if the detection status of one of the obstruction detection sensors is obstructed, only if the direction of travel is away from the obstruction. In one embodiment of the obstruction detection system, the monitoring means may be a software system including code for determining a direction of travel of the catheter and sheath manipulation bases by determining a direction of rotation of motors that drive the catheter and sheath manipulation bases.


For the obstruction detection system described above, in one embodiment, the system may inc kale means for indicating the detection status of the obstruction detection sensor. In one embodiment of the obstruction detection system, the means for indicating may include LEDs, visual signals, audible signals, and/or haptic feedback to a user input device. In one embodiment of the obstruction detection system, the monitoring means may monitor the manipulation bases and the detection means by means of a CANOpen protocol standard.


The foregoing and other aspects, features, details, utilities and advantages of the present invention will be apparent from reading the following description and claims, and from reviewing the accompanying drawings.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is an isometric diagrammatic view of a robotic catheter system, illustrating an exemplary layout of various system components;



FIG. 2 is an enlarged isometric view of an exemplary robotic catheter manipulator assembly, also shown in FIG. 1;



FIGS. 3a-3c are enlarged isometric views of an embodiment of a robotic catheter manipulator assembly, and FIGS. 3d-3g are respectively enlarged left side, right side, top and front views of the robotic catheter manipulator assembly of FIG. 3a, illustrating use of the manipulator assembly with a robotic catheter rotatable device cartridge;



FIGS. 4a-4c are enlarged isometric views of an embodiment of a manipulation base;



FIGS. 5a-5e are enlarged isometric views of an embodiment of a robotic catheter device cartridge, with FIG. 3a illustrating an exemplary usage of the robotic catheter device cartridge;



FIG. 6 is a sketch illustrative of exemplary placement of obstruction detection sensors for the obstruction detection system according to the invention; and



FIG. 7 is a flow-chart of the control logic for the obstruction detection system according the invention.





DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

Referring now to the drawings wherein like reference numerals are used to identify identical components in the various views, an embodiment of robotic catheter system 10 (described in detail in commonly owned and copending application Ser. No. 12/347,811 titled “Robotic Catheter System”), also referred to as “the system,” may be likened to “fly by wire” operation for a catheter system. The system may be used, for example, to manipulate the location and orientation of catheters and sheaths in a heart chamber or in another body cavity. As shown in FIG. 1, robotic catheter system 10 may generally incorporate a human input device and control system (referred to as “input control system”) 100, e.g., a joystick and related controls (described briefly below and in detail in commonly owned and copending Application Serial No. PCT/US2009/038618 titled “Robotic Catheter System Input Device”), that a user such as an electrophysiologist (EP) may interact with, an electronic control system 200 (described briefly below and in detail in commonly owned and copending Application Serial No. PCT/US2009/038597 titled “Robotic Catheter System with Dynamic Response”) that translates motions of the user at the input device into a resulting movement of a catheter tip, and a visualization system 12 that provides a user with real-time or near-real-time positioning information concerning the catheter tip. The system may further include closed-loop feedback using an EnSite NavX™ Navigation and Visualization system 14 and/or optical force transducers, a robotic catheter manipulator assembly 300 (described briefly below and in detail in commonly owned and copending application Ser. No. 12/347,826 titled “Robotic Catheter Manipulator Assembly”) for operating a robotic catheter device cartridge 400 (described briefly below and in detail in commonly owned and copending application Ser. No. 12/347,835 titled “Robotic Catheter Device Cartridge” and application Ser. No. 12/347,842 “Robotic Catheter Rotatable Device Cartridge”), and manipulator support structure 500 (described briefly below and in detail in commonly owned and copending application Ser. No. 12/347,811 titled “Robotic Catheter System”). As discussed in detail below, robotic catheter system 10 may include an obstruction detection system 600 for detection of obstructions that may hinder or otherwise stop movement of catheter and sheath manipulation bases, and related components during operation of the robotic catheter system. The respective disclosures of the above-identified and other commonly owned and copending applications discussed in this application are incorporated herein by reference.


Before proceeding with a detailed description of obstruction detection system 600, the general layout and operation of the components of robotic catheter system 10 will be described with reference to FIGS. 1-5e to provide a basis for the operation of obstruction detection system 600.


An embodiment of robotic catheter system 10 may involve automated catheter movement. A user, such as an EP, could identify locations (potentially forming a path) on a rendered computer model of the cardiac anatomy. The system can be configured to relate those digitally selected points to positions within a patient's actual/physical anatomy, and may command and control the movement of a catheter to defined positions. Once in position, either the user or system could then perform the desired treatment or therapy—which may further be in accordance with a defined algorithm. This system could enable full robotic control by using optimized path planning routines together with closed-loop position control. Furthermore, the system could automate certain “best-practices,” such as pulling the catheter across the surface, or making contact at an oblique angle.


Referring to FIG. 1, input control system 100, described below and in commonly owned and copending application titled “Robotic Catheter System Input Device,” may generally allow a user to control the movement and advancement of both the catheter and sheath. Generally, several types of joysticks may be employed, including, without limitation, instrumented traditional catheter handle controls, oversized catheter models, instrumented, user-wearable gloves, and traditional joysticks. In embodiments, for example and without limitation, the joystick may be spring or motor centering so that any movement from the center position causes an incremental movement of the actual catheter tip, or the joystick may work in absolute terms.


Referring to FIG. 1, electronic control system 200 will be described briefly.


As discussed in detail in commonly owned and copending applications titled “Robotic Catheter System Input Device,” and “Robotic Catheter System with Dynamic Response,” many additional features may be included with embodiments of the system to, for example, improve the accuracy or effectiveness of the system. Such features may include, closed-loop feedback using EnSite NavX™ Navigation and Visualization system 14 for creating realistic cardiac chamber geometries or models, displaying activation timing and voltage data to identify arrhythmia, and guiding precise catheter movement, and/or optical force transducers; active tensioning of “passive” steering wires to reduce the system response time; cumulative ablation while the tip is following a front-to-back ironing motion; and/or reactive/resistive impedance monitoring.


Referring to FIG. 1, visualization system 12 will be described briefly.


Visualization system 12 may provide a user with real-time or near-real-time positioning information concerning the catheter tip. In an exemplary embodiment, system 12 may include an EnSite NavX™ Navigation and Visualization monitor 16 for displaying cardiac chamber geometries or models, displaying activation timing and voltage data to identify arrhythmias, and for facilitating guidance of catheter movement. A fluoroscopy monitor 18 may be provided for displaying a real-time x-ray image or for assisting a physician with catheter movement. Additional exemplary displays may include an ICE and EP Pruka displays, 20, 22, respectively.


Referring to FIG. 1, EnSite NavX™ Navigation and Visualization system 14 will be described briefly.


EnSite NavX™ Navigation and Visualization system 14 (described in detail in U.S. Pat. No. 7,263,397, titled “Method and Apparatus for Catheter Navigation and Location and Mapping in the Heart,” incorporated by reference in its entirety) may be provided for creating realistic cardiac chamber geometries or models, displaying activation timing and voltage data to identify arrhythmias, and guiding precise catheter movement. System 14 may collect electrical data from catheters and use this information to track or navigate their movement and construct three-dimensional (3-D) models of the chamber.


Referring to FIGS. 1-5e, robotic catheter manipulator assembly 300 for operating robotic catheter device cartridges 400, various embodiments of which are described in detail in the aforementioned commonly owned and copending applications, will be described briefly for facilitating an understanding of input control system 100, and the operational integration of an haptic feedback system 900 with manipulator assembly 300 for controlling cartridges 400.


As generally shown in FIGS. 1 and 3a-5e, robotic catheter system 10 which includes one or more robotic catheter manipulator assemblies 300, includes an embodiment of robotic catheter manipulator assembly 302 including both catheter and sheath manipulation mechanisms 304, 306 for manipulating, for example, catheter and sheath cartridges 402, 404. Manipulator assembly 302 may include interconnected/interlocking manipulation bases 308, 310 for catheter and sheath cartridges 402, 404, and likewise may include electrical “handshake” functionality as discussed below. Each interlocking base 308, 310 may be capable of travel in the longitudinal direction of the catheter/sheath (D1, D2, respectively). In an embodiment, D1 and D2 may each represent a translation of approximately 8 linear inches. As shown in FIG. 3a, each interlocking base may be translated by high precision drive mechanisms 312, 314. Such drive mechanisms may include, for example and without limitation, a motor driven lead screw or ball screw.


As shown in FIGS. 3a-5e, for each cartridge 402, 404, an associated manipulation base 308, 310 may include a plurality of fingers 316, 318, 320 and 322, (e.g., one per steering wire) that extend or protrude upwardly to contact and interact with the steering wire slider blocks (such as slider blocks 412, 414, 416, 418) to independently tension select steering wires 420, 422, 424, 426. Each finger can be configured to be independently actuated by a precision drive mechanism, such as a motor driven ball screw 324, and may be outfitted with force sensors to measure corresponding steering wire tension. A distal steering wire encoder (not shown) may also be provided for force measurements at the distal end of the steering wires adjacent the catheter distal end. Each motor driven ball screw (for both finger control and cartridge translation control) may further include encoders to measure a relative and/or an absolute position of each element of the system. As shown in FIG. 4a, bearing 332 and coupler 330 of ball screw 324 may engage frame 340 of respective bases 308, 310 and a. corresponding finger 316, 318, 320 or 322 may be mounted adjacent a strain gauge for measuring the corresponding steering wire tension.


Referring to FIGS. 4a-4c, bases 308, 310 may include exemplary components such as motors 342, 344, 346 and 348, respectively coupled to fingers 316, 318, 320 and 322. A hearing 354 may be provided for sliding of bases 308, 310 on track 356. A plurality of inductive sensors (e.g. home sensors) 358 may be provided for guiding each manipulation base to a safe position.


Referring to FIGS. 1-3g, particularly FIGS. 3d-3g, robotic catheter manipulator assembly 302 may be usable with a robotic catheter rotatable device cartridge 490, described in detail in commonly owned and copending application titled “Robotic Catheter Rotatable Device Cartridge.” As shown in FIG. 3g, manipulator base 308 may be replaced with a robotic catheter rotatable drive head 492 and a robotic catheter rotatable drive mechanism 494, described in detail in commonly owned and copending application titled “Robotic Catheter Rotatable Drive Mechanism.”


Referring to FIGS. 1 and 5a-5e, an embodiment of catheter and sheath cartridges 402, 404 will be described in detail.


As briefly discussed above, robotic catheter system 10 may include one or more cartridges 400, with manipulator 302 including at least two cartridges 402, 404, each of which may be respectively designed to control the distal movement of either the catheter or the sheath. With respect to catheter cartridge 402, catheter 406 may be substantially connected or affixed to cartridge 402, so that advancement of cartridge 402 correspondingly advances catheter 406, and retraction of the cartridge retracts the catheter. As further shown in FIGS. 5a-5e and discussed above, in an embodiment, each cartridge 402, 404 may include slider blocks (e.g., 412, 414, 416, 418), each rigidly (and independently) connected or affixed to one of a plurality of catheter steering wires (e.g., 420, 422, 424, 426) in a manner that permits independent tensioning of each steering wire. The cartridge may be provided as a disposable item that is capable of being easily positioned (e.g., snapped) into place in an overall assembly. In an embodiment, as discussed in detail below the cartridge may include an electrical “handshake” device or component to allow the system to properly identify the cartridge (e.g., by type and/of proper placement/positioning). Sheath cartridge 404 may be designed in a similar manner as the catheter cartridge 402, but will typically be configured to provide for the passage of catheter 406. Assembly 302 may include a plurality (e.g., as many as ten or more) of independent driving mechanisms (e.g., motor driven ball screws 324).


For some embodiments, the catheter and sheath cartridge can be designed to be substantially similar and in that context a reference to either may relate to both. For example, as shown in FIGS. 5a-5e, the design of the catheter/sheath cartridge may include upper and lower cartridge sections 428, 430, and independent slider blocks 412, 414, 416, 418. The system is not generally limited to specific material selection or formation techniques. However, in an embodiment, the upper and lower cartridge sections 428, 430 may be injection molded using a polycarbonate material. Each slider block 412, 414, 416, 418 may be connected to a separate catheter steering wire 420, 422, 424, 426, and may be formed of a Teflon-like material such as, for example, Delrin AF. When in contact with the cartridge housing portions 428, 430, such Teflon-like slider blocks may maintain a low static and dynamic coefficient, of friction and may avoid the need for additional lubrication.


Referring to FIGS. 3a-5e and as discussed above, catheter and sheath cartridges 402, 404 may be configured to secure or lock down onto respective interconnecting catheter and sheath manipulation bases 308, 310. To couple cartridge 402 (and 404) with base 308 (and 310), one or more locking puts (e.g., 432 in FIGS. 5a, 5d and 5c) on the cartridge may engage one or more mating recesses 360 in the base (see FIG. 4a). In an embodiment such recesses 360 may include an interference lock such as a spring detent or other locking means. In an embodiment, such other locking means may include a physical interference that may require affirmative/positive action by the user to release the cartridge. Such action may include or require actuation of a release lever 362. Additionally, as shown in FIGS. 5c, 5d and 5e, cartridge 402 (and 404) may include one or more locator pins 434 that are configured to passively fit into mating holes on the base (e.g., 364 in FIG. 4a).


In an embodiment, a user (e.g. an EP) may first manually position catheter 406 and sheath 410 (with catheter 406 inserted in sheath 410) within the vasculature of a patient. Once the devices are roughly positioned in relation to the heart, the user may then engage or connect (e.g., “snap-in”) the catheter cartridge into place on interconnecting/interlocking bases 308, 310 of manipulator assembly 302, for example, by inserting the locking/locating pins 432, 434 of the cartridges into mating holes 360, 364 of respective base 308, 310. When the cartridge is interconnected with the base, each of the plurality of fingers 316, 318, 320 or 322 may fit into recesses formed between the distal edge of slider blocks 412, 414, 416, 418 and a lower portion of the cartridge housing. Such recesses are shown in, for example, FIGS. 5d and 5e. With sufficiently rigid coupling between each slider block and a corresponding steering wire, pushing a slider block in a proximal direction may cause an attached steering wire to tension and thus laterally deflect the distal end of the catheter and sheath 406, 410.


The aforementioned electrical handshake between manipulation bases 308, 310 and catheter and sheath cartridges 402, 404 will be described briefly.


Robotic catheter system 10 may be useful for a variety of procedures and in connection with a variety of tools and/or catheters. Such tools and/or catheters may include, without limitation, spiral catheters, ablation catheters, mapping catheters, balloon catheters, needle/dilator tools, cutting tools, cauterizing tools, and/or gripping tools. The system may additionally include a means of identifying the nature and/or type of catheter/tool cartridge that is installed for use, and/or position or connection related information. The system may automatically access/obtain additional information about the cartridge, such as, without limitation, its creation date, serial number, sterilization date, prior uses, etc.


Further, some embodiments of the system may include an ability to “read” or detect the type or nature of the connected cartridge through the use of memory included with the disposable cartridge together with some data/signal transmission means. By way of example, each cartridge may contain a chip (e.g., an EEPROM chip) that can be electrically interfaced by the manipulator head. Such a chip could, for instance, be programmed during the manufacturing process and may electronically store various data, such as the make; model; serial number; creation date; and/or other special features associated with the cartridge or tool. Additionally the chip may contain other worthwhile information, such as an indication of previous use, catheter specific calibration data, and/or any other information that may relate to the safety or performance of the particular device.


In an embodiment, upon interconnecting the cartridge (e.g. 402, 404) with the manipulator head (e.g. 302), a detection means, such as an optical or magnetic sensor, may initially detect the presence of the cartridge. Once presence is detected, the manipulator may energize a chip and initiate data/signal retrieval. Such retrieved data/signal may then be used by the system to control or alter various features and/or displays based on the type of device and/or information provided. While one embodiment may use a chip (e.g., EEPROM), due to its design flexibility, another embodiment may include a wireless transmission device, such as an RFID, which may be employed to facilitate the data storage/transfer instead of, or in addition to a chip.


Referring now to FIGS. 1-7, and particularly FIGS. 6 and 7, obstruction detection system 600 of the invention will be described in detail, and may generally include a hardware system 700 and a software system 800.


Referring to FIG. 6, hardware system 700 may include a plurality of obstruction detection sensors 702, 704, 706, 708, 710 and 712 (described in detail below) generally operatively interconnected with software system 800 for enabling, disabling or otherwise controlling movement of manipulation bases 308, 310. Obstruction detection system 600 may initiate control, or otherwise disable movement of manipulation bases 308, 310 as the bases generally move towards or away from each other on track 356 based on the particular nature of the operation being performed by a physician during surgery or by a technician, for example, during maintenance, or by as physician or technician during attachment or detachment of cartridges 402, 404. Since manipulator assembly 302 generally includes an enclosure 370 as shown in FIG. 2 partially or fully covering manipulation bases 308, 310, during typical operation, the general working area of manipulation bases 308, 310 remains covered. However, in the event of an obstruction being present in the path of manipulation bases 308, 310 or during routine maintenance of manipulator assembly 302 where a technician or operator may insert an object or finger in the area of manipulation bases 308, 310, enclosure 370 may be removed for access to manipulation bases 308, 310. The combination of hardware system 700 and a software system 800, as discussed herein, may detect the presence of an obstruction in the path of manipulation bases 308, 310 and stop movement of bases 308, 310 when certain criteria have been met.


In further detail, as shown in FIGS. 3a and 6, hardware system 700 may generally include obstruction detection sensors 702, 704, 706, 708, 710 and 712 respectively disposed on or along track 356 and manipulation bases 308, 310. In a particular embodiment of the invention, sensors 702-712 may be ultrasonic sensors, or alternatively, light-emitting sensors for detecting the presence of an obstruction. Sensors 702 and 712 may be disposed at the opposing ends of track 356, and sensors 704, 706, and 708, 710 may be respectively disposed at the corners or other suitable locations on manipulation bases 310, 308. Sensors 702, 704 may monitor the presence of any obstructions along Path 1 between manipulation base 310 and end 714 of track 356. Sensors 706, 708 may monitor the presence of any obstructions along Path 2 between manipulation bases 310 and 308, and sensors 710, 712 may monitor the presence of any obstructions along Path 3 between manipulation base 308 and end 716 of track 356. As discussed below, any positive (e.g. toward end 714) and negative (e.g. toward end 716) translation of manipulation base 308, 310 would be stopped in case of an obstruction along track 356.


Referring to FIG. 7, software system 800 operates in combination with hardware system 700 to track motion of manipulation bases 308, 310 on track 356, and more specifically, whether the manipulation bases are moving in a positive or negative direction, and their distance from each other. Typically, manipulation bases 308, 310 are designed to move within 2-3 millimeters of each other to prevent collision. Software system 800 may selectively activate one or more of sensors 702-712 upon actuation or movement of manipulation bases 308, 310 in a predetermined direction to detect any obstructions in the path of translation of a specific manipulation base. Alternatively, all sensors 702-712 may be activated so that software system 800 determines a proper course of action based on the location of an obstruction (e.g. along Path 1, Path 2 or Path 3), and other factors such as the direction of movement of the manipulation bases, and the actual function being performed (e.g. surgery or routine maintenance). Based on the specific function being performed, software system 800 may stop movement of the manipulation bases (e.g. by cutting power to high precision drive mechanisms 312, 314), allow movement of the manipulation bases, or reverse movement of the manipulation bases.


For example, if an obstruction is present along. Path 2 and routine maintenance is being performed on manipulator assembly 302, software system 800 may stop movement of manipulation bases 308, 310 if they are moving, toward each other, but can allow movement of the manipulation bases if they are moving away from each other. In this manner, if an obstruction (e.g. a hand or finger of a service technician) is present along Path 2, movement of the manipulation bases may only be halted if the bases are moving towards each other (e.g. to prevent contact with an obstruction), but may be otherwise allowed to continue. If the obstructions is present along Path 2, in a routine maintenance mode, manipulation bases 308, 310 may be directed to move away from each other such that a predetermined distance (e.g. 20 mm) remains between the bases for insertion of a technician's fingers or another object along Path 2 for maintenance operations.


One method of detecting motion of manipulation bases 308, 310 may be to detect the direction of motion of high precision drive mechanisms 312, 314, which operate via the CANOpen protocol standard. Referring to FIG. 7, the algorithm for software system 800 is illustrated and may include a motion command request at location 802 for initiating or continuing motion of manipulation bases 308, 310. At location 804, software system 800 may determine if high precision drive mechanisms 312, 314 are moving, and if not, motion may be initiated at location 806. At location 808, if high precision drive mechanisms 312, 314 are moving at step 804 or motion is initiated at step 806, then system 800 may determine if the position of the sheath manipulation base 310 minus the position of the catheter manipulation base 308 is less than a predetermined obstruction position delta (e.g. a predetermined safe distance between the sheath and catheter drive mechanisms; 20 mm in the example discussed above). Alternatively, at location 808, the system may also determine if any of the obstruction detection sensors 702-712 have been activated. If the determination at location 808 is no, then motion may continue at location 810, if the determination at location 808 is yes, then at location 812, system 800 may set an Obstruction Status flag to Obstructed, and turn LED 718 to red, as discussed in detail below with reference to FIG. 2. Thereafter at location 814, high precision drive mechanisms 312, 314 may be stopped by turning the power off or by other means. The off status of high precision drive mechanisms 312, 314 may then be fed to CANOpen protocol 816 for further evaluation. Once the Obstruction Status flag is cleared (e.g. no obstruction), LED 718 may be turned to green, as also discussed below.


The LED will be turned off as soon as the obstruction status flag is cleared.


In a particular embodiment, software system 800 may monitor high precision drive mechanisms 312, 314, for example, every 50 ms to determine the direction of movement and location of manipulation bases 308, 310 (e.g. location along track 356, and relative location). Software system 800 may thus monitor manipulation bases 308, 310, which operate via the CANOpen protocol standard, and further monitor the presence of any obstruction along Paths 1-3 as detected by sensors 702-712. Upon the detection of an obstruction, software system 800 may issue instructions through the CANOpen protocol to stop high precision drive mechanisms 312, 314, and thus manipulation bases 308, 310.


Thus, referring again to FIG. 7, at location 816, CANOpen protocol may receive input from locations 810, 820 and 822, which are respectively, monitors for sheath high precision drive mechanism 314, catheter high precision drive mechanism 312, and obstruction sensors 702-712. The data from the respective locations 810, 820 and 822 may be sampled at a predetermined rate (e.g. 50 ms) and fed into location 804 to determine movement of the catheter/sheath high precision drive mechanisms, and further evaluation as discussed above.


The combination of hardware system 700 including obstruction detection sensors 702-712, and software system 800 which monitors sensors 702-712 and high precision drive mechanisms 312, 314 operable via the CANOpen protocol standard, provides for an obstruction detection system 600 that monitors for obstructions along Paths 1-3 and stops motion of manipulation bases 308, 310 depending on factors such as the position of an obstruction, the direction of travel of the manipulation bases, and the type of operation being performed (e.g. surgery, routine maintenance, or cartridge replacement). Yet further, depending on the extent and location of an obstruction, system 600 may cut off power to all high precision drive mechanisms (e.g. 312, 314, 342, 344, 346 and 348; see FIGS. 3a and 4b), or just selective drive mechanisms depending on whether the obstruction is detected during surgery or maintenance. During surgery, this selective disablement of certain high precision drive mechanisms would allow critical functions to be performed, without entire system shut-down.


Referring to FIG. 2, a LED 718 may be provided for conveying the operational status of robotic catheter system 10 to a user. In a particular embodiment, LED 718 may include, for example, three light color indicators such as red, yellow, green for respectively indicating the requirement for system shutdown, a problem and the requirement for system maintenance, or proper system operation. Alternatively, LED 718 may include codes via, for example, blinks to indicate the type of problem. An emergency on/off switch 720 may also be provided to manually shut robotic catheter system 10 off in the event of an emergency, and as a redundant measure for shutting down system 10 and motion of manipulation bases 308, 310.


With the addition of obstruction detection system 600 to robotic catheter system 10, set-point calibration can be fully automated with the presence of obstruction detection sensors 702-712. Set-point calibration assures that when catheter and sheath cartridges 402, 404 are in place, there is a minimum amount of tension on steering wires 420, 422, 424 and 426 to enable control of the catheter/sheath. For example, in order to automate movement of catheter and sheath 406, 410, and, set-point calibration during system initialization, system 600 may prevent movement of manipulation bases 308, 310 if an obstruction is detected along Paths 1-3. Specifically, once catheter and sheath cartridges 402, 404 are snapped onto manipulation bases 308, 310, if an obstruction is detected along Paths 1-3 by obstruction detection sensors 702-712, set-point calibration would not initiate until the user clears the obstruction. Such functionality would enhance the EP experience by providing additional safety for the robotic catheter system, and would also provide, safety to a patient so that the desired movement of the sheath and catheter can be achieved without any obstruction. Additionally, obstruction detection system 600 may be include other visible or audible signals, and/or be integrated with haptic feedback system 900 so that when an obstruction is detected, haptic feedback is provided to a user via input control system 100 to stop further motion of the manipulation bases 308, 310, as well as catheter and sheath cartridges 402, 404, as needed.


The invention thus provides an obstruction detection system 600 for detection of Obstructions that may hinder or otherwise stop movement of manipulation bases 308, 310, and related components. As discussed above, hardware system 700 and software system 800 of obstruction detection system 600 may operate in a cohesive manner to control movement of the manipulation bases in a predetermined manner based on the type and location of an obstruction, and other factors involving direction of movement of the manipulation bases.


Although several embodiments of this invention have been described above with a certain degree of particularity, those skilled in the art could make numerous alterations to the disclosed embodiments without: departing from the scope of this invention. All directional references (e.g., upper, lower, upward, downward, left, right, leftward, rightward, top, bottom, above, below, vertical, horizontal, clockwise and counterclockwise) are only used for identification purposes to aid the reader's understanding of the present invention, and do not create limitations, particularly as to the position, orientation, or use of the invention. Joinder references (e.g., attached, coupled, connected and the like) are to be construed broadly and may include intermediate members between a connection of elements and relative movement between elements. As such, joinder references do not necessarily infer that two elements are directly connected and in fixed relation to each other. It is intended that all matter contained in the above description or shown in the accompanying drawings shall be interpreted as illustrative only and not as limiting. Changes in detail or structure may be made without departing from the invention as defined in the appended claims.

Claims
  • 1. A robotic catheter system comprising: a robotic catheter manipulator assembly comprising:a support member having a longitudinal axis and comprising a catheter manipulation base configured for linear movement along the longitudinal axis of the support member and a sheath manipulation base configured for linear movement along the longitudinal axis of the support member;a robotic catheter device cartridge removably mounted to the catheter manipulation base, wherein the robotic catheter device cartridge is configured to be generally linearly movable relative to the support member along the longitudinal axis of the support member, and wherein the robotic catheter device cartridge comprises a catheter; anda robotic sheath device cartridge removably mounted to the sheath manipulation base, wherein the robotic sheath device cartridge is generally linearly movable relative to the support member along the longitudinal axis of the support member; andan input control system for controlling operation of the robotic catheter manipulator assembly,wherein one of the catheter manipulation base and the robotic catheter device cartridge includes at least one first element engageable with at least one complementary second element of the other one of the catheter manipulation base and the robotic catheter device cartridge, wherein linear movement of one of the first element and the second element is configured to cause corresponding linear movement of the other one of the first element and the second element and control deflection of the catheter by pulling a steering wire attached to the catheter and one of the first element and the second element, and wherein the linear movement of one of the first element and the second element is configured to laterally deflect a distal end of the catheter.
  • 2. The robotic catheter system according to claim 1, further comprising a visualization system including at least one display for displaying a position of at least one of a first surgical instrument attached to the robotic first surgical instrument device cartridge and a second surgical instrument attached to the robotic second surgical instrument device cartridge.
  • 3. The robotic catheter system according to claim 1, wherein at least one of the robotic catheter device cartridge and the robotic sheath device cartridge is rotatable relative to the robotic catheter manipulator assembly.
  • 4. The robotic catheter system according to claim 1, wherein the catheter manipulation base and the sheath manipulation base are movable relative to each other.
  • 5. The robotic catheter system according to claim 1, wherein one of the sheath manipulation base and the robotic sheath device cartridge includes at least one first element engageable with at least one complementary second element of the other one of the sheath manipulation base and the robotic sheath device cartridge, wherein linear movement of one of the first element and the second element is configured to cause corresponding linear movement of the other one of the first element and the second element and control deflection of the sheath by pulling a steering wire attached to the sheath and one of the first element and the second element.
  • 6. The robotic catheter system according to claim 1, wherein the catheter manipulation base is disposed generally behind the sheath manipulation base to allow insertion of the catheter into the sheath.
  • 7. The robotic catheter system according to claim 1, wherein the input control system includes at least one of an instrumented traditional catheter handle control, an oversized catheter model, an instrumented, user-wearable glove, and a traditional joystick.
  • 8. The robotic catheter system according to claim 1, wherein the input control system includes haptic feedback based on one of actual sensed forces on a distal catheter tip, and impedance measured from the distal catheter tip.
  • 9. The robotic catheter system according to claim 1, wherein the input control system includes active tensioning of steering wires attached to the catheter and sheath.
  • 10. A robotic catheter system comprising: a robotic manipulator assembly comprising:a support member having a longitudinal axis and comprising a first surgical instrument manipulation base configured for linear movement along the longitudinal axis of the support member and a second surgical instrument manipulation base configured for linear movement along the longitudinal axis of the support member;at least one robotic first surgical instrument device cartridge removably mounted to the first surgical instrument manipulation base, wherein the robotic first surgical instrument device cartridge is configured to be generally linearly movable relative to the support member along the longitudinal axis of the support member, and wherein the at least one robotic first surgical instrument device cartridge comprises a first surgical instrument; andat least one robotic second surgical instrument device cartridge removably mounted to the second surgical instrument manipulation base, wherein the robotic second surgical instrument device cartridge is generally linearly movable relative to the support member along the longitudinal axis of the support member; andan input control system for controlling operation of the robotic manipulator assembly,wherein one of the first surgical instrument manipulation base and the first surgical instrument device cartridge includes at least one first element engageable with at least one complementary second element of the other one of the first surgical instrument manipulation base and the robotic first surgical instrument device cartridge, wherein linear movement of one of the first element and the second element is configured to cause corresponding linear movement of the other one of the first element and the second element and control deflection of the first surgical instrument by pulling a steering wire attached to the first surgical instrument and one of the first element and the second element, and wherein the linear movement of one of the first element and the second element is configured to laterally deflect a distal end of the catheter.
  • 11. The robotic catheter system according to claim 10, further comprising a visualization system including at least one display for displaying a position of at least one of a first surgical instrument attached to the robotic first surgical instrument device cartridge and a second surgical instrument attached to the robotic second surgical instrument device cartridge.
  • 12. The robotic catheter system according to claim 10, wherein at least one of the first surgical instrument device cartridge and the second surgical instrument device cartridge is rotatable relative to the robotic manipulator assembly.
  • 13. The robotic catheter system according to claim 10, wherein the first surgical instrument manipulation base and the at least one second surgical instrument manipulation base are movable relative to each other.
  • 14. The robotic catheter system according to claim 10, wherein the input control system includes at least one of an instrumented traditional catheter handle control, an oversized catheter model, an instrumented, user-wearable glove, and a traditional joystick.
  • 15. The robotic catheter system according to claim 10, wherein the input control system includes haptic feedback based on one of actual sensed forces on a distal first surgical instrument tip, and impedance measured from the distal first surgical instrument tip.
  • 16. The robotic catheter system according to claim 10, wherein the input control system includes active tensioning of steering wires attached to the first surgical instrument and the second surgical instrument.
  • 17. The robotic catheter system according to claim 10, wherein the first surgical instrument and the second surgical instrument are each one of a transseptal needle, a catheter and a sheath.
  • 18. The robotic catheter system of claim 10, wherein the respective ranges of linear movement along the longitudinal axis of the support member each have a length of approximately 8 inches.
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No. 13/120,715 filed 24 Mar. 2011, which is a United States national stage filing based upon PCT Application No. PCT/US2009/058121 (the '121 application) filed 23 Sep. 2009, which claims priority to and is a continuation of U.S. non-provisional application Ser. Nos. 12/347,811, filed 31 Dec. 2008 (the '811 application), 12/347,826, filed 31 Dec. 2008 (the '826 application), 12/347,835, filed 31 Dec. 2008 (the '835 application), 12/347,842, filed 31 Dec. 2008 (the '842 application), each of which claim the benefit of U.S. provisional application No. 61/099,904, filed 24 Sep. 2008 (the '904 application). The '811 application, '826 application, '835 application, and '842 application, and, subsequently this application also claim the benefit of U.S. provisional application No. 61/040,143, filed 27 Mar. 2008 (the '143 application). The '121 application, '811 application, '826 application, '835 application, '842 application, '143 application, and '904 application are hereby incorporated by reference as though fully set forth herein.

US Referenced Citations (188)
Number Name Date Kind
3091130 Payerle et al. May 1963 A
3605725 Bentov Sep 1971 A
3893449 Lee et al. Jul 1975 A
4180508 Becker et al. Dec 1979 A
4348556 Gettig et al. Sep 1982 A
4393728 Larson et al. Jul 1983 A
4494417 Larson Jan 1985 A
4543090 McCoy Sep 1985 A
4758222 McCoy Jul 1988 A
4784042 Paynter Nov 1988 A
4802487 Martin Feb 1989 A
4884557 Takehana Dec 1989 A
4962448 DeMaio Oct 1990 A
4974151 Advani et al. Nov 1990 A
5078140 Kwoh Jan 1992 A
5107080 Rosen Apr 1992 A
5170817 Sunderland Dec 1992 A
5238005 Imran Aug 1993 A
5298930 Asakura Mar 1994 A
5303148 Mattson et al. Apr 1994 A
5318525 West Jun 1994 A
5339799 Kami et al. Aug 1994 A
5396266 Brimhall et al. Mar 1995 A
5410638 Colgate et al. Apr 1995 A
5441483 Avitall Aug 1995 A
5449345 Taylor Sep 1995 A
5520644 Imran May 1996 A
5533967 Imran Jul 1996 A
5545200 West Aug 1996 A
5579442 Kimoto Nov 1996 A
5607158 Chan Mar 1997 A
5607462 Imran Mar 1997 A
5623582 Rosenberg Apr 1997 A
5630783 Steinberg May 1997 A
5661253 Aoki Aug 1997 A
5706827 Ehr Jan 1998 A
5784542 Ohm Jul 1998 A
5791908 Gillio Aug 1998 A
5800178 Gillio Sep 1998 A
5807377 Madhani Sep 1998 A
5808665 Green Sep 1998 A
5828813 Ohm Oct 1998 A
5854622 Brannon Dec 1998 A
5861024 Rashidi Jan 1999 A
5876325 Mizuno et al. Mar 1999 A
5897488 Ueda Apr 1999 A
5913820 Bladen et al. Jun 1999 A
6040758 Sedor Mar 2000 A
6063095 Wang May 2000 A
6113395 Hon Sep 2000 A
6201196 Wergen Mar 2001 B1
6233476 Strommer et al. May 2001 B1
6233504 Das et al. May 2001 B1
6290683 Erez Sep 2001 B1
6348911 Rosenberg Feb 2002 B1
6358207 Lathbury et al. Mar 2002 B1
6385509 Das et al. May 2002 B2
6396232 Haanpaa May 2002 B2
6432112 Brock Aug 2002 B2
6498944 Ben-Haim et al. Dec 2002 B1
6500167 Webster Dec 2002 B1
6522141 Debbins et al. Feb 2003 B2
6540685 Rhoads et al. Apr 2003 B1
6671533 Chen et al. Dec 2003 B2
6709667 Lowe Mar 2004 B1
6785358 Johnson Aug 2004 B2
6850252 Hoffberg Feb 2005 B1
6869390 Elliott Mar 2005 B2
6869396 Belson Mar 2005 B2
6968223 Hanover Nov 2005 B2
7016469 Johnson et al. Mar 2006 B2
7193521 Moberg Mar 2007 B2
7197354 Sobe Mar 2007 B2
7199790 Rosenberg Apr 2007 B2
7247139 Yudkovitch et al. Jul 2007 B2
7263397 Hauck Aug 2007 B2
7276044 Ferry Oct 2007 B2
7386339 Strommer et al. Jun 2008 B2
7465288 Dudney et al. Dec 2008 B2
7672849 Yudkovitch et al. Mar 2010 B2
7698966 Gosselin Apr 2010 B2
7742803 Viswanathan et al. Jun 2010 B2
7850642 Moll Dec 2010 B2
7880717 Berkley et al. Feb 2011 B2
7945546 Bliss et al. May 2011 B2
7963288 Rosenberg et al. Jun 2011 B2
8164573 DaCosta et al. Apr 2012 B2
8317744 Kirschenman Nov 2012 B2
8317745 Kirschenman Nov 2012 B2
8332072 Schaible et al. Dec 2012 B1
8390438 Olson et al. Mar 2013 B2
8416203 Tsui Apr 2013 B2
8560118 Greer et al. Oct 2013 B2
8926511 Bar-Tar Jan 2015 B2
20010018591 Brock Aug 2001 A1
20010025183 Shahidi Sep 2001 A1
20020065485 DuBois et al. May 2002 A1
20020068868 Thompson et al. Jun 2002 A1
20020072704 Mansouri-Ruiz Jun 2002 A1
20020087048 Brock Jul 2002 A1
20020184055 Naghavi et al. Dec 2002 A1
20030018232 Elliott Jan 2003 A1
20030050733 Wang et al. Mar 2003 A1
20030114962 Niemeyer Jun 2003 A1
20030121382 Morson Jul 2003 A1
20040050247 Topping Mar 2004 A1
20040068173 Viswanathan Apr 2004 A1
20040133189 Sakurai Jul 2004 A1
20040138530 Kawai et al. Jul 2004 A1
20040146388 Khajepour et al. Jul 2004 A1
20040193239 Falwell et al. Sep 2004 A1
20040223636 Edic Nov 2004 A1
20040243147 Lipow Dec 2004 A1
20050038333 Sra Feb 2005 A1
20050075538 Banik Apr 2005 A1
20050172405 Menkedick et al. Aug 2005 A1
20050203382 Govari Sep 2005 A1
20050222554 Wallace Oct 2005 A1
20050234293 Yamamoto et al. Oct 2005 A1
20050234320 Balasubramanian Oct 2005 A1
20060052664 Julian Mar 2006 A1
20060089637 Werneth et al. Apr 2006 A1
20060137476 Bull Jun 2006 A1
20060155321 Bressler et al. Jul 2006 A1
20060276775 Rosenberg et al. Dec 2006 A1
20070016008 Schoenefeld Jan 2007 A1
20070022384 Abbott et al. Jan 2007 A1
20070043338 Moll et al. Feb 2007 A1
20070060833 Hauck Mar 2007 A1
20070073137 Schoenefeld Mar 2007 A1
20070100254 Murakami et al. May 2007 A1
20070120512 Albu-Schaffer et al. May 2007 A1
20070135803 Belson Jun 2007 A1
20070142726 Carney Jun 2007 A1
20070172803 Hannaford et al. Jul 2007 A1
20070185404 Hauck et al. Aug 2007 A1
20070185485 Hauck Aug 2007 A1
20070185486 Hauck Aug 2007 A1
20070197896 Moll et al. Aug 2007 A1
20070197939 Wallace Aug 2007 A1
20070198008 Hauck et al. Aug 2007 A1
20070233044 Wallace Oct 2007 A1
20070233045 Weitzner Oct 2007 A1
20070257821 Son et al. Nov 2007 A1
20070268269 Chang et al. Nov 2007 A1
20070270685 Kang Nov 2007 A1
20070276214 Dachille Nov 2007 A1
20070298877 Rosenberg et al. Dec 2007 A1
20080009791 Cohen et al. Jan 2008 A1
20080013809 Zhu Jan 2008 A1
20080112842 Edwards May 2008 A1
20080201847 Menkedick Aug 2008 A1
20080297490 Adkins Dec 2008 A1
20080312536 Dala-Krishna Dec 2008 A1
20090012533 Barbagli Jan 2009 A1
20090033623 Lin Feb 2009 A1
20090061928 Lee et al. Mar 2009 A1
20090123111 Udd May 2009 A1
20090137952 Ramamurthy et al. May 2009 A1
20090177454 Bronstein Jul 2009 A1
20090192519 Omori et al. Jul 2009 A1
20090195514 Glynn et al. Aug 2009 A1
20090247993 Kirschenman et al. Oct 2009 A1
20090264156 Burghardt et al. Oct 2009 A1
20090322697 Cao Dec 2009 A1
20090327886 Whytock Dec 2009 A1
20100066676 Kramer et al. Mar 2010 A1
20100073150 Olson et al. Mar 2010 A1
20100079386 Scott et al. Apr 2010 A1
20100082039 Mohr et al. Apr 2010 A1
20100103127 Park et al. Apr 2010 A1
20100256558 Olson et al. Oct 2010 A1
20100268067 Razzaque et al. Oct 2010 A1
20100314031 Heideman et al. Dec 2010 A1
20110040547 Gerber et al. Feb 2011 A1
20110128555 Rotschild et al. Jun 2011 A1
20110137156 Razzaque et al. Jun 2011 A1
20110152882 Wenderow et al. Jun 2011 A1
20110289441 Venon et al. Nov 2011 A1
20110306986 Lee et al. Dec 2011 A1
20120071891 Itkowitz et al. Mar 2012 A1
20120133601 Marshall et al. May 2012 A1
20120277663 Millman et al. Nov 2012 A1
20130006268 Swarup et al. Jan 2013 A1
20130154913 Genc et al. Jun 2013 A1
20130165854 Sandhu et al. Jun 2013 A1
20130176220 Merschon et al. Jul 2013 A1
20130179162 Merschon et al. Jul 2013 A1
Foreign Referenced Citations (33)
Number Date Country
0151479 Aug 1985 EP
0904796 Mar 1999 EP
2211280 Jun 1989 GB
2397177 Jul 2007 GB
S60221280 Nov 1985 JP
H06344285 Dec 1994 JP
H8-280709 Oct 1996 JP
H10216238 Aug 1998 JP
2003024336 Jan 2003 JP
2007-325936 Dec 2007 JP
9320535 Oct 1993 WO
1996039944 Dec 1996 WO
9639944 Dec 1996 WO
2003049596 Jun 2003 WO
2006120666 Nov 2006 WO
2007056590 May 2007 WO
2007088208 Aug 2007 WO
2007098494 Aug 2007 WO
2007120329 Oct 2007 WO
2007136803 Nov 2007 WO
2007146325 Dec 2007 WO
2007143859 Dec 2007 WO
2008045831 Apr 2008 WO
2008101228 Aug 2008 WO
2008103212 Aug 2008 WO
2009120982 Oct 2009 WO
2009120992 Oct 2009 WO
2009120940 Oct 2009 WO
2009120992 Oct 2009 WO
2010025338 Mar 2010 WO
2010059179 May 2010 WO
2010068783 Jun 2010 WO
2010107916 Sep 2010 WO
Non-Patent Literature Citations (30)
Entry
Title: Supplemental European Search Report Citation: EP Application No. 11763450.1 Publication Date: Oct. 29, 2014 9 pages.
Title: International Search Report Citation: PCT Application No. PCT/US2011/030656 Publication Date: Jun. 13, 2011 8 pages.
Title: Emotiv—Brain Computer Interface Technology (online) Citation: <URL: http://www.emotiv.com> Publication Date: Aug. 11, 2011 3 pages.
Title: Supplemental European Search Report Citation: EP Application No. 09726364.4 Publication Date: Jan. 22, 2013 7 pages.
Title: Supplemental European Search Report Citation: EP Application No. 09723739.0 Publication Date: Jul. 10, 2012 6 pages.
Title: Supplemental European Search Report Citation: EP Application No. 09724550.0 Publication Date: Jul. 10, 2012 6 pages.
Title: International Search Report Citation: PCT Application No. PCT/US2009/058121 Publication Date: Nov. 19, 2009 2 pages.
Title: International Search Report Citation: PCT Application No. PCT/US2009/038536 Publication Date: May 28, 2009 2 pages.
Title: International Search Report Citation: PCT Application No. PCT/US2009/038534 Publication Date: May 27, 2009 2 pages.
Supplementary European Search Report for EP Application No. 11763410.5, dated Jun. 10, 2015. 7 pages.
Title: International Search Report Citation: PCT Application No. PCT/US2009/038597 Publication Date: May 18, 2009 2 pages.
Title: International Search Report Citation: PCT Application No. PCT/US2009/038618 Publication Date: May 22, 2009 2 pages.
International Search Report for PCT Application No. PCT/US2009/069712, dated Feb. 25, 2010, 10 pgs.
Supplementary European Search Report for EP Application No. 09725131.8, dated Feb. 20, 2013. 7 pgs.
Title: International Search Report Citation: PCT Application No. PCT/US2009/038525 Publication Date: May 27, 2009 2 pages.
Title: International Search Report Citation: PCT Application No. PCT/US2009/038531 Publication Date: May 19, 2009 3 pages.
Title: International Search Report Citation: PCT Application No. PCT/US2009/038533 Publication Date: Jun. 17, 2009 2 pages.
Title: The Aurora Electromagnetic Tracking System, Aurora Electromagnetic Measurement System—3D Tracking for Medical Guidance Citation: Northern Digital, Inc. <URL: http://www.ndigital.com/medical/aurora.pho?act=print> Publication Date: (actual publication date unknown) 3 pages.
Title: Apple Wins Strategic Multitouch and Music Tempo Workout Patents Citation: Patently Apple <URL: http://www.patentlyapple.com/patently-apple/2010/04/apple-wins-strategic-multitouch-music-tempo-workout-patents.html> Publication Date: (actual publication date unknown) 5 pages.
Polaris Family of Optical Tracking Systems, Polaris Vicra & Spectra-Optical Measurement Systems for Medical Citation: Northern Digital Inc. <URL: http://www.ndigital.com/medical/polarisfamily.php?act=print> Publication Date: (actual publication date unknown) 5 pages.
Author: LaBelle, Kathryn Title: Evaluation of Kinect Joint Tracking for Clinical and In-Home Stroke Rehabilitation Tools Citation: <http://netscale.cse.nd.edu/twiki/pub/Edu/KinectRehabilitation/Eval_of_Kinect_for_Rehab.pdf> Publication Date: Dec. 2011 67 pages.
Author: Padoy, Nicolas Title: Needle Insertion Revisted (tele-surgery in depth), (online) Citation: The John Hopkins University <URL: http://www.youtube.com/watch?v=YsY_A0kLh-g> Publication Date: Jan. 2011 25 pages.
Title: Emotiv EPOC Software Development Kit—EPOC neuroheadset (online) Citation: <URL: http://www.emotiv.com/store/hardware/epoc/bci/epoc-neuroheadseU> Publication Date: (actual publication date unknown) 2 pages.
Title: Wii Remote—Wikipedia, the free encyclopedia (online) Citation: <URL: http://en .wikipedia.org/wiki/Wii_Remote> Publication Date: (actual publication date unknown) 17 pages.
Title: About the Kinect for Windows SDK—Microsoft Research (online) Citation: <URL: http://research .microsoft.com/en-us/um/redmond/projects/kinectsdk/about.aspx> Publication Date: (actual publication date unknown) 2 pages.
Title: Kinect—Wikipedia, the free encyclopedia (online) Citation: <URL: http://en .wikipedia.org/wiki/Kinect> Publication Date: (actual publication date unknown) 15 pages.
Title: International Search Report & Written Opinion Citation: PCT/US2012/031008 Publication Date: Jul. 20, 2012 10 pages.
Title: International Search Report and Written Opinion Citation : PCT/US2011/030764 Publication Date: Jun. 15, 2011 8 pages.
Ghobadi, et al. “Real Time Hand Based Robot Control Multimodal Images”, IAENG International Journal of Computer Sciences, 35:4, IJCS_35_4_08; Nov. 20, 2008. 6 pgs.
Robot.pdf (Robot—Definition Robot at Dictionary.com, Oct. 27, 2015, http://dictionary.reference.com/browse/robot, pp. 1-5).
Related Publications (1)
Number Date Country
20160310220 A1 Oct 2016 US
Provisional Applications (2)
Number Date Country
61099904 Sep 2008 US
61040143 Mar 2008 US
Continuations (5)
Number Date Country
Parent 13120715 US
Child 15089791 US
Parent 12347826 Dec 2008 US
Child 13120715 US
Parent 12347842 Dec 2008 US
Child 12347826 US
Parent 12347811 Dec 2008 US
Child 12347842 US
Parent 12347835 Dec 2008 US
Child 12347811 US