Invasive procedures, such as ablation or electrophysiology procedures, often utilize catheters and similar devices to take measurements, receive imagery, and enable surgical functions. Such procedures are very complicated and often require additional techniques and devices to visualize the location of catheters within patients during the procedures. For example, a fluoroscopy imaging technique may be used to help position catheters or other elongated medical devices within a patient's body within an organ, such as the heart or the circulatory system. Because fluoroscopy imaging uses ionizing radiation, systems have been developed to enable the insertion and maneuvering of steerable catheters within patients using remote controls. These remote techniques may protect clinicians and attending nurses from exposure to high cumulative dosages of radiation, as well as provide fine control over catheters.
The various embodiments include a system and methods for controlling a remotely controlled catheter positioning system to maintain a therapeutic or diagnostic catheter within the field of view of an ultrasound imaging catheter while both are positioned within a patient's body. The embodiments may enable improved medical procedures by relieving a clinician of a burden of frequently repositioning and imaging catheter while performing therapeutic or diagnostic procedures with another catheter.
The accompanying drawings, which are incorporated herein and constitute part of this specification, illustrate example embodiments of the invention, and together with the general description given above and the detailed description given below, serve to explain the features of the invention.
The various embodiments will be described in detail with reference to the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. References made to particular examples and implementations are for illustrative purposes, and are not intended to limit the scope of the invention or the claims.
The term “computing device” is used herein to refer to any electronic device equipped with at least a processor and a data or network interface suitable for interfacing with a remotely-controlled catheter positioning device. The processor of a computing device may be configured with processor-executable instructions perform the operations of the embodiment methods described below.
A number of invasive medical diagnostic and treatment procedures may require more than one catheter to be concurrently utilized within an organ of a patient, such as the heart, kidneys, stomach, etc. For example, in an ablation procedure, an ablation catheter may be inserted into an organ within the patient to perform tissue ablation treatments, and an ultrasound imaging catheter may also be inserted into the same organ or an adjacent portion of the patient in order to provide imagery of the ablation catheter that clinicians may view as they manipulate the handle of the catheter in order to position the tip of the ablation catheter onto the portion of the organ to be treated. An ultrasound catheter is often used for imaging within patients because of the ability of ultrasound to image tissues through blood that will inhibit visual imaging techniques.
However, the manipulation of multiple catheters within an organ may be difficult for clinicians to manage, as the manipulations of each catheter must be precise to ensure the success of the procedure and the health of the patient. In particular, keeping the tip of a treatment catheter within the field of view of an ultrasound imaging catheter may require complex coordination of the two catheter handles. This difficulty coordinating two catheters simultaneously may add to the complexity of the procedure and the difficulty for the clinician. For example, when an ablation catheter is repositioned within a chamber of the patient's heart in order place the tip of the ablation catheter on the tissue to be ablated, the ablation catheter may move outside of the field of view of the ultrasound catheter, requiring the clinician to move the ultrasound catheter as well. Thus, a clinician may be forced to move the ablation catheter an increment, adjust the orientation of the ultrasound catheter to reacquire the ablation catheter within the ultrasound image, and repeat this process until the ablation catheter has been repositioned to a new location for treatment.
Catheter Robotics Inc. has developed a remotely-controlled catheter positioning system that is configured to enable clinicians to position catheters within a patient from a location removed from exposure to ionizing radiation. An example of such a remotely-controlled catheter positioning system is disclosed in U.S. patent application Ser. No. 13/432,161 filed on Mar. 28, 2012, entitled “Remotely Controlled Catheter Insertion System with Automatic Control System,” which is incorporated herein by reference in its entirety for disclosing details of that system. Such a remotely-controlled catheter positioning system enables clinicians to remotely maneuver, articulate, and orient catheters (generally referred to herein as “positioning” or “repositioning” catheters).
The various embodiments provide systems, devices, methods, and non-transitory processor-readable storage media for enabling a remotely-controlled catheter positioning system to automatically reposition a first catheter within a patient based on the position of a second catheter. In particular, the various embodiments may enable a remotely-controlled catheter positioning system to reposition an ultrasound imaging catheter in order to keep its imaging field of view focused on the second catheter, such as an ablation catheter. In an embodiment, a computing device coupled to or included within the control system of a remotely-controlled catheter positioning system may be configured with processor-executable instructions to analyze ultrasound imagery obtained from an ultrasound catheter in order to determine when and how the remotely-controlled catheter positioning system should move in order to reposition the ultrasound catheter so as to keep the second catheter within the ultrasound imagery. For example, when the computing device determines that an ablation catheter co-located in a patient with the ultrasound catheter is moving out of the imaging field of view, the computing device or control system may transmit control signals to the ultrasound catheter's remotely-controlled catheter positioning system to move control actuators in order to bend, translate, and/or rotate the ultrasound catheter until the ablation catheter's tip is once again centered within the field of view (i.e., at or near the center of the ultrasound image generated by the ultrasound catheter).
In an embodiment, the computing device may be configured to prompt a clinician to confirm automated movements of the ultrasound catheter before the commands are sent to the remotely-controlled catheter positioning system. For example, the computing device may render warnings, input requests, or other messages to ensure that proper professional oversight is maintained over automated catheter movements caused by the remotely-controlled catheter positioning system. Such prompts for clinician authorization before automatic movements are initiated may be rendered on a per-action basis, on a per procedure basis, or periodically.
In an embodiment, the computing device may use reports of movements by a second remotely-controlled catheter positioning system that is controlling the second catheter (e.g., the ablation catheter) in order to anticipate repositioning movements that should be implemented by the remotely-controlled catheter positioning system positioning the imaging catheter. In this embodiment, the computing device may obtain reports of control signals sent to the second remotely-controlled catheter positioning system for positioning the second catheter (e.g., the ablation catheter), anticipate a compensatory movement that may be required for the imaging catheter, and generate control signals for the remotely-controlled catheter positioning system controlling the ultrasound catheter based so that the imaging field of view moves in parallel with movements of the second catheter. The control signals sent to the second remotely-controlled catheter positioning system may be from a clinician or automated (e.g., preprogrammed) movement commands issued by a computing device controlling the second remotely-controlled catheter positioning system. For example, the computing device may receive indications of movement commands executing by the second remotely-controlled catheter positioning system to reposition an ablation catheter, determined that the resulting movement of the ablation catheter will take it out of the ultrasound catheter's imaging field of view, and issue commands to the remotely-controlled catheter positioning system controlling the ultrasound catheter to move in a compensatory manner. As another example, when the second remotely-controlled catheter positioning system is executing a preprogrammed sequence of movements to reposition an ablation catheter according to a prescribed procedure (e.g., to achieve a pre-defined ablation pattern), the computing device may issue commands to the remotely-controlled catheter positioning system controlling the ultrasound catheter to maintain the ablation catheter within the field of view without any inputs by the clinician supervising the preprogrammed ablation treatment.
The computing device may further be configured to refine movements of the remotely-controlled catheter positioning system positioning the ultrasound catheter that are performed in response to movement commands issued to the second remotely-controlled catheter positioning system by evaluating subsequently obtained ultrasound imagery and adjusting the algorithm used to determine compensatory movements. In this manner, the computing device may learn how the ultrasound catheter is responding to movement commands (which may depend upon the particular orientation of the catheter at the time) sees, and adjust the compensatory movement commands in order to better maintain the ablation catheter within the imaging field of view.
In various embodiments, ultrasound imagery may be evaluated by the computing device to identify contextual or characteristic information about an organ in which a procedure is being perform, and use such information to change, correct, or modify control algorithms used to generate movement commands to the remotely-controlled catheter positioning system controlling the ultrasound imaging catheter. For example, when the computing device determines that a certain translation of the ultrasound catheter would cause its distal end (which includes the transducer) to collide with tissue (e.g., a heart wall or valve) or otherwise degrade resulting imagery, the computing device may adjust the translation instructions to avoid such a situation.
The remotely-controlled catheter positioning systems may be configured to position various types of catheters and therefore the various embodiments are not limited to ablation catheters and ultrasound catheters that are referred to herein as example embodiments. Further, although the various embodiments may be described as utilizing ultrasound data and/or ultrasound imagery, it should be appreciated that other forms of data and imagery from imaging catheters may be utilized by the various embodiments.
The descriptions of various embodiments refer generally to a “computing device” performing operations of processing imagery and determining catheter repositioning movements that should be executed by a remotely-controlled catheter positioning system. Such a computing device may be a separate computer, part of the control system for a remotely-controlled catheter positioning system, and/or part of an imaging system, such as integrated within an ultrasound catheter processing system.
In embodiments in which the operations attributed to the computing device are performed in a separate computer, such as a portable or workstation computer, (i.e., a computing device that is not part of either the control system for a remotely-controlled catheter positioning system or the imaging system), that separate computer may be coupled via data and command communication links (i.e., data cables and/or wireless data links) to each of the control system for a remotely-controlled catheter positioning system and the imaging system.
In embodiments in which the operations attributed to the computing device are performed within the control system for a remotely-controlled catheter positioning system, the computing device may be implemented as a software module executing within the control system computer (i.e., the control system computer and the computing device may be the same processor executing different software), or as a co-processor or second computer within the same control system (i.e., the control system computer and the computing device may be separate processors within the same system).
In embodiments in which the operations attributed to the computing device are performed within the imaging system, such as an ultrasound catheter processing system, the computing device may be implemented as a software module executing within the imaging system computer (i.e., the imaging system computer and the computing device may be the same processor executing different software), or as a co-processor or second computer within the imaging system (i.e., the imaging system computer and the computing device may be separate processors within the same system).
In further embodiments, some of the operations of the embodiment methods may be performed in the imaging system computer (e.g., processing ultrasound images) and other operations may be performed in a separate computer or within the control system of a remotely-controlled catheter positioning system.
For ease of reference, these various alternative configurations for the computer performing the embodiment methods are referred to generally herein as being performed in a “computing device.” Similarly, a generic computer is shown in the system drawings referenced in the embodiment descriptions that follow. However, the use of this general term in the descriptions of the embodiments is not intended to limit the scope of the claims to a particular embodiment or configuration unless a specific configuration is recited in the claims themselves.
An ultrasound catheter 114 (or other imaging catheter) may be installed on or attached to the remotely-controlled catheter positioning system 110. Based on the control signals received from the computing device 105 via the connection 111, the remotely-controlled catheter positioning system 110 may manipulate the ultrasound catheter 114 within a patient, such as by advancing, retracting, and/or rotating the ultrasound catheter 114, as well as actuating or bending a tip of the tubular member 115 by actuating a control manipulator on the catheter handle. Thus, based on actions of the remotely-controlled catheter positioning system 110, a tubular member 115 of the ultrasound catheter 114 may be manipulated within the patient (e.g., a human, horse, various mammals, etc.) so that its distal end 215 is positioned within an organ 130 of the patient. For example, the organ 130 may be a blood vessel or a chamber of the patient's heart. A tubular member 120 of a second catheter 125 (e.g., an ablation catheter) may be manipulated within the subject such that its distal end 220 is also positioned within the organ 130. In an embodiment, the second catheter 125 may be manipulated by hand (e.g., manually inserted and positioned by a physician manipulating the catheter handle) or alternatively by a second remotely-controlled positioning device, as described below with reference to
In an embodiment, the computing device 105 may be configured to exchange data (e.g., the ultrasound image data obtained by the ultrasound catheter 114) with the ultrasound catheter 114 via a connection 117. For example, the ultrasound catheter 114 may collect and relay (or transmit) raw ultrasound echo data to the computing device 105 to be processed into ultrasound imagery that may be viewed by a clinician and/or evaluated by the computing device 105. In another embodiment, the computing device 105 may receive ultrasound data from another device, such as a dedicated ultrasound data processing system (not shown separately) connected to the ultrasound catheter 114.
In an embodiment, the computing device 105 may store pre-programmed commands or instructions that may be transmitted to the remotely-controlled catheter positioning system 110, such as transmitting control signals for a pre-programmed movement (e.g., rotational and translational movements, a corkscrew maneuver, etc.) in response to a user input, such as a user selecting a file name and pressing an execute key on the remote controller 102 or the system keyboard 106. For example, an embodiment remote controller 102 may include a single button that may be pushed to activate a pre-programmed sequence of operations (e.g., a corkscrew maneuver) that includes rotational and translational movement commands programmed and stored in the computing device 105. Pre-programmed movement commands may also be executed in response to feedback (e.g., sensor data, ultrasound data, etc.) received from the remotely-controlled catheter positioning system 110 and/or the catheter controlled by the remotely-controlled catheter positioning system 110. For example, ultrasound data from the ultrasound catheter 114 controlled by the remotely-controlled catheter positioning system 110 may be received at the computing device 105 and processed to trigger automated or pre-programmed movements. As another example, a pressure sensor on the tip on the catheter may send signals to the computing device 105 when the catheter tip presses against tissue, such as signals indicating an amount of pressure being applied to tissue, which may trigger an automated movement of the remotely-controlled catheter positioning system 110 to relieve that pressure.
The computing device 105 may be configured to receive data generated by or related to both catheters 114, 125, such as sensor data related to the manipulation of the catheters within the organ 130 and/or imaging data. The computing device 105 may be configured to execute separate, concurrent threads, routines, applications, software, or other instructions to properly handle the data exchanges. For example, the computing device 105 may utilize concurrently executing threads for monitoring buffers associated with feedback data (or imaging data) from the individual catheters 114, 125 and/or equipment related to the catheters 114, 125, such as a separate device for buffering, formatting, or otherwise processing data from sensors within the catheters 114, 125.
As described above, data received by the computing device 105 from the ultrasound catheter 114 may be used to generate repositioning instructions and control signals for a remotely-controlled catheter positioning system to cause repositioning of the ultrasound catheter 114 within the patient. In particular, ultrasound data obtained by the ultrasound catheter 114 may be received and processed by the computing device 105 to generate repositioning instructions and control signals that cause the first remotely-controlled catheter positioning system 110 to manipulate the ultrasound catheter 114 so that its transducer may be better positioned to obtain the desired ultrasound data/imagery (e.g., images of the second catheter).
As mentioned above, the automated repositioning of the catheter initiated by the computing device 105 may also be based, at least in part, upon input signals received from the second remote controller 142. In particular, the computing device 105 may receive inputs from the second remote controller 142 for the second remotely-controlled catheter positioning system 150, evaluate the repositioning of the second catheter 125 that may result from the inputs, and generate repositioning instructions and control signals for the first remotely-controlled catheter positioning system 110 based on the received inputs for the second remotely-controlled catheter positioning system 150. In this way, a single clinician may be assisted by the computing device 105 to facilitate moving both catheters 114, 125 in tandem based on the clinician's input commands entered on only one of the remotely-controlled catheter positioning systems 110, 150. In other words, an embodiment computing device 105 may use repositioning commands being executed by a remotely-controlled catheter positioning system positioning an ablation catheter 125 to generate control commands for the remotely-controlled catheter positioning system positioning the ultrasound catheter 114 so that the ultrasound catheter 114 is moved automatically in tandem an appropriate or compensatory amount to ensure that imaging of the ablation catheter 125 is maintained.
Regardless of any dependent repositioning instructions, the computing device 105 may be configured to cause the ultrasound catheter 114 to be repositioned in response to clinician inputs received from the first remote controller 102. In other words, the computing device 105 may control the remotely-controlled catheter positioning systems 110, 150 so that the ultrasound catheter 114 may be moved automatically based on the repositioning of the second catheter 125 and manually based on manual inputs. This embodiment allows the ultrasound catheter 114 to be moved when the second catheter 125 is moved, but also allows the clinician to make fine adjustments (or corrections) via the first remote controller 102.
As an example, in response to receiving a control input via the second remote controller 142, the second computing device 185 may transmit control signals to the second remotely-controlled catheter positioning system 150 to move the second catheter 125 within the organ 130. At the same time, the second computing device 185 may also report such control signals to the first computing device 105 via the data connection 183 between them. In response to receiving such control signals, the first computing device 105 may generate repositioning instructions and control signals for the first remotely-controlled catheter positioning system 110 to move the ultrasound catheter 114 within the patient in a compensatory manner.
The second distal end 220 may be located at the end of a second tubular member 120 of a second catheter, such as an ablation catheter. The second catheter may be repositioned via a remotely-controlled catheter positioning device, such as shown in the
In the example shown in
For the purposes of this disclosure, the center of an image may be considered an optimal position (or a “desired location”) for an object to be viewed within imagery. However, other locations within imagery may be preferred for various procedures, clinicians, and/or equipment. To accommodate this, particular desired locations within ultrasound images (e.g., target regions or coordinates within imagery) may be stored within a computing device as procedure, equipment or clinician preferences, such as within stored profiles corresponding to clinicians, procedures, patients, etc.
In the example illustrated in
In the example illustrated in
In block 302, the computing device may receive ultrasound data from the ultrasound catheter co-located with a second catheter within an organ (e.g., within chamber of patient heart, etc.). The computing device may receive the ultrasound data from the ultrasound catheter directly when the computing device is directly coupled to the ultrasound catheter or from an ultrasound imaging system, which receives the ultrasound data from the ultrasound catheter and renders ultrasound images. For example, the computing device may receive the ultrasound data after it has been stored, formatted, and otherwise processed by a dedicated ultrasound imaging system directly coupled to the ultrasound catheter. In an embodiment, the computing device may receive the ultrasound data or ultrasound images from a storage device or other data structure configured to buffer, store, or maintain ultrasound data.
The ultrasound catheter may be any catheter type, structure, or design capable of relaying ultrasound data for imaging the organ and capable of being positioned within the organ by a remotely-controlled catheter positioning device, such as described below with reference to
In optional block 304, the computing device may generate ultrasound imagery based on the received ultrasound data in embodiments in which the ultrasound data is processed directly by the computing device (i.e., not by an ultrasound imaging system). The computing device may perform various decoding, conversion, and processing operations, routines, or software to generate ultrasound imagery that may provide graphical representations of the organ based on the received ultrasound data. For example, the computing device may perform a software routine that converts the received ultrasound data into a static image or a series of images (e.g., a video file). In an embodiment, the computing device may receive ultrasound imagery from another device, such as a dedicated ultrasound processing device.
The computing device may perform image analysis operations on the ultrasound imagery to detect the presence of the second catheter within the image volume in block 306. Such image analysis operations may include evaluating the visual characteristics of the various segments of the generated imagery, such as identifying areas with high or low contrast or reflectivity, movement over a time period, changing values (e.g., blinking, etc.), predefined shapes, deformations over a time period, etc. In an embodiment the computing device may be configured to filter out irrelevant information within the ultrasound imagery, such as motion blur or artifacts caused by corrupt data or other errata. Further, the computing device may be configured to analyze the ultrasound imagery based on the organ structure, such as by utilizing predefined thresholds for determining errata or movement that are informed by typical conditions in the organ (e.g., typical heartbeat frequency ranges, tissue densities in a certain area of vascular system, etc.).
In an embodiment, the second catheter may include one or more ultrasound reflectors (e.g., microspheres or bubbles embedded within the catheter) configured to produce a loud echo (which may appear as a bright spot in the ultrasound imagery) affixed to or near the tip of the catheter to function as a recognizable features or fiducial marks to facilitate locating the second catheter within ultrasound images. In this embodiment, the computing device may be configured to evaluate the ultrasound data to identify and track such ultrasound reflectors, use the resulting loud echoes is fiducial marks for tracking the catheter tip. For example, the computing device may analyze the ultrasound imagery to determine whether an ultrasound reflector known to be located at the tip of the second catheter (e.g., an ultrasound reflector) appears within the ultrasound imagery. In an embodiment, such an element at the tip may be made of a particular material or surface known to be highly reflective regarding ultrasound waves or otherwise cause highly recognizable representations within ultrasound imagery.
In determination block 308, the computing device may determine whether the second catheter is detected within the imagery based on the image analysis. For example, the computing device may determine whether any segment within the ultrasound imagery matches the approximate shape, consistency, materials, transparency, and/or size of a man-made object resembling a catheter. In an embodiment, the computing device may perform pattern-matching operations, such as by comparing segments within the analyzed ultrasound imagery to predefined images of catheters (e.g., pictures of a catheter tip or lumen, etc.). The computing device may also compare the ultrasound imagery to information known about the second catheter, such as shapes, ultrasound reflectors, and echo characteristics. For example, the computing device may use stored data regarding the expected density and tip shape of the second catheter when processing the ultrasound imagery to recognize and locate the tip of the catheter within an ultrasound image. In various embodiments, the computing device may utilize tolerance thresholds in its determinations and may only determine that the second catheter is imaged within the ultrasound imagery when the analysis falls within a certain confidence or certainty threshold.
If the computing device determines that the second catheter is not imaged within the ultrasound imagery field of view (i.e., determination block 308=“No”), the computing device may repeat the operations of receiving ultrasound images in block 302 to continuing looking for the presence of the second catheter in the images. In this situation, the computing device may execute a preprogrammed to search routine by which it causes the ultrasound catheter tip to move in a preprogrammed sequence to scan a large volume in order to find the target catheter. Alternatively, the computing device may process images while a clinician manipulates a controller and sending movement commands to the remotely-controlled catheter positioning system. A clinician not seeing the second catheter in the ultrasound imagery may command the remotely-controlled catheter positioning system so as to reposition the ultrasound catheter searching for the target catheter. For example, a doctor conducting a procedure with an ablation second catheter may interact with a remote controller to reposition the ultrasound catheter until the ablation catheter can be seen to some degree within the resulting ultrasound imagery. Thus, operations of blocks 302 through 308 may continue in a loop while the clinician manipulates the ultrasound catheter via its corresponding remotely-controlled catheter positioning system until the second catheter is within view of the ultrasound imagery (i.e., determination block 308=“Yes”).
When the computing device determines that the second catheter is within the ultrasound image volume (i.e., determination block 308=“Yes”), the computing device may determine whether the second catheter tip appears at a desired location within the imagery (e.g., at or near the center of the ultrasound imagery) in determination block 310. For example, the computing device may evaluate the ultrasound imagery to detect shapes associated with tips (e.g., hard, pointed objects, etc.) and determine the distance that such shapes appear from the centerline of the ultrasound image volume. As described above, the desired location of the target catheter within the ultrasound image may be predefined, such as within a stored preference or profile corresponding to the clinician, procedure, patient, and/or equipment. Tracking of enhanced ultrasound echo structures, such as microspheres within the catheter near the tip, may facilitate the accurate determination of the tip of the catheter with respect to the centerline of the ultrasound image volume.
If the computing device determines that the second catheter tip appears at or near the desired location within the ultrasound imagery (i.e., determination block 310=“Yes”), no adjustment in the positioning of the ultrasound catheter tip is necessary, so the computing device may continue with the operations of receiving ultrasound data in block 302 and processing the ultrasound to locate the catheter within.
If the computing device determines that the second catheter tip is at the desired location within the imagery (i.e., determination block 310=“Yes”), in optional block 311 the computing device may render a user prompt requesting the clinician to make an input to confirm that automated repositioning operations may begin. In other words, to ensure complete control and awareness of clinicians over automated actions for positioning a catheter within a patient, the computing device may request that the clinician approve when such automated actions are authorized to be performed. In this way, the computing device may be constrained from manipulating the ultrasound catheter except when explicitly authorized to do so. The prompt may be rendered in various ways, such as a dialog box is on a display connected to the computing device, as a predefined sound or audible cue broadcast via a speaker connected to the computing device, and/or a tactile signal, such as a rumble on the remote controller for the remotely-controlled catheter positioning device connected to the computing device.
In another embodiment, the operations in optional block 311 may be performed by the computing device after the operations in block 316 or block 318 so that more information may be presented to the clinician. For example, the computing device may render a prompt that indicates a proposed amount of repositioning of an ultrasound catheter based on the calculated positioning corrections (e.g., “OK to extract ultrasound catheter by a millimeter?”) and/or the generated repositioning instructions (e.g., “OK to bend distal end to the left by a 1 degree angle?”). In an embodiment, the computing device may render a prompt requesting permission to lock a setting for performing automated repositioning operations (e.g., “OK to activate setting for automatically repositioning ultrasound catheter?”).
In optional determination block 312, the computing device may determine whether a user input confirming the automated repositioning operations has been received. The computing device may monitor input buffers, interactions with user interfaces (e.g., a GUI button press, etc.), input gestures, and/or input from various connected peripherals, devices, or functionalities. For example, the computing device may receive a mouse click on a portion of a rendered dialog box associated with an ‘accept’ or ‘reject’ graphical user interface button. As another example, the computing device may receive audio data from a microphone and perform speech analysis to determine whether the physician has audibly confirmed automated operations (e.g., “Yes” or “Move the ultrasound catheter,” “No,” etc.). If the computing device determines a user input confirming the automated repositioning operations be performed has not been received (i.e., optional determination block 312=“No”), in optional block 314 the computing device may render an acknowledgement (e.g., visual, sound, etc.) indicating that automated repositioning operations may not be performed (e.g., a dialog box rendered on the computing device display indicating “Automated operations are deactivated,” etc.), the computing device may continue receiving ultrasound data in block 302.
If the computing device determines that a user input confirmed conducting automated repositioning operations (i.e., optional determination block 312=“Yes”), in optional block 315 the computing device may render an acknowledgement indicating that automated repositioning operations are activated (e.g., a dialog box rendered on the computing device display indicating “Automated repositioning active.”).
In an embodiment, the operations in optional block 311 and optional determination block 312 may be performed repeatedly, periodically, or until reset. For example, to avoid redundant or distracting prompts, the computing device may be configured to only prompt a clinician to confirm whether to allow automated repositioning operations once every predetermined time period (e.g., prompt once every few seconds, minute, etc.), or alternatively based on a predefined event (e.g., prompt once per procedure, after a predefined number of control signals are transmitted, etc.). In an embodiment, the computing device may be configured to prompt the user to confirm automated repositioning whenever the second catheter comes into view within the ultrasound imagery after being absent from the imagery.
In block 316, the computing device may calculate positioning corrections based on the current location of the second catheter tip detected within the imagery. For example, the computing device may calculate a lateral distance (e.g., a number of millimeters, etc.) to move the ultrasound catheter based on the distance and direction from the center of the current ultrasound imagery to the tip of the second catheter. The computing device may also calculate orientations and various other movements that may need to be performed in order to center-align subsequent ultrasound imagery to the tip of the second catheter.
In block 318, the computing device may generate repositioning instructions based on the calculated positioning corrections (e.g., translate, rotate, bend, etc.). In other words, the computing device may identify actions that may be performed by a remotely-controlled catheter positioning system to manipulate the ultrasound catheter based on the positioning correction information. For example, the computing device may determine that instructions employing a certain amount of pushing (or pulling) may be performed in order to correct for the second catheter's tip being offset laterally from the center of the current ultrasound imagery. As another example, the computing device may determine that an instruction for rotating a certain number of degrees may be performed by the remotely-controlled catheter positioning system to place the second catheter's tip in the middle of subsequent ultrasound imagery. The instructions may be API commands or other instructions that utilized a predefined set of operations that may be performed by the remotely-controlled catheter positioning device.
In an embodiment, the computing device may utilize predefined data describing the organ when generating the repositioning instructions in block 318. For example, the computing device may compare the current location of the ultrasound catheter to model data representing the organ (e.g., a model of the geography of the heart, etc.) to determine whether generated instructions would cause a collision with the anatomy of patient's organ. In this way, the computing device may modify (e.g., decrease or increase the values of movements) the generated instructions, or alternatively delete instructions entirely, when such actions would not safe for the patient. Additionally, the computing device may use such predefined data to avoid generating instructions that may cause the ultrasound catheter to be poorly positioned and/or unable to relay useful ultrasound data. For example, the computing device may evaluate data representing the organ to determine whether the generated instruction would move the ultrasound catheter in such a way that its data collection would be impeded, and if so, adjust the generated instructions. In an embodiment, the predefined data may be general data (e.g., anatomical data for a typical heart, etc.) or alternatively may be specific to the particular patient (e.g., data of Mr. Smith's actual organs, etc.).
In block 320, the computing device may transmit control signals based on the generated repositioning instructions to a remotely-controlled catheter positioning system associated with the ultrasound catheter. In other words, the computing device may communicate the generated instructions to the remotely-controlled catheter positioning system in order to cause the repositioning of the ultrasound catheter. The control signals may be formatted for use by remotely-controlled catheter positioning systems as described below with reference to
In block 302, the computing device may receive ultrasound data from an ultrasound catheter co-located with a second catheter within an organ (e.g., within chamber of patient heart, etc.). In block 304, the computing device may generate ultrasound imagery based on the received ultrasound data. In block 306, the computing device may perform image analysis operations on the generated ultrasound imagery to detect a representation of the second catheter. In determination block 308, the computing device may determine whether the representation of the second catheter is detected within the imagery.
If the computing device detects the second catheter within the imagery (i.e., determination block 308=“Yes”), the computing device may determine whether the second catheter tip is at the desired location within the imagery in determination block 310. If the computing device determines that the second catheter tip is at the desired location within the imagery (i.e., determination block 310=“Yes”), the computing device may continue receiving additional ultrasound data for processing in block 302. If the computing device determines that the second catheter tip is not at the desired location within the imagery (i.e., determination block 310=“No”), the computing device may calculate positioning corrections based on the current location of the second catheter tip detected within the imagery in block 316 as described above with reference to
If the computing device does not detect the second catheter within the imagery (i.e., determination block 308=“No”), in block 402 the computing device may calculate positioning correction's based on context information from the performed image analysis (e.g., heart geography, etc.), such as to search for the target catheter. As described above, the computing device may evaluate predefined organ model data (e.g., stored data indicating the dimensions or characteristics of a heart, etc.) and/or the ultrasound imagery to determine where with the ultrasound catheter is currently located within the patient's organ. For example, the computing device may determine that based on the lack of movement within the ultrasound imagery, the ultrasound catheter is rotated away from the portion of the heart that is the site for the procedure, and thus should be rotated a number of degrees in order to capture images of the second catheter. In an embodiment, the computing device may also evaluate predefined organ model data, such as mappings of the organ, individually or in combination with the context information in order to calculate the positioning correction information. As part of the operations of block 402, the computing device may calculate positioning correction that may be the most likely to position the ultrasound catheter in the direction of the second catheter, or as part of a predefined search pattern. Thus, the operations in block 402 may involve an automated procedure for iteratively searching for the second catheter using best guess repositioning.
After calculating positioning correction in block 402 or block 316, the computing device may generate repositioning instructions for a remotely-controlled catheter positioning system based on the calculated positioning correction (e.g., translate, rotate, bend, etc.) in block 318. The computing device may transmit the generated repositioning control instructions to a remotely-controlled catheter positioning system associated with the ultrasound catheter in block 320, and continue receiving and processing imagery in block 302 in a continuous process.
In determination block 502, the computing device may determine whether a report of repositioning control signals transmitted to a remotely-controlled catheter positioning system associated with the second catheter is obtained. Such a report may be received as a message from another device, such as a computer connected to the second remotely-controlled catheter positioning system. In another embodiment, the report may be data within a buffer or other data structure within the computing device. For example, the computing device may execute separate routines that are configured to process inputs associated with different remotely-controlled catheter positioning systems (and related catheters), and in response to receiving inputs for positioning the second catheter, the computing device may indicate the received inputs in a stored buffer that may be accessed by routines for automatically controlling another remotely-controlled catheter positioning system associated with the first catheter. If the computing device determines that a report indicating repositioning control signals transmitted to the remotely-controlled catheter positioning system associated with the second catheter was received (i.e., determination block 502=“Yes”), the computing device may generate repositioning instructions for the remotely-controlled catheter positioning system associated with the first catheter based on the received report and the current position of the first catheter in block 504. The computing device may determine the repositioning instructions to emulate the actions corresponding to the control signals within the report. For example, the computing device may generate a rotate instruction for the first catheter based on a control signal that was sent to cause the second catheter to move in a direction roughly parallel to the short axis of the ultrasound image.
Because the first and second catheters are not in the same location within the patient's organ, the computing device may also have to adjust instructions to avoid collisions with anatomy or other elements within the patient's organ. For example, a certain translation by the imaging catheter may not be possible when that translation would cause the imaging catheter to contact the wall of a heart chamber. The computing device may evaluate the current position of the first catheter and generate repositioning instructions that are appropriate for the difference in catheter positioning within the patient's organ and to maintain the first catheter within the field of view of the imaging catheter.
However, if the computing device determines that no report indicating repositioning control signals transmitted to the remotely-controlled catheter positioning system associated with the second catheter was received (i.e., determination block 502=“No”), the computing device may determine whether inputs for manipulating the first catheter are received, such as via a remote controller corresponding to the remotely-controlled catheter positioning system associated with the first catheter and connected to the computing device. If no inputs are received (i.e., determination block 506=“No”), the computing device may continue to monitor for receipt of report indicating repositioning control signals in determination block 502. If inputs for manipulating the first catheter are received (i.e., determination block 506=“Yes”), in block 508 the computing device may generate repositioning instructions based on the received inputs, such as bend, translate, and/or rotate instructions.
Based on the repositioning instructions generated in block 504 or block 508, the computing device may transmit repositioning control instructions to the remotely-controlled catheter positioning system associated with the first catheter in block 510. The computing device may then continue to monitor for receipt of report indicating repositioning control signals in determination block 502.
As described above, in determination block 502, the computing device may determine whether a report indicating repositioning control signals transmitted to a remotely-controlled catheter positioning system associated with the second catheter is obtained. If computing device determines that the report indicating repositioning control signals transmitted to the remotely-controlled catheter positioning system associated with the second catheter is obtained (i.e., determination block 502=“Yes”), the computing device may calculate positioning corrections based on the obtained report and the current position of the ultrasound catheter in block 554. The calculated positioning corrections may be an estimate of how much the ultrasound catheter should be moved to keep the second catheter in the center of the ultrasound imagery. For example, the computing device may calculate the distance the second catheter's tip likely moved based on the obtained report of the control signals that moved the second catheter.
If the computing device determines that no report indicating repositioning control signals transmitted to the remotely-controlled catheter positioning system associated with the second catheter has been obtained (i.e., determination block 502=“No”), the computing device may receive ultrasound data from an ultrasound catheter co-located with a second catheter within an organ in block 302, generate ultrasound imagery based on the received ultrasound data in block 304, and perform image analysis operations on the generated ultrasound imagery to detect a representation of the second catheter in block 306 as described above with reference to
If the computing device detects the second catheter within the imagery (i.e., determination block 308=“Yes”), the computing device may determine whether the second catheter tip is at the desired location within the imagery in determination block 310. If the computing device determines that the second catheter tip is at the desired location within the imagery (i.e., determination block 310=“Yes”), the computing device may continue to receive additional ultrasound data for processing in block 302.
If the computing device determines that the second catheter tip is not at the desired location within the imagery (i.e., determination block 310=“No”), the computing device may calculate positioning corrections based on the current location of the second catheter tip detected within the imagery in block 316. In block 318, the computing device may generate repositioning instructions for a remotely-controlled catheter positioning system based on the calculated positioning corrections (e.g., translate, rotate, bend, etc.). In block 320, the computing device may transmit the repositioning control instructions to a remotely-controlled catheter positioning system controlling with the ultrasound catheter. The computing device may perform the above-described operations in a continuous process by determining whether subsequent control signal reports are received in determination block 502.
Any type of computing device or combination of computing devices may be configured to perform some or all of the operations described above with reference to
The embodiments may be implemented with a variety of different types of catheter devices that are well known in the art, such as ablation catheters and electrophysiology catheters. Therefore, the devices described below with reference to
A tubular member 115 of the ultrasound catheter 114 may have a proximal end 614 (or proximal portion) and a distal end 215 (or distal portion). Distal portions of the tubular member 115 may be more flexible than proximal portions to improve maneuverability and decrease the risk of damage to a patient's organ. Like other known catheters, the ultrasound catheter 114 may also include a steering mechanism 624 that may control tensions on steering cables (not shown) within the tubular member 115 and may cause bending or other contorting of the tubular member 115. The steering mechanism may be a handle, a slide actuator, a rotatable control knob, handle or wheel, or other suitable manipulating member mounted in a control handle 623.
An ultrasound transducer 216 may be at the distal end 215 of the tubular member 115. The transducer 216 may be formed from an array of individual ultrasound elements 618. As is well known in the art, the transducer 216 may be comprised of various numbers and configurations of ultrasound elements 618, such as forty-eight elements or sixty-four elements to form a linear phased array ultrasound imaging sensor. The transducer 216 may be connected to a plurality of electrical cables (e.g., coaxial cables) running through the tubular member 115. There may be one electrical cable per each ultrasound element 618 of the transducer 216. In order to fit various components, such as the transducer 216 and associated wires, the diameter of the ultrasound catheter 114 may be in various size ranges, such as in between 6 to 12 French. The direction or orientation of the transducer 216 and the ultrasound elements 618 may be adjusted by bending the tubular member 115 of the catheter 114, such as by manipulating (or steering) the ultrasound catheter 114 via a remote control or device. Such bending of the ultrasound catheter 114 is shown with the dotted lines 630 in
As it is known in the art, a tubular member 120 (e.g., a catheter sheath) may be inserted into a patient by use of various known procedures and devices. The tubular member 120 may terminate in a distal end 220. The distal end 220 may include, for example, electrodes for supplying electrical stimulation, coolant, heat, etc.
The tubular member 120 may be physically attached to the catheter handle 702 so that movement of the catheter handle 702 forward or backward in the direction of arrow 720 or 722 may cause the tubular member 120, as well as the distal end 220, to move similarly. Rotation or torquing of the catheter handle 702 in a clockwise or counterclockwise manner as is shown by arrows 724 and 726, may impart a similar rotation to the tubular member 120. Rotation of the knob 712 in the direction of arrow 728 or 730 may cause deflection of the distal end 220 in one of the directions shown as 220a and 220b. Thus, when used manually, commercially available catheters may operate in six ranges of motion: forward and backward in the direction of arrows 720 and 722, rotation in the direction of arrows 724 and 726, and deflection to positions such as 220a and 220b.
The sled member 878 may be attached to the catheter handle 702 by the modular plate 884 and the handle control assembly 882. The modular plate 884 and handle control assembly 882 may be specific to the type/manufacture of the catheter 125 shown. Different modular plates 884 and handle control assemblies 882 may be used dependent upon the type/make of catheter used. The modular plates 884 and handle control assemblies 882 may be sterilizable, disposable, or both. As the modular plate 884 is detachable from sled member 878, different handles may be used for different types of catheters.
It should be noted that various types of available, off-the-shelf or other catheter may be utilized in remotely-controlled catheter positioning systems, such as a bi-directional ablation catheter or the ultrasound catheter 114 described above with reference to
The catheter handle 702 of catheter 125 may be engaged into the modular plate 884 at three points, namely, clamps 886 and 888 and the molded nest 890. The catheter handle 702 may be snap fit into molded nest 890 or secured by friction. The proximal end of catheter handle 702 may be mounted to the modular plate 884 through the use of the clamp 886 and the distal end may be mounted onto the modular plate 884 through the use of the clamp 888. The clamps 886, 888 may be snap fit. If the catheter 125 has an additional range of motion, such as the point of deflection in a certain ablation catheter, an additional motor may be attached to move the corresponding control on the handle. The modular plate 884 may subsequently be attached to the sled member 878 by snap fit. The modular plate 884 may have protrusions (not shown) effective to secure the modular plate 884 to the sled member 878. The modular plate 884 may also be attached to a sled member and the catheter handle.
The sled member 878 may be equipped with rear and/or front end force sensors (not shown) to gauge force in three zones. A display (not shown) may be located on modular plate 884 or elsewhere. The display may indicate forces of low, medium, and high. These indications may be represented by colored lights, including green, yellow, and red respectively, or bars of light, such as one bar, two bar, or three bars. In a further embodiment, the display may further include an audio sensor which emits a noise when the incorrect amount of force is applied.
A motor housing 958 may house a motor (not shown) mounted on a support surface (not shown). Such a motor may receive power and signal control through the use of wires fed through a wire housing (not shown) and terminal connectors (not shown). Wires may supply both power and signal control to the motor and the handle controller 944. The motor may rotate a drive screw (not shown) to advance the sled member 938. The motor may easily move the handle controller 944 and sled member 938 back and forth on the sled base 936 to help with catheter placement. The handle controller 944 may be coupled to the sled member 938. The device 110 may be connected to a control device or system (not shown), such as a programmable computing device, via a connection 111.
The remotely-controlled catheter positioning system 110 may be connected to the remote controller 102 which may be used to receive inputs from clinicians (or users). The remote controller 102 may imitate the look and feel of a standard catheter for ease in controls, and further may be designed for use with a single hand. The distal end 972 may be rotated to control right roll and left roll of a catheter, such as catheter 125 described above. Buttons (not shown) located on the body of the remote controller 102 may control in and out functionalities. At the indentation close to the distal end 972 of remote controller 102, a knob 974 may be used to control deflection or other articulation. A connection 103 (or wire) located at proximal end 976 may connect the remote controller 102 to a power source. In various configurations, the remote controller 102 may be connected to the remotely-controlled catheter positioning system 110 and/or a control device or system (e.g., a computing device) via the connection 103.
Various other catheters, medical devices, and configurations and components for remotely-controlled catheter positioning systems and related systems that may be used with the embodiments are described in U.S. patent application Ser. No. 13/432,161 that is incorporated by reference above.
A number of different types of computing devices may be used to implement the various embodiments, including personal computers and laptop computers. Such computing devices typically include the components illustrated in
The various embodiments may be implemented on any of a variety of commercially available computing devices, such as the workstation computer 1100 illustrated in
The processors 1001 and 1101 may be any programmable microprocessor, microcomputer or multiple processor chip or chips that can be configured by software instructions (applications) to perform a variety of functions, including the functions of the various embodiments described above. In the various devices, multiple processors may be provided, such as one processor dedicated to wireless communication functions and one processor dedicated to running other applications. Typically, software applications may be stored in the internal memory 1002 and 1102 before they are accessed and loaded into the processors 1001 and 1101. The processors 1001 and 1101 may include internal memory sufficient to store the application software instructions. In many devices the internal memory may be a volatile or nonvolatile memory, such as flash memory, or a mixture of both. For the purposes of this description, a general reference to memory refers to memory accessible by the processors 1001 and 1101 including internal memory or removable memory plugged into the various devices and memory within the processors 1001 and 1101.
The foregoing method descriptions and the process flow diagrams are provided merely as illustrative examples and are not intended to require or imply that the steps of the various embodiments must be performed in the order presented. As will be appreciated by one of skill in the art the order of steps in the foregoing embodiments may be performed in any order. Words such as “thereafter,” “then,” “next,” etc. are not intended to limit the order of the steps; these words are simply used to guide the reader through the description of the methods. Further, any reference to claim elements in the singular, for example, using the articles “a,” “an” or “the” is not to be construed as limiting the element to the singular.
The various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The hardware used to implement the various illustrative logics, logical blocks, modules, and circuits described in connection with the embodiments disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
In the functions of the various embodiments described above may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a non-transitory processor-readable (i.e., processor-readable instructions), computer-readable medium or a non-transitory processor-readable storage medium. The steps of a method or algorithm disclosed herein may be embodied in a processor-executable software module or processor-executable software instructions which may reside on a non-transitory computer-readable storage medium, and/or a non-transitory processor-readable storage medium. In various embodiments, such instructions may be stored processor-executable instructions or stored processor-executable software instructions. Tangible, non-transitory computer-readable storage media may be any available media that may be accessed by a computer. By way of example, and not limitation, such non-transitory computer-readable media may comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer. Disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of non-transitory computer-readable media. Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a tangible, non-transitory processor-readable storage medium and/or computer-readable medium, which may be incorporated into a computer program product.
The preceding description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the following claims and the principles and novel features disclosed herein.