Patent Application
20230335262
This application is also related to the following commonly-owned U.S. patent application filed on even date herewith and having Attorney Docket Number AFRA-0002-P01, and entitled “ANATOMICAL MODEL CONTROLLING,” the entire contents of which are hereby incorporated herein by reference.
Three-dimensional models can be used to assist in the placement or use of a device when such placement or use is not easily observable. For example, in medical procedures, three-dimensional models are used to assist in the placement and use of medical devices used for diagnosis or treatment of patients. An example of such a medical procedure carried out with the assistance of a three-dimensional model is the use of a catheter to deliver radio frequency (“RF”) ablation to form lesions that interrupt abnormal conduction in cardiac tissue, thus terminating certain arrhythmias in the heart.
The present disclosure is directed to devices, systems, and methods of controlling the construction of a three-dimensional model of a cardiac chamber. More specifically, the devices, systems, and methods of the present disclosure can be used to rewind a portion of a build of a three-dimensional model of the cardiac chamber. As compared to systems and methods that do not offer a physician the ability to rewind a build of a three-dimensional model of a cardiac chamber, the systems and methods of the present disclosure can facilitate efficiently building an accurate representation of the cardiac chamber, which can reduce the time of a medical procedure. Additionally, or alternatively, the accuracy in building the representation of the cardiac chamber can be useful for visualizing movement of a medical device in the cardiac chamber.
According to one aspect, a method includes receiving a plurality of signals indicative of respective visited locations of a catheter in a cardiac chamber of a patient, progressively forming, based on the visited locations of the catheter in the cardiac chamber, a continuous surface representing at least a portion of a surface of the cardiac chamber, displaying the continuous surface on a graphical user interface, receiving, from an input device, a rewind command, and updating, based on the rewind command, a display of the continuous surface on the graphical user interface from a first state of the continuous surface to a second state of the continuous surface, at least a portion of the second state preceding at least a portion of the first state in the progressive formation of the continuous surface.
In some implementations, the first state of the continuous surface and the second state of the continuous surface can correspond to partially overlapping time periods in the progressive formation of the continuous surface.
In certain implementations, the first state of the continuous surface can define a first volume and the second state of the continuous surface can define a second volume different from the first volume. For example, the second volume can be less than the first volume. Additionally, or alternatively, receiving the rewind command can include receiving a signal indicative of a quantity of discrete inputs, and the difference between the first volume defined by the first state of the continuous surface and the second volume defined by the second state of the continuous surface can be substantially proportional to the quantity of discrete inputs. Each discrete input can, for example, correspond substantially to a predetermined difference in volume defined by the continuous surface.
In some implementations, the method can further include storing a plurality of temporal states of the continuous surface in a data structure, the plurality of temporal states of the continuous surface including the first state and the second state. For example, in the data structure, consecutive temporal states of the continuous surface can be distinguished from one another by a respective key frame based on a change in the continuous surface as the continuous surface is progressively formed. Further, or instead, the continuous surface corresponding to each state of the plurality of states can define a respective volume, and each key frame corresponds substantially to a predetermined change (e.g., about 1 cm3) in volume between respective consecutive temporal states of the continuous surface.
In certain implementations, the data structure can include respective pointers corresponding to the first state of the continuous surface and the second state of the continuous surface, and displaying the second state of the continuous surface can include changing from a first pointer corresponding to the first state to a second pointer corresponding to the second state.
In some implementations, the data structure can include a three-dimensional data structure (e.g., a three-dimensional grid), and each state of the plurality of temporal states of the continuous surface can be derived from one or more portions of the three-dimensional data structure. The portions of the three-dimensional data structure can include, for example, surface elements forming the plurality of temporal states of the continuous surface. Additionally, or alternatively, the portions of the three-dimensional data structure can include one or more of zero-dimensional elements, one-dimensional elements, two-dimensional elements, three-dimensional elements, four-dimensional elements, and combinations thereof. By way of example, the first state of the continuous surface can be derived from the three-dimensional data structure corresponding to a first time period, the second state of the continuous surface can be derived from the three-dimensional data structure corresponding to a second time period, and at least a portion of the second time period can precede at least a portion of the first time period. The one or more portions of the three-dimensional data structure can be, in some instances, modified based on the rewind command.
In certain implementations, progressively forming the continuous surface can be based on a chronological order of the visited locations of the catheter in the cardiac chamber.
In some implementations, the method can further include receiving an undo command and, based on the undo command, modifying the display of the continuous surface on the graphical user interface from the second state of the continuous surface to a third state of the continuous surface, wherein the third state of the continuous surface follows the second state of the continuous surface in the progressive formation of the continuous surface. The third state of the continuous surface can precede or be substantially contemporaneous with the first state of the continuous surface in the progressive formation of the continuous surface.
According to another aspect, a method includes receiving a plurality of signals indicative of respective visited locations of a catheter in a cardiac chamber of a patient, displaying, on a graphical user interface, a continuous surface representing at least a portion of a surface of the cardiac chamber, the continuous surface derived from a data structure and based on the visited locations, receiving, from an input device, a rewind command, accessing, based on the rewind command and on an order of receipt of the visited locations of the catheter, one or more entries in the data structure, and, based on the accessed one or more entries in the data structure, updating the display of the continuous surface on the graphical user interface.
In some implementations, the method can further include forming, based on the visited locations of the catheter in the cardiac chamber, the data structure as a three-dimensional data structure of the visited catheter locations.
In certain implementations, accessing the one or more entries in the data structure can include removing the one or more entries from the data structure.
In some implementations, accessing the one or more entries of the data structure can include modifying the one or more entries corresponding to the visited locations of the catheter.
In certain implementations, accessing the one or more entries of the data structure can include modifying the one or more entries based on a reverse chronological order of receipt of the corresponding visited location or locations of the catheter. For example, accessing the one or more entries of the data structure can include modifying the one or more entries corresponding to the visited location or locations of the catheter based on a last-in-first-out priority. Additionally, or alternatively, accessing the one or more entries of the data structure can include removing the one or more entries corresponding to the most recently received location or locations of the catheter within a predetermined period.
In some implementations, receiving the rewind command can include receiving a signal indicative of a quantity of discrete inputs, and a quantity of the one or more accessed entries of the data structure is proportional to the quantity of the discrete inputs. For example, the quantity of discrete inputs can correspond to a received quantity of clicks of a click-based input device.
In certain implementations, receiving the rewind command can include displaying, on the graphical user interface, visual indicia of the received rewind command. Displaying visual indicia on the graphical user interface can include, for example, displaying a spatial extent of the received rewind command. As a more specific example, the spatial extent of the received rewind command can be displayed on one or more of the continuous surface, on the data structure, as a surface or volume separate from the continuous surface and the data structure, and combinations thereof. Further, or instead, displaying visual indicia on the graphical user interface can include displaying a temporal extent of the received rewind command, the temporal extent corresponding to a time between a first state of the continuous surface and a second state of the continuous surface, wherein the second state precedes the first state in a progressive formation of the continuous surface.
In some implementations, the method can further include receiving an undo command (e.g., from an input device) and, based on the undo command, modifying the display of the continuous surface from a second state of the continuous surface to a third state of the continuous surface, wherein the third state of the continuous surface follows the second state in a progressive formation of the continuous surface. The third state of the continuous surface can, for example, precede or be substantially contemporaneous with a first state of the continuous surface in the progressive formation of the continuous surface. Further or instead, receiving the undo command can include receiving a signal indicative of a quantity of discrete inputs (e.g., corresponding to a receive quantity of clicks of a click-based input device) and the third state of the continuous surface is based on the quantity of the discrete inputs.
According to another aspect, a non-transitory, computer-readable storage medium has stored thereon computer executable instructions for causing one or more processors to receive a plurality of signals indicative of respective visited locations of a catheter in a cardiac chamber of a patient, based on the visited locations of the catheter in the cardiac chamber, progressively form a continuous surface representing at least a portion of a surface of the cardiac chamber, display the continuous surface on a graphical user interface, receive, from an input device, a rewind command, and, based on the rewind command, update a display of the continuous surface on the graphical user interface from a first state of the continuous surface to a second state of the continuous surface, at least a portion of the second state preceding at least a portion of the first state in the progressive formation of the continuous surface.
According to still another aspect, a system includes a cardiac catheter and a computer interface unit in communication with the cardiac catheter. The catheter interface unit includes a graphical user interface, one or more processors, and a non-transitory, computer-readable storage medium having stored thereon computer executable instructions for causing one or more processors to receive a plurality of signals indicative of respective visited locations of a catheter in a cardiac chamber of a patient, based on the visited locations of the catheter in the cardiac chamber, progressively form a continuous surface representing at least a portion of a surface of the cardiac chamber, display the continuous surface on the graphical user interface, receive, from an input device, a rewind command, and, based on the rewind command, update a display of the continuous surface on the graphical user interface from a first state of the continuous surface to a second state of the continuous surface, at least a portion of the second state preceding at least a portion of the first state in the progressive formation of the continuous surface.
Implementations can include one or more of the following advantages.
In some implementations, a rewind command can facilitate editing a three-dimensional anatomic model formed based on catheter locations in a cardiac chamber. For example, the rewind command can facilitate efficient editing of the three-dimensional anatomic model as the model is being built. More specifically, the rewind command can correct distortions or errors in the three-dimensional anatomic model, such as distortions or errors that can occur through one or more of inadvertent placement of a catheter tip. Further, or instead, the rewind command can correct distortions or errors resulting from pressure of the catheter on tissue as the three-dimensional anatomic model is in a build phase.
Other aspects, features, and advantages will be apparent from the description and drawings, and from the claims.
Like reference symbols in the various drawings indicate like elements.
The present disclosure is generally directed to devices, systems and methods of controlling the build of a three-dimensional model of a cardiac chamber of a patient. More specifically, a continuous surface displayed on a graphical user interface can be based on a three-dimensional data structure that can be modified to provide corresponding control over the displayed continuous surface. The three-dimensional data structure can include received catheter locations, and control over the displayed continuous surface can include a rewind command executed on the received catheter locations. The rewind command can be useful as a simple interface for undoing certain portions of a continuous surface displayed on a graphical user interface without requiring the use of a mouse to mark sections on a three-dimensional model displayed on a screen. Additionally, or alternatively, the simplicity of the rewind command can be useful for implementation as part of a remote control device in communication with a graphical user interface and operated by a physician (e.g., while the physician is manipulating the catheter).
It should be appreciated that, unless otherwise specified or made clear from the context, the systems and methods of the present disclosure can be used for any of various different medical procedures performed on an organ of a patient, in which direct visual access to the medical procedure is impractical and/or is improved by the use of a model of the anatomic structure. For the sake of clarity of explanation, however, the systems and methods of the present disclosure are described with respect to a cardiac chamber of a patient. Thus, for example, the systems and methods of the present disclosure can be used to facilitate visualization of a catheter inserted into a cardiac chamber as part of a medical treatment associated with diagnosis, treatment, or both of a cardiac condition (e.g., cardiac arrhythmia).
As used herein, the term “physician” shall be understood to include any type of medical personnel who may be performing or assisting a medical procedure and, thus, is inclusive of a doctor, a nurse, a medical technician, other similar personnel, and any combination thereof. Additionally, or alternatively, as used herein, the term “medical procedure” shall be understood to include any manner and form of diagnosis, treatment, or both, inclusive of any preparation activities associated with such diagnosis, treatment, or both. Thus, for example, the term “medical procedure” shall be understood to be inclusive of any manner and form of movement or positioning of a medical device in or relative to a cardiac chamber.
As used herein, the term “patient” should be considered to include any mammal, including a human, upon which a medical procedure is being performed.
In use, the catheter 104 can be moved within the cardiac chamber (e.g., as part of a medical procedure), and the processing unit 109 can receive a plurality of location signals of the catheter 104 in the cardiac chamber during a build phase. The build phase can include, for example, a portion of a medical procedure in which a portion of the catheter 104 is moved within the cardiac cavity to gather spatial information related to the cardiac chamber. As described in greater detail below, the processing unit 109 can construct a data structure (e.g., a data structure including a three-dimensional data structure) including a representation of locations, within the cardiac chamber, visited by the catheter 104 during the build phase. As also described in greater detail below, the data structure can form a basis for a continuous surface representing a blood-tissue boundary in the cardiac chamber. The continuous surface can be displayed on the graphical user interface 110, representing at least a portion of a surface of the cardiac chamber.
As the catheter 104 is being moved within the cardiac chamber during the build phase, the catheter 104 can slip out of the cardiac chamber through a heart valve as the catheter 104 is moved through different locations to build the data structure. Such inadvertent positioning can result in errors in the continuous surface to be displayed on the graphical user interface 110.
To facilitate correcting errors that may occur during movement of the catheter 104 in the cardiac chamber during the build phase, the processing unit 109 can receive one or more rewind commands to modify the continuous surface on graphical user interface 110 according to any one or more of the methods described herein. As compared to deleting a portion of a three-dimensional data structure by marking it on a screen with a mouse, rewinding to modify the display of the continuous surface on the graphical user interface 110 can reduce the time associated with the procedure. Additionally, or alternatively, because the rewind command can facilitate editing a data structure upon which the continuous surface is based, the rewind command can result in a more accurate representation of the cardiac chamber on the graphical user interface 110 (e.g., as compared to an unedited representation of the cardiac chamber). This improvement in accuracy can be useful, for example, for using the representation of the cardiac chamber on the graphical user interface 110 to visualize a medical procedure performed on the cardiac chamber.
Referring now to
The tip section 124 can generally include any portion of the catheter 104 that directly or indirectly engages tissue in the cardiac chamber for the purpose of treatment, diagnosis, or both and, therefore, can include all manner and type of contact and/or non-contact interaction with tissue known in the art. For example, the tip section 124 can be used for contact interaction, non-contact interaction, or both with tissue in the form of energy interaction (e.g., electrical energy, ultrasound energy, light energy, and any combinations thereof) and/or chemical interaction with tissue in the cardiac chamber. Thus, by way of non-limiting example, the tip section 124 can deliver energy (e.g., electrical energy) to tissue in the cardiac chamber as part of any number of medical procedures.
In certain implementations, it can be desirable to deliver energy (e.g., RF energy) from the tip section 124 to targeted portions of cardiac tissue to ablate tissue at some depth relative to a surface of the cardiac chamber. Such ablations created by the tip section 124 along a surface of the cardiac chamber can, for example, treat cardiac arrhythmia in patients with this condition. However, the effectiveness of the ablations created using the tip section 124 in such a cardiac ablation procedure can be dependent upon location of the ablations. It should be appreciated, therefore, that accurate representation of the cardiac chamber on the graphical user interface 110 used to guide the tip section 124 can be advantageous for accurately delivering ablation energy to tissue in cardiac ablation procedures or other similar procedures in which there is a benefit derived from targeted energy delivery.
The catheter 104 can further, or instead, include a magnetic position sensor 130 along the distal portion 128 of the shaft 122. It should be appreciated that the magnetic position sensor 130 can be any of various magnetic position sensors well known in the art and can be positioned at any point along the distal portion 128. The magnetic position sensor 130 can, for example, include one or more coils that detect signals emanating from magnetic field generators. One or more coils for determining position with five or six degrees of freedom can be used.
The magnetic field detected by the magnetic position sensor 130 can be used to determine the position of the distal portion 128 of the catheter shaft 122 according to one or more methods commonly known in the art such as, for example, methods based on using a sensor, such as the magnetic position sensor 130, to sense magnetic fields indicative of the position of the magnetic position sensor 130 and using a look-up table to determine a location of the magnetic position sensor 130. Accordingly, because the tip section 124 is coupled to the distal portion 128 of the shaft 122 in a known, fixed relationship to the magnetic position sensor 130, the magnetic position sensor 130 also provides the location of the tip section 124.
While the location of the tip section 124 is described as being determined based on magnetic position sensing, electrical signal feedback, other position sensing methods, or combinations thereof can additionally or alternatively be used. For example, the location of the tip section 124 can be additionally, or alternatively, based on impedance, ultrasound, and/or imaging (e.g., real time MRI or fluoroscopy). Thus, more generally, the location of the tip section 124 at visited positions within the cardiac chamber can be based on one or more location signals generated based on one or more sensors carried on or near the tip section 124, sensors separate from the tip section 124, and combinations thereof.
Referring now to
The chronological ordering of the locations 129 can facilitate determination of the most recently visited locations 129 such that, for example, the most recently visited locations can be removed as part of an editing function. As used herein, an indication of chronological order can include an ordered sequence (e.g., a numbered list) arranged, for example, in ascending or descending order of most recently visited locations 129. Additionally, or alternatively, the indication of chronological order can include a time-stamp.
Each of the locations 129 can be visited by the tip section 124 (
The three-dimensional data structure 134 can include, for example, a three-dimensional grid of voxels 135. Each voxel 135 can be a discrete element of volume corresponding to an analogous volume in the cardiac chamber. Together, the voxels 135 can form the three-dimensional data structure 134 which, in general, is a three-dimensional notational space. Thus, as a tip section of a catheter (e.g., the tip section 124 of the catheter 104 in
A rewind function can include removing, from the three-dimensional data structure 134, an indication of chronological order associated with a given one of the voxels 135. For example, if one of the voxels 135 corresponds to a location that has been visited twice by a tip section of a catheter (e.g., the tip section 124 of the catheter 104 in
A continuous surface 136 can be formed along a boundary of the three-dimensional data structure 134, with the continuous surface 136 representing at least a portion of a surface of the cardiac chamber 132. The continuous surface 136 can be extracted from the three-dimensional data structure 134 according to any one or more known computational algorithms for extracting a three-dimensional surface of an object. Examples of such algorithms include one or more of a “marching cubes” algorithm, a “ball-pivoting” algorithm, and a “power crust” algorithm.
Because the continuous surface 136 can be extracted from the voxels 135 of the three-dimensional data structure 134, it should be appreciated that rewinding to change the status of the voxels 135 of the three-dimensional data structure 134 can result in corresponding changes in the shape of the continuous surface 136. For example, in instances in which rewinding changes the status of one of the voxels 135 from “visited” to “unvisited,” the resulting continuous surface 136 formed based on the voxels 135 in the three-dimensional data structure 134 may change in the vicinity of the voxel 135 that has been changed. Thus, a physician can use a rewind function to remove certain portions of the three-dimensional data structure 134 that were, for example, erroneously obtained and, in this way, can change the shape of the continuous surface 136. An exemplary change of this type is described in greater detail below.
The three-dimensional data structure 134 and the continuous surface 136 can be stored, for example, on the storage medium 111, along with instructions executable by the processing unit 109 to display the three-dimensional data structure 134, the continuous surface 136, or both, on the graphical user interface 110, as described in greater detail below. The instructions stored on the storage medium 111 and executable by the processing unit 109 to display one or both of the three-dimensional data structure 134 and the continuous surface 136 can be, for example, an application built using Visualization Toolkit, an open-source 3D computer graphics toolkit, available at www.vtk.org.
Referring now to
In the time progression of the exemplary rewind editing function shown in
While the rewind function shown in
In certain instances, the consecutive temporal states of the continuous surface 136 can be distinguished from one another by a respective key frame based on a change in the continuous surface as the continuous surface is progressively formed through movement of the catheter in the cardiac chamber of the patient. As used herein, a key frame shall be understood to correspond to a temporal state of the continuous surface 136 after a significant change from a preceding temporal state of the continuous surface 136. Thus, for example, the continuous surface 136 corresponding to each temporal state can define a respective volume, and each key frame can correspond substantially (e.g., ±25 percent) to a predetermined change (e.g., about 1 cm3) in volume between respective consecutive temporal states of the continuous surface.
The computer executable instructions stored on the storage medium 111 (
In general, receiving 172 the plurality of signals indicative of respective visited locations of the catheter in the cardiac chamber of the patient can include receiving signals indicative of the location of the catheter according to any one or more of the methods described herein. As used herein, the received 172 plurality of location signals of the catheter generally corresponds to locations visited by a tip section of the catheter (e.g., the tip section 124 of the catheter 104 of
Displaying 176 the continuous surface representing at least a portion of the surface of the cardiac chamber can include projecting the continuous surface onto a display of a graphical user interface as described, for example, with respect to
In general, as the catheter is moved in the cardiac chamber during the build phase, the displayed 176 continuous surface can undergo corresponding changes based on the received 172 signals indicative of visited locations of the catheter. Thus, for example, a physician can view the displayed 176 continuous surface and make a determination regarding whether or not rewinding or other editing would improve the displayed 176 continuous surface. Displaying 176 the continuous surface can, in certain instances, further include displaying one or more portions of the data structure, which can provide the physician with more specific information regarding the visited locations than may be apparent from the display of the continuous surface alone.
In general, receiving 178 the rewind command can include receiving a signal from any one or more of various different input devices. Examples of input devices that can send the rewind command include one or more of a mouse, a keyboard, a microphone, a touchscreen, and a capacitive touch sensor. Additionally, or alternatively, it should be appreciated that a physician may communicate (e.g., verbally communicate) a rewind command from within the sterile field to an operator outside of the sterile field. The rewind command can be received 178 directly or indirectly at a processing unit (e.g., the processing unit 109 in
In general, a rewind command can create a visual impression of reversing at least a portion of the construction of the continuous surface on a graphical user interface. Thus, a rewind command can include any command that initiates or otherwise results in modification of a visual representation of at least a portion of the continuous surface displayed 176 on the graphical user interface. The modification can be based at least in part upon a chronological order of visited locations of a catheter. For example, a rewind command can include deleting, deselecting, or not accessing a portion of the data structure such that an earlier state of the continuous surface is displayed on the graphical user interface. Additionally, or alternatively, a rewind command can include turning portions of the data structure, such as a three-dimensional data structure, from visible to translucent (e.g., to provide an appearance of at least a portion of the three-dimensional data structure being deleted) on a graphical user interface based on a chronological order in which locations in the cardiac chamber were visited by the catheter.
Receiving 178 the rewind command can include, for example, receiving a signal indicative of a quantity of discrete inputs (e.g., a quantity of clicks from a click-based input device). In such instances, the number of the discrete inputs can be proportional to a time period or chronological sequence length corresponding to the one or more accessed 180 entries of the data structure. For example, receiving 178 the rewind command including a signal indicative of three discrete inputs can correspond to removal of the one or more indications of chronological order corresponding to the last three visited locations of the catheter in the cardiac chamber. A continuous surface formed based on the data structure with the removed indications of chronological order can correspond to an earlier state of the continuous surface. Additionally, or alternatively, each discrete input can correspond to a predetermined period of time. As a specific example, each discrete input can correspond to a predetermined period of time (e.g., five seconds) such that receiving 178 the rewind command including three discrete inputs can correspond to returning to a previous state of the continuous surface corresponding to a time that is three predetermined periods of time earlier (e.g., fifteen seconds earlier in the case in which each predetermined period of time is five seconds). It should be appreciated that the proportionality between the quantity of the discrete inputs and the change in state of the continuous surface to be displayed can be selectable (e.g., by the physician) to facilitate, for example, making both fine and coarse adjustments to the continuous surface during a build phase. Further, or instead, the duration of each discrete input can be proportional to a duration of a time sequence to be rewound from the continuous surface. Continuing with this example, the physician can press an input longer to further rewind the continuous surface during the build phase. As another example, the quantity of discrete inputs can correspond to a predetermined change in volume defined by the continuous surface. Continuing with this example, each discrete input can correspond to rewinding a predetermined volume (e.g. about 1 cm3) such that receiving 178 the rewind command including three discrete inputs can correspond to reducing the volume defined by the continuous surface by at least three times the predetermined volume (e.g. about 3 cm3 in the case in which the predetermined volume is about 1 cm3).
Receiving 178 the rewind command can include displaying, on the graphical user interface, visual indicia of the received rewind command. For example, the graphical user interface can display an icon indicating that the rewind command has been received 178. As a further or alternative example, displaying visual indicia on the graphical user interface can include displaying a spatial extent of the received 178 rewind command. As used here, the spatial extent of the received 178 rewind command should be understood to include a difference between a current state of the continuous surface and the state of the continuous surface resulting from application of the received 178 rewind command.
In general, displaying visual indicia of the received rewind command can be useful for providing feedback to a physician or other user and, thus, can reduce the likelihood that the physician or other user will inadvertently provide more rewind commands than intended. In certain implementations, receiving 178 the rewind command can include displaying the visual indicia of the rewind command on one or more of the data structure and the continuous surface. Additionally, or alternatively, the visual indicia of the rewind command can be displayed as a surface or volume separate from the continuous surface and the data structure. The visual indicia can provide a preview of the state of the continuous surface resulting from application of the received 178 rewind command. For example, a spatial extent of the received 178 rewind command can be highlighted or otherwise distinguished from other portions of the continuous surface to provide the physician or other user with a visual indication of a pending rewind command. In such instances, the continuous surface can be modified along the spatial extent of the received 178 rewind command upon receipt, for example, of a subsequent input to confirm removal.
As a further or alternative example, displaying the visual indicia on the graphical user interface can include displaying a temporal extent of the received rewind command, with the temporal extent corresponding to a time between the first state of the continuous surface and the second state of the continuous surface. The temporal extent of the rewind command can be useful for providing the physician or another user with an indication of how far back a display of the continuous display is rewound. Additionally, or alternatively, the temporal extent of the rewind command can be useful for providing the physician or another user with an indication of how far forward a display of the continuous display can be undone, as described in greater detail below.
In general, accessing 180 the one or more entries of the data structure can be based on the received 178 rewind command and on an order of receipt of the received 172 locations of the catheter. Accessing 180 the one or more entries of the data structure can include modifying the one or more entries that correspond to the received locations of the catheter. For example, in implementations in which the data structure includes a three-dimensional data structure, as voxels of the three-dimensional data structure are being flagged based on received locations of the catheter, accessing 180 the one or more entries of the data structure can include modifying only those voxels that have been flagged and, thus, correspond to locations visited by the catheter. Accordingly, in this way, accessing 180 the one or more entries of the data structure can include modifying entries of a three-dimensional data structure corresponding to inadvertent placement of the catheter (e.g., in the event of catheter movement through a valve and out of the cardiac chamber).
Accessing 180 the one or more entries in the data structure can include, for example, removing the one or more entries from the data structure. For example, removing the one or more entries from the data structure can include removing only those entries in the data structure that are not represented by earlier data in the chronological sequence of locations visited by the catheter after modifying those entries associated by the rewind command. As used herein, removal of an entry from the three-dimensional data structure can include unflagging the entry as corresponding to a visited location of the catheter. Accessing 180 the one or more entries in the data structure can, in some cases, result in only removal of indications of chronological order of locations while the flags remain unchanged. An entry that is unflagged can be omitted from consideration in a surface generation algorithm used to generate the continuous surface from the data structure (e.g., from a three-dimensional data structure). Additionally, or alternatively, removing the one or more entries in the data structure can include adjusting the one or more entries to be translucent such that the one or more entries are not shown on the graphical user interface.
In certain implementations, accessing 180 the one or more entries of the data structure can be based on a reverse chronological order of receipt of the corresponding received locations of the catheter. For example, accessing 180 the one or more entries of the data structure can include modifying the one or more entries based on a last-in-first-out priority. It should be appreciated, however, that other orders of modification are additionally, or alternatively, possible. For example, accessing 180 the one or more entries of the data structure can include accessing those entries of the data structure corresponding to time periods not including the most recent locations visited by the catheter. Additionally, or alternatively, accessing 180 the one or more entries can be based on all of the entries of the three-dimensional data structure corresponding to a predetermined period. As a specific example, accessing 180 the one or more entries can include removing indications of chronological order corresponding to the most recently received location or locations of the catheter within a predetermined period, such as a predetermined period immediately preceding receipt 178 of the rewind command.
In general, updating 182 the display of the continuous surface on the graphical user interface can be based on the accessed 180 one more entries in the data structure and can include changing the appearance of the continuous surface on the graphical user interface. Additionally, or alternatively, updating 182 the display of the continuous surface can include reforming at least a portion of the continuous surface based on the accessed 180 one or more entries of the data structure. For example, updating 182 the display of the continuous surface can include reapplying one or more surface generation algorithms to the data structure to reform at least a portion of the continuous surface. Additionally, or alternatively, updating 182 the display of the continuous surface can be based on changing pointers in the data structure to point to, for example, an earlier state of the continuous surface stored in the data structure, as described in greater detail below. In certain instances, updating 182 the display of the continuous surface can occur after each portion of the three-dimensional surface representation is accessed 180 such that the updating 182 of the display of the continuous surface can appear to occur on the graphical user interface substantially in real time. In some instances, updating 182 the display of the continuous surface representation can occur based on a user input (e.g., a refresh command).
The method 170 can, optionally, include forming 174 the data structure. Forming 174 the data structure can additionally, or alternatively, include associating each visited location with a chronological order in the data structure. Such chronological ordering can include any one or more of the various different techniques of chronological ordering described herein. Thus, for example, multiple visits by the catheter to a given location in the cardiac chamber can be tracked in the data structure as unique instances of visiting the location according to any one or more of the various different methods described herein.
In certain implementations, the data structure can be formed 174 as a three-dimensional data structure based on the received locations of the catheter in the cardiac chamber. For example, the three-dimensional data structure can include a three-dimensional grid. Voxels in the three-dimensional grid can correspond, in certain instances, to locations in a three-dimensional coordinate system and, thus, can be used to track locations visited by the catheter in the cardiac chamber.
In some implementations, forming 174 the data structure can include, for example, storing portions of the continuous surface representing different but optionally overlapping periods of time such that the portions are accessible or selectable based on chronological order. As a more specific example, forming 174 the data structure can include storing a sequence of continuous surfaces accessible based on chronological order, as described in greater detail below.
The exemplary method 170 can optionally include receiving 184 an undo command. Based on the undo command, the display of the continuous surface on the graphical user interface can be modified to a third state of the continuous surface, with the third state of the continuous surface following the second state of the continuous surface in the progressive formation of the continuous surface. For example, the third state of the continuous surface can precede or, in some instances, can be substantially contemporaneous with the first state of the continuous surface in the progressive formation of the surface. Accordingly, on the graphical user interface, the undo command can appear to revert modifications to portions of the continuous surface and/or the data structure that were previously modified by a previously received rewind command. Thus, in general, a physician or other user can control the display of the continuous surface on the graphical user interface through a combination of the undo command and the rewind command to navigate forward and backward in a time sequence of a plurality (sometimes known as a stack) of states of the continuous surface. In some instances, continuing to progressively form the continuous surface following application of the undo command or the rewind command can interrupt the ability to toggle between the undo command and the rewind command.
Receiving 184 the undo command can include, for example, receiving a signal indicative of a quantity of discrete inputs. Continuing with this example, the state of the continuous surface preceding the update of the display of the continuous surface can be based on the quantity of discrete inputs.
In certain implementations, the undo command can be symmetric with the rewind command. For example, in instances in which a discrete input corresponds to a rewind increment of 5 seconds of catheter locations, a discrete input of an undo command can correspond to restoring 5 seconds of catheter locations. In some implementations, however, the undo command and the rewind command can be asymmetric. For example, the undo command and the rewind commands can be asymmetric with respect to one another such that restoring can be done at a faster rate than rewinding. It should be appreciated that in some instances, the relative symmetry between the rewind command and the undo command can be adjustable (e.g., according to a preference of a physician or other user).
Receiving 184 the undo command can include receiving one or more signals from an input device, including any one or more of the input devices described herein. Thus, for example, the same input device that sends the rewind command can send the undo command.
Receiving 192 the signals indicative of the respective visited locations of the catheter can include any one or more of the methods of receiving signals described herein. For example, unless otherwise indicated or made clear from the context, receiving 192 the signals indicative of the visited locations of the catheter should be understood to be analogous to receiving 172 the signals as described with respect to the exemplary method 170 described with respect to
Progressively forming 194 a continuous surface can include forming the continuous surface based on a chronological order of the visited locations of the catheter in the cardiac chamber. For example, progressively forming 194 a surface based on the visited locations of the catheter can include applying a surface generation algorithm to a data structure (e.g., three-dimensional data structure) including the visited locations. The surface generation can be any one or more of various different surface generation algorithms known in the art. As the catheter is moved in the cardiac chamber and additional visited locations are received, progressively forming 194 the continuous surface can include forming new instances of the continuous surface based on the additional visited locations. Each instance of the continuous surface is referred to herein as a “state.”
Displaying 196 the continuous surface on the graphical user interface can include displaying a state of the continuous surface. The displayed 196 state of the continuous surface can generally correspond to a most recent state of the continuous surface such that the physician can have a substantially real-time indication of progress of the build phase. In general, unless otherwise indicated or made clear from the context, displaying 196 the continuous surface on the graphical user interface should be understood to be analogous to displaying 176 a continuous surface on a graphical user interface as described with respect to the exemplary method 170 corresponding to
Receiving 200 the rewind command can include any of the various different methods of receiving a rewind command described herein. Thus, for example, receiving 200 the rewind command can be analogous to receiving 178 the rewind command, as described with respect to the exemplary method 170 corresponding to
In general, updating 202 the display of the continuous surface from the first state to the second state provides a visual impression of rewinding the continuous surface to a previous state in the progressive formation 194 of the continuous surface. It should be understood, however, that the second state of the continuous surface need not have been previously displayed on the graphical user interface prior to updating 202 the display of the continuous surface. That is, in certain implementations, the second state can be similar, but not necessarily identical, to an earlier state of the continuous surface displayed 196 on the graphical user interface.
Following updating 202, the progressive formation 194 can be continued from the second state of the continuous surface such that the first state of the continuous surface is effectively removed from the display on the graphical user interface. Once removed from the display on the graphical user interface, it should be appreciated that the first state can be stored in a data structure (e.g., for retrieval in implementations including an undo command) or removed entirely from a data structure.
Updating 202 the continuous surface can be based on volumetric differences associated with states of the continuous surface as the continuous surface is progressively formed 194. That is, in each state, the continuous surface can include a closed shape defining a volume in a three-dimensional representation of the cardiac chamber. As the continuous surface is progressively formed 194, the volume associated with each state of formation of the continuous surface can stay the same or increase. For example, the first state of the continuous surface can define a first volume and the second state of the of the continuous surface can define a second volume, different from the first volume. More specifically, because the second state precedes the first state in the progressive formation 194 of the continuous surface, the second volume can be less than the first volume. Thus, updating 202 the display of the continuous surface on the graphical user interface from the first state of the continuous surface to the second state of the continuous surface can produce the visual impression of rewinding the continuous surface.
In implementations in which the received 200 rewind command includes a signal indicative of a quantity of discrete inputs, the difference between the first volume defined by the first state of the continuous surface and the second volume defined by the second state can be substantially proportional (e.g., within about ±25 percent) to the quantity of discrete inputs. For example, each discrete input can correspond substantially to a predetermined difference in volume. By way of a more specific example, each discrete input can correspond to about a 1 cm3 difference in volume. Continuing with this example, a received 200 rewind command including three discrete inputs can produce about a 3 cm3 difference between the first volume and the second volume. In this instance, updating 202 the display of the continuous surface on the graphical user interface can correspond to removing the most recent about 3 cm3 of the volume of the progressive formation 194 of the continuous surface.
Additionally, or alternatively, the first state of the continuous surface and the second state of the continuous surface can correspond, for example, to partially overlapping time periods in the progressive formation of the continuous surface. By way of an illustrative example, the first state can correspond to a time period of 0 seconds to 45 seconds, and the second state can correspond to a time period of 0 seconds to 30 seconds. Thus, in this example, updating 202 the display of the continuous surface from the first state to the second state can produce a 15 second rewind.
The exemplary method 190 can optionally include storing 198 a plurality of temporal states of the continuous surface in a data structure. The temporal states can include, for example, the first state and the second state. More generally, however, the plurality of temporal states can correspond to states of the progressive formation 194 of the continuous surface. While the plurality of temporal states can correspond to the entire progressive formation 194 of the continuous surface, it should be appreciated that the plurality of temporal states can be selected to correspond only to significant changes in the progressive formation 194 of the continuous surface. Such selection of the temporal states can be useful, for example, for reducing the storage and/or processing requirements associated with updating 202 the display of the continuous surface. As a specific example, consecutive temporal states of the continuous surface stored 198 in the data structure can be distinguished from one another in the data structure by a key frame based on a change in the continuous surface as the continuous surface is progressively formed. Each key frame can, for example, correspond substantially to a predetermined change (e.g., about 1 cm3) in volume defined by respective consecutive temporal states of the continuous surface. Thus, updating 202 the display of the continuous surface 202 can include moving from one key frame to another based on the received 200 rewind command (e.g., based on discrete inputs).
In certain implementations, the data structure can include respective pointers corresponding to the first state of the continuous surface and the second state of the continuous surface. In such implementations, updating 202 the display of the continuous surface from the first state to the second state can include changing from a first pointer corresponding to the first state to a second pointer corresponding to the second state. Such pointers can be useful for transitioning from the first state to the second state without necessarily requiring changes to the data structure and, thus, can facilitate rapid transitions with little computational overhead.
In some implementations, the data structure in which the plurality of temporal states of the continuous surface is stored can include a three-dimensional data structure (e.g., a three-dimensional grid) such as any one or more of the three-dimensional data structures described herein. Each state of the plurality of temporal states of the continuous surface can be derived from one or more portions of the three-dimensional data structure. The first state of the continuous surface can be derived from data (e.g., visited locations) in the three-dimensional data structure corresponding to a first time period associated with the first state and, similarly, the second state of the continuous surface can be derived from data (e.g., visited locations) in the three-dimensional data structure corresponding to a second time period associated with the second state. In this context, the derivation of the first state of the continuous surface and the second state of the continuous surface from data in the three-dimensional data structure can include any manner and form of generating the continuous surface, as described herein. Thus, updating 202 the display of the first continuous surface to the second continuous surface can include changing pointers to surface elements, or other types of elements, stored in the three-dimensional data structure and, additionally or alternatively, can include modifying the one or more entries of the three-dimensional data structure.
In instances in which the three-dimensional data structure includes surface elements, the first state of the continuous surface can be derived from the surface elements corresponding to visited locations of the catheter at the first time period and, similarly, the second state of the continuous surface can be derived from the surface elements corresponding to the visited locations of the catheter at the second time period. At least a portion of the second time period can precede at least a portion of the first time period. To the extent that such a difference between the first time period and the second time period corresponds to a difference in visited locations of the catheter, it should be appreciated that updating 202 the display of the continuous surface from the first state to the second state can, in some instances, result in fewer surface elements appearing in the second state of the continuous surface displayed on the graphical user interface. It should be further appreciated that, for the sake of clarity of explanation, the three-dimensional data structure has been described as including surface elements. The three-dimensional data structure can, additionally or alternatively, include one or more of zero-dimensional elements, one-dimensional elements, two-dimensional elements, three-dimensional elements, four-dimensional elements, and combinations thereof.
The exemplary method 190 can optionally include receiving 204 an undo command. Receiving 204 the undo command should be understood to be similar to receiving 184 the undo command described with respect to the exemplary method 170 (
The above systems, devices, methods, processes, and the like may be realized in hardware, software, or any combination of these suitable for a particular application. The hardware may include a general-purpose computer and/or dedicated computing device. This includes realization in one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors or other programmable devices or processing circuitry, along with internal and/or external memory. This may also, or instead, include one or more application specific integrated circuits, programmable gate arrays, programmable array logic components, or any other device or devices that may be configured to process electronic signals.
It will further be appreciated that a realization of the processes or devices described above may include computer-executable code created using a structured programming language such as C, an object oriented programming language such as C++, or any other high-level or low level programming language (including assembly languages, hardware description languages, and database programming languages and technologies) that may be stored, compiled or interpreted to run on one of the above devices, as well as heterogeneous combinations of processors, processor architectures, or combinations of different hardware and software. In another aspect, the methods may be embodied in systems that perform the steps thereof, and may be distributed across devices in a number of ways. At the same time, processing may be distributed across devices such as the various systems described above, or all of the functionality may be integrated into a dedicated, standalone device or other hardware. In another aspect, means for performing the steps associated with the processes described above may include any of the hardware and/or software described above. All such permutations and combinations are intended to fall within the scope of the present disclosure.
Embodiments disclosed herein may include computer program products comprising computer-executable code or computer-usable code that, when executing on one or more computing devices, performs any and/or all of the steps thereof. The code may be stored in a non-transitory fashion in a computer memory, which may be a memory from which the program executes (such as random access memory associated with a processor), or a storage device such as a disk drive, flash memory or any other optical, electromagnetic, magnetic, infrared or other device or combination of devices.
In another aspect, any of the systems and methods described above may be embodied in any suitable transmission or propagation medium carrying computer-executable code and/or any inputs or outputs from same.
The method steps of the implementations described herein are intended to include any suitable method of causing such method steps to be performed, consistent with the patentability of the following claims, unless a different meaning is expressly provided or otherwise clear from the context. So, for example, performing the step of X includes any suitable method for causing another party such as a remote user, a remote processing resource (e.g., a server or cloud computer) or a machine to perform the step of X. Similarly, performing steps X, Y and Z may include any method of directing or controlling any combination of such other individuals or resources to perform steps X, Y and Z to obtain the benefit of such steps. Thus, method steps of the implementations described herein are intended to include any suitable method of causing one or more other parties or entities to perform the steps, consistent with the patentability of the following claims, unless a different meaning is expressly provided or otherwise clear from the context. Such parties or entities need not be under the direction or control of any other party or entity, and need not be located within a particular jurisdiction.
It will be appreciated that the methods and systems described above are set forth by way of example and not of limitation. Numerous variations, additions, omissions, and other modifications will be apparent to one of ordinary skill in the art. In addition, the order or presentation of method steps in the description and drawings above is not intended to require this order of performing the recited steps unless a particular order is expressly required or otherwise clear from the context. Thus, while particular embodiments have been shown and described, it will be apparent to those skilled in the art that various changes and modifications in form and details may be made therein without departing from the spirit and scope of this disclosure and are intended to form a part of the invention as defined by the following claims.
This application claims the benefit under 35 U.S.C. § 119(e) of U.S. Prov. App. No. 62/335,120, filed May 12, 2016, U.S. Prov. App. No. 62/336,143, filed May 13, 2016, U.S. Prov. App. 62/338,210, filed May 18, 2016, U.S. Prov. App. No. 62/384,291, filed Sep. 7, 2016, U.S. Prov. App. No. 62/410,022, filed Oct. 19, 2016, and U.S. Prov. App. No. 62/463,870, filed Feb. 27, 2017, with the entire contents of each of these applications hereby incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| 62335120 | May 2016 | US | |
| 62336143 | May 2016 | US | |
| 62338210 | May 2016 | US | |
| 62384291 | Sep 2016 | US | |
| 62410022 | Oct 2016 | US | |
| 62463870 | Feb 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15594039 | May 2017 | US |
| Child | 18339086 | US |
