The present disclosure relates generally to locating a medical device in a patient reference frame using a medical device model that estimates the shape of a medical device in the patient frame of reference in conjunction with measurements from impedance electrodes and magnetic sensors of the medical device.
Various systems are known for determining the position and orientation (P&O) of a medical device in a human body, for example, for visualization and navigation purposes. One such system is known as an electrical impedance-based positioning system. Electrical impedance-based systems generally include one or more pairs of body surface electrodes (e.g., patches) outside a patient's body, a reference sensor (e.g., another patch) attached to the patient's body, and one or more sensors (e.g., electrodes) attached to the medical device. The pairs can be adjacent, linearly arranged, or associated with respective axes of a coordinate system for such a positioning system. The system can determine P&O by applying a current across pairs of electrodes, measuring respective voltages induced at the device electrodes (i.e., with respect to the reference sensor), and then processing the measured voltages.
Another system is known as a magnetic field-based positioning system. This type of system generally includes one or more magnetic field generators attached to or placed near the patient bed or other component of the operating environment and one or more magnetic field detection coils coupled with a medical device. Alternatively, the field generators may be coupled with a medical device, and the detection coils may be attached to or placed near a component of the operating environment. The generators provide a controlled low-strength AC magnetic field in the area of interest (i.e., an anatomical region). The detection coils produce a respective signal indicative of one or more characteristics of the sensed field. The system then processes these signals to produce one or more P&O readings associated with the coils (and thus with the medical device). The P&O readings are typically taken with respect to the field generators, and thus the field generators serve as the de facto “origin” of the coordinate system of a magnetic field-based positioning system. Unlike an electrical impedance-based system, where the coordinate system is relative to the patient on which the body surface electrodes are applied, a magnetic field-based system has a coordinate system that is independent of the patient.
Both electrical impedance-based and magnetic field-based positioning systems provide advantages. For example, electrical impedance-based systems provide the ability to simultaneously locate (i.e., provide a P&O reading for) a relatively large number of sensors on multiple medical devices. However, because electrical impedance-based systems employ electrical current flow in the human body, such systems may be subject to electrical interference. As a result, geometries and representations that are rendered based on position measurements may appear distorted relative to actual images of subject regions of interest. Magnetic field-based coordinate systems, on the other hand, are not dependent on characteristics of the patient's anatomy and typically provide improved accuracy. However, magnetic field-based positioning systems are generally limited to tracking relatively fewer sensors.
Efforts have been made to provide a system that combines the advantages of an electrical impedance-based positioning system (e.g., positioning of numerous electrodes) with the advantages of a magnetic-field based coordinate system (e.g., independence from patient anatomy, higher accuracy). In an embodiment, such a system may be provided by registering the coordinate systems of an electrical impedance-based positioning system with the coordinate system of a magnetic field-based positioning system. In such an arrangement, locations of electrodes may be identified in an impedance-based coordinate system in conjunction with identifying the locations of one or more magnetic sensors in a magnetic-based coordinate system. In an embodiment, at least a portion of the electrodes and magnetic sensors may be co-located to define fiducial pairs. This co-location allows for determining a transformation (e.g., transformation matrix) between the coordinate systems. The transformation may be applied to the locations of any electrode to register these locations in the magnetic-based coordinate system once the transformation is determined. Accordingly, the electrical impedance-based electrodes can be identified in the coordinate system of the magnetic field-based positioning system thereby increasing the positioning accuracy for the electrodes. While providing improved electrode positioning, the determination of a transformation between the impedance-based coordinate system and the magnetic based impedance system and subsequent registration of the electrode locations to the magnetic coordinate system can fail to account for various impedance shifts and/or drifts, associated with the electrode(s).
The previous systems that utilize electrode information (e.g., impedance measurements) and magnetic sensor information to provide improved electrode positioning in three-dimensional space (e.g., within a body of a patient) rely primarily on impedance-based measurements. That is, the magnetic sensor information (e.g., magnetic sensor measurements) delivers additional accuracy. This may be described as an impedance-primary location arrangement. Due to the distortion and temporal instability of the impedance measurements, such an arrangement can suffer from instability. Further, the previous impedance-primary location arrangements, in some instances, fail to account for various errors within the system. Further, such systems may fail to take into account other system inputs (e.g., patient movement, shape of the medical device, etc.), which may affect the calculated locations or positions of the electrodes. In summary, registration of an impedance-based system to magnetic-based system may fail to include additional information which may be observed and/or inferred and which may improve the overall identification of catheter and/or electrode positions in a three-dimensional space.
Various embodiments herein provide systems, methods and/or non-transitory computer readable medium storing instructions (i.e., utilities) for use in identifying location of electrodes of a catheter within a three-dimensional space (e.g., a patient body or patient reference frame). Initially, the utilities are directed to predicting locations of physical electrodes and/or physical magnetic sensors of a physical medical device disposed within the three-dimensional space. Based on the predicted locations of the electrodes and/or sensors, the utilities predict responses or measurements (hereafter ‘responses’) for the electrodes and/or sensors. Additionally, the utilities obtain actual measurements/responses from the electrodes and/or sensors of the physical catheter. For instance, the utilities may acquire or measure impedance responses from the physical electrodes, upon application of an applied electrical potential field to the three-dimensional space. Likewise, the utilities may acquire or measure magnetic responses upon the application of a magnetic field to the three-dimensional space. Based on the predicted responses and the measured responses, the utilities may update the locations of electrodes or sensors in the three-dimensional space. Such updated locations may utilize information from both the predicted responses and the measured responses to produce locations (e.g., calculated locations) for the electrodes and/or sensors where the calculated locations have an accuracy that is greater than locations produced by either the predicted responses or the measured responses.
In an embodiment, the utilities are directed to a location arrangement that integrates predicted and measured impedance responses from the electrodes of the medical device with other observed parameters such as predicted and measured position and orientation responses of magnetic sensors to estimate the position (e.g., a latent state) of a physical medical device (e.g., physical catheter) disposed within a patient reference frame. In an embodiment, the utilities utilize a catheter model of the physical catheter to predict locations of the physical electrodes and/or magnetic sensors in the three-dimensional space. The catheter model models the physical catheter where spacing of model electrodes and/or model sensors of the catheter model correspond to spacing of the electrodes and/or sensors of the physical catheter. In such an embodiment, the catheter model defines model electrode and/or model sensors in a catheter reference frame. In an embodiment, a catheter transformation transforms locations of the model electrodes and/or sensors from the catheter reference frame to the three-dimension space (e.g., patient reference frame) to predict the locations of the model electrodes and/or sensors in the three-dimensional space. In an embodiment, the transformation is a rigid body transformation.
In an embodiment, the utilities apply an impedance model to the model electrode locations within the three-dimensional space to predict the impedance responses for the model electrode locations. In an embodiment, the impedance model models the electrical potential field applied to the three-dimensional space via physical surface patch electrodes. In such an embodiment, independent impedance fields may be mapped to driven patch pairs to estimate impedance responses or measurements for any location within the electrical potential field.
In an embodiment, the utilities apply a magnetic model to the model sensor locations within the three-dimensional space to predict magnetic responses for the model sensor locations. In an embodiment, the magnetic model incorporates a magnetic patient reference sensor disposed within the three-dimensional space. In such an embodiment, an origin defined by the patient reference sensor may be correlated to an origin of an applied magnetic field. Measured responses of the physical sensor(s) and the model sensors(s) may be utilized with the magnetic model to position and orient the electrodes and sensors of the catheter model within the three-dimensional space.
In an embodiment, the utilities integrate (e.g., fuse) predicted and measured impedance responses from the electrodes and/or external patches with additional observed parameter including, for example, predicted and measured position and orientation responses from magnetic sensors to estimate a latent state (e.g., position) of a medical device disposed within the three-dimensional space. In an embodiment, the models (e.g., catheter model, catheter transformation, impedance model and/or magnetic model) are variable models where variables of the models represent state variables of a state space system. Such a state space system allows updating the various models based, in part, on the measured responses of the physical system. In an embodiment, one or more of the models are used in conjunction to define a composite model of the medical device in the three-dimensional space. In such an embodiment, an estimator system may estimate latent (e.g., hidden) variables of the individual models to iteratively improve the correspondence of the models with the physical systems they represent. In an embodiment, the estimator is an extended Kalman filter. In any embodiment utilizing an estimator, a state space estimation of possible states may be generated from the composite model. Various constraints may be applied to the state space estimation to penalize unlikely states. A most likely state (e.g., mean and covariance) of the state space estimation may be mapped to measured responses to produce a corrected state space estimation. The updated locations of the electrodes and/or sensors may be generated from the corrected state space estimation.
Various embodiments described herein provide systems, methods and/or non-transitory computer readable medium storing instructions (i.e., utilities) for use in estimating the shape of a deformable catheter in a three-dimensional space (e.g., patient reference space). A catheter model is used to estimate the shape of the deformable catheter. The catheter model includes definitions for two or more model segments that correspond to two or more segments of the deformable catheter. Typically, a length of each model segment is defined as are the location(s) of electrode(s) and/or magnetic sensor(s) along the length. The spacing of the electrodes and/or magnetic sensors in the definition corresponds to the spacing of the physical electrodes and/or magnetic sensors of the corresponding physical catheter (i.e., deformable catheter). Each model segment may have one or more variable shape parameters that define a curvature of the segment. That is, the model segments may define a first variable shape parameter for the first segment and a second variable shape parameter for the second segment, wherein the variable shape parameters describe curvatures of the model segments. In an arrangement, the model segments each include a variable curvature parameter and a torsional parameter. These parameters may be varied (e.g., in a computer model) over predetermined ranges that may be predetermined and/or depend on the physical properties of the modeled catheter. Further, the parameters of each model segment may be different. The shape parameters are varied by a computer to generate a plurality of potential catheter shapes. Each potential shape may include a model electrode location and/or a model magnetic sensor location. That is, each model segment may define the location of one or more electrodes and/or magnetic sensors along the length of the model segment. In an arrangement, the potential catheter shapes define a state distribution of potential shapes. In conjunction with generating the potential catheter shapes, impedance and/or magnetic responses (e.g., measured responses) may be obtained for the electrodes and/or magnetic sensors of the deformable catheter disposed in the three-dimensional space. For instance, a medical positioning system may measure these responses. Using a selected one of the catheter shapes and the measured responses, the utility is operative to update the variable shape parameters to more closely fit the catheter model to the shape of the deformable catheter. The updated shape parameters may be used to generate a catheter shape, which may be output to a display. Such updating may be substantially continuous. For instance, the shape parameters and/or a generated catheter shape may be updated 30, 50 or even 100 times per second.
In an arrangement, the selected catheter shape model is used to predict the location of electrodes and/or magnetic sensors in the three-dimensional space. In such an arrangement, the catheter model may be transformed from a catheter reference frame to the three-dimensional space to predict the locations of model electrodes and/or model sensors in the three-dimensional space. Predicted responses are generated for the predicted locations of the model electrodes and/or model sensors. Such predicted responses may be generated by an impedance model that models an impedance field for the three-dimensional space and/or a magnetic model that models a magnetic field of the three-dimensional space. Based on the predicted responses and the measured responses, the utilities may update the locations (e.g., generate calculated locations) of the electrodes or sensors in the three-dimension space. The utilities may utilize information from both the predicted responses and the measured responses to produce the calculated locations for the electrodes and/or sensors of the catheter. The calculated locations typically have an accuracy that is greater than locations produced by either the predicted responses or the measured responses. Further, the predicted responses and measured responses may be utilized to update the variable shape parameters.
In an embodiment, the utilities integrate (e.g., fuse) the predicted and measured responses to estimate hidden variables of the system. Such hidden variables may include a position the catheter in the three-dimensional space as well as the variable parameters of the catheter model. In an arrangement, the variable parameters of the model segments of the catheter model represent state variables of a state vector. Such an arrangement allows updating the various parameters based, in part, on the measured responses of the physical system. In such an arrangement, an estimator system may estimate latent (e.g., hidden) variables to iteratively improve the correspondence of the catheter model with the physical catheter it represents. In an embodiment, the estimator is an extended Kalman filter. In any embodiment utilizing an estimator, a state space estimation of possible states (e.g., catheter shapes) may be generated. A most likely shape may be represented by the mean the state distribution. The mean of the state space estimation may be mapped to measured responses to produce a corrected state space estimation. Calculated locations of the electrodes and/or sensors may be generated from the corrected state space estimation. Likewise, updated shape parameters may be generated from the corrected state space estimation.
In an arrangement, each model segment of the catheter model includes at least one electrode and/or at least one sensor. Such an arrangement ensures that measured responses from corresponding segments of the physical catheter are available for use in adjusting the variable parameters of each model segment. In an arrangement, the model segments are continuous. The continuous model segments may define an entirety of a deformable portion of the catheter. In an arrangement, each model segment is defined as a moving frame. In one particular arrangement, the moving frame is a Frenet Frame.
Various embodiments described herein provide systems and methods for use in determining shape parameters of a deformable catheter. The systems and method apply know forces and orientations to a catheter. Such systems and methods may be implemented in benchtop testing. In an arrangement, a deformable catheter is held at a known roll angle relative to a central axis of the catheter (e.g., the catheter shaft). A movable sled contacts the distal end of the deformable catheter at a known contact angle. The movable sled is advanced a predetermined distance and/or until a predetermined force set point is achieved. At such time, three dimensional locations of electrode and/or magnetic sensors may be obtained (e.g., using three-dimensional imaging). The three-dimensional locations of the electrodes and/or sensors may be correlated to the known force, roll angle and contact angle to determine shape parameters for one or more segments of the catheter for a known displacement. The process may be repeated for multiple permutations of roll angle, contact angle, displacement and/or force to determine a landscape of shape parameters.
Various embodiments herein provide systems, methods and/or non-transitory computer readable medium storing instructions (i.e., utilities) for use in identifying locations of electrodes of a catheter within a three-dimensional space (e.g., a patient body or patient reference frame) while accounting for respiration artifacts. That is, the inventors have recognized that during a medical procedure (e.g., a cardiac medical procedure) in-vivo impedance measurement errors co-vary significantly due to respiration. That is, respiration induces a time-varying artifact relative to spatially-varying impedance measurements within a patient reference frame (e.g., on or within a patient chest). The time-varying artifact occurs during each respiration cycle due to changes in a volume of the chest of a patient increasing and decreasing. More specifically, the change in volume alters the physiological state of the patient and thereby alters impedance measurements of an impedance potential field within in the patient reference frame. Accordingly, accounting for respiration artifact allows for improving the accuracy of electrode locations (e.g., determined from impedance measurements) in a patient reference frame.
In an arrangement, the utilities predict a respiration artifact for an impedance field (e.g., covering all or a portion of a patient reference frame) based on a phase angle and an amplitude of a current respiration cycle of a patient. Additionally, the utilities predict one or more spatially-dependent impedance values for a predicted location(s) of one more physical electrodes (e.g., catheter electrodes) of a physical medical device (e.g., physical catheter) disposed within a patient reference frame. The respiration artifact and the predicted spatially-dependent impedance value(s) collectively define a predicted impedance value for a predicted location of a catheter electrode. The utilities then obtain an observed or measured impedance value for the catheter electrode. For instance, such a measured impedance value may be obtained from an impedance-based medical positioning device. Based on the predicted impedance value and the measured impedance value, the utilities may calculate the locations of electrode(s) in the patient reference frame. Such calculated locations may utilize information from both the predicted impedance value(s) and the measured impedance value(s) to produce more accurate locations for the electrodes. Such calculated locations may have an accuracy that is greater than locations produced by either the predicted impedance value(s) or the measured impedance value(s). Further, the predicted impedance value(s) and the measured impedance value(s) may be utilized to update the phase and or amplitude used to predict subsequent respiration artifacts. Further, the utilities may output the calculated locations to a display, for instance, in or on a rendering of the catheter as disposed in a patient body.
In an arrangement, a respiration model predicts the respiration artifact. In such an arrangement, the respiration model is defined as a quasiperiodic function where the phase and amplitude are variables of the model. In an arrangement, the quasiperiodic function is equal to zero when the phase angle is zero. In a further arrangement, the phase and amplitude are hidden variables of the respiration model. In such an arrangement, the phase and amplitude are state variables that may be estimated in an estimation system even though these variables are never directly observed. In one implementation, a Kalman filer is used to estimate the state variables.
In an arrangement, the utilities utilize a catheter model of the physical catheter to predict locations of the electrode(s) in the patient reference frame. The catheter model models a physical catheter where spacing of model electrodes and/or sensors of the catheter model correspond to spacing of the electrodes and/or sensors of the physical catheter. In such an embodiment, the catheter model defines model electrodes in a catheter reference frame. In an embodiment, a catheter transformation transforms locations of the model electrodes and/or sensors from the catheter reference frame to the patient reference frame to predict the locations (e.g., model locations) of the model electrodes. The utilities apply an impedance model to the model electrode locations to predict the spatially-dependent impedance values for the model electrodes locations. In an embodiment, the impedance model models the electrical potential field applied to the patient reference frame by physical surface patch electrodes. In such an embodiment, independent impedance fields may be mapped to driven patch pairs to estimate impedance responses or measurements for any location within the potential field.
In an arrangement, the utilities integrate (e.g., fuse) predicted impedance responses including respiration artifact and measured impedance responses from the electrodes to estimate a latent state (e.g., position) of a medical device disposed within the patient reference space. In an embodiment, the models (e.g., catheter model, impedance model and/or respiration) are variable models where variables of the models represent state variables of a state space system. Such a state space system allows updating the various models based, in part, on the measured responses of the physical system. In an embodiment, one or more of the models are used in conjunction to define a composite model of the medical device in the three-dimensional space. In such an embodiment, an estimator system may estimate latent (e.g., hidden) variables of the individual models to iteratively improve the correspondence of the models with the physical systems they represent. In an embodiment, the estimator is an extended Kalman filter.
Various embodiments described herein provide systems, methods and/or non-transitory computer readable medium storing instructions (i.e., utilities) for use in predicting impedance values or measurements in a three-dimensional space. Broadly, the utilities define an impedance potential field and its measurement characteristics such that an impedance measurement may be estimated for any location within the potential field. The utilities define a transformation or impedance model that estimates electrode impedance measurements in the three-dimensional space (e.g., location-to-impedance-values). The model may evolve over time based on actual impedance measurements of electrodes located in the three-dimensional space. The utilities drive a plurality of patch electrodes to generate an impedance field to a three-dimensional space (e.g., a patient reference frame). For instance, such patch electrodes may be applied externally (e.g., surface patch electrodes) to a patient body. Individual pairs of the surface patch electrodes may be driven (e.g., source-sink) to generate an impedance field within the three-dimensional space. For instance, in a six-patch electrode system, six individual combinations of pairs of patch electrodes may be driven for each impedance measurement. One or more electrodes disposed in the impedance field may measure impedances while the various pairs patches are driven. In addition, for each set of driven patch pairs, a number of independent impedance fields exist between the non-driven patch pairs. That is, the non-driven patch pairs define independent impedance potential fields within the system. These independent impedance potential fields may be estimated and mapped to impedance measurements of the electrode(s) at locations(s) within the impedance field to define the impedance field. Such mapping of the independent impedance potentials to the measured impedances defines the model of the impedance field.
Once the impedance model is defined, impedance values may be generated or predicted for predicted locations of electrodes in the impedance field. In one arrangement, locations of physical electrodes of a catheter may be predicted in the three-dimensional space using a catheter model, which models the catheter as disposed within the three-dimensional space. In such an arrangement, an actual impedance measurement or value(s) may be obtained for the physical electrode(s). The measured impedance value(s) and predicted impedance value(s) may then be utilized to generate an updated impedance value and/or location for the electrode(s). Such an updated impedance value may have an improved accuracy compared to either the predicted value or the measured value. Additionally, the predicted value and the measured value may be utilized to update the impedance model. For instance, these values may update the definitions of the independent impedance fields.
In an arrangement, the independent impedance fields are defined as a combination of basis functions. In one specific arrangement, the impedance fields are defined as a linear combination of harmonic basis functions. The basis functions may include weighting factors that may be adjusted in a stochastic process. In a further arrangement, definitions of the independent impedance fields may further be constrained. In another arrangement, definitions of the independent impedance fields may include error terms. Such error terms may include a distant dependent modeling error and/or a respiration dependent modeling error.
Various embodiments herein provide systems, methods and/or non-transitory computer readable medium storing instructions (i.e., utilities) for use in predicting magnetic values for coordinates in a patient reference frame while continuously updating these values based on patient movement. The utilities utilize a time-variable patient reference sensor transformation (e.g., patient reference sensor model) that aligns a position and orientation of a patient reference sensor attached to a patient body with a patient reference frame. This transformation allows for continuously tracking movements of the patient body (e.g., relative to an initial or nominal position of the patient body relative to the patient reference frame). The utilities further utilize a time-variable magnetic transformation (e.g., magnetic model) that transforms between the patient reference frame and a magnetic reference frame of a magnetic-based medical positioning system. This transformation predicts magnetic values for coordinates in the patient reference frame. The utilities are operative to apply the time-variable patient reference sensor transformation to a coordinate (e.g., a predicted magnetic sensor location in the patient body) to align the coordinate with the patient reference frame and adjust the position of the coordinate based on patient movements. This generates a patient frame coordinate (e.g., the predicted location of the magnetic sensor in the patient reference frame). The time-variable magnetic transformation may be applied to the patient frame coordinate to identify a magnetic value for the coordinate in the magnetic reference frame. The utilities may periodically or continuously update the time-variable transformations based movements of the patient reference sensor and/or measurements of a corresponding magnetic sensor in the patient reference frame. Likewise, the magnetic value for the coordinate may also be continuously updated. In an embodiment, such updates may occur 20 times per second, fifty times per second or even 100 times per second. In such embodiments, the updating appears substantially continuous to a user, for example, viewing an output of a corresponding medical device on a display.
In an arrangement, the utilities further include predicting a response of a magnetic sensor of a catheter that is disposed within the patient reference frame. In such an arrangement, a catheter model corresponding to the catheter may be used to predict a location of the magnetic sensor in the patient reference frame. This location may define the coordinate to which the transformations are applied. That is, the time-varying transformation are applied to the predicted location of the magnetic sensor to predict a magnetic value (e.g., predicted value) for the magnetic sensor. The magnetic-based medical positioning system may then obtain a magnetic measurement for the magnetic sensor. The magnetic measurement (e.g., observed measurement) and the predicted value may be utilized to calculate a location of the magnetic sensor in the patient reference frame and/or to update the time-variable transformations.
In an arrangement, the utilities integrate (e.g., fuse) predicted magnetic values and measured magnetic values to refine the transformations. In an embodiment, the time-varying transformations (e.g., patient reference sensor model and magnetic model) are variable models where parameters of the models are state variables of a state vector. Such a variable system allows updating the various models based, in part, on the measured responses of the physical system. In such an arrangement, an estimator system may estimate latent (e.g., hidden) variables of the individual models to iteratively improve the correspondence of the models with the physical systems they represent. In an arrangement, the estimator is an extended Kalman filter.
The foregoing and other aspects, features, details, utilities, and advantages of the present invention will be apparent from reading the following description and claims, and from reviewing the accompanying drawings.
Referring now to the drawings wherein like reference numerals are used to identify identical or similar components in the various views,
Before proceeding to a detailed description of the embodiments of the present disclosure, a description of an exemplary environment in which such devices and sensors may be used will first be set forth. With continued reference to
Input/output mechanisms 14 may comprise conventional apparatus for interfacing with a computer-based control unit including, for example, one or more of a keyboard, a mouse, a tablet, a foot pedal, a switch and/or the like. Display 16 may also comprise conventional apparatus, such as a computer monitor.
Various embodiments described herein may find use in navigation applications that use real-time and/or pre-acquired images of a region of interest. Therefore system 10 may optionally include image database 18 to store image information relating to the patient's body. Image information may include, for example, a region of interest surrounding a destination site for medical device 24 and/or multiple regions of interest along a navigation path contemplated to be traversed by medical device 24. The data in image database 18 may comprise known image types including (1) one or more two-dimensional still images acquired at respective, individual times in the past; (2) a plurality of related two-dimensional images obtained in real-time from an image acquisition device (e.g., fluoroscopic images from an x-ray imaging apparatus), wherein the image database acts as a buffer (live fluoroscopy); and/or (3) a sequence of related two-dimensional images defining a cine-loop wherein each image in the sequence has at least an ECG timing parameter associated therewith, adequate to allow playback of the sequence in accordance with acquired real-time ECG signals obtained from ECG monitor 20. It should be understood that the foregoing embodiments are examples only and not limiting in nature. For example, the image database may also include three-dimensional image data as well. It should be further understood that the images may be acquired through any imaging modality, now known or hereafter developed, for example X-ray, ultra-sound, computerized tomography, nuclear magnetic resonance or the like.
ECG monitor 20 is configured to continuously detect an electrical timing signal of the heart organ through the use of a plurality of ECG electrodes (not shown), which may be externally-affixed to the outside of a patient's body. The timing signal generally corresponds to a particular phase of the cardiac cycle, among other things. Generally, the ECG signal(s) may be used by the control unit 12 for ECG synchronized play-back of a previously captured sequence of images (cine loop) stored in database 18. ECG monitor 20 and ECG-electrodes may both comprise conventional components.
Another medical positioning system sensor, namely, patient reference sensor (PRS) 26 (if provided in system 10) can be configured to provide a positional reference of the patient's body so as to allow motion compensation for patient body movements, such as respiration-induced movements. Such motion compensation is described in greater detail in U.S. patent application Ser. No. 12/650,932, entitled “Compensation of Motion in a Moving Organ Using an Internal Position Reference Sensor”, hereby incorporated by reference in its entirety as though fully set forth herein. PRS 26 may be attached to the patient's manubrium sternum or other location. PRS 26 can be configured to detect one or more characteristics of the magnetic field in which it is disposed, wherein medical positioning system 22 determines a location reading (e.g., a P&O reading) indicative of the PRS's position and orientation in the magnetic reference coordinate system.
Medical positioning system 22 is configured to serve as the localization system and therefore to determine position (localization) data with respect to one or more magnetic position sensors 28 and/or electrodes 30 and output a respective location reading. In an embodiment, a medical positioning system 22 may include a first medical positioning system or an electrical impedance-based medical positioning system 22A that determines electrode locations in a first coordinate system, and a second medical positioning system or magnetic field-based medical positioning system 22B that determines magnetic position sensors in a second coordinate system. In an embodiment, the location readings may each include at least one or both of a position and an orientation (P&O) relative to a reference coordinate system (e.g., magnetic based coordinate system or impedance based coordinate system). For some types of sensors, the P&O may be expressed with five degrees-of-freedom (five DOF) as a three-dimensional (3D) position (e.g., a coordinate in three perpendicular axes X, Y and Z) and two-dimensional (2D) orientation (e.g., a pitch and yaw) of an electromagnetic position sensor 28 in a magnetic field relative to a magnetic field generator(s) or transmitter(s) and/or electrode 30 in an applied electrical field relative to an electrical field generator (e.g., a set of electrode patches). For other sensor types, the P&O may be expressed with six degrees-of-freedom (six DOF) as a 3D position (e.g., X, Y, Z coordinates) and 3D orientation (e.g., roll, pitch, and yaw).
Impedance based medical positioning system 22A determines electrode locations based on capturing and processing signals received from the electrodes 30 and external electrode patches while the electrodes are disposed in a controlled electrical field (e.g., potential field) generated by the electrode patches, for example.
Medical positioning system 22A includes a diagrammatic depiction of a heart 52 of a patient 54. The system includes the ability to determine a catheter electrode location (i.e., position and orientation) as the catheter distal end is moved around and within a chamber of the heart 52. For this purpose, three sets of body surface electrodes (patches) are shown: (1) electrodes 56, 58 (X-axis); (2) electrodes 60, 62 (Y-axis); and (3) electrodes 64, 66 (Z-axis). Additionally, a body surface electrode (“belly patch”) 68 is shown diagrammatically. The surface electrodes are all connected to a switch 70. Of course, other surface electrode configurations and combinations are suitable for use with the present invention, including fewer electrodes, e.g., three electrodes, more electrodes, e.g., twelve, or different physical arrangements, e.g., linear arrangement instead of an orthogonal arrangement.
Medical device 24 is shown as a catheter with a distal electrode 30. Catheter 24 may have additional electrodes in addition to electrode 30 (e.g., a catheter tip electrode and/or ring electrodes) as well as one or more magnetic position sensors (not shown).
It should be understood that catheter 24 may include still other electrodes, and in other embodiments, such as in EP or RF ablation embodiments, the other electrodes may be used for any number of diagnostic and/or therapeutic purposes. For instance, such electrodes and therefore such catheters may be used for performing ablation procedures, cardiac mapping, electrophysiological (EP) studies and other diagnostic and/or therapeutic procedures. Embodiments are not limited to any one type of catheter or catheter-based system or procedure.
Each body surface (patch) electrode is independently coupled to switch 70 and pairs of electrodes are selected by software running on computer system 78, which couples the patches to signal generator 80. A pair of electrodes, for example the Z-axis electrodes 64 and 66, may be excited by signal generator 80 to generate an electrical field in the body of patient 54 and heart 52. In one embodiment, this electrode excitation process occurs rapidly and sequentially as different sets of patch electrodes are selected and one or more of the unexcited (in an embodiment) surface electrodes are used to measure voltages. During the delivery of the excitation signal (e.g., current pulse), the remaining (unexcited) patch electrodes may be referenced to the belly patch 68 and the voltages impressed on these remaining electrodes are measured by the A-to-D converter 82. In this fashion, the surface patch electrodes are divided into driven and non-driven electrode sets. Low pass filter 84 may process the voltage measurements. The filtered voltage measurements are transformed to digital data by analog to digital converter 82 and transmitted to computer 78 for storage under the direction of software. This collection of voltage measurements is referred to herein as the “patch data.” The software has access to each individual voltage measurement made at each surface electrode during each excitation of each pair of surface electrodes.
The patch data is used, along with measurements made at electrode 30, to determine a relative location of electrode 30 in what may be termed a patient-based coordinate system or patient reference frame 6. That is, as the patches are applied directly to the patient, the patient defines the reference frame of the impedance measurements. Potentials across each of the six orthogonal surface electrodes may be acquired for all samples except when a particular surface electrode pair is driven (in an embodiment). In one embodiment, sampling while a surface electrode acts as a source or sink in a driven pair is normally avoided as the potential measured at a driven electrode during this time may be skewed by the electrode impedance and the effects of high local current density. In an alternate embodiment, however, sampling may occur at all patches (even those being driven).
Generally, in one embodiment, three nominally orthogonal electric fields are generated by a series of driven and sensed electric dipoles in order to realize localization function of the catheter in a biological conductor. Alternately, these orthogonal fields can be decomposed and any pair of surface electrodes (e.g., non-orthogonal) may be driven as dipoles to provide effective electrode triangulation.
Data sets from each of the surface electrodes and the internal electrodes are all used to determine the location of measurement electrode 30 within heart 52. After the voltage measurements are made, a different pair of surface electrodes is excited by the current source and the voltage measurement process of the remaining patch electrodes and internal electrodes takes place. The sequence occurs rapidly, e.g., on the order of 100 times per second in an embodiment. To a first approximation the voltage on the electrodes within the heart bears a linear relationship with position between the patch electrodes that establish the field within the heart, as more fully described in U.S. Pat. No. 7,263,397 referred to above.
Magnetic-based medical positioning system 22B determines magnetic position sensor locations (e.g., P&O) in a magnetic coordinate system based on capturing and processing signals received from the magnetic position sensor 28 while the sensor is disposed in a controlled low-strength alternating current (AC) magnetic (e.g., magnetic) field. Each magnetic position sensor 28 and the like may comprise a coil and, from an electromagnetic perspective, the changing or AC magnetic field may induce a current in the coil(s) when the coil(s) are in the magnetic field. The magnetic position sensor 28 is thus configured to detect one or more characteristics (e.g., flux) of the magnetic field(s) in which it is disposed and generate a signal indicative of those characteristics, which is further processed by medical positioning system 22B to obtain a respective P&O for the magnetic sensor 28 relative to, for example, a magnetic field generator.
As further illustrated in
As previously noted, the impedance-based medical positioning systems and magnetic-based medical positioning systems have different strengths and weaknesses. For instance, impedance-based systems provide the ability to simultaneously locate a relatively large number of electrodes. However, because impedance-based systems employ electrical current flow in the human body, the system can be subject to measurement inaccuracies due to shift and/or drift caused by various physiological phenomena (e.g., local conductivity changes, sweat/patch interactions, etc.). Additionally, impedance-based systems may be subject to electrical interference. As a result, electrode locations, renderings, geometries and/or representations based on such impedance-based measurements may be distorted. Magnetic-based systems, on the other hand, are not dependent on the characteristics of a patient's anatomy and are considered to provide a higher degree of accuracy. However, magnetic position sensors generally are limited to tracking relatively fewer sensors.
Efforts have been made to provide a system that combines the advantages of an electrical impedance-based positioning system (e.g., positioning of numerous electrodes) with the advantages of a magnetic-field based coordinate system (e.g., independence from patient anatomy, higher accuracy). In an embodiment, such a system may be provided by registering the coordinate systems of an electrical impedance-based positioning system with the coordinate system of a magnetic field-based positioning system. In such an arrangement, locations of electrodes may be identified in an impedance-based coordinate system in conjunction with identifying the locations of one or more magnetic sensors in a magnetic-based coordinate system. In an embodiment, at least a portion of the electrodes and magnetic sensors may be co-located to define fiducial pairs. This co-location allows for determining a transformation (e.g., transformation matrix) between the coordinate systems. The transformation may be applied to the locations of any electrode to register these locations in the magnetic-based coordinate system once the transformation is determined. Accordingly, the electrical impedance-based electrodes can be identified in the coordinate system of the magnetic field-based positioning system thereby increasing the positioning accuracy for the electrodes. Such a system is set forth in co-owned U.S. Pat. Pub. No. 2013/0066193, as incorporated above.
While providing improved electrode positioning, the determination of a transformation between the impedance-based coordinate system and the magnetic based impedance system and subsequent registration of the electrode locations to the magnetic coordinate system can fail to account for various impedance shifts and/or drifts, associated with the electrode(s). That is, impedance-based systems can be subject to nonlinear shift and/or drift due to physiological phenomena. Along these lines, previous efforts have been directed to identify shifts and/or drifts and apply corrections to the registrations. Such a system is set forth in co-owned U.S. Pat. Pub. No. 2016/0367168 hereby incorporated by reference in its entirety. Generally, such a system determines a transformation between the impedance-based system and the magnetic-based system and applies a correction to the electrode locations.
The previous systems that utilize electrode information (e.g., impedance measurements) and magnetic sensor information to provide improved electrode positioning in three-dimensional space (e.g., within a body of a patient) rely primarily on impedance-based measurements. That is, the magnetic sensor information (e.g., magnetic sensor measurements) delivers additional accuracy. This may be described as an impedance-primary location arrangement. Due to the distortion and temporal instability of the impedance measurements, such an arrangement can suffer from instability. Further, the previous impedance-primary location arrangements, in some instances, fail to account for various errors within the system. By way of example, a transformation between the impedance-based coordinate system and the magnetic-based impedance system may underestimate error or uncertainty in the electrode and/or magnetic sensor measurements. By way of further example, such systems may fail to take into account other system inputs (e.g., patient movement, shape of the medical device, etc.), which may affect the calculated locations or positions of the electrodes. In summary, registration of an impedance-based system to magnetic-based system may fail to include additional information which may be observed and/or inferred and which may improve the overall identification of catheter and/or electrode positions in a three-dimensional space.
To provide an improved system for determining the locations of electrodes in a three-dimensional space such as within a body of a patient, the present disclosure is directed to a location arrangement (e.g., sensor fusion process or algorithm) that continuously integrates (e.g., fuses) impedance measurements from the electrodes and external patches with position and orientation measurements from magnetic sensors to estimate the latent state (e.g., position) of a medical device disposed within a patient reference frame. The latent state is used to track catheter electrodes within a body of a patient as though there were a magnetic sensor located at each catheter electrode, thereby achieving both accuracy and stability. More broadly, the presented arrangement expands the number of observed parameters utilized to locate the electrodes within a patient reference frame without relying on direct transformation between the impedance-based coordinate system and the magnetic-based impedance coordinate system based on the existence of fiducial pairs of electrodes and sensors. Fiducial pairs are not required by the systems and methods of the present disclosure. Rather, the impedance measurements and magnetic measurements are utilized as inputs to an overall system model that estimates/predicts and updates catheter electrode locations in a patient reference frame. Catheter and/or electrode locations may be tracked using both magnetic and impedance measurements.
The following provides one simplified catheter model (i.e.,
Referring again to
Frenet formulas describe the geometric properties of a continuous, differentiable curve in three-dimensional space. More specifically, the Frenet formulas describe the derivatives of the tangent ‘T’, normal ‘N’, and binormal ‘B’ unit vectors in terms of one other along at each point along the length λ, of the frame. See
where d/ds is the derivative with respect to arc length, k is the curvature (e.g., inverse or radius of a curve), and τ is the torsion of the curve. The two scalars k and τ effectively define the curvature and torsion of a curve. For each segment in a homogenous coordinate system, the Frenet frame (FF) for a curve defined by k and τ at a distance λ along the curve is defined as:
Utilization of the Frenet frame effectively permits defining each model segment utilizing two parameters curvature k and torsion τ.
In the embodiment of
In an embodiment, state transition models (e.g., matrixes), which apply the effect of each curve parameter at time k-1 to the curve parameters at time k are as follows:
f(x)i=ki(k-1)+curve(-ki(k-1))
f(x)i=τi(k-1)+torsion(-τi(k-1))
In an embodiment, the forcing factor(s) may be derived from catheter specific mechanical parameters. In an embodiment, the forcing factor may represent the returning force of a shape metal wire that forms the spline of the catheter. In such an embodiment, the forcing factor F applies a returning force to a deformation associated with the given shape parameters that represents the force applied by the shape metal wire attempting to return to an un-deformed or nominal state from a current shape parameter. In an embodiment for a single-segment catheter which is nominally straight and untwisted with the same torsional stiffness as the rotational stiffness:
As will be appreciated, such a forcing factor F is unique for a specific catheter. The inclusion of the forcing factor prevents the state transition model from being identity to a prior state.
Through application of the above noted transition models, a state distribution of potential catheter shapes, in the catheter frame of reference, may be estimated for time k.
An observational model may be implemented to map the state parameters into a physical domain (e.g., catheter frame of reference). In an embodiment, this is performed by evaluating the matrix exponential for the Frenet Frame. In an embodiment, the matrix exponential is an integrated differential matrix with constant terms (e.g., curvature and torsion) over the arc length for all electrodes where the position l of the electrodes varies over the arc length. In an embodiment, the matrix evaluation may be computed using a Givens rotation and trigonometric functions.
In an embodiment, a Given's rotation is initially computed to eliminate two terms of the Frenet Frame:
θ=√{square root over (k2+τ2)}
such that:
After expanding the first several terms of the remaining matrix exponential, the following trigonometric series identities can be recognized:
Where Φ is a transformation from the state space to the catheter frame of reference. For the full Φ matrix, it is useful to leave the Given's rotations in the solution. However, the last row, which contains the Cartesian coordinate for a given arc length along the curve, is evaluated for each electrode on the hoop:
Where P is a coordinate at position of the Frenet Fame. The model electrodes and/or coil(s) are then identified in the catheter reference frame by computing the arc length along a specified curve for each electrode, computing P as above and composing it with any Φ which may be more proximal.
For the model electrodes on the distal hoop (e.g., subscript 2 in the current embodiment) for the model of
For the magnetic sensor or electrode (if present) on the proximal shaft of the two segment catheter model of
Once the positions of the model electrodes and/or magnetic sensors are known in the catheter reference frame, they may be transformed into the patient reference frame using any appropriate transformation. In an embodiment, a six degree of freedom rigid transformation is utilized to orient the catheter model locations of the electrodes and magnetic sensor into the patient reference frame based on the position and orientation of the magnetic sensor relative to a position and orientation of a magnetic patient reference sensor. For each model electrode position in the patient reference frame, impedance measurements may be predicted and impedance measurements may be obtained (e.g., observed) from the physical electrodes. The predicted measurements and observed measurements may be utilized to update the parameters of the catheter model to more closely approximate a physical configuration of the deformable catheter.
While previously discussing the modeling of a relatively simple single spline catheter, it will be appreciated that more complex catheters may be modeled based on a limited set of parameters.
In an embodiment, the planar catheter is modeled by four parameters, a base curvature, a paddle curvature, a slanting angle and a tube curvature. Such parameters relate to physical actions that may occur during the course of a clinical procedure that would cause the catheter 140 to take a particular shape (e.g., deform). For instance, during a cardiac procedure the catheter 140 typically presses against a cardiac wall and/or is pushed into a lumen (e.g., blood vessel, artery). Pressing against a cardiac wall typically results in a change in the base curvature and paddle curvature from the relaxed state where the paddle 144 is displaced from the reference axis x as shown in the side view of
The base curvature kb and paddle curvature kp are best shown in
k
p
≈c·f(kb)
where the functional factor f (kb) is positive. This relationship may be determined through experimentation where a number of paddle deformations are examined (e.g., in benchtop testing) to determine the shape or range of the base curvature. In an embodiment, a plot of the relative values of base curvature kb and paddle curvature kp may be prepared such that for example, a best fit curve may define the relationship of the parameters. In an embodiment, the relationship between these curvatures for the specific catheter was found to be:
k
p
≈c·f(kb)=c·c1arctan(c2 kb)
where c1 and c2 are experimentally determined constants.
The catheter models may be implemented to estimate shapes or states of a catheter as part of a stochastic process. In such an arrangement, a catheter model may be used to predict or estimate a current shape of a catheter and thereby the locations of electrodes in a catheter reference frame based on a previous known shape of the catheter. In such an arrangement, a shaping function may be applied to adjust each set of model parameters (e.g., previous curvatures, torsions, slant angles etc.) to estimate new potential catheter shapes. In such an arrangement, the model parameters may form hidden state variables and, in an embodiment, an Extended Kalman filter or other estimator may be used to estimate these hidden state variables to predict catheter shapes. In such an arrangement, a state distribution of all possible catheter shapes may be generated and transformed from the catheter reference frame to the patient reference frame to predict electrode locations within the patient reference frame. Predicted electrode measurements (e.g., from an impedance model) associated with the predicted locations of the electrodes in the patient reference frame (e.g., from the catheter model) may be utilized with actual electrode measurements in the patient reference frame to update a set of shape parameters associated with the updated shape estimate. This may allow identifying a true catheter shape and electrode locations in the patient reference frame.
When estimating or predicting the shape of a catheter described by a small number of parameters, it has been recognized that the shape estimation is over-determined. That is, the state distribution of predicted catheter shapes based on the shape parameters may include shapes that, while possible, are not likely. For instance, the loop catheter of
In an embodiment, the present disclosure describes a technique for pruning the parameter space to physically achievable states by determining the likelihood of a set of shape parameters. More specifically, a likelihood function is applied to an estimated state distribution of the catheter shape model to exclude unlikely states from the estimated state distribution. This results in biasing the estimator towards more likely parameters.
In an embodiment, the likelihood function may be determined experimentally by deforming a physical catheter associated with a catheter model under constant force and computing the energy associated with a set of shape parameters for each shape of the catheter. The stored energy may then be used as proportional to the negative log likelihood of an associated set of shape parameters for particular catheter shape. Along these lines, it is recognized that many catheters have one or more shape memory wires or splines that, when deformed, attempt to return to a nominal or original configuration. By way of example, the planar catheter discussed above may return to the planar configuration once a deforming force is removed from the catheter. Accordingly, the energy stored in the catheter when bent may be assumed to be proportional to the likelihood of the deformation. When a catheter is deformed by pushing it against a structure, it may be assumed that the catheter will adopt the lowest-energy configuration. For example, for a deformation in response to an obstacle, if a lower energy configuration can produce the same measurements, the catheter will be in the lower energy configuration. Thus, it follows that the energy of a deformation is proportional to the likelihood of the corresponding set of shape parameters.
The collet 202 holds the catheter shaft at a desired roll angle α. In an embodiment, the collet is configured to rotate about an axis that is substantially co-axial with the longitudinal axis of the catheter shaft. Thus, the collet may rotate to any desired roll angle α. During each bending procedure, the catheter shaft may be maintained at a predetermined fixed roll angle. The movable sled 210 is moved into contact with the distal end of the catheter at an angle theta θ (e.g., contact angle) to the longitudinal axis of the catheter 140. The sled 210 is attached to an actuator 212 through the force sensor 220. The sled 210 is then controllably displaced by the actuator 212 which is configured to maintain a force set point (e.g., via PID control). The sled 210 is displaced toward the catheter until it contacts the distal end of the catheter at a known angle theta θ and the force set point is achieved. Once an initial force set point is achieved, the sled may be additionally displaced for additional force set points. For each advancement or displacement of the sled and force set point, the catheter is bent or deformed. By recording the displacements and the forces, these may be integrated to compute the energy stored in the catheter. Similar processes may be provided where the distal end of the catheter is displaced (e.g., pushed) into a lumen of a known size and orientation.
This bending procedure is conducted in a calibrated multicamera system. That is, cameras 230 identify the position of each electrode 146 such that a low-error 3D coordinate of each electrode is determined for each deformation. The controller 232, for each deformation, utilizes the coordinates from the cameras, the angular information from the collet and sled, the forces and the displacements to determine corresponding shape parameters (e.g., curvatures, slanting angles etc.). In an embodiment, a nonlinear least-squares minimization of the shape, position and orientation parameters is used to find the shape parameters associated with a particular deformation. By iterating the constant force displacement over the permutations of alpha, theta and force, samples of the shape/energy landscape are acquired. Curves describing the energy as a function of the shape parameters can then be fit to the samples.
In an embodiment, the experimentally determined curves are the basis of the likelihood function r(x). The likelihood function is used to regularize an estimated state distribution. Generally, the likelihood function describes the plausibility of a state (e.g., catheter shape). In an embodiment, a negative log likelihood is utilized. In such an embodiment, impossible states have a negative log likelihood of infinity and the most likely state has the minimum negative log likelihood. To apply this regularization, in an embodiment, a probability density function (regularizing PDF) is computed by negating, exponentiating and normalizing the negative log function. The estimated state distribution is then multiplied by the regularizing PDF and renormalized to create a regularized state distribution that omits unlikely states (i.e., states outside the combination of the state distribution and the regularizing PDF).
In an embodiment, the log likelihood function may be approximately applied through a second-order Taylor series expansion of the negative log likelihood function at the mean of the estimated state distribution to create a probability density function. In an embodiment, the approximation of the negative log likelihood function may be made via the following equation:
−ln r(x)≅−ln r(x′)−(x-x′)−1/2(x-x′)T(x-x′)
Where the Hessian of the second order expansion is treated as the inverse of the covariance, with the Gaussian mean given by the multiplication of the Jacobian of the second-order expansion by the inverse of the Hessian. This approximation is equivalent to a Guassian PDF, which can be multiplied with the state distribution by well understood means.
The regularization of a state distribution estimate is graphically illustrated in
For any catheter model having a magnetic sensor, the magnetic sensor will typically define a vector having six degrees-of-freedom. Three degrees-of-freedom for position (i.e., x, y, z), which may define an origin model in the catheter reference frame as defined by one or more magnetic sensors of the model, and three degrees of freedom for orientation (i.e., yaw, pitch, roll). The three degrees of freedom for the orientation may define a 3D bivector (byz, bzx and bxy), which is the log of the quaternion. The catheter shape model may be transformed into the patient reference frame utilizing a transformation (e.g., catheter transformation) that preserves shape and size of the catheter model. That is, catheter position and orientation model may be represented by a rigid-body transformation (e.g. six degree of freedom rigid-body translation) that translates the vector (e.g., state vector) of the shape model into the patent reference frame. For instance, such a transformation may align the origin and orientation of the catheter model (e.g., vector in an embodiment) relative to the origin of the patient reference frame (e.g., as determined by the patient reference sensor). At such time, the locations of the magnetic sensor and electrodes are known or estimated within the patient reference frame. Of note, the origin of the patient reference frame as well as the origin of the catheter reference frame may shift due to patient motions (e.g., respiration, physical patient movement, etc.). Accordingly, the transformation and registration between the patent reference frame and the catheter reference frame may be updated.
In an embodiment, a magnetic patient reference sensor model or PRS model (e.g., PRStoPat) is used to describe the displacement of the patient reference sensor(s) relative to a patient reference frame 6. As will be appreciated, magnetic measurements are produced in a static magnetic-based coordinate system or magnetic reference frame 4, which typically has an origin based on a magnetic field generator. To eliminate patient movement relative to the static magnetic reference frame, patient movement may be monitored by a magnetic positional patient reference sensor (PRS) 26. See
The PRS model includes a position and orientation of a one or more positional reference sensors (e.g., patient reference sensors) defined in the patient reference frame, where each patient reference sensor has a further 6 degrees of freedom (e.g., a 3D position and a 3D orientation), which are also expressed by state variables of the sensor fusion algorithm. The model allows tracking of motion of the patient reference sensor(s) relative to the patient. This motion can be modeled as having error of a small magnitude. Consistent placement of patient reference sensor(s) on the patient allows at least one of them to be considered as being at a specified initial translational offset from the origin of the patient frame. For example the patient origin can be placed at or within a typical heart location. Alternatively, a patient origin may be defined by a patient reference sensor.
A magnetic model (PatToMag) defines a rigid transformation from a patient coordinate frame (e.g., patient reference frame) to a magnetic field generator frame, which can vary over time. In an embodiment, the magnetic model defines an initial transformation between a location in the patient reference frame (e.g., origin) and an origin of the magnetic reference frame. In an embodiment, the magnetic model permits predicting magnetic values for locations in the patient reference frame. The magnetic model has 6 degrees of freedom, expressed by state variables of a sensor fusion process or algorithm. The magnetic model allows for tracking patient motion in substantially real time. At the start of a procedure, the patient typically lies in a consistent orientation on a surgical table, which is at or near a known orientation relative to the magnetic field generator. Therefore, a fixed orientation of the magnetic field generator (e.g., magnetic reference frame 4) relative to the patient reference frame can be assumed for an initial state.
The purpose of the models is to determine a time-variable three-dimensional Patient to Magnetic model/transformation at any time k (i.e., PatToMagk). This transformation, at any given time, provides a rigid translation from the patient reference frame to the magnetic reference frame (e.g., field generator frame). The time variable transformation allows for transforming locations in the patient reference frame to the magnetic reference frame and periodically or continuously updating these locations in response to patient movement. Broadly, the models allow for representing one frame of reference in another frame of reference such that a point in one frame at a given time (e.g., patient reference frame) may be identified in the coordinates of the other frame (magnetic reference frame) at that time. In this regard, a first frame of reference can be represented in terms of a second frame of reference by applying a transformation matrix M. That is a set of resulting coordinates (e.g., position and orientation) in one frame of reference are a function of the coordinates (e.g., position and orientation) in another frame of reference. In a generalized equation:
where the column vector [x, y, z] is a location in the patient reference frame, the matrix M represents the PatToMagk matrix, the column vector [x′, y′, z′] are predicted measurements of the location in the magnetic reference frame. This relationship may implemented in a stochastic process such that the PatToMagk transformation/model may be used to predict magnetic measurements for predicted locations of magnetic sensors (e.g., from a medical device model) in the patient reference frame. Such predicted measurements may be updated or corrected based on subsequent observations. For instance, actual magnetic measurements for a magnetic sensor at or near a predicted location may be obtained from the medical positioning system 22. The actual measurement may be utilized with the predicted measurements to determine a true location of a magnetic sensor in a patient reference frame. Further, the actual measurements and the predicted measurements may be utilized to update the matrix M, which predicts the values for locations in the patient reference frame.
The model utilizes a patient reference sensor to establish a reference position in the patient frame of reference. As the patient reference sensor moves with a patient, the PatToMagk model must evolve over time to account for such patient movement. By way of example a transformation may be performed by:
where positional values further use of a 1 or 0 in the last entry of the column vectors to represent a point/position or a direction, respectively. In the embodiment where the process is stochastic process, the variables of the matrix (e.g., a-i) are allowed to evolve over time.
In the present embodiment, the models have the following relationships:
patk=PRSToPati,krefk
and:
magk=PatToMagk patk
where refk is a coordinate 100 in the patient body (e.g., reference sensor space) at time k (e.g., prior to alignment with the patient reference frame to account for patient movement), patk is the value of the coordinate in patient reference frame at time k (e.g. patient frame coordinate), and magk is the value of the coordinate in the magnetic reference frame at time k (e.g., patk after being transformed from the patient reference frame to the magnetic reference frame). This is illustrated in
The PRSToPati,k transformation aligns (e.g., rotates) the patient reference sensor 26 at refk to the patient reference frame 6. That is, the PRSToPati,k transformation represents a patient reference sensor transformation between the patient reference sensor and the patient reference frame. In an embodiment, the patient reference sensor may define an origin of the patient reference frame. In another embodiment, the patient reference sensor may be offset from an origin of the patient reference frame. In either embodiment, the initial orientation of the patient is known. For instance, at the start of a procedure, the patient typically lies in a consistent orientation on a surgical table such that the orientation of patient reference frame is known. The patient reference frame 6 may extend from, for example, head to foot of the patient, which is initially aligned with a support/surgical table, left to right and vertically up and down. The patient reference sensor 26 has six degrees of freedom (e.g., x, y, z, roll, pitch and yaw). As the patient reference sensor is applied externally to the patient, an initial orientation 5 of the sensor 26 (e.g., roll, pitch, yaw) may not align with the patient reference frame 6. However, the orientation of the patient reference sensor as applied to a patient can be determined (e.g., using the medical positioning system) and transformed to align the patient reference sensor 26 with the patient reference frame 6 defining the PRSToPati,k transformation. The relationship between the patient reference sensor 26 and the origin or any coordinate in the patient body is assumed to remain substantially constant as the patient reference sensor 26 and origin (as well as other coordinates in a patient body) both move with patient movements. Therefore, a nominal patient reference sensor to patient transformation (e.g., NomPRStoPat) is a definable and fixed transformation.
The PatToMagk transformation aligns the patient reference frame with the magnetic reference frame 4. Stated otherwise, the PatToMagk transformation defines a transformation between a magnetic reference frame having an origin associated with the magnetic field generator of the magnetic-based medical positioning system and a coordinate or location in the patient reference frame. This transformation, PatToMagk, may initially be based on a fixed orientation of the magnetic field generator (e.g., magnetic reference frame 4) relative to an initial orientation of the patient reference frame, which is known. Stated otherwise, a nominal patient to magnetic transformation (e.g., NomPatToMag) is a definable and fixed transformation.
Based on these relationships and transformations, a position and orientation of any coordinate (e.g., patk) in the patient reference frame may be determined in the magnetic reference (e.g., magk) frame using the PatToMagk transformation. In this regard, the relationship magk=PatToMagkpatk forms a portion of an observational model, as discussed further herein. In an embodiment, the position of the patient reference sensor may be monitored to identify displacements caused by patient movement. That is, the medical positioning system may identify displacements of the patient reference sensor and these displacements may be used to update the above-noted relationships.
In order to implement the model, it is necessary to define the transformations between the coordinate systems (e.g., patient coordinate system and magnetic coordinate system). The relationship from the patient reference sensor space to the magnetic field generator (e.g., magnetic coordinates) is at any time k:
PRStoMagi,k=PatToMagkPRSToPati,k
That is, the transformation from the patient reference sensor to the magnetic field generator is a product of the two transformations PatToMagk and PRStoPati,k. As the patient reference sensor is a magnetic sensor, its position in the magnetic field of reference may also be directly observed. However, due to patient motion, both PatToMagk and PRStoPati,k may change or evolve over time though these two transformation should remain near their nominal relationships NomPRSToPati, which is also defined as PRStoPATi,nom, and NomPatToMag, which is also defined as PatToMagnom. In an embodiment, the nominal relationships are the initial relationships (e.g. at k=0). PatToMagk and PRStoPati,k are defined to track deviations from their nominal relationships and capture these changes so that the transformations between these frames of reference are updated in conjunction with patient movements (e.g., movement of the patient reference sensor).
In an embodiment, the PRStoPati,k can be defined to track deviations as follows:
PRStoPati,k=NomPRSToPatiPRSToNomPRSi,k
This is diagramed in
In embodiment, PatToMagk can be defined to track deviations as follows:
PatToMagk=NomPatToMag PatToNomPatk
This is diagramed in
As previously noted, a patient typically lies in a consistent orientation on a surgical table, at the start of a procedure. Therefore, a fixed orientation of the magnetic field generator (e.g., magnetic reference frame 4) relative to the patient reference frame can be assumed for an initial state. Accordingly, in an embodiment it is assumed that the nominal relationships (e.g., transformations, sensor locations etc.) are substantially equal to the initial relationships at the beginning of the procedure. In an embodiment:
PRSToNomPRSi,nom=I≈PRStoNomPRSi,0
PatToNomPatnom=I≈PatToNomPat0
That is, it is expected that the nominal configuration is near the initial configuration I which is substantially equal to the nominal configuration at time 0. Therefore, the initial patient reference sensor locations are a suitable value for PRSToMag0,nom, as they are expected to be close to PRSToMag0,0.
In an embodiment, the patient reference sensor may be measured (i.e., observed) in the magnetic field:
where Pnom is the observed orientation of the patient reference sensor at the nominal time (e.g., time 0 or a combination of several observations near time 0) and pnom is the position of the patient reference sensor at the nominal time. Accordingly, the PRSToMag0,nom transformation may be determined from direct measurements. Based on the PRSToMag0,nom transformation, the following transformations may be derived:
In an embodiment, it is desirable to set a fixed position of the patient reference sensor (e.g., 0 or origin) in the patient frame so that the patient origin is typically inside the heart. In an exemplary embodiment, for a posterior patient reference sensor, an offset between the patient reference sensor and an origin inside the heart is chosen as bnom=[0 175 0]T., which is a column vector as noted by the superscripted T. Other offsets are possible and typically depend on the system in which they are implemented and/or where the patient reference sensor is placed on the patient (e.g., chest, back etc.).
As the patient is laid on the table in a characteristic orientation, the orientation between the field generator, the table and, hence, the patient reference frame may be known initially. In an embodiment, a fixed nominal rotation between the patient reference frame and the magnetic reference frame may be established. For example:
This fixed nominal rotation typically depends on the configuration of a specific magnetic field-based positioning system. The remaining degrees of freedom are anom and Bnom. Given the previous relationship:
PRStoMagk=PatToMagkPRSToPatk
The models define a time-varying rigid transformation from the patient coordinate frame to a magnetic field generator frame to permit determining a magnetic value for a location in the patient reference frame. In an embodiment, the PRS model is used in conjunction with the catheter model and the position and orientation model. As shown in
In an embodiment, an Extended Kalman filter is used to infer hidden state variables corresponding to the hidden state variables of the transformations of the models. From the hidden state variables, at any time, hidden state measurements (e.g., magnetic values in the patient reference frame) can be predicted and estimates of the state variables can be updated using an Extended Kalman filter (or other estimator) framework in a fashion that allows updates to those parts of the hidden state variables that are accessible. Thus, at any instant in time, while there may not be enough information to determine parts of state variables, by using the Extended Kalman filter framework, predictions associated with appropriate parts of the state variables associated with the transformation from an impedance based domain to a patient domain can be made.
Differences between the predictions for the appropriate parts of the state variables associated with the model and actual measurements can be made and the appropriate parts of the state variables can be updated based on the differences between the predictions and the actual measurements. As such, the state variables can be modified over a given period of time, rather than at a given instant in time. For example, the prior prediction of the appropriate parts of the state variables can be corrected based on measurements at a current time point.
As discussed further herein, the magnetic and/or PRS models may form a part of the overall or composite system model. During implementation, the models are queried to predict sensor locations in the patient reference frame. Subsequently, these predictions are utilized with sensor locations measurements to further refine the estimated locations of the sensors in the patient reference frame and update the magnetic model and/or PRS model. It will be appreciated that additional magnetic models are possible and considered within the scope of the present disclosure. In an example, a magnetic model for use in transforming between patient relative coordinates to magnetic coordinates is described in U.S. Provisional Application No. 62/756,936 titled “Patient Reference Sensor Model for Medical Device Localization based on Magnetic and Impedance Sensor Measurements”, filed on Nov. 7, 2018, the entire contents of which is incorporated herein by reference.
Within the context of a sensor fusion process, the usefulness of impedance measurements to locate physical catheters and their electrodes in a three-dimensional space (e.g., patient reference frame) depends on having an effective model, for any catheter configuration, to predict the impedance measurements within an electrical or impedance potential field. That is, based on a predicted location (e.g., model location) of a catheter and/or catheter electrodes (e.g., model electrodes) in a patient reference frame (e.g., three-dimensional space), it is desirable to predict the impedance measurements of the modeled catheter electrodes to refine the location of the physical catheter and/or its electrodes and/or to update the impedance model. It has been further recognized that previous efforts of impedance modeling of electrodes locations has, in some instances, lacked accuracy due to the failure to account for noise.
In an embodiment, an impedance model transforms between the patient coordinate system and the impedance measurements (e.g., PatTolmp). Further, the impedance model may incorporate noise and and/or distance dependent modeling errors between individual electrodes to improve the estimation of impedance measurements for determining electrode locations within a patient. In an embodiment, the impedance model is a stochastic process where a true state of the model is a hidden or latent state that is determined. The model generates estimates of electrode impedance measurements in a three-dimensional space (e.g., location-to-impedance-values). Such estimates and/or the model may be refined based on actual impedance measurements of electrodes located in the three-dimensional space. In an embodiment, such an impedance model implements various separate methodologies, which can be used in combination.
In an embodiment, a first methodology is directed to modeling the location-to-impedance-value as mapping a linear combination of harmonic basis functions, such as regular solid harmonics. However, it will be appreciated that additional harmonic basis functions are possible and considered within the scope of the present disclosure. However, it is believed that regular solid harmonic basis functions provide suitable descriptiveness with reduced degrees of freedom, simplifying the model. Further, as the electrodes are located within a common blood pool, they experience generally uniform conditions such that a Laplacian of the harmonic basis functions should be zero providing a constraint for the model. Yet further, the linear combination of harmonic basis functions may be constrained to obey Kirchhoff's voltage law. Collectively, this helps to account for spatial nonlinearity of the impedance measurements. In an embodiment, a second methodology is directed to modeling the measurement noise characteristics of the impedance system, including covariance among measurements from distinct electrodes. In an embodiment, a third methodology is directed to introducing an artificial measurement noise covariance among distinct electrodes that falls off with the distance between those electrodes. This noise term represents the amount of otherwise un-modeled error and helps to account for spatial nonlinearity of the impedance measurements and/or respiration-related artifacts.
The hardware for impedance-based location measurements include of a set of electrical patches affixed to the patient/patient reference frame (e.g. 6 patches: neck, leg, chest, back, right, left). See.
Based on these constraints, the number of independent impedance potential fields is the number of driven patch pairs (i.e., six in the present embodiment) less the number of cycles (i.e., one in the present embodiment) in the graph. In the present embodiment, there are five independent impedance potential fields. Further, there is a linear mapping from these independent impedance potential fields to the larger set of potentials driven by the patch pairs. For the set of driven patch pairs shown in the present embodiment, the mapping is as follows:
Where z is the vector of measured or estimated potentials, and y is the vector of the independent impedance potentials, which, in an embodiment, are hidden state variables of a stochastic process. The numeric matrix, denoted Mbelow, maps the five independent impedance potential fields y to the six potentials z. In an embodiment, the matrix M forms an observational model for the stochastic process. The independent impedance potential fields represent virtual potential fields that, in the presented embodiment, are never excited though exist within the system. That is, the independent impedance potential fields exist between the non-exited patch pairs. Two of these independent impedance potential fields yleft-right and yback-chestare shown in the graph of
Each time point and for each independent driven patch pair or ‘impedance mod’, model impedance measurements for each independent impedance potential field i and electrode j are set forth as follows:
Y
ij=φij+εij
and:
Z
k
=Vec(Myj)+vk
Where φij is a potential in independent impedance potential field i for electrode j computed from a series of harmonic bases , εi,j is a modeling error term which covaries between a pair of electrodes as function of their distance, and vk is a measurement noise term.
For each independent driven patch pair or impedance mod i′, φi′,j is a function of the electrode location xj (e.g., in the patient reference frame) and of the state variables of the impedance model (e.g., Patient to Impedance transformation). In an embodiment, the impedance transformation may be a global dynamic non-rigid transformation that maps the patient frame of reference to the impedance frame of reference. εi′ is the vector of all distance dependent modeling error terms for impedance mod i′ and is modeled as a multivariate normal random variable whose entries have a covariance dependent on the distances between pairs of electrodes. Finally, v, the vector of the electrical noise terms for all electrodes, is a multivariate normal random variable reflecting electrical noise characteristics of the measurement system. This model of impedance measurement behavior is used as part of the sensor fusion process or algorithm, such as a recursive Bayesian estimator (e.g. an extended Kalman filter or particle filter), to fit impedance and catheter state variables to impedance measurements and other measurements.
In an embodiment, φi,j is a linear combination of basis functions. Each basis function at a point in space maps to an electrical value of the modeled potential field to an electrical value (e.g, voltage, impedance, etc.). If electrodes are at locations xj then:
Where is a scalar-valued function evaluating the th solid harmonic basis function for an electrode location, and is the weights on the basis functions (e.g.,th basis function) relating the patient frame of reference to the impedance potential field. All basis functions should be harmonic. That is, the Laplacian everywhere should be zero. In an embodiment, can be the regular solid harmonics of up to a predetermined order. For example, can be the regular solid harmonics of up to the fourth order. Use of harmonics up to the fourth order results in 25 basis functions per electrode. As will be appreciated, limiting the harmonic basis functions to the fourth order truncates information in higher order harmonics, which may provide additional description of the potential field. The exclusion of this information is accounted for in the modeling error term ε. In an embodiment, the weights may be set to predetermined or default values, which may be based on experimentally determined baselines. During operation of the impedance model, these weights are adjusted to fit impedance and catheter state variables to impedance measurements and other measurements.
Distribution of the modeling error term ε:
The intent of the modeling error term is to represent sources of unmodeled signals in the impedance measurements, such as unmodeled high-order terms of the harmonic basis or perturbations caused by patient respiration. Explicitly incorporating the expected magnitude of unmodeled phenomena or error in the impedance basis model makes the system robust to such discrepancies.
For each independent impedance mod i′, let εj=nj+rj where nj is a multivariate normal random variable representing error due to nonlinearity of the impedance not modeled by the gk and rj is a multivariate normal random variable representing error due to, for example, unmodeled respiratory artifacts.
In an embodiment nj:
Where N is a normal random distribution, 0 represents the mean of the distribution and the matrix h represents the covariance for each electrode based on the absolute distance d (e.g., vector) between each electrode (i.e., |x#-x#|). See. e.g.,
In an embodiment, rj:
At each time i, respiration applies a shared translation to all points of each independent impedance potential field. The parameter c controls the magnitude of respiratory error. In an example, a system and method for modeling a respiratory error or artifact is described in U.S. Provisional Application No. 62/756,926 titled “Respiration Model for Device Localization Based on Impedance Sensor Measurements”, filed on Nov. 7, 2018, the entire contents of which is incorporated herein by reference.
Distribution of the electrical noise term vk:
For each driven patch pair j:
In this embodiment, each electrode has a noise component of variance e that is independent of other electrodes and a noise component of variance d that is shared with other electrodes.
In use, the impedance model mathematically defines the impedance field for a patient reference frame. In an embodiment, the impedance field is defined such that impedance potentials for a set of driven patch electrodes, at any location in the impedance field, are a function of a set independent impedance potential fields, which are mapped to the impedance potentials. Various method may be implanted to generate the impedance model. In an embodiment, the impedance model is generated on the fly during a procedure. That is, a catheter 24 may be disposed within an impedance field at the beginning of a medical procedure. See
In an embodiment, the independent impedance potential fields and their parameters are state variables of a stochastic process such that they may evolve over time. Initially the impedance model estimates a set of impedance measurements zi,est (e.g. back->left, left->chest, right->back, chest->right, neck->back, leg->back) for electrodes j at a locations xj. See. e.g., predicted electrode locations 301-304 in the heart 52 in
In an embodiment, an Extended Kalman filter is used to infer hidden state variables corresponding to the hidden state variables of the model. From the hidden state variables, at any time, hidden state measurements (e.g., impedance values at locations in space) can be predicted and estimates of the state variables can be updated using an Extended Kalman filter framework in a fashion that allows updates to those parts of the hidden state variables that are accessible. Thus, at any instant in time, while there may not be enough information to determine parts of state variables, by using the Extended Kalman filter framework, predictions associated with appropriate parts of the state variables associated with the transformation from the location in the patient reference frame to impedance measurement can be made.
Differences between the predictions for the appropriate parts of the state variables associated with the model and actual measurements can be made and the appropriate parts of the state variables can be updated based on the differences between the predictions and the actual measurements. As such, the state variables can be modified over a given period of time, rather than at a given instant in time. For example, the prior prediction of the appropriate parts of the state variables can be corrected based on measurements at a current time point.
As discussed further herein, the impedance model forms a part of the overall or composite system model. During implementation, the impedance model is queried for use with predicted electrode locations in the patient reference frame as estimated by the catheter model. More specifically, the impedance model is used to predict measurements for each electrode location in the patient reference frame. Subsequently, these predictions are utilized with actual electrode measurements to further refine the estimated locations of the electrodes in the patient reference frame as well as update the impedance model. In an example, impedance models for use in determining impedance measurement or values for a location in a patient reference frame are described in U.S. Provisional Application No. 62/756,931 titled “Impedance Transformation Model for Estimating Catheter Locations”, filed on Nov. 7, 2018, the entire contents of which is incorporated herein by reference.
Respiration artifacts can contribute significantly to impedance measurement errors thereby increasing an error in location determinations for medical devices. In an embodiment, the present disclosure describes a respiration model accounting for impedance changes due to respiration/breathing. In an embodiment the respiration model describes catheter electrode impedance artifacts allowing for increasing the accuracy of impedance measurements and/or predictions thereby providing improved accuracy when determining a location of a medical device and/or its electrodes.
During a cardiac medical procedure, in vivo impedance measurement errors co-vary significantly due to respiration. That is, respiration induces a time-varying artifact relative to spatially-varying impedance measurements within a patient reference frame (e.g., on or within a patient chest). The time-varying artifact occurs during each respiration cycle due to changes in a volume of the chest of a patient increasing and decreasing. More specifically, the change in volume alters the physiological state of the patient and thereby alters impedance measurements of an impedance potential field within in the patient reference frame. Accordingly, it is desirable to monitor and account for such artifacts. Monitoring respiration induced artifacts is complicated by the fact that respiration varies between cycles. While respiration does move through a periodic phase-space, from the end of expiration through inspiration and back to expiration, respiration is not regularly periodic. Each breath is unique in amplitude and in duration with the time between breaths also varying. This is illustrated in
While each respiration/breath is unique, there are some relatively stable or constant respiration parameters, which may be used in modeling respiration as a quasiperiodic function. For instance, the Functional Residual Capacity (FRC), which is the volume of air present in the lungs at the end of passive expiration, is relatively constant for a given individual. In contrast, Tidal Volume (TV) is the lung volume representing the normal volume of air displaced between normal inhalation and exhalation. While FRC is relatively constant, TV (e.g., amplitude) varies more from breath to breath. The result is that the phase between end of expiration and the start of inhalation represents a relatively stable phase θs with each breath representing a perturbation from the stable phase.
To model the respiration-related artifact in impedance measurements, each electrode impedance measurement, zi, is modeled as the composition of a quasiperiodic function, g(θ), which is a temporally dependent function in an embodiment, and an aperiodic function, fi, which is a spatially dependent function in an embodiment. That is, fi, may represent an impedance measurement for a location within a patient reference frame and/or within an impedance field. The quasiperiodic function is dependent on the phase angle θ of the respiration cycle. That is, the quasiperiodic function is dependent on the location in the respiration cycle between the beginning of inhalation and the end of exhalation, which is denoted as the phase angle θ in present analysis. As there is a common respiratory process affecting all impedance measurements within the patient reference frame, it is assumed that a single phase angle, θ and amplitude, γ, governs all quasiperiodic functions at a time sample, k.
In an embodiment, the relationship between the impedance measurement and the quasiperiodic functions (e.g., measurement vector) may be written as:
Z
i+(j-1)*numElec(xk, θk, γk)=fij(xk)+γk gi (θk)
where the electrode impedance measurement Zi+j*numElec for the electrode at time k is a function of the an impedance for a location of the electrode given by the aperiodic function f(x), which may be provided by the impedance model discussed above, and the an artifact for that location determined by the quasiperiodic functions gj modified by the amplitude γ of the respiration cycle at time k and the location θ in the respiration cycle at time k. In an embodiment, the aperiodic function f(x) is a constant. While each quasiperiodic function is governed by the same phase angle, each function may lead or lag relative to the others. Each quasiperiodic function is similarly expected to have either a larger or smaller, positive or negative amplitude relative to the others.
For each driven patch pair, four patches are not driven and four additional quasiperiodic functions govern the non-driven patch pairs. By way of example, in the embodiment of
Z
6*numElec+j′(xk, θk, γk)=f′j′(xk)+γk g6+j′(θk)
As previously noted, respiration may be considered to have a relatively stable period θs when the phase angle is zero (e.g., between respirations). During this stable period, the quasiperiodic functions should have no influence on the measurement. Consequently, it is desired that the all quasiperiodic functions equal zero when the phase angle is zero. Accordingly, in an embodiment, each quasiperiodic function may be formulated as:
g
j(θk)=αj(1-cos(θk))+βjsin(θk)
where α and β represent weights to adjust the phase of each quasiperiodic function. In an embodiment, α and β are constants. In an embodiment, each quasiperiodic function and the governing phase angles and amplitudes vary according to a stochastic process, with some normally-distributed error from sample to sample. That is, phase and amplitude are hidden state variables that may be predicted from previous values and observable parameters (e.g., impedance measurements).
In an embodiment, it is presumed that once a respiratory cycle begins, it will advance at a relatively steady rate, ω, except when the phase is close to zero, defined by a stable phase angle, θs. When sufficiently close to zero, the phase angle is predicted to be stable, trending toward zero. The phase angle has a periodic domain, from π to −π. In an embodiment, the evolution of θ from a previous time step (e.g., k-1) to a current time step (e.g,. k) is advances at the steady rate, ω. That is, the model assumes a predictable advancement of θ between time steps. Though ω and each αj and βj are presented as constants, these parameters may also vary. That is, these parameters may form hidden state variables of a stochastic processes, albeit ones which change on a slower time scale.
As noted, phase angle and amplitude are hidden state variables that may be predicted from previous values and current measurements. In this regard, θk-1 and γk-1 may be known and utilized to predict current phases θk and amplitudes γk, for use in predicting electrode impedance measurements zi(xk, θk, γk) for location(s) (x) at time k. For example, in conjunction with a catheter model that predicts the location of an electrode(s) in the impedance field (e.g., patient reference frame) at location (x), an impedance model may predict an impedance value for the location and the respiration model may predict an artifact for that electrode. As a result, impedance measurements including respiratory artifact may be predicted for a model electrode location in the patent reference frame. Correspondingly, actual impedance measurements of a physical electrode (e.g., of a physical catheter) corresponding to the model electrode may be obtained/measured. For instance, the medical positioning system may obtain actual impedance measurements (e.g., with some amount of system noise) for a corresponding electrode of a physical catheter disposed within the patient reference frame. The predicted measurements and the actual measurements may be utilized to update the various models. That is, the predicted measurements and the actual measurements may be utilized to determine the true location of the physical electrode within the patient reference frame. In addition, the phases θ and amplitudes γ may be updated based on the predicted measurements and the actual measurements. As will be appreciated, the model permits estimating the phase and amplitude though these parameters are never directly observed. In this regard, the stochastic process infers the phase and amplitude and, through an iterative process, adjusts the respiration model to substantially align with the actual phase and amplitude of the respiration cycle.
In an embodiment, an Extended Kalman filter is used to infer the hidden state variables of the quasiperiodic functions. From the hidden state variables, at any time, hidden state measurements can be predicted and estimates of the state variables can be updated using an Extended Kalman filter framework in a fashion that allows updates to those parts of the hidden state variables that are accessible. Thus, at any instant in time, while there may not be enough information to determine parts of state variables, by using the Extended Kalman filter framework, predictions associated with appropriate parts of the state variables associated with the quasiperiodic functions can be made.
Differences between the predictions for the appropriate parts of the state variables associated with the quasiperiodic functions and actual measurements can be made and the appropriate parts of the state variables can be updated based on the differences between the predictions and the actual measurements. As such, the state variables can be modified over a given period of time, rather than at a given instant in time. For example, the prior prediction of the appropriate parts of the state variables can be corrected based on measurements at a current time point.
Collectively, the models fully describe the movement of the medical device in the absence of noise. Stated otherwise, the models describe possible states of the system and represent the individual state variables of the system. Generally, knowledge of the state variables at an initial time with at least partial knowledge of system inputs and/or outputs permits estimating current states and/or subsequent states of the system as points or a distribution in a state space (e.g., geometrical manifold). In such an arrangement, the state variables are disposed on the coordinate axes of the state space (e.g., and N-dimensional space). To abstract from the number of inputs, outputs and states, the state variables (e.g., models) are expressed as vectors, which are combined to form the state vector of the system. The state of the system can be represented as a distribution 100 of possible states within the state space (i.e., represented as points in the state space). See
The state vector describes the movement of the medical device in the absence of noise. However, actual measurements of the electrodes and magnetic sensors are noisy. That is, measurements of these parameters each include errors or noise of an unknown magnitude. The actual system is a stochastic process as are a number of the system components (e.g., individual models). To provide improved modeling and estimation of the system, noise should be included within the system model. Accordingly, the present disclosure provides an observational model defining the relationship between the state vector, noisy measurements and control vector (e.g., known inputs). This observational model utilizes new measurements (e.g., with some amount of noise) with the previous state of the system to estimate a new state(s) of the system.
One benefit of the disclosed system is that is provides for continuous updates or estimate of the system state at each time step. That is, the observational model provides continuous correction as opposed to a static correction factor. For instance, the disclosed system may predict and update states of the system approximately 100 times per second. Of further benefit, the observation model only requires information about the previous state of the system (e.g., at time k-1) and the current system measurements (e.g., at time k) to generate updates/estimates of the system state where the state estimates are provided by an estimator.
The overall stochastic process estimates new locations of the medical device and/or new locations of the electrodes of the medical device as well as estimates for various state variables of each of the models (e.g., impedance model, magnetic model, catheter model etc.). In an embodiment, the process assumes that the state of a system at time k evolved from a prior state at k-1 according to the equation:
x
k
=F
k(Xk-1)+Bk(uk)+wk
Measurements of the system, with error, are also performed at each time step according to the model:
z
k
=h
k(xk)+vk
vk is the vector containing the measurement noise terms for each measured variable in the measurement vector. In an embodiment, the process noise is assumed to be drawn from a multivariate distribution with covariance defined by a covariance matrix Rk.
The stochastic process is utilized to determine a true state of the system, which is a hidden or latent state. The purpose of the process is to generate estimates of the system state (e.g., electrode locations, hidden variables of the models, etc.) and determine the true state (e.g., more accurate state) from these estimates. In an embodiment, an estimator is implemented in an extended Kalman filter adapted for use with non-linear system models or linearized system models and/or with models having non-Gaussian noise distributions. However, it will be appreciated that variations may be implanted using other estimators such as the unscented Kalman filter, Markov Models and/or particle filters, which each may be applied to nonlinear systems and/or systems with non-Gaussian noise distributions.
Each estimate of the estimator is a mean (i.e., center of a distribution of state estimates) and covariance describing a probability about the mean. In application, the estimates include an a priori estimate (predict) prior to incorporating the measurements and an a posteriori estimate (update) after incorporating the measurements. The a priori estimate uses the state estimate from the previous time step to produce an estimate (e.g., prediction) of the latent state (mean xk|k-1 and covariance Pk|k-1) at the current time step:
x
k|k-1
=F
k
k|k-1
+B
kuk
P
k|k-1
=F
kPk|k-1+FkT+Qk
That is, the a priori estimate is an estimate from the transformation matrix that produces an estimated distribution and covariance from the prior state (i.e., k-1). The transformation matrix takes every point in the original distribution and moves it to a new predicted distribution, which may have an expanded covariance (e.g., the addition of Qk to the covariance matric P) to account for unknown system noise. In the a posteriori estimate, the current a priori prediction is combined with the observation model to refine the state estimate. More specifically, the observational model maps the estimation (e.g. mean xk|k-1 and covariance Pk|k-1) to the measurement domain to predict measurements:
z
k
=h
kxk|k-1
The predicted measurements zk may be compared with the actual measurements zk of observable parameters (e.g., electrode measurements and sensors measurements of the system):
y
k
=z
k-zk
This allows for determining the gain K of the system, where K minimizes the expected sum squared error between xk|k-xk. This is graphically illustrated in
x
k|k
=x
k|k-1
+k
kyk
P
k|k=(I-KkHk)Pk|k-1(I-KkHk)TKkRkKT.
The updated mean state may be utilized to determine updated or true locations (e.g., calculated locations) of the electrodes and/or magnetic sensors. Further, this state may be utilized to update the various state variables of the various models.
While the above noted process allows for predicting a current state of the system, it is further realized that the state vector and corresponding estimates of the state may be subject to various constraints. Such constraints may be utilized to limit or otherwise refine the state distributions and thereby improve the overall accuracy of the system. Given a state vector, x, a model constraint can be expressed in a functional form as g(x)=0. In this form, any true state must satisfy this equation. By way of example, impedance measurements are made by driving current across surface patch electrodes to excite an electrode. As previously noted, the electrode excitation process occurs rapidly and sequentially as different sets of patch electrodes are selected and one or more of the unexcited (in an embodiment) surface electrodes are used to measure voltages. During the delivery of the excitation signal (e.g., current pulse), the remaining (unexcited) patch electrodes may be referenced to the reference or belly patch while the voltages impressed on these remaining electrodes are measured. Potentials across each of the surface patch electrodes may be acquired for all samples except when a particular surface electrode patch pair is driven. In the two-dimensional representation shown in
Z
B-L
+Z
L-C
+Z
C-R
+Z
R-B=0
Correspondingly, the sum of driven potentials on any electrode from that cycle must be zero. Accordingly, this constraint may be applied to the portion(s) of the state vector that relates to impedance measurements (e.g., impedance model). Another constraint may be that the magnetic model may be constrained to changes that correspond to a rigid-body transformation without scaling. That is, all identified objects before and after transformation must have the same relative orientations. Other constraints may be applied to the composite model or the independent models. In application one or more such constraints may be applied to limit or otherwise refine the state distributions.
The constraint application may be approximated using a first-order Taylor series expansion which generates a linear representation or tangent line 102 about the mean of the unconstrained state distribution estimate 100. This produces a first-order approximation about the unconstrained mean of the state distribution estimate. This tangent line may be projected to the surface of the constraint. More specifically, this first-order approximation may be projected orthogonally to the null-space of the Jacobian of the constraint:
with the distribution projected into the null space of G. With successive projections through G, the estimated state distribution will track the constraint manifold even if the constraint is not exactly linear. The result is that the state distribution estimate is constrained to the constraint.
The parametrization of the system (e.g., within the system models) may describe possible system states that are not realizable nor well determined by the measurements of the system. Accordingly, the present disclosure may further include penalizing such unlikely states. More specifically, the present disclosure provides a means to regularize estimations such that more likely estimates/states are produced for the system. To regularize an estimated state distribution, a regularizing function may be defined which expresses a quantity proportional to the likelihood of a state. Generally, a likelihood function describes the plausibility of a state given an observation and is the product of a probability distribution function and a state distribution. In an embodiment, a negative log likelihood is utilized. In such an embodiment, impossible states have a negative log likelihood of infinity and the most likely state has the minimum negative log likelihood. To apply this regularization, in an embodiment, a probability density function (regularizing PDF) is computed by negating, exponentiating and normalizing the negative log function. The estimated state distribution is then multiplied by the regularizing PDF and renormalized to create a regularized state distribution that omits unlikely states (e.g., states outside the combination of the state distribution and the regularizing PDF).
In an embodiment, a general negative log likelihood function may be approximately applied through a second-order Taylor series expansion of the negative log likelihood function at the mean of the estimated state distribution to create a probability density function. In an embodiment, the approximation of the negative log likelihood function may be made via the following equation:
−ln r(x)≅−ln r(x′)−(x-x′)−1/2(x-x′)T(x-x′)
Where the Hessian of the second order expansion is treated as the inverse of the covariance, with the Gaussian mean given by the multiplication of the Jacobian of the second-order expansion by the inverse of the Hessian. This approximation is equivalent to a Gaussian PDF, which can be multiplied with the state distribution by well understood means.
The regularization of a state distribution estimate is graphically illustrated in
The main control 12 can be a combination of hardware and program instructions configured to perform a number of functions. The hardware, for example, can include one or more processing resources 160, computer readable medium (CRM) 162, etc. The program instructions (e.g., computer-readable instructions (CRI) 164) can include instructions stored on CRM 162 and executable by the processing resource 160 to implement a desired function (e.g., determine an updated location of an electrode on an impedance based medical device using the observation model, etc.). The CRI 164 can also be stored in remote memory managed by a server and represent an installation package that can be downloaded, installed, and executed. The main control 12 can include memory resources 166, and the processing resources 160 can be coupled to the memory resources 166.
Processing resources 160 can execute CRI 164 that can be stored on an internal or external non-transitory CRM 162. The processing resources 160 can execute CRI 164 to perform various functions, including the functions described above.
A number of modules 168, 170, 172, 174, 176 can be sub-modules or other modules. For example, the estimation module 172 and estimator module 174 can be sub-modules and/or contained within a single module. Furthermore, the number of modules 168, 170, 172, 174, 176 can comprise individual modules separate and distinct from one another.
A navigation module 168 can comprise CRI 164 and can be executed by the processing resource 160 to acquire measurements from a medical device 24 and render an output on a display 16. The measurements can include impedance measurement of an electrode 30 disposed on a catheter and/or impedance surface patch measurements. The measurements can also include magnetic locations of a magnetic position sensor 28 disposed on the catheter and/or magnetic measurements of a patient reference sensor 26. The navigation module 168 may call the location module 170 to obtain updated locations of electrodes and/or sensors of the medical device 24.
A locator module 170 can comprise CRI 164 and can be executed by the processing resource 160 to coordinate the operation of the estimation module 172, the model module 174 and the estimator module 176. In an example, the locator module can receive raw measurements from the navigator module in conjunction with an update request. The locator module 170 may call the estimation system module 172 to pre-process the raw measurements. Once the pre-processed measurements are acquired from the estimation module, the locator module 172 may provide the pre-processed measurements to the estimator 176 to with a request to update the current state of the system.
The estimation system module 172 can comprise CRI 164 and can be executed by the processing resource 160. In an embodiment, the estimation system module 172 defines the stochastic process of the overall system including the state transition(s) and the observational model(s). In an embodiment, the estimation system may be a Kalman system that that implements Kalman filtering techniques. In an embodiment, the estimation system module 172 calls the model module 174 to and estimator module 176 to obtain an updated state estimate.
A model module 174 can comprise CRI 164 and can be executed by the processing resource 160. The model module may include a plurality of individual models. These individual models may include one or more catheter models. In an embodiment, a medical device/catheter may be represented one or more models. Additionally, catheter models may include models of different medical devices for use when more than one catheter is within a patient reference frame. The individual models may also include a magnetic model (e.g., magnetic transformation model) that transforms locations from the patient reference frame of reference to the magnetic reference frame. The individual models may also include an impedance model or impedance transformation model that predicts impedances for locations in the patient reference frame.
An estimator module 176 can comprise CRI 164 and can be executed by the processing resource 160. The estimator module may receive update requests and inputs from the estimation system 172 and provide updated state estimates and/or predicted measurement in response. In an embodiment, the estimator module may be implemented as an extended Kalman filter.
At box 304 the flow diagram includes computing one or more state constraints to limit or otherwise refine the state distributions and thereby improve the overall accuracy of the system. Once such constraints are computed, the previous state may be projected to the constraints in box 306. Of note, this may include expanding the covariance matrix for the previous state to account for additional uncertainty or noise in the system for the upcoming prediction. Once this additional process noise is included in the previous state, the previous state may no longer be located on the constraint manifold. Accordingly, the previous state may be moved to the constraint manifold as discussed above.
Once the previous state is projected to the constraint(s), the next state of the system is predicted at box 308 of the flow diagram. That is, a new distribution (e.g., mean and covariance) of the state is generated using the state transition matrix Ft which applies the effect of each system state parameter at time k-1 to the system state at time k. That is, a current state is predicted. Once the new state distribution (e.g., mean and covariance) is generated one or more constraints may be computed for the current state at box 310. The current state may be projected to the constraints at box 312.
In an embodiment, unlikely states in the current state are penalized to reduce the distribution of the current state. In an embodiment, a negative log likelihood is computed at box 314 of the flow diagram. In an embodiment, a probability density function is generated. This function may be applied to the current state distribution. That is, the current state distribution may be regularized at box 316 of the flow diagram.
Predicted measurements may be generated at box 318 of the flow diagram. That is, the observational model may be utilized to predict measurements (e.g., electrode and sensor location measurements) given the current predicted state to produce a distribution of predicted measurements having a mean and covariance. Once the measurements are predicted, they may be compared with the actual measurements. A difference between the predicted measurements and actual measurements may be utilized to correct the current predicted state at box 320 of the flow diagram. Once the current state is corrected, outliers may, in an embodiment, be identified and removed from the current state at box 322 of the flow diagram. At this point a new state distribution is generated for the current update (e.g., time step). From the new or updated state distribution, electrode locations may be calculated at box 324 of the flow diagram. Further, all state variables of the various models may be calculated from the updated state distribution.
The estimator module 176 works with estimation system module 172, which describes the stochastic process of the system, to generate the updated state mean and state covariance for the previous time step. The estimator module 176 requests that the estimation system module 172 compute constraint(s) for the system (e.g., for the state vector) and the estimator system module 172 provides constraint(s) to the estimator module 176 in a request and a response loop 354. The estimator 176 the projects 356 the state (e.g., k-1) to the constraint(s). Once constrained, the estimator module 176 requests that the estimation system module 172 predict the next state of the system and the estimation system 172 returns a next state distribution estimate (e.g., mean and covariance) for the system to the estimator 176 in a request and response loop 358. The estimator module 176 and estimation system module 172 compute updated constraints for the next state distribution estimate (e.g., at time t) in a request and response loop 360. The estimator projects 362 the next state distribution estimate to the updated constraints. The estimator module 176 and estimation system module 172 compute a likelihood function for the state distribution estimate in a request and response loop 364. The estimator module 176 utilizes the likelihood function to produce 366 a regularized state distribution estimate.
The estimator module 176 and estimation system module 172 then predict measurements (e.g. electrode and sensor measurements) through application of the observation model, which maps the regularized state distribution estimate to the measurement space in a request and response loop 368. This loop 368 is further discussed in relation to
If the status of the updated state mean and state covariance is acceptable, the call graph continues on
As noted above, the estimator module 176 and estimation system module 172 predict measurements (e.g. electrode and sensor measurements) through application of the observation model, which maps the regularized state distribution estimate to the measurement space in a request and response loop 368 of
Confidence and Fault Detection
As noted in relation to
For each group of measurements (e.g. the 6 impedance interrogations (hereafter ‘impedance mods’) from an electrode, measurements from a sensor, each patch, all patch impedance data combined, all magnetic data combined, each single impedance mod, all impedance data combined, each single catheter) a reliability value indicates presence or absence of a plurality of measurement problems, such as disconnected or incorrectly connected electrodes, or measurements that cannot be explained by the state transition and observation models. When these measurement problems are detected, an indication of the fault may be displayed to the user and/or data collection from the corresponding medical device may be suppressed for some types of faults. Detection of some measurement problems excludes the corresponding measurements from the sensor fusion process. Generally, it is desirable to: 1) determine whether the corresponding estimated catheter locations are reliable; 2) detect measurement faults requiring user action to remedy and/or detect faulty measurements to be excluded from the sensor fusion algorithm; and/or 3) determine statistical outliers.
Reliability
In an embodiment, all location estimates may be marked as unreliable during a designated time interval, after the sensor fusion process is started. This unreliability period may be implement at the estimations of the magnetic transformation, impedance transformation, catheter shapes, and other state variables can take time to settle. Accordingly, all location estimates may be marked as unreliable during a designated time interval, such as 120 seconds, after the sensor fusion process is started. Location estimates on a catheter can also be marked as unreliable for a time after the catheter is introduced, while the catheter is inside a sheath, for a time after the catheter leaves a sheath, or when the catheter is disconnected.
In an embodiment, bounds may be put on various distance errors and/or mark the participating catheter feature locations as unreliable. In such an embodiment, the bounds may include determining: an error distance between the true and estimated location of a catheter feature; an error in distance between a catheter feature and an anatomic location, such as a nearby surface, nearby lesion, or nearby mapping point; and/or an error in distance between two separate catheter features, on the same or distinct catheters. For such distances, a tolerance is set. The tolerance may be set as a physical distance (e.g., 2 mm) or as a percentage of an estimated value (e.g., 10%). In application, the estimator produces a probability distribution over the state variables of the system. For example, a one dimensional state distribution (e.g., bell curve). For each possible state, locations of all catheter features can be computed. The system computes the probability that each distance of a catheter feature relative to the mean for the state variable exceeds its tolerance. If the probability exceeds a threshold (e.g., two standard deviations in a one dimensional distribution), then catheter feature locations participating in that distance are marked as unreliable.
In an embodiment, a numerical method to compute the probability of a distance exceeding its tolerance includes Monte Carlo sampling. In such an embodiment, states are sampled at random from the probability distribution of states. Distances are computed for each sample. The percentage of distances that that exceed their tolerance is determined. If more than a threshold percentage of the distances exceed the tolerance then the distance is considered unreliable.
In an embodiment, a numerical method to compute the probability of a distance exceeding its tolerance includes an analytic heuristic. In this embodiment, for a Gaussian state distribution, local linearization of catheter feature offsets from the estimate are computed. Each offset will then have a Jacobian. If the state distribution has mean x and covariance S, the distribution of the offset is well approximated by:
N(0,JSJT)
If the error is close to isotropic, then the square root of trace(JSJT) approximates the standard deviation of the squared distance error. When this value exceeds an upper bound then the distance is considered unreliable and therefore the participating location estimate(s) are considered unreliable.
Faulty Measurements
Several heuristic fault detection algorithms may be implemented to detect problems with impedance data. The following circumstances detect electrodes considered disconnected or physically faulty. If these circumstances are detected, the measurements are excluded from the estimator. In an embodiment, electrodes whose impedance values are larger than a threshold are considered disconnected or faulty. In another embodiment, electrodes having an impedance value that differs from the average of all electrodes, which are not considered faulty.
The following embodiments detect electrodes considered disconnected, physically faulty, or with interchanged connections. These measurements are excluded from the estimator. In an embodiment, electrodes whose location estimates according to the sensor fusion process differ by more than a threshold from their estimates according to an impedance-primary algorithm, are excluded. In another embodiment, a polyline is fit the electrode locations. If the polyline through a series of adjacent electrodes has a sharp angle at one of the electrodes, that electrode is considered a candidate for misconnection detection. Alternatively if the average bend angle exceeds a threshold, all electrodes on the catheter spline are considered candidates for misconnection detection. Then misconnection candidates that are not actually misconnected are removed from consideration as follows: if there is a single electrode that is flagged as potentially misconnected and no other electrodes have bad measurement status or were marked as disconnected, then that single electrode is removed. In an embodiment, an electrode is removed if the sensor fusion process estimate of the electrode location is closer to the impedance location of that electrode than to the impedance location of any other misconnection candidate.
Statistical Outliers.
The state estimator computes a probability distribution over all measurements. For each measurement group, a test statistic may be computed comparing the measurements to their expected distribution. In an embodiment having a generally Gaussian distribution computed by the estimator a Mahalanobis distance from the mean to the measurements may, in an embodiment, form the test statistic. The Mahalanobis distance is a measure of the distance between a point P and a mean of a distribution D containing the point. If the distance exceeds a predetermined threshold, then the measurement group is marked as a statistical outlier.
Embodiments are described herein of various apparatuses, systems, and/or methods. Numerous specific details are set forth to provide a thorough understanding of the overall structure, function, manufacture, and use of the embodiments as described in the specification and illustrated in the accompanying drawings. It will be understood by those skilled in the art, however, that the embodiments may be practiced without such specific details. In other instances, well-known operations, components, and elements have not been described in detail so as not to obscure the embodiments described in the specification. Those of ordinary skill in the art will understand that the embodiments described and illustrated herein are non-limiting examples, and thus it can be appreciated that the specific structural and functional details disclosed herein may be representative and do not necessarily limit the scope of the embodiments, the scope of which is defined solely by the appended claims.
Reference throughout the specification to “various embodiments,” “some embodiments,” “one embodiment,” or “an embodiment”, or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment(s) is included in at least one embodiment. Thus, appearances of the phrases “in various embodiments,” “in some embodiments,” “in one embodiment,” or “in an embodiment,” or the like, in places throughout the specification, are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Thus, the particular features, structures, or characteristics illustrated or described in connection with one embodiment may be combined, in whole or in part, with the features, structures, or characteristics of one or more other embodiments without limitation given that such combination is not illogical or non-functional.
It will be appreciated that the terms “proximal” and “distal” may be used throughout the specification with reference to a clinician manipulating one end of an instrument used to treat a patient. The term “proximal” refers to the portion of the instrument closest to the clinician and the term “distal” refers to the portion located furthest from the clinician. It will be further appreciated that for conciseness and clarity, spatial terms such as “vertical,” “horizontal,” “up,” and “down” may be used herein with respect to the illustrated embodiments. However, surgical instruments may be used in many orientations and positions, and these terms are not intended to be limiting and absolute.
Although at least one embodiment for estimating locations of electrodes based on a utilizing a system model has been described above with a certain degree of particularity, those skilled in the art could make numerous alterations to the disclosed embodiments without departing from the spirit or scope of this disclosure. All directional references (e.g., upper, lower, upward, downward, left, right, leftward, rightward, top, bottom, above, below, vertical, horizontal, clockwise, and counterclockwise) are only used for identification purposes to aid the reader's understanding of the present disclosure, and do not create limitations, particularly as to the position, orientation, or use of the devices. Joinder references (e.g., affixed, attached, coupled, connected, and the like) are to be construed broadly and can include intermediate members between a connection of elements and relative movement between elements. As such, joinder references do not necessarily infer that two elements are directly connected and in fixed relationship to each other. It is intended that all matter contained in the above description or shown in the accompanying drawings shall be interpreted as illustrative only and not limiting. Changes in detail or structure can be made without departing from the spirit of the disclosure as defined in the appended claims.
Any patent, publication, or other disclosure material, in whole or in part, that is said to be incorporated by reference herein is incorporated herein only to the extent that the incorporated materials does not conflict with existing definitions, statements, or other disclosure material set forth in this disclosure. As such, and to the extent necessary, the disclosure as explicitly set forth herein supersedes any conflicting material incorporated herein by reference. Any material, or portion thereof, that is said to be incorporated by reference herein, but which conflicts with existing definitions, statements, or other disclosure material set forth herein will only be incorporated to the extent that no conflict arises between that incorporated material and the existing disclosure material.
The present application claims the benefit of the filing dates of: U.S. Provisional Application No. 62/756,941 having a filing date of Nov. 7, 2018; U.S. Provisional Application No. 62/756,915 having a filing date of Nov. 7, 2018; U.S. Provisional Application No. 62/756,926 having a filing date of Nov. 7, 2018; U.S. Provisional Application No. 62/756,931 having a filing date of Nov. 7, 2018; and U.S. Provisional Application No. 62/756,936 having a filing date of Nov. 7, 2018 the entire contents of each of which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
62756941 | Nov 2018 | US | |
62756915 | Nov 2018 | US | |
62756926 | Nov 2018 | US | |
62756931 | Nov 2018 | US | |
62756935 | Nov 2018 | US |