Techniques for modifying tool operation in a surgical robotic system based on comparing actual and commanded states of the tool relative to a surgical site

Information

  • Patent Grant
  • 11850011
  • Patent Number
    11,850,011
  • Date Filed
    Wednesday, November 24, 2021
    2 years ago
  • Date Issued
    Tuesday, December 26, 2023
    4 months ago
Abstract
A robotic surgical system and method of operating the same. A manipulator supports a tool that has a TCP and manipulates a target bone. A navigation system has a localizer to monitor states of the manipulator and the target bone. Controller(s) determine commanded states of the TCP to move the tool along a cutting path relative to the target bone to remove material from the target bone. The controller(s) determine actual states of the TCP responsive to commanded movement of the tool along the cutting path, wherein each one of the commanded states of the TCP has a corresponding one of the actual states of the TCP for a given time step. The controller(s) compare the corresponding commanded and actual states of the TCP for one or more given time steps to determine a deviation and modify operation of the tool to account for the deviation.
Description
TECHNICAL FIELD

The disclosure relates generally to techniques for modifying tool operation based on comparing actual and commanded states of the tool relative to a surgical site.


BACKGROUND

Robotic systems are commonly used to perform surgical procedures and typically include a robot comprising a robotic arm and an end effector coupled to an end of the robotic arm. The robotic system commands the end effector along a cutting path for engaging a surgical site. Often, a supplemental tracking system, such as optical localization, is utilized to track positioning of the robot and the surgical site. Kinematic data from the robot may be aggregated with supplemental data from the tracking system to update positioning of the robot along the commanded cutting path. Such aggregation is used to provide redundancy for the critical task of positioning the end effector and to improve accuracy by accounting for kinematic errors such as residual kinematic calibration error and link deflection.


Tracking systems often track the robot and the anatomy at the surgical site at much higher frequencies than the closed loop bandwidth of the robot's response. Tracking systems can respond in near-real time, whereas the robot arm is limited by inertia and available power. Moreover, anatomy movement can be faster than the robot can respond. As a result, updating positioning of the robot based on data from the tracking system is a delayed process. This delay helps to avoid undesirable effects, such as positive feedback.


Failure to account for the lag necessary to prevent positive feedback, the near real-time actual positions of the end effector, and fast movements of the anatomy cause cutting inaccuracies at the surgical site. The issue is worsened when subsequent commanded cutting paths are generated based on previous commanded cutting paths, wherein neither the previous nor the subsequent commanded cutting path account for the near real-time, actual positions of the end effector, thereby causing regenerative cutting errors.


As such, there is a need in the art for systems and methods for addressing at least the aforementioned problems.


SUMMARY

According to a first aspect, a method is provided for operating a robotic surgical system, the robotic surgical system comprising a surgical tool including a tool center point (TCP) and the surgical tool being configured to manipulate a target bone, a manipulator comprising a plurality of links and being configured to support the surgical tool, a navigation system comprising a localizer configured to monitor states of the manipulator and the target bone, and one or more controllers coupled to the manipulator and the navigation system, and with the method comprising the one or more controllers performing the steps of: determining, using data from one or more of the manipulator and the navigation system, commanded states of the TCP for moving the surgical tool along a cutting path relative to the target bone for removing material from the target bone in preparation for an implant; determining, using the data from one or more of the manipulator and the navigation system, actual states of the TCP responsive to commanded movement of the surgical tool along the cutting path relative to the target bone, wherein each one of the commanded states of the TCP has a corresponding one of the actual states of the TCP for a given time step; comparing the corresponding commanded and actual states of the TCP for one or more given time steps for determining a deviation between the corresponding commanded and actual states; and based on an outcome of comparing the corresponding commanded and actual states of the TCP, modifying operation of the surgical tool to account for the deviation.


According to a second aspect, a robotic surgical system is provided that comprises: a surgical tool including a tool center point (TCP) and being configured to manipulate a target bone; a manipulator comprising a plurality of links and being configured to support the surgical tool; a navigation system comprising a localizer being configured to monitor states of the manipulator and the target bone; and one or more controllers coupled to the manipulator and the navigation system and being configured to: determine, using data from one or more of the manipulator and the navigation system, commanded states of the TCP to move the surgical tool along a cutting path relative to the target bone to remove material from the target bone in preparation for an implant; determine, using the data from one or more of the manipulator and the navigation system, actual states of the TCP responsive to commanded movement of the surgical tool along the cutting path relative to the target bone, wherein each one of the commanded states of the TCP has a corresponding one of the actual states of the TCP for a given time step; compare the corresponding commanded and actual states of the TCP for one or more given time steps to determine a deviation between the corresponding commanded and actual states; and based on an outcome of comparing the corresponding commanded and actual states of the TCP, modify operation of the surgical tool to account for the deviation.


The system and method determine near real-time, actual states of the surgical tool and/or tracker along the first path independent of the delay of the first filter. The system and method advantageously exploit raw or lightly (second) filtered raw kinematic measurement data and/or navigation data to modify operation of the surgical tool. Since the second filtered kinematic measurement data and/or navigation data is near instantaneous, the actual states of the surgical tool can be determined in near real time and faster than using the commanded (first filtered) states alone. The system and method acquire and utilize actual states of the surgical tool and/or tracker, which are faster than the delayed commanded states. Consequently, the actual and commanded states are compared to properly account for deviations. By doing so, the system and method increase path or cutting accuracy at the surgical site and reduce the possibility for regenerative cutting errors. The system and method may exhibit advantages other than those described herein.





BRIEF DESCRIPTION OF THE DRAWINGS

Advantages of the present invention will be readily appreciated as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings wherein:



FIG. 1 is a perspective view of a robotic surgical system for manipulating a target tissue of a patient with a tool, according to one embodiment.



FIG. 2 is a block diagram of a controller for controlling the robotic surgical system, according to one embodiment.



FIG. 3 is a perspective view illustrating transforms between components of a manipulator and components of a navigation system of the robotic surgical system, according to one embodiment.



FIG. 4 is a simplified block diagram of techniques, implemented by the controller, for filtering and fusing data from the manipulator and the navigation system, according to one embodiment.



FIG. 5 is a detailed block diagram of techniques, implemented by the controller, for filtering and fusing data from the manipulator and the navigation system, according to one embodiment.



FIG. 6 is a perspective view illustrating transforms between a localizer, patient tracker, and manipulator tracker of the navigation system, a tool center point of the tool, and a virtual mesh associated with the target tissue, according to one embodiment.



FIG. 7 is a diagram, according to one embodiment, illustrating sample movement of the tool along a first path for removing a portion target tissue wherein deviations between commanded and actual states of the tool are represented.



FIG. 8 is a diagram illustrating sample movement of the tool along a subsequent path for removing portions of the target tissue remaining from FIG. 7.



FIG. 9 is a diagram illustrating sample movement of the tool along a path of movement and immediate correction of the path based on recognition of present deviations between commanded and actual states.



FIG. 10 is a diagram illustrating sample movement of the tool along a path of movement and proactively correction of the path based on recognition of past deviations between commanded and actual states.





DETAILED DESCRIPTION

I. Overview


Referring to the Figures, wherein like numerals indicate like or corresponding parts throughout the several views, a robotic surgical system 10 (hereinafter “system”) and method for operating the system 10 are shown throughout.


As shown in FIG. 1, the system 10 is a robotic surgical system for treating an anatomy (surgical site) of a patient 12, such as bone or soft tissue. In FIG. 1, the patient 12 is undergoing a surgical procedure. The anatomy in FIG. 1 includes a femur (F) and a tibia (T) of the patient 12. The surgical procedure may involve tissue removal or treatment. Treatment may include cutting, coagulating, lesioning the tissue, treatment in place of tissue, or the like. In some embodiments, the surgical procedure involves partial or total knee or hip replacement surgery. In one embodiment, the system 10 is designed to cut away material to be replaced by surgical implants, such as hip and knee implants, including unicompartmental, bicompartmental, multicompartmental, or total knee implants. Some of these types of implants are shown in U.S. Patent Application Publication No. 2012/0330429, entitled, “Prosthetic Implant and Method of Implantation,” the disclosure of which is hereby incorporated by reference. Those skilled in the art appreciate that the system 10 and method disclosed herein may be used to perform other procedures, surgical or non-surgical, or may be used in industrial applications or other applications where robotic systems are utilized.


The system 10 includes a manipulator 14. The manipulator 14 has a base 16 and plurality of links 18. A manipulator cart 17 supports the manipulator 14 such that the manipulator 14 is fixed to the manipulator cart 17. The links 18 collectively form one or more arms of the manipulator 14. The manipulator 14 may have a serial arm configuration (as shown in FIG. 1) or a parallel arm configuration. In other embodiments, more than one manipulator 14 may be utilized in a multiple arm configuration. The manipulator 14 comprises a plurality of joints (J) and a plurality of joint encoders 19 located at the joints (J) for determining position data of the joints (J). For simplicity, only one joint encoder 19 is illustrated in FIG. 1, although it is to be appreciated that the other joint encoders 19 may be similarly illustrated. The manipulator 14 according to one embodiment has six joints (J1-J6) implementing at least six-degrees of freedom (DOF) for the manipulator 14. However, the manipulator 14 may have any number of degrees of freedom and may have any suitable number of joints (J) and redundant joints (J).


The base 16 of the manipulator 14 is generally a portion of the manipulator 14 that is stationary during usage thereby providing a fixed reference coordinate system (i.e., a virtual zero pose) for other components of the manipulator 14 or the system 10 in general. Generally, the origin of a manipulator coordinate system MNPL is defined at the fixed reference of the base 16. The base 16 may be defined with respect to any suitable portion of the manipulator 14, such as one or more of the links 18. Alternatively, or additionally, the base 16 may be defined with respect to the manipulator cart 17, such as where the manipulator 14 is physically attached to the cart 17. In a preferred embodiment, the base 16 is defined at an intersection of the axes of joints J1 and J2 (see FIG. 3). Thus, although joints J1 and J2 are moving components in reality, the intersection of the axes of joints J1 and J2 is nevertheless a virtual fixed reference point, which does not move in the manipulator coordinate system MNPL. The manipulator 14 and/or manipulator cart 17 house a manipulator computer 26, or other type of control unit.


A surgical tool 20 (hereinafter “tool”) couples to the manipulator 14 and is movable relative to the base 16 to interact with the anatomy in certain modes. The tool 20 is or forms part of an end effector 22 in certain modes. The tool 20 may be grasped by the operator. One exemplary arrangement of the manipulator 14 and the tool 20 is described in U.S. Pat. No. 9,119,655, entitled, “Surgical Manipulator Capable of Controlling a Surgical Instrument in Multiple Modes,” the disclosure of which is hereby incorporated by reference. The manipulator 14 and the tool 20 may be arranged in alternative configurations. The tool 20 can be like that shown in U.S. Patent Application Publication No. 2014/0276949, filed on Mar. 15, 2014, entitled, “End Effector of a Surgical Robotic Manipulator,” hereby incorporated by reference.


The tool 20 includes an energy applicator 24 designed to contact the tissue of the patient 12 at the surgical site. The energy applicator 24 may be a drill, a saw blade, a bur, an ultrasonic vibrating tip, or the like. The tool 20 comprises a TCP, which in one embodiment, is a predetermined reference point defined at the energy applicator 24. The TCP has known position in its own coordinate system. In one embodiment, the TCP is assumed to be located at the center of a spherical of the tool 20 such that only one point is tracked. The TCP may relate to a bur having a specified diameter. The TCP may be defined according to various manners depending on the configuration of the energy applicator 24.


Referring to FIG. 2, the system 10 includes a controller 30. The controller 30 includes software and/or hardware for controlling the manipulator 14. The controller 30 directs the motion of the manipulator 14 and controls a state (position and/or orientation) of the tool 20 with respect to a coordinate system. In one embodiment, the coordinate system is the manipulator coordinate system MNPL, as shown in FIG. 1. The manipulator coordinate system MNPL has an origin located at any suitable pose with respect to the manipulator 14. Axes of the manipulator coordinate system MNPL may be arbitrarily chosen as well. Generally, the origin of the manipulator coordinate system MNPL is defined at the fixed reference point of the base 16. One example of the manipulator coordinate system MNPL is described in U.S. Pat. No. 9,119,655, entitled, “Surgical Manipulator Capable of Controlling a Surgical Instrument in Multiple Modes,” the disclosure of which is hereby incorporated by reference.


As shown in FIG. 1, the system 10 further includes a navigation system 32. One example of the navigation system 32 is described in U.S. Pat. No. 9,008,757, filed on Sep. 24, 2013, entitled, “Navigation System Including Optical and Non-Optical Sensors,” hereby incorporated by reference. The navigation system 32 is configured to track movement of various objects. Such objects include, for example, the manipulator 14, the tool 20 and the anatomy, e.g., femur F and tibia T. The navigation system 32 tracks these objects to gather state information of each object with respect to a (navigation) localizer coordinate system LCLZ. Coordinates in the localizer coordinate system LCLZ may be transformed to the manipulator coordinate system MNPL, and/or vice-versa, using transformation techniques described herein.


The navigation system 32 includes a cart assembly 34 that houses a navigation computer 36, and/or other types of control units. A navigation interface is in operative communication with the navigation computer 36. The navigation interface includes one or more displays 38. The navigation system 32 is capable of displaying a graphical representation of the relative states of the tracked objects to the operator using the one or more displays 38. First and second input devices 40, 42 may be used to input information into the navigation computer 36 or otherwise to select/control certain aspects of the navigation computer 36. As shown in FIG. 1, such input devices 40, 42 include interactive touchscreen displays. However, the input devices 40, 42 may include any one or more of a keyboard, a mouse, a microphone (voice-activation), gesture control devices, and the like. The controller 30 may be implemented on any suitable device or devices in the system 10, including, but not limited to, the manipulator computer 26, the navigation computer 36, and any combination thereof.


The navigation system 32 also includes a navigation localizer 44 (hereinafter “localizer”) coupled to the navigation computer 36. In one embodiment, the localizer 44 is an optical localizer and includes a camera unit 46. The camera unit 46 has an outer casing 48 that houses one or more optical sensors 50.


The navigation system 32 includes one or more trackers. In one embodiment, the trackers include a pointer tracker PT, one or more manipulator trackers 52, a first patient tracker 54, and a second patient tracker 56. In the illustrated embodiment of FIG. 1, the manipulator tracker 52 is firmly attached to the tool 20 (i.e., tracker 52A), the first patient tracker 54 is firmly affixed to the femur F of the patient 12, and the second patient tracker 56 is firmly affixed to the tibia T of the patient 12. In this embodiment, the patient trackers 54, 56 are firmly affixed to sections of bone. The pointer tracker PT is firmly affixed to a pointer P used for registering the anatomy to the localizer coordinate system LCLZ. The manipulator tracker 52 may be affixed to any suitable component of the manipulator 14, in addition to, or other than the tool 20, such as the base 16 (i.e., tracker 52B), or any one or more links 18 of the manipulator 14. Those skilled in the art appreciate that the trackers 52, 54, 56, PT may be fixed to their respective components in any suitable manner.


Any one or more of the trackers may include active markers 58. The active markers 58 may include light emitting diodes (LEDs). Alternatively, the trackers 52, 54, 56 may have passive markers, such as reflectors, which reflect light emitted from the camera unit 46. Other suitable markers not specifically described herein may be utilized.


The localizer 44 tracks the trackers 52, 54, 56 to determine a state of each of the trackers 52, 54, 56, which correspond respectively to the state of the object respectively attached thereto. The localizer 44 provides the state of the trackers 52, 54, 56 to the navigation computer 36. In one embodiment, the navigation computer 36 determines and communicates the state the trackers 52, 54, 56 to the manipulator computer 26. As used herein, the state of an object includes, but is not limited to, data that defines the position and/or orientation of the tracked object or equivalents/derivatives of the position and/or orientation. For example, the state may be a pose of the object, and may include linear data, and/or angular velocity data, and the like.


Although one embodiment of the navigation system 32 is shown in the Figures, the navigation system 32 may have any other suitable configuration for tracking the manipulator 14 and the patient 12. In one embodiment, the navigation system 32 and/or localizer 44 are ultrasound-based. For example, the navigation system 32 may comprise an ultrasound imaging device coupled to the navigation computer 36. The ultrasound imaging device images any of the aforementioned objects, e.g., the manipulator 14 and the patient 12, and generates state signals to the controller 30 based on the ultrasound images. The ultrasound images may be 2-D, 3-D, or a combination of both. The navigation computer 36 may process the images in near real-time to determine states of the objects. The ultrasound imaging device may have any suitable configuration and may be different than the camera unit 46 as shown in FIG. 1.


In another embodiment, the navigation system 32 and/or localizer 44 are radio frequency (RF)-based. For example, the navigation system 32 may comprise an RF transceiver coupled to the navigation computer 36. The manipulator 14 and the patient 12 may comprise RF emitters or transponders attached thereto. The RF emitters or transponders may be passive or actively energized. The RF transceiver transmits an RF tracking signal and generates state signals to the controller 30 based on RF signals received from the RF emitters. The navigation computer 36 and/or the controller 30 may analyze the received RF signals to associate relative states thereto. The RF signals may be of any suitable frequency. The RF transceiver may be positioned at any suitable location to track the objects using RF signals effectively. Furthermore, the RF emitters or transponders may have any suitable structural configuration that may be much different than the trackers 52, 54, 56 as shown in FIG. 1.


In yet another embodiment, the navigation system 32 and/or localizer 44 are electromagnetically based. For example, the navigation system 32 may comprise an EM transceiver coupled to the navigation computer 36. The manipulator 14 and the patient 12 may comprise EM components attached thereto, such as any suitable magnetic tracker, electro-magnetic tracker, inductive tracker, or the like. The trackers may be passive or actively energized. The EM transceiver generates an EM field and generates state signals to the controller 30 based upon EM signals received from the trackers. The navigation computer 36 and/or the controller 30 may analyze the received EM signals to associate relative states thereto. Again, such navigation system 32 embodiments may have structural configurations that are different than the navigation system 32 configuration as shown throughout the Figures.


Those skilled in the art appreciate that the navigation system 32 and/or localizer 44 may have any other suitable components or structure not specifically recited herein. Furthermore, any of the techniques, methods, and/or components described above with respect to the camera-based navigation system 32 shown throughout the Figures may be implemented or provided for any of the other embodiments of the navigation system 32 described herein. For example, the navigation system 32 may utilize solely inertial tracking or any combination of tracking techniques.


As shown in FIG. 2, the controller 30 further includes software modules. The software modules may be part of a computer program or programs that operate on the manipulator computer 26, navigation computer 36, or a combination thereof, to process data to assist with control of the system 10. The software modules include instructions stored in memory on the manipulator computer 26, navigation computer 36, or a combination thereof, to be executed by one or more processors of the computers 26, 36. Additionally, software modules for prompting and/or communicating with the operator may form part of the program or programs and may include instructions stored in memory on the manipulator computer 26, navigation computer 36, or a combination thereof. The operator interacts with the first and second input devices 40, 42 and the one or more displays 38 to communicate with the software modules. The user interface software may run on a separate device from the manipulator computer 26 and navigation computer 36.


The controller 30 includes a manipulator controller 60 for processing data to direct motion of the manipulator 14. In one embodiment, as shown in FIG. 1, the manipulator controller is implemented on the manipulator computer 26. The manipulator controller 60 may receive and process data from a single source or multiple sources. The controller 30 further includes a navigation controller 62 for communicating the state data relating to the femur F, tibia T, and manipulator 14 to the manipulator controller 60. The manipulator controller 60 receives and processes the state data provided by the navigation controller 62 to direct movement of the manipulator 14. In one embodiment, as shown in FIG. 1, the navigation controller 62 is implemented on the navigation computer 36. The manipulator controller 60 or navigation controller 62 may also communicate states of the patient 12 and manipulator 14 to the operator by displaying an image of the femur F and/or tibia T and the manipulator 14 on the one or more displays 38. The manipulator computer 26 or navigation computer 36 may also command display of instructions or request information using the display 38 to interact with the operator and for directing the manipulator 14.


As shown in FIG. 2, the controller 30 includes a boundary generator 66. The boundary generator 66 is a software module that may be implemented on the manipulator controller 60. Alternatively, the boundary generator 66 may be implemented on other components, such as the navigation controller 62. The boundary generator 66 generates virtual boundaries 55 for constraining the tool 20, as shown in FIG. 3. Such virtual boundaries 55 may also be referred to as virtual meshes, virtual constraints, or the like. The virtual boundaries 55 may be defined with respect to a 3-D bone model registered to the one or more patient trackers 54, 56 such that the virtual boundaries 55 are fixed relative to the bone model. The state of the tool 20 is tracked relative to the virtual boundaries 55. In one embodiment, the state of the TCP is measured relative to the virtual boundaries 55 for purposes of determining when and where haptic feedback force is applied to the manipulator 14, or more specifically, the tool 20.


A tool path generator 68 is another software module run by the controller 30, and more specifically, the manipulator controller 60. The tool path generator 68 generates a path 100 for the tool 20 to traverse, such as for removing sections of the anatomy to receive an implant. One exemplary system and method for generating the tool path 100 is explained in U.S. Pat. No. 9,119,655, entitled, “Surgical Manipulator Capable of Controlling a Surgical Instrument in Multiple Modes,” the disclosure of which is hereby incorporated by reference. In some embodiments, the virtual boundaries 55 and/or tool paths 100 may be generated offline rather than on the manipulator computer 26 or navigation computer 36. Thereafter, the virtual boundaries 55 and/or tool paths 100 may be utilized at runtime by the manipulator controller 60. Yet another software module in FIG. 2 is a state comparison module 96, the details of which are described below.


II. Data Fusion and Filtering for Determining Commanded States of the Tool Relative to the Surgical Site


As described above, the manipulator 14 and the navigation system 32 operate with respect to different coordinate systems, i.e., the manipulator coordinate system MNPL and the localizer coordinate system LCLZ, respectively. As such, in some embodiments, the controller 30 fuses data from the manipulator 14 and the navigation system 32 for controlling the manipulator 14 using the navigation system 32. To do so, the controller 30 utilizes data fusion techniques as described herein.


In general, the controller 30 acquires raw data of various transforms between components of the system 10. As used herein, the term “raw” is used to describe data representing an actual or true state of one or more components of the system 10 (e.g., base 16, tool 20, localizer 44, trackers 52, 54, 56) relative to at least another component(s) of the system 10, whereby the raw data is obtained near instantaneously (in near real time) from its respective source such that the raw data is unfiltered. The raw data is an unaltered or minimally processed measurement.


As used herein, the term “filtered” is used to describe raw data that is filtered according to a filter length and that represents a filtered state of one or more components of the system 10 relative to at least another component(s) of the system 10. The filtered data is delayed with respect to the near instantaneously obtained raw data due to application of the filter length in the filter. As will be described below, the raw data is ultimately filtered to control the manipulator 14. Additional details related to filtering are described below.


Each tracked component has its own coordinate system separate from the manipulator coordinate system MNPL and localizer coordinate system LCLZ. The state of each component is defined by its own coordinate system with respect to MNPL and/or LCLZ. Each of these coordinate systems has an origin that may be identified as a point relative to the origin of the manipulator coordinate system MNPL and/or the localizer coordinate system LCLZ. A vector defines the position of the origin of each of these coordinate systems relative to another one of the other coordinate systems. The location of a coordinate system is thus understood to be the location of the origin of the coordinate system. Each of these coordinate systems also has an orientation that, more often than not, is different from the coordinate systems of the other components. The orientation of a coordinate system may be considered as the relationship of the X, Y and Z-axes of the coordinate system relative to the corresponding axes of another coordinate system, such as MNPL and/or LCLZ.


Referring to FIGS. 3 and 6, the state of one component of the system 10 relative to the state of another component is represented as a transform (shown in the figures using arrows). In one embodiment, each transform is specified as a transformation matrix, such as a 4×4 homogenous transformation matrix. The transformation matrix, for example, includes three unit vectors representing orientation, specifying the axes (X, Y, Z) from the first coordinate system expressed in coordinates of the second coordinate system (forming a rotation matrix), and one vector (position vector) representing position using the origin from the first coordinate system expressed in coordinates of the second coordinate system.


The transform, when calculated, gives the state (position and/or orientation) of the component from the first coordinate system given with respect to a second coordinate system. The controller 30 calculates/obtains and combines a plurality of transforms e.g., from the various components of the system 10 to control the manipulator 14, as described below.


As shown in FIG. 3, the transforms include the following: transform (B2T) between the base 16 and the tool 20, transform (MT2T) between the manipulator tracker 52 and the tool 20, transform (L2MT′) between the localizer 44 and the manipulator tracker 52 on the tool 20, transform (L2MT″) between the localizer 44 and the manipulator tracker 52 at the base 16, transform (L2PT) between the localizer 44 and one or more of the patient trackers 54, 56, transform (MT2TCP) between the manipulator tracker 52 and the TCP, and transform (T2TCP) between the tool 20 and the TCP.


Referring to FIG. 6, additional transforms include transform (PT2TCP) between the one or more patient trackers 54, 56 and the TCP, transform (TCP2MESH) between the TCP and the virtual boundary 55, and transform (PT2MESH) between the one or more patient trackers 54, 56 and the virtual boundary 55.


One exemplary system and method for obtaining the transforms of the various components of the system is explained in U.S. Pat. No. 9,119,655, entitled, “Surgical Manipulator Capable of Controlling a Surgical Instrument in Multiple Modes,” the disclosure of which is hereby incorporated by reference.


The output (e.g., values) of the transforms are regarded as raw data when obtained instantaneously (in near real time) and when unfiltered. Such raw data may be understood as being derived from a near transform, i.e., a near instantaneous determination of the state of one component of the system 10 relative to the state of another component. On the other hand, the output values of such transforms are regarded as filtered data when the values are filtered, such as for reasons described below.


The transforms are now described in detail. The controller 30 acquires raw kinematic measurement data relating to a state of the tool 20. The state of the tool 20 may be determined relative to the manipulator coordinate system MNPL. In some instances, the raw kinematic measurement data may relate to the state of the tool 20 relative to the base 16. The raw kinematic measurement data may be obtained from the manipulator controller 60. Specifically, as shown in FIG. 3, the controller 30 is configured to acquire the raw kinematic measurement data by acquiring one or more values of transform (B2T) between a state of the base 16 and the state of the tool 20. Here, the raw kinematic measurement data may be obtained from kinematic data of the manipulator 14. In particular, the controller 30 may acquire one or more values of the first transform (B2T) by applying a forward kinematic calculation to values acquired from the joint encoders 19. Thus, the state of the tool 20 can be determined relative to the manipulator coordinate system MNPL without intervention from the navigation system 32. In other words, the first transform (B2T) may be obtained irrespective of any measurements from the navigation system 32.


In FIG. 3, transform (B2T) is indicated by an arrow having an origin at the base 16 and extending to and having an arrowhead pointing to the tool 20. In one exemplary convention used throughout FIG. 3, the arrowhead points to the component having its state derived or specified relative to the component at the origin. Transform (B2T) may be determined using any suitable reference frames (coordinate systems) on the base 16 and the tool 20.


The controller 30 may further acquire known relationship data relating to the state of the manipulator tracker 52 relative to the tool 20. In general, the known relationship data may be derived from any known relationship between the manipulator tracker 52 and the tool 20. In other words, the manipulator tracker 52 and the tool 20 have a relationship that is known or calculatable using any suitable method. The manipulator tracker 52 and the tool 20 may be fixed or moving relative to each other. For example, the manipulator tracker 52 may be attached directly to the tool 20, as shown in FIG. 3. Alternatively, the manipulator tracker 52 may be attached to one of the links 18, which move relative to the tool 20. In general, the manipulator tracker 52 and the tool 20 are tracked by different techniques, i.e., by navigation data and kinematic measurement data, respectively. The known relationship data assists to bridge the kinematic measurement data and the navigation data by aligning the manipulator tracker 52 and the tool 20 to a common coordinate system.


The known relationship data may be fixed (constant or static) or variable. In embodiments where the known relationship data is fixed, the known relationship data may be derived from calibration information relating to the manipulator tracker 52 and/or the tool 20. For example, the calibration information may be obtained at a manufacturing/assembly stage, e.g., using coordinate measuring machine (CMM) measurements, etc. The known relationship data may be obtained using any suitable method, such as reading the known relationship data from a computer-readable medium, an RFID tag, a barcode scanner, or the like. The known relationship data may be imported into system 10 at any suitable moment such that the known relationship data is readily accessible by the controller 30. In embodiments where the known relationship data is variable, the known relationship data may be measured or computed using any ancillary measurement system or components, such as additional sensors, trackers, encoders, or the like. The known relationship data may also be acquired after mounting the manipulator tracker 52 to the tool 20 in preparation for a procedure by using any suitable technique or calibration method.


Whether static or variable, the known relationship data may or may not be regarded as raw data, as described herein, depending on the desired technique for obtaining the same. In one embodiment, the controller 30 may acquire the known relationship data by acquiring one or more values of transform (MT2T) between the state of the manipulator tracker 52A and the state of the tool 20. Transform (MT2T) may be determined with respect to any suitable coordinate system or frame on the manipulator tracker 52 and the tool 20.


In other embodiments, the controller 30 may determine transform (MT2T) using any one or more of kinematic measurement data from the manipulator 14 and navigation data from the navigation system 32 such that known relationship data is not utilized. For example, transform (MT2T) may be calculated using one or more of raw kinematic measurement data relating to the state of the tool 20 relative to the manipulator coordinate system MNPL from the manipulator 14 and raw navigation data relating to the state of the tracker 52 relative to the localizer 44 from the navigation system 32. For example, the tool 20 may be rotated about its wrist to create a circular or spherical fit of the tool 20 relative to the manipulator tracker 52.


In some embodiments, it may be desirable to determine the state of the TCP relative to the manipulator coordinate system MNPL and/or localizer coordinate system LCLZ. For example, the controller 30 may further acquire known relationship data relating to the state of the tool 20 relative to the TCP by acquiring one or more values of transform (T2TCP), as shown in FIG. 3. Additionally, or alternatively, the controller 30 may acquire known relationship data relating to the state of the manipulator tracker 52A relative to the TCP by acquiring one or more values of transform (MT2TCP), as shown in FIG. 3. Transforms (T2TCP) and (MT2TCP) may be acquired using any of the aforementioned techniques described with respect to transform (MT2T). Transforms (T2TCP) and (MT2TCP) may be utilized to determine commanded states 98 of the TCP relative to the surgical site, as well as actual states 108 of the same, as described in the subsequent section.


The controller 30 is further configured to acquire, from the navigation system 32, raw navigation data relating to the state of the manipulator tracker 52 relative to the localizer 44. The controller 30 may do so by acquiring one or more values of transform (L2MT′) between the manipulator tracker 52A on the tool 20 and the localizer 44 and/or transform (L2MT″) between the manipulator tracker 52B at the base 16 and the localizer 44. Transforms (L2MT′ or L2MT″) can be calculated using navigation data alone, irrespective of kinematic measurement data from the manipulator 14.


The transform (L2PT) between the localizer 44 and one or more of the patient trackers 54, 56 may be determined by the controller 30 by similar techniques and assumptions as described above with respect to transforms (L2MT′ or L2MT″). Specifically, the localizer 44 is configured to monitor the state of one or more of the patient trackers 54, 56 and the controller 30 is configured to acquire, from the navigation system 32, raw navigation data relating to the state of the one or more of the patient trackers 54, 56 relative to the localizer 44.


Referring to FIG. 6, transform (PT2MESH) may be calculated between one or more of the patient trackers 54, 56 and the virtual boundary 55 associated with the anatomy of the patient 12 using registration techniques involving the navigation system 32 and the pointer (P). In one embodiment, the pointer (P) is tracked by the navigation system 32 via the pointer tracker (PT) and is touched to various points on a surface of the anatomy. The navigation system 32, knowing the state of the pointer (P), registers the state of the anatomy with respect to one or more of the patient trackers 54, 56. Alternatively, (PT2MESH) may be broken up into additional (intermediate) transforms that are combined to result in (PT2MESH). For example, transform (IMAGE2MESH) may correspond to implant placement (e.g., from surgical planning) relative to a pre-op image, acquired using techniques such as CT, MRI, etc., and transform (PT2IMAGE) may correspond to location of the one or more patient trackers 54, 56 relative to that same pre-op image (e.g., from registration). These intermediate transforms may be combined to obtain transform (PT2MESH). One exemplary system and method for registering the anatomy is explained in U.S. Pat. No. 9,119,655, entitled, “Surgical Manipulator Capable of Controlling a Surgical Instrument in Multiple Modes,” the disclosure of which is hereby incorporated by reference.


In FIG. 6, two additional transforms are shown which relate to the TCP. Specifically, these transforms include transform (PT2TCP) between the one or more patient trackers 54, 56 and the TCP and transform (TCP2MESH) between the TCP and the virtual boundary 55. As will be described below, these transforms are utilized to determine actual and commanded states 98 of the tool 20 relative to the surgical site. Transforms (PT2TCP) and (TCP2MESH) may be determined using navigation data alone, or navigation data in combination with kinematic measurement data. Those skilled in the art appreciate that given the various components of the system 10, other transforms other than those described above may be utilized in the techniques described herein.


With the transforms identified, one simplified embodiment of the data fusion and filtering techniques is illustrated in FIG. 4. As shown, the controller 30 acquires the raw kinematic measurement data, which in this embodiment, relates to kinematically derived states of the manipulator 14. In one example, the raw kinematic measurement data may relate to the state of the tool 20 relative to the base 16 or manipulator coordinate system MNPL, i.e., (B2T)) Additionally or alternatively, the raw kinematic measurement data may relate to a state of one or more of the links 18 relative to the base 16, a state of the tool 20 relative to one or more of the links 18, a state of one or more of the joints (J1-J6) relative to the base 16, a state of the tool 20 relative to one or more of the joints (J1-J6), a state of the TCP relative to any of the aforementioned components, or the like. The controller 30 may acquire this raw kinematic measurement data using forward kinematic calculations, and by using any suitable transform depending on which components of the manipulator 14 have states that are being tracked.


The controller 30 is also configured to acquire, from the navigation system 32, raw navigation data. The raw navigation data may relate to the state of the manipulator tracker 52 relative to the localizer 44 (L2MT′, L2MT″) and/or data relating to the state of the one or more patient trackers 54, 56 relative to the localizer 44 (L2PT).


In FIG. 4, the raw kinematic measurement data and raw navigation data (i.e., raw data) is passed to a first filter 86. The first filter 86 applies a first filter length, to produce first filtered kinematic measurement data and first filtered navigation data, respectively. The first filtered measurement and navigation data are utilized to determine commanded states 98 of the tool 20 while commanding the tool 20 to move relative to the surgical site, e.g., along a tool path 100.


The first filter 86 is a digital temporal filter that filters the raw data. This filtering may occur in the time-domain. Filtering may be understood as performing a type of averaging over a time history of data. Filtering does not affect the update or measurement rate but rather the frequency of content of the output signal (e.g., how quickly or smoothly the output changes), yet still providing a new output for each sample. In general, the greater the filter length for the filter, the greater the filter latency (delay) and averaging. In other words, a greater filter length provides more time to take into account (or average) determinations of the raw data over time. Thus, the greater the filter length, the smoother the raw data is over time. As will be described below, this first filtered data is involved in the calculation of constraints and downstream control commands, ultimately used to control the manipulator 14. The first filter 86 may consequently result in spatial filtering by ultimately causing the manipulator 14 to lag (as compared with the second filtered data, described below) in the spatial domain.


The first filter 86 may be one or more of various types of filters. In one embodiment, the first filter 86 may be understood as averaging inputted data, or averaging a time history of data. For example, the first filter 86 may be an infinite impulse response (IIR) filter, a finite impulse response filter (FIR), a “boxcar” filter, or the like. In addition, the filter order and length or filter length maybe chosen to meet requirements of the application. Generally, the filtering described herein applies to low pass-type filtering, however, other filter-types, such as band pass, high pass, or notch filtering may be utilized. The filter length takes into account the time history of the filter. Examples of a filter length include a “time constant” for IIR filters, number of taps or coefficients (i.e., memory depth) for a FIR (finite impulse response) filter, or any parameter of a filter relating to the amount of depth of data that is processed or averaged. In addition, the filter order and length maybe chosen to meet requirements of the application. Generally, the filtering described herein applies to low pass-type filtering, however, other filter-types, such as band pass, high pass, or notch filtering may be utilized.


The filter length of the first filter 86 may be expressed as a unit of time. For example, the filter length may be represented in milliseconds (ms) or seconds (s). In one embodiment, the first filter length is greater than or equal to 100 ms and less than or equal to 1000 ms. For example, the first filter length may be 1000 ms. In this example, for any given time step, the filtered relationship is based on the raw relationship determinations averaged over the previous 1000 ms relative to the given time step.


Filtering by the first filter 86 is performed on the raw data for two primary purposes, i.e., reducing noise and increasing system stability. If it were possible, using the raw data alone to control the system 10 is would be preferred since doing so would give the fastest and most accurate response. However, filtering is needed because of practical limitations on the system 10. Such practical limitations include noise reduction and stability improvements by removal of positive feedback. The localizer 44 is capable of operating at a much higher bandwidth as compared to the manipulator 14. That is, the localizer 44 tracks poses of the trackers 52, 54, 56 faster than the manipulator 14 can respond. Controlling off the raw data alone causes instability of system 10 because the manipulator 14 must react to commanded movements including those arising from random signal variation (i.e., noise), which are provided at the rate of the localizer 44. For example, the manipulator 14 would have to respond to every variation in the raw data. Commanded movement occurring at a rate higher than the manipulator 14 can respond results in heat, audible noise, mechanical wear, and potentially resonance, which can cause system instability. Because the localization data feedback represents an outer positioning loop, it is important not to close this outer loop at a higher bandwidth than the manipulator 14 can respond, to avoid instability.


Filtering with the first filter 86 reduces the bandwidth of the outer positioning loop thereby accommodating the bandwidth limitations of the inner positioning loop of the manipulator 14. Through such filtering, noise is reduced and stability is improved by removal or reduction in positive feedback. The manipulator 14 is prevented from reacting to every minor change in the raw data. Otherwise, if the manipulator 14 had react to noisy data, the manipulator 14 may be susceptible to spatial overshoot of tool 20 along the tool path 100 (such as when turning corners). Such spatial overshoot may cause the tool 20 to overcut the anatomy contrary to best design practices of favoring undercutting rather than overcutting. Instead, filtering of the raw data causes the manipulator 14 to behave more smoothly and run more efficiently. Further, noise may be introduced into the system 10 through measurement error in the sensors (e.g., encoders, localization feedback data, etc.). Filtering limits overall noise to a threshold tolerable by the system 10.



FIG. 5 is a block diagram illustrating, in part, aspects of the data fusion techniques implemented by the controller 30 and as described herein. In this section, only those portions of FIG. 5 relating to generating commanded states 98 of the tool 20 relative to the surgical site are described. As shown, the transforms (L2MT, L2PT) are provided from navigation data, transform (B2T) is provided from kinematic measurement data, and transforms (T2TCP, MT2T) are provided from known relationship data, as described above. As shown, transforms (B2T) and (T2TCP) may be combined from kinematic measurement data and known relationship data to form transform (BT2TCP) between the base 16 and the TCP. Similarly, transforms (MT2T) and (T2TCP) may be combined from known relationship data to form transform (MT2TCP) between the manipulator tracker 52 and the TCP.


The controller 30 combines any combination of these transforms from different sources at data fusion block 82. The controller 30 may apply any suitable matrix multiplier at data fusion block 82. The output of the data fusion block 82 is transform (B2PT) between the base 16 and one or more of the patient trackers 54, 56. However, transform (B2PT) is filtered by the first filter 86, and hence is identified in FIG. 5 using the abbreviation “filt” representing a filtered version of this transform. Filtered transform (B2PT) may be understood as representing first filtered states of the one or more patient trackers 54, 56 relative to the base 16. The first filter 86 is shown within the data fusion block 82 in FIG. 5. However, the first filter 86 may be applied at the output of the data fusion block 82 instead. Filtered transform (B2PT), which is based on pose data, is primarily or entirely a spatial relationship. However, the sequences of such pose data may also signify one or more relationships that are derived from spatial parameters, such as relationships with respect to velocity and/or acceleration of the respective components of the transform.


In one embodiment, transform (B2PT) is formed by combining transforms (B2T), (MT2T), (L2MT′; localizer 44 to tool tracker 52A) and (L2PT). Transforms (MT2T) and (L2MT′) may be inverted to enable proper combination these transforms. In another embodiment, transform (B2PT) is formed by combining transforms (L2MT″; localizer 44 to base tracker 52B) and (L2PT). Those skilled in the art appreciate that transform (B2PT) may be formed using any other suitable combination of transforms from kinematic measurement, navigation, and/or known relationship data.


The one or more patient trackers 54, 56 are assumed to move during operation of the system 10. Movement of the patient trackers 54, 56 may result from movement of a table on which the patient 12 rests, movement of the patient 12 generally, and/or local movement of the anatomy subject to the procedure. Movement may also occur from anatomy holder dynamics, cut forces affecting movement of the anatomy, and/or physical force applied to the anatomy by an external source, i.e., another person, or a collision with an object. As such, it is desirable to provide the first filter 86 or a different filter to transform (L2PT) to enable the manipulator 14 to track/respond to motion within practical limits needed for stability. Such filtering is utilized for many of the same reasons described above with respect to the first filter 86, i.e., signal noise reduction and increasing system stability.


As shown in FIG. 5, the controller 30 combines filtered transform (B2PT) and the filtered version of transform (PT2TCP) to produce filtered transform (B2TCP) between the base 16 and the TCP. The controller 30 produces this transform by utilizing matrix multiplier at block 92. The controller 30 utilizes filtered transform (B2TCP) for controlling the manipulator 14 using inverse kinematic calculations wherein the path generator 69 generates the tool path 100 based on the filtered transform (B2TCP) and such that the boundary generator 66 assesses the filtered transform (B2TCP) with respect to the virtual boundaries 55. Mainly, filtered transform (B2PT) may be combined with filtered transform (B2TCP) to produce filtered transform (PT2TCP) between the one or more patient trackers 54, 56 and the TCP. As shown in FIG. 5, filtered transform (PT2TCP) may be combined with transform (PT2MESH) from registration and pre-planning to produce filtered transform (TCP2MESH). Ultimately, filtered transform (TCP2MESH) represents command states of the tool 20, and more specifically the TCP, relative to the surgical site.


III. Techniques for Determining Actual States of the Tool Relative to the Surgical Site and Comparing Actual States to Commanded States


In the embodiments of the techniques described above, the raw kinematic measurement and/or raw navigation data are filtered individually, or in combination, for determining commanded states 98 of the tool 20. Notably, the raw kinematic measurement and raw navigation data remain available prior to being filtered in FIG. 4. This raw data is exploited for techniques for modifying operation of the tool 20, as described in detail below.


In FIG. 4, the raw data remain available and are duplicated or accessed and passed to the branch including the second filter 94, leaving the first filtered measurement and/or navigation data in tact for control purposes downstream. The second filter 94 applies a second filter length that is shorter than the first filter length, to produce raw or second filtered kinematic measurement data and raw or second filtered navigation data, respectively. The raw or second filtered measurement and navigation data are utilized to determine actual states 108 of the tool 20 relative to the surgical site. The state comparison module 96 compares the actual states 108 and commanded states 98. The second filtered data is produced specifically for comparison to the first filtered data to determine how to modify operation of the tool 20 based on the outcome of the comparison.


Utilizing the raw kinematic measurement and navigation data before filtering by the first filter 86 enables the controller 30 to record to memory a log of actual states 108 of the tool 20. The controller 30 is configured to determine actual states 108 of the tool 20 while commanding the tool 20 to move relative to the surgical site, e.g., along the tool path 100. As will be described below, the actual states 108 are determined using one or more of second filtered (or unfiltered) kinematic measurement data and second filtered (or unfiltered) navigation data. For any given time step during movement of the tool 20, each commanded state 98 has a corresponding actual state 108. As described above, the first filter 86 generally has a longer filter length to accommodate stability requirements of the outer position loop. Thus, these actual states 108 are in contrast to the commanded states 98, which are otherwise delayed by filtering by the longer filter length of the first filter 84. Accordingly, the term ‘actual’ as used herein is not intended to be limited solely to instantaneous states of the tool 108. Said differently, the raw kinematic measurement data and/or raw navigation data is lightly filtered relative to the filtering of the first filtered measurement and/or navigation data. The actual states 108 may be purely instantaneous (unfiltered) or more instantaneous (less filtered) than the commanded states 98.


In one embodiment, the controller 30 is configured to utilize the raw kinematic measurement and/or navigation data (instead of the second filtered measurement and/or navigation data), e.g., from any one or more of the transforms, to determine the actual states 108. The raw kinematic measurement and/or navigation data, in this embodiment, are filtered by the second filter 94 having a filter length of zero. If filtered by the filter length of zero, the raw kinematic measurement and/or navigation data “passes through” the second filter 94, as shown in FIGS. 4 and 5.


The raw data are filtered by the second filter 94 to remove high frequency noise or high frequency jitter from the raw signal. The amount of filtering (filter length) applied by the second filter 94 may be chosen such that it is long enough to remove the aforementioned high frequency noise/jitter in the raw signal, but short enough to represent the near real time states of the tool 20 to the extent practical. When filtered, it is generally understood that the filter length is greater than zero. In one example, the filter length of the second filter 94 is greater than 0 ms and less than or equal to 50 ms, as compared to, for example, the filter length of 1000 ms for the first filter 86. The second filter 94 may have any configuration and may be any type of filter as those described above with respect to the first filter 86.


The controller 30 is configured to filter any of the raw data with the second filter 94 (e.g., from any one or more of the transforms of FIGS. 3 and 6) to arrive at the actual states 108. However, in one specific embodiment, as shown in FIG. 5, the actual states 108 are derived using the following technique. Any suitable combination of the transforms of FIG. 5 are combined in the data fusion block 82. Another output of the data fusion block 82 is transform (B2PT) between the base 16 and one or more of the patient trackers 54, 56. However, transform (B2PT) is raw, and hence is identified in FIG. 5 using “raw” representing a raw version of this transform. Raw transform (B2PT) may be understood as representing raw states of the one or more patient trackers 54, 56 relative to the base 16. The raw transform (B2PT) then passes to the second filter 94, which applies the shorter filter length of 0 (pass-through) or for example, between 0-50 ms (i.e., lightly filtered). Assuming the filter length is greater than 0, a near real time (i.e., “nrt”) transform (B2PT) is produced.


As shown in FIG. 5, the controller 30 combines near real time transform (B2PT) and a near real time version of transform (BT2TCP), which is extracted from the transforms before input into the data fusion block 82. The combination of these transforms produces a near real time transform (PT2TCP) between the one or more patient trackers 54, 56 and the TCP. The controller 30 produces near real time transform (PT2TCP) by utilizing matrix multiplier at block 97. Near real time transform (PT2TCP) may be combined with transform (PT2MESH) from registration and pre-planning to produce near real time transform (TCP2MESH). Ultimately, near real time transform (TCP2MESH) represents actual states 108 of the tool 20, and more specifically the TCP, relative to the surgical site.


Those skilled in the art appreciate that various other combinations of transforms, other than those described herein may be utilized to determine actual states 108 of the tool 20, and/or TCP relative to the surgical site, and that such various combinations may depend on any factors, such as the location of the object being tracked, the desired coordinate system, or the like.


As described in the previous section, filtered transform (PT2TCP) is produced and represents commanded states 98 of the tool 20, and more specifically the TCP, relative to the surgical site. The values from the near real time and filtered transform (TCP2MESH) are inputted into the comparison module 96. The state comparison module 96 determines deviations 110 between the commanded states 98 and the actual states 108. Consequently, the commanded states 98 are compared to the actual states 108 to properly account for actual states that may be different than commanded states of the tool 20 or TCP. For example, as described in the next section, the controller 30 determines tool path 100 or feed rate updates/modifications for the tool 20 based on an outcome of this comparison.


The deviations 110 may be represented with respect to any components of the pose of the tool 20. In one sense, the deviations 110 may be understood by a difference (subtraction) between the commanded and actual states 98, 108. These deviations 110 can be identified by the state comparison module 96, which compares the underlying data respectively corresponding to the commanded and actual states 98, 108.


Deviations 110 between the commanded and actual states 98, 108 may not always occur. For example, there may be situations where the state of the tool 20 or TCP is constant, enabling temporary alignment between the commanded and actual states 98, 108. However, more likely than not, such deviations 110 occur because of sudden or abrupt changes in movement of the tool 20 or TCP. In general, the more abrupt the change in movement of the tool 20 or TCP for any given time step, the greater the deviation 110 will be between the commanded and actual states 98, 108. Of course, the commanded and actual states 98, 108 may have any relationship with respect to each other and may deviate according to any manner depending on factors such as the type of data being compared (e.g., measurement or navigation data) and the respective filter lengths of the first filter 86 and the second filter 94, and the like.


Comparison between the commanded and actual states 98, 108 over time may be executed according to various implementations. In one example, the deviations 110 are converted into respective positional and angular components. The state comparison module 96 may perform this conversion to analyze each of the components individually.


In some embodiments, the deviations 110, or components thereof, may be taken “as-is” such that the state comparison module 96 accounts for an entirety of such deviations 110. Alternatively, the controller 30 is configured to compare the deviations 110 to one or more predetermined thresholds. For example, the positional and angular components of the deviations 110 are compared to one or more thresholds. If the deviation 110 exceeds the threshold, the deviation 110 is accounted for by the controller 30 for purposes of modifying operation of the tool 20.


In some instances, it may be undesirable to account for an entirety of the deviation 110 for any one or more of the positional and angular components. For example, the sensitivity of the threshold should be set such that only noticeable and/or meaningful deviations 110 exceed the threshold. In one example, the threshold should be greater than zero such that minor or negligible deviations 110 are disregarded. The threshold for the positional and/or angular components may be chosen based on cutting guidelines for the system 10. For example, the threshold may be set according to a predetermined distance or range (e.g., 1 mm) such that there is some safety margin to prevent over cutting of the target tissue, but sensitive enough to detect meaningful deviations 110 between the commanded 98 and actual states 108. The threshold may be an upper threshold or a lower threshold and may have any suitable limit, minimum, maximum, range, standard deviation from profile, or other configuration.


The state comparison module 96 may be implemented by the manipulator controller 60, as shown in FIG. 2. The state comparison module 96 may comprise any suitable computer-executable instructions, algorithms, and/or logic for comparing the raw/second filtered data to the first filtered data.


IV. Techniques for Modifying Tool Operation Based on Comparing Actual and Commanded States of the Surgical Tool Relative to the Surgical Site


Based on an outcome or result of comparing commanded and actual states 98, 108 relative to the surgical site, the controller 30 dynamically modifies operation of the tool 20 relative to the surgical site. Such modification of tool 20 operation may be performed according to various techniques, but generally are focused on modifying the path of movement and/or the feed rate of the tool 20.


Although the tool 20 is subject to many of the techniques described herein, and it should be understood that because the TCP derived from the tool 20, the TCP similarly may be subject of these techniques, even when not explicitly stated.


Generally, the commanded states 98 are utilized to move the tool 20 relative to the surgical site. As shown in FIGS. 7-10, for example, such movement of the tool 20 may be along a commanded first path 100C.


To implement such modification, in one embodiment, the controller 30 determines a subsequent (follow-up) path 100′ for the tool 20 to account for the deviations 110 between the commanded and actual states 98, 108. That is, the controller 30 provides a subsequent correction of the first path 100.



FIG. 7 is a diagram illustrating one example of the commanded and actual states 98, 108 of the tool 20 along the first path 100 with respect to time. In this example, the first path 100 is a cutting path for manipulating a target tissue at the surgical site. The tool 20 is commanded to move along the first path 100 for removing a first section of the target tissue. As shown, the tool 20 is commanded to move along the commanded first path 100C according to the commanded states 98. The commanded first path 100C is defined by a combination of all commanded states 98 with respect to time. However, because the commanded states 98 are derived from first filtered data, the tool 20 does not completely follow the commanded first path 100C. Instead, the tool 20 follows the actual states 108 as shown in FIG. 7, which are determined based on raw or second filtered data. In doing so, the tool 20 slightly deviates from the commanded first path 100C and follows an actual first path 100A, which is defined by a combination of all actual states 108 with respect to time. Here, the deviations 110 between the commanded and actual states 98, 108 over time are represented in FIG. 7 by a variable gap between the commanded and actual first paths 100C, 100A.


In FIG. 7, it has been demonstrated that the tool 20 follows the actual first path 100A instead of the commanded first path 100C. As a result, the tool 20 removes the first section of the target tissue as defined by the actual first path 100A rather than by the commanded first path 100C. If the system 10 proceeded on the basis that the tool 20 followed the commanded first path 100C alone, then the system 10 may falsely assume that the tool 20 removed the first section of tissue as commanded and as desired. However, FIG. 7 demonstrates that this is not the case. Specifically, certain peaks or uncut portions of the first section may remain because of the deviations 110. For simplicity, these peaks or uncut portions left over from the first section are referred to as the second section, which are illustrated in FIG. 8. In this specific example, the commanded first path 100C alone may be suitable for removing a “bulk” portion of the target tissue. However, in this example, the commanded first path 100C alone may be inadequate for “fine” removal of the residual target tissue.


As such, as shown in FIG. 8, the controller 30 generates the second path 100′ as a follow-up path to account for the deviations 110 between the commanded and actual states 98, 108. In other words, the second path 100′ is designed for more accurately or “finely” removing the target tissue, and more specifically, the second section left behind after commanding the tool 20 to move along the commanded first path 100C.


In one example, the second path 100′ may be generated similarly to the first path 100 in that the controller 30 may determine (second) commanded states 98′ for moving the tool 20 along a second commanded path 100C′. As such, any of the details described above with respect to generating of the first path 100 may apply to the second path 100′. However, even if commanded, the commanded second path 100C′ is different than the commanded first path 100C in that the commanded second path 100C′ accounts for the deviations 110 between the commanded and actual states 98, 108, whereas the commanded first path 100C does not. For this reason, the commanded second path 100C′ in FIG. 8 follows a different route than the commanded first path 100C in FIG. 7.


The second path 100′ may also be generated when the TCP is tracked to determine the deviations 110. In this example, a solid body model of the tissue, which is removed based on data from the actual states 108, may be utilized to determine what needs to be removed in second path 100′. The diameter of the TCP may be taken into account to determine what was actually removed from the surgical site. In one embodiment, if there are any deviations 110 between the commanded and actual states 98, 108 of the TCP, but the commanded and actual states 98, 108 overlap in a way that the TCP removes all the tissue from its actual states 108, such deviations 110 from the commanded states 98 may be disregarded to increase efficiency of the second path 100′ and to avoid cutting when the tissue has already been removed.


The techniques described above for comparing the commanded and actual states 98, 108 from the first path 100 may be similarly applied to the commanded and actual states 98′, 108′ from the second path 100′ to generate yet another path, e.g., a third path. Through this iterative process, any number of paths may be generated, thereby gradually removing the target tissue until a suitable state of the target tissue is achieved. In one example, this iterative process may be understood in that each currently generated path is designed to remove target tissue according to a level of accuracy that is greater than a preceding generated path. Said differently, the deviations 110 between commanded and actual states 98, 108 for any current path should have magnitudes being less than the deviations 110 between commanded and actual states 98, 108 for the preceding path.


Hence, in this “follow-up” or “clean-up” path embodiment, the error, i.e., the deviations between the commanded and actual bone surfaces (derived from transform between near real time capture of TCP path and commanded TCP path) are detected and under-cut errors (predominant) are corrected with the subsequent tool path 100′ pass or passes until the residual error is within a pre-determined tolerance.


Although the technique of this embodiment has specific benefits, there may be drawbacks. For example, it will be apparent to the user that deviations 110 are occurring and corrections of such deviations 100 take time. Further, since most deviations 110 are likely to occur in corners or over disparate places on the cut surface, there is wasted time as the tool 20 “air cuts” from undercut area to undercut area. Additionally, if the second path 100′ is not performed until the end of machining, early undercut errors may be amplified due to “regenerative cutting error” since undercut areas will impose greater tool forces than in non-undercut areas, thereby causing a greater undercut on the next pass, i.e., positive feedback. The next embodiment addresses some of these setbacks.


In another embodiment as shown in FIG. 9, the controller 30, based on the outcome of comparing the commanded and actual states 98, 108, immediately modifies operation of the tool 20 along the path 100 to account for the deviations 110. This may be done, for example, by immediately altering the path 100. Alternatively, or additionally, the controller 30 may immediately alter a feed rate of the tool 20, as described below.


In the example of FIG. 9, a single tool path 100 is shown and as compared with FIG. 8, there is no subsequent tool path 100′. Here, the tool 20 follows the commanded path 100C, and actual states 108 of the tool 20 deviate from the commanded states 108 near a corner thereby causing deviations 110, which produce an undercut. Upon immediately recognizing these deviations 110, the controller 30 generates an updated commanded tool path 100C′ with updated commanded states 98′. This immediate updating occurs at a point in time represented by a dot on the commanded tool path 100C. The updated commanded tool path 100C′ loops back around with a localized clean up pass, thereby minimizing deviations 110′. In FIG. 9, the updated commanded tool path 100C′ may continue along the originally commanded path 100C or any other suitable updated commanded tool path 100C′.


Using such “immediate” correction, the undercut is corrected before the remainder of the tool path 100 is executed. Due to the need for the first filter 86 to prevent positive feedback in the machining control loops, actions to address the undercut deviations 110 must occur, at a minimum, after the filter length of the first filter 86. One exception to this is to slow down the feed rate of the tool 20 along the tool path 100, which may be done in near real time (within the acceleration limits of the manipulator 14). As soon as the undercut deviation 110 is recognized, the commanded speed can be reduced. This action alone will often largely mitigate undercut deviation 110 because such errors are often caused by increases in machining force due to bone density increases or movement of the bone away from the tool 20. Any undercut occurring during the transient will be minimized When the deviation 110 falls below a tolerance threshold, the initial undercut error is then corrected with the localized cleanup pass, thereby removing the potential for regenerative cutting error development.


One method of addressing the initial undercut deviation 110 is to reverse the direction of feed and iteratively traverse a location of the undercut deviation 110 until the undercut is removed. This may be done with or without the aforementioned immediate feed rate slowdown, such as when the undercut deviation 110 is reduced below the tolerance threshold. That is, the undercut is sensed, but not acted upon until after the situation causing the undercut has ended. For example, large actuator accelerations commanded when turning a sharp corner at a high feed rate may not be achievable by the system 10, resulting in an undercut. Upon stabilizing on a subsequent low radius or straight area, the system 10 would sense that undercutting has stopped. The direction of feed would then reverse to go back along the tool path 100 to address the undercut, most likely at a lower feed rate. Feed rate may be ramped down and/or the re-transited path iterated until the undercut deviation 110 is reduced to the tolerance threshold.


In a situation where the tool path 100 is creating a pocket several times greater than the TCP diameter, a more sophisticated method of addressing the undercut deviation 110 would be to circle back to the undercut location using a circle having a radius, which the system 10 can follow with low error given its feed rate. In some instances, however, the circular/helical path milling may only be used to address undercut deviation 110, and then the original tool path 100 would be resumed until the next undercut deviation 110 is sensed.


In a third embodiment, as shown in FIG. 10, the controller 30, based on the outcome of comparing the commanded and actual states 98, 108, proactively modifies operation of the tool 20 along the path 100 to account for the deviations 110. This may be done, for example, by proactively altering the path 100. Alternatively, or additionally, the controller 30 may proactively alter the feed rate of the tool 20, as described below.


Once again, in the example of FIG. 10, a single tool path 100 is shown and as compared with FIG. 8, there is no subsequent tool path 100′. Here, the tool 20 follows the commanded path 100C, and actual states 108 of the tool 20 deviate from the commanded states 108 near a first corner thereby causing deviations 110, which produce the undercut. Upon immediately recognizing these deviations 110, the controller 30 proactively generates the commanded tool path 100C′. This proactive updating occurs at a point in time represented by the present location of the TCP in FIG. 10. The proactively generated and updated commanded tool path 100C′ is configured to minimize deviations 110′ at a second corner (as compared to the deviations 110 from the first corner). Thus, the controller 30, in a sense, predicts future undercuts and modifies operation of the tool 20 accordingly. In FIG. 10, the proactively updated commanded tool path 100C′ may continue along the originally commanded path 100C or any other suitable updated commanded tool path 100C′.


In proactive correction, the system 10 learns from the prior undercut deviations 110 and adjusts the feed rate and/or tool path accordingly before similar deviations 110 can occur, thereby avoiding the need for subsequent correction. Due to the high variation in bone density, the preferred implementation of proactive correction is reduction in feed rate. Tool path corrections would need to be approached conservatively to avoid potential overcorrection or overcut “correction” error.


In this embodiment, the threshold value to proactively correct deviations 110 may be variable. For example, the threshold value may be dependent on whether the machining is a roughing pass or finishing pass. Alternatively, or additionally, the threshold value may be dependent on the function and criticality of the feature being machined. For example, lower undercut errors would likely be tolerable in the middle ⅔rds of a surface intended for a press fit interface. This is since undercuts in this region would result in rocking of the implant, which could lead to poor fixation and/or alignment. Larger undercuts would be allowable in the outer portion since bone is not strictly rigid and, within localized areas, highpoints can compress and adapt to the implant upon impaction.


The controller 30 may use any of the above described techniques individually, or in combination to modify operation of the tool 20 to account for deviations 110 between the commanded and actual states 20.


Additionally, it may be desirable to associate any of the aforementioned first and second paths 100, 100′ to certain modes of operation for the system 10. For example, the system 10 may enable the manipulator 14 to interact with the site using manual and semi-autonomous modes of operation. An example of the semi-autonomous mode is described in U.S. Pat. No. 9,119,655, entitled, “Surgical Manipulator Capable of Controlling a Surgical Instrument in Multiple Modes,” the disclosure of which is hereby incorporated by reference. In the semi-autonomous mode, the manipulator 14 directs movement of the tool 20 and, in turn, the energy applicator 24 at the surgical site. In one embodiment, the controller 30 models the tool 20 and/or energy applicator 24 as a virtual rigid body and determines forces and torques to apply to the virtual rigid body to advance and constrain the tool 20 and/or energy applicator 24 along any of the first and second paths 100, 100′ in the semi-autonomous mode. Movement of the tool 20 in the semi-autonomous mode is constrained in relation to the virtual constraints generated by the boundary generator 66 and/or path generator 69.


In the semi-autonomous mode, the manipulator 14 is capable of moving the tool 20 free of operator assistance. Free of operator assistance may mean that an operator does not physically contact the tool 20 to apply force to move the tool 20. Instead, the operator may use some form of control to remotely manage starting and stopping of movement. For example, the operator may hold down a button of a remote control to start movement of the tool 20 and release the button to stop movement of the tool 20. Alternatively, the operator may press a button to start movement of the tool 20 and press a button to stop movement of the tool 20.


Alternatively, the system 10 may be operated in the manual mode. Here, in one embodiment, the operator manually directs, and the manipulator 14 controls, movement of the tool 20 and, in turn, the energy applicator 24 at the surgical site. The operator physically contacts the tool 20 to cause movement of the tool 20. The manipulator 14 monitors the forces and torques placed on the tool 20 by the operator in order to position the tool 20. A sensor that is part of the manipulator 14, such as a force-torque transducer, measures these forces and torques. In response to the applied forces and torques, the manipulator 14 mechanically moves the tool 20 in a manner that emulates the movement that would have occurred based on the forces and torques applied by the operator. Movement of the tool 20 in the manual mode is also constrained in relation to the virtual constraints generated by the boundary generator 66 and/or path generator 69.


For the “subsequent path” technique of FIGS. 7 and 8, the controller 30, in one example, commands movement of the tool 20 along the first path 100 according to the manual mode and commands movement of the tool 20 along the second path 100′ according to the semi-autonomous mode. For example, it may be desirable to use the manual mode to control the tool 20 along the first path 100 for rough or bulk manipulation of the target tissue. In other words, the desire may be to quickly, but less accurately, remove large sections of the target tissue in the manual mode. Such bulk manipulation may result in relatively large deviations 110 between the commanded and actual states 98, 108. Accordingly, the semi-autonomous mode may be utilized to account for deviations 110 resulting from manual manipulation by commanding the tool 20 along the second path 100′. This scenario provides an automated and highly accurate follow-up or clean-up after manual manipulation.


For the “subsequent path” technique, the controller 30 may alternatively command movement of the tool 20 along both the first and second paths 100, 100′ according to the semi-autonomous mode. For example, it may be desirable to use the semi-autonomous mode to control the tool 20 along the first path 100 for rough or bulk manipulation of the target tissue. In other words, the desire may be to quickly, but less accurately remove large sections of the target tissue. In one example, rough-cut paths may be designed for the most efficient bulk removal of material given the capability and workspace stability of the manipulator 14, without particular regard for accuracy. Thereafter, the semi-autonomous mode may again be utilized to account for deviations 110 from the first iteration of semi-autonomous manipulation by commanding the tool 20 along the second path 100′. Using the semi-autonomous mode in this fashion provides an iterative process for removing the target tissue, as described above. That is, any number of follow-up paths may be generated, thereby gradually removing the target tissue and gradually reducing the deviations 110 between commanded and actual states 98, 108 until a suitable state or threshold for the target tissue is achieved.


In other embodiments of this technique, the controller 30 is configured to command movement of the tool 20 along both the first and second paths 100, 100′ according to the manual mode, in accordance with the techniques described above. Those skilled in the art appreciate that the controller 30 may command movement of the tool 20 along the first and second paths 100, 100′ according to any other modes of operation and for other reasons not specifically recited herein


For any of the embodiments shown in FIGS. 7-10, the system 10 may enable switching between the manual mode and the semi-autonomous mode at any time, and for any tool path. In one embodiment, such switching occurs in response to manual input. For example, the operator may use any suitable form of control to manage, e.g., remotely, which mode should be active. Alternatively, switching may be implemented autonomously in response to certain events or conditions. For example, the controller 30 may determine that the requisite amount of tissue has been removed in the manual mode and switch to the semi-autonomous mode in response. The controller 30 may further enable switching for the second tool path 100′, to immediately correct the original tool path 100 or in anticipation of proactive correction of the original tool path 100. Furthermore, switching may occur based on analysis of the deviations 110 with respect to the threshold tolerance. Those skilled in the art appreciate that switching between manual and semi-autonomous modes may be performed according to other methods not explicitly described herein.


Several embodiments have been described in the foregoing description. However, the embodiments discussed herein are not intended to be exhaustive or limit the invention to any particular form. The terminology, which has been used, is intended to be in the nature of words of description rather than of limitation. Many modifications and variations are possible in light of the above teachings and the invention may be practiced otherwise than as specifically described.


The many features and advantages of the invention are apparent from the detailed specification, and thus, it is intended by the appended claims to cover all such features and advantages of the invention which fall within the true spirit and scope of the invention. Further, since numerous modifications and variations will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation illustrated and described, and accordingly, all suitable modifications and equivalents may be resorted to, falling within the scope of the invention.

Claims
  • 1. A method of operating a robotic surgical system, the robotic surgical system comprising a surgical tool including a tool center point (TCP) and the surgical tool being configured to manipulate a target bone, a manipulator comprising a plurality of links and being configured to support the surgical tool, a navigation system comprising a localizer configured to monitor states of the manipulator and the target bone, and one or more controllers coupled to the manipulator and the navigation system, and with the method comprising the one or more controllers performing the steps of: determining, using data from one or more of the manipulator and the navigation system, commanded states of the TCP for moving the surgical tool along a cutting path relative to the target bone for removing material from the target bone in preparation for an implant;determining, using the data from one or more of the manipulator and the navigation system, actual states of the TCP responsive to commanded movement of the surgical tool along the cutting path relative to the target bone, wherein each one of the commanded states of the TCP has a corresponding one of the actual states of the TCP for a given time step;comparing the corresponding commanded and actual states of the TCP for one or more given time steps for determining a deviation between the corresponding commanded and actual states; and based on an outcome of comparing the corresponding commanded and actual states of the TCP, modifying operation of the surgical tool to account for the deviation.
  • 2. The method of claim 1, wherein modifying operation of the surgical tool comprises the one or more controllers modifying the cutting path to account for the deviation.
  • 3. The method of claim 2, further comprising the one or more controllers: predicting a future deviation between the future corresponding commanded and actual states based on past or present deviation; andproactively modifying the cutting path to account for the predicted future deviation.
  • 4. The method of claim 1, wherein modifying operation of the surgical tool comprises the one or more controllers modifying a feed rate of the surgical tool along the cutting path to account for the deviation.
  • 5. The method of claim 4, further comprising the one or more controllers: predicting a future deviation between the future corresponding commanded and actual states based on a past or present deviation; andproactively modifying the feed rate of the surgical tool along the cutting path to account for the predicted future deviation.
  • 6. The method of claim 1, wherein modifying of the surgical tool comprises the one or more controllers determining a new cutting path for the surgical tool to account for the deviation.
  • 7. The method of claim 1, further comprising the one or more controllers: obtaining the data from one or more of the manipulator and the navigation system, wherein the data is filtered according to a first filter length; anddetermining, using the first filtered data, the commanded states of the TCP for moving the surgical tool along the cutting path relative to the target bone for removing material from the target bone in preparation for the implant.
  • 8. The method of claim 7, further comprising the one or more controllers: obtaining the data from one or more of the manipulator and the navigation system, wherein the data is unfiltered or filtered according to a second filter length being shorter than the first filter length; anddetermining, using the unfiltered or second filtered data, the actual states of the TCP while commanding movement of the surgical tool along the cutting path relative to the target bone.
  • 9. The method of claim 1, further comprising the one or more controllers: generating a virtual boundary associated with the target bone, wherein the virtual boundary is for providing a constraint on the surgical tool;determining the commanded states of the TCP for moving the surgical tool along the cutting path relative to virtual boundary associated with the target bone;determining the actual states of the TCP while commanding movement of the surgical tool along the cutting path relative to the virtual boundary associated with the target bone; andcomparing the corresponding commanded and actual states of the TCP for one or more given time steps for determining the deviation between the corresponding commanded and actual states relative to the virtual boundary associated with the target bone.
  • 10. A robotic surgical system comprising: a surgical tool including a tool center point (TCP) and being configured to manipulate a target bone;a manipulator comprising a plurality of links and being configured to support the surgical tool;
  • 11. The robotic surgical system of claim 10, wherein the one or more controllers modify operation of the surgical tool by further being configured to modify the cutting path to account for the deviation.
  • 12. The robotic surgical system of claim 11, wherein the one or more controllers are further configured to: predict a future deviation between the future corresponding commanded and actual states based on a past or present deviation; andproactively modify the cutting path to account for the predicted future deviation.
  • 13. The robotic surgical system of claim 10, wherein the one or more controllers modify operation of the surgical tool by further being configured to modify a feed rate of the surgical tool along the cutting path to account for the deviation.
  • 14. The robotic surgical system of claim 13, wherein the one or more controllers are further configured to: predict a future deviation between the future corresponding commanded and actual states based on a past or present deviation; andproactively modify the feed rate of the surgical tool along the cutting path to account for the predicted future deviation.
  • 15. The robotic surgical system of claim 10, wherein the one or more controllers modify operation of the surgical tool by further being configured to determine a new cutting path for the surgical tool to account for the deviation.
  • 16. The robotic surgical system of claim 10, wherein the one or more controllers are further configured to: obtain the data from one or more of the manipulator and the navigation system, wherein the data is filtered according to a first filter length; anddetermine, using the first filtered data, the commanded states of the TCP to move the surgical tool along the cutting path relative to the target bone to remove material from the target bone in preparation for the implant.
  • 17. The robotic surgical system of claim 16, wherein the one or more controllers are further configured to: obtain the data from one or more of the manipulator and the navigation system, wherein the data is unfiltered or filtered according to a second filter length being shorter than the first filter length; anddetermine, using the unfiltered or second filtered data, the actual states of the TCP responsive to commanded movement of the surgical tool along the cutting path relative to the target bone.
  • 18. The robotic surgical system of claim 10, wherein the one or more controllers are further configured to: generate a virtual boundary associated with the target bone, wherein the virtual boundary is configured to provide a constraint on the surgical tool;determine the commanded states of the TCP to move the surgical tool along the cutting path relative to the virtual boundary associated with the target bone;determine the actual states of the TCP responsive to commanded movement of the surgical tool along the cutting path relative to the virtual boundary associated with the target bone; andcompare the corresponding commanded and actual states of the TCP for one or more given time steps to determine the deviation between the corresponding commanded and actual states relative to the virtual boundary associated with the target bone.
CROSS-REFERENCE TO RELATED APPLICATIONS

The subject application is a continuation of U.S. Nonprovisional patent application Ser. No. 15/840,278, filed Dec. 13, 2017, which claims priority to and all the benefits of U.S. Provisional Pat. App. No. 62/435,254, filed on Dec. 16, 2016, the contents of each of the aforementioned applications being hereby incorporated by reference in their entirety.

US Referenced Citations (539)
Number Name Date Kind
3202759 Forgue Aug 1965 A
3344260 Lukens, II Sep 1967 A
3891800 Janssen et al. Jun 1975 A
4425818 Asada et al. Jan 1984 A
4442493 Wakai et al. Apr 1984 A
4561749 Utagawa Dec 1985 A
4564819 Hirose Jan 1986 A
4696167 Matsui et al. Sep 1987 A
4863133 Bonnell Sep 1989 A
4979949 Matsen, III et al. Dec 1990 A
5078140 Kwoh Jan 1992 A
5086401 Glassman et al. Feb 1992 A
5091861 Geller et al. Feb 1992 A
5154717 Matsen, III et al. Oct 1992 A
5184024 Hussmann et al. Feb 1993 A
5231693 Backes et al. Jul 1993 A
5279309 Taylor et al. Jan 1994 A
5299288 Glassman et al. Mar 1994 A
5339799 Kami et al. Aug 1994 A
5343391 Mushabac Aug 1994 A
5397323 Taylor et al. Mar 1995 A
5399951 Lavallee et al. Mar 1995 A
5408409 Glassman et al. Apr 1995 A
5434489 Cheng et al. Jul 1995 A
5445144 Wodicka et al. Aug 1995 A
5543695 Culp et al. Aug 1996 A
5562448 Mushabac Oct 1996 A
5569578 Mushabac Oct 1996 A
5576727 Rosenberg et al. Nov 1996 A
5629594 Jacobus et al. May 1997 A
5630431 Taylor May 1997 A
5682886 Delp et al. Nov 1997 A
5689159 Culp et al. Nov 1997 A
5691898 Rosenberg et al. Nov 1997 A
5695500 Taylor et al. Dec 1997 A
5699038 Ulrich et al. Dec 1997 A
5710870 Ohm et al. Jan 1998 A
5711299 Manwaring et al. Jan 1998 A
5721566 Rosenberg et al. Feb 1998 A
5730129 Darrow et al. Mar 1998 A
5731804 Rosenberg Mar 1998 A
5734373 Rosenberg et al. Mar 1998 A
5737500 Seraji et al. Apr 1998 A
5739811 Rosenberg et al. Apr 1998 A
5748767 Raab May 1998 A
5762458 Wang et al. Jun 1998 A
5767548 Wondrak et al. Jun 1998 A
5767648 Morel et al. Jun 1998 A
5767839 Rosenberg Jun 1998 A
5769092 Williamson, Jr. Jun 1998 A
5769640 Jacobus et al. Jun 1998 A
5776136 Sahay et al. Jul 1998 A
5784542 Ohm et al. Jul 1998 A
5789890 Genov et al. Aug 1998 A
5792135 Madhani et al. Aug 1998 A
5792147 Evans et al. Aug 1998 A
5806518 Mittelstadt Sep 1998 A
5807377 Madhani et al. Sep 1998 A
5815640 Wang et al. Sep 1998 A
5820623 Ng Oct 1998 A
5824085 Sahay et al. Oct 1998 A
5831408 Jacobus et al. Nov 1998 A
5841950 Wang et al. Nov 1998 A
5847528 Hui et al. Dec 1998 A
5855553 Tajima et al. Jan 1999 A
5855583 Wang et al. Jan 1999 A
5871018 Delp et al. Feb 1999 A
5880976 DiGioia, III et al. Mar 1999 A
5882206 Gillio Mar 1999 A
5891157 Day et al. Apr 1999 A
5907487 Rosenberg et al. May 1999 A
5907664 Wang et al. May 1999 A
5929607 Rosenberg et al. Jul 1999 A
5950629 Taylor et al. Sep 1999 A
5952796 Colgate et al. Sep 1999 A
5959613 Rosenberg et al. Sep 1999 A
5966305 Watari et al. Oct 1999 A
5971976 Wang et al. Oct 1999 A
5976156 Taylor et al. Nov 1999 A
5993338 Kato et al. Nov 1999 A
5995738 DiGioia, III et al. Nov 1999 A
5999168 Rosenberg et al. Dec 1999 A
6002859 DiGioia, III et al. Dec 1999 A
6020876 Rosenberg et al. Feb 2000 A
6024576 Bevirt et al. Feb 2000 A
6033415 Mittelstadt et al. Mar 2000 A
6037927 Rosenberg Mar 2000 A
6046727 Rosenberg et al. Apr 2000 A
6050718 Schena et al. Apr 2000 A
6063095 Wang et al. May 2000 A
6067077 Martin et al. May 2000 A
6084587 Tarr et al. Jul 2000 A
6097168 Katoh et al. Aug 2000 A
6102850 Wang et al. Aug 2000 A
6111577 Zilles et al. Aug 2000 A
6124693 Okanda et al. Sep 2000 A
6157873 DeCamp et al. Dec 2000 A
6163124 Ito et al. Dec 2000 A
6181096 Hashimoto et al. Jan 2001 B1
6191796 Tarr Feb 2001 B1
6205411 DiGioia, III et al. Mar 2001 B1
6228089 Wahrburg May 2001 B1
6233504 Das et al. May 2001 B1
6236875 Bucholz et al. May 2001 B1
6236906 Muller May 2001 B1
6246200 Blumenkranz et al. Jun 2001 B1
6278902 Hashimoto et al. Aug 2001 B1
6281651 Haanpaa et al. Aug 2001 B1
6300937 Rosenberg Oct 2001 B1
6304050 Skaar et al. Oct 2001 B1
6311100 Sarma et al. Oct 2001 B1
6314312 Wessels et al. Nov 2001 B1
6322567 Mittelstadt et al. Nov 2001 B1
6325808 Bernard et al. Dec 2001 B1
6329777 Itabashi et al. Dec 2001 B1
6329778 Culp et al. Dec 2001 B1
6330837 Charles et al. Dec 2001 B1
6336931 Hsu et al. Jan 2002 B1
6339735 Peless et al. Jan 2002 B1
6341231 Ferre et al. Jan 2002 B1
6342880 Rosenberg et al. Jan 2002 B2
6347240 Foley et al. Feb 2002 B1
6351659 Vilsmeier Feb 2002 B1
6351661 Cosman Feb 2002 B1
6352532 Kramer et al. Mar 2002 B1
6366272 Rosenberg et al. Apr 2002 B1
6368330 Hynes et al. Apr 2002 B1
6369834 Zilles et al. Apr 2002 B1
6377839 Kalfas et al. Apr 2002 B1
6385475 Cinquin et al. May 2002 B1
6385508 McGee et al. May 2002 B1
6385509 Das et al. May 2002 B2
6401006 Mizuno et al. Jun 2002 B1
6405072 Cosman Jun 2002 B1
6408253 Rosenberg et al. Jun 2002 B2
6411276 Braun et al. Jun 2002 B1
6413264 Jensen et al. Jul 2002 B1
6414711 Arimatsu et al. Jul 2002 B2
6417638 Guy et al. Jul 2002 B1
6421048 Shih et al. Jul 2002 B1
6423077 Carol et al. Jul 2002 B2
6424356 Chang et al. Jul 2002 B2
6428487 Burdorff et al. Aug 2002 B1
6430434 Mittelstadt Aug 2002 B1
6432112 Brock et al. Aug 2002 B2
6434415 Foley et al. Aug 2002 B1
6436107 Wang et al. Aug 2002 B1
6441577 Blumenkranz et al. Aug 2002 B2
6443894 Sumanaweera et al. Sep 2002 B1
6450978 Brosseau et al. Sep 2002 B1
6451027 Cooper et al. Sep 2002 B1
6459926 Nowlin et al. Oct 2002 B1
6461372 Jensen et al. Oct 2002 B1
6463360 Terada et al. Oct 2002 B1
6466815 Saito et al. Oct 2002 B1
6468265 Evans et al. Oct 2002 B1
6473635 Rasche Oct 2002 B1
6486872 Rosenberg et al. Nov 2002 B2
6490467 Bucholz et al. Dec 2002 B1
6491702 Heilbrun et al. Dec 2002 B2
6494882 Lebouitz et al. Dec 2002 B1
6501997 Kakino Dec 2002 B1
6507165 Kato et al. Jan 2003 B2
6507773 Parker et al. Jan 2003 B2
6514082 Kaufman et al. Feb 2003 B2
6520228 Kennedy et al. Feb 2003 B1
6522906 Salisbury, Jr. et al. Feb 2003 B1
6533737 Brosseau et al. Mar 2003 B1
6535756 Simon et al. Mar 2003 B1
6542770 Zylka et al. Apr 2003 B2
6562055 Walen May 2003 B2
6620174 Jensen et al. Sep 2003 B2
6636161 Rosenberg Oct 2003 B2
6639581 Moore et al. Oct 2003 B1
6665554 Charles et al. Dec 2003 B1
6671651 Goodwin et al. Dec 2003 B2
6676669 Charles et al. Jan 2004 B2
6697048 Rosenberg et al. Feb 2004 B2
6699177 Wang et al. Mar 2004 B1
6702805 Stuart Mar 2004 B1
6704002 Martin et al. Mar 2004 B1
6704683 Hasser Mar 2004 B1
6704694 Basdogan et al. Mar 2004 B1
6711432 Krause et al. Mar 2004 B1
6723106 Charles et al. Apr 2004 B1
6728599 Wang et al. Apr 2004 B2
6756761 Takahashi et al. Jun 2004 B2
6757582 Brisson et al. Jun 2004 B2
6778850 Adler et al. Aug 2004 B1
6778867 Ziegler et al. Aug 2004 B1
6781569 Gregorio et al. Aug 2004 B1
6785572 Yanof et al. Aug 2004 B2
6785593 Wang et al. Aug 2004 B2
6788999 Green Sep 2004 B2
6793653 Sanchez et al. Sep 2004 B2
6799106 Fukushima et al. Sep 2004 B2
6804547 Pelzer et al. Oct 2004 B2
6810314 Tashiro et al. Oct 2004 B2
6827723 Carson Dec 2004 B2
6832119 Miller Dec 2004 B2
6833846 Hasser Dec 2004 B2
6837892 Shoham Jan 2005 B2
6856888 Kawai Feb 2005 B2
6871117 Wang et al. Mar 2005 B2
6892110 Inoue et al. May 2005 B2
6892112 Wang et al. May 2005 B2
6892129 Miyano May 2005 B2
6895306 Ebisawa et al. May 2005 B2
6903721 Braun et al. Jun 2005 B2
6904823 Levin et al. Jun 2005 B2
6941224 Fukuyasu Sep 2005 B2
6958752 Jennings, Jr. et al. Oct 2005 B2
6963792 Green Nov 2005 B1
6978166 Foley et al. Dec 2005 B2
6982700 Rosenberg et al. Jan 2006 B2
6999852 Green Feb 2006 B2
7003368 Koike et al. Feb 2006 B2
7006895 Green Feb 2006 B2
7030585 Iwashita et al. Apr 2006 B2
7034491 Kozai et al. Apr 2006 B2
7035711 Watanabe et al. Apr 2006 B2
7035716 Harris et al. Apr 2006 B2
7038657 Rosenberg et al. May 2006 B2
7042175 Watanabe May 2006 B2
7044039 Powell May 2006 B2
7047117 Akiyama et al. May 2006 B2
7055789 Libbey et al. Jun 2006 B2
7056123 Gregorio et al. Jun 2006 B2
7084596 Iwashita et al. Aug 2006 B2
7084867 Ho et al. Aug 2006 B1
7086056 Fukushima Aug 2006 B2
7087049 Nowlin et al. Aug 2006 B2
7092791 Terada et al. Aug 2006 B2
7097640 Wang et al. Aug 2006 B2
7102314 Hayashi Sep 2006 B2
7102635 Shih et al. Sep 2006 B2
7103499 Goodwin et al. Sep 2006 B2
7139601 Bucholz et al. Nov 2006 B2
7155316 Sutherland et al. Dec 2006 B2
7181315 Watanabe et al. Feb 2007 B2
7193607 Moore et al. Mar 2007 B2
7204844 Jensen et al. Apr 2007 B2
7206626 Quaid, III Apr 2007 B2
7206627 Abovitz et al. Apr 2007 B2
7209117 Rosenberg et al. Apr 2007 B2
7212886 Nagata et al. May 2007 B2
7215326 Rosenberg May 2007 B2
7221983 Watanabe et al. May 2007 B2
7225404 Zilles et al. May 2007 B1
7239940 Wang et al. Jul 2007 B2
7245202 Levin Jul 2007 B2
7249951 Bevirt et al. Jul 2007 B2
7260437 Senoo et al. Aug 2007 B2
7260733 Ichikawa et al. Aug 2007 B2
7280095 Grant Oct 2007 B2
7283120 Grant Oct 2007 B2
7319466 Tarr et al. Jan 2008 B1
7346417 Luth et al. Mar 2008 B2
7390325 Wang et al. Jun 2008 B2
7404716 Gregorio et al. Jul 2008 B2
7422582 Malackowski et al. Sep 2008 B2
7447604 Braun et al. Nov 2008 B2
7454268 Jinno Nov 2008 B2
7460104 Rosenberg Dec 2008 B2
7460105 Rosenberg et al. Dec 2008 B2
7466303 Yi et al. Dec 2008 B2
7468594 Svensson et al. Dec 2008 B2
7491198 Kockro Feb 2009 B2
7542826 Hanzawa Jun 2009 B2
7543588 Wang et al. Jun 2009 B2
7573461 Rosenberg Aug 2009 B2
7577504 Sawada et al. Aug 2009 B2
7590458 Endo et al. Sep 2009 B2
7623944 Dariush Nov 2009 B2
7625383 Charles et al. Dec 2009 B2
7646161 Albu-Schaffer et al. Jan 2010 B2
7648513 Green et al. Jan 2010 B2
7657356 Iwashita et al. Feb 2010 B2
7660623 Hunter et al. Feb 2010 B2
7667687 Cruz-Hernandez et al. Feb 2010 B2
7683565 Quaid et al. Mar 2010 B2
7714836 Rodomista et al. May 2010 B2
7725162 Malackowski et al. May 2010 B2
7742801 Neubauer et al. Jun 2010 B2
7744608 Lee et al. Jun 2010 B2
7747311 Quaid, III Jun 2010 B2
7765890 Inoue et al. Aug 2010 B2
7800609 Tarr et al. Sep 2010 B2
7806891 Nowlin et al. Oct 2010 B2
7813368 Ootaka Oct 2010 B2
7813784 Marquart et al. Oct 2010 B2
7813838 Sommer Oct 2010 B2
7815644 Masini Oct 2010 B2
7818044 Dukesherer et al. Oct 2010 B2
7824424 Jensen et al. Nov 2010 B2
7831292 Quaid et al. Nov 2010 B2
7835784 Mire et al. Nov 2010 B2
7843158 Prisco Nov 2010 B2
7853356 Tsai et al. Dec 2010 B2
7853358 Joly Dec 2010 B2
7881917 Nagatsuka et al. Feb 2011 B2
7892243 Stuart Feb 2011 B2
7914522 Morley et al. Mar 2011 B2
7916121 Braun et al. Mar 2011 B2
7950306 Stuart May 2011 B2
7969288 Braun et al. Jun 2011 B2
8004229 Nowlin et al. Aug 2011 B2
8005571 Sutherland et al. Aug 2011 B2
8005659 Nelson et al. Aug 2011 B2
8010180 Quaid et al. Aug 2011 B2
8013847 Anastas Sep 2011 B2
8049457 Okita et al. Nov 2011 B2
8049734 Rosenberg et al. Nov 2011 B2
8054028 Aoyama et al. Nov 2011 B2
8090475 Blanc et al. Jan 2012 B2
8095200 Quaid, III Jan 2012 B2
8140189 Nagasaka Mar 2012 B2
8155790 Oga et al. Apr 2012 B2
8271134 Kato et al. Sep 2012 B2
8287522 Moses et al. Oct 2012 B2
8391954 Quaid, III Mar 2013 B2
8405340 Moon et al. Mar 2013 B2
8428779 Ohga et al. Apr 2013 B2
8452449 Iida May 2013 B2
8489238 Ooga et al. Jul 2013 B2
8498744 Odermatt et al. Jul 2013 B2
8541970 Nowlin et al. Sep 2013 B2
8560047 Haider et al. Oct 2013 B2
8644988 Prisco et al. Feb 2014 B2
8740882 Jun et al. Jun 2014 B2
8749189 Nowlin et al. Jun 2014 B2
8749190 Nowlin et al. Jun 2014 B2
8770905 Al-Mouhamed et al. Jul 2014 B2
8786241 Nowlin et al. Jul 2014 B2
8816628 Nowlin et al. Aug 2014 B2
8823308 Nowlin et al. Sep 2014 B2
8831779 Ortmaier et al. Sep 2014 B2
8843236 Barajas et al. Sep 2014 B2
9008757 Wu Apr 2015 B2
9060796 Seo Jun 2015 B2
9084613 Qutub Jul 2015 B2
9119638 Schwarz et al. Sep 2015 B2
9119655 Bowling et al. Sep 2015 B2
9205560 Edsinger et al. Dec 2015 B1
9226796 Bowling et al. Jan 2016 B2
9364291 Bellettre et al. Jun 2016 B2
9566122 Bowling et al. Feb 2017 B2
9566125 Bowling et al. Feb 2017 B2
9654183 Ma May 2017 B2
9681920 Bowling et al. Jun 2017 B2
9707043 Bozung Jul 2017 B2
9795445 Bowling Oct 2017 B2
9820818 Malackowski et al. Nov 2017 B2
10660711 Moctezuma de la Barrera et al. May 2020 B2
11202682 Staunton Dec 2021 B2
20020035321 Bucholz et al. Mar 2002 A1
20030069591 Carson et al. Apr 2003 A1
20030181934 Johnston et al. Sep 2003 A1
20030208296 Brisson et al. Nov 2003 A1
20030216816 Ito et al. Nov 2003 A1
20040010190 Shahidi Jan 2004 A1
20040024311 Quaid Feb 2004 A1
20040034283 Quaid Feb 2004 A1
20040034302 Abovitz et al. Feb 2004 A1
20040077939 Graumann Apr 2004 A1
20040106916 Quaid et al. Jun 2004 A1
20040128030 Nagata et al. Jul 2004 A1
20040148036 Sunami Jul 2004 A1
20040157188 Luth et al. Aug 2004 A1
20040243147 Lipow Dec 2004 A1
20050166413 Crampton Aug 2005 A1
20050171553 Schwarz et al. Aug 2005 A1
20060071625 Nakata et al. Apr 2006 A1
20060091842 Nishiyama May 2006 A1
20060109266 Itkowitz et al. May 2006 A1
20060111813 Nishiyama May 2006 A1
20060142657 Quaid et al. Jun 2006 A1
20060155262 Kishi et al. Jul 2006 A1
20060176242 Jaramaz et al. Aug 2006 A1
20060257379 Giordano et al. Nov 2006 A1
20060258938 Hoffman et al. Nov 2006 A1
20060261770 Kishi et al. Nov 2006 A1
20060264742 Neubauer et al. Nov 2006 A1
20060284587 Teshima et al. Dec 2006 A1
20070013336 Nowlin et al. Jan 2007 A1
20070085496 Philipp et al. Apr 2007 A1
20070129846 Birkenbach et al. Jun 2007 A1
20070142968 Prisco Jun 2007 A1
20070151389 Prisco et al. Jul 2007 A1
20070156285 Sillman et al. Jul 2007 A1
20070249911 Simon Oct 2007 A1
20070260394 Dean Nov 2007 A1
20070265527 Wohlgemuth Nov 2007 A1
20070270685 Kang et al. Nov 2007 A1
20070287911 Haid et al. Dec 2007 A1
20080001565 Nakashima et al. Jan 2008 A1
20080009697 Haider et al. Jan 2008 A1
20080010706 Moses et al. Jan 2008 A1
20080058776 Jo et al. Mar 2008 A1
20080065111 Blumenkranz et al. Mar 2008 A1
20080077158 Haider et al. Mar 2008 A1
20080086029 Uchiyama et al. Apr 2008 A1
20080114267 Lloyd et al. May 2008 A1
20080161829 Kang Jul 2008 A1
20080210477 Takenaka et al. Sep 2008 A1
20080269602 Csavoy et al. Oct 2008 A1
20080300478 Zuhars et al. Dec 2008 A1
20090003975 Kuduvalli et al. Jan 2009 A1
20090012532 Quaid et al. Jan 2009 A1
20090037033 Phillips et al. Feb 2009 A1
20090043556 Axelson et al. Feb 2009 A1
20090068620 Knobel et al. Mar 2009 A1
20090069942 Takahashi Mar 2009 A1
20090082784 Meissner et al. Mar 2009 A1
20090088774 Swarup et al. Apr 2009 A1
20090088897 Zhao Apr 2009 A1
20090096148 Usui Apr 2009 A1
20090099680 Usui Apr 2009 A1
20090102767 Shiomi Apr 2009 A1
20090105878 Nagasaka Apr 2009 A1
20090112316 Umemoto et al. Apr 2009 A1
20090149867 Glozman et al. Jun 2009 A1
20090209884 Van Vorhis et al. Aug 2009 A1
20090245600 Hoffman et al. Oct 2009 A1
20090245992 Kato Oct 2009 A1
20090248038 Blumenkranz et al. Oct 2009 A1
20090259412 Brogardh Oct 2009 A1
20090308683 Suzuki Dec 2009 A1
20100076474 Yates et al. Mar 2010 A1
20100094312 Ruiz Morales et al. Apr 2010 A1
20100110599 Ohshima May 2010 A1
20100137882 Quaid, III Jun 2010 A1
20100154578 Duval Jun 2010 A1
20100168950 Nagano Jul 2010 A1
20100174410 Greer et al. Jul 2010 A1
20100286826 Tsusaka et al. Nov 2010 A1
20100292707 Ortmaier et al. Nov 2010 A1
20100312392 Zimmermann Dec 2010 A1
20100331855 Zhao et al. Dec 2010 A1
20100331859 Omori Dec 2010 A1
20110015649 Anvari et al. Jan 2011 A1
20110077590 Plicchi et al. Mar 2011 A1
20110082468 Hagag et al. Apr 2011 A1
20110082587 Ziaei et al. Apr 2011 A1
20110106102 Balicki et al. May 2011 A1
20110118751 Balaji et al. May 2011 A1
20110130761 Plaskos et al. Jun 2011 A1
20110152676 Groszmann et al. Jun 2011 A1
20110160745 Fielding et al. Jun 2011 A1
20110178639 Kwon et al. Jul 2011 A1
20110190932 Tsusaka et al. Aug 2011 A1
20110208256 Zuhars Aug 2011 A1
20110257653 Hughes et al. Oct 2011 A1
20110263971 Nikou et al. Oct 2011 A1
20110264107 Nikou et al. Oct 2011 A1
20110264112 Nowlin et al. Oct 2011 A1
20110277580 Cooper et al. Nov 2011 A1
20110295247 Schlesinger et al. Dec 2011 A1
20110295268 Roelle et al. Dec 2011 A1
20110295274 Mueller Dec 2011 A1
20110295658 Bastos et al. Dec 2011 A1
20110301500 Maguire et al. Dec 2011 A1
20110306985 Inoue et al. Dec 2011 A1
20120030429 Synge Feb 2012 A1
20120059378 Farrell Mar 2012 A1
20120071752 Sewell et al. Mar 2012 A1
20120071893 Smith et al. Mar 2012 A1
20120083922 Kwak et al. Apr 2012 A1
20120120091 Koudijs et al. May 2012 A1
20120123441 Au et al. May 2012 A1
20120143084 Shoham Jun 2012 A1
20120173021 Tsusaka Jul 2012 A1
20120197182 Millman et al. Aug 2012 A1
20120245595 Kesavadas et al. Sep 2012 A1
20120283747 Popovic Nov 2012 A1
20120323244 Cheal et al. Dec 2012 A1
20120330429 Axelson, Jr. et al. Dec 2012 A1
20130006267 Odermatt Jan 2013 A1
20130019883 Worm et al. Jan 2013 A1
20130035690 Mittelstadt et al. Feb 2013 A1
20130035696 Qutub Feb 2013 A1
20130060146 Yang et al. Mar 2013 A1
20130060278 Bozung et al. Mar 2013 A1
20130096574 Kang et al. Apr 2013 A1
20130116706 Lee et al. May 2013 A1
20130172902 Lightcap et al. Jul 2013 A1
20130172905 Iorgulescu et al. Jul 2013 A1
20130175969 Kwon Jul 2013 A1
20130178868 Roh Jul 2013 A1
20130304258 Taylor et al. Nov 2013 A1
20130325029 Hourtash et al. Dec 2013 A1
20130331644 Pandya et al. Dec 2013 A1
20130345718 Crawford Dec 2013 A1
20140039517 Bowling et al. Feb 2014 A1
20140039681 Bowling et al. Feb 2014 A1
20140052153 Griffiths et al. Feb 2014 A1
20140052154 Griffiths et al. Feb 2014 A1
20140081461 Williamson et al. Mar 2014 A1
20140121837 Hashiguchi et al. May 2014 A1
20140135795 Yanagihara May 2014 A1
20140148818 Komuro et al. May 2014 A1
20140195205 Benker et al. Jul 2014 A1
20140222023 Kim et al. Aug 2014 A1
20140222207 Bowling et al. Aug 2014 A1
20140275955 Crawford et al. Sep 2014 A1
20140276943 Bowling et al. Sep 2014 A1
20140276949 Staunton et al. Sep 2014 A1
20140276952 Hourtash et al. Sep 2014 A1
20140277742 Wells et al. Sep 2014 A1
20140378999 Crawford et al. Dec 2014 A1
20150012715 Aronovich et al. Jan 2015 A1
20150032126 Nowlin et al. Jan 2015 A1
20150032164 Crawford et al. Jan 2015 A1
20150051733 Nowlin et al. Feb 2015 A1
20150081098 Kogan Mar 2015 A1
20150094736 Malackowski et al. Apr 2015 A1
20150150591 Takagi Jun 2015 A1
20150223941 Lang Aug 2015 A1
20150289941 Bowling et al. Oct 2015 A1
20160235493 LeBoeuf, II et al. Aug 2016 A1
20160361070 Ardel et al. Dec 2016 A1
20170024014 Chizeck et al. Jan 2017 A1
20170052622 Smith Feb 2017 A1
20170071680 Swarup et al. Mar 2017 A1
20170128136 Post May 2017 A1
20170143442 Tesar et al. May 2017 A1
20170245955 Bowling et al. Aug 2017 A1
20170258526 Lang Sep 2017 A1
20170258532 Shalayev Sep 2017 A1
20180168749 Dozeman Jun 2018 A1
20180168750 Staunton Jun 2018 A1
20200030036 Forstein Jan 2020 A1
20200138518 Lang May 2020 A1
20200281608 Sharifi-Mehr Sep 2020 A1
20200297429 Montane Sep 2020 A1
20210068845 Schers Mar 2021 A1
20210353311 Lavallee Nov 2021 A1
20220079692 Staunton Mar 2022 A1
20220273396 Bozung Sep 2022 A1
Foreign Referenced Citations (59)
Number Date Country
102208835 Oct 2011 CN
102470016 May 2012 CN
1680007 Jul 2006 EP
1871267 Jan 2008 EP
1973487 Oct 2008 EP
2204136 Jul 2010 EP
2666428 Nov 2013 EP
199611624 Apr 1996 WO
1999037220 Jul 1999 WO
2000021450 Apr 2000 WO
2000035366 Jun 2000 WO
2000059397 Oct 2000 WO
2000060571 Oct 2000 WO
200200131 Jan 2002 WO
2002024051 Mar 2002 WO
2002060653 Aug 2002 WO
2002065931 Aug 2002 WO
2002074500 Sep 2002 WO
2002076302 Oct 2002 WO
2003086714 Oct 2003 WO
2003094108 Nov 2003 WO
2004001569 Dec 2003 WO
2004014244 Feb 2004 WO
2004019785 Mar 2004 WO
2004069036 Aug 2004 WO
2005009215 Feb 2005 WO
2005122916 Dec 2005 WO
2006058633 Jun 2006 WO
2006063156 Jun 2006 WO
2006091494 Aug 2006 WO
2007017642 Feb 2007 WO
2007111749 Oct 2007 WO
2007117297 Oct 2007 WO
2007136739 Nov 2007 WO
2007136768 Nov 2007 WO
2007136769 Nov 2007 WO
2007136771 Nov 2007 WO
2009059330 May 2009 WO
2010088959 Aug 2010 WO
2010102384 Sep 2010 WO
2011021192 Feb 2011 WO
2011088541 Jul 2011 WO
2011106861 Sep 2011 WO
2011109041 Sep 2011 WO
2011113483 Sep 2011 WO
2011133873 Oct 2011 WO
2011133927 Oct 2011 WO
2011134083 Nov 2011 WO
2011128766 Dec 2011 WO
2012018816 Feb 2012 WO
2012018823 Feb 2012 WO
2013020026 Feb 2013 WO
2013117909 Aug 2013 WO
2013181507 Dec 2013 WO
2013192598 Dec 2013 WO
2014022786 Feb 2014 WO
2014121262 Aug 2014 WO
2014151550 Sep 2014 WO
2015061638 Apr 2015 WO
Non-Patent Literature Citations (118)
Entry
Abovitz, R., Digital surgery the future of medicine and human-robot symbiotic interaction, Industrial Robot: An International Journal, 2001, pp. 401-406, vol. 28, Issue 5, Hollywood, FL, USA; 5 pages.
Abovitz, R.A., Human-Interactive Medical Robotics, Abstract for CAOS 2000, 2000, pp. 71-72; 2 pages.
Ansara,. D. et al., Visual and haptic collaborative tele-presence, Computers & Graphics, 2001, pp. 789-798, vol. 25, Elsevier, Inc.; 10 pages.
Bainville, E. et al., Concepts and Methods of Registration for Computer-Integrated Surgery, Computer Assisted Orthopedic Surgery (CAOS), 1999, pp. 15-34, Hogrefe & Huber Publishers, Bern; 22 pages.
Bargar, W.L. et al., Primary and Revision Total Hip Replacement Using the Robodoc System, Clinical Orthopaedics and Related Research, Sep. 1998, pp. 82-91, No. 354; 10 pages.
Bierentzen, J. Andreas, Octree-based Volume Sculpting, Proc. Late Breaking Hot Topics, IEEE Visualization '98, pp. 9-12, 1998; 4 pages.
Bouazza-Marouf, K. et al., Robot-assisted invasive orthopaedic surgery, Mechatronics in Surgery, Jun. 1996, pp. 381-397, vol. 6, Issue 4, UK; 17 pages.
Brandt, G. et al., “CRIGOS: A Compact Robot for Image-Guided Orthopedic Surgery,” Information Technology in Biomedicine, IEEE Transactions on, vol. 3, No. 4, pp. 252-260,Dec. 1999; 9 pages.
Brisson, G. et al., Precision Freehand Sculpting of Bone, Medical Image Computing and Computer-Assisted Intervention—MICCAI 2004, Lecture Notes in Computer Science, vol. 3217, Jan. 1, 2004, pp. 105-112, Springer-VerlagBerlin Heidelberg 2004; 8 pages.
Buckingham, R.O., Robotics in surgery a new generation of surgical tools incorporate computer technology and mechanical actuation to give surgeons much finer control than previously possible during some operations, IEE Review, Sep. 1994, pp. 193-196; 4pages.
Buckingham, R.O., Safe Active Robotic Devices for Surgery, Systems, Man and Cybernetics, 1993. ‘Systems Engineering in the Service of Humans’, Conference Proceedings., International Conference on, Oct. 17-20, 1993, pp. 355-358, vol. 5, IEEE, LeTougeut; 4 pages.
Burghart, C.R. et al., A. Pernozzoli; H. Grabowski; J. Muenchenberg; J. Albers; S. Hafeld; C. Vahl; U. Rembold; H. Woern, Robot assisted craniofacial surgery first clinical evaluation, Computer Assisted Radiology andSurgery, 1999, pp. 828-833; 7 pages.
Burghart, C.R. et al., Robot Controlled Osteotomy in Craniofacial Surgery, First International Workshop on Haptic Devices in Medical Applications Proceedings, Jun. 23, 1999, pp. 12-22, Paris, FR; 13 pages.
Burghart, C.R., Partial English Translation of Robotergestutzte Osteotomie in der craniofacialen Chirurgie (Robot Clipped Osteotomy in Craniofacial sugery), Jul. 1, 1999, GCA-Verlag, 2000, 62 pages.
Burghart, C.R., Robotergestutzte Osteotomie in der craniofacialen Chirurgie (Robot Clipped osteotomy in craniofacial surgery), Jul. 1, 1999, GCA-Verlag, 2000; 250 pages.
Catto, E., Iterative Dynamics with Temporal Coherence, Feb. 22, 2005, Menlo Park, CA, US; 24 pages.
Catto, E., Soft Constraints Reinventing the Spring, Game Developer Conference, 2011; 51 pages.
Choi, D.Y. et al., Flexure-based Manipulator for Active Handheld Microsurgical Instrument, Engineering in Medicine and Biology Society, 2005. Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference of theDigital Object Identifier, 2005, pp. 5085-5088, IEEE, Shanghai, China, Sep. 1-4, 2005, 4 pages.
Colgate, J.E. et al., Issues in the Haptic Display of Tool Use, Intelligent Robots and Systems 95. ‘Human Robot Interaction and Cooperative Robots’, Proceedings. 1995 IEEE/RSJ International Conference on, Aug. 5-9, 1995, pp. 140-145, vol. 3, IEEE, Pittsburgh, PA, USA; 6 pages.
Davies, B.L. et al., Acrobot-using robots and surgeons synergistically in knee surgery, Advanced Robotics, 1997. ICAR '97. Proceedings., 8th International Conference on, Jul. 7-9, 1997, pp. 173-178, IEEE,Monterey, CA, USA; 6 pages.
Davies, B.L. et al., Active compliance in robotic surgery-the use of force control as a dynamic constraint, Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineeringin Medicine, Apr. 1, 1997, pp. 285-292, vol. 211, Sage, 9 pages.
Davies, B.L. et al., “Active Constraints for Robotic Knee Surgery”, May 4, 2006, The Institution of Engineering and Technology, Ref. No. 2006/11372, pp. 31-48.
Davies, B.L. et al., Neurobot a special-purpose robot for neurosurgery, Robotics and Automation, 2000. Proceedings. ICRA '00. IEEE International Conference on, Apr. 2000, pp. 4103-4108, vol. 4,IEEE, San Francisco, CA, USA; 6 pages.
Davies, B.L., A review of robotics in surgery, Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineering in Medicine Jan. 1, 2000, vol. 214, No. 1, pp. 129-140, Sage Publications; 13 pages.
Davies, B.L., Computer-assisted and robotics surgery, International Congress and Symposium Series 223, 1997, pp. 71-82, Royal Society of Medicine Press Limited; 12 pages.
Davies, B.L.., Robotics in minimally invasive surgery, Through the Keyhole: Microengineering in Minimally Invasive Surgey, IEE Colloquium on, Jun. 6, 1995, pp. 5/1-5/2, London, UK; 2 pages.
Delp, S.L. et al., Computer Assisted Knee Replacement, Clinical Orthopaedics, Sep. 1998, pp. 49-56, vol. 354, Lippincott-Raven Publishers; 8 pages.
DiGioia, A.M. et al., Computer Assisted Orthopaedic Surgery Image Guided and Robotic Assistive Technologies, Clinical Orthopaedics & Related Research:, Sep. 1998, pp. 8-16, vol. 354, Lippincott Williams & Wilkins, Pittsburgh, PA, USA; 9 pages.
Doignon, C. et all., Segmentation and guidance of multiple rigid objects for intra-operative endoscopic vision, Proceeding WDV'05/WDV'06/ICCV'05/ECCV'06 Proceedings of the 2005/2006 International Conference on Dynamical Vision,2006, pp. 314-327, Springer-Verlag Berlin, Heidelberg, Illkirch, FR; 14 pages.
Ellis, R.E. et al., A surgical planning and guidance system for high tibial osteotomy, Computer Aided Surgery, Apr. 16, 1999, 264-274, vol. 4, Wiley-Liss, Inc.; 11 pages.
Engel, D. et al., A Safe Robot System for Craniofacial Surgery, Robotics and Automation, 2001. Proceedings 2001 ICRA. IEEE International Conference on (vol. 2), pp. 2020-2024, IEEE; 5 pages.
English language abstract and machine-assisted English translation for WO 2000/21450 A1 extracted from www.Espacenet.org on Aug. 11, 2014; 37 pages.
English language abstract and machine-assisted English translation for WO 2000/59397 A1 extracted from www.Espacenet.org on Aug. 11, 2014; 33 pages.
English language abstract and machine-assisted English translation for WO 2002/074500 A2 extracted from www.Espacenet.org on Aug. 11, 2014; 25 pages.
English language abstract for CN 102208835 extracted from espacenet.com database on Sep. 21, 2017, 2 pages.
English language abstract for CN 102470016 extracted from espacenet.com database on Sep. 21, 2017, 2 pages.
English language abstract for EP 1 680 007 A2 not found; however, see English language equivalent U.S. Pat. No. 7,831,292 B2 and original document extracted www.Espacenet.org on May 8, 2014; 3 pages.
English language abstract for EP 1 871 267 A1 not found; however, see English language equivalent International Publication No. WO 2006/091494 A1 and original document extracted www.Espacenet.org on May 8, 2014; 3 pages.
English language abstract for EP 1 973 487 A2 not found; equivalent WO 2007/117297 A2 and original document however, see English language extracted www.Espacenet.org on May 8, 2014; 3 pages.
English language abstract for WO 02/076302 extracted from espacenet.com database on Apr. 11, 2018, 2 pages.
English language abstract for WO 2002/065931 A1 extracted from www.espacenet.com database on Apr. 11, 2018; 2 pages.
English language abstract for WO 2004/019785 extracted from espacenet.com database on Apr. 11, 2018, 2 pages.
English language abstract for WO 2006/058633 extracted from espacenet.com database on Apr. 11, 2018, 2 pages.
Fadda, M. et al., Computer Assisted Planning for Total Knee Arthroplasty, 1997, pp. 619-628; 10 pages.
Fadda, M. et al., Computer-Assisted Knee Arthroplasty at Rizzoli Insitutes, First International Symposium on Medical Robotics and ComputerAssisted Surgery, Sep. 22-24, 1994, pp. 26-30, Pittsburgh, Pennsylvania, US; 6 pages.
Fadda, M. et al., Premiers Pas Vers La Dissectomie et la Realisation de Protheses du Genou a L'Aide de Robots, Innov. Tech. Bio. Med. , 1992, pp. 394-409, vol. 13, No. 4; 16 pages.
Fluete, M. et al., Incorporating a statistically based shape model into a system for computer-assisted anterior cruciate ligament surgery, Medical Image Analysis, Oct. 1999, pp. 209-222, vol. 3, No. 3, FR; 14 pages.
Gravel, D.P. et al., Flexible robotic assembly efforts at Ford Motor Company, Intelligent Control, 2001. (ISIC '01). Proceedings of the 2001 IEEE International Symposium on, 2001, pp. 173-182, IEEE, Detroit, Michigan, US; 10 pages.
Gravel, D.P. et al., Flexible Robotic Assembly, Measuring the Performance and Intelligence of Systems: Proceedings of the 2000 PerMIS Workshop, NIST Interagency/Internal Report (NISTIR)—970, Aug. 14-16, 2000, pp. 412-418, Sep. 1, 2001 NIST; 11pages.
Grueneis, C.O.R. et al., Clinical Introduction of the Caspar System Problems and Initial Results, 4th International Symposium of Computer Assited Orthopaedic Surgery, CAOS'99, Abstracts from CAOS '99, 1999, p. 160, Davos, Switzerland; 1 pages.
Haider, H. et al., Minimally Invasive Total Knee Arthroplasty Surgery Through Navigated Freehand Bone Cutting, Journal of Arthroplasty, Jun. 2007, vol. 22, No. 4, pp. 535-542, Elsevier B.V.; 8 pages.
Harris, S.J. et al., Experiences with Robotic Systems for Knee Surgery, CVRMed-MRCAS'97, Lecture Notes in Computer Science, 1997, pp. 757-766, vol. 1205, Springer Berlin Heidelberg,London, UK; 10 pages.
Harris, S.J. et al., Intra operative Application of a Robotic Knee Surgery System, Medical Image Computing and Computer-Assisted Intervention—MICCAl'99, 1999, pp. 1116-1124, vol. 1679, Springer-Verlag Berlin Heidelberg; 9pages.
Hassfeld, C. et al., Intraoperative Navigation Techniques Accuracy Tests and Clinical Report, In: Computer Assisted Radiology and Surgery (CARS'98), Tokyo, Jun. 1998, pp. 670-675, Elseview Science B.V.; 6 pages.
Ho, S.C. et al., Force Control for Robotic Surgery, ICAR '95, 1995, pp. 21-32, London, UK; 12 pages.
Ho, S.C. et al., Robot Assisted Knee Surgery Establishing a force control strategy incorporating active motion constraint, IEEE Engineering in Medicine and Biology, May/Jun. 1995, pp. 292-300, vol. 14, No. 3; 9 pages.
Hyosig, K. et al., Autonomous Suturing using Minimally Invasive Surgical Robots, Control Applications, Sep. 25-27, 2000. Proceedings of the 2000 IEEE International Conference on, 2000, pp. 742-747, IEEE, Anchorage, AK, USA; 6 pages.
Hyosig, K. et al., EndoBot A Robotic Assistant in Minimally Invasive Surgeries, Robotics and Automation, 2001. Proceedings 2001 ICRA. IEEE International Conference on, Seoul, KR, 2001, pp. 2031-2036, vol. 2, IEEE, Troy, NYY, USA; 6 pages.
International Search Report for Application No. PCT/US2013/053451 dated Mar. 19, 2014; 8 pages.
International Search Report for Application No. PCT/US2016/049955 dated Nov. 4, 2016, 21 pages.
International Search Report for Application No. PCT/US2014/025975 dated Sep. 26, 2014, 2 pages.
International Search Report for Application No. PCT/US2017/066071 dated Mar. 27, 2018, 4 pages.
Jakopec, M. et al., The first clinical application of a “hands-on” robotic knee surgery system, Computer Aided Surgery , 2001, pp. 329-339, vol. 6, Issue 6, Wiley-Liss, Inc.; 11 pages.
Jaramaz, B. et al., Range of Motion After Total Hip Arthroplasty Experimental Verification of the Analytical Simulator, CVRMed-MRCAS'97, Lecture Notes in Computer Science, Feb. 20, 1997, pp. 573-582, vol. 1205,Springer Berlin Heidelberg, Pittsburgh, PA, USA; 14 pages.
Kazanzides, P. et al., Architecture of a Surgical Robot, Systems, Man and Cybernetics, 1992., IEEE International Conference on, Oct. 18-21, 1992, pp. 1624-1629, vol. 2, IEEE,Chicago, IL, USA; 6 pages.
Khadem, R. et al., Comparative Tracking Error Analysis of Five Different Optical Tracking Systems, Computer Aided Surgery, 2000, pp. 98-107, vol. 5, Stanford, CA,USA; 10 pages.
Kienzle, III, T.C. et al., An Integrated CAD-Robotics System for Total Knee Replacement Surgery, Systems, Man and Cybernetics, 1992., IEEE International Conference on, Oct. 18-21, 1992, pp. 1609-1614, vol. 2,IEEE, Chicago, IL, USA; 6 pages.
Kienzle, III, T.C. et al., Total Knee Replacement Computer-assisted surgical system uses a calibrated robot, Engineering in Medicine and Biology, May 1995, pp. 301-306, vol. 14, Issue 3,IEEE; 35 pages.
Korb, W. et al., Development and First Patient Trial of a Surgical Robot for Complex Trajectory Milling, Computer Aided Surgery, 2003, vol. 8, pp. 247-256, CAS Journal LLC; 10 pages.
Koseki, Y. et al., Robotic assist for MR-guided surgery using leverage and parallelepiped mechanism, Medical Image Computing and Computer-Assisted Intervention—MICCAI 2000, Lecture Notes in Computer Science, 2000, pp. 940-948, vol. 1935, Springer Berlin Heidelberg; 9 pages.
Kozlowski, D. et al., Automated Force Controlled Assembly Utilizing a Novel Hexapod Robot Manipulator, Automation Congress,2002 Proceedings of the 5th Biannual World, 2002, pp. 547-552, vol. 14, IEEE; 6 pages.
Lavallee, S. et al., Computer Assisted Spine Surgery a technique for accurate transpedicular screw fixation using CT data and a 3-D optical localizer, Journal of Image Guided Surgery, 1995, pp. 65-73; 9 pages.
Lea, J.T. et al., Registration and immobilization in robot-assisted surgery, Journal of Image Guided Surgery, Computer Aided Surgery, 1995, vol. 1, No. 2, pp. 80-87; 11 pages.
Lea, J.T. Registration Graphs a Language for Modeling and Analyzing Registration in Image-Guided Surgery, Dec. 1998, Evanston, Illinois, US; 49 pages.
Leitner, F. et al., Computer-Assisted Knee Surgical Total Replacement, CVRMed-MRCAS'97, Lecture Notes in Computer Science vol. 1205, 1997, pp. 629-638, Springer Berlin Heidelberg, Jan. 1, 1997; 10 pages.
Lembcke, S., Realtime Rigid Body Simulation Using Impulses, 2006, Morris, MN, US; 5 pages.
Levison, T.J. et al., Surgical Navigation for THR a Report on Clinical Trial Utilizing HipNav, MICCAI 2000, LNCS 1935, pp. 1185-1187, 2000, Springer-Verlag Berlin Heidelberg; 3 pages.
Louhisalmi, Y. et al., Development of a Robotic Surgical Assistant, 1994, pp. 1043-1044, IEEE, Linnanmaa, Oulu, FI; 2 pages.
Matsen, F.A. et al., Robotic Assistance in Orthopaedic Surgery a Proof of Principle Using Distal Femoral Arthroplasty, Clinical Orthopaedic Related Research, Nov. 1993, pp. 178-186, vol. 296; 9pages.
Meng, C. et al., Remote surgery case robot-assisted teleneurosurgery, Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 IEEE International Conference on, Apr. 26-May 1, 2004, pp. 819-823, vol. 1, IEEE, New Orleans, LA, USA; 5pages.
Moctezuma, J.L.. et al., A Computer and Robotic Aided Surgery System for Accomplishing Osteotomies, First International Symposium on Medical Robotics and Computer Assisted Surgery, Sep. 22-24, 1994, Pittsburgh, Pennsylvania, US; 6pages.
Nolte, L.P. et al., A Novel Approach to Computer Assisted Spine Surgery, Proc. First International Symposium on Medical Robotics and Computer Assisted Surgery, Pittsburgh, 1994, pp. 323-328; 7 pages.
O'Toole, R.V. et al., Biomechanics for Preoperative Planning and Surgical Simulations in Orthopaedics, Computers in Biology and Medicine, Mar. 1995, pp. 183-191, vol. 25, Issue 2; 8 pages.
Orto Maquet and Caspar: An Automated Cell for Prosthesis Surgery, Robotics World, Sep./Oct. 1999, pp. 30-31, Circular No. 87 on Reader Reply Card; 2 pages.
Paul, H.A. et al., A Surgical Robot for Total Hip Replacement Surgery, International Conference on Robotics and Automation, 1992, pp. 606-611, IEEE, Nice, FR; 6 pages.
Paul, H.A. et al., Development of a Surgical Robot for Cementless Total Hip Anthroplasty, Clinical Orthopaedics and Related Research, Dec. 1992, pp. 57-66, No. 285, Sacramento, CA, USA; 10 pages.
Paul, H.A. et al., Robotic Execution of a Surgical Plan, Systems, Man and Cybernetics, 1992., IEEE International Conference on, Oct. 18-21, 1992,pp. 1621-1623, IEEE, Sacramento, California, US; 3 pages.
Preising, B. et al., A Literature Review Robots in Medicine, Engineering in Medicine and Biology Magazine, IEEE (vol. 10, Issue: 2), Jun. 1991, pp. 13-22, IEEE; 10 pages.
Quaid, A.E. et al., Haptic Information Displays for Computer-Assisted Surgery, Robotics and Automation, 2002 Proceedings. ICRA '02. IEEE International Conference on, May 2002, pp. 2092-2097, vol. 2, IEEE, Washington DC, USA; 6 pages.
Raczkowsky, J. et al., Ein Robotersystem fur craniomaxillofaciale chirurgische Eingriffe (A robotic system for surgical procedures craniomaxillofaciale), with English language abstract, Computer Forsch. Entw., 1999, pp. 24-35, vol. 14,Springer-Verlag; 12 pages.
Rembold, U. et al., Surgical Robotics: An Introduction, Journal of Intelligent and Robotic Systems vol. 30, No. 1, pp. 1-28, 2001, Kluwer Academic Publishers; 28 pages.
Riviere, C.N. et al., Modeling and Canceling Tremor in Human-Machine Interfaces, Engineering in Medicine and Biology Magazine, IEEE, vol. 15, Issue 3, May/Jun. 1996, p. 29-36, IEEE; 8 pages.
Rohling, R. et al., Comparison of Relative Accuracy Between a Mechanical and an Optical Position Tracker for Image-Guided Neurosurgery, Journal of Image Guided Surgery, 1995, pp. 30-34, vol. 1, No. 1; 4 pages.
Salisbury, J.K., Active Stiffness Control of a Manipulator in Cartesian Coordinates, Decision and Control including the Symposium on Adaptive Processes, 1980 19th IEEE Conference on, Dec. 1980, pp. 95-100, vol. 19, IEEE, Stanford, CA, USA; 7 pages.
Santos-Munne, Julio J. et al., A Stereotactic/Robotic System for Pedicle Screw Placement, Interactive Technology and the New Paradigm for Healthcare, (Proceedings of theMedicine Meets Virtual Reality III Conference, San Diego, 1995), pp. 326-333, IOS Press and Ohmsha, 8 pages.
Satava, R.M., History of Robotic Surgery the early chronicles a personal historical perspective, Surgical Laparoscopic Endoscopic Percutaneous Technology, Feb. 2002, vol. 12 pp. 6-16, WebSurg, 6 pages.
Schmidt, T. et al., EasyGuide Neuro, A New System for Image-Guided Planning, Simulation and Navigation in Neurosurgery, Biomedical Engineering, vol. 40, Supplement 1, 1995, pp. 233-234, Hamburg, DE; 2 pages, and partial English language translation of EasyGuide Neuro, A New System for Image-Guided Planning, Simulation and Navigation in Neurosurgery, 1 page.
Shinsuk, P., Safety Strategies for Human-Robot Interaction in Surgical Environment, SICE-ICASE, 2006. International Joint Conference, Oct. 18-21, 2006, pp. 1769-1773, IEEE, Bexco, Busan, SK; 5 pages.
Siebert, W. et al., Technique and first clinical results of robot-assisted total knee replacement, The Knee, Sep. 2002, pp. 173-180, vol. 9, Issue 3, Elsevier B.V.; 8 pages.
Siebold, U. et al., Prototype of Instrument for Minimally Invasive Surgery with 6-Axis Force Sensing Capability, Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on, Apr. 18-22, 2005, pp. 498-503, IEEE, Barcelona, Spain; 6 pages.
Sim, C. et al., Image-Guided Manipulator Compliant Surgical Planning Methodology for Robotic Skull-Base Surgery, Medical Imaging and Augmented Reality, 2001. Proceedings. International Workshop on, Jun. 10-12, 2001, pp. 26-29, EEE, Shatin, HK; 4 pages.
Simon, D.A. et al., Accuracy validation in image-guided orthopaedic surgery, In Medical Robotics and Computer Assisted Surgery, 1995, pp. 185-192, Wiley; 8 pages.
Spencer, E.H., The ROBODOC Clinical Trial A Robotic Assistant for Total Hip Arthroplasty, Orthopaedic Nursing, Jan.-Feb. 1996, pp. 9-14, vol. 15, Issue 1; 6 pages.
Spetzger, U. et al., Frameless Neuronavigation in Modern Neurosurgery, Minimally Invasive Neurosurgery, Dec. 1995, pp. 163-166, vol. 38; 4 pages.
Taylor, R. et al., A Steady-Hand Robotic System for Microsurgical Augementation, MICCA199: the Second International Conference on Medical ImageComputing and Computer-Assisted Intervention, Cambridge, England, Sep. 19-22, 1999. MICCAI99 Submission #1361999, pp. 1031-1041, Springer-Verlag Berlin Heidelberg, 11 pages.
Taylor, R.H. et al., A Model-Based Optimal Planning and Execution System with Active Sensing and Passive Manipulation for Augmentation of HumanPrecision in Computer-Integrated Surgery, Section 4 Robotic Systems and Task-Level Programming, Experimental Robotics II, The 2nd International Symposium, Lecture Notes in Control and Information Sciences, pp. 177-195, vol. 190, Springer BerlinHeidelberg, Toulouse, FR, Jun. 25-27, 1991; 19 pages.
Taylor, R.H. et al., An Image-directed Robotic System for Hip Replacement Surgery, Oct. 1990, pp. 111-116, vol. 8, No. 5; 7 pages.
Taylor, R.H. et al., An Image-Directed Robotic System for Precise Orthopaedic Surgery, Robotics and Automation, IEEE Transactions on, Jun. 1994, pp. 261-275, vol. 10, Issue 3, IEEE; 15 pages.
Tonet, O. et al., An Augmented Reality Navigation System for Computer Assisted Arthroscopic Surgery of the Knee, Medical Image Computing and Computer-AssistedIntervention—MICCAI 2000, Lecture Notes in Computer Science, 2000, pp. 1158-1162, vol. 1935, Springer Berlin Heidelberg; 5 pages.
Troccaz, J. et al., A passive arm with dynamic constraints a solution to safety problems in medical robotics, Systems, Man and Cybernetics, 1993. ‘Systems Engineering in the Service of Humans’, Conference Proceedings., InternationalConference on, Oct. 17-20, 1993, pp. 166-171, vol. 3, IEEE, Le Touquet, FR; 6 pages.
Troccaz, J. et al., Semi-Active Guiding Systems in Surgery. A Two-DOF Prototype of the Passive Arm with Dynamic Constraints (PADyC), Mechatronics, Jun. 1996, pp. 399-421, vol. 6, Issue 4, 1996, Elsevier Ltd., UK; 23 pages.
Troccaz, J. et al., Guiding systems for computer-assisted surgery introducing synergistic devices and discussing the different approaches, Medical Image Analysis, Jun. 1998, vol. 2, No. 2, pp. 101-119, Elsevier B.V.; 19 pages.
Van Ham, G. et al., Accuracy study on the registration of the tibia by means of an intramedullary rod in robot-assisted total knee arthroplasty, PosterSession-Knee Arthroplasty—Valencia Foyer, 46th Annual Meeting, Orthopaedic Research Society, Mar. 12-15, 2000, Orlando, Florida, Jan. 1, 2010, p. 450; 1 pages.
Van Ham, G. et al., Machining and Accuracy Studies for a Tibial Knee Implant Using a Force-Controlled Robot, Computer Aided Surgery, Feb. 1998, pp. 123-133, vol. 3, Wiley-Liss, Inc., Heverlee BE; 11 pages.
Want, T. et al., A robotized surgeon assistant, Intelligent Robots and Systems '94. ‘Advanced Robotic Systems and the Real World’, IROS '94. Proceedings of the IEEE/RSJ/GI International Conference on,Sep. 12-16, 1994, pp. 862-869, vol. 2, IEEE, Munich, Germany; 8 pages.
Watanable, E. et al., Three-Dimensional Digitizer (Neuronavigator); New Equipment for Computed Tomography-Guided Stereotaxic Surgery, Surgical Neurology, Jun. 1987, pp. 543-547, vol. 27, Issue 6, ElsevierInc.; 5 pages.
Yoshimine, Kato A. et al., A frameless, armless navigational system for computer-assisted neurosurgery. Technical note, Journal of Neurosurgery, vol. 74, May 1991, pp. 845-849; 5 pages.
Zilles, C.B. et al., A Constraint-Based God-object Method for Haptic Display, Intelligent Robots and Systems 95. ‘Human Robot Interaction and Cooperative Robots’, Proceedings. 1995 IEEE/RSJ International Conference on , Aug. 5-9-, 1995, pp. 146-151, vol. 3, IEEE, MIT, Cambridge, MA, USA; 6 pages.
Related Publications (1)
Number Date Country
20220079692 A1 Mar 2022 US
Provisional Applications (1)
Number Date Country
62435254 Dec 2016 US
Continuations (1)
Number Date Country
Parent 15840278 Dec 2017 US
Child 17534499 US