Surgical tool system and method

Abstract
Devices, Systems, and Methods for controlled movement of the robot system. The surgical robot system may include a robot having a robot base, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm. The robot may include a plurality of omni-directional wheels affixed to the robot base allowing multiple-axis movement of the robot. The robot may further include sensors for detecting a desired movement of the robot base and a control system responsive to the plurality of sensors for controlling the multiple-axis movement of the robot by actuating two or more of the plurality of omni-directional wheels.
Description
FIELD

The present disclosure relates to medical robotic systems, and more particularly, controlled movement of the robot system or components thereof.


BACKGROUND

Position recognition systems are used to determine the position of and track a particular object in 3-dimensions (3D). In robot assisted surgeries, for example, certain objects, such as surgical instruments, need to be tracked with a high degree of precision as the instrument is being positioned and moved by a robot or by a physician, for example.


Infrared signal based position recognition systems may use passive and/or active sensors or markers for tracking the objects. In passive sensors or markers, objects to be tracked may include passive sensors, such as reflective spherical balls, which are positioned at strategic locations on the object to be tracked. Infrared transmitters transmit a signal, and the reflective spherical balls reflect the signal to aid in determining the position of the object in 3D. In active sensors or markers, the objects to be tracked include active infrared transmitters, such as light emitting diodes (LEDs), and thus generate their own infrared signals for 3D detection.


With either active or passive tracking sensors, the system then geometrically resolves the 3-dimensional position of the active and/or passive sensors based on information from or with respect to one or more of the infrared cameras, digital signals, known locations of the active or passive sensors, distance, the time it took to receive the responsive signals, other known variables, or a combination thereof.


One problem is ensuring that the location of the robot is accurate and controlling movement of the robot system or other medical equipment, for example, around the operating room environment.


SUMMARY

To meet this and other needs, devices, systems, and methods for controlling movement of the robot-assisted surgeries, for example, with omni-directional wheels is provided.


According to one embodiment, a surgical robot system includes a robot having a robot base, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm, the end-effector including a plurality of tracking markers detectable by at least one camera; a plurality of omni-directional wheels affixed to the robot base allowing multiple-axis movement of the robot; a plurality of sensors for detecting a desired movement of the robot base; and a control system responsive to the plurality of sensors for controlling the multiple-axis movement of the robot by actuating two or more of the plurality of omni-directional wheels.


According to another embodiment, a surgical robot system includes a robot having a robot base, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm, the end-effector including a guide tube for receiving at least one instrument; a plurality of omni-directional wheels attached to the robot base allowing three-axis movement of the robot in a general area of a plane; a plurality of sensors for detecting a desired movement of the robot base; and a control system responsive to the plurality of sensors for controlling the three-axis movement of the robot base by actuating two or more of the plurality of omni-directional wheels.


According to yet another embodiment, a surgical robot system includes A surgical robot system comprising: a robot having a robot base, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm, the end-effector including a plurality of tracking markers detectable by at least one camera; and a plurality of omni-directional wheels affixed to the robot base allowing multiple-axis movement of the robot, wherein each of the plurality of omni-directional wheels includes a central hub with a plurality of rollers mounted to the central hub.





DESCRIPTION OF THE DRAWINGS


FIG. 1 is an overhead view of a potential arrangement for locations of the robotic system, patient, surgeon, and other medical personnel during a surgical procedure;



FIG. 2 illustrates the robotic system including positioning of the surgical robot and the camera relative to the patient according to one embodiment;



FIG. 3 illustrates a surgical robotic system in accordance with an exemplary embodiment;



FIG. 4 illustrates a portion of a surgical robot in accordance with an exemplary embodiment;



FIG. 5 illustrates a block diagram of a surgical robot in accordance with an exemplary embodiment;



FIG. 6 illustrates a surgical robot in accordance with an exemplary embodiment;



FIGS. 7A-7C illustrate an end-effector in accordance with an exemplary embodiment;



FIG. 8 illustrates a surgical instrument and the end-effector, before and after, inserting the surgical instrument into the guide tube of the end-effector according to one embodiment;



FIGS. 9A-9C illustrate portions of an end-effector and robot arm in accordance with an exemplary embodiment;



FIG. 10 illustrates a dynamic reference array, an imaging array, and other components in accordance with an exemplary embodiment;



FIG. 11 illustrates a method of registration in accordance with an exemplary embodiment;



FIG. 12A-12B illustrate embodiments of imaging devices according to exemplary embodiments;



FIG. 13 is a top plan view of a robot device equipped with the control system and omni-directional wheels (“omni-wheels”) of the present disclosure and depicting a first example of an array of sensors;



FIGS. 14A-14D depict arrays of sensors useful in moving the robot;



FIGS. 15A and 15B depict configurations for applying power to the omni-wheels of the robot;



FIG. 16 is a perspective view of an example of a first type of omni-directional wheel (“omni-wheel”) useful in imaging systems according to the present disclosure;



FIG. 17 is a perspective view of an example of a second type of omni-wheel useful in the present disclosure;



FIG. 18 is a perspective view of an example of a third type of omni-wheel useful in the present disclosure; and



FIG. 19 is an elevational view of an example of a fourth type of omni-wheel useful in the present disclosure.





DETAILED DESCRIPTION

It is to be understood that the present disclosure is not limited in its application to the details of construction and the arrangement of components set forth in the description herein or illustrated in the drawings. The teachings of the present disclosure may be used and practiced in other embodiments and practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless specified or limited otherwise, the terms “mounted,” “connected,” “supported,” and “coupled” and variations thereof are used broadly and encompass both direct and indirect mountings, connections, supports, and couplings. Further, “connected” and “coupled” are not restricted to physical or mechanical connections or couplings.


The following discussion is presented to enable a person skilled in the art to make and use embodiments of the present disclosure. Various modifications to the illustrated embodiments will be readily apparent to those skilled in the art, and the principles herein can be applied to other embodiments and applications without departing from embodiments of the present disclosure. Thus, the embodiments are not intended to be limited to embodiments shown, but are to be accorded the widest scope consistent with the principles and features disclosed herein. The following detailed description is to be read with reference to the figures, in which like elements in different figures have like reference numerals. The figures, which are not necessarily to scale, depict selected embodiments and are not intended to limit the scope of the embodiments. Skilled artisans will recognize the examples provided herein have many useful alternatives and fall within the scope of the embodiments.


Turning now to the drawing, FIGS. 1 and 2 illustrate a surgical robot system 100 in accordance with an exemplary embodiment. Surgical robot system 100 may include, for example, a surgical robot 102, one or more robot arms 104, a base 106, a display 110, an end-effector 112, for example, including a guide tube 114, and one or more tracking markers 118. The surgical robot system 100 may include a patient tracking device 116 also including one or more tracking markers 118, which is adapted to be secured directly to the patient 210 (e.g., to the bone of the patient 210). The surgical robot system 100 may also utilize a camera 200, for example, positioned on a camera stand 202. The camera stand 202 can have any suitable configuration to move, orient, and support the camera 200 in a desired position. The camera 200 may include any suitable camera or cameras, such as one or more infrared cameras (e.g., bifocal or stereophotogrammetric cameras), able to identify, for example, active and passive tracking markers 118 in a given measurement volume viewable from the perspective of the camera 200. The camera 200 may scan the given measurement volume and detect the light that comes from the markers 118 in order to identify and determine the position of the markers 118 in three-dimensions. For example, active markers 118 may include infrared-emitting markers that are activated by an electrical signal (e.g., infrared light emitting diodes (LEDs)), and passive markers 118 may include retro-reflective markers that reflect infrared light (e.g., they reflect incoming IR radiation into the direction of the incoming light), for example, emitted by illuminators on the camera 200 or other suitable device.



FIGS. 1 and 2 illustrate a potential configuration for the placement of the surgical robot system 100 in an operating room environment. For example, the robot 102 may be positioned near or next to patient 210. Although depicted near the head of the patient 210, it will be appreciated that the robot 102 can be positioned at any suitable location near the patient 210 depending on the area of the patient 210 undergoing the operation. The camera 200 may be separated from the robot system 100 and positioned at the foot of patient 210. This location allows the camera 200 to have a direct visual line of sight to the surgical field 208. Again, it is contemplated that the camera 200 may be located at any suitable position having line of sight to the surgical field 208. In the configuration shown, the surgeon 120 may be positioned across from the robot 102, but is still able to manipulate the end-effector 112 and the display 110. A surgical assistant 126 may be positioned across from the surgeon 120 again with access to both the end-effector 112 and the display 110. If desired, the locations of the surgeon 120 and the assistant 126 may be reversed. The traditional areas for the anesthesiologist 122 and the nurse or scrub tech 124 remain unimpeded by the locations of the robot 102 and camera 200.


With respect to the other components of the robot 102, the display 110 can be attached to the surgical robot 102 and in other exemplary embodiments, display 110 can be detached from surgical robot 102, either within a surgical room with the surgical robot 102, or in a remote location. End-effector 112 may be coupled to the robot arm 104 and controlled by at least one motor. In exemplary embodiments, end-effector 112 can comprise a guide tube 114, which is able to receive and orient a surgical instrument 608 (described further herein) used to perform surgery on the patient 210. As used herein, the term “end-effector” is used interchangeably with the terms “end-effectuator” and “effectuator element.” Although generally shown with a guide tube 114, it will be appreciated that the end-effector 112 may be replaced with any suitable instrumentation suitable for use in surgery. In some embodiments, end-effector 112 can comprise any known structure for effecting the movement of the surgical instrument 608 in a desired manner.


The surgical robot 102 is able to control the translation and orientation of the end-effector 112. The robot 102 is able to move end-effector 112 along x-, y-, and z-axes, for example. The end-effector 112 can be configured for selective rotation about one or more of the x-, y-, and z-axis, and a Z Frame axis (such that one or more of the Euler Angles (e.g., roll, pitch, and/or yaw) associated with end-effector 112 can be selectively controlled). In some exemplary embodiments, selective control of the translation and orientation of end-effector 112 can permit performance of medical procedures with significantly improved accuracy compared to conventional robots that utilize, for example, a six degree of freedom robot arm comprising only rotational axes. For example, the surgical robot system 100 may be used to operate on patient 210, and robot arm 104 can be positioned above the body of patient 210, with end-effector 112 selectively angled relative to the z-axis toward the body of patient 210.


In some exemplary embodiments, the position of the surgical instrument 608 can be dynamically updated so that surgical robot 102 can be aware of the location of the surgical instrument 608 at all times during the procedure. Consequently, in some exemplary embodiments, surgical robot 102 can move the surgical instrument 608 to the desired position quickly without any further assistance from a physician (unless the physician so desires). In some further embodiments, surgical robot 102 can be configured to correct the path of the surgical instrument 608 if the surgical instrument 608 strays from the selected, preplanned trajectory. In some exemplary embodiments, surgical robot 102 can be configured to permit stoppage, modification, and/or manual control of the movement of end-effector 112 and/or the surgical instrument 608. Thus, in use, in exemplary embodiments, a physician or other user can operate the system 100, and has the option to stop, modify, or manually control the autonomous movement of end-effector 112 and/or the surgical instrument 608. Further details of surgical robot system 100 including the control and movement of a surgical instrument 608 by surgical robot 102 can be found in co-pending U.S. patent application Ser. No. 13/924,505, which is incorporated herein by reference in its entirety.


The robotic surgical system 100 can comprise one or more tracking markers 118 configured to track the movement of robot arm 104, end-effector 112, patient 210, and/or the surgical instrument 608 in three dimensions. In exemplary embodiments, a plurality of tracking markers 118 can be mounted (or otherwise secured) thereon to an outer surface of the robot 102, such as, for example and without limitation, on base 106 of robot 102, on robot arm 104, or on the end-effector 112. In exemplary embodiments, at least one tracking marker 118 of the plurality of tracking markers 118 can be mounted or otherwise secured to the end-effector 112. One or more tracking markers 118 can further be mounted (or otherwise secured) to the patient 210. In exemplary embodiments, the plurality of tracking markers 118 can be positioned on the patient 210 spaced apart from the surgical field 208 to reduce the likelihood of being obscured by the surgeon, surgical tools, or other parts of the robot 102. Further, one or more tracking markers 118 can be further mounted (or otherwise secured) to the surgical tools 608 (e.g., a screw driver, dilator, implant inserter, or the like). Thus, the tracking markers 118 enable each of the marked objects (e.g., the end-effector 112, the patient 210, and the surgical tools 608) to be tracked by the robot 102. In exemplary embodiments, system 100 can use tracking information collected from each of the marked objects to calculate the orientation and location, for example, of the end-effector 112, the surgical instrument 608 (e.g., positioned in the tube 114 of the end-effector 112), and the relative position of the patient 210.


In exemplary embodiments, one or more of markers 118 may be optical markers. In some embodiments, the positioning of one or more tracking markers 118 on end-effector 112 can maximize the accuracy of the positional measurements by serving to check or verify the position of end-effector 112. Further details of surgical robot system 100 including the control, movement and tracking of surgical robot 102 and of a surgical instrument 608 can be found in co-pending U.S. patent application Ser. No. 13/924,505, which is incorporated herein by reference in its entirety.


Exemplary embodiments include one or more markers 118 coupled to the surgical instrument 608. In exemplary embodiments, these markers 118, for example, coupled to the patient 210 and surgical instruments 608, as well as markers 118 coupled to the end-effector 112 of the robot 102 can comprise conventional infrared light-emitting diodes (LEDs) or an Optotrak® diode capable of being tracked using a commercially available infrared optical tracking system such as Optotrak®. Optotrak® is a registered trademark of Northern Digital Inc., Waterloo, Ontario, Canada. In other embodiments, markers 118 can comprise conventional reflective spheres capable of being tracked using a commercially available optical tracking system such as Polaris Spectra. Polaris Spectra is also a registered trademark of Northern Digital, Inc. In an exemplary embodiment, the markers 118 coupled to the end-effector 112 are active markers which comprise infrared light-emitting diodes which may be turned on and off, and the markers 118 coupled to the patient 210 and the surgical instruments 608 comprise passive reflective spheres.


In exemplary embodiments, light emitted from and/or reflected by markers 118 can be detected by camera 200 and can be used to monitor the location and movement of the marked objects. In alternative embodiments, markers 118 can comprise a radio-frequency and/or electromagnetic reflector or transceiver and the camera 200 can include or be replaced by a radio-frequency and/or electromagnetic transceiver.


Similar to surgical robot system 100, FIG. 3 illustrates a surgical robot system 300 and camera stand 302, in a docked configuration, consistent with an exemplary embodiment of the present disclosure. Surgical robot system 300 may comprise a robot 301 including a display 304, upper arm 306, lower arm 308, end-effector 310, vertical column 312, casters 314, cabinet 316, tablet drawer 318, connector panel 320, control panel 322, and ring of information 324. Camera stand 302 may comprise camera 326. These components are described in greater with respect to FIG. 5. FIG. 3 illustrates the surgical robot system 300 in a docked configuration where the camera stand 302 is nested with the robot 301, for example, when not in use. It will be appreciated by those skilled in the art that the camera 326 and robot 301 may be separated from one another and positioned at any appropriate location during the surgical procedure, for example, as shown in FIGS. 1 and 2.



FIG. 4 illustrates a base 400 consistent with an exemplary embodiment of the present disclosure. Base 400 may be a portion of surgical robot system 300 and comprise cabinet 316. Cabinet 316 may house certain components of surgical robot system 300 including but not limited to a battery 402, a power distribution module 404, a platform interface board module 406, a computer 408, a handle 412, and a tablet drawer 414. The connections and relationship between these components is described in greater detail with respect to FIG. 5.



FIG. 5 illustrates a block diagram of certain components of an exemplary embodiment of surgical robot system 300. Surgical robot system 300 may comprise platform subsystem 502, computer subsystem 504, motion control subsystem 506, and tracking subsystem 532. Platform subsystem 502 may further comprise battery 402, power distribution module 404, platform interface board module 406, and tablet charging station 534. Computer subsystem 504 may further comprise computer 408, display 304, and speaker 536. Motion control subsystem 506 may further comprise driver circuit 508, motors 510, 512, 514, 516, 518, stabilizers 520, 522, 524, 526, end-effector 310, and controller 538. Tracking subsystem 532 may further comprise position sensor 540 and camera converter 542. System 300 may also comprise a foot pedal 544 and tablet 546.


Input power is supplied to system 300 via a power source 548 which may be provided to power distribution module 404. Power distribution module 404 receives input power and is configured to generate different power supply voltages that are provided to other modules, components, and subsystems of system 300. Power distribution module 404 may be configured to provide different voltage supplies to platform interface module 406, which may be provided to other components such as computer 408, display 304, speaker 536, driver 508 to, for example, power motors 512, 514, 516, 518 and end-effector 310, motor 510, ring 324, camera converter 542, and other components for system 300 for example, fans for cooling the electrical components within cabinet 316.


Power distribution module 404 may also provide power to other components such as tablet charging station 534 that may be located within tablet drawer 318. Tablet charging station 534 may be in wireless or wired communication with tablet 546 for charging table 546. Tablet 546 may be used by a surgeon consistent with the present disclosure and described herein.


Power distribution module 404 may also be connected to battery 402, which serves as temporary power source in the event that power distribution module 404 does not receive power from input power 548. At other times, power distribution module 404 may serve to charge battery 402 if necessary.


Other components of platform subsystem 502 may also include connector panel 320, control panel 322, and ring 324. Connector panel 320 may serve to connect different devices and components to system 300 and/or associated components and modules. Connector panel 320 may contain one or more ports that receive lines or connections from different components. For example, connector panel 320 may have a ground terminal port that may ground system 300 to other equipment, a port to connect foot pedal 544 to system 300, a port to connect to tracking subsystem 532, which may comprise position sensor 540, camera converter 542, and cameras 326 associated with camera stand 302. Connector panel 320 may also include other ports to allow USB, Ethernet, HDMI communications to other components, such as computer 408.


Control panel 322 may provide various buttons or indicators that control operation of system 300 and/or provide information regarding system 300. For example, control panel 322 may include buttons to power on or off system 300, lift or lower vertical column 312, and lift or lower stabilizers 520-526 that may be designed to engage casters 314 to lock system 300 from physically moving. Other buttons may stop system 300 in the event of an emergency, which may remove all motor power and apply mechanical brakes to stop all motion from occurring. Control panel 322 may also have indicators notifying the user of certain system conditions such as a line power indicator or status of charge for battery 402.


Ring 324 may be a visual indicator to notify the user of system 300 of different modes that system 300 is operating under and certain warnings to the user.


Computer subsystem 504 includes computer 408, display 304, and speaker 536. Computer 504 includes an operating system and software to operate system 300. Computer 504 may receive and process information from other components (for example, tracking subsystem 532, platform subsystem 502, and/or motion control subsystem 506) in order to display information to the user. Further, computer subsystem 504 may also include speaker 536 to provide audio to the user.


Tracking subsystem 532 may include position sensor 504 and converter 542. Tracking subsystem 532 may correspond to camera stand 302 including camera 326 as described with respect to FIG. 3. Position sensor 504 may be camera 326. Tracking subsystem may track the location of certain markers that are located on the different components of system 300 and/or instruments used by a user during a surgical procedure. This tracking may be conducted in a manner consistent with the present disclosure including the use of infrared technology that tracks the location of active or passive elements, such as LEDs or reflective markers, respectively. The location, orientation, and position of structures having these types of markers may be provided to computer 408 which may be shown to a user on display 304. For example, a surgical instrument 608 having these types of markers and tracked in this manner (which may be referred to as a navigational space) may be shown to a user in relation to a three dimensional image of a patient's anatomical structure.


Motion control subsystem 506 may be configured to physically move vertical column 312, upper arm 306, lower arm 308, or rotate end-effector 310. The physical movement may be conducted through the use of one or more motors 510-518. For example, motor 510 may be configured to vertically lift or lower vertical column 312. Motor 512 may be configured to laterally move upper arm 308 around a point of engagement with vertical column 312 as shown in FIG. 3. Motor 514 may be configured to laterally move lower arm 308 around a point of engagement with upper arm 308 as shown in FIG. 3. Motors 516 and 518 may be configured to move end-effector 310 in a manner such that one may control the roll and one may control the tilt, thereby providing multiple angles that end-effector 310 may be moved. These movements may be achieved by controller 538 which may control these movements through load cells disposed on end-effector 310 and activated by a user engaging these load cells to move system 300 in a desired manner.


Moreover, system 300 may provide for automatic movement of vertical column 312, upper arm 306, and lower arm 308 through a user indicating on display 304 (which may be a touchscreen input device) the location of a surgical instrument or component on three dimensional image of the patient's anatomy on display 304. The user may initiate this automatic movement by stepping on foot pedal 544 or some other input means.



FIG. 6 illustrates a surgical robot system 600 consistent with an exemplary embodiment. Surgical robot system 600 may comprise end-effector 602, robot arm 604, guide tube 606, instrument 608, and robot base 610. Instrument tool 608 may be attached to a tracking array 612 including one or more tracking markers (such as markers 118) and have an associated trajectory 614. Trajectory 614 may represent a path of movement that instrument tool 608 is configured to travel once it is positioned through or secured in guide tube 606, for example, a path of insertion of instrument tool 608 into a patient. In an exemplary operation, robot base 610 may be configured to be in electronic communication with robot arm 604 and end-effector 602 so that surgical robot system 600 may assist a user (for example, a surgeon) in operating on the patient 210. Surgical robot system 600 may be consistent with previously described surgical robot system 100 and 300.


A tracking array 612 may be mounted on instrument 608 to monitor the location and orientation of instrument tool 608. The tracking array 612 may be attached to an instrument 608 and may comprise tracking markers 804. As best seen in FIG. 8, tracking markers 804 may be, for example, light emitting diodes and/or other types of reflective markers (e.g., markers 118 as described elsewhere herein). The tracking devices may be one or more line of sight devices associated with the surgical robot system. As an example, the tracking devices may be one or more cameras 200, 326 associated with the surgical robot system 100, 300 and may also track tracking array 612 for a defined domain or relative orientations of the instrument 608 in relation to the robot arm 604, the robot base 610, end-effector 602, and/or the patient 210. The tracking devices may be consistent with those structures described in connection with camera stand 302 and tracking subsystem 532.



FIGS. 7A, 7B, and 7C illustrate a top view, front view, and side view, respectively, of end-effector 602 consistent with an exemplary embodiment. End-effector 602 may comprise one or more tracking markers 702. Tracking markers 702 may be light emitting diodes or other types of active and passive markers, such as tracking markers 118 that have been previously described. In an exemplary embodiment, the tracking markers 702 are active infrared-emitting markers that are activated by an electrical signal (e.g., infrared light emitting diodes (LEDs)). Thus, tracking markers 702 may be activated such that the infrared markers 702 are visible to the camera 200, 326 or may be deactivated such that the infrared markers 702 are not visible to the camera 200, 326. Thus, when the markers 702 are active, the end-effector 602 may be controlled by the system 100, 300, 600, and when the markers 702 are deactivated, the end-effector 602 may be locked in position and unable to be moved by the system 100, 300, 600.


Markers 702 may be disposed on or within end-effector 602 in a manner such that the markers 702 are visible by one or more cameras 200, 326 or other tracking devices associated with the surgical robot system 100, 300, 600. The camera 200, 326 or other tracking devices may track end-effector 602 as it moves to different positions and viewing angles by following the movement of tracking markers 702. The location of markers 702 and/or end-effector 602 may be shown on a display 110, 304 associated with the surgical robot system 100, 300, 600, for example, display 110 as shown in FIG. 2 and/or display 304 shown in FIG. 3. This display 110, 304 may allow a user to ensure that end-effector 602 is in a desirable position in relation to robot arm 604, robot base 610, the patient 210, and/or the user.


For example, as shown in FIG. 7A, markers 702 may be placed around the surface of end-effector 602 so that a tracking device placed away from the surgical field 208 and facing toward the robot 102, 301 and the camera 200, 326 is able to view at least 3 of the markers 702 through a range of common orientations of the end-effector 602 relative to the tracking device 100, 300, 600. For example, distribution of markers 702 in this way allows end-effector 602 to be monitored by the tracking devices when end-effector 602 is translated and rotated in the surgical field 208.


In addition, in exemplary embodiments, end-effector 602 may be equipped with infrared (IR) receivers that can detect when an external camera 200, 326 is getting ready to read markers 702. Upon this detection, end-effector 602 may then illuminate markers 702. The detection by the IR receivers that the external camera 200, 326 is ready to read markers 702 may signal the need to synchronize a duty cycle of markers 702, which may be light emitting diodes, to an external camera 200, 326. This may also allow for lower power consumption by the robotic system as a whole, whereby markers 702 would only be illuminated at the appropriate time instead of being illuminated continuously. Further, in exemplary embodiments, markers 702 may be powered off to prevent interference with other navigation tools, such as different types of surgical instruments 608.



FIG. 8 depicts one type of surgical instrument 608 including a tracking array 612 and tracking markers 804. Tracking markers 804 may be of any type described herein including but not limited to light emitting diodes or reflective spheres. Markers 804 are monitored by tracking devices associated with the surgical robot system 100, 300, 600 and may be one or more of the line of sight cameras 200, 326. The cameras 200, 326 may track the location of instrument 608 based on the position and orientation of tracking array 612 and markers 804. A user, such as a surgeon 120, may orient instrument 608 in a manner so that tracking array 612 and markers 804 are sufficiently recognized by the tracking device or camera 200, 326 to display instrument 608 and markers 804 on, for example, display 110 of the exemplary surgical robot system.


The manner in which a surgeon 120 may place instrument 608 into guide tube 606 of the end-effector 602 and adjust the instrument 608 is evident in FIG. 8. The hollow tube or guide tube 114, 606 of the end-effector 112, 310, 602 is sized and configured to receive at least a portion of the surgical instrument 608. The guide tube 114, 606 is configured to be oriented by the robot arm 104 such that insertion and trajectory for the surgical instrument 608 is able to reach a desired anatomical target within or upon the body of the patient 210. The surgical instrument 608 may include at least a portion of a generally cylindrical instrument. Although a screw driver is exemplified as the surgical tool 608, it will be appreciated that any suitable surgical tool 608 may be positioned by the end-effector 602. By way of example, the surgical instrument 608 may include one or more of a guide wire, cannula, a retractor, a drill, a reamer, a screw driver, an insertion tool, a removal tool, or the like. Although the hollow tube 114, 606 is generally shown as having a cylindrical configuration, it will be appreciated by those of skill in the art that the guide tube 114, 606 may have any suitable shape, size and configuration desired to accommodate the surgical instrument 608 and access the surgical site.



FIGS. 9A-9C illustrate end-effector 602 and a portion of robot arm 604 consistent with an exemplary embodiment. End-effector 602 may further comprise body 1202 and clamp 1204. Clamp 1204 may comprise handle 1206, balls 1208, spring 1210, and lip 1212. Robot arm 604 may further comprise depressions 1214, mounting plate 1216, lip 1218, and magnets 1220.


End-effector 602 may mechanically interface and/or engage with the surgical robot system and robot arm 604 through one or more couplings. For example, end-effector 602 may engage with robot arm 604 through a locating coupling and/or a reinforcing coupling. Through these couplings, end-effector 602 may fasten with robot arm 604 outside a flexible and sterile barrier. In an exemplary embodiment, the locating coupling may be a magnetically kinematic mount and the reinforcing coupling may be a five bar over center clamping linkage.


With respect to the locating coupling, robot arm 604 may comprise mounting plate 1216, which may be non-magnetic material, one or more depressions 1214, lip 1218, and magnets 1220. Magnet 1220 is mounted below each of depressions 1214. Portions of clamp 1204 may comprise magnetic material and be attracted by one or more magnets 1220. Through the magnetic attraction of clamp 1204 and robot arm 604, balls 1208 become seated into respective depressions 1214. For example, balls 1208 as shown in FIG. 9B would be seated in depressions 1214 as shown in FIG. 9A. This seating may be considered a magnetically-assisted kinematic coupling. Magnets 1220 may be configured to be strong enough to support the entire weight of end-effector 602 regardless of the orientation of end-effector 602. The locating coupling may be any style of kinematic mount that uniquely restrains six degrees of freedom.


With respect to the reinforcing coupling, portions of clamp 1204 may be configured to be a fixed ground link and as such clamp 1204 may serve as a five bar linkage. Closing clamp handle 1206 may fasten end-effector 602 to robot arm 604 as lip 1212 and lip 1218 engage clamp 1204 in a manner to secure end-effector 602 and robot arm 604. When clamp handle 1206 is closed, spring 1210 may be stretched or stressed while clamp 1204 is in a locked position. The locked position may be a position that provides for linkage past center. Because of a closed position that is past center, the linkage will not open absent a force applied to clamp handle 1206 to release clamp 1204. Thus, in a locked position end-effector 602 may be robustly secured to robot arm 604.


Spring 1210 may be a curved beam in tension. Spring 1210 may be comprised of a material that exhibits high stiffness and high yield strain such as virgin PEEK (poly-ether-ether-ketone). The linkage between end-effector 602 and robot arm 604 may provide for a sterile barrier between end-effector 602 and robot arm 604 without impeding fastening of the two couplings.


The reinforcing coupling may be a linkage with multiple spring members. The reinforcing coupling may latch with a cam or friction based mechanism. The reinforcing coupling may also be a sufficiently powerful electromagnet that will support fastening end-effector 102 to robot arm 604. The reinforcing coupling may be a multi-piece collar completely separate from either end-effector 602 and/or robot arm 604 that slips over an interface between end-effector 602 and robot arm 604 and tightens with a screw mechanism, an over center linkage, or a cam mechanism.


Referring to FIGS. 10 and 11, prior to or during a surgical procedure, certain registration procedures may be conducted in order to track objects and a target anatomical structure of the patient 210 both in a navigation space and an image space. In order to conduct such registration, a registration system 1400 may be used as illustrated in FIG. 10.


In order to track the position of the patient 210, a patient tracking device 116 may include a patient fixation instrument 1402 to be secured to a rigid anatomical structure of the patient 210 and a dynamic reference base (DRB) 1404 may be securely attached to the patient fixation instrument 1402. For example, patient fixation instrument 1402 may be inserted into opening 1406 of dynamic reference base 1404. Dynamic reference base 1404 may contain markers 1408 that are visible to tracking devices, such as tracking subsystem 532. These markers 1408 may be optical markers or reflective spheres, such as tracking markers 118, as previously discussed herein.


Patient fixation instrument 1402 is attached to a rigid anatomy of the patient 210 and may remain attached throughout the surgical procedure. In an exemplary embodiment, patient fixation instrument 1402 is attached to a rigid area of the patient 210, for example, a bone that is located away from the targeted anatomical structure subject to the surgical procedure. In order to track the targeted anatomical structure, dynamic reference base 1404 is associated with the targeted anatomical structure through the use of a registration fixture that is temporarily placed on or near the targeted anatomical structure in order to register the dynamic reference base 1404 with the location of the targeted anatomical structure.


A registration fixture 1410 is attached to patient fixation instrument 1402 through the use of a pivot arm 1412. Pivot arm 1412 is attached to patient fixation instrument 1402 by inserting patient fixation instrument 1402 through an opening 1414 of registration fixture 1410. Pivot arm 1412 is attached to registration fixture 1410 by, for example, inserting a knob 1416 through an opening 1418 of pivot arm 1412.


Using pivot arm 1412, registration fixture 1410 may be placed over the targeted anatomical structure and its location may be determined in an image space and navigation space using tracking markers 1420 and/or fiducials 1422 on registration fixture 1410. Registration fixture 1410 may contain a collection of markers 1420 that are visible in a navigational space (for example, markers 1420 may be detectable by tracking subsystem 532). Tracking markers 1420 may be optical markers visible in infrared light as previously described herein. Registration fixture 1410 may also contain a collection of fiducials 1422, for example, such as bearing balls, that are visible in an imaging space (for example, a three dimension CT image). As described in greater detail with respect to FIG. 11, using registration fixture 1410, the targeted anatomical structure may be associated with dynamic reference base 1404 thereby allowing depictions of objects in the navigational space to be overlaid on images of the anatomical structure. Dynamic reference base 1404, located at a position away from the targeted anatomical structure, may become a reference point thereby allowing removal of registration fixture 1410 and/or pivot arm 1412 from the surgical area.



FIG. 11 provides an exemplary method 1500 for registration consistent with the present disclosure. Method 1500 begins at step 1502 wherein a graphical representation (or image(s)) of the targeted anatomical structure may be imported into system 100, 300600, for example computer 408. The graphical representation may be three dimensional CT or a fluoroscope scan of the targeted anatomical structure of the patient 210 which includes registration fixture 1410 and a detectable imaging pattern of fiducials 1420.


At step 1504, an imaging pattern of fiducials 1420 is detected and registered in the imaging space and stored in computer 408. Optionally, at this time at step 1506, a graphical representation of the registration fixture 1410 may be overlaid on the images of the targeted anatomical structure.


At step 1508, a navigational pattern of registration fixture 1410 is detected and registered by recognizing markers 1420. Markers 1420 may be optical markers that are recognized in the navigation space through infrared light by tracking subsystem 532 via position sensor 540. Thus, the location, orientation, and other information of the targeted anatomical structure is registered in the navigation space. Therefore, registration fixture 1410 may be recognized in both the image space through the use of fiducials 1422 and the navigation space through the use of markers 1420. At step 1510, the registration of registration fixture 1410 in the image space is transferred to the navigation space. This transferal is done, for example, by using the relative position of the imaging pattern of fiducials 1422 compared to the position of the navigation pattern of markers 1420.


At step 1512, registration of the navigation space of registration fixture 1410 (having been registered with the image space) is further transferred to the navigation space of dynamic registration array 1404 attached to patient fixture instrument 1402. Thus, registration fixture 1410 may be removed and dynamic reference base 1404 may be used to track the targeted anatomical structure in both the navigation and image space because the navigation space is associated with the image space.


At steps 1514 and 1516, the navigation space may be overlaid on the image space and objects with markers visible in the navigation space (for example, surgical instruments 608 with optical markers 804). The objects may be tracked through graphical representations of the surgical instrument 608 on the images of the targeted anatomical structure.



FIGS. 12A-12B illustrate imaging devices 1304 that may be used in conjunction with robot systems 100, 300, 600 to acquire pre-operative, intra-operative, post-operative, and/or real-time image data of patient 210. Any appropriate subject matter may be imaged for any appropriate procedure using the imaging system 1304. The imaging system 1304 may be any imaging device such as imaging device 1306 and/or a C-arm 1308 device. It may be desirable to take x-rays of patient 210 from a number of different positions, without the need for frequent manual repositioning of patient 210 which may be required in an x-ray system. As illustrated in FIG. 12A, the imaging system 1304 may be in the form of a C-arm 1308 that includes an elongated C-shaped member terminating in opposing distal ends 1312 of the “C” shape. C-shaped member 1130 may further comprise an x-ray source 1314 and an image receptor 1316. The space within C-arm 1308 of the arm may provide room for the physician to attend to the patient substantially free of interference from x-ray support structure 1318. As illustrated in FIG. 12B, the imaging system may include imaging device 1306 having a gantry housing 1324 attached to a support structure imaging device support structure 1328, such as a wheeled mobile cart 1330 with wheels 1332, which may enclose an image capturing portion, not illustrated. The image capturing portion may include an x-ray source and/or emission portion and an x-ray receiving and/or image receiving portion, which may be disposed about one hundred and eighty degrees from each other and mounted on a rotor (not illustrated) relative to a track of the image capturing portion. The image capturing portion may be operable to rotate three hundred and sixty degrees during image acquisition. The image capturing portion may rotate around a central point and/or axis, allowing image data of patient 210 to be acquired from multiple directions or in multiple planes. Although certain imaging systems 1304 are exemplified herein, it will be appreciated that any suitable imaging system may be selected by one of ordinary skill in the art.


Turning now to FIGS. 13-19, sensor-controlled and/or omni-directional movement of the robot system is described. In particular, various embodiments may provide controlled movement of the system, for example, in any X-Y direction with Wag-rotation about any Z-axis using omni-directional wheels 62, 64.


With reference to FIG. 13, one embodiment of a control system 20 for sensor-controlled movement of the robot system is shown. As described earlier, the control system 20 may include computer subsystem 504, motion control subsystem 506. Input devices may include a display 110 with touch screen capabilities, a keyboard with function keys 12, handles 17, 19, a joystick 14, or the like. Any of these input devices may control either or both of the motion control portion 506 and the computer subsystem 504. Switching between a motion control mode and a robot control mode may be accomplished by a function key, a touch screen command from one of the display devices, or other desired method. The robot system may also include, as part of the motion control portion 506 and/or computer subsystem 504, a smart phone or cellular phone link or global positioning system (GPS) that may be useful for communicating information concerning a position of the patient or the robot system.


Control system 20 of FIG. 13 is depicted as a plan view of the robot system, depicting a top view of the surgical robot 102 and the robot arm 104. Omni-wheels 62, 64 are separated into front portion omni-wheels 62, left and right, and rear portion omni-wheels 64, also left and right. FIG. 13 also depicts the three axes for the three degrees of omni-wheel freedom of motion of the system. As depicted in the figure, these include freedom to move left or right along a y-axis, freedom to move forward and backward along an x-axis, and freedom of rotation along a rotational axis Wag that is perpendicular to a plane formed by the x and y axes, i.e., a vertical axis. Thus, the vertical axis Wag in FIG. 13 is perpendicular to the plane of the drawing.



FIG. 13 may also provide a useful reference for a discussion of the sensors used in this disclosure. Left sensors 21, 25 are mounted on the left handle 17 while right sensors 23 and 27 are mounted on the right handle 19. A first embodiment may include these four sensors 21, 23, 25, 27, as shown. A person, such as a health care professional operating the robot system 100, may position the device by using the handles 17, 19 and the motion control portion 504.


In one embodiment, the motion control may have two modes, a transport mode and a fine-tune mode. For example, if the robot system 100 is transported from one wing of a hospital or other health-care facility, speed may be more highly valued than fine-tuned positioning. Thus, pushing on the rear portion handles 17, 19 of system 100 may activate the transport mode. Pushing on either of the two handles 17, 19 may activate a fine-tune mode, in which every movement of the omni-wheels 62, 64 is slower and more deliberate. Switching between these modes may also be accomplished by appropriate programming allowing the user to switch via a function key, a command, a touch-screen input, and so forth.


In fine tune mode, motion control 504 may be used to return the robot system 100 to a set position, e.g., reset to a predetermined position. For example, and with reference to FIG. 3, if a surgical procedure has concluded, the user may wish to move the robot system 100 to a preset configuration. The position may be programmed into the motion control 504. This may be accomplished using the keyboard or function buttons 12 available to the operator, the touch screens of the display devices 110, a joystick 14 or a predetermined applied force and direction to the handles 17, 19. The keyboard, the function buttons and the touch screen display devices may also be used to control the robot functions and motion control portions, including movement of the omni-directional wheels 62, 64.


The capabilities of the omni-wheels 62, 64 may also be used so that the system moves about a specified axis. This may be any convenient axis, such as a geometrical center of the robot 100, a particular feature or part of the robot system 100 or its base 106, a feature of the robot, such as the end-effector 112 mounted thereon, and so forth. The motion applied by the omni-wheels 62, 64 may also be proportional to the force(s) applied to the sensor(s) 21, 23, 25, 27—a light force may result in slower, more deliberate speed while a higher force or heavier touch may result in higher speeds applied by the omni-wheels 62, 64. In addition, the direction in which the forces are applied may indicate the desired direction of movement of robot system 100. The forces applied to the sensor(s) 21, 23, 25, 27 may be resolved by motion control 504 into a resultant vector and moment that is used to drive each of front wheels 62 and rear wheels 64, as needed, to provide the desired motion.


We now discuss examples of movement using FIG. 13. In one example, pushing the left handle 17 forward would operate to cause the device to go forward and turn the device to the right. In another example, pushing the left handle 17 activates sensors 21, 25 to require forward movement. The sensor(s) 21, 23, 25, 27 may be strain gauges that interpret the force as applied in a particular direction for sensors 21, 25, forward, but with no force applied to sensors 23, 27. Since no force is applied to the right handle 19 and its sensors 23, 27, motion control 504 interprets the signals from the sensors 23, 27 as calling for a right turn with only a slight forward motion. Thus, the robot 100 makes a tight turn to the right with minimal forward movement via the omni-wheels 62, 64. In embodiments, all four wheels 62, 64 may move in this example to achieve a slight rightward turn movement. The wheels 62, 64 may be controlled individually so that their movements together achieve a desired movement of the robot base 106. As discussed above, this is an example of movement in a fine-tune mode. In other embodiments, only the left wheels 62, 64 may be activated or only the right wheels 62, 64, depending on the desired movement.


In another example, pushing left handle 17 to the right applies a force to sensors 21, 25, calling for rightward lateral or side movement. If no forward or backward force is applied to the sensors 21, 25 and no force is applied to right sensors 23, 27, motion control 504 interprets the signals as calling for rightward lateral movement with no forward or backward motion, still in a fine-tune mode. Accordingly, all four omni-wheels 62, 64 may make a small movement in the direction indicated, i.e., a few mm or inches to the right. In another example, the front wheels 62 may turn in a forward and leftward direction while the rear wheels 64 turn backwards and to the right to achieve a left turn or rotation in position. In another example, pushing both handles 17, 19 to the left will bring up a transport mode rather than a fine-movement mode. This may cause the robot 100 to move to the left to a leftward position. The same may be said for pushing both handles 17, 19 forward, in an x-axis direction, to move the base 106 forward, now in a transport mode rather than in a fine-tune mode. Although described with reference to applying a force to specific handles 17, 19 and sensors 21, 23, 25, 27, it will be appreciated that more or less handles and/or sensors may be employed with the system. In addition, different forces and/or movements may occur in a number of different configurations in order to employ the fine-tune and/or transport modes and/or to move the robot system 100 about the operating room. It is also envisioned that these types of sensors, omni-wheels, and movement controls may be applied to other equipment in the operating room environment including the camera stand 202, carts, imaging devices, or other heavy machinery or operating room equipment.


The sensors 21, 23, 25, 27 used in embodiments of the present disclosure may include one or more force sensors. These include strain gauges, force-sensing resistors, piezo-electric sensors, piezocapacitive pressure sensors, piezoresistors and microelectro-mechanical systems (MEMS) micro-scale strain gauges. Typically, a force sensor possesses an electrical property that is changed when a user applies a force to the sensor. The property may be an electrical conductance, a resistance or a capacitance that increases or decreases in a predictable manner when a force is applied. Piezo-type sensors may generate a small microvoltage when a pressure is applied. The sensor may be part of an electrical circuit for detecting such a change, e.g., a Wheatstone bridge. By using an array or plurality of strain gauges or sensors, the user may fine-tune the direction of the desired force to be applied to the omni-wheels.


The sensors 21, 23, 25, 27 used in FIG. 13 and in the examples below may be used to control the wheels 62, 64 of the robot system 100. Examples of such techniques are depicted in FIGS. 15A and 15B. In FIG. 15A, the base 106 of the robot system 100 is depicted with front wheels 62 and rear wheels 64, which may be the same or may be different. In this embodiment, motor 1100 under the direction of the motion control 504, transmits power to each of the wheels 62, 64 as desired. The power supplied to the wheels 62, 64 may include manual operation, automatic operation, or a combination of both. The motor 1100 may have more than one shaft to supply power to axles 1102, 1104, 1106, 1108 to individually power the omni-wheels 62, 64. This allows for fine control of each wheel 62, 64 for precise placement of the base 106 and the robot equipment mounted thereon. In one embodiment, the motor 1100 and each shaft or axle 1102, 1104, 1106, 1108 may further comprise a rotary encoder or other feedback mechanism to provide positional feedback to the motion control module.


Alternatively, as depicted in FIG. 15B, base 106 may include a local controller 1120 for allocating power via separate motors 1122 that power independent axles 1124, 1126, 1128, 1130 to each of the omni-wheels 62, 64. It may be simpler for motion control 504 to maintain separate control of each omni-wheels 62, 64 via its own motor. In this embodiment, each motor 1122 may include its own encoder for positional feedback, and may also include an encoder or other feedback mechanism on axles 1124, 1126, 1128, 1130. Other methods for supplying power to the wheels 62, 64 may be used. The local controller or the motion control module may contain a computer program that resolves sensor readings into commands to each of the motors 1122 and axles 1124, 1126, 1128, 1130. With this technique, the omni-directional wheels 62, 64 are individually controlled for very accurate movement by the sensors provided. Feedback from the motion, such as from the rotary encoders on the axles 1124, 1126, 1128, 1130, or by other devices, can be used to store given positions for later use in restoring the base 106 to a desired location.


The sensors 21, 23, 25, 27 used to sense a desired direction of the robot 100 may be mounted in the handles 17, 19, as disclosed above. The sensors 21, 23, 25, 27 may alternatively be mounted in a joystick or in other types of handles, as disclosed in FIGS. 14A-14D. A first alternate embodiment is disclosed in FIG. 14A. In this control system 1610, a plurality of force sensors 1612, six sensors, are mounted in a circular arrangement. A user presses on a surface of the control system, activating the sensors 1612 to guide the robot system 100 in the appropriate direction. The direction is determined by the sensors 1612 that are activated and by the amount of force or pressure applied by the user. This is the same principle used in the example above of the handles 17, 19 of the robot 100. The circular control arrangement is useful for guiding the device in all x-y directions, in a plane. Rotation about a predetermined axis may also be achieved by pushing up or down on the joystick or by commands to the keyboard or function button inputs. For example, depressing the joystick for a few seconds may command the system to rotate clockwise about the axis, while pulling upwardly for a few seconds may command a counter-clockwise rotation.


Other examples with similar modes of operation are depicted in FIGS. 14B-14D. In FIG. 14B, eight sensors 1622 are arranged elliptically for a control system 1620 that is more suggestive of forward-backward movement, x-direction, as are the side handles. More sensors 1622 may be used for more sensitivity to the direction desired by the operator. In FIG. 14C, control system 1630 includes six force sensors 1632 mounted in a square pattern as shown, with two sensors 1632 for forward/backward movement and also with additional sensitivity for left/right or sideways direction with a four-corner distribution of the remaining four sensors 1632. FIG. 14D depicts an example of a control system 1640 configured with a plurality of sensors 1642 in a rectangular arrangement. This arrangement includes three sensors 1642 per side, allowing for finer tuning of lateral movements of the robot. Other configurations may be used to guide the robot system 100 and its omni-directional wheels 62, 64.


There are many types of omni-wheels 62, 64 useful in embodiments of the present disclosure, such as those depicted in FIGS. 16-19. Unlike traditional wheels, which only allow a device to move in one direction (e.g., forward and backward), the omni-directional wheels allow the robot to be moved in every direction (e.g., forward, backward, left, right, diagonally, in an arc, or the like). Thus, the omni-direction wheels 62, 64 allow the robot to be moved in any direction. Omni-directional wheels 62, 64 or Mecanum-type wheels generally have a central hub with a plurality of smaller wheels or rollers on its circumference. The smaller wheels are mounted at an angle to the central axis of the hub, such as 45 degrees or 90 degrees. FIG. 16 depicts an omni-directional wheel 130. This wheel 130 includes a central hub 132 about a central axis A, with a plurality of rollers or wheels 134 mounted in two non-coaxial rows 136, 138 at about a 45-degree angle to the central axis. The wheels or rollers 134 take turns being on the ground, making turning easier. These types of wheels 130 are described in U.S. Pat. Appl. 2010/0187779, which is hereby incorporated by reference in its entirety.


Another type of omni-directional wheel 62, 64 useful in the present disclosure is depicted in FIG. 17. Mecanum wheel 140 has a central hub 142 with a central axis A. A plurality of rollers 144 are mounted on flanges 146 on the periphery of the central hub 142. In this example, the flanges 146 are bent at about a 45-degree angle and thus the rollers 144 are also mounted at about a 45-degree angle to the central axis A. Other angles may be used. Each wheel 62, 64 may be powered individually to guide the robot in the desired direction. These types of wheels 140 are described in U.S. Pat. Appl. 2013/0292918, which is hereby incorporated by reference in its entirety.



FIG. 18 depicts another type of omni-directional wheel 62, 64, a Mecanum wheel 150, useful in the present disclosure. Wheel 150 includes a central hub 152 with a central hub axis A and a plurality of flat circumferential surfaces (not shown). Each surface mounts a protruding spoke 154, which is then used to mount a circumferential roller 156. In this wheel 150, only one or two of the rollers 156 is on the floor or surface at a time, making turning easier. These types of wheels 150 are described in U.S. Pat. No. 8,011,735, which is hereby incorporated by reference in its entirety.


Yet another type of omni-directional wheel 62, 64, wheel 160 is disclosed in FIG. 19. Wheel 160 includes a central hub 162 which mounts two series of spokes or mounts 164, 166. Each of the first series of spokes 164 mounts a wheel 165 whose axis of rotation is ninety-degrees opposed to a direction of rotation of wheel 160 and central hub 162. Each of the second series of spokes 166 mounts a wheel 167 whose axis of rotation is also ninety-degrees opposed to a direction of rotation of wheel 160. Second series of wheels 167 have a slightly larger diameter than the first series 164 of wheels. Wheel 160 can rotate about an axis (not shown) perpendicular to its central hub 162. Rollers 165, 167 allow the wheels 160 to easily change direction, thus making this a suitable omni-wheel 62, 64. These types of wheels 160 are described in U.S. Pat. Appl. 2015/0130260, which is hereby incorporated by reference in its entirety. Other types of Mecanum or omni-directional wheels 62, 64 may also be used in embodiments of this disclosure.


Once the location of the robot 100 is set in the operating room, the base 106 may be locked into position. For example, the omni-directional wheels 62, 64 may be locked such that they are unable to move. In the alternative, a kickstand or other locking mechanism may be employed to prevent movement of the base 106. Once the locking mechanism is released, the base 106 is again free to move in any direction as described herein.


The advantages of this disclosure include the ability to accurately position large equipment in any desired position or direction, using the three-axis, three-degrees of freedom capabilities described above. The on-board GPS system may also be used to track the position of the equipment and to store and recall positions where the equipment is used. The unique three-axis motion capability of the omni-wheels 62, 64 includes a rotary axis, which may be chosen as desired. By using both motion control and robot control, the operator or diagnostic person can coordinate the position of the system with the patient. The precise positioning made possible by the motion control system, the encoders and the omni-wheels 62, 64 allows the system 100 to have the control and precision of a fixed, non-mobile system.


The motion control system, the sensors, the encoders and the system memory allow the system to act as a smart system. The sensors allow one to position the system as desired using the sensors and the memory. The system includes capabilities for precise, small movements for a particular procedure for a patient, as well as a transport mode, e.g., for moving to another patient or to another room. This allows users to park the system in a more convenient location and then to recall the system to a precise location when desired. The system's memory gives users the ability to quickly and accurately recall the base 106 to a particular position when it is needed later.


Although several embodiments of the invention have been disclosed in the foregoing specification, it is understood that many modifications and other embodiments of the invention will come to mind to which the invention pertains, having the benefit of the teaching presented in the foregoing description and associated drawings. It is thus understood that the invention is not limited to the specific embodiments disclosed hereinabove, and that many modifications and other embodiments are intended to be included within the scope of the appended claims. It is further envisioned that features from one embodiment may be combined or used with the features from a different embodiment described herein. Moreover, although specific terms are employed herein, as well as in the claims which follow, they are used only in a generic and descriptive sense, and not for the purposes of limiting the described invention, nor the claims which follow. The entire disclosure of each patent and publication cited herein is incorporated by reference, as if each such patent or publication were individually incorporated by reference herein. Various features and advantages of the invention are set forth in the following claims.

Claims
  • 1. A surgical robot system comprising: a robot having a robot base, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm, the end-effector including a plurality of tracking markers detectable by at least one camera;a plurality of wheels affixed to the robot base allowing multiple-axis movement of the robot;a handle attached to the robot base;a plurality of spaced directional force sensors positioned to detect directional forces applied to the handle by the user for detecting a desired movement of the robot base; anda control system responsive to outputs from the plurality of directional force sensors for controlling the multiple-axis movement of the robot by actuating two or more of the plurality of wheelswherein eight of the plurality of spaced directional force sensors are arranged elliptically for the control system to cause movement in an x-direction.
  • 2. The surgical robot system of claim 1, wherein each of the plurality of wheels includes a central hub with a plurality of rollers mounted to the central hub.
  • 3. The surgical robot system of claim 2, wherein the plurality of rollers are mounted at an angle relative to a central axis of the central hub.
  • 4. The surgical robot system of claim 1, wherein the multiple axis movement is selected from the group consisting of: movement in a plane; movement in a 2-D coordinate system; and three axis movement in a forward-backward direction, movement in a side direction and rotation about a defined axis perpendicular to the forward-backward and side directions.
  • 5. The surgical robot system of claim 1, wherein the plurality of sensors for detecting a desired movement are selected from the group consisting of a strain gauge, force-sensing resistor, a piezoelectric sensor, a piezo capacitive pressure sensor, a piezo resistor and a microelectromechanical systems (MEMS) micro-scale strain gauge.
  • 6. The surgical robot system of claim 1, wherein the plurality of sensors for detecting a desired movement are mounted in left-and-right handles of the robot base.
  • 7. The surgical robot system of claim 1, wherein the plurality of sensors for detecting a desired movement are mounted in a joystick of the robot base, and wherein the desired movement is indicated by a movement of the joystick.
  • 8. The surgical robot system of claim 1, wherein the plurality of sensors are operable to sense a desired front left wheel force in a forward/backward direction, a desired rear left wheel force in the forward/backward direction, a desired rear left wheel force in a side direction, a desired front right wheel force in a forward/backward direction, a rear right wheel force in a side direction and a rear right wheel force in a backward/forward direction.
  • 9. The surgical robot system of claim 1, wherein the plurality of sensors comprises a sensor array mounted in a planar configuration selected from the group consisting of a generally circular array, a generally elliptical array, a generally rectangular array and a generally square array.
  • 10. The surgical robot system of claim 1, further comprising at least one motor under control of the control system for providing power to each of the plurality of wheels.
  • 11. The surgical robot system of claim 1, wherein the plurality of tracking markers in the end-effector are active markers having an active state and an inactive state, the active state emitting an infrared signal detected by the at least one camera, and the inactive state not emitting the infrared signal such that the plurality tracking markers are not detected by the at least one camera.
  • 12. The surgical robot system of claim 1, further comprising a surgical instrument having one or more tracking markers to be tracked by the robot system, the surgical instrument configured to be positioned in the end-effector in order to align the surgical instrument along a given trajectory for a surgical procedure.
  • 13. A surgical robot system comprising: a robot having a robot base, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm, the end-effector including a guide tube for receiving at least one instrument;a handle attached to the robot base;a plurality of wheels attached to the robot base allowing three-axis movement of the robot in a general area of a plane;a plurality of spaced directional force sensors positioned to detect directional forces applied to the handle by the user for detecting a desired movement of the robot base; anda control system responsive to outputs from the plurality of sensors for controlling the three-axis movement of the robot base by actuating two or more of the plurality of wheels,wherein eight of the plurality of spaced directional force sensors are arranged elliptically for the control system to cause movement in an x-direction.
  • 14. The surgical robot system of claim 13, wherein each of the plurality of wheels includes a central hub with a plurality of rollers mounted to the central hub.
  • 15. The surgical robot system of claim 13, wherein the plurality of sensors for detecting a desired movement are selected from the group consisting of a strain gauge, force-sensing resistor, a piezoelectric sensor, a piezo capacitive pressure sensor, a piezo resistor and a microelectromechanical systems (MEMS) micro-scale strain gauge.
  • 16. The surgical robot system of claim 13, further comprising a plurality of motors, one motor for each of the plurality of wheels, each motor controlled by the control system for independently powering one of the plurality of wheels.
  • 17. The surgical robot system of claim 13, wherein the plurality of sensors are operable to sense a desired front left wheel force in a forward/backward direction, a desired rear left wheel force in the forward/backward direction, a desired rear left wheel force in a side direction, a desired front right wheel force in a forward/backward direction, a rear right wheel force in a side direction and a rear right wheel force in a backward/forward direction.
  • 18. The surgical robot system of claim 13, wherein the plurality of sensors comprises a sensor array mounted in a planar configuration selected from the group consisting of a generally circular array, a generally elliptical array, a generally rectangular array and a generally square array.
  • 19. A surgical robot system comprising: a robot having a robot base and a robot arm coupled to the robot base;a handle attached to the robot base;a plurality of spaced directional force sensors positioned to detect directional forces applied to the handle by the user for detecting a desired movement of the robot base; anda plurality of omni-directional wheels affixed to the robot base adapted for multiple-axis movement of the robot, wherein each of the plurality of omni-directional wheels includes a central hub with a plurality of rollers mounted to the central hub; anda control system responsive to outputs from the plurality of sensors for controlling the multiple-axis movement of the robot by actuating two or more of the plurality of omni-directional wheels,wherein eight of the plurality of spaced directional force sensors are arranged elliptically for the control system to cause movement in an x-direction.
  • 20. The surgical robot system of claim 19, wherein the plurality of rollers are mounted at an angle to a central axis of the central hub.
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of U.S. patent application Ser. No. 15/095,883, filed Apr. 11, 2016, which is a continuation-in-part of U.S. patent application Ser. No. 14/062,707, filed on Oct. 24, 2013, which is a continuation-in-part application of U.S. patent application Ser. No. 13/924,505, filed on Jun. 21, 2013, which claims priority to provisional application No. 61/662,702 filed on Jun. 21, 2012 and claims priority to provisional application No. 61/800,527 filed on Mar. 15, 2013, all of which are incorporated by reference herein in their entireties for all purposes.

US Referenced Citations (249)
Number Name Date Kind
4150293 Franke Apr 1979 A
4511825 Klino Apr 1985 A
4697661 Pajerski et al. Oct 1987 A
5246010 Gazzara et al. Sep 1993 A
5425069 Pellegrino et al. Jun 1995 A
5598453 Baba et al. Jan 1997 A
5772594 Barrick Jun 1998 A
5987960 Messner et al. Nov 1999 A
6031888 Ivan et al. Feb 2000 A
6144875 Schweikard et al. Nov 2000 A
6203196 Meyer et al. Mar 2001 B1
6276471 Kratzenberg et al. Aug 2001 B1
6306126 Montezuma Oct 2001 B1
6314311 Williams et al. Nov 2001 B1
6320929 Von Der Haar Nov 2001 B1
6477400 Barrick Nov 2002 B1
6484049 Seeley et al. Nov 2002 B1
6487267 Wolter Nov 2002 B1
6490475 Seeley et al. Dec 2002 B1
6501981 Schweikard et al. Dec 2002 B1
6535756 Simon et al. Mar 2003 B1
6614453 Suri et al. Sep 2003 B1
6614871 Kobiki et al. Sep 2003 B1
6619840 Rasche et al. Sep 2003 B2
6666579 Jensen Dec 2003 B2
6757068 Foxlin Jun 2004 B2
6782287 Grzeszczuk et al. Aug 2004 B2
6856826 Seeley et al. Feb 2005 B2
6856827 Seeley et al. Feb 2005 B2
6871715 Diaz Carmena et al. Mar 2005 B1
6920347 Simon et al. Jul 2005 B2
6922632 Foxlin Jul 2005 B2
6988009 Grimm et al. Jan 2006 B2
6996487 Jutras et al. Feb 2006 B2
7016457 Senzig et al. Mar 2006 B1
7035716 Harris Apr 2006 B2
7043961 Pandey et al. May 2006 B2
7062006 Pelc et al. Jun 2006 B1
7063705 Young et al. Jun 2006 B2
7072707 Galloway, Jr. et al. Jul 2006 B2
7099428 Clinthorne et al. Aug 2006 B2
7108421 Gregerson et al. Sep 2006 B2
7130676 Barrick Oct 2006 B2
7139418 Abovitz et al. Nov 2006 B2
7194120 Wicker et al. Mar 2007 B2
7197107 Arai et al. Mar 2007 B2
7231014 Levy Jun 2007 B2
7231063 Naimark et al. Jun 2007 B2
7301648 Foxlin Nov 2007 B2
7313430 Urquhart et al. Dec 2007 B2
7318805 Schweikard et al. Jan 2008 B2
7324623 Heuscher et al. Jan 2008 B2
7327865 Fu et al. Feb 2008 B2
7460637 Clinthorne et al. Dec 2008 B2
7493153 Ahmed et al. Feb 2009 B2
7505617 Fu et al. Mar 2009 B2
7623902 Pacheco Nov 2009 B2
7643862 Schoenefeld Jan 2010 B2
7661881 Gregerson et al. Feb 2010 B2
7683331 Chang Mar 2010 B2
7683332 Chang Mar 2010 B2
7702379 Avinash et al. Apr 2010 B2
7702477 Tuemmler et al. Apr 2010 B2
7711083 Heigl et al. May 2010 B2
7725253 Foxlin May 2010 B2
7726171 Langlotz et al. Jun 2010 B2
7760849 Zhang Jul 2010 B2
7796728 Bergfjord Sep 2010 B2
7813838 Sommer Oct 2010 B2
7835778 Foley et al. Nov 2010 B2
7835784 Mire et al. Nov 2010 B2
7840256 Lakin et al. Nov 2010 B2
7844320 Shahidi Nov 2010 B2
7853305 Simon et al. Dec 2010 B2
7853313 Thompson Dec 2010 B2
7900524 Calloway et al. Mar 2011 B2
7940999 Liao et al. May 2011 B2
7945012 Ye et al. May 2011 B2
7945021 Shapiro et al. May 2011 B2
8019045 Kato Sep 2011 B2
8021310 Sanborn et al. Sep 2011 B2
8052688 Wolf, II Nov 2011 B2
8086299 Adler et al. Dec 2011 B2
8098914 Liao et al. Jan 2012 B2
8100950 St. Clair et al. Jan 2012 B2
8116430 Shapiro et al. Feb 2012 B1
8121249 Wang et al. Feb 2012 B2
8150494 Simon et al. Apr 2012 B2
8208708 Homan et al. Jun 2012 B2
8224024 Foxlin et al. Jul 2012 B2
8311611 Csavoy et al. Nov 2012 B2
8335557 Maschke Dec 2012 B2
8358818 Miga et al. Jan 2013 B2
8379791 Forthmann et al. Feb 2013 B2
8386019 Camus et al. Feb 2013 B2
8394099 Patwardhan Mar 2013 B2
8442738 Patmore May 2013 B2
8462911 Vesel et al. Jun 2013 B2
8526700 Isaacs Sep 2013 B2
8541970 Nowlin et al. Sep 2013 B2
8560118 Green et al. Oct 2013 B2
8597198 Sanborn et al. Dec 2013 B2
8611985 Lavallee et al. Dec 2013 B2
8630389 Kato Jan 2014 B2
8634897 Simon et al. Jan 2014 B2
8660635 Simon et al. Feb 2014 B2
8676420 Kume et al. Mar 2014 B2
8678647 Gregerson et al. Mar 2014 B2
8696458 Foxlin et al. Apr 2014 B2
8706185 Foley et al. Apr 2014 B2
8727618 Maschke et al. May 2014 B2
8738115 Amberg et al. May 2014 B2
8740882 Jun et al. Jun 2014 B2
8781186 Clements et al. Jul 2014 B2
8781630 Banks et al. Jul 2014 B2
8787520 Baba Jul 2014 B2
8792704 Isaacs Jul 2014 B2
8798231 Notohara et al. Aug 2014 B2
8812077 Dempsey Aug 2014 B2
8814793 Brabrand Aug 2014 B2
8818105 Myronenko et al. Aug 2014 B2
8821511 Von Jako et al. Sep 2014 B2
8867703 Shapiro et al. Oct 2014 B2
8888821 Rezach et al. Nov 2014 B2
8964934 Ein-Gal Feb 2015 B2
8992580 Bar et al. Mar 2015 B2
8996169 Lightcap et al. Mar 2015 B2
9001963 Sowards-Emmerd et al. Apr 2015 B2
9002076 Khadem et al. Apr 2015 B2
9044190 Rubner et al. Jun 2015 B2
9107683 Hourtash et al. Aug 2015 B2
9125556 Zehavi et al. Sep 2015 B2
9131986 Greer et al. Sep 2015 B2
9215968 Schostek et al. Dec 2015 B2
9308050 Kostrzewski et al. Apr 2016 B2
9380984 Li et al. Jul 2016 B2
9393039 Lechner et al. Jul 2016 B2
9398886 Gregerson et al. Jul 2016 B2
9398890 Dong et al. Jul 2016 B2
9414859 Ballard et al. Aug 2016 B2
9420975 Gutfleisch et al. Aug 2016 B2
9492235 Hourtash et al. Nov 2016 B2
9554953 Dirauf et al. Jan 2017 B2
9592096 Maillet et al. Mar 2017 B2
9750465 Engel et al. Sep 2017 B2
9757203 Hourtash et al. Sep 2017 B2
9795354 Menegaz et al. Oct 2017 B2
9814535 Bar et al. Nov 2017 B2
9820783 Donner et al. Nov 2017 B2
9833265 Donner et al. Nov 2017 B2
9848922 Tohmeh et al. Dec 2017 B2
9925011 Gombert et al. Mar 2018 B2
9931025 Graetzel et al. Apr 2018 B1
10034717 Miller et al. Jul 2018 B2
20010036302 Miller Nov 2001 A1
20030055049 Kath et al. Mar 2003 A1
20030153829 Sarin et al. Aug 2003 A1
20040024311 Quaid, III Feb 2004 A1
20040076259 Jensen et al. Apr 2004 A1
20050245820 Sarin Nov 2005 A1
20060184396 Dennis et al. Aug 2006 A1
20060291612 Nishide et al. Dec 2006 A1
20070038059 Sheffer et al. Feb 2007 A1
20070073133 Schoenefeld Mar 2007 A1
20080004523 Jensen Jan 2008 A1
20080013809 Zhu et al. Jan 2008 A1
20080082109 Moll et al. Apr 2008 A1
20080108991 Von Jako May 2008 A1
20080144906 Allred et al. Jun 2008 A1
20080161680 Von Jako et al. Jul 2008 A1
20080235052 Node-Langlois et al. Sep 2008 A1
20080269596 Revie et al. Oct 2008 A1
20080287781 Revie et al. Nov 2008 A1
20080300477 Lloyd et al. Dec 2008 A1
20080302950 Park et al. Dec 2008 A1
20080306490 Lakin et al. Dec 2008 A1
20080319311 Hamadeh Dec 2008 A1
20090185655 Koken et al. Jul 2009 A1
20090198121 Hoheisel Aug 2009 A1
20100022874 Wang et al. Jan 2010 A1
20100039506 Sarvestani et al. Feb 2010 A1
20100125286 Wang et al. May 2010 A1
20100143089 Hvass Jun 2010 A1
20100228117 Hartmann Sep 2010 A1
20100274120 Heuscher Oct 2010 A1
20110098553 Robbins et al. Apr 2011 A1
20110282189 Graumann Nov 2011 A1
20110286573 Schretter et al. Nov 2011 A1
20120035507 George et al. Feb 2012 A1
20120051498 Koishi Mar 2012 A1
20120143084 Shoham Jun 2012 A1
20120226145 Chang et al. Sep 2012 A1
20120235909 Birkenbach et al. Sep 2012 A1
20120294498 Popovic Nov 2012 A1
20130016889 Myronenko et al. Jan 2013 A1
20130060146 Yang et al. Mar 2013 A1
20130094742 Feilkas Apr 2013 A1
20130113791 Isaacs et al. May 2013 A1
20130165937 Patwardhan Jun 2013 A1
20130281821 Liu et al. Oct 2013 A1
20130307955 Deitz et al. Nov 2013 A1
20130342578 Isaacs Dec 2013 A1
20130345718 Crawford et al. Dec 2013 A1
20130345757 Stad Dec 2013 A1
20140046132 Hoeg et al. Feb 2014 A1
20140049629 Siewerdsen et al. Feb 2014 A1
20140066944 Taylor et al. Mar 2014 A1
20140080086 Chen Mar 2014 A1
20140096369 Matsumoto et al. Apr 2014 A1
20140121676 Kostrzewski et al. May 2014 A1
20140135796 Simon et al. May 2014 A1
20140130810 Azizian et al. Aug 2014 A1
20140221819 Sarment Aug 2014 A1
20140234804 Huang et al. Aug 2014 A1
20140275955 Crawford et al. Sep 2014 A1
20140371577 Maillet et al. Dec 2014 A1
20140379130 Lee et al. Dec 2014 A1
20150039034 Frankel et al. Feb 2015 A1
20150051519 Morbi Feb 2015 A1
20150085970 Bouhnik et al. Mar 2015 A1
20150146847 Liu May 2015 A1
20150150524 Yorkston et al. Jun 2015 A1
20150196261 Funk Jul 2015 A1
20150213633 Chang et al. Jul 2015 A1
20150216746 Dirauf Aug 2015 A1
20150335480 Alvarez et al. Nov 2015 A1
20150342647 Frankel et al. Dec 2015 A1
20160005194 Schretter et al. Jan 2016 A1
20160113728 Piron Apr 2016 A1
20160166329 Langan et al. Jun 2016 A1
20160235480 Scholl et al. Aug 2016 A1
20160249990 Glozman et al. Sep 2016 A1
20160302871 Gregerson et al. Oct 2016 A1
20160320322 Suzuki Nov 2016 A1
20160331335 Gregerson et al. Nov 2016 A1
20170135770 Scholl et al. May 2017 A1
20170143284 Sehnert et al. May 2017 A1
20170143426 Isaacs et al. May 2017 A1
20170156816 Ibrahim Jun 2017 A1
20170202629 Maillet et al. Jul 2017 A1
20170212723 Atarot et al. Jul 2017 A1
20170215825 Johnson et al. Aug 2017 A1
20170215826 Johnson et al. Aug 2017 A1
20170215827 Johnson et al. Aug 2017 A1
20170231710 Scholl et al. Aug 2017 A1
20170258426 Risher-Kelly et al. Sep 2017 A1
20170273748 Hourtash et al. Sep 2017 A1
20170296277 Hourtash et al. Oct 2017 A1
20170360493 Zucher et al. Dec 2017 A1
Foreign Referenced Citations (7)
Number Date Country
0744633 Nov 1996 EP
2286729 Feb 2011 EP
898843 Apr 1996 JP
8313304 Nov 1996 JP
2008538184 Oct 2008 JP
02071369 Sep 2002 WO
2012018816 Feb 2012 WO
Non-Patent Literature Citations (3)
Entry
Edward Ramsden, Hall Effect Sensors; Theory and Application (2nd Edition), pp. 107-130, http://store.elsevier.com/Hall-Effect-Sensors/Edward-Ramsden/isbn-9780080523743/. Feb. 28, 2006.
Shuanghui, Hao et al., Study on a novel absolute magnetic encoder, Robotice and Biomemetics, 2009, ROBIO, 2009. IEEE, International Conference On IEEE. pp. 1773-1776, Feb. 22, 2009.
Eric M. Yeatmann et al., “Use of Scanned Detection in Optical Position Encoders”, IEEE, Transactions of Instrumentation and Measurement. vol. 53, No. 1, pp. 37-44. http://www3.imperial.ac.uk/pls/portallive/docs/1/375913.PDF. Feb. 28, 2004.
Related Publications (1)
Number Date Country
20190046281 A1 Feb 2019 US
Provisional Applications (2)
Number Date Country
61800527 Mar 2013 US
61662702 Jun 2012 US
Continuations (1)
Number Date Country
Parent 15180135 Jun 2016 US
Child 16161672 US
Continuation in Parts (3)
Number Date Country
Parent 15095883 Apr 2016 US
Child 15180135 US
Parent 14062707 Oct 2013 US
Child 15095883 US
Parent 13924505 Jun 2013 US
Child 14062707 US